Sessions at OSCON Data 2011 about Big Data

Tuesday 26th July 2011

• Taming the Big Data Fire Hose

  by John Hugg

  In this talk, we will introduce a simple formula for all Big Data applications: Big Data = Fast Data + Deep Data. Through a use-case format, we will discuss the specialized requirements for real-time (“fast”) and analytic (“deep”) data management.

  • Big Data

  At 10:40am to 11:20am, Tuesday 26th July

  In C121/122, Oregon Convention Center

• The Big Data Ecosystem at LinkedIn

  by Jay Kreps

  The last few years have brought a wealth of new data technologies organized around horizontal scalability. This talk will cover the essential infrastructure areas: real-time stream processing, offline data crunching, large-scale data deployments and live serving. The focus will be on how these ingredients come together to enable innovative data-driven products at LinkedIn.

  • Big Data
  • LinkedIn

  At 10:40am to 11:20am, Tuesday 26th July

  In B118-119, Oregon Convention Center

  Coverage slide deck video

• LexisNexis HPCC Systems Finds Health Care Fraud

  by Bill Fox

  A big data case study with the NY Medicaid Inspector General's Office and HPCC Systems from LexisNexis.

  • Big Data

  At 11:30am to 12:10pm, Tuesday 26th July

  In C125/126, Oregon Convention Center

• Castle: Reinventing Storage for Big Data

  by Tom Wilkie

  The standard Linux storage stack wasn't designed for write-heavy big data workloads, nor is it well-suited to modern hardware: large, slow SATA disks, SSDs or many cores. Castle, an open-source project, is a ground-up overhauling of RAID, file systems, and the POSIX interface.

  • Big Data

  At 1:30pm to 2:10pm, Tuesday 26th July

  In C121/122, Oregon Convention Center

  Coverage slide deck

• Big Data For Less – Dealing with Large Data Sets on a Startup’s Budget

  by kate matsudaira

  Building large data applications can present a unique set of technical challenges because things that often work well in the conventional development environment can become incredibly arduous or expensive when applied on a much bigger scale. This talk will cover some of those challenges and potential solutions for each.

  • Big Data

  At 2:20pm to 3:00pm, Tuesday 26th July

  In C123, Oregon Convention Center

• Lean Big Data for Mobile

  by Erik Onnen

  This talk will cover lessons learned in building Urban Airship's large-scale data warehouse in EC2 including PostgreSQL, Kafka, Cassandra, HBase and Hadoop.

  • Big Data
  • Cassandra
  • Hadoop
  • PostgreSQL
  • Urban Airship

  At 2:20pm to 3:00pm, Tuesday 26th July

  In B118-119, Oregon Convention Center

Wednesday 27th July 2011

• The Hitchhiker’s Guide to A Kaggle Competition

  by Krishna Sankar

  Algorithms are getting raunchier, tools more potent and competitions more intimate! Let us mix analytics tools (like R & Mahout) and a dash of algorithmics to work on BigData Analytics competitions and see if the answer is always 42. In the process we will explore and apply a few good algorithms, to the Heritage Health competition …

  • Big Data

  At 1:40pm to 3:10pm, Wednesday 27th July

  In Oregon Ballroom 203, Oregon Convention Center

  Coverage slide deck