Sessions at Open Source Bridge 2011 about map/reduce

Tuesday 21st June 2011

• Gearman: From the Worker's Perspective

  by Brian Aker

  Many people view topics like Map/Reduce and queue systems as advanced concepts that require in-depth knowledge and time consuming software setup. Gearman is changing all that by making this barrier to entry as low as possible with an open source, distributed job queuing system.

  In this talk we’ll start with problems such as:
  • Map/Reduce style problems
  • Pipeline processing
  • Scatter/gather queries
  • Asynchronous queuing of tasks
  We’ll get to the root of these problems and show how Gearman can be used to solve them efficiently. Armed with distributed architectures and examples, we will explore how to integrate these concepts into custom applications. This knowledge can greatly benefit those building scale-out, fault tolerant, and/or cloud based solutions.

  • Cloud
  • Distributed Computing
  • Gearman
  • map/reduce

  At 11:00am to 11:45am, Tuesday 21st June

  Coverage note

Thursday 23rd June 2011

• Data Warehousing 101

  by Josh Berkus

  ETL. OLAP. BIDW. ELT. M/R. MPP. Windowing. Matviews. Data Marts. Column Stores. Are you at sea in a tidal surge of arcane terminology, trying to cope with big data problems?

  While big data may be bigger today, and far more common, and while we have a lot of new tools for dealing with it, the essential practices of how to process, store, and visualize large quantities of data haven't changed very much in the last ten years. Data warehousing veteran Josh Berkus will give you a lightning tour of the techniques and tools for dealing with masses of data, including: the data processing pipeline, types of big databases, visualizing and summarizing, and tips on dealing with GB to PB. All in a friendly FAQ format.

  This talk will give you everything you never wanted to know about data warehousing but were forced to find out. Or at least enough that you can Google the rest.

  • Big Data
  • Databases
  • Graph Databases
  • map/reduce
  • XML Databases

  At 2:30pm to 3:15pm, Thursday 23rd June

  Coverage note