Sessions at Chicago Data Summit about Logging with slides and video

Tuesday 26th April 2011

• Flume: An Introduction

  by Jonathan Hsieh

  Flume is an open-source, distributed, streaming log collection system designed for ingesting large quantities of data into large-scale data storage and analytics platforms such as Apache Hadoop. It has four goals in mind: Reliability, Scalability, Extensibility, and Manageability. Its horizontal scalable architecture offers fault-tolerant end-to-end delivery guarantees, support for low-latency event processing, provides a centralized management interface , and exposes metrics for ingest monitoring and reporting. It natively supports writing data to Hadoop's HDFS but also has a simple extension interface that allows it to write to other scalable data systems such as low-latency datastores or incremental search indexers.

  • Flume
  • Hadoop
  • Logging

  At 3:45pm to 4:30pm, Tuesday 26th April

  Coverage video slide deck