Facebook's Large Scale Monitoring System Built on HBase

A session at Strata New York 2012

  • Vinod Venkataraman
  • Liyin Tang

Wednesday 24th October, 2012

1:40pm to 2:20pm (EST)

ODS is Facebook’s internal monitoring system, which collects a variety of system and application level metrics from every server for real-time monitoring, anomaly detection, alerting and analysis.

In this talk, we’ll start by giving an overview of ODS, and go over the manageability and scalability challenges with the previous MySQL based setup. We will then discuss our motivation to choose HBase for this workload, and share a series of lessons learnt from building ODS on top of HBase, including takeaways from our attempts to scale the HBase cluster separately from the HDFS cluster, a dual-HBase architecture for high availability, migration data from MySQL to HBase, running MapReduce jobs for time-based rollup of metrics.

About the speakers

This person is speaking at this event.
Vinod Venkataraman

Software Engineer, Facebook

This person is speaking at this event.
Liyin Tang

Software Engineer, Facebook

Sign in to add slides, notes or videos to this session

Tell your friends!


Time 1:40pm2:20pm EST

Date Wed 24th October 2012

Short URL


View the schedule


See something wrong?

Report an issue with this session