Spark as a Platform to Support Mult-tenancy and All Kinds of Data Applications

A session at Spark Summit 2015

  • Kelvin Chu

Tuesday 16th June, 2015

3:00pm to 3:30pm

Uber is running businesses in 279 cities across 53 countries. In US, we covers 64% of the population. Every month, we created 50,000 driver jobs. Every day, we facilitates 1+ million trips globally. Uber has over ten engineering, business and data scientists teams which run all kinds of different data applications with all sorts of different performance characteristics and SLA. In this talk, we will present how we design and build this multi-tenancy architecture by Spark as a Platform while we scale our cluster size rapidly to match our business growth. We will discuss how we are leveraging Spark, SparkSQL, Spark Streaming, MLlib and IPython Notebook with Spark to build data applications efficiently in this shared environment. We will show why Spark make it a lot easier and we will also share our lessons from this on-going journey.

About the speaker

This person is speaking at this event.
Kelvin Chu

Sign in to add slides, notes or videos to this session

Tell your friends!


Time 3:00pm3:30pm PST

Date Tue 16th June 2015

Short URL


Official event site


View the schedule


See something wrong?

Report an issue with this session