How to boost 100x performance for real world application w/ Apache Spark

A session at Spark Summit 2015

Monday 15th June, 2015

3:00pm to 3:30pm

With the bloom of Apache spark, various big data applications shift to Spark pool to pursue better user experience. However the initial performance doesn't always meet expectation. In this talk, we will share our experience on working with several top China internet companies to build their next generation big data engine on Spark - including graph analysis, interactive, batch OLAP/BI and real-time analytics. With careful tuning, Spark brought x5-100 speedup versus their original Map Reduce implements. We even accumulated certain experience to further improve the user experience from building real-world Spark application in production environment. We expect this talk will be very useful for people who want to deploy their own spark application and also spark developers who are interested to learn some real case challenges.

About the speakers

This person is speaking at this event.
Grace Huang

Engineering Manager at Intel Corporation bio from LinkedIn

This person is speaking at this event.
jiangang duan

manager of cloud and big data engineering team at intel bio from LinkedIn

Sign in to add slides, notes or videos to this session

Tell your friends!


Time 3:00pm3:30pm PST

Date Mon 15th June 2015

Short URL


Official event site


View the schedule


See something wrong?

Report an issue with this session