Wednesday 28th September, 2016
4:35pm to 5:15pm
Swisscom is not only the leading mobile service provider in Switzerland, but a provider of data-driven intelligence, through the analysis of the data created by its mobile network. Its Mobility Insights team works to help civil administrators, tourism and marketing professionals, and many others to understand the flow of people through their locations of interest. This talk will go over the platform, tooling and choices that help achieve this service, before drilling down on the task of understanding the speeds of populations through a path of interest.
We will explain the design of some Swisscom’s big data infrastructure, in which Scala, Kafka and Apache Spark feature as pivotal tools. The tour will focus on the multiple components that allow a unified and reliable access to the high-throughput data flowing from the telecommunication network, and leads to a single platform that lets engineers answer heterogeneous questions quickly. We will also explain the technical challenges of moving into real-time analysis and fast data, a key feature of our speed measurement task.
We will show possible solutions to technical challenges such as selecting interesting datapoints out of a millions coming in every second, sessionizing when no batch interval seems to make clear sense, and the importance of checking ground truth.
Finally, we’ll insist on how privacy protection — a crucial point to Swisscom and the Mobility Insights team — is constitutive of both the data filtering and the questions the team chooses to tackle.
Sign in to add slides, notes or videos to this session