Loading…
Apache: Big Data Europe 2016
Click here to Register or for more information 
Tuesday, November 15 • 09:30 - 09:50
Keynote: Hadoop Infrastructure @Uber Past, Present and Future - Mayank Bansal, Sr. Engineer, Uber

Sign up or log in to save this to your schedule, view media, leave feedback and see who's attending!

Uber’s mission is to provide transportation as reliable as running water and for fulfilling that mission data plays a critical role. In Uber, Hadoop plays a critical role in Data Infrastructure. We want to talk about the journey of Hadoop @Uber and our future plans in terms of scaling for billions of trips. We will talk about most unique use case Uber have and how Hadoop and eco system which we built, helped us in this journey. We want to talk about how we scaled from 10 -> 1000 and In future with help of Apache Mesos, Myriad and Hadoop to scale up to 10’s X1000 of Nodes. We will talk about our mistakes, learning and wins and how we process billions of events per day. We will talk about the unique challenges and real world use-cases and how we will co-locate the Uber’s service architecture with batch (e.g data pipelines, machine learning and analytical workloads).

Speakers
avatar for Mayank Bansal

Mayank Bansal

Staff Engineer, Uber
Mayank Bansal is currently working as a Staff engineer at Uber in data infrastructure team. He is co-author of Peloton. He is Apache Hadoop Committer and Oozie PMC and Committer. Previously he was working at ebay in hadoop platform team leading YARN and MapReduce effort. Prior to... Read More →



Tuesday November 15, 2016 09:30 - 09:50 CET
Giralda I/II