Loading…
Apache: Big Data Europe 2016
Click here to Register or for more information 
View analytic
Wednesday, November 16 • 11:00 - 11:50
On-Premise, UI-Driven Hadoop/Spark/Flink/Kafka/Zeppelin-as-a-service - Jim Dowling, KTH Royal Institute of Technology

Sign up or log in to save this to your schedule and see who's attending!

Since April 2016, SICS Swedish ICT has provided Hadoop/Spark/Flink/Kafka/Zeppelin-as-a-service to researchers in Sweden. We have developed a UI-driven multi-tenant platform (Apache v2 licensed) in which researchers securely develop and run their applications. Applications can be either deployed as jobs (batch or streaming) or written and run directly from Notebooks in Apache Zeppelin. All applications are run on YARN within a security framework built on project-based multi-tenancy. A project is simply a grouping of users and datasets. Datasets are first-class entities that can be securely shared between projects. Our platform also introduces a necessary condition for elasticity: pricing. Application execution time in YARN is metered and charged to projects, that also have HDFS quotas for disk usage. We also support project-specific Kafka topics that can also be securely shared.

Speakers
avatar for Jim Dowling

Jim Dowling

CEO, Logical Clocks
Jim Dowling is an Associate Professor at KTH Royal Institute of Technology in Stockholm as well as a Senior Researcher at SICS Swedish ICT. He received his Ph.D. in Distributed Systems from Trinity College Dublin (2005) and worked at MySQL AB (2005-2007). He is lead architect of Hops... Read More →


Wednesday November 16, 2016 11:00 - 11:50
Giralda III/IV

Attendees (13)