Loading…
This event has ended. View the official site or create your own event → Check it out
This event has ended. Create your own
Apache: Big Data Europe 2016
Click here to Register or for more information 
View analytic
Tuesday, November 15 • 12:00 - 12:50
Building Streaming Applications with Apache Apex - Thomas Weise & Chinmay Kolhatkar, DataTorrent

Sign up or log in to save this to your schedule and see who's attending!

Stream processing applications built on Apache Apex run on Hadoop clusters and typically power analytics use cases where availability, flexible scaling, high throughput, low latency and correctness are essential. These applications consume data from a variety of sources, including streaming sources like Apache Kafka, Kinesis or JMS, file based sources or databases. Processing results often need to be stored in external systems (sinks) for downstream consumers (pub-sub messaging, real-time visualization, Hive and other SQL databases etc.). Apex has the Malhar library with a wide range of connectors and other operators that are readily available to build applications. We will cover key characteristics like partitioning and processing guarantees, generic building blocks for new operators (write-ahead-log, incremental state saving, windowing etc.) and APIs for application specification.

Speakers
CK

Chinmay Kolhatkar

Chinmay is Software Engineer at DataTorrent Software, India and committer on the Apache Apex project.
avatar for Thomas Weise

Thomas Weise

Architect, DataTorrent
Thomas is Apache Apex PMC chair and architect/co-founder at DataTorrent. He has developed distributed systems, middleware and web applications since 1997. Prior to DataTorrent he was in the Hadoop Team at Yahoo! and contributed to several of the ecosystem projects.



Tuesday November 15, 2016 12:00 - 12:50
Carmona

Attendees (21)