Present and future of unified, portable and efficient data processing with Apache Beam

Present and future of unified, portable and efficient data processing with Apache Beam

Wednesday, April 18
2:00 PM - 2:40 PM
Room III

The world of big data involves an ever-changing field of players. Much as SQL stands as a lingua franca for declarative data analysis, Apache Beam aims to provide a portable standard for expressing robust, out-of-order data processing pipelines in a variety of languages across a variety of platforms. In a way, Apache Beam is a glue that can connect the big data ecosystem together; it enables users to "run any data processing pipeline anywhere."

This talk will briefly cover the capabilities of the Beam model for data processing and discuss its architecture, including the portability model. We’ll focus on the present state of the community and the current status of the Beam ecosystem. We’ll cover the state of the art in data processing and discuss where Beam is going next, including completion of the portability framework and the Streaming SQL. Finally, we’ll discuss areas of improvement and how anybody can join us on the path of creating the glue that interconnects the big data ecosystem.

Presentation Video

SPEAKERS

Davor Bonaci
V.P. of Apache Beam; Founder/CEO at Operiant
Apache Software Foundation; Simbly
Davor is serving as a chair of the Apache Beam Project Management Committee, and is a CEO of Operiant, a company he founded that helps users get Big Data to production. He was previously a software engineer at Google where he worked on Google Cloud Dataflow, the predecessor to Apache Beam, since its beginnings.