Containerized Hadoop beyond Kubernetes

Containerized Hadoop beyond Kubernetes

Wednesday, June 20
2:50 PM - 3:30 PM
Grand Ballroom 220B

Supporting Hadoop in containers takes much more than the very primitive support Docker provides using the Storage Plugin. A production scale Hadoop deployment inside containers needs to honor anti/affinity, fault-domain and data-locality policies. Kubernetes alone, with primitives such as StatefulSets and PersitentVolumeClaims, is not sufficient to support a complex data-heavy application such as Hadoop. One needs to think about this problem more holistically across containers, networking and storage stacks. Also, constructs around deployment, scaling, upgrade etc in traditional orchestration platforms is designed for applications that have adopted a microservices philosophy, which doesn't fit most Big Data applications across the ingest, store, process, serve and visualization stages of the pipeline. Come to this technical session to learn how to run and manage lifecycle of containerized Hadoop and other applications in the data analytics pipeline efficiently and effectively, far and beyond simple container orchestration. #BigData, #NoSQL, #Hortonworks, #Cloudera, #Kafka, #Tensorflow, #Cassandra, #MongoDB, #Kudu, #Hive, #HBase

Presentation Video


Partha Seetala
Robin Systems
Partha Seetala joined Robin Systems in 2015 as Chief Technology Officer, with more than 16 years of technology and product expertise. His previous position was with Symantec’s information management business, known as Veritas, where he was Distinguished Engineer and Senior Director of Engineering. In that capacity he conceived, architected and led engineering teams to take multiple products from concept to market in the scale-out storage, distributed systems, content-aware file systems and information analytics space. He was also an adviser on multimillion-dollar product lines including NetBackup Appliance, Cluster File System, Veritas Cluster Server and Information Fabric. Earlier positions include serving as architect at a Data/Information Management startup acquired by EMC – and architect at Veritas Technologies. He holds a master’s degree in Computer Science and Engineering from the University of Minnesota.