Migrating your clusters and workloads from Hadoop 2 to Hadoop 3

Migrating your clusters and workloads from Hadoop 2 to Hadoop 3

Tuesday, June 19
2:50 PM - 3:30 PM
Meeting Room 211A/B/C/D

The Hadoop community announced Hadoop 3.0 GA in December, 2017 and 3.1 around April, 2018 loaded with a lot of features and improvements. One of the biggest challenges for any new major release of a software platform is its compatibility. Apache Hadoop community has focused on ensuring wire and binary compatibility for Hadoop 2 clients and workloads.

There are many challenges to be addressed by admins while upgrading to a major release of Hadoop. Users running workloads on Hadoop 2 should be able to seamlessly run or migrate their workloads onto Hadoop 3. This session will be deep diving into upgrade aspects in detail and provide a detailed preview of migration strategies with information on what works and what might not work. This talk would focus on the motivation for upgrading to Hadoop 3 and provide a cluster upgrade guide for admins and workload migration guide for users of Hadoop.


Suma Shivaprasad
Staff Engineer
Hortonworks INC
Software Engineer at Hortonworks and PMC for Apache Atlas and Apache Lens. Full-time contributor to Apache YARN and Hadoop.
Senior Software Engineer
Rohith Sharma K S is member of Project Management Committee for Apache Hadoop and Senior Software Engineer at Hortonworks. Full time contributor for YARN. Most of the contributions on YARN are RM restart, HA. Since last year working on ATSv2 for making production ready and auto spawning of services on YARN. Before joining Hortonworks, working at Huawei in Hadoop team. Rohith is passionate for traveling across the globe and discovering people culture and their habitat.