Quality for the Hadoop Zoo

Quality for the Hadoop Zoo

Thursday, June 21
12:20 PM - 1:00 PM
Meeting Room 230B

Hadoop distributions can be combination of 25+ open source projects. Enterprise adoptions have various kinds of workloads, environments with vectors like Operating systems, JDK, Database, Security, Ranger Authorization, Encryption, TDE and so on. Ensuring quality for a complex stack and the combinations can be overwhelming.

In this talk we will cover details of technologies involved in automated validation of the stack. Our testing journey begins with ingestion of commits from apache and meets the finish line as we GA the stack distribution. As we speak about this journey, we will walk through how quality is established at various stages like commit, nightly testing, pre prod and readiness. We will go over the challenges we face as we cater to several releases of major, maintenance, hot-fixes all at the same time , how we tackled them with the YARN on YARN infrastructure, using test methodologies to bring efficiencies and how LOG AI comes to the rescue. We will conclude with talk with a case study of end to end workflow test

Presentation Video


Sunitha velpula
Director of Engineering, Quality
Seasoned technology leader in Quality Engineering with a proven history of creating effective TestFrameworks and Tools, building and developing strong QE teams globally. Passionate in driving efficiencies in test certification using innovative test strategies and tools. Sunitha has been part of Hortonworks for last 5+ years and is responsible for delivering quality releases for Hadoop Storage and Compute, Ambari, Security Governance and all things Platform Certification for the full HDP Stack. Prior to Hortonworks, she has lead technical initiatives in Quality Org at Yahoo! including but not limited to developing test frameworks, lead Automation special interest group, delivered high quality technical workshops/presentations/consultations boosting adoption of newer test tools across cross functional orgs