Operating a secure big data platform in a multi-cloud environment

Operating a secure big data platform in a multi-cloud environment

Wednesday, April 18
11:50 AM - 12:30 PM
Room V

The Health Cyberinfrastructure Division at the San Diego Supercomputer Center (SDSC) at the University of California, San Diego has been deploying and managing a number of big data platforms ranging from the traditional data warehouse to the more recent big data platforms leveraging Hadoop in a secure cloud platform, Sherlock Cloud, for nearly a decade. We understand the necessity to remain agile and visionary in this arena to grow with the ever-changing technological and customer requirements while simultaneously ensuring a compliant environment to secure data.

As such, during our presentation, we will speak to our more recent deployment, namely a multi-cloud, Hadoop-based data management platform and the mechanisms employed to marry best-of-breed big data technology solutions and cloud platforms to support large-scale data management and analytics within the highly secure and compliant (U.S. HIPAA-compliant) boundaries of our hybrid cloud that spans an on-premises cloud running at UC San Diego and another operating in AWS Cloud. We will further identify the challenges and lessons learned from deploying, and securely operating, a big data platform offering capabilities that include disaster recovery and business continuity across a hybrid cloud setup.

Presentation Video


Sandeep Chandra
Division Director
San Diego Supercomputer Center
Sandeep Chandra is the Director for the SDSC Health CI Division and the Executive Director for Sherlock Cloud. Since joining SDSC in 2003, he has worked on different aspects of infrastructure deployment for scientific data management, as a principal investigator and in other leadership roles across a wide range of cross-disciplinary NSF, DOE, NIH and Foundation initiatives. As the Director of the Health Cyberinfrastructure division, Sandeep Chandra provides strategic vision, direction, management and implementation of concepts and methodologies for building Sherlock’s technology platforms including Cloud computing and Big Data solutions. Sandeep brings strong knowledge of the healthcare ecosystem with deep focus in compliance including NIST, FISMA and HIPAA requirements. He led the deployment of Sherlock’s compliant services in AWS making it the first compliant, hybrid Cloud platform in academia. Sandeep holds as MS in Computer Science from North Carolina State University and has over 15 years of experience providing direct policy, business, operations, and technology advice to the leadership at federal, state and academic institutions.