A Journey to a Serverless Business Intelligence, Machine Learning and Big Data platform

A Journey to a Serverless Business Intelligence, Machine Learning and Big Data platform

Thursday, March 21
4:00 PM - 4:40 PM
Room 127-128

In this talk we will describe the journey we made with one of our customers, Volotea, to deploy a serverless Business Intelligence (BI), Machine Learning (ML) and Big Data (BD) platform on the Cloud. The new platform leverages Platform-as-a-Service (PaaS) Cloud services, and it is the result of the reengineering and extension of an existing platform based on Cloud Infrastructure-as-a-Service (IaaS) services and bare-metal systems. Managing and maintaining BI, ML and BD platforms based on bare-metal or IaaS deployments is not a straightforward task, and as size and complexity grow, we often find ourselves spending more and more time in tasks that are rather administrative, more than of a development or analytics nature. That is exactly what Volotea realized, and together we envisioned and executed a plan to lift and reengineer their platform into a new solution that leverages Microsoft Azure PaaS services. We have delivered a solution that manages to greatly reduce the administrative burden as well as the technical complexity when implementing new use cases. The new platform is based on the Microsoft Azure stack and it includes Azure Data Lake, Azure Data Lake Analytics, Azure Data Factory, Azure Machine Learning and Azure SQL Database. Join us in this talk where we will share our lessons learned and we will discuss how to plan and execute such an endeavor.

Presentation Video

SPEAKERS

Oscar Martinez Rubi
Principal Business Intelligence & Big Data Consultant
ClearPeaks
Oscar Martinez Rubi is an expert on Big Data, Business Intelligence and Data Management solutions. He currently leads the Advanced Business Analytics department at ClearPeaks where, together with his team, he works in multiple Big Data, Cloud and Advanced Analytics projects throughout various industries. Before joining ClearPeaks, Oscar was an engineer in the Netherlands eScience Center, a center specialized in Big Data for scientific projects in the Netherlands. Before that, he was the Data Manager in a scientific project leveraging the LOFAR radio-telescope. He also worked in the implementation of several data processing systems for an ESA space mission.