The Fifth Elephant round the year submissions for 2019

Dream11 is India’s biggest fantasy sports platform that allows users to play fantasy cricket, hockey, football, kabaddi and basketball.
Our total user base is over 70 million and expected to cross 100 million by end of 2019.

2019 IPL, Dream11 served 2.4M concurrent users, 2200/sec contest joins, 5k/sec team save/edits.
On a data size front, we are generating 2TB per day transactional and events data volume.

We started small in 2008 and grew exponentially every year, we would like to share our journey of building day1 startup data platform to a more scalable data platform aligned with our growth pattern supporting real time operational and batch analytics use cases.

Outline

• Day 1 Startup Data Pipeline for Analytics
• Data Collection Framework
• Data Lake Architecture
• Integrated Data Warehouse
• Real Time Analytics and Alerting
• Data Quality
• Learnings

Speaker bio

Pradip has been in Data Engineering space for 12+ years and currently working as an Architect - Data Engineering at Dream11. Throughout the years, he has worked extensively on bulding real time, batch data analytics pipelines and Data Warehouse implementations in traditional and modern big data platforms on both on-premises and on the cloud. He has a Masters from BIT’s Pilani, Rajasthan.