A Journey of Building Dream11's Data Platform
Dream11 is India’s biggest fantasy sports platform that allows users to play fantasy cricket, hockey, football, kabaddi and basketball.
Our total user base is over 70 million and expected to cross 100 million by end of 2019.
2019 IPL, Dream11 served 2.4M concurrent users, 2200/sec contest joins, 5k/sec team save/edits.
On a data size front, we are generating 2TB per day transactional and events data volume.
We started small in 2008 and grew exponentially every year, we would like to share our journey of building day1 startup data platform to a more scalable data platform aligned with our growth pattern supporting real time operational and batch analytics use cases.
- Day 1 Startup Data Pipeline for Analytics
- Data Collection Framework
- Data Lake Architecture
- Integrated Data Warehouse
- Real Time Analytics and Alerting
- Data Quality
Pradip has been in Data Engineering space for 12+ years and currently working as an Architect - Data Engineering at Dream11. Throughout the years, he has worked extensively on bulding real time, batch data analytics pipelines and Data Warehouse implementations in traditional and modern big data platforms on both on-premises and on the cloud. He has a Masters from BIT’s Pilani, Rajasthan.
Deep Learning powered Genomic Research
The event disease happens when there is a slip in the finely orchestrated dance between physiology, environment and genes. Treatment with chemicals (natural, synthetic or combination) solved some diseases but others persisted and got propagated along the generations. Molecular basis of disease became prime center of studies to understand and to analyze root cause. Cancer also showed a way that or… more