The Fifth Elephant 2024 Annual Conference (12th &13th July)

Outline

• Introduction (5 minutes)
• Brief overview of Dream11
• Importance of a robust data platform in fantasy sports

Initial Data Platform Setup (5 minutes)
Early challenges and requirements
Basic infrastructure and tools used

Scaling Up (5 minutes)
Growth in user base and data volume
Introduction of new technologies and architectures
Key challenges faced during scaling

Modern Data Ecosystem (10 minutes)
Current architecture and technologies
Data pipelines, storage solutions, and processing frameworks
Real-time analytics and machine learning integration

Lessons Learned and Best Practices (3 minutes)
Key takeaways from the evolution process
Best practices for building and scaling a data platform

Q&A (2 minutes)

Audience for the session
The primary audience for this session includes data engineers, data architects, and tech enthusiasts who are involved in building, maintaining, or scaling data platforms. These individuals are likely to have a foundational understanding of data infrastructure and are looking to learn from real-world implementations and challenges.

The session aims to address the common challenges organisations face in building and scaling a data platform. These include:

• Handling rapid growth in data volume and complexity
• Choosing the right technologies and architectures
• Integrating advanced analytics and machine learning

By sharing Dream11’s journey, the talk will provide insights and practical solutions to these challenges.

Scope of the session
The scope will cover the complete journey of Dream11’s data platform from its inception to its current state. This includes:

Initial setup and foundational tools
Challenges and solutions during scaling
The current advanced data ecosystem

How will participants benefit from your session?
Participants will benefit by gaining:

A clear understanding of the practical steps involved in building and scaling a data platform
Insights into the challenges faced and how they were addressed
Knowledge of the latest technologies and best practices in the data domain
Inspiration and actionable takeaways to apply to their own data platforms

Format:

Given the technical nature of the audience and the objectives:

Slides to illustrate key points and architectural diagrams
Real-world examples and case studies from Dream11
Interactive Q&A session to address specific queries from the audience
The format will ensure that the session is informative, engaging, and directly relevant to the audience’s interests and needs.