MP
Mrinal Paliwal
@mnpw
Apache Iceberg: Under the hood
Submitted Apr 20, 2025
Topic of your submission:
Distributed data systems
Type of submission:
30 mins talk
I am submitting for:
Rootconf Annual Conference 2025
Description
In this talk, we will explore the internals of Iceberg table format. We examine the past, present, and future of analytics data systems, and reason with first-principles why open table formats, such as Iceberg, exist.
The outline of the talk roughly looks like:
- Early 2010s in big data and emergence of OLAP data systems
- Advent of object storage as the universal file system
- The great disaggregation – separation of storage and compute
- Rise of open table formats
- Apache Iceberg’s mechanics and ACID compliance
Takeaway
This talk would help audience:
- Build a knack for systems thinking
- Make distributed data systems seem less scary and more approachable
- Develop mechanical sympathy and appreciate the collective effort that engineering is
Target audience
Beginner/Intermediate engineers interested in database and systems engineering
Bio
Mrinal Paliwal - Software Engineer at e6data
{{ gettext('Login to leave a comment') }}
{{ gettext('Post a comment…') }}{{ errorMsg }}
{{ gettext('No comments posted yet') }}