Vaidyanathan S
@vaidyanathan
Moving your Databases to Kubernetes - Flipkart's DBaaS journey.
Submitted Sep 24, 2024
Submission type:
40 min talk
Track in which your submission fits:
Systems engineering
Abstract
When most companies talk about Kubernetes adoption, they talk about the stateless aspect. However most of them shy away from Kubernetes when it comes to the stateful part. In this talk we will explore why Flipkart chose to move to stateful K8s for databases, the challenges we faced in this journey and the road ahead.
This talk will cover some of the key technical investments Flipkart has made over the last couple of years and how some of them are shaping up in significantly improving productivity of our engineering teams.
All of the content covered in this talk is coming from real world usage of production databases on K8s stateful at a massive scale over the last 3+ years.
Key Takeaways
- Learn how to evaluate what makes sense for your Organisation’s database stack - should you continue to be on VMs or move to K8s.
- Get real insights into the many of the unexpected challenges K8s poses when you start managing large fleets of data.
- Learn about Flipkart’s Hybrid Cloud (Flipkart Cloud Platform + Google Cloud Platform) and how we view BCP-DR.
Audience
- DBAs / DBRE Engineers: Individuals who are also database wizards and would like to know how their world is quickly evolving.
- Engineering Leaders: Leaders who are responsible for taking decisions on long term technical investments, specifically on the cost vs availability or build vs buy aspects for databases.
- Cloud Architects and Engineers: Individuals who are responsible for designing, implementing, and managing cloud-based infrastructure and applications.
- Technically Curious: Anyone and everyone who is technically curious about K8s or Hybrid Cloud or Databases. This talk will attempt to cover a lot of advanced concepts in an easy to understand way.
Comments
Hybrid Access Ticket
Hosted by
We care about site reliability, cloud costs, security and data privacy
Supported by
Platinum Sponsor
Nutanix is a global leader in cloud software, offering organizations a single platform for running apps and data across clouds.
Platinum Sponsor
PhonePe was founded in December 2015 and has emerged as India’s largest payments app, enabling digital inclusion for consumers and merchants alike.
Community sponsor
Peak XV Partners (formerly Sequoia Capital India & SEA) is a leading venture capital firm investing across India, Southeast Asia and beyond.
Venue host - Rootconf workshops
Thoughtworks is a pioneering global technology consultancy, leading the charge in custom software development and technology innovation.
Community Partner
FOSS United is a non-profit foundation that aims at promoting and strengthening the Free and Open Source Software (FOSS) ecosystem in India.
more
Community Partner
A community of Rust language contributors and end-users from Bangalore. We have presence on the following telegram channels https://t.me/RustIndia https://t.me/fpncr LinkedIn: https://www.linkedin.com/company/rust-india/ Twitter (not updated frequently): https://twitter.com/rustlangin
more
Login to leave a comment
Srimitravinda Ponnada
@srimitravinda_p Editor
Hello!
Please ensure that your account is set to public at your earliest convenience.
Vaidyanathan S
@vaidyanathan Submitter
Thanks Srimitravinda, It is now public.
Zainab Bawa
@zainabbawa Editor & Promoter
Hi Vaidyanathan, thanks for this well-articulated submission. Your proposal is shortlisted for Rootconf Mini.
The next step is to add draft slides
If you have a prepared deck, add a G-Drive (view/comment only) link in the comments.
If you can share the slides by 30 September, the editors will review and share their feedback.
If you have questions about the process, reply to this thread.
Vaidyanathan S
@vaidyanathan Submitter
Thank you @zainabbawa. Acknowledged 👍🏼
Vaidyanathan S
@vaidyanathan Submitter
https://docs.google.com/presentation/d/1WAdNaTIHKwmnuy7dGQBEqNdRWZ0HhGA-8aiQHPCTIEo/edit?usp=sharing
Ravi Chandra Padmala
@neenaoffline Editor
Hey Vaidyanathan,
I'm glad there's a proposal on this topic for Rootconf. There have been a lot of developments in the space and not as much adoption, in my opinion.
I went through the slides, and the talk flows well. However, I feel like the takeaways might be a bit too high-level.
Could you consider making the focus of the talk (or a portion of it) more concrete by diving into the nuances of a specific database deployment? I'm thinking on the themes of backup-restore, upgrades, replication/HA, clustering, storage & networking setup etc.
I suspect that'll be convincing for a lot of people who are on the fence about running their databases on k8s.
Vaidyanathan S
@vaidyanathan Submitter
Hi Ravi, thanks for going through the slides and providing your feedback. I have now tried to capture some of the most common operations that engineers / dev-ops personnel would need to perform on such a system to give them a better idea of ops (slides 14 to 19) .. Kindly review and let me know if that works.
Ravi Chandra Padmala
@neenaoffline Editor
Thanks Vaidyanathan, I think this looks good.
I would suggest that you tone down the amount of content on the slides as you refine them.
I find that slides help keep the listeners focus on the key point that's being spoken about. If they're too dense, it can be difficult to identify what the key point is.
You can keep the denser version as speaker notes elsewhere perhaps.
Happy to accept this as is. So you can work on the slides at your own pace.
Vaidyanathan S
@vaidyanathan Submitter
Ack. I hope though there is alignment on the content itself ? (will rework on the condensation aspect).
Ravi Chandra Padmala
@neenaoffline Editor
I am in alignment. Give me some time to confirm with the other editors to confirm if we can accept it.