Rootconf Mini 2024 (on 22nd & 23rd Nov)

Geeking out on systems and security since 2012

This video is for members only

Arpit Bhayani

Arpit Bhayani

@arpit_bhayani

How we made DiceDB a truly real-time reactive database

Submitted Oct 15, 2024

The talk will deep dive into how we built DiceDB and made it a truly real-time reactive database by eliminating polling inefficiencies. The talk will touch on the internal arch of Redis, persistent connections, and leveraging Pub/Sub patterns to enable instantaneous data flow at low latency and high throughput.

The talk will be focussed on the core design decisions of DiceDB that enabled us to build efficient query subscriptions using .WATCH commands and the inner components like query fingerprints, subscription maps, and the database watcher. The difference in user experience and ease of building will be demonstrated through a real-time leaderboard example.

Ultimately, the audience will get a solid understanding of the foundational work that makes DiceDB real-time and reactive. Some key takeaways are

  • the internal architecture of Redis
  • challenges with building 1:n fanout with poll-based system
  • how we re-architected it to make a push-based
  • key design principles behind .WATCH commands for query subscriptions and real-time data updates

This talk is ideal for backend engineers, database enthusiasts, system architects, and technical leads working on real-time, data-intensive applications. It will particularly resonate with engineers already familiar with Redis. It’s also highly relevant for developers working on large-scale distributed systems or infrastructure teams looking to optimize performance and responsiveness in high-concurrency environments.

Comments

{{ gettext('Login to leave a comment') }}

{{ gettext('Post a comment…') }}
{{ gettext('New comment') }}
{{ formTitle }}

{{ errorMsg }}

{{ gettext('No comments posted yet') }}

Hosted by

We care about site reliability, cloud costs, security and data privacy

Supported by

Platinum Sponsor

Nutanix is a global leader in cloud software, offering organizations a single platform for running apps and data across clouds.

Platinum Sponsor

PhonePe was founded in December 2015 and has emerged as India’s largest payments app, enabling digital inclusion for consumers and merchants alike.

Silver Sponsor

The next-gen analytics engine for heavy workloads.

Sponsor

Community sponsor

Peak XV Partners (formerly Sequoia Capital India & SEA) is a leading venture capital firm investing across India, Southeast Asia and beyond.

Venue host - Rootconf workshops

Thoughtworks is a pioneering global technology consultancy, leading the charge in custom software development and technology innovation.

Community Partner

FOSS United is a non-profit foundation that aims at promoting and strengthening the Free and Open Source Software (FOSS) ecosystem in India. more

Community Partner

A community of Rust language contributors and end-users from Bangalore. We have presence on the following telegram channels https://t.me/RustIndia https://t.me/fpncr LinkedIn: https://www.linkedin.com/company/rust-india/ Twitter (not updated frequently): https://twitter.com/rustlangin more