Rootconf Mini 2024

Geeking out on systems and security since 2012

Tickets

Loading…

Arpit Bhayani

Arpit Bhayani

@arpit_bhayani

How we made DiceDB a truly real-time reactive database

Submitted Oct 15, 2024

The talk will deep dive into how we built DiceDB and made it a truly real-time reactive database by eliminating polling inefficiencies. The talk will touch on the internal arch of Redis, persistent connections, and leveraging Pub/Sub patterns to enable instantaneous data flow at low latency and high throughput.

The talk will be focussed on the core design decisions of DiceDB that enabled us to build efficient query subscriptions using .WATCH commands and the inner components like query fingerprints, subscription maps, and the database watcher. The difference in user experience and ease of building will be demonstrated through a real-time leaderboard example.

Ultimately, the audience will get a solid understanding of the foundational work that makes DiceDB real-time and reactive. Some key takeaways are

  • the internal architecture of Redis
  • challenges with building 1:n fanout with poll-based system
  • how we re-architected it to make a push-based
  • key design principles behind .WATCH commands for query subscriptions and real-time data updates

This talk is ideal for backend engineers, database enthusiasts, system architects, and technical leads working on real-time, data-intensive applications. It will particularly resonate with engineers already familiar with Redis. It’s also highly relevant for developers working on large-scale distributed systems or infrastructure teams looking to optimize performance and responsiveness in high-concurrency environments.

Comments

{{ gettext('Login to leave a comment') }}

{{ gettext('Post a comment…') }}
{{ gettext('New comment') }}
{{ formTitle }}

{{ errorMsg }}

{{ gettext('No comments posted yet') }}

Hybrid Access Ticket

Hosted by

We care about site reliability, cloud costs, security and data privacy