Rootconf Mini 2024 (on 22nd & 23rd Nov)

Geeking out on systems and security since 2012

Anirudh Singh

@perseus

Powering Real-Time Gameplay at Scale: Managing Cassandra in Production at Quizizz

Submitted Oct 29, 2024

Abstract

Operating Cassandra at scale for mission-critical workloads presents unique challenges. This talk explores the strategies we use at Quizizz to maintain a resilient Cassandra cluster for real-time gameplay, ensuring high availability and low latency. We discuss architectural considerations for building a scalable, fault-tolerant infrastructure, with a focus on data modeling, performance monitoring, and optimization.

At Quizizz, we ingest a billion question responses every month with each response then being used for real-time aggregation and getting a birds eye view for everyone in a school.

We cover data modeling techniques for balanced partitioning, compaction strategies for performance improvement, monitoring practices to identify bottlenecks, and performance tuning for real-time demands. Additionally, we share lessons learned on integrating Cassandra into a distributed architecture with resilience and reliability as the focus.

Key Takeways

  • Strategies for Cassandra data modeling, partitioning, and compaction to ensure consistent performance
  • Techniques for mitigating split-brain scenarios and conducting repairs to ensure data consistency with Cassandra Reaper.
  • Approaches to prevent tombstone buildup and optimize bulk read performance.
  • Methods for leveraging Change Data Capture (CDC) for analytics in a large-scale environment.

Audience

  • Engineers and Architects developing high-throughput, low-latency applications with high availability requirements.
  • Site Reliability Engineers (SREs) and Platform Engineers managing Cassandra or similar NoSQL databases in production.

Comments

{{ gettext('Login to leave a comment') }}

{{ gettext('Post a comment…') }}
{{ gettext('New comment') }}
{{ formTitle }}

{{ errorMsg }}

{{ gettext('No comments posted yet') }}

Hosted by

We care about site reliability, cloud costs, security and data privacy

Supported by

Platinum Sponsor

Nutanix is a global leader in cloud software, offering organizations a single platform for running apps and data across clouds.

Platinum Sponsor

PhonePe was founded in December 2015 and has emerged as India’s largest payments app, enabling digital inclusion for consumers and merchants alike.

Silver Sponsor

The next-gen analytics engine for heavy workloads.

Sponsor

Community sponsor

Peak XV Partners (formerly Sequoia Capital India & SEA) is a leading venture capital firm investing across India, Southeast Asia and beyond.

Venue host - Rootconf workshops

Thoughtworks is a pioneering global technology consultancy, leading the charge in custom software development and technology innovation.

Community Partner

FOSS United is a non-profit foundation that aims at promoting and strengthening the Free and Open Source Software (FOSS) ecosystem in India. more

Community Partner

A community of Rust language contributors and end-users from Bangalore. We have presence on the following telegram channels https://t.me/RustIndia https://t.me/fpncr LinkedIn: https://www.linkedin.com/company/rust-india/ Twitter (not updated frequently): https://twitter.com/rustlangin more