Rootconf 2019
Rootconf For members

Rootconf 2019

On infrastructure security, DevOps and distributed systems.

Tickets

Loading…

##About Rootconf 2019:
The seventh edition of Rootconf is a two-track conference with:

  1. Security talks and tutorials in audi 1 and 2 on 21 June.
  2. Talks on DevOps, distributed systems and SRE in audi 1 and audi 2 on 22 June.

##Topics and schedule:
View full schedule here: https://hasgeek.com/rootconf/2019/schedule

Rootconf 2019 includes talks and Birds of Feather (BOF) sessions on:

  1. OSINT and its applications
  2. Key management, encryption and its costs
  3. Running a bug bounty programme in your organization
  4. PolarDB architecture as Cloud Native Architecture, developed by Alibaba Cloud
  5. Vitess
  6. SRE and running distributed teams
  7. Routing security
  8. Log analytics
  9. Enabling SRE via automated feedback loops
  10. TOR for DevOps

##Who should attend Rootconf?

  1. DevOps programmers
  2. DevOps leads
  3. Systems engineers
  4. Infrastructure security professionals and experts
  5. DevSecOps teams
  6. Cloud service providers
  7. Companies with heavy cloud usage
  8. Providers of the pieces on which an organization’s IT infrastructure runs -- monitoring, log management, alerting, etc
  9. Organizations dealing with large network systems where data must be protected
  10. VPs of engineering
  11. Engineering managers looking to optimize infrastructure and teams

For information about Rootconf and bulk ticket purchases, contact info@hasgeek.com or call 7676332020. Only community sponsorships available.

##Rootconf 2019 sponsors:

#Platinum Sponsor
CRED

#Gold Sponsors
Atlassian Endurance Trusting Social

#Silver Sponsors
Digital Ocean GO-JEK Paytm

#Bronze Sponsors
MySQL sumo logic upcloud
platform sh nilenso CloudSEK

#Exhibition Sponsor
FreeBSD Foundation

#Community Sponsors
Ansible PlanetScale

Hosted by

Rootconf
Rootconf
Rootconf is a community-funded platform for activities and discussions on the following topics: Site Reliability Engineering (SRE). Infrastructure costs, including Cloud Costs - and optimization. Security - including Cloud Security. more
All submissions

Regunath Balasubramanian

@regunathb

Data handling patterns for diverse needs of Consistency, Scale, Low Latency and Analytics Injestion

Submitted Apr 5, 2019

Large internet companies have rich data, gathered from user interactions and transactions. The user transactions are often served by custom built data stores and solutions targeting needs of Consistency and/or Scale & Low Latency. There is no one-size-fits-all solution for diverse needs of eCommerce applications at Flipkart, such as:

  • Strong consistency and highly durable data stores for requirements like Payments, Orders that scale to thousands of transactions per second
  • Low Latency look-up data stores that scale to millions of requests per second, while managing hot-spotting on subset of the data corpus
  • Timeline consistent view of data across multiple distributed systems such as Search and Pricing
  • Reliably injest/transport data from transactional systems to Analytics platforms

This talk will present the following Data handling patterns:

  • Replica management for Consistent & Partition Tolerant (CP in CAP terminology) data stores
  • Command and Query Responsibility Separation (CQRS) to handle high throughout writes and virtual buckets based replication to manage read hot-spotting on subset of the data corpus
  • Data pre-compute and Time-travel to create Timeline consistent view of data across multiple distributed systems
  • Data sourcing from Database replication mechanisms, Local transactions and async relaying to Analytics platform
  • By-passing network bottlenecks like centralized Load-balancers by instead using data-placement-aware smart local proxies/sidecars

I will share system design and underlying technology details on how these patterns have been used at Flipkart.

Outline

  • Discuss diverse data needs at Flipkart - Consistent, Low Latency, Scale and Analytics
  • Further characterize the requirements into logical solutions while acknowledging formal constraints like the CAP theorem
  • Assess available landscape of data stores, their strengths and shortcomings
  • Introduce patterns and custom solutions to each of the requirements identified
  • Discuss design and underlying technology stack in implementing the patterns and solutions

Requirements

Prior experience designing, building systems of reasonable scale and an appreciation of related data handling problems.

Speaker bio

Regunath works as Principal Architect at Flipkart where he leads system readiness and scaling for large events like the Big Billion Days. He is an Open Source developer and his work can be found here : https://github.com/regunathb

All submissions

Comments

{{ gettext('Login to leave a comment') }}

{{ gettext('Post a comment…') }}
{{ gettext('New comment') }}
{{ formTitle }}

{{ errorMsg }}

{{ gettext('No comments posted yet') }}

Register

Hosted by

Rootconf
Rootconf
Rootconf is a community-funded platform for activities and discussions on the following topics: Site Reliability Engineering (SRE). Infrastructure costs, including Cloud Costs - and optimization. Security - including Cloud Security. more