Submit a talk on data

Submit talks on data engineering, data science, machine learning, big data and analytics through the year – 2018

Realtime System Uptime Tracking for 2M req/min

Submitted by Amiruddin Nagri (@amir) on Monday, 26 February 2018

videocam_off

Technical level

Intermediate

Section

Crisp talk

Status

Submitted

Vote on this proposal

Login to vote

Total votes:  +4

Abstract

@GO-JEK, we serve more than 3M+ customers daily. This involves rigorous discipline around system reliability and availability. One of the tools that helps us achieve this goal is our Realtime System Uptime Tracking.

Outline

  • Vanilla ELK stack and its shortcomings
  • Moving logs to Kafka
  • Realtime aggregation using Flink
  • Scaling InfluxDB
  • Scaling Elastic Search
  • Monitoring and Alerting using Grafana
  • Advantages over ELK

Speaker bio

Amir works as Data Engineer@GO-JEK. He has donned many hats, and currently loves working on distributed systems and problems involving data and scaling.

Comments

  • 1
    Zainab Bawa (@zainabbawa) Reviewer 7 months ago

    Amir, we need to see draft slides and preview video to evaluate this talk.

Login with Twitter or Google to leave a comment