Submit a talk on data

Submit a talk on data

Submit talks on data engineering, data science, machine learning, big data and analytics through the year – 2019

Amir Nagri

@amir

Realtime System Uptime Tracking for 2M req/min

Submitted Feb 26, 2018

@GO-JEK, we serve more than 3M+ customers daily. This involves rigorous discipline around system reliability and availability. One of the tools that helps us achieve this goal is our Realtime System Uptime Tracking.

Outline

  • Vanilla ELK stack and its shortcomings
  • Moving logs to Kafka
  • Realtime aggregation using Flink
  • Scaling InfluxDB
  • Scaling Elastic Search
  • Monitoring and Alerting using Grafana
  • Advantages over ELK

Speaker bio

Amir works as Data Engineer@GO-JEK. He has donned many hats, and currently loves working on distributed systems and problems involving data and scaling.

Comments

{{ gettext('Login to leave a comment') }}

{{ gettext('Post a comment…') }}
{{ gettext('New comment') }}
{{ formTitle }}

{{ errorMsg }}

{{ gettext('No comments posted yet') }}

Hosted by

Jump starting better data engineering and AI futures