Managing your Logging Infrastructure
Submitted by Aravind Putrevu (@aravindputrevu) on Friday, 7 December 2018
Monitoring is a simple task, but with the right tools it is not a hard task. However, events like Black Friday/Big Billion Day can push your application to the limit, and even cause crashes.
As the system is stressed, it is a lot more logs, which may crash the monitoring system as well. In this talk I will walk through the best practices when using the Elastic Stack to centralize and monitor your logs/metrics/apm data. I will also share some tricks to help you with the huge increase of typical traffic on events like Big Billion Day.
- Monitoring architectures
- Optimal bulk size
- Distributing the load
- Index and shard size
- Optimizing disk IO
Key Takeaway: best practices when building a monitoring system with the Elastic Stack, advanced tuning to optimize and increase ingest performance.
Aravind is passionate about evangelising technology, meeting developers and helping in solving their problems. He is a backend developer and has seven years of development experience.
Currently he works at Elastic as Developer Advocate and looks after the Developer Relation function of India. Previously, He worked at McAfee Antivirus as a Sr. Software Engineer in Cloud Security Domain. He has deep interest in Search, Machine Learning, Security Incident Analysis and IoT tech. In his free time, he plays around Raspi or a Arduino.