Nov 2024
18 Mon
19 Tue
20 Wed
21 Thu
22 Fri 09:00 AM – 05:10 PM IST
23 Sat
24 Sun
Ishika Mittal
Monitoring and collecting metrics and logs is essential for product and service improvement, particularly at scale due to the vast data size and diverse stakeholders. At e6data, we began our journey with our Gen3 Lake House native compute engine in a “Cloudprem” model. Metrics and logs are crucial for understanding customer interactions, such as query success rates and the reasons behind query failures. Currently, we utilize an open-source stack comprising Loki for logs, Mimir for metrics, and Grafana for visualization. This talk will detail our journey in leveraging Loki and Mimir to create an effective monitoring and alerting system.
KEY TAKEAWAYS:
Effective Use of Open-Source Tools: Learn how to leverage open-source technologies like Loki and Mimir to build a robust monitoring and alerting system that scales with your data needs.
Challenges of Scaling: Learn about the key challenges faced at scale regarding heavy data ingestion and reads, and strategies to effectively manage them.
AUDIENCE:
Platform engineering and DevOps engineering developers and enthusiasts working on platforms at scale, or starting their journey towards it.
Hosted by
Supported by
Platinum Sponsor
Platinum Sponsor
Community sponsor
Venue host - Rootconf workshops
Community Partner
Community Partner
{{ gettext('Login to leave a comment') }}
{{ gettext('Post a comment…') }}{{ errorMsg }}
{{ gettext('No comments posted yet') }}