Observability is a Data Engineering problem. Write-heavy, realtime latency, faster queries are the typical requirements of a Observability system. Traditional observability systems fail to meet the ever-growing demand of increased volumes due to cloud deployments, AI agents speeding up the feature and product development. AI agents also changes the query patterns which were common in Observability - human-led sparse queries. AI agents can make 100x more queries than human engineers which breaks the assumptions underlying fixed compute and disk based observability architectures. This session goes into building blocks required to design an observability system on Object storage and Serverless architecture.
- An architectural blueprint of an observability system on top of object storage and serverless compute. It includes how to design data file formats and index file formats optimized for S3 dynamics.
- Utilizing serverless compute for bursty loads is essential for reducing the idle tax of always-on clusters.
This session is ideal for
- Data engineering architects who are building scalable and performant systems on object storage.
- SRE/DevOps engineers navigating cost / operational overhead challenges of traditional observability systems
Founding Engineer at Oodle AI, an observability platform built on object storage + serverless compute.
Prev: Early (among fist 30 hires) engineer at Rubrik
to be added
{{ gettext('Login to leave a comment') }}
{{ gettext('Post a comment…') }}{{ errorMsg }}
{{ gettext('No comments posted yet') }}