Call for submissions: Platform Engineering meet-ups
Rootconf
Rootconf

Call for submissions: Platform Engineering meet-ups

Share your journey of building platforms that power engineering teams

All submissions

Neel Shah

@neel_devops

Building robust LLM observability and improve security posture with OpenLit and OpenTelemetry

Submitted May 10, 2026

Session type: Talk (30 mins) Submission made for: Mumbai meet-up in April

LLMs are game-changing in today’s world but understanding their behavior is much more crucial as it can improve the output a thousand times. Simply observing the input and output – the “prompt” and the “response” is no longer sufficient for building robust and dependable LLM-powered applications.

LLM Observability refers to a more in-depth approach to monitoring large language models, where it captures not only the basic outputs but also metrics, traces, and patterns of behavior. Without observability, identifying and fixing anomalies, performance issues, detection of sensitive data leak, inaccuracies becomes difficult.
In this talk, we will discuss how we can develop complete end-to-end Observability for LLM using OpenLit.

Outcomes that LLM observability gives to enhance the performance
Response latency: How quickly the model responds to user queries.
Data leak detection: Are PII and sensitive data included in response?
Classified data seek rate: Effective guardrails for excluding the classified data. Tracking the frequency of such user queries and from whom?
Token usage: Tracking token consumption to manage operational costs.
Prompt effectiveness: Evaluating how well the crafted prompts generate the desired outputs.

Presentation Benefits
Almost every person nowadays uses LLMs and AI applications. Many products are using them to make some modern tech solutions so all the Cloud Native professionals can understand the benefits from it and can implement them in their projects, which will eventually help them improve their performance and also security.

Neel Shah - Developer Advocate at StackGen
I help platform engineers and DevOps teams understand and adopt cloud-native infrastructure through talks, demos, and community building. I organise the CNCF Gandhinagar, HashiCorp UG Gandhinagar, and Google Cloud Gandhinagar communities, and I have spoken at 40+ events, including KubeCon India, PlatformCon, HashiTalks, OpenSearchCon Korea, FOSS ASIA, and LinuxFest Northwest.

My core focus areas are Kubernetes, GitOps, IaC with Terraform/Vault, AI-powered DevOps tooling, and observability pipelines. I've mentored 15+ hackathons and open-source programmes.
All submissions

Comments

{{ gettext('Login to leave a comment') }}

{{ gettext('Post a comment…') }}
{{ gettext('New comment') }}
{{ formTitle }}

{{ errorMsg }}

{{ gettext('No comments posted yet') }}

Register

Hosted by

Rootconf
Rootconf
We care about site reliability, cloud costs, security and data privacy