Call for submissions: Platform Engineering meet-ups
Rootconf
Rootconf

Call for submissions: Platform Engineering meet-ups

Share your journey of building platforms that power engineering teams

All submissions

Kumar Ravi

The Platform Around the Agent: Guardrails, Evals and Cost Control for LLM Workloads in Fintech

Submitted Oct 23, 2026

Session type: Talk (30 mins) Submission made for: Bangalore meet-ups

Abstract

Our LLM agents for wealth management passed offline evals and then failed with real users: stale data behind valid tool calls, confident answers that should have gone to a human, and multi-turn drift. Fixing them one agent at a time didn’t scale. We ended up building a shared platform layer that every AI feature now runs on.

This talk walks through that layer and the trade-offs behind it:

  • Guardrails and human escalation as shared services, not per-team code.
  • Tracing and behaviour monitoring for AI calls, beyond latency and error rates.
  • An eval pipeline that turns production incidents into regression tests, which teams run before every release.
  • Cost and latency controls: model routing, caching and budgets per feature.
  • How we standardised AI usage across teams without slowing them down.

We’ll also cover what this platform cost to run and which parts we’d build first if we started again.

Format

In-depth talk, 30–40 min (can trim to a 10-min flash talk: “The guardrail and escalation service we wish we’d built first”).

Takeaways

  1. Which AI concerns belong in a platform and which belong in product teams.
  2. A reference architecture for guardrails, tracing and evals as shared services.
  3. The cost and latency levers that actually moved the numbers.

Bio

Kumar Ravi is CTO India at TIFIN in Mumbai. He’s a former founder turned CTO with about 17 years in tech, building production AI in fintech on LLMs, RAG and agentic systems, with a background in Docker/Kubernetes infrastructure. He has built engineering teams from zero as CTO at four companies. LinkedIn: https://www.linkedin.com/in/techsavyravi/ · First public talk.

All submissions

Comments

{{ gettext('Login to leave a comment') }}

{{ gettext('Post a comment…') }}
{{ gettext('New comment') }}
{{ formTitle }}

{{ errorMsg }}

{{ gettext('No comments posted yet') }}

Register

Hosted by

Rootconf
Rootconf
We care about site reliability, cloud costs, security and data privacy