Platform engineering for production agents - a hands-on workshop

Platform engineering for production agents - a hands-on workshop

AI agents don't behave like typical services: they have variable control flow, chained model and tool calls, unpredictable latency and cost.

Tickets

Loading…

Platform Engineering for production agents

Check out the set-up required for the workshop, and other details from this document - https://docs.google.com/document/d/1prbu5lZoCIduQekNM3Jln0IZbRJcg_d-gzYE3jhUqDg/edit?tab=t.0

A hands-on workshop for platform, systems, DevOps, and SRE engineers who need to run AI agents safely, reliably, and cost-effectively in production.

AI agents are no longer just local coding assistants or experimental chatbots. Once agents call tools, access data, run workflows, retry failed steps, and serve users, they become production workloads. They need the same platform discipline as any other distributed system: identity, secrets, isolation, observability, deployment, rollback, cost controls, and operational recovery.

This workshop focuses on the runtime and platform responsibilities that come with supporting agent-based applications in production.

What is this workshop about?

This workshop will help engineers understand what changes when AI agents move from development environments into hosted, production systems.

Participants will learn how an agent request flows across model calls, tool calls, retries, responses, logs, traces, and failure states. The workshop will cover the operational controls needed to make agents observable, bounded, secure, debuggable, and recoverable.

The emphasis is not on prompt engineering or chatbot design. The workshop is about the production environment around agents: how to run them, monitor them, constrain them, and recover them when something goes wrong.

Who is the target audience?

This workshop is for:

  • Platform engineers supporting application teams that are building or deploying AI workloads
  • Systems engineers working on infrastructure, runtime environments, internal platforms, or developer platforms
  • DevOps and SRE practitioners responsible for reliability, deployment, observability, security, and cost controls
  • Backend engineers building agents who want to understand the production platform their agents will need
  • Engineers experimenting with AI agents who understand containerisation basics and want to move beyond local demos

Background knowledge requirements

  • You do not need prior experience building AI agents.
  • You should be comfortable with basic containerization concepts and familiar with how production applications are usually deployed, monitored, and operated.

This workshop is not designed for non-technical participants, business users, or people looking only for an introduction to prompting or AI tools.

Workshop content and plan

The workshop will be hands-on and will cover the following areas:

1. What makes agents different as production workloads

  • Difference between coding assistants, local agents, and hosted agent services
  • Anatomy of an agent request
  • Model calls, tool calls, retries, memory, state, and responses
  • Why agent workloads are harder to reason about than standard request-response services

2. Runtime behaviour and failure modes

  • Tracing an agent request across model and tool boundaries
  • Latency, timeout, retry, and partial failure patterns
  • Model failures, tool failures, permission failures, and workflow failures
  • Choosing safe recovery actions when agent execution goes wrong

3. Observability for agents

  • Logs, metrics, and traces for agent systems
  • Tracking token usage, latency, errors, tool calls, and cost
  • Debugging agent behaviour using telemetry
  • Separating application bugs, model issues, and platform failures

4. Access, isolation, and safety boundaries

  • Bounding what an agent can access
  • Tool permissions and scoped credentials
  • Secrets management for agent workloads
  • Sandboxing, isolation, rate limits, time limits, and spend limits

5. Platform responsibilities

  • What belongs in agent code vs what should be provided by the platform
  • Minimum production environment for hosted agents
  • Deployment, rollback, configuration, and environment management
  • Operational checklists for supporting agent-based applications

6. Hands-on exercises

Participants will work with a small agent workload and practice:

  • Running it in a containerised environment
  • Tracing a request through model calls and tool calls
  • Observing latency, failures, token usage, and cost
  • Applying runtime limits and access boundaries
  • Diagnosing failures and selecting recovery actions

Key takeaways

By the end of the workshop, you will be able to:

  • Explain how production agents differ from local coding tools and simple AI demos
  • Trace one agent request across model calls, tool calls, retries, and responses
  • Use metrics and traces to identify latency, errors, token usage, and cost
  • Bound an agent’s access to tools, data, time, credentials, and spending
  • Decide which controls belong in agent code and which should be platform defaults
  • Define the minimum production environment for identity, secrets, isolation, telemetry, deployment, and rollback
  • Diagnose model, tool, and agent failures and choose a safe recovery action
  • Support application teams that are moving agent workloads into production

Software installation requirements

Participants will need:

  • A laptop that can run Docker containers
  • An API key for an LLM provider or model gateway
  • A code editor
  • Basic familiarity with command-line usage

You may use any LLM API provider that is compatible with the workshop exercises.

Low-cost or free options include:

Detailed setup instructions will be shared with registered participants before the workshop.

About the instructor

Giridharan Manivannan is a DevOps and Platform Engineering consultant with over 12 years of experience. He has worked with infrastructure teams at Razorpay and Hasura, helping teams build, operate, and scale production systems.

He writes and shares thoughts on DevOps, platform engineering, AI infrastructure, Chelsea FC, and anime at https://x.com/_dforce. He can be reached at hello@giridharan.dev for work.

How to attend this workshop

This workshop is open to Rootconf members.

The workshop is open to 30 in-person participants, with hybrid access available for remote attendees. Seats for in-person participants will be available on a first-come, first-served basis.

Contact information

For inquiries about the workshop, contact +91-7676332020 or write to info@hasgeek.com.

Hosted by

We care about site reliability, cloud costs, security and data privacy