The Fifth Elephant OSAI meet-up - Hyderabad edition
The Fifth Elephant
The Fifth Elephant

The Fifth Elephant OSAI meet-up - Hyderabad edition

Call for Proposals - make a submission; give visibility to your work

All submissions

irfan basha sheik

@sheikirfanbasha

Building Production-Grade LLM Applications with DSPy: From Simple Start to Scalable Excellence

Submitted Aug 29, 2025

Type of session: 25-35 min talk

Description

The rapid evolution of Large Language Models (LLMs) has introduced a paradigm shift in AI development, but building reliable, production ready applications remains a challenge. Developers often face brittle systems, driven by ad hoc prompting and rapidly changing model guides. This session introduces DSPy, an open source, lightweight, declarative framework that brings engineering discipline back into the process, transforming LLM development from chaotic prompt engineering into structured, maintainable programming.

In this talk, we will start with the basics of DSPy’s core abstractions, Signatures and Modules, and demonstrate how they help define tasks declaratively and encapsulate inference strategies. We’ll then progressively enhance these applications for production by introducing adapters, multimodality support, robust modules with scalability features, and DSPy Optimizers like MIPROv2 and SIMBA, that improve performance. We will also explore DSPy’s integration with MLFlow for observability, tracking, and deployment. Attendees will leave with a roadmap to build scalable, testable, and production grade LLM applications.

Takeaways

  • Learn how DSPy’s abstractions (Signatures, Modules) enable structured, maintainable LLM applications.

  • Discover how to scale LLM workflows with optimization, multimodality, async support, and observability tools.

Audiences

  • Engineers and architects building LLM powered features.

  • AI/ML practitioners exploring open source frameworks for production readiness.

  • Technical leaders seeking structured approaches to integrate AI into the SDLC.

About Me

I am Irfan Basha S, a software Architect with over 15 years of experience building scalable, production grade systems at TCS, Pramati Technologies, UKG, TechConative, and SymphonyAI. I am passionate about AI and emerging technologies, and I actively work with DSPy, an open source framework, to help teams bridge the gap between prototypes and resilient, production ready AI systems. I am also the Cofounder of NGI Academy, where I focus on building a local AI community in my hometown Madanapalle by giving in-person talks, mentoring, and encouraging others to take part in shaping the future of AI.

All submissions

Comments

{{ gettext('Login to leave a comment') }}

{{ gettext('Post a comment…') }}
{{ gettext('New comment') }}
{{ formTitle }}

{{ errorMsg }}

{{ gettext('No comments posted yet') }}

Register

Hosted by

The Fifth Elephant
The Fifth Elephant
Jump starting better data engineering and AI futures

Supported by

Community sponsor

Meta
Meta