The Fifth Elephant
The Fifth Elephant

The Fifth Elephant 2025 Winter Edition Call for Proposals

On AI disrupting analytics - make a submission

All submissions

prerit Khandelwal

@prerit20

From Bottleneck to Self-Serve: How Razorpay Built and Scaled its AI Analyst, DataGaaru

Submitted Nov 8, 2025

Type of submission: 30 mins talk

At Razorpay, the growing demand for data & insights was increasing manual dependence, slowing down critical business decisions. This led us to ask a question: “Are chatbots the future of analytics?” Our answer is DataGaaru, a home-grown AI Analyst Assistant that is fundamentally reshaping how we interact with data. Today, it handles over 1,500 queries monthly and has already reclaimed 20% of our analytics team’s bandwidth.

This session is a behind-the-scenes case study of our journey building DataGaaru from the ground up. We’ll unpack the architecture of its two core features: a Reasoning Bot (our text-to-SQL engine) and a Health Metrics Document Generator that automates metric deep-dives.A key focus will be our structured prompting strategy, which injects crucial, domain-specific context and business rules into the LLM to achieve high query accuracy.

Key Takeways

This session provides a practical playbook for anyone building and scaling AI-driven data tools.

  • Our Blueprint for an AI Analyst: A simple walkthrough of our architecture, how we give the LLM the right context, and our plans to use multiple models to optimize for cost and performance.
  • From Idea to Essential Tool: How we rolled it out in phases and focused on basics like security and data logging. We’ll show the exact OKRs we used to track our progress, like cutting down query time from 4 minutes to under 20 seconds.
  • How We Built Trust: An AI tool is useless if people don’t trust it. We’ll share the simple features we added to build confidence, like a “test questions” library, a SQL explainer, and a “Confidence Score” for every query.

Proposed Session Format: Presentation + Live Product Demo

Ideal Audience

  • Data Leaders and Managers who want a proven strategy to solve the data and insights bottleneck.
  • Data Product Managers who want to learn how to build and scale a tool users trust.
  • Data Analysts who want to see how AI can help them focus on more important work.

Speaker’s bio
As Razorpay’s first analytics hire, Prerit built the Analytics Center of Excellence (COE) from the ground up, scaling analytics and AI across multiple product lines.

Link: https://drive.google.com/file/d/1ynT-zmfDVQMKACSaNLiD6Pm-XCT2Ca-B/view?usp=drivesdk

All submissions

Comments

{{ gettext('Login to leave a comment') }}

{{ gettext('Post a comment…') }}
{{ gettext('New comment') }}
{{ formTitle }}

{{ errorMsg }}

{{ gettext('No comments posted yet') }}

Hosted by

The Fifth Elephant
The Fifth Elephant
Jumpstart better data engineering and AI futures