Submissions
Shivam Gupta

Shivam Gupta

@shivamgupta

Staff Engineer @Inmobi

  • Joined Oct 2025

Platform Engineering meet-up - Nov 8

Building Low-Latency ML Inference at Ad-serving Scale

Ever wondered what it takes to run a low-latency, high-throughput ML platform serving over 3 million requests per second? In this talk, we’ll dive deep into the engineering challenges of operating at extreme scale — from handling synchronous ML inference in real-time ad serving to ensuring predictable latency under heavy load. We’ll explore the evolution of our architecture — how Jetty-based appl… more
  • 2 comments
  • Confirmed & scheduled
  • 06 Oct 2025
Session type: Talk (30 mins)

Speak at The Fifth Elephant 2026 Annual Conference

Discover Globally, Materialize Locally: Building a Governed Cross-Domain Data Sharing Platform

Cross-business-unit data sharing usually starts with good intentions and quickly turns into ticket-driven exports, undocumented copies, governance bottlenecks, and growing compliance risk. At InMobi, multiple business units operate independent lakehouses, catalogs, and data engineering organizations. Combining data across these domains creates significant business value, but traditional approache… more
  • 0 comments
  • Submitted
  • 12 Jun 2026
I am submitting for: Track 1 - Data engineering & infrastructure Type of session: 30 mins talk