sooraj shankar

@soorajshankar

Memory Is a Data System: State, Search, and History for AI Agents

Submitted May 30, 2026

AI agent memory is often discussed as a prompting problem or a vector search problem. In production, it behaves much more like a data system. Agents need to store facts, preferences, decisions, intermediate notes, and shared organizational context. That memory has to be named, scoped, searched, updated, versioned, inspected, and eventually corrected.

This session looks at agent memory through a data engineering lens. We will discuss how to model memory as scoped state rather than opaque prompt text: virtual paths for user and shared memory, full-text search alongside retrieval, revision history for every write, access logs for observability, and controlled context injection back into the model. I will use MemexAI, an open-source Postgres-backed memory layer for agents, as the implementation example, but the talk is designed around reusable design patterns and trade-offs for anyone building long-running AI systems.

Takeaways:

  • How to reason about agent memory as structured operational data, not just embeddings or chat history.
  • A practical data model for agent memory: scoped paths, search, revisions, access logs, and policy boundaries.

This session is useful for data engineers, ML systems engineers, AI platform teams, backend engineers, and product engineers building RAG systems, copilots, or long-running agents that need persistent and inspectable context.

Sooraj Sanker is a Bengaluru-based fullstack and AI engineer, and the founder of MemexAI, an open-source Postgres-backed memory layer for long-horizon AI agents. He spent roughly six years at Hasura and PromptQL, where he worked on conversational analytics, AI agent interfaces, tool-based workflows, artifact-aware chat, and state management for distributed agent execution. His work sits at the intersection of agent infrastructure, context engineering, data UX, and production reliability.

Draft slides: https://drive.google.com/file/d/1-UAb5BWP_CQIMcRxrWe0Im21VOmoAerW/view?usp=sharing

Comments

{{ gettext('Login to leave a comment') }}

{{ gettext('Post a comment…') }}
{{ gettext('New comment') }}
{{ formTitle }}

{{ errorMsg }}

{{ gettext('No comments posted yet') }}

Hosted by

Jumpstart better data engineering and AI futures