The Fifth Elephant 2023 Winter

The Fifth Elephant 2023 Winter

On the engineering and business implications of AI & ML




Understanding how to achieve high accuracy and a great user experience for LLM-based service bots.

Submitted Jul 12, 2023

In this talk, we will outline the journey of building policyGPT, a system designed to automate responses to health insurance support queries. The system can guide users with educational context such as how-to guides and provide instant, precise answers to a wide range of coverage questions interpreting policy terms and conditions. Given this context’s crucial high accuracy requirements, our main focus was ensuring that the model provides the user with the most reliable and useful information.

The talk will explore the various steps we took to ensure high accuracy and a great user experience, from preparing high-quality input data to indexing strategy, temperature control, memory management and prompt engineering to enhance discreet reasoning.

We will use many examples from policyGPT’s early prototypes to production-ready and handy tips on evaluation framework.


Karthik B.
Engineering, Plum
linkedin profile


{{ gettext('Login to leave a comment') }}

{{ gettext('Post a comment…') }}
{{ gettext('New comment') }}
{{ formTitle }}

{{ errorMsg }}

{{ gettext('No comments posted yet') }}

Hybrid access (members only)

Hosted by

All about data science and machine learning

Supported by


Providing all founders, at any stage, with free resources to build a successful startup.