Let's build production-ready RAG pipeline the right way!

Dec 2023

4 Mon

5 Tue

6 Wed

7 Thu

8 Fri 09:00 AM – 04:15 PM IST

9 Sat

10 Sun

Make a submission

Accepting submissions till 15 Nov 2023, 11:59 PM

Bangalore International Centre (BIC), Bengaluru

Why Large Language Models are important in AI

In 2020, OpenAI released a Large Language Model (LLM) called GPT3 which has a billion parameters. With a minimal and intuitive user interface which was released to go with GPT3, it caught the imagination and attention of AI communities and researchers all over the world.
One by one, the domain use cases such as co-pilots for coding, creative AI, and other downstream tasks were shown to be fast-tracked by GenerativeAI models and LLMs. As such, there is a wide-ranging interest in large language models and applications around them for various domains and use cases in the AI space. Experiments which aim to find optimal hyperparameters, and those dealing with underfitting and overfitting models are being carried out regularly; more and more barriers are being broken down every day.

The Fifth Elephant 2023 Winter edition will cover topics on the research, engineering, and business aspects of AI, exploring the practical implementation and economic implications of these systems.

Themes

The winter edition of The Fifth Elephant will showcase talks, discussions and demos across generative and multimodal AI, and other classic AI/ML/DL applications on the below themes.

Share approaches and case studies covering the following use cases:

Products and platforms using LLMs, GenerativeAI, ML, and Deep Learning techniques, and business formulation around AI engineering.

Conversational AI and search, automatic speech recognition, healthcare, e-commerce, fintech, media and OTT, and other verticals.

Multilingual needs in India in digital products/platforms - features discussions, models training, finetuning, RLHF, RAGs, quantization techniques, dataset curation and augmentations, challenges faced in pipelines, evaluation metrics, future roadmaps, applications such as multilingual voice bots using ASR/STT, text to speech for accessibility.

Share case studies and experiential talks on handling the operations for data science such as scaling challenges and fine-tuning challenges, and lessons learned, and best practices for incorporating ethics, safety, and bias.

Show demos on features/products which leverage AI and LLM-based APIs and models. It can be from creative AI, generative AI space, and various verticals with relevant use cases.

The Fifth Elephant membership

The December edition will be held in-person. Attendance is open to The Fifth Elephant members only. Pick a membership to attend the in-person conference, and to support The Fifth Elephant’s community activities.

AI/ML/Data Science Ops engineers who want to learn about state-of-the-art tools and techniques, especially from domains such as health care, e-commerce, automobile, agri-tech and industrial verticals

Data scientists who want a deeper understanding of model deployment/governance.

Architects who are building ML workflows that scale.

Tech founders and CTOs who are building products and platforms that leverage AI, ML and LLMs

Product managers, who want to learn about the process of building AI/ML products.

Directors, VPs and senior tech leadership who are building AI/ML teams.

Sponsorship

Sponsorship slots are open for:

Infrastructure (GPU, CPU and cloud providers) and developer productivity tool makers who want to evangelise their offering to developers and decision-makers.

Companies who want to do tech branding among AI and ML developers.

Venture Capital (VC) firms and investors who want to scan the landscape of innovations and innovators in AI and who want to source leads for investment in the AI and ML space.
If you are interested in sponsoring The Fifth Elephant, email sales@hasgeek.com.

Let's build production-ready RAG pipeline the right way!

Submitted Nov 15, 2023

Retrieval Augmented Generation (RAG) is a brilliant technique of augmenting knowledge to Large Language Models (LLMs) so that we can use the power of Language Models for multiple use cases on enterprise and real-time data.

But, like every coin has two sides, the RAG technique comes with its own set of challenges. Firstly, building secure data APIs is time-consuming; on top of it, LLMs resolving incoming queries to data models makes it hard to have a highly reliable and deterministic pipeline. Businesses can’t scale without determinism. Imagine a nondeterministic flight management system that schedules flights at an incorrect time once in a while. We would end up adding multiple validation steps, and scaling would become highly expensive.

In most RAG setups, we fetch information and leave the decision-making to LLM to decide whether there is information present in the context to answer the question. LLM tasks are defined to execute a specific task like information extraction, summarization, etc, and not to do data validations. Even if we defined LLMs to do the data validation, this wouldn’t be the right thing to do as we would be compounding the error of wrong context with LLM hallucinations. We need the data checks for valid context to be at the data source.

In this talk, I will present the challenges of building production-ready RAG and how Hasura, with the understanding of your data model, can help you build a highly deterministic RAG pipeline by cutting down noise.

The Fifth Elephant 2023 Winter

Why Large Language Models are important in AI

Themes

AI engineering Track

Data Science operations track

Demo track

The Fifth Elephant membership

Who will benefit from participating in The Fifth Elephant community:

Sponsorship

Contact information

Let's build production-ready RAG pipeline the right way!

Comments