The Fifth Elephant OSAI meet-up - Hyderabad edition
The Fifth Elephant
The Fifth Elephant

The Fifth Elephant OSAI meet-up - Hyderabad edition

Call for Proposals - make a submission; give visibility to your work

All submissions

Saurabh Machave

@saurabh_machave

Powering your workstation with local GenAI

Submitted Aug 30, 2025

Type of session: 10 mins Lightning talk/demo

Intro

This talk will start with the question–why should one use open-source models in the first place? While it seems perfectly normal to make API calls to closed-source models for day-to-day tasks, it comes at the cost of privacy, judicious use of tokens and at the end of the day–money. I will explain how to wire up your code editor to use open-source models for autocomplete and chat, which extension to install, how to configure it to query your local models and of course the various open-source models that you can try out.

In addition to code, I’ll talk about how to generate images locally, show which tools to use, how to configure the models and which models generate good outputs.

Key takeaways

  1. How open-source models can be used as a replacement for Copilot and Claude.
  2. How images can be locally generated by open-source models.

This talk is for

  1. Developers and designers new to GenAI
  2. Folks concerned about privacy of their data and code
  3. Seasoned developers and designers looking to save some bucks on cloud-based LLMs

About me

My name is Saurabh and I work at Thoughtworks as a Developer.

All submissions

Comments

{{ gettext('Login to leave a comment') }}

{{ gettext('Post a comment…') }}
{{ gettext('New comment') }}
{{ formTitle }}

{{ errorMsg }}

{{ gettext('No comments posted yet') }}

Register

Hosted by

The Fifth Elephant
The Fifth Elephant
Jump starting better data engineering and AI futures

Supported by

Community sponsor

Meta
Meta