Preview video

Hack Five
Hack Five

The Fifth Elephant Open Source AI Hackathon 2024

GenAI makers and creators contest and showcase

Tickets

Loading…

All submissions

Amir Nagri

@amir

Bodhilib - An OSS multi-language, performant, plugin architecture based, composable LLM library

Submitted Jan 18, 2024

Category: AI tools/SDK innovation

Bodhilib

Bodhilib is an Open-Source, performant, plugin architecture based, composable LLM library.

Open Source

Source: https://github.com/bodhisearch/bodhilib

Multi-language

  • Bodhilib components are written in Rust
  • Currently supports Python using PyO3
  • Plan is to have language bindings for TypeScript, Java, Swift, WebAssembly
  • Same core, available on multi-platforms, with compatibility
  • Allows applications to be written for Web, Desktop, Mobile, WebAssembly using language of your choice

Performant

With core components written in Rust, bodhilib provides a performance edge over interpreted languages like Python.

Plugin Architecture

  • Bodhilib only defines the core interfaces and models
  • Implementation by vendors
  • Integrated using a Dependency Injection component that supports auto-discovery

Composable

  • The interfaces are designed with composability in mind
  • Easy to create pipelines without need for separate/additional features (like LCEL)

If you are interested in contributing to Bodhilib, sign-up, and I will be very happy to onboard and get you started.

Thanks.

All submissions

Comments

{{ gettext('Login to leave a comment') }}

{{ gettext('Post a comment…') }}
{{ gettext('New comment') }}
{{ formTitle }}

{{ errorMsg }}

{{ gettext('No comments posted yet') }}

Hybrid access (members only)

Hosted by

Hack Five
Hack Five
The Fifth Elephant hackathons

Supported by

Host

The Fifth Elephant
The Fifth Elephant
Jump starting better data engineering and AI futures
Meta
Meta

Venue host

H
Hasura
Welcome to the events page for events hosted at The Terrace @ Hasura. more

Partner

Microsoft for Startup's
Microsoft for Startup's
Providing all founders, at any stage, with free resources to build a successful startup.