Open Source AI Hackathon 2024

GenAI makers and creators contest and showcase

Tickets

Loading…

Amir Nagri

@amir

Bodhilib - An OSS multi-language, performant, plugin architecture based, composable LLM library

Submitted Jan 18, 2024

Bodhilib

Bodhilib is an Open-Source, performant, plugin architecture based, composable LLM library.

Open Source

Source: https://github.com/bodhisearch/bodhilib

Multi-language

  • Bodhilib components are written in Rust
  • Currently supports Python using PyO3
  • Plan is to have language bindings for TypeScript, Java, Swift, WebAssembly
  • Same core, available on multi-platforms, with compatibility
  • Allows applications to be written for Web, Desktop, Mobile, WebAssembly using language of your choice

Performant

With core components written in Rust, bodhilib provides a performance edge over interpreted languages like Python.

Plugin Architecture

  • Bodhilib only defines the core interfaces and models
  • Implementation by vendors
  • Integrated using a Dependency Injection component that supports auto-discovery

Composable

  • The interfaces are designed with composability in mind
  • Easy to create pipelines without need for separate/additional features (like LCEL)

If you are interested in contributing to Bodhilib, sign-up, and I will be very happy to onboard and get you started.

Thanks.

Comments

{{ gettext('Login to leave a comment') }}

{{ gettext('Post a comment…') }}
{{ gettext('New comment') }}
{{ formTitle }}

{{ errorMsg }}

{{ gettext('No comments posted yet') }}

Hybrid access (members only)

Hosted by

The Fifth Elephant hackathons

Supported by

Host

Jump starting better data engineering and AI futures

Venue host

Welcome to the events page for events hosted at The Terrace @ Hasura. more

Partner

Providing all founders, at any stage, with free resources to build a successful startup.