Bangalore Systems Meetup #3

Description

In this talk, we will explore a novel approach to distributed systems that redefines the traditional boundaries between cloud and edge. We introduce JOHNAIC, an affordable AI server that empowers developers with a seamless cloud-like experience without the need for extensive infrastructure setup or maintenance.

Our Cloud-in-a-box system, provides a self-contained environment that integrates a developer-friendly operating system, LLM-powered coding tools, and SaaS applications. This integrated approach enables users to host their own applications like notion and slack without relying on external cloud providers like AWS.

We will get into the technical aspects of JOHNAIC, highlighting its affordability and simplicity over traditional cloud solutions. Our operating system uses Distrobox/Podman to provide secure sudo-less experience that simplifies developer setup and environment management. We will showcase how self hosting of various Saas applications like chatllama, outline and matrix work.

Talk Outline:

1. Introduction to JOHNAIC: an affordable AI server
2. Cloud-in-a-box: the concept of a self-contained environment for cloud computing.
3. Advantages of JOHNAIC over traditional cloud solutions:

• More affordable
• Easier to set up and manage
• Increased control and flexibility

4. Operating system features:

• Distrobox/Podman: sudo-less experience for simplified setup and management
• Private LLM for coding and other tasks.

5. SaaS applications self-hosted:

• Notes app (e.g., Outline)
• Chat app (e.g., Matrix)
• LLM UI (e.g., Open Web UI)

Bio:
Adithya works with von-nuemann.ai as an engineer enthusiastic about operating system based on linux. He embraces the hacker mentality of mainly breaking things and learning from it.

Check out our passionate work at johnaic.com