Open-Source GPU Stacks in the Era of Proprietary Dominance more

Abstract: Compilers are workhorses of performance behind all AI algorithms. Making algorithms work effectively on GPUs is especially hard - called kernel programming. Compiler ecosystem around GPUs is especially messed up. Compilers are supposed to allow for performance portability of different hardwares but this is usually not the case. See below infographic for current state of AI compilers. more

Abstract We have been working on shipping an AI server called JOHNAIC for serving cloud like workloads from this edge server. We are developing our operating system with a specific focus on security and usability for developers. With this OS, we are able to deploy SaaS apps, indistinguisable from cloud and expose them over internet. In this session, I will speak about this operating system in det… more