Lightning talk: Sovereign LLM Inference on heterogenous AI accelerators using llm-d and vLLM

Pravein Govindan Kannan, Staff Research Scientist at IBM Research

Optimized AI inference with llm-d and a case-study on sovereign AI on heterogenous GPU cluster

Pravein Govindan Kannan, Staff Research Scientist at IBM Research