Lightning talk: Sovereign LLM Inference on heterogenous AI accelerators using llm-d and vLLM

Pravein Govindan Kannan, Staff Research Scientist at IBM Research