Running an open-weight model on a laptop is easy; getting it to serve reliably in production - on-prem/on-cloud GPUs - is where most teams stall. This session is a hands-on playbook for that journey: model selection, quantization, choosing a serving stack (vLLM, TensorRT-LLM), batching and KV-cache behaviour, the latency-vs-throughput tradeoff, evals, and routing. I’ll use an open-weight model (N… more