Alosh Denny

@aoxo

I'm an AI researcher that loves making and breaking LLMs

We burned 48 GPU hours finding out how few bits a model needs

We burned 48 GPU hours finding out how few bits a model needs

Alosh Denny, Senior Staff Engineer at Shield AI

39 minutes20 November 2026
Birds of Feather (BOF) session: Fewer bits, more questions: making quantization work across models, runtimes and hardware

Birds of Feather (BOF) session: Fewer bits, more questions: making quantization work across models, runtimes and hardware

Facilitated by Alosh Denny and Vivek Kalyanarangan

51 minutes20 November 2026