Fine-tuning an LLM looks deceptively simple, but the real challenges often lie beyond the training code. In this talk, I share our experience building Aalap, an open-source LLM for Indian legal tasks. We will look at the choices we made, the experiments that surprised us, and the things that did not work as expected. A practitioner’s account of lessons learned the hard way while fine-tuning a dom… more