Come economic winter and as Infrastructure engineer your calendar is booked for multiple meetings/calls titled “Optimising Cloud Cost”. I am sure it sounds familiar. Everyone in the engineering teams prioritises cutting the cloud cost. But this is often a reactive and partial approach. Why? As an observation, we only optimise what is visible to us and pluck low-hanging fruits. What we often need … more

LLMs and generative AI have made their way into our day-to-day operations. While the wrappers over GPT are a good starting point, I was intrigued by what it takes for an SRE to understand the domain, identify its operational aspects, and build runbooks around running self-hosted LLM models. more