Summary Over the past few months we’ve been evaluating AI SRE agents with several of our customers: OpenSRE, HolmesGPT, K8sGPT and a handful of others. We started with the things any SRE would check before trusting one of these on a real incident. That only took us so far, so we built a benchmark on top of the open-source SREGym framework, where the agent’s diagnosis is graded against what actual… more