AHAkash Hadagali Persettiinakashpersetti.hashnode.dev·10h ago · 9 min readMy eval leaderboard published a negative retry countI was looking at the EvalBench dashboard a few weeks ago and one cell stopped me: Retries to valid 0.125 95% CI -0.035 – 0.285 n=40 A negative number of retries. You cannot retry a request negative-p00
AHAkash Hadagali Persettiinakashpersetti.hashnode.dev·2d ago · 8 min readI Ran terraform validate Inside a Lambda. Two Things Broke.Most agent projects that generate code evaluate it by asking another model whether the code looks correct. I did that for about a week in TerraformAgent before I got tired of it. The failure mode is b00
AHAkash Hadagali Persettiinakashpersetti.hashnode.dev·5d ago · 7 min readThe cost of a serverless agent isn't the Lambda. It's the loop.When I moved Wingman onto Lambda, I assumed the thing I'd have to watch was compute duration. That's the serverless mental model everyone starts with: you pay per millisecond, so keep the function fas12K
AHAkash Hadagali Persettiinakashpersetti.hashnode.dev·Jul 12 · 6 min readFour rival LLMs, zero consensus: designing an MCP panelThe obvious version of a multi-model tool is a black box: send it a question, it asks GPT and Gemini and Claude and Grok, and hands you back one blended answer. That was the first thing I cut. I built00
AHAkash Hadagali Persettiinakashpersetti.hashnode.dev·Jul 9 · 6 min readI grade my AI twin on real traffic, not just an offline test setMost eval setups have a quiet lie in them. You run a fixed question set through your agent, a judge model scores the answers, you get a number, and you feel good. But that number describes a sandbox. 00