AHAkash Hadagali Persettiinakashpersetti.hashnode.dev·Aug 4 · 6 min readThe eval schema I stopped migratingEvery time I added a benchmark suite to EvalBench, I used to touch the database. New suite, new columns, a migration, a change to the aggregation query, and usually a change to the frontend so it knew00
AHAkash Hadagali Persettiinakashpersetti.hashnode.dev·Jul 31 · 9 min readWhat happens when your migration agent dies at file 7 of 12A migration agent spends real money and real minutes per run. It clones a repo, installs its deps, plans a file order, then rewrites files one at a time, running the target's test suite after each one00
AHAkash Hadagali Persettiinakashpersetti.hashnode.dev·Jul 29 · 5 min readOne domain broke. I refused to rerun the other five.TerraformAgent turns a plain-English infrastructure request into validated Terraform. Six nodes: an orchestrator plans the domains, a researcher pulls AWS docs, a set of domain subagents write code in00
AHAkash Hadagali Persettiinakashpersetti.hashnode.dev·Jul 22 · 11 min readThe variables my subagents referenced and nobody declaredterraform validate failed on nearly every multi-file run with the same error class: Error: Reference to undeclared input variable on iam.tf line 14, in resource "aws_iam_policy" "app_access": 14:00
AHAkash Hadagali Persettiinakashpersetti.hashnode.dev·Jul 20 · 9 min readMy eval leaderboard published a negative retry countI was looking at the EvalBench dashboard a few weeks ago and one cell stopped me: Retries to valid 0.125 95% CI -0.035 – 0.285 n=40 A negative number of retries. You cannot retry a request negative-p00