---
title: "Discussion on \"Your AI Agent Improved Its Score. Did It Improve the System?\" | Hashnode"
description: "Discussion on \"Your AI Agent Improved Its Score. Did It Improve the System?\". A thousand research agents are useful only if their discoveries survive verification."
url: "https://hashnode.com/posts/your-ai-agent-improved-its-score-did-it-improve-the-system/6aa5d1b67cfde2f47ac4f72d"
---

[Feed](https://hashnode.com/feed) /

Discussion

# [Your AI Agent Improved Its Score. Did It Improve the System?](https://piszczek.hashnode.dev/your-ai-agent-improved-its-score-did-it-improve-the-system?utm_source=hashnode&utm_medium=feed)

A thousand research agents are useful only if their discoveries survive verification.

Sep 12 · 4 min read · piszczek.hashnode.dev  
Read the article

-   [#artificial-intelligence](https://hashnode.com/tag/artificial-intelligence)
-   [#machine-learning](https://hashnode.com/tag/machine-learning)
-   [#ai-agents](https://hashnode.com/tag/ai-agents)
-   [#software-architecture](https://hashnode.com/tag/software-architecture)

## Written by

[Michał Piszczek](https://hashnode.com/@michalpiszczek)

@michalpiszczek · Kraków, Poland

  
[View profile](https://hashnode.com/@michalpiszczek)

CEO / CTO / Founder. AI infrastructure & economics. Author of the Joule Wars concept — piszczek.pl

CTO of Archdesk; founder and former CEO of Robotero (acquired), Rejsomat.pl, Inclify and Lextron.ai. Ex white-hat hacker. I write about AI infrastructure &amp; economics — author of the Joule Wars concept. Home: https://piszczek.pl

## Responses 1

Markdown supported · ⌘↵ to post

[Vlad Zoff](https://hashnode.com/@vladzoff)

[Oct 1](https://hashnode.com/posts/your-ai-agent-improved-its-score-did-it-improve-the-system/6aa5d1b67cfde2f47ac4f72d/comment/6abdf372d213d3267f0d0175)

Benchmark improvement can be a dangerous proxy. An agent can get better at the metric by changing the system around the task, while the actual workflow becomes harder to reason about. I like separating the task outcome, the evaluation signal, and the system changes instead of treating one score as the whole result.
