---
title: "Discussion on \"The Model Changed. My Skill Didn't. The Score Still Dropped.\" | Hashnode"
description: "Discussion on \"The Model Changed. My Skill Didn't. The Score Still Dropped.\". What agent evals taught me about moving model floors, noisy LLM judges, and treating the evaluator as part of the instrument"
url: "https://hashnode.com/posts/the-model-changed-my-skill-didn-t-the-score-still-dropped/6ac3cdcb13d6c7ff530ab3f4"
---

[Feed](https://hashnode.com/feed) /

Discussion

# [The Model Changed. My Skill Didn't. The Score Still Dropped.](https://blog.technopathy.club/the-model-changed-my-skill-didn-t-the-score-still-dropped?utm_source=hashnode&utm_medium=feed)

What agent evals taught me about moving model floors, noisy LLM judges, and treating the evaluator as part of the instrument

Oct 5 · 9 min read · blog.technopathy.club  
Read the article

-   [#ai](https://hashnode.com/tag/ai)
-   [#evals](https://hashnode.com/tag/evals)
-   [#llm](https://hashnode.com/tag/llm)
-   [#testing](https://hashnode.com/tag/testing)
-   [#coding-agents](https://hashnode.com/tag/coding-agents)
-   [#keepthewhy](https://hashnode.com/tag/keepthewhy)
-   [#context-engineering](https://hashnode.com/tag/context-engineering)

## Written by

[Oliver Zehentleitner](https://hashnode.com/@oliver-zehentleitner)

@oliver-zehentleitner · Vienna, Austria

  
[View profile](https://hashnode.com/@oliver-zehentleitner)

DevSecOps · Python · AI-driven Development · Real-world findings from production systems.

I build systems that work — technically sound, security-first, and actually useful to the people who depend on them. Creator of the UNICORN Binance Suite — six open-source Python libraries with 3.3M+ downloads and 390+ dependent public projects — and Keep the Why, an open-source agent skill that preserves the reasoning behind engineering decisions alongside the code. Currently pioneering AI-driven open-source maintenance: running a controlled AI agent that maintains production code and documenting what this shift means for engineering teams. Vienna, Austria 🇦🇹

## Responses

Markdown supported · ⌘↵ to post

No responses yet.
