--- title: "#ai-evaluation articles | Hashnode" description: "Explore 18 articles tagged #ai-evaluation on Hashnode. Tutorials, guides, and how-tos from the community." url: "https://hashnode.com/tag/ai-evaluation" --- Tag # #ai-evaluation 18 posts · 1 followers [Nagappan S](https://hashnode.com/@imkarthik03) · [Nov 4](https://hashnode.com/posts/llm-as-a-judge-using-one-model-to-grade-another-and-where-it-fools-you/6aeafeb3f128828a14a16cc1) ### [LLM-as-a-Judge: Using One Model to Grade Another (and Where It Fools You)](https://nagspidey.hashnode.dev/llm-as-a-judge-using-one-model-to-grade-another-and-where-it-fools-you?utm_source=hashnode&utm_medium=feed) LLM-as-a-Judge 8 min read · [nagspidey.hashnode.dev](https://nagspidey.hashnode.dev/llm-as-a-judge-using-one-model-to-grade-another-and-where-it-fools-you?utm_source=hashnode&utm_medium=feed) [2](https://hashnode.com/posts/llm-as-a-judge-using-one-model-to-grade-another-and-where-it-fools-you/6aeafeb3f128828a14a16cc1) [Adam Jaber](https://hashnode.com/@adamjaber) · [Oct 19](https://hashnode.com/posts/llm-as-a-judge-bias/6ad5a6517f8b9ebbd4a1f570) ### [LLM-as-a-Judge Bias: Why Your Eval Score Climbs While Your Answers Get Worse](https://simplyexplained.hashnode.dev/llm-as-a-judge-bias?utm_source=hashnode&utm_medium=feed) Position, length, and self-preference bias in LLM judges, with the swap test, the pad test, and the calibration code to catch them 11 min read · [simplyexplained.hashnode.dev](https://simplyexplained.hashnode.dev/llm-as-a-judge-bias?utm_source=hashnode&utm_medium=feed) [Muhammad Azlaan Zubair](https://hashnode.com/@mdazlaanzubair) · [Sep 25](https://hashnode.com/posts/jev-is-not-a-paradigm-shift-it-s-ust-a-fast-classifier/6ab6070e6f71e37fe1b72e1e) ### [Jev Is Not a Paradigm Shift. It’s ust a Fast Classifier.](https://letinix.hashnode.dev/jev-is-not-a-paradigm-shift-it-s-ust-a-fast-classifier?utm_source=hashnode&utm_medium=feed) Jev Doesn't Fix LLM Evaluation. It Just Makes It Faster 16 min read · [letinix.hashnode.dev](https://letinix.hashnode.dev/jev-is-not-a-paradigm-shift-it-s-ust-a-fast-classifier?utm_source=hashnode&utm_medium=feed) [2](https://hashnode.com/posts/jev-is-not-a-paradigm-shift-it-s-ust-a-fast-classifier/6ab6070e6f71e37fe1b72e1e) [Sanath](https://hashnode.com/@sbhat1) · [Sep 24](https://hashnode.com/posts/how-botgauge-is-building-the-missing-layer-for-trustworthy-ai-agents/6ab4c35c5f20b00fc2a43ef8) ### [How BotGauge Is Building the Missing Layer for Trustworthy AI Agents](https://aiqa.hashnode.dev/how-botgauge-is-building-the-missing-layer-for-trustworthy-ai-agents?utm_source=hashnode&utm_medium=feed) Most AI agent failures never show up in a test suite. Here's why red teaming closes that gap. 9 min read · [aiqa.hashnode.dev](https://aiqa.hashnode.dev/how-botgauge-is-building-the-missing-layer-for-trustworthy-ai-agents?utm_source=hashnode&utm_medium=feed) [Muhammad Azlaan Zubair](https://hashnode.com/@mdazlaanzubair) · [Aug 22](https://hashnode.com/posts/context-compression-hidden-reacquisition-cost/6a8967b42663d26b2183bb8f) ### [Your Agent Passed the Eval. Its Retrieval Calls Still Tripled.](https://letinix.hashnode.dev/context-compression-hidden-reacquisition-cost?utm_source=hashnode&utm_medium=feed) Task completion can stay flat while context compression shifts an agent's budget from execution to redundant retrieval. 6 min read · [letinix.hashnode.dev](https://letinix.hashnode.dev/context-compression-hidden-reacquisition-cost?utm_source=hashnode&utm_medium=feed) [Muhammad Azlaan Zubair](https://hashnode.com/@mdazlaanzubair) · [Aug 20](https://hashnode.com/posts/agent-evals-are-production-security-boundaries/6a8718735f6e60a65db746f7) ### [Your AI Agent Eval Is a Production Security Boundary](https://letinix.hashnode.dev/agent-evals-are-production-security-boundaries?utm_source=hashnode&utm_medium=feed) A benchmark stops being neutral test infrastructure when the agent can execute code, cross trust boundaries, or affect real systems. 9 min read · [letinix.hashnode.dev](https://letinix.hashnode.dev/agent-evals-are-production-security-boundaries?utm_source=hashnode&utm_medium=feed) [2](https://hashnode.com/posts/agent-evals-are-production-security-boundaries/6a8718735f6e60a65db746f7) [Redwan Rahman](https://hashnode.com/@redwan-rahman) · [Aug 10](https://hashnode.com/posts/the-ruler-can-change-too-navigating-judge-drift-in-production-ai-evaluation/6a7a0fe2872f096cae9b27af) ### [The Ruler Can Change Too: Navigating Judge Drift in Production AI Evaluation](https://nirizan.hashnode.dev/the-ruler-can-change-too-navigating-judge-drift-in-production-ai-evaluation?utm_source=hashnode&utm_medium=feed) Redwan Rahman, Creator and Maintainer of NiriZan 8 min read · [nirizan.hashnode.dev](https://nirizan.hashnode.dev/the-ruler-can-change-too-navigating-judge-drift-in-production-ai-evaluation?utm_source=hashnode&utm_medium=feed) [2](https://hashnode.com/posts/the-ruler-can-change-too-navigating-judge-drift-in-production-ai-evaluation/6a7a0fe2872f096cae9b27af) [Shivam Bhardwaj](https://hashnode.com/@shivmbhrdwj) · [Aug 8](https://hashnode.com/posts/my-reflection-loop-made-things-worse-my-evaluation-framework-showed-me-why/6a775e207ab63cddbf340c1d) ### [My Reflection Loop Made Things Worse. My Evaluation Framework Showed Me Why.](https://shivambhardwaj.hashnode.dev/my-reflection-loop-made-things-worse-my-evaluation-framework-showed-me-why?utm_source=hashnode&utm_medium=feed) How building an evaluation framework before the agent revealed failures I never would have caught manually. 11 min read · [shivambhardwaj.hashnode.dev](https://shivambhardwaj.hashnode.dev/my-reflection-loop-made-things-worse-my-evaluation-framework-showed-me-why?utm_source=hashnode&utm_medium=feed) [Alexander Codes](https://hashnode.com/@alexandercodes) · [Jul 26](https://hashnode.com/posts/test-your-pydantic-ai-sql-agent-with-pydantic-evals/6a65651212e191f81d73af8a) ### [Test Your Pydantic AI SQL Agent with Pydantic Evals](https://alexandercodes.hashnode.dev/test-your-pydantic-ai-sql-agent-with-pydantic-evals?utm_source=hashnode&utm_medium=feed) Test a Pydantic AI SQL agent with Pydantic Evals and evaldata. Check if queries have the same meaning, then compare their results when needed. 7 min read · [alexandercodes.hashnode.dev](https://alexandercodes.hashnode.dev/test-your-pydantic-ai-sql-agent-with-pydantic-evals?utm_source=hashnode&utm_medium=feed) [Vamsi Krishna](https://hashnode.com/@vamsikrishna981) · [Jul 18](https://hashnode.com/posts/day-56-why-evaluating-the-model-is-not-enough/6a5f7ede9851aa36c991e26d) ### [Day 56: Why evaluating the model is not enough](https://blog.vamsiannamreddy.com/day-56-why-evaluating-the-model-is-not-enough?utm_source=hashnode&utm_medium=feed) Why evaluating agents means measuring the whole workflow users experience. 3 min read · [blog.vamsiannamreddy.com](https://blog.vamsiannamreddy.com/day-56-why-evaluating-the-model-is-not-enough?utm_source=hashnode&utm_medium=feed)