---
title: "Discussion on \"I read the metric libraries of five widely-used eval tools. The metric was never the hard part.\" | Hashnode"
description: "Discussion on \"I read the metric libraries of five widely-used eval tools. The metric was never the hard part.\". Every LLM eval tool sells you the same headline: a big bag of ready-made metrics. Fifty of them. Seventy. Pick one, call evaluate(), get a number. The pitch works because it is true, and because it qu"
url: "https://hashnode.com/posts/i-read-the-metric-libraries-of-five-widely-used-eval-tools-the-metric-was-never-the-hard-part/6a7b6feada84d66b0fbb7f1b"
---

[Feed](https://hashnode.com/feed) /

Discussion

# [I read the metric libraries of five widely-used eval tools. The metric was never the hard part.](https://llmasajudge.hashnode.dev/i-read-the-metric-libraries-of-five-widely-used-eval-tools-the-metric-was-never-the-hard-part?utm_source=hashnode&utm_medium=feed)

Every LLM eval tool sells you the same headline: a big bag of ready-made metrics. Fifty of them. Seventy. Pick one, call evaluate(), get a number. The pitch works because it is true, and because it qu

Aug 11 · 9 min read · llmasajudge.hashnode.dev  
Read the article

-   [#llm-evaluation](https://hashnode.com/tag/llm-evaluation)
-   [#open-source](https://hashnode.com/tag/open-source)
-   [#llm-as-judge](https://hashnode.com/tag/llm-as-judge)
-   [#mlops](https://hashnode.com/tag/mlops)

## Written by

[mayaandersson](https://hashnode.com/@mayaanderssondev)

@mayaanderssondev · Palo Alto CA

  
[View profile](https://hashnode.com/@mayaanderssondev)

Just a bored curious dev

## Responses

Markdown supported · ⌘↵ to post

No responses yet.
