#evaluation

1d ago · 15 min read · My name is Hung also known as Paul. I have worked in the technical field for 6 years and started learning about LLM around spring 2023, when ChatGPT had just launched and the whole world was asking

Join discussion

AKAbhijit Kadamevaluate.hashnode.dev

0

From Weeks to Minutes: How E-Valuate AI Evaluates Handwritten Answer Sheets at Scale

5d ago · 7 min read · We are teachers. Every examination season meant evenings, weekends, and sometimes entire holidays spent evaluating stacks of handwritten answer sheets. That experience — evaluating stacks of 50 to 100

Join discussion

AJAlen Joypragmaticstack.in

4

In Probabilistic Systems, You Watch the Shape of Success

Jun 9 · 18 min read · 🗓️ Last updated June 2026. Field names and stability levels track the still evolving OpenTelemetry GenAI semantic conventions; check them against the official spec on GitHub before adoption. There's

LMLara and 3 more commented

MPMEET PATELmeetp2022.hashnode.dev

0

My RAGAS Scores Varied Between Runs. That Was the Most Useful Finding of All

Jun 7 · 8 min read · I have a document assistant that answers questions from enterprise cloud documentation. Azure OpenAI generates the answers, Azure AI Search handles retrieval. It works. People use it. The answers soun

Join discussion

RMRobert McBrydeai-notebook.uk

0

Evaluation: Measuring our Agents capabilities with Gaia

Jun 4 · 5 min read · When working with the non-deterministic nature of LLMs (the same prompt will return different responses each time, due to the probabilistic nature of LLMs) traditional means of software testing are no

Join discussion

SYShota Yamazakiblog.simukappu.com

0

AI Agent Evaluation: What, How, When

May 22 · 20 min read · Most teams pick the AI agent evaluation tool their framework integrates with, then a quarter later notice that one corner of the evaluation space is covered and the rest is exposed. The market has no

Join discussion

VPVarun Pratap Bhardwajqualixar.hashnode.dev

0

The Pass^k Wall: One Failure Mode Behind AI's Quietly Disastrous Week

May 6 · 10 min read · Last week was loud for AI. Five separate stories ran the front page of every tech outlet, every newsletter, every Slack channel that takes itself seriously. Anthropic admitted three quality regressions its own evaluation suite missed. GitHub announce...

Join discussion

AMAamer Mehaisimehaisi.hashnode.dev

0

The Arabic LLM Gap Nobody's Measuring

Apr 22 · 4 min read · The Arabic LLM Gap Nobody's Measuring Most benchmarks tell you how well a model speaks English. QIMMA asks a harder question: does it actually understand Arabic? Not the textbook version. The real thing—poetry, dialects, classical grammar, modern sla...

Join discussion

AAAbstract Algorithmsabstractalgorithms.dev

0

LLM Software Development Pitfalls: What to Avoid and When to Simplify

Apr 17 · 20 min read · TLDR: Most bad LLM products do not fail because the model is weak. They fail because teams wrap a maybe-useful model in too much architecture: prompt spaghetti, no eval harness, weak tool schemas, hug

Join discussion

AKAyush Kumarayushbuilds.hashnode.dev

0

I Evaluated My AI Agent. Three Decisions Were Wrong.

Apr 17 · 9 min read · In my last post, I built a customer support agent with conditional routing, RAG-grounded responses, and human-in-the-loop approval for billing actions. I ended that post by listing evaluations as the

Join discussion

Tag feed

Tag feed

#evaluation

Trending tags this week

We Burned Dozens of Sprints Learning This, But You Don’t Have To

From Weeks to Minutes: How E-Valuate AI Evaluates Handwritten Answer Sheets at Scale

In Probabilistic Systems, You Watch the Shape of Success

My RAGAS Scores Varied Between Runs. That Was the Most Useful Finding of All

Evaluation: Measuring our Agents capabilities with Gaia

AI Agent Evaluation: What, How, When

The Pass^k Wall: One Failure Mode Behind AI's Quietly Disastrous Week

The Arabic LLM Gap Nobody's Measuring

LLM Software Development Pitfalls: What to Avoid and When to Simplify

I Evaluated My AI Agent. Three Decisions Were Wrong.

#evaluation

Search Hashnode

#evaluation

Trending tags this week

We Burned Dozens of Sprints Learning This, But You Don’t Have To

From Weeks to Minutes: How E-Valuate AI Evaluates Handwritten Answer Sheets at Scale

In Probabilistic Systems, You Watch the Shape of Success

My RAGAS Scores Varied Between Runs. That Was the Most Useful Finding of All

Evaluation: Measuring our Agents capabilities with Gaia

AI Agent Evaluation: What, How, When

The Pass^k Wall: One Failure Mode Behind AI's Quietly Disastrous Week

The Arabic LLM Gap Nobody's Measuring

LLM Software Development Pitfalls: What to Avoid and When to Simplify

I Evaluated My AI Agent. Three Decisions Were Wrong.