---
title: "Discussion on \"Evals before vibes\" | Hashnode"
description: "Discussion on \"Evals before vibes\". A small prompt eval for my WhatsApp assistant: three easy examples, 24 labelled cases, a code grader and an AI judge that missed some mistakes."
url: "https://hashnode.com/posts/evals-before-vibes/6afb20723fe6fb1cd9850605"
---

[Feed](https://hashnode.com/feed) /

Discussion

# [Evals before vibes](https://sayamjain.hashnode.dev/evals-before-vibes?utm_source=hashnode&utm_medium=feed)

A small prompt eval for my WhatsApp assistant: three easy examples, 24 labelled cases, a code grader and an AI judge that missed some mistakes.

3h ago · 12 min read · sayamjain.hashnode.dev  
Read the article

-   [#ai](https://hashnode.com/tag/ai)
-   [#llm](https://hashnode.com/tag/llm)
-   [#testing](https://hashnode.com/tag/testing)
-   [#evaluation](https://hashnode.com/tag/evaluation)

## Written by

[Sayam Jain](https://hashnode.com/@sayamjain)

@sayamjain · Bengaluru, India

  
[View profile](https://hashnode.com/@sayamjain)

AI Product Engineer | Full Stack | Applied AI | DevOps

AI Product Engineer in Bengaluru. I build full stack products end to end and write about shipping AI features in real products. Every article comes with code you can run: https://github.com/sayamjn/shipping-with-ai

## Responses

Markdown supported · ⌘↵ to post

No responses yet.
