---
title: "Discussion on \"LLM benchmark stimulus audit: 33 of 80 pairs not clean\" | Hashnode"
description: "Discussion on \"LLM benchmark stimulus audit: 33 of 80 pairs not clean\". Sunny Chokshi. November 6, 2026.\n\nAfter my runs finished I did an LLM benchmark stimulus audit on my own matched pairs. Of the 80 pairs that have both a plain and an indirect form, 33 differ in more t"
url: "https://hashnode.com/posts/llm-benchmark-stimulus-audit-33-of-80-pairs-not-clean/6af72a3eaeb41c351252eed2"
---

[Feed](https://hashnode.com/feed) /

Discussion

# [LLM benchmark stimulus audit: 33 of 80 pairs not clean](https://sunnychokshi.hashnode.dev/llm-benchmark-stimulus-audit-33-of-80-pairs-not-clean?utm_source=hashnode&utm_medium=feed)

Sunny Chokshi. November 6, 2026. After my runs finished I did an LLM benchmark stimulus audit on my own matched pairs. Of the 80 pairs that have both a plain and an indirect form, 33 differ in more t

6d ago · 5 min read · sunnychokshi.hashnode.dev  
Read the article

-   [#security](https://hashnode.com/tag/security)
-   [#llm](https://hashnode.com/tag/llm)
-   [#python](https://hashnode.com/tag/python)
-   [#benchmark](https://hashnode.com/tag/benchmark)

## Written by

[Sunny Chokshi](https://hashnode.com/@sunnychokshi)

@sunnychokshi · Massachusetts, USA

  
[View profile](https://hashnode.com/@sunnychokshi)

Doctoral student researching LLM security

I am a doctoral student at the University of the Cumberlands. My dissertation looks at the adversarial robustness of large language models in cybersecurity applications. I write short notes on experiments I ran myself, mostly LLM code review and crypto API misuse, with the numbers and a link to the preprint or dataset behind each one. Google Scholar: https://scholar.google.com/citations?user=0dosaOcAAAAJ

## Responses

Markdown supported · ⌘↵ to post

No responses yet.
