---
title: "Discussion on \"Building haven bench in the open, and the flaky CI ghost it flushed out\" | Hashnode"
description: "Discussion on \"Building haven bench in the open, and the flaky CI ghost it flushed out\". I shipped a tokens/sec benchmark for local models. The unit tests were green, and then CI turned red in a way that looked like my fault. It wasn't. Here's the whole hunt: a chown that raced the tide, set -e, and a zsh lock file that vanished mid-sweep."
url: "https://hashnode.com/posts/building-haven-bench-in-the-open-and-the-flaky-ci-ghost-it-flushed-out/6a3c16b8f27af9c50e5eca0c"
---

[Feed](https://hashnode.com/feed) /

Discussion

# [Building haven bench in the open, and the flaky CI ghost it flushed out](https://inferhaven.hashnode.dev/building-haven-bench-in-the-open-and-the-flaky-ci-ghost-it-flushed-out?utm_source=hashnode&utm_medium=feed)

I shipped a tokens/sec benchmark for local models. The unit tests were green, and then CI turned red in a way that looked like my fault. It wasn't. Here's the whole hunt: a chown that raced the tide, set -e, and a zsh lock file that vanished mid-sweep.

Jun 24 · 9 min read · inferhaven.hashnode.dev  
Read the article

-   [#devops](https://hashnode.com/tag/devops)
-   [#debugging](https://hashnode.com/tag/debugging)
-   [#bash](https://hashnode.com/tag/bash)
-   [#build-in-public](https://hashnode.com/tag/build-in-public)

## Written by

[InferHaven](https://hashnode.com/@inferhaven)

@inferhaven

  
[View profile](https://hashnode.com/@inferhaven)

Bringing privacy & security to the AI dev environment by default.

Bringing privacy &amp; security to the AI dev environment by default.

## Responses

Markdown supported · ⌘↵ to post

No responses yet.
