Building a Local LLM Benchmark Harness with TypeScript, Ollama & SQLite
Local LLMs are easier than ever to run, but they're surprisingly hard to benchmark fairly.
The first number most people look at is tokens per second. In practice, that number is influenced by everythi
jaivalsuthar.hashnode.dev9 min read