---
title: "Comment by Kartik N V J K on \"Bigger Isn't Always Smarter\" | Hashnode"
description: "Your line that a model topping one leaderboard can look mediocre on another matches my experience: a coding agent I picked off a leaderboard flopped on our repo"
url: "https://hashnode.com/posts/bigger-isn-t-always-smarter/6ac21d7870ce8cc6030f8a87/comment/6ac54d9c27c1b61e1085abe0"
---

[Discussion](https://hashnode.com/posts/bigger-isn-t-always-smarter/6ac21d7870ce8cc6030f8a87)

Comment [Bigger Isn't Always Smarter](https://hashnode.com/posts/bigger-isn-t-always-smarter/6ac21d7870ce8cc6030f8a87)

[Kartik N V J K](https://hashnode.com/@kartik-nvj)

[Oct 6](https://hashnode.com/posts/bigger-isn-t-always-smarter/6ac21d7870ce8cc6030f8a87/comment/6ac54d9c27c1b61e1085abe0)

Your line that a model topping one leaderboard can look mediocre on another matches my experience: a coding agent I picked off a leaderboard flopped on our repo. I make the final call by replaying our own merged work, as I wrote up here: [kartiknvjk.hashnode.dev/i-picked-a-coding-agent-o…](https://kartiknvjk.hashnode.dev/i-picked-a-coding-agent-off-a-leaderboard-it-flopped-on-our-codebase). Do you have numbers for the 70B model's quality loss on that 4GB card?
