---
title: "Comment by Damiano Bianda on \"There is no 4B Qwen 3.8. The smallest open model is 27B, and here is what it took to run it on one rented GPU.\" | Hashnode"
description: "Great teardown. The size gap you documented is real on the ground: when I needed a model for a fully offline tool (explaining official letters, the kind of text"
url: "https://hashnode.com/posts/there-is-no-4b-qwen-38-the-smallest-open-model-is-27b-and-here-is-what-it-took-to-run-it-on-one-rent/6ad03c7c28eb9de96cce725c/comment/6ad36d035000549f41aa2ffc"
---

[Discussion](https://hashnode.com/posts/there-is-no-4b-qwen-38-the-smallest-open-model-is-27b-and-here-is-what-it-took-to-run-it-on-one-rent/6ad03c7c28eb9de96cce725c)

Comment [There is no 4B Qwen 3.8. The smallest open model is 27B, and here is what it took to run it on one rented GPU.](https://hashnode.com/posts/there-is-no-4b-qwen-38-the-smallest-open-model-is-27b-and-here-is-what-it-took-to-run-it-on-one-rent/6ad03c7c28eb9de96cce725c)

[Damiano Bianda](https://hashnode.com/@damianobianda)

[Oct 17](https://hashnode.com/posts/there-is-no-4b-qwen-38-the-smallest-open-model-is-27b-and-here-is-what-it-took-to-run-it-on-one-rent/6ad03c7c28eb9de96cce725c/comment/6ad36d035000549f41aa2ffc)

Great teardown. The size gap you documented is real on the ground: when I needed a model for a fully offline tool (explaining official letters, the kind of text that cannot leave the machine), nothing in the newest families was small enough for plain CPU, so I ended up on a 1B Gemma. Slower than your L4 numbers, about 40 seconds per document end to end, but the task budget allowed it. Your memory math is the part most "run it locally" tutorials skip: 18 GB before context is not a laptop model for most people. Did you measure how much extra memory the context window adds as you raise it past 4,096?