Search posts, tags, users, and pages
Michał Piszczek
CEO / CTO / Founder. AI infrastructure & economics. Author of the Joule Wars concept — piszczek.pl
I spent a night trying to fit a dense 30B model, 256K context, vision, and speculative decoding onto one 24 GB GPU. The fastest quant lost. The quant with the lowest perplexity lost too. What won was
Markdown supported · ⌘↵ to post
No responses yet.