1d ago · 8 min read · I Run a 40GB AI Model on a MacBook. Three Months of MLX on M1 Max Has Changed How I Think About Apple Silicon. It's Just a Laptop. But It's Running a 40GB Model Right Now. I'm drafting this on a MacBook Pro. Qwen 3.6 35B-A3B MoE Q8 — about 40GB of we...
Join discussion1d ago · 5 min read · ▶ Watch the race on YouTube: https://www.youtube.com/watch?v=2KeTDDodE0A April 22, 2026. Anthropic's Claude Code Max plan jumped to $100 a month. I ran a live three-way AI race on the exact same prompt — Gemma 31B local, Llama 70B local, and Claude...
Join discussionApr 6 · 5 min read · My M4 Max was decoding Qwen3.5 at 58 tokens per second yesterday. Today it's doing 112. Same model, same hardware, same prompt. The only thing that changed was a single environment variable. Ollama 0.19 shipped on March 31, 2026 with a preview of its...
Join discussion
Mar 18 · 3 min read · Apple Silicon changed what is possible for local AI. The unified memory architecture means ML models can run on the GPU without copying data between CPU and GPU memory. For a desktop agent that needs to process screen content in real-time, this matte...
Join discussionMar 14 · 8 min read · It started with a tweet. Google Devs posted a demo of FunctionGemma running a game, and I watched this tiny model parse natural language into structured function calls in real time. My immediate thoug
Join discussion
Oct 30, 2025 · 4 min read · ML Pipeline Tutorial: Fine-tune Models Link to GitHub project you gonna need to follow this: project Learn to build a complete ML pipeline for fine-tuning models using F1 racing data. This tutorial covers data processing, workflow management, and m...
Join discussionSep 15, 2025 · 6 min read · From Stub to Coherent MLX Model, a story-shaped release note Getting Meta's efficient 950M parameter model running natively on Apple Silicon for fast, local inference I’ve done a tiny bit of contributions to the llama.cpp community, including adding ...
Join discussionSep 25, 2024 · 2 min read · 在 2024年9月 @kyutai_labs 在 Huggingface 以及 GitHub 上釋出了即時語音對話模型，該模型是個 7B 模型，如果你有張 RTX 3090 24GB 或者與之大小相符的顯卡就可以跑這顆 Model 了，再來就可能要選擇量化模型了。 相信大家可能或多或少都有看到這篇在 Ｘ 上的貼文，這是一個來自法國的初創團隊 Kyutai，在七月初發佈對標 GPT-4o 的神奇模型。經歷兩個多月的時間，他們也對兌現自己的承諾，不僅把模型開源，甚至程式碼也開源了！ 論文: ht...
Join discussion
