GGPUStackingpustack.hashnode.dev·3d ago · 6 min readDay 0 Benchmark: Deploying DeepSeek-V4-Flash-DSpark on GPUStack Doubles ThroughputThis article is based on a community benchmark contributed by a GPUStack user. DeepSeek-V4-Flash-DSpark enhances DeepSeek-V4-Flash by adding a Speculative Decoding module. Using the same model weights00
GGPUStackingpustack.hashnode.dev·5d ago · 8 min readGPUStack v2.2: From Model Serving to Token Operations, from Compute Pooling to GPU-as-a-ServiceDeploying a model and bringing it online is only the starting point of AI service delivery. As large language model applications move into scaled production, AI infrastructure is entering an inevitabl00
GGPUStackingpustack.hashnode.dev·Mar 10 · 5 min readGPUStack × MaxKB: Build a Powerful and Easy-to-Use Open-Source Enterprise AI Agent PlatformAs AI applications become increasingly common within organizations, more teams are beginning to focus on two core challenges: How to efficiently manage and deploy local large models How to quickly b00
GGPUStackingpustack.hashnode.dev·Mar 6 · 5 min readNo More Token Anxiety: Build an “Unlimited-Use” Local AI Assistant with GPUStack + OpenClawOver the past two years, more and more teams have integrated AI into their daily workflows. But soon, a practical issue emerged: The more the model is used, the faster Tokens are consumed, and both co00
GGPUStackingpustack.hashnode.dev·Nov 12, 2024 · 3 min readBuilding Your Private ChatGPT and Knowledge Base with AnythingLLM and GPUStackAnythingLLM [https://github.com/Mintplex-Labs/anything-llm] is an all-in-one AI application that runs on Mac, Windows, and Linux. Its goal is to enable the local creation of a personal ChatGPT using either commercial or open-source LLMs along with ve...00
