Tag feed

#local-ai

63 posts0 followers

Explore Hashnode

Alternatives

Trending tags this week

NNakonakokawaiiai-change-brief.hashnode.dev13h ago · 9 min read

What I Learned While Exploring Local AI Tools

Recently, I have been spending more time exploring local AI tools and learning how different parts of the ecosystem work together. Until recently, I mostly thought about AI through web services and ch

0

NNakonakokawaiiai-change-brief.hashnode.dev21h ago · 5 min read

Gemma 4 12B on a 16GB Laptop: A Privacy-First Local AI Business Playbook

Google’s mid-sized multimodal open model creates a credible path to on-device services, but the winning offer is controlled workflow design—not a vague promise that “local” solves everything. For a sm

0

BKBrian Kingsolodev.app4d ago · 12 min read

Installing vLLM onto EVO-X2.

Abstract. I download a vLLM Docker image that supports AMD, and the ROCm GPU driver that runs on the Strix Halo platform (AI Max+ 395 APU). I connect the running Docker container to local GGUF AI mode

0

RCRobert Collinsselfenrichment.hashnode.devJul 1 · 8 min read

dgx-spark-inference - Keeping good habits around local inference

Local inference has a habit of becoming folklore. You launch a model from a shell history fragment you can never quite find again. A context setting lives in a note somewhere. A faster quantization ge

0

TStarini sunilai-content-utilties.hashnode.devJun 22 · 4 min read

What Your Documents Mean, Not Just What They Say

On this page A Tiny Experiment Why Keywords Fail Meaning Without Matching Words The Hidden Layer A Simple Mental Model Try It Yourself The Aha Moment The Hidden Signal In the previous artic

0

NCNube Colectivanubecolectiva.hashnode.devJun 22 · 5 min read

6 Free Local AI Models That Are Getting Close to Claude in 2026

For years, models like Claude became the reference point for developers, writers, researchers, and professionals who needed strong reasoning, long-context analysis, coding ability, and natural convers

0

JWJiyao Wengwengjiyao.hashnode.devJun 14 · 12 min read

Gemma 4 for Telephony: I Replaced Two AI Models With One in My Voice Phone Agent — Until I Switched to Chinese

Building a phone agent on a multimodal LLM: dropping faster-whisper and letting Gemma 4 hear the caller directly — a response-time and reply-accuracy benchmark across English, French, and Mandarin My

0

YPYaroslav Pristupacode-friendly.hashnode.devJun 8 · 12 min read

Step-by-step guide to running Gemma-4 26B locally on budget GPUs

The local AI revolution just got a serious upgrade. Google's Gemma-4 26B model, combined with Unsloth's Quantization-Aware Training GGUF formats, makes it possible to run a 26-billion parameter model

0

JCJim Chundevalelaccidentalcomplexity.hashnode.devJun 1 · 18 min read

Part 1: Building a Self-Hosted AI Agent Cluster with Raspberry Pi 5 and Hailo AI HAT+ 2

Introduction So there I was, staring at four Raspberry Pi 5s, two Hailo AI HAT+ accelerators, a growing pile of cables, and the uncomfortable realization that I had built a tiny data center to avoid s

0

TStarini sunilai-content-utilties.hashnode.devMay 30 · 5 min read

What Your Documents Whisper When Nobody's Looking

Most people think important information is easy to spot. Look at enough documents and you will find the important topics because they appear again and again. More mentions = more importance. Right? No

0

#local-ai

Search Hashnode

#local-ai

Explore Hashnode

Trending tags this week

What I Learned While Exploring Local AI Tools

Gemma 4 12B on a 16GB Laptop: A Privacy-First Local AI Business Playbook

Installing vLLM onto EVO-X2.

dgx-spark-inference - Keeping good habits around local inference

What Your Documents Mean, Not Just What They Say

6 Free Local AI Models That Are Getting Close to Claude in 2026

Gemma 4 for Telephony: I Replaced Two AI Models With One in My Voice Phone Agent — Until I Switched to Chinese

Step-by-step guide to running Gemma-4 26B locally on budget GPUs

Part 1: Building a Self-Hosted AI Agent Cluster with Raspberry Pi 5 and Hailo AI HAT+ 2

What Your Documents Whisper When Nobody's Looking