Tag feed

#local-ai

65 posts0 followers

Explore Hashnode

Alternatives

Trending tags this week

DSDarsh Shahfreecodecamp.org1d ago · 12 min read

How to Evaluate AI Agents with an LLM-as-a-Judge Harness in Python

In this tutorial, I'll show you how to evaluate a local AI agent with a simple, repeatable evaluation harness. The harness runs the agent against a set of test cases, checks the results with both rule

0

MMinoxpersonalaiassistant.hashnode.dev1d ago · 4 min read

OpenClaw - What it does, Who’s it for, What’s required

OpenClaw is a personal AI assistant that runs on your laptop, talks to local or remote models, and exposes itself through every messaging app you already use. It can actually does the work and gets th

0

NNakonakokawaiiai-change-brief.hashnode.dev6d ago · 9 min read

What I Learned While Exploring Local AI Tools

Recently, I have been spending more time exploring local AI tools and learning how different parts of the ecosystem work together. Until recently, I mostly thought about AI through web services and ch

0

NNakonakokawaiiai-change-brief.hashnode.dev6d ago · 5 min read

Gemma 4 12B on a 16GB Laptop: A Privacy-First Local AI Business Playbook

Google’s mid-sized multimodal open model creates a credible path to on-device services, but the winning offer is controlled workflow design—not a vague promise that “local” solves everything. For a sm

0

BKBrian Kingsolodev.appJul 9 · 12 min read

Installing vLLM onto EVO-X2.

Abstract. I download a vLLM Docker image that supports AMD, and the ROCm GPU driver that runs on the Strix Halo platform (AI Max+ 395 APU). I connect the running Docker container to local GGUF AI mode

0

RCRobert Collinsselfenrichment.hashnode.devJul 1 · 8 min read

dgx-spark-inference - Keeping good habits around local inference

Local inference has a habit of becoming folklore. You launch a model from a shell history fragment you can never quite find again. A context setting lives in a note somewhere. A faster quantization ge

0

TStarini sunilai-content-utilties.hashnode.devJun 22 · 4 min read

What Your Documents Mean, Not Just What They Say

On this page A Tiny Experiment Why Keywords Fail Meaning Without Matching Words The Hidden Layer A Simple Mental Model Try It Yourself The Aha Moment The Hidden Signal In the previous artic

0

NCNube Colectivanubecolectiva.hashnode.devJun 22 · 5 min read

6 Free Local AI Models That Are Getting Close to Claude in 2026

For years, models like Claude became the reference point for developers, writers, researchers, and professionals who needed strong reasoning, long-context analysis, coding ability, and natural convers

0

JWJiyao Wengwengjiyao.hashnode.devJun 14 · 12 min read

Gemma 4 for Telephony: I Replaced Two AI Models With One in My Voice Phone Agent — Until I Switched to Chinese

Building a phone agent on a multimodal LLM: dropping faster-whisper and letting Gemma 4 hear the caller directly — a response-time and reply-accuracy benchmark across English, French, and Mandarin My

0

YPYaroslav Pristupacode-friendly.hashnode.devJun 8 · 12 min read

Step-by-step guide to running Gemma-4 26B locally on budget GPUs

The local AI revolution just got a serious upgrade. Google's Gemma-4 26B model, combined with Unsloth's Quantization-Aware Training GGUF formats, makes it possible to run a 26-billion parameter model

0

#local-ai

Search Hashnode

#local-ai

Explore Hashnode

Trending tags this week

How to Evaluate AI Agents with an LLM-as-a-Judge Harness in Python

OpenClaw - What it does, Who’s it for, What’s required

What I Learned While Exploring Local AI Tools

Gemma 4 12B on a 16GB Laptop: A Privacy-First Local AI Business Playbook

Installing vLLM onto EVO-X2.

dgx-spark-inference - Keeping good habits around local inference

What Your Documents Mean, Not Just What They Say

6 Free Local AI Models That Are Getting Close to Claude in 2026

Gemma 4 for Telephony: I Replaced Two AI Models With One in My Voice Phone Agent — Until I Switched to Chinese

Step-by-step guide to running Gemma-4 26B locally on budget GPUs