Tag feed

#local-llm

103 posts0 followers

Explore Hashnode

Alternatives

Trending tags this week

Hhy-tokenhy-token.hashnode.dev3d ago · 3 min read

Omnigent is a meta-harness. Liel is an event-sourced memory file.

Databricks announced Omnigent on 2026-06-13. The official blog describes Omnigent as a meta-harness that sits above Claude Code, Codex, Pi, and custom agents. Its goal is to support agent composition,

0

SKSathvic Kollusathvickollu.hashnode.dev6d ago · 6 min read

How much VRAM do you actually need to run Llama 3 or Gemma locally?

Every few days someone in a local LLM thread asks the same question: "will this run on my 3060?" And the answers are almost always vibes. "Should be fine." "Probably need to quantize." Nobody shows th

0

Ssatyasutarprimitives.hashnode.devJun 13 · 11 min read

Building an Enterprise Second Brain Locally with MLX + OpenCode

What Is an Enterprise Second Brain? The term "second brain" was popularized by productivity thinkers as a way to describe an external system for capturing, organizing, and retrieving knowledge — freei

0

HMHari Marthalaharibuilds.hashnode.devJun 6 · 4 min read

How to Run AI Models Offline on Linux

If you’ve procrastinated on running AI models offline and exploring them, I’m in the same boat. I planned to run models locally, even bought a new laptop for it, but five months later my GPU still isn

0

DPDevarsh Pateldevarshpatel.hashnode.devMay 29 · 13 min read

I Ran a monster GPT-OSS-120B MoE AI Model on my MacBook — Local LLM(No Cloud GPU) with llama.cpp

💡 Running a large language model (LLM) locally gives you absolute privacy, zero ongoing subscription costs, and the ability to work entirely offline. It is ideal if you have strict data security need

0

NLNagesh Lakshmana Gowdanageshtech.hashnode.devMay 10 · 4 min read

How to Run Ollama Locally: Complete Beginner’s Guide

Artificial Intelligence is evolving rapidly, and developers are increasingly looking for ways to run Large Language Models (LLMs) locally on their machines. One of the easiest tools to achieve this is

0

강강문규devsnack.hashnode.devMay 6 · 8 min read

Every Optimized Model for NVIDIA DGX Spark GB10 — Benchmarked & Ranked (April 2026)

Got your hands on an NVIDIA DGX Spark but have no idea which models to run on it? I scoured every GB10-optimized model on Hugging Face so you don't have to. Table of Contents What Makes DGX Spark Spe

1

L

APAnkita Patilblog.ankitapatil.devMay 4 · 3 min read

Moving the Brains to the Metal: My Local AI Setup with Gemma 4

Building for the web in 2026 means being an AI orchestrator. Most devs are just API consumers, but if you want to understand the stack, you move the intelligence to the metal. I recently migrated my w

0

VBVlad Butacuomniforge.onlineMay 4 · 9 min read

Green AI at the Edge: When Local LLMs Save Electricity and Water

AI sustainability keeps getting framed around the wrong question: does a local LLM use less electricity and water than ChatGPT or Claude? The sharper question is: how many frontier-model calls are we

0

GMGustavo M.hola-gus.hashnode.devMay 4 · 5 min read

How to Use MCP Servers With Ollama and Local LLMs

Ollama makes it easy to run open-weight models locally, but it does not ship an MCP client. The MCP protocol is handled at the client layer, not inside the LLM itself. To use MCP servers with a local

0

#local-llm

Search Hashnode

#local-llm

Explore Hashnode

Trending tags this week

Omnigent is a meta-harness. Liel is an event-sourced memory file.

How much VRAM do you actually need to run Llama 3 or Gemma locally?

Building an Enterprise Second Brain Locally with MLX + OpenCode

How to Run AI Models Offline on Linux

I Ran a monster GPT-OSS-120B MoE AI Model on my MacBook — Local LLM(No Cloud GPU) with llama.cpp

How to Run Ollama Locally: Complete Beginner’s Guide

Every Optimized Model for NVIDIA DGX Spark GB10 — Benchmarked & Ranked (April 2026)

Moving the Brains to the Metal: My Local AI Setup with Gemma 4

Green AI at the Edge: When Local LLMs Save Electricity and Water

How to Use MCP Servers With Ollama and Local LLMs