Tag

#local-llm

135 posts0 followers

Explore Hashnode

Alternatives

Dragos Roua2d ago

[ Video ] Running Nanbeige 4.2 3B on my 16GB MacBook Pro

I tested Nanbeige 4.2 3b on a 16GB MacBook Pro. The 4bit quant is good, but the generation is relatively slow

2 min readdragosroua.hashnode.dev

Robert Degallan2d ago

Alibaba + unknown European IT company are cooking something that could crush AI Goliaths

Alibaba's Qwen4-27B model (David) and Amadeus' CoDoc (the rock) standard could tremble the AI Goliaths by providing a small local brain with context.

3 min readrobertdegallan.hashnode.dev

Charles Smith3d ago

The 2026 Homelab AI Stack: What's Worth Running

Hugging Face's advice after its July breach was to have a capable model on your own infrastructure before you need it. A homelab is a cheap place to learn what "capable" means.

6 min readchuckworks.hashnode.dev

1

Dragos Roua3d ago

[ Video ] Running K2 Horizon 3.7B on my 16GB MacBook Pro

K2 Horizon 3.7B runs comfortably on a 16GB MacBook Pro. Worth noting that the 7B parameter version was better, but way too slow.

2 min readdragosroua.hashnode.dev

Dragos Roua6d ago

Can AI Improve Itself Without Training? Well, Maybe…

A frontier model was capable to change a smaller model by just editing their weights. The short and long term consequences are fascinating.

3 min readdragosroua.hashnode.dev

Avneesh JadhavNov 4

Self-hosting Qwen 3.8 27B

Self-hosted Qwen 3.8 27B on a GPU pod with 2x Nvidia RTX 3090 GPUs and vLLM.

1 min readavneeshjadhav.hashnode.dev

Dragos RouaNov 2

[ Video ] Testing Ling 3.0 Tiny on my 16GB MacBook Pro

Ling 3.0 Tiny is a surprisingly good model to run on a 16GB MacBook Pro. Test generation can go as fast as 45 tokens / second.

2 min readdragosroua.hashnode.dev

Dragos RouaOct 31

[ Video ] Testing Apple Intelligence on my 16GB MacBook Pro

I tested the Apple Intelligence model Apple ships with its default install, by actually chatting with it. One of the fastest models so far.

2 min readdragosroua.hashnode.dev

Dragos RouaOct 29

[ Video ] Testing Spark-X2.6–4B on my 16GB MacBookPro

Spark 2.6 4B from Spark LLM is a decent model for its size. In my testing, there was even room left for other apps on my MacBook Pro

2 min readdragosroua.hashnode.dev

aiFetchlyOct 28

Inside Custom AI Providers: Multi-Model Routing in aiFetchly

Direct Answer: Power users optimize LLM latency, reasoning quality, and API expenses by configuring aiFetchly's Custom AI Provider engine to route distinct tasks across local and cloud models. By supp

3 min readaifetchly-app.hashnode.dev

Search Hashnode

Explore Hashnode

Trending tags this week

[ Video ] Running Nanbeige 4.2 3B on my 16GB MacBook Pro

Alibaba + unknown European IT company are cooking something that could crush AI Goliaths

The 2026 Homelab AI Stack: What's Worth Running

[ Video ] Running K2 Horizon 3.7B on my 16GB MacBook Pro

Can AI Improve Itself Without Training? Well, Maybe…

Self-hosting Qwen 3.8 27B

[ Video ] Testing Ling 3.0 Tiny on my 16GB MacBook Pro

[ Video ] Testing Apple Intelligence on my 16GB MacBook Pro

[ Video ] Testing Spark-X2.6–4B on my 16GB MacBookPro

Inside Custom AI Providers: Multi-Model Routing in aiFetchly