Tag

#webllm

4 posts0 followers

Explore Hashnode

Alternatives

Implementing Client-Side AI in E-Commerce (WebLLM & Privacy-First Architecture)

How to bring Enterprise-grade conversational AI to e-commerce without the six-figure cloud infrastructure costs. A deep dive into Edge AI, WebGPU, and deterministic JavaScript guardrails using Llama 3.2 and native browser APIs.

9 min readvibrisse-studio.hashnode.dev

Yunus Emre VurgunOct 15

Agents That Live in the Tab: A Practical Guide to Browser-Side AI Agents with Local Inference

How to build browser-side AI agents with local inference via WebGPU and WebLLM: architecture, tool loops, privacy and practical code.

15 min readyunusemrevurgun.hashnode.dev

ZyVOPOct 3

MicroLLM: Let Your Users Bring Their Own AI Keys

MicroLLM lets users bring their own AI keys so developers can avoid token bills. We also look at browser-based LLMs as a key-free alternative.

15 min readblog.zyvop.com

Pourya AkraminayeriFeb 27

Why I built a "Second Brain" for Browser-Native LLMs (and why you should too)

Born from the Lokul privacy AI, LokulMem is an open-source JS memory layer that manages chat history and context windows for any browser-native LLM.

5 min readstay-lokul.hashnode.dev

ScribblerFeb 19, 2025

LLM in Browser using WebLLM and WebGPU

The rise of large language models (LLMs) like GPT-4 and Llama has transformed the AI landscape, but most of these models run on powerful cloud servers. What if you could run an LLM directly in your browser without relying on external APIs? This is wh...

3 min readscribbler-blog.hashnode.dev

Search Hashnode