Tag

#tokens-in-ai

5 posts0 followers

Explore Hashnode

Alternatives

🚀 Cutting LLM Token Costs with JDA-ZIP Protocol: A Lightweight Compression Approach

An open-source (GPLv3) solution using Semantic Anchors & Local Dictionaries to reduce LLM token costs and memory overhead on edge devices.

4 min readhttpsgithubcomjdavid465jda-zip-protocol.hashnode.dev

Shubham MoreOct 10

Building with LLMs? Understand Tokens, API Costs, and How to Avoid Unexpected Bills

What every developer should know about token consumption, context management, and cost control before building AI-powered applications. By Shubham · Software Development Engineer

12 min readtheshubhammore.hashnode.dev

Akash GoenkaAug 3

Where the tokens go in an agent session

Most of what an agent session costs isn't the answer it produced — it's the same context, re-sent on every turn. Here's the one lever that matters.

7 min readcodebase-memory.hashnode.dev

NaveenKumar VRJul 5

AI - Fundamentals : Part 1 : LLM Tokens

Understanding Tokens, BPE, and LLM Costs

8 min readclaybrainer.com

1

ssnmaheshMay 31

What Lives Inside an LLM's Context Window

A language model can only respond to the text sitting right in front of it. That text is the context window — its short-term working memory. Once you can see what's inside it, almost every "weird" thing an AI does suddenly makes sense.

11 min readcorelogic.hashnode.dev

Search Hashnode