Tag feed

#caching

749 posts46 followers

Explore Hashnode

Alternatives

Trending tags this week

KSKynth Studioskynth.hashnode.dev18h ago · 5 min read

Your cache dedupes reads that finished, not reads in flight: the hour that took a shared database down

Google wrote to say one of my sites had picked up a new reason it could not be indexed: server error. By the time I went looking, every page it named answered fine. A crawl of 3,060 URLs under Googleb

0

CDCoding Dropletscodingdroplets.com1d ago · 11 min read

Semantic Caching for LLM Calls in ASP.NET Core: When to Use It and How

Every AI feature I have shipped eventually hits the same wall. Users ask the same twenty questions in a hundred different phrasings, and each one costs a full round trip to the model. Semantic caching

2

K

SSUPRABHATblog.suprabhat.site4d ago · 7 min read

Building Scalable Systems: Caching, Rate Limiting and Observability

Every application starts small. A few users, a single server, everything running smoothly. Then one day, traffic spikes. The database groans. Requests start timing out. Users leave. This isn't a hypot

0

NLNagesh Lakshmana Gowdanageshtech.hashnode.devAug 9 · 10 min read

Stop Paying Twice: Caching Strategies to Cut Your LLM API Costs

If you're running anything on top of an LLM API at scale, there's a good chance you're paying for the same computation over and over. The same system prompt. The same reference documents. The same han

0

Jjasmineparkjas-blogs.hashnode.devAug 6 · 7 min read

A 4% cache hit rate was costing us money. Here is the arithmetic I should have run first.

We turned on prompt caching for our document-QA service and the invoice went up. Not dramatically. About 5%. Enough that I assumed it was traffic growth for the first two weeks, and it was not. This p

0

AYAkash Yadavblog.akashy.com.npAug 4 · 9 min read

The Ultimate Guide to Next.js Caching (Part 2): Cache Invalidation, SWR, React Query & Real Production Architecture

This is Part 2 of my Next.js Caching series. In Part 1, we covered Browser Cache, CDN, Router Cache, Full Route Cache, Data Cache, unstable_cache, and use cache. Previously... We learned that a requ

0

AYAkash Yadavblog.akashy.com.npAug 4 · 5 min read

The Ultimate Guide to Next.js Caching (Part 1): Browser Cache, CDN, Data Cache & unstable_cache

When someone opens your website, does Next.js immediately query your database? Not always. A request may pass through multiple cache layers before your database is even touched. The more requests serv

0

DADaniel Anthony Romitelli Jrcraftedbydaniel.hashnode.devAug 3 · 4 min read

A Cache Key Is an Equivalence Relation

A retry should not become a new creative decision. When a video job fails halfway through and runs again, the user still asked for the same scene. If a timestamp or retry count changes the lookup, the

0

ASAman Singhamanksinghin.hashnode.devJul 24 · 7 min read

Redis Caching Best Practices and Pitfalls

The caching module covered the patterns and their failure modes one at a time. This article pulls them into a practical set of habits and warnings, the things experienced teams do by default and the m

0

ASAman Singhamanksinghin.hashnode.devJul 24 · 7 min read

Preventing Cache Stampede with Redis

A cache stampede is one of those failures that stays hidden until traffic is high, then takes down your database at the worst possible moment. A popular cached key expires, and in the brief instant be

0

#caching

Search Hashnode

#caching

Explore Hashnode

Trending tags this week

Your cache dedupes reads that finished, not reads in flight: the hour that took a shared database down

Semantic Caching for LLM Calls in ASP.NET Core: When to Use It and How

Building Scalable Systems: Caching, Rate Limiting and Observability

Stop Paying Twice: Caching Strategies to Cut Your LLM API Costs

A 4% cache hit rate was costing us money. Here is the arithmetic I should have run first.

The Ultimate Guide to Next.js Caching (Part 2): Cache Invalidation, SWR, React Query & Real Production Architecture

The Ultimate Guide to Next.js Caching (Part 1): Browser Cache, CDN, Data Cache & unstable_cache

A Cache Key Is an Equivalence Relation

Redis Caching Best Practices and Pitfalls

Preventing Cache Stampede with Redis