@DhavalSingh

Dhaval Singh

@DhavalSingh

Website

Writing about Software Development, Backend in particular!

Bangalore, IndiaJoined October 2023

About

Nothing here yet.

Available for

Nothing here yet.

Dhaval Singh's blogs

Dhaval Singh's Blogwww.dsdev.in45 posts

Articles Threads Comments

Recently published

DSDhaval Singhdsdev.in

The cost of doing evals has gone down substantially...

1d ago · 4 min read · Evals have been extremely important for building agentic products. This is a known fact, but the main problem has always been doing better or decent evals. The hard part of evals is not just building

Join discussion

DSDhaval Singhdsdev.in

K.I.S.S(Keep It Static, Stupid): System prompt ft. caching

Apr 22 · 5 min read · The 3 most important things that control what happens to the cache are: Tool Defs Systemp Prompts Messages Explicitly in this order! Atleast confirmed for claude and gpt models. The gemini docs a

Sstack commented

DSDhaval Singhdsdev.in

Not All Caches Are Equal: Claude, OpenAI, and Gemini

Apr 22 · 2 min read · We focus quite a bit on prompt caching @LittlebirdAI to ensure lower latencies and cost. But it's very tricky to get it right, esp when you deal with multiple providers. There are quite a few really g

Join discussion

DSDhaval Singhdsdev.in

Some notes on Agentic search & Turbopuffer

Aug 31, 2025 · 6 min read · Search systems are always broken. Mend them with care, and like Kintsugi, they become more beautiful. Recently I’ve been diving deep in improving search & retrieval for Littlebird and here are some notes worth sharing. Turbopuffer Tpuf is an amazing...

Join discussion

DSDhaval Singhdsdev.in

Counting tokens at scale using tiktoken

Jul 22, 2025 · 2 min read · Tiktoken is one of the most popular tokenizers out there. This is a really nice and simple cookbook that shows how to use it. Recently I was optimizing our token counting function that is often used to chunk data to send to embedding models(need prec...

Join discussion

Dhaval Singh

About

Available for

Dhaval Singh's blogs

Recently published

The cost of doing evals has gone down substantially...

K.I.S.S(Keep It Static, Stupid): System prompt ft. caching

Not All Caches Are Equal: Claude, OpenAI, and Gemini

Some notes on Agentic search & Turbopuffer

Counting tokens at scale using tiktoken

Search Hashnode

Dhaval Singh

About

Available for

Dhaval Singh's blogs

Recently published

The cost of doing evals has gone down substantially...

K.I.S.S(Keep It Static, Stupid): System prompt ft. caching

Not All Caches Are Equal: Claude, OpenAI, and Gemini

Some notes on Agentic search & Turbopuffer

Counting tokens at scale using tiktoken