Tag

#latency

119 posts2 followers

Explore Hashnode

Alternatives

nRouter.aiOct 14 · 3 min read

Reading a Benchmark Table Honestly: TTFT Percentiles From a Warm-Pool Gateway Test

Vendor benchmarks deserve suspicion. Most hide the workload, cherry-pick the tier, or quote a p50 and let you assume the tail behaves. So let's read one the way it should be read — method first, numbe

nrouter.hashnode.dev

Vijay ChoudharyOct 6 · 22 min read

From Event to Endpoint: Engineering a Real-Time Sports Data Architecture That Doesn't Lag

A goal is scored. Eleven seconds later, your app still shows 0 to 0. Meanwhile a user in another tab sees 1 to 0, and a third user sees the goal twice. Nothing crashed. Every service was up. The archi

bettechmagnetics.hashnode.dev

Vijay ChoudharyOct 6 · 16 min read

Why "Sub-50ms" Claims Are Mostly Meaningless Without Knowing Which Latency They Measure

Every API landing page has a number on it. "Sub-50ms." "Real-time." "Lightning fast." It sits next to a green dot and a globe animation, and it is supposed to settle the argument before you have writt

bettechmagnetics.hashnode.dev

Mohammed UsmaniSep 29 · 11 min read

From 2.44 s to 1.81 s: working through my voice agent's latency list, and the fast model that went silent

TL;DR Part 1 ended with a list of things to try. I tried all of them on the same phone agent, now running a recruiter's pre-screening call. At the agent, the median reply went from 2.44 s to 1.81 s

mohammed-usmani.hashnode.dev

Rutu VarhadiSep 28 · 5 min read

Can Network Latency be used as a 'Distance Sensor'?

Imagine you are sitting in Mumbai; you send a data packet to the other side of the world and get a response within a fraction of a second. You know exactly how long the journey took. But can you tell

my-networkingblog.hashnode.dev

Mohammed UsmaniSep 26 · 11 min read

LiveKit turn detection on real phone calls: why a 2-second average hid a 3.6-second stall

TL;DR I built a voice agent you can call from a real phone (SIP through LiveKit Cloud) and measured every turn instead of trusting averages. On a test call the average reply took about 2 seconds, bu

mohammed-usmani.hashnode.dev

Nasim Hossain RabbiSep 14 · 10 min read

Little's Law: The Formula Behind Every Good System Design Interview

You're in a system design interview and you're asked to design a banking application. Customers can: Login View accounts Check transactions Transfer money Download statements The interviewer ad

blog.nasimhossain.dev

abhishek pareekAug 20 · 7 min read

Reading Latency Effectively

TL;DR Mean latency describes total latency averaged across requests.p50 describes the middle of the distribution.p90 and p99 describe progressively higher boundaries in the tail.The latency SLO measur

abhishekpareek.dev

marcuschenAug 10 · 8 min read

Two weeks before launch, every turn was green and the call still died

The dashboard was a wall of green. Word error rate under 5 percent. Intent classification at 94 percent on our eval set. Response appropriateness, graded by a rubric we trusted, sitting comfortably in

voicelatency.hashnode.dev