Optimising OpenAI API Latency: Vector Caching + Streaming in Node.js to Reduce TTFT

The Problem (Production Context) You've built an AI-powered code assistant for your engineering team. A developer types "Explain this function" — and then waits. And waits. The Time To First Token (TT