---
title: "Discussion on \"Optimising OpenAI API Latency: Vector Caching + Streaming in Node.js to Reduce TTFT\" | Hashnode"
description: "Discussion on \"Optimising OpenAI API Latency: Vector Caching + Streaming in Node.js to Reduce TTFT\". The Problem (Production Context)\nYou've built an AI-powered code assistant for your engineering team. A developer types \"Explain this function\" — and then waits. And waits. The Time To First Token (TT"
url: "https://hashnode.com/posts/optimising-openai-api-latency-vector-caching-streaming-in-node-js-to-reduce-ttft/6a0769dd73afc88757a1563e"
---

[Feed](https://hashnode.com/feed) /

Discussion

# [Optimising OpenAI API Latency: Vector Caching + Streaming in Node.js to Reduce TTFT](https://thetoolstack.hashnode.dev/optimising-openai-api-latency-vector-caching-streaming-in-node-js-to-reduce-ttft?utm_source=hashnode&utm_medium=feed)

The Problem (Production Context) You've built an AI-powered code assistant for your engineering team. A developer types "Explain this function" — and then waits. And waits. The Time To First Token (TT

May 15 · 11 min read · thetoolstack.hashnode.dev  
Read the article

## Written by

[The ToolStack](https://hashnode.com/@TheToolStack)

@TheToolStack

  
[View profile](https://hashnode.com/@TheToolStack)

Everything Tech Based

## Responses

Markdown supported · ⌘↵ to post

No responses yet.