---
title: "Discussion on \"⭐ Reducing LLM Costs & Latency with Semantic Cache\" | Hashnode"
description: "Discussion on \"⭐ Reducing LLM Costs & Latency with Semantic Cache\". Implementing semantic cache from scratch for production use cases.\nVrushank Vyas\nJul 11, 20235 min\n\nImage credits: Our future AI overlords. (No, seriously, Stability AI)\nLatency and Cost are significant hurdles for developers building on top of Large..."
url: "https://hashnode.com/posts/reducing-llm-costs-latency-with-semantic-cache/670cdc7afc355e1a289ca7b0"
---

[Feed](https://hashnode.com/feed) /

Discussion

# [⭐ Reducing LLM Costs & Latency with Semantic Cache](https://portkey-llm-elo-rating.hashnode.dev/reducing-llm-costs-latency-with-semantic-cache?utm_source=hashnode&utm_medium=feed)

Implementing semantic cache from scratch for production use cases. Vrushank Vyas Jul 11, 20235 min Image credits: Our future AI overlords. (No, seriously, Stability AI) Latency and Cost are significant hurdles for developers building on top of Large...

Oct 14, 2024 · 5 min read · portkey-llm-elo-rating.hashnode.dev  
Read the article

-   [#semantic-cache](https://hashnode.com/tag/semantic-cache)
-   [#latency](https://hashnode.com/tag/latency)
-   [#caching](https://hashnode.com/tag/caching)
-   [#cost-optimisation](https://hashnode.com/tag/cost-optimisation)
-   [#semantic](https://hashnode.com/tag/semantic)

## Written by

[Kavya](https://hashnode.com/@portkey-km)

@portkey-km

  
[View profile](https://hashnode.com/@portkey-km)

Portkey AI

## Responses

Markdown supported · ⌘↵ to post

No responses yet.
