KKavyainportkey-llm-elo-rating.hashnode.dev·Oct 14, 2024 · 5 min read⭐ Reducing LLM Costs & Latency with Semantic CacheImplementing semantic cache from scratch for production use cases. Vrushank Vyas Jul 11, 20235 min Image credits: Our future AI overlords. (No, seriously, Stability AI) Latency and Cost are significant hurdles for developers building on top of Large...00
KKavyainportkey-llm-elo-rating.hashnode.dev·Oct 14, 2024 · 14 min read⭐️ Implementing FrugalGPT: Reducing LLM Costs & Improving PerformanceRohit Agarwal, Ayush Garg Apr 22, 2024∙12 min FrugalGPT is a framework proposed by Lingjiao Chen, Matei Zaharia, and James Zou from Stanford University in their 2023 paper "FrugalGPT: How to Use Large Language Models While Reducing Cost and Improvin...00
KKavyainportkey-llm-elo-rating.hashnode.dev·Oct 14, 2024 · 11 min read⭐️ Decoding OpenAI EvalsLearn how to use the eval framework to evaluate models & prompts to optimise LLM systems for the best outputs. Rohit Agarwal May 10, 2023 ∙ 9 min Conversation on Twitter There's been a lot of buzz around model evaluations since OpenAI open-sourced t...00
KKavyainportkey-llm-elo-rating.hashnode.dev·Oct 14, 2024 · 2 min read⭐️ OpenAI Model Deprecation GuideVrushank Vyas Jan 2, 2024 ∙ 2 min In two days (i.e. Jan 4), OpenAI will retire 33 models, including GPT-3 (text-davinci-003) and various others. This is OpenAI's biggest model deprecation so far. Here's what you need to know: GPT-3 Model Retirement...00
KKavyainportkey-llm-elo-rating.hashnode.dev·Oct 14, 2024 · 7 min read⭐️ Ranking LLMs with Elo RatingsChoosing an LLM from 50+ models available today is hard. We explore Elo ratings as a method to objectively rank and pick the best performers for our use case. Rohit Agarwal Apr 18, 20236 min Photo by Joshua Golde / Unsplash Large language models (LL...00
