@portkey-km
Portkey AI
Nothing here yet.
Nothing here yet.
Oct 14, 2024 · 5 min read · Implementing semantic cache from scratch for production use cases. Vrushank Vyas Jul 11, 20235 min Image credits: Our future AI overlords. (No, seriously, Stability AI) Latency and Cost are significant hurdles for developers building on top of Large...
Join discussionOct 14, 2024 · 14 min read · Rohit Agarwal, Ayush Garg Apr 22, 2024∙12 min FrugalGPT is a framework proposed by Lingjiao Chen, Matei Zaharia, and James Zou from Stanford University in their 2023 paper "FrugalGPT: How to Use Large Language Models While Reducing Cost and Improvin...
Join discussion
Oct 14, 2024 · 11 min read · Learn how to use the eval framework to evaluate models & prompts to optimise LLM systems for the best outputs. Rohit Agarwal May 10, 2023 ∙ 9 min Conversation on Twitter There's been a lot of buzz around model evaluations since OpenAI open-sourced t...
Join discussion
Oct 14, 2024 · 2 min read · Vrushank Vyas Jan 2, 2024 ∙ 2 min In two days (i.e. Jan 4), OpenAI will retire 33 models, including GPT-3 (text-davinci-003) and various others. This is OpenAI's biggest model deprecation so far. Here's what you need to know: GPT-3 Model Retirement...
Join discussion
Oct 14, 2024 · 7 min read · Choosing an LLM from 50+ models available today is hard. We explore Elo ratings as a method to objectively rank and pick the best performers for our use case. Rohit Agarwal Apr 18, 20236 min Photo by Joshua Golde / Unsplash Large language models (LL...
Join discussion
