Tag

#litellm

23 posts0 followers

Explore Hashnode

Alternatives

A Poem on GitHub and a CVE Chain: the PoeLLM Botnet Mining on Exposed AI Infrastructure

Summary PoeLLM is malware that Black Lotus Labs (Lumen) has tracked since April 2026. It has compromised more than 3,400 servers, peaking at over 800 active systems per day. Victims are concentrated i

blog.fiscybersec.com

Vikram Kumar Shukla6d ago · 4 min read

The LiteLLM release everyone upgraded to was poisoned

The LiteLLM release everyone upgraded to was poisoned I pinned my dependencies this week. Not because of a CVE. Because three startup files shipped inside a release tens of thousands of projects depen

vikramkumarshukla.hashnode.dev

Gavin SaturOct 11 · 7 min read

Managing the LiteLLM Control Plane at Scale with Git-Driven Automation

If your engineering teams are adopting generative AI, you are likely relying on proxies like LiteLLM to sit between your internal systems and the dozens of large language models (LLMs) your teams want

blog.cybergav.in

Haithem SlimiSep 28 · 17 min read

How to Build an Intelligent Router for NVIDIA and Ollama with LiteLLM, JEV, and Memori on a Mac Mini (Part 2)

Part 1 covered the foundation: an NVIDIA API key, a local proxy for NVIDIA NIM, and OpenClaw configured with its native NVIDIA provider. That setup gave the Mac mini access to frontier NVIDIA models,

nightthoughts.me

Misbah SyedSep 14 · 8 min read

Set up LiteLLM Auto Router: send each prompt to the right model

Most AI apps let you pick one model, and then every query goes to it. "What's the capital of France?" goes to that model. "Find the race condition in our billing service" goes to the same one. Your si

misbahsy.hashnode.dev

Misbah SyedSep 10 · 9 min read

How to set up Cursor with LiteLLM

This guide connects Cursor to a LiteLLM proxy, one you run yourself or one your team already hosts. Cursor takes one base URL and one API key in its settings. The tldr version Cursor Settings, then M

misbahsy.hashnode.dev

Misbah SyedSep 9 · 7 min read

How to set up OpenAI Codex with LiteLLM

This guide connects OpenAI Codex to a LiteLLM proxy, one you run yourself or one your team already hosts. Codex reads one base URL out of a config file, so pointing it at LiteLLM gives you: Any model

misbahsy.hashnode.dev

Manu ShuklaJul 31 · 15 min read

AI gateway comparison 2026: LiteLLM vs Cloudflare vs Kong vs Bifrost vs OpenRouter for LLM cost control

AI gateway comparison 2026: LiteLLM vs Cloudflare vs Kong vs Bifrost vs OpenRouter for LLM cost control Summary. Frontier tokens keep getting cheaper. OpenAI cut the price of GPT-5.6 Luna by 80% and T

ecorpit.hashnode.dev

wasim AkramJun 22 · 4 min read

How I Accidentally Opened a Pull Request With 3 Lakh Lines of Code

I sat down to fix one bug. ONE. The kind you knock out in an hour and then go touch grass. I did not touch grass. I finished at 3am questioning what a branch even is. It's a litellm thing. Reuse a cod

wasimat404.hashnode.dev

Balraj SinghMay 30 · 18 min read

Claude Code + NVIDIA NIM API + LiteLLM + Terraform MCP: A Full Stack AI Dev Setup

I've Been Using Claude Code for Free — Here's the Exact Setup Nobody Talks About You can run Claude Code against NVIDIA's free NIM API (powered by DeepSeek V4 Pro) through a local proxy — with full M

balrajsingh.hashnode.dev

Search Hashnode

Explore Hashnode

Trending tags this week

A Poem on GitHub and a CVE Chain: the PoeLLM Botnet Mining on Exposed AI Infrastructure

The LiteLLM release everyone upgraded to was poisoned

Managing the LiteLLM Control Plane at Scale with Git-Driven Automation

How to Build an Intelligent Router for NVIDIA and Ollama with LiteLLM, JEV, and Memori on a Mac Mini (Part 2)

Set up LiteLLM Auto Router: send each prompt to the right model

How to set up Cursor with LiteLLM

How to set up OpenAI Codex with LiteLLM

AI gateway comparison 2026: LiteLLM vs Cloudflare vs Kong vs Bifrost vs OpenRouter for LLM cost control

How I Accidentally Opened a Pull Request With 3 Lakh Lines of Code

Claude Code + NVIDIA NIM API + LiteLLM + Terraform MCP: A Full Stack AI Dev Setup