Jjasmineparkinjas-blogs.hashnode.dev00We cut our LLM trace bill 30% with two sampling rules 6h ago · 2 min read · Our observability bill for LLM traces was climbing in a straight line with request volume, and most of what we were paying to store was boring: successful calls that did exactly what they were supposeJoin discussion
Jjasmineparkinjas-blogs.hashnode.dev00Per-project LLM cost attribution with OTel spans: the wiring6d ago · 8 min read · TL;DR. If your LLM bill is one line item on a cloud invoice, you cannot answer "which team spent that." We fixed this by tagging every gateway span with team.id, project.id, and feature.id, plus the OJoin discussion
