Testing Non-Deterministic AI Systems Without Losing Your MindLearn how to test non-deterministic AI systems using repeated evaluations, outcome-based testing, reliability metrics, and continuous monitoring.7 min read·pinnasysai.hashnode.dev1d ago
Your RAG Evaluation Is Measuring the Wrong ThingLearn how to evaluate RAG systems beyond retrieval accuracy using context relevance, faithfulness, answer quality, and key metrics for production AI.6 min read·pinnasysai.hashnode.dev3d ago
Prompt Caching Cost Math: When It Actually Saves You MoneyLarge language models do not charge only for generating responses. Every request also involves processing input tokens, including system instructions, conversation history, tool definitions, and refer10 min read·pinnasysai.hashnode.devNov 3
Claude Tool Use: What to Do When Tool Calls Go WrongIntroduction Claude tool use is one of the most powerful capabilities in the Anthropic API, and one of the most fragile when left unguarded. When Claude calls a tool correctly, and the tool returns cl8 min read·pinnasysai.hashnode.devSep 3