GGil Neto1d ago · 5 min readMy second brain scored 88% and still told me something falseOn 21 October a group of researchers published a benchmark for how personal agents remember what their users want (arXiv 2610.30485). They tested several memory systems against simulated users and meablog.gil-neto.com
AAdarsh DivakaranOct 19 · 4 min readSerpApi Achieves 97.6% Accuracy on SimpleQA VerifiedSimpleQA Verified is a benchmark from Google DeepMind and Google Research for testing how accurately AI models answer factual questions. It contains 1,000 questions, selected from OpenAI's original Siserpapi.hashnode.dev
AAyesha KhanOct 9 · 7 min readBelievable Is Not CorrectOur owner wants an AI agent in the app. It should understand the regional language, take voice notes, cope with different dialects, and do real work inside the product. It's an exciting request, and Iayeshakoder.hashnode.dev
OOliver ZehentleitnerOct 5 · 9 min readThe Model Changed. My Skill Didn't. The Score Still Dropped.My rule for evaluating an agent skill is deliberately asymmetric: Test the agent on the weakest model you intend to support. Choose the judge by measuring which model grades that task reliably. Those blog.technopathy.club
SSanathSep 29 · 3 min readAdding a Tool to Your AI Agent? Here's What Actually Needs RetestingTwo changes account for most of the "wait, when did that break" moments teams have with AI agents: adding a tool or widening a permission, and updating the model, system prompt, or orchestration layer1Maiqa.hashnode.dev
LLakshaya SharmaSep 11 · 12 min readyour agent passed the eval. it still failed the job.Most AI projects add evals in roughly the same way. Someone picks a benchmark, collects a set of prompts, runs a model, and turns the results into a percentage. The percentage becomes a line on a dashblog.langersword.in
OOliver ZehentleitnerAug 24 · 15 min readSame Skill, Six Agents, Nine Models: What a Real Eval Matrix Taught MeI tested Keep the Why, my open-source agent skill for preserving the reasoning behind a codebase, through six coding agents, with a matrix spanning nine hosted models plus a local Ollama run. The mode2blog.technopathy.club
MManu ShuklaAug 20 · 14 min readOpenAI shuts Agent Builder, Evals and reusable prompts on 30 November 2026OpenAI shuts Agent Builder, Evals and reusable prompts on 30 November 2026 Summary. OpenAI is retiring three developer-platform surfaces on the same day. Agent Builder, the Evals platform and reusableecorpit.hashnode.dev
SSunny GuptaJul 28 · 7 min readSeven Models in Seven Days: How to Pick Without WhiplashBetween July 17 and July 23, the AI world shipped seven notable models in seven days. Kimi K3 with a trillion parameters. Three separate Qwen drops. Google's Gemini 3.6 Flash family. poolside's open-w21Nicodestartups.com
JJeremy LongshoreJul 10 · 18 min readNoise-Robust LLM-Judge Evals: Don't Sign a Coin FlipAn un-seeded LLM judge is nondeterministic even at temperature 0. So a single-call binary verdict is a coin flip. And when you sign that verdict into a public transparency log, you have cryptographicajeremylongshore.hashnode.dev
