MGMikhail Golikovingolikovichevhashnodedev.hashnode.dev·Jul 21 · 2 min readYour eval suite is green. Production is not.You ship an LLM feature. Three weeks later a Slack thread mentions that a customer got a strange answer. You dig in. The prompt has been edited twice since release, the provider has quietly re-quantis00
MGMikhail Golikovinfreecodecamp.org·Jul 9 · 6 min readHow to Turn a Postman Collection into a Maintainable pytest SuiteA Postman collection is a great place to explore an API. But it's a poor place to keep your tests. Most teams find this out the slow way. Someone exports the collection, converts the requests into tes00
MGMikhail Golikovingolikovichevhashnodedev.hashnode.dev·Jun 22 · 4 min readGreen unit tests are a comfort blanketMy converter has a test suite. It was green. Every example I could think of went in, the right pytest file came out, and I shipped it to PyPI as 1.0. Weeks later it sits there marked Production/Stable00
MGMikhail Golikovingolikovichevhashnodedev.hashnode.dev·Jun 10 · 8 min readKeep the LLM out of your chatbot testsIt is a warm evening. You are home from work, you crack the window open, and the room fills with that low gold light you get for about twenty minutes a day. You have changed into the soft clothes. The00
MGMikhail Golikovingolikovichevhashnodedev.hashnode.dev·Jun 1 · 6 min readYour Kibana logs are full of test cases. Here is a CLI that extracts them, with auth scrubbed by default.Every sprint we export a JSON dump from Kibana, scroll through hundreds of log entries, and tell ourselves we will turn them into test cases later. Later never comes. The logs contain real API calls. 00