Engineering insights on building and scaling modern software.
Cloud & Platform Engineer focused on building systems that scale and endure. I explore how infrastructure, automation, and engineering practices come together to support modern software teams.
Markdown supported · ⌘↵ to post
The annotation is the permission model, not a docstring. If the tool description is missing, the agent will guess the argument shape and the server will accept a wider call than the human would. Are the tool descriptions treated as sensitive data, or as public schema? Which one do you log when the agent picks the wrong tool?
iin1006h12
indiainfranotes
Skipping the vector database for the first chatbot is the right call. The failure I keep seeing is retrieval without a refusal: the model answers from the top hit even when the hit is a weak match. What score do you require before you answer, and what do you say when nothing clears it? iin1006h19