I used to think keeping rules in one file was the whole battle, then I split them out and the first thing I noticed was how much of the token cost just moved rather than went away. Yours is the measurement I wanted and hadn't gone and got. Going to read the rest of this properly.
Glad it was the one you were after. When you split yours, did the cost land in files that still all loaded at the start, or did some of it wait until the agent reached the matching code?
Adam Lewis
Product Engineer/Architect navigating the AI revolution
I used to think keeping rules in one file was the whole battle, then I split them out and the first thing I noticed was how much of the token cost just moved rather than went away. Yours is the measurement I wanted and hadn't gone and got. Going to read the rest of this properly.