One thing we've noticed is that as repositories grow, retrieval becomes a much bigger bottleneck than generation. If an agent spends most of its time grepping and re-reading files, you're paying in both latency and tokens before it even starts reasoning.
Using AST-based indexing is a smart approach because it gives the agent structural context instead of raw text. It would also be interesting to see benchmarks on incremental re-indexing for large monorepos and how it performs alongside RAG- or embedding-based code retrieval. Nice first project looking forward to seeing how it evolves.
One thing we've noticed is that as repositories grow, retrieval becomes a much bigger bottleneck than generation. If an agent spends most of its time grepping and re-reading files, you're paying in both latency and tokens before it even starts reasoning.
Using AST-based indexing is a smart approach because it gives the agent structural context instead of raw text. It would also be interesting to see benchmarks on incremental re-indexing for large monorepos and how it performs alongside RAG- or embedding-based code retrieval. Nice first project looking forward to seeing how it evolves.