RAG Chunking: Why Chunk Size Is the Wrong Knob

You've swept chunk size from 256 to 1024 tokens. You tried 20% overlap, then 50%. You swapped in a semantic splitter. Your eval score moved a point and a half, and the answers that were wrong are most