Semantic chunks averaging 43 tokens and finishing last at 54% look like the case your hierarchical section is built for. I'm curious how much of the gap to recursive splitting at 512 closes if the semantic splits stay as small retrieval children and the surrounding section gets swapped in before generation.
That's the hierarchical pattern from the post (small children for retrieval, parent section for generation), and it should help: the semantic fragments averaged 43 tokens, which is too thin to answer from, so swapping the section in addresses exactly that. I can't give you a number though. The 69% vs 54% figures come from the FloTorch benchmark, which didn't test that combination. I'd run it on your own corpus and measure end-to-end answer accuracy, not retrieval recall, since Chroma's 91.9% recall for semantic chunking suggests the retrieval side isn't the problem.
Kartik N V J K
Semantic chunks averaging 43 tokens and finishing last at 54% look like the case your hierarchical section is built for. I'm curious how much of the gap to recursive splitting at 512 closes if the semantic splits stay as small retrieval children and the surrounding section gets swapped in before generation.