Building RAG without a framework really exposes how much the chunking strategy matters — your approach of splitting by document sections mirrors what we found when building a similar pipeline for internal docs. One thing that surprised us: overlapping chunks by 10-15% at boundaries dramatically improved retrieval accuracy for questions that spanned two adjacent sections.