Ingestion quietly decides everything downstream in RAG, so starting the series there is the right call. ArXiv is a nice hard test, since the papers are long, structured, and full of math that naive chunking mangles. Looking forward to how you handle chunk boundaries around equations and references.
Couldn't agree more with this! Often we overcomplicate things, but keeping it structured like this solves half the problem. Thanks for putting this together.
Kartik N V J K
AI Developer | Making AI reliable, trustworthy & accessible to everyone | Active community contributor
Ingestion quietly decides everything downstream in RAG, so starting the series there is the right call. ArXiv is a nice hard test, since the papers are long, structured, and full of math that naive chunking mangles. Looking forward to how you handle chunk boundaries around equations and references.