Building Production RAG on ArXiv — Part 1: Architecture & Ingestion What I'm building, and why Nobody can keep up with AI research anymore. On ArXiv — the open-access preprint server where nearly all
Markdown supported · ⌘↵ to post
Couldn't agree more with this! Often we overcomplicate things, but keeping it structured like this solves half the problem. Thanks for putting this together.
Kartik N V J K
AI Developer | Making AI reliable, trustworthy & accessible to everyone | Active community contributor
Ingestion quietly decides everything downstream in RAG, so starting the series there is the right call. ArXiv is a nice hard test, since the papers are long, structured, and full of math that naive chunking mangles. Looking forward to how you handle chunk boundaries around equations and references.