---
title: "Discussion on \"Building Production RAG on ArXiv — Part 1: Architecture & Ingestion\" | Hashnode"
description: "Discussion on \"Building Production RAG on ArXiv — Part 1: Architecture & Ingestion\". I'm building an open-source system to interrogate the AI-research firehose — RAG now, a multi-agent researcher by the end, in public over five parts. Part 1 is the foundation: the architecture, the ingestion, and the eval bug that would have shipped meaningless numbers."
url: "https://hashnode.com/posts/building-production-rag-arxiv-part-1/6a6b5f43b8aece0f269a6dc6"
---

[Feed](https://hashnode.com/feed) /

Discussion

# [Building Production RAG on ArXiv — Part 1: Architecture & Ingestion](https://blog.deepakgoyal.ai/building-production-rag-arxiv-part-1?utm_source=hashnode&utm_medium=feed)

I'm building an open-source system to interrogate the AI-research firehose — RAG now, a multi-agent researcher by the end, in public over five parts. Part 1 is the foundation: the architecture, the ingestion, and the eval bug that would have shipped meaningless numbers.

Jul 30 · 18 min read · blog.deepakgoyal.ai  
Read the article

-   [#machine-learning](https://hashnode.com/tag/machine-learning)
-   [#artificial-intelligence](https://hashnode.com/tag/artificial-intelligence)
-   [#rag](https://hashnode.com/tag/rag)
-   [#llm](https://hashnode.com/tag/llm)

## Written by

[Deepak Goyal](https://hashnode.com/@deepakgoyal-ai)

@deepakgoyal-ai · Faridabad, India

  
[View profile](https://hashnode.com/@deepakgoyal-ai)

Technical Architect · AI-powered systems at scale · Architecture decisions, not opinions

Technical Architect · 20 years in software · Writing about AI architecture, system design, and real decisions at scale

## Responses 2

Markdown supported · ⌘↵ to post

[Kartik N V J K](https://hashnode.com/@kartik-nvj)

[Jul 31](https://hashnode.com/posts/building-production-rag-arxiv-part-1/6a6b5f43b8aece0f269a6dc6/comment/6a6cc127aa3e95a7bd9e9f8a)

Ingestion quietly decides everything downstream in RAG, so starting the series there is the right call. ArXiv is a nice hard test, since the papers are long, structured, and full of math that naive chunking mangles. Looking forward to how you handle chunk boundaries around equations and references.

[Nahid Mahmud](https://hashnode.com/@nahidmahmud555)

[Jul 30](https://hashnode.com/posts/building-production-rag-arxiv-part-1/6a6b5f43b8aece0f269a6dc6/comment/6a6b7fda247e765e40c9189a)

Couldn't agree more with this! Often we overcomplicate things, but keeping it structured like this solves half the problem. Thanks for putting this together.
