---
title: "Comment by OnlineProxy on \"Building a RAG Pipeline Without a Scraper Farm: Free Fetch-to-Markdown for Agents\" | Hashnode"
description: "Stale chunks were the thing I'd check first. If a page shrinks from 10 chunks to 7, the vectors for chunks numbered 7 through 9 just sit in the store and keep g"
url: "https://hashnode.com/posts/building-a-rag-pipeline-without-a-scraper-farm-free-fetch-to-markdown-for-agents/6aee897e8959be50809030ea/comment/6af21bc2b2d1ae1ae5497851"
---

[Discussion](https://hashnode.com/posts/building-a-rag-pipeline-without-a-scraper-farm-free-fetch-to-markdown-for-agents/6aee897e8959be50809030ea)

Comment [Building a RAG Pipeline Without a Scraper Farm: Free Fetch-to-Markdown for Agents](https://hashnode.com/posts/building-a-rag-pipeline-without-a-scraper-farm-free-fetch-to-markdown-for-agents/6aee897e8959be50809030ea)

[OnlineProxy](https://hashnode.com/@onlineproxyio)

[2d ago](https://hashnode.com/posts/building-a-rag-pipeline-without-a-scraper-farm-free-fetch-to-markdown-for-agents/6aee897e8959be50809030ea/comment/6af21bc2b2d1ae1ae5497851)

Stale chunks were the thing I'd check first. If a page shrinks from 10 chunks to 7, the vectors for chunks numbered 7 through 9 just sit in the store and keep getting retrieved. I mean hashing the content doesn't really fix that by itself, so i'd run a delete on source\_url before every upsert. Or a generation key, if you don't want to delete in place

And keep fetched\_at in the metadata, otherwise you've got no idea how old the stuff you're serving actually is