---
title: "Discussion on \"robots.txt and XML sitemap mistakes on small business sites\" | Hashnode"
description: "Discussion on \"robots.txt and XML sitemap mistakes on small business sites\". The errors we find most often, why they matter, and a short Python script to check every URL in your sitemap"
url: "https://hashnode.com/posts/robots-txt-and-xml-sitemap-mistakes-on-small-business-sites/6af6ded903e147f23d7abc71"
---

[Feed](https://hashnode.com/feed) /

Discussion

# [robots.txt and XML sitemap mistakes on small business sites](https://digitalcave.hashnode.dev/robots-txt-and-xml-sitemap-mistakes-on-small-business-sites?utm_source=hashnode&utm_medium=feed)

The errors we find most often, why they matter, and a short Python script to check every URL in your sitemap

5d ago · 5 min read · digitalcave.hashnode.dev  
Read the article

-   [#seo](https://hashnode.com/tag/seo)
-   [#sitemap](https://hashnode.com/tag/sitemap)
-   [#python](https://hashnode.com/tag/python)
-   [#web-development](https://hashnode.com/tag/web-development)

## Written by

[DigitalCave](https://hashnode.com/@digitalcave)

@digitalcave · Birmingham, United Kingdom

  
[View profile](https://hashnode.com/@digitalcave)

All-in-one web design, SEO and digital marketing agency. Notes on WordPress, performance, SEO and structured data.

DigitalCave is an all-in-one web design, SEO and digital marketing agency based in the West Midlands, serving Birmingham, Coventry and the UK. Since 2013 we have built WordPress, Shopify and custom websites and run SEO, local SEO, Google Ads and Meta ads for our clients. This blog shares practical technical notes from client work. Website: https://digitalcave.uk

## Responses

Markdown supported · ⌘↵ to post

No responses yet.
