---
title: "Discussion on \"Deeper Dive into robots.txt: Optimizing Crawl Directives for Performance and SEO\" | Hashnode"
description: "Discussion on \"Deeper Dive into robots.txt: Optimizing Crawl Directives for Performance and SEO\". All you need to know about robots.txt file"
url: "https://hashnode.com/posts/deeper-dive-into-robotstxt/6961c60b675394c30f189e73"
---

[Feed](https://hashnode.com/feed) /

Discussion

# [Deeper Dive into robots.txt: Optimizing Crawl Directives for Performance and SEO](https://blogs.rjlaasish.com/deeper-dive-into-robotstxt?utm_source=hashnode&utm_medium=feed)

All you need to know about robots.txt file

Jan 10 · 5 min read · blogs.rjlaasish.com  
Read the article

-   [#web-development](https://hashnode.com/tag/web-development)
-   [#crawler](https://hashnode.com/tag/crawler)
-   [#seo](https://hashnode.com/tag/seo)
-   [#performance](https://hashnode.com/tag/performance)

## Written by

[Aasish Rijal](https://hashnode.com/@rjlaasish)

@rjlaasish · Auckland, New Zealand

  
[View profile](https://hashnode.com/@rjlaasish)

Code. Create. Deploy.

## Responses

Markdown supported · ⌘↵ to post

No responses yet.