Growth Radar

Can AI crawlers read your site? Check robots.txt and what your server answers

Originally published on DEV. Getting a site online is easy now, but getting found takes much longer, and more of that happens inside AI assistants, which can only mention pages they managed to fetch.