AI Crawler Inspector

Check whether crawlers can actually access the page. robots.txt and HTTP response are shown separately: allowed by robots does not automatically mean reachable by the server.