robot.txt tester (GSC)

The robot.txt tester, for a specific URL of your site in the robot.txt file, the crawler over is the tool that allows you to check whether it is blocked.

When you send the URL from the form, the tester will behave like Googlebot and check robot.txt.
From the output of the checked robots.txt file, you can check whether the URL is properly blocked.

Leave a Reply

Your email address will not be published. Required fields are marked *