Can AI bots get into your website?
See whether GPTBot, ClaudeBot, PerplexityBot and Googlebot are let in, and if not, where they are stopped.
Free check. No sign-up. Made by Sunny Patel.
Example A check I ran on 16 November 2026 for thebestmowers.co.uk
Your robots.txt lets AI bots in. Something in front of your site turns them away.

I asked for the home page using each bot's name. The real bots can get a different answer.
Checked on 16 November 2026 at 14:20 GMT.
Name I gave
robots.txt says
Answer I got
GPTBot
robots.txt: Allowed
Refused
HTTP 403
ClaudeBot
robots.txt: Allowed
Refused
HTTP 403
PerplexityBot
robots.txt: Allowed
Refused
HTTP 403
Googlebot
robots.txt: Allowed
Let in
HTTP 200
Tools
- Bot check
Asks for your home page as each of 19 crawlers and as an ordinary browser, and shows which are let in.
- Sitemap check
Finds your sitemaps and checks each one loads, can be read and is let in when asked as Googlebot.
- robots.txt tester
Shows the line of your robots.txt that decides each bot, for any path, live or pasted.
- Fetch as a bot
Asks for one page as one bot, hop by hop, and compares it with an ordinary browser.