URL is Crawlable
User-agent: *
Disallow: /api/
Disallow: /.well-known/
Disallow: /openapi.yaml/
Disallow: /cdn-cgi/
Disallow: /results/
User-agent: Google-Extended
Disallow: /
User-agent: CCBot
Disallow: /
User-agent: GPTBot
Disallow: /
User-agent: ChatGPT-User
Disallow: /
User-agent: anthropic-ai
Disallow: /
User-agent: Claude-Web
Disallow: /
robots.txt
Lines in robots.txt
Page tested on 2nd May 2025 at 06:53
What Else Could We Find on This Page?
Page Authority: | 0 | View Report |
---|---|---|
Page Speed: | 100/100 Mobile / 100/100 Desktop | View Report |
Page Language: | en | View Report |
Meta Description: | 165 characters | View Report |