URL is Crawlable
# Blocks robots from specific folders / directories
User-agent: googlebot
User-agent: google
User-agent: bingbot
User-agent: bing
User-agent: Mediapartners-Google
Disallow: /cgi-bin/
Disallow: /cron/
Disallow: /log/
Crawl-delay: 15
User-agent: *
Disallow: /
robots.txt
Lines in robots.txt
Page tested on 27th March 2025 at 10:47
What Else Could We Find on This Page?
| Page Authority: | 0 | View Report |
|---|---|---|
| Page Speed: | 53/100 Mobile / 100/100 Desktop | View Report |
| Page Language: | en, en | View Report |
| Meta Description: | 100 characters | View Report |