URL is Crawlable
# http://www.robotstxt.org/robotstxt.html
# www.google.com/support/webmasters/bin/answer.py?hl=en&answer=156449
# http://stackoverflow.com/questions/17377835/robots-txt-what-is-the-proper-format-for-a-crawl-delay-for-multiple-user-agent
User-agent: AhrefsBot
Disallow: /
User-agent: MJ12bot
Disallow: /
User-agent: Slurp
Crawl-delay: 10
User-agent: Exabot
Crawl-delay: 10
User-agent: Yandex
Crawl-delay: 10
robots.txt
Lines in robots.txt
Page tested on 24th June 2025 at 11:15
What Else Could We Find on This Page?
| Page Authority: | 0 | View Report |
|---|---|---|
| Page Speed: | 68/100 Mobile / 99/100 Desktop | View Report |
| Page Language: | en | View Report |
| Meta Description: | 30 characters | View Report |