URL is Crawlable
User-agent: *
Crawl-delay: 10
Disallow: /error/
Disallow: /templates/
#Ticket: 20157146
User-agent: Bytespider
Disallow: /
User-agent: AhrefsBot
Disallow: /
User-agent: facebookexternalhit
Disallow: /
User-agent: meta-externalagent
Disallow: /
User-agent: PetalBot
Disallow: /
User-agent: Amazonbot
Disallow: /
User-agent: MJ12bot
Disallow: /
User-agent: SemrushBot-BA
Disallow: /
User-agent: DataForSeoBot
Disallow: /
robots.txt
Lines in robots.txt
Page tested on 11th November 2024 at 00:06
What Else Could We Find on This Page?
| Page Authority: | 0 | View Report |
|---|---|---|
| Page Speed: | 95/100 Mobile / 100/100 Desktop | View Report |
| Page Language: | View Report | |
| Meta Description: | 71 characters | View Report |