URL is Crawlable
User-agent: *
Crawl-delay: 10
Disallow: /error/
Disallow: /templates/
#Ticket: 20157146
User-agent: Bytespider
Disallow: /
User-agent: AhrefsBot
Disallow: /
User-agent: facebookexternalhit
Disallow: /
User-agent: meta-externalagent
Disallow: /
User-agent: PetalBot
Disallow: /
User-agent: Amazonbot
Disallow: /
User-agent: MJ12bot
Disallow: /
User-agent: SemrushBot-BA
Disallow: /
User-agent: DataForSeoBot
Disallow: /
robots.txt
Lines in robots.txt
Page tested on 12th December 2024 at 00:22
What Else Could We Find on This Page?
Page Authority: | 0 | View Report |
---|---|---|
Page Speed: | 95/100 Mobile / 100/100 Desktop | View Report |
Page Language: | View Report | |
Meta Description: | 54 characters | View Report |