URL is Crawlable
User-agent: Scrapy
Allow: /
User-agent: *
Crawl-delay: 2
User-agent: *
Disallow: /wp-admin/
Disallow: /wp-login.php
Allow: /wp-admin/admin-ajax.php
robots.txt
Lines in robots.txt
Page tested on 6th November 2024 at 00:05
What Else Could We Find on This Page?
Page Authority: | 0 | View Report |
---|---|---|
Page Speed: | 60/100 Mobile / 99/100 Desktop | View Report |
Page Language: | en-GB | View Report |
Meta Description: | 129 characters | View Report |