URL is Crawlable
User-agent: *
Disallow: /search
Disallow: /feeds/
Disallow: /feeds/comments/default
# Allow specific important URLs if necessary
Allow: /search/label/*?max-results=10
# Allow images
User-agent: Googlebot-Image
Disallow:
# Sitemap
Sitemap: https://www.theedgesearch.com/sitemap.xml
robots.txt
Lines in robots.txt
Page tested on 10th March 2025 at 00:01
What Else Could We Find on This Page?
Page Authority: | 0 | View Report |
---|---|---|
Page Speed: | 44/100 Mobile / 91/100 Desktop | View Report |
Page Language: | View Report | |
Meta Description: | 134 characters | View Report |