URL is Crawlable
User-agent: Googlebot
Disallow: /our-favourite-websites-2021/
Disallow: /contacts/
Sitemap: https://avstarnews.com/sitemap.xml
Sitemap: https://avstarnews.com/sitemap.rss
# START YOAST BLOCK
# ---------------------------
User-agent: *
Disallow:
Sitemap: https://avstarnews.com/sitemap_index.xml
# ---------------------------
# END YOAST BLOCK
User-agent: AhrefsBot
Disallow: /$
User-agent: AhrefsSiteAudit
Disallow: /$
robots.txt
Lines in robots.txt
Page tested on 11th December 2024 at 00:14
What Else Could We Find on This Page?
| Page Authority: | 0 | View Report |
|---|---|---|
| Page Speed: | 98/100 Mobile / 100/100 Desktop | View Report |
| Page Language: | en-US | View Report |
| Meta Description: | Is empty | View Report |