URL is Crawlable
# START YOAST BLOCK
# ---------------------------
User-agent: *
Disallow: /category/blog/
Disallow: /wp-admin/
Allow: /wp-admin/admin-ajax.php
Disallow: /?s=
Disallow: ?nonamp=1
Disallow: /wp-comments-post.php
Disallow: /wp-content/plugins/
Sitemap: https://www.searchenginemagazine.com/sitemap_index.xml
# ---------------------------
# END YOAST BLOCK
robots.txt
Lines in robots.txt
Page tested on 26th August 2025 at 23:11
What Else Could We Find on This Page?
| Page Authority: | 0 | View Report |
|---|---|---|
| Page Speed: | 54/100 Mobile / 97/100 Desktop | View Report |
| Page Language: | en | View Report |
| Meta Description: | 143 characters | View Report |