URL is Crawlable
User-agent: *
Allow: /
Disallow: /cgi-bin/
Disallow: /wp-admin/
Disallow: /archives/
Disallow: /*?*
Disallow: /comments/feed/
Disallow: /refer/
Disallow: /index.php
Disallow: /wp-content/plugins/
User-agent: Mediapartners-Google*
Allow: /
User-agent: Googlebot-Image
Allow: /wp-content/uploads/
User-agent: Adsbot-Google
Allow: /
User-agent: Googlebot-Mobile
Allow: /
User-agent: AhrefsBot
Allow: /
Sitemap: https://www.thetechdiary.com/wp-sitemap.xml
robots.txt
Lines in robots.txt
Page tested on 24th March 2025 at 00:10
What Else Could We Find on This Page?
| Page Authority: | 0 | View Report |
|---|---|---|
| Page Speed: | 98/100 Mobile / 96/100 Desktop | View Report |
| Page Language: | en-US | View Report |
| Meta Description: | 156 characters | View Report |