URL is Crawlable
# Applies to all bots
User-agent: *
Disallow: /wp-admin/
Disallow: /wp-login.php
Disallow: /cdn-cgi/
Disallow: /search/
Disallow: /?s=
Disallow: /tag/
Allow: /wp-admin/admin-ajax.php
# Explicitly allow AI bots
User-agent: GPTBot
Disallow:
User-agent: ChatGPT-User
Disallow:
User-agent: ClaudeBot
Disallow:
User-agent: PerplexityBot
Disallow:
User-agent: Google-Extended
Disallow:
Allow: /wp-admin/admin-ajax.php
Sitemap: https://techjustify.com/sitemap_index.xml
robots.txt
Lines in robots.txt
Page tested on 21st October 2025 at 23:11
What Else Could We Find on This Page?
| Page Authority: | 0 | View Report |
|---|---|---|
| Page Speed: | 75/100 Mobile / 100/100 Desktop | View Report |
| Page Language: | en-US | View Report |
| Meta Description: | 137 characters | View Report |