URL is Crawlable
User-agent: *
Disallow: /404
Disallow: /blog/wp-admin/
Disallow: /blog/author/
Disallow: /blog/tag/
Disallow: /blog/category/
Disallow: /blog/api/
Sitemap: https://www.crestexa.com/sitemap.xml
robots.txt
1
Lines in robots.txt
What Else Could We Find on This Page?
Page Authority: | 0 | View Report |
---|---|---|
Page Speed: | 54/100 Mobile / 97/100 Desktop | View Report |
Page Language: | en-US | View Report |
Meta Description: | 151 characters | View Report |