URL is Crawlable
User-agent: *
Disallow: /wp-admin/
Allow: /wp-admin/admin-ajax.php
Sitemap: https://streetfoodguy.com/sitemap_index.xml
User-agent: Googlebot
Disallow:
User-agent: Baiduspider
Disallow: /
User-agent: AhrefsBot
Disallow: /
User-agent: MJ12bot
Disallow: /
User-agent: BLEXBot
Disallow: /
User-agent: DotBot
Disallow: /
User-agent: SemrushBot
Disallow: /
User-agent: Slurp
Disallow:
User-agent: bingbot
Disallow:
User-agent: Yandexbot
Disallow:
robots.txt
Lines in robots.txt
Page tested on 20th February 2026 at 00:22
What Else Could We Find on This Page?
| Page Authority: | 0 | View Report |
|---|---|---|
| Page Speed: | 89/100 Mobile / 100/100 Desktop | View Report |
| Page Language: | View Report | |
| Meta Description: | 383 characters | View Report |