URL is Crawlable
User-agent: Node/simplecrawler
Disallow: *
User-Agent: *
Disallow: /ads/
Disallow: /admin*
Disallow: /user-activation
Disallow: /search*
Disallow: /places/*/edit
Disallow: /browse_content*
Disallow: /nav/*
Disallow: /random
Disallow: /denver
Disallow: /travelnevadahighway95tc
Disallow: /newsletters/kiosk
Disallow: /chase-sapphire
User-agent: GPTBot
Disallow: /
Sitemap: http://www.atlasobscura.com/sitemaps/sitemap_index.xml.gz
robots.txt
Lines in robots.txt
Page tested on 4th June 2025 at 10:01
What Else Could We Find on This Page?
| Page Authority: | 0 | View Report |
|---|---|---|
| Page Speed: | 3/100 Mobile / 63/100 Desktop | View Report |
| Page Language: | en | View Report |
| Meta Description: | 31 characters | View Report |