Skip to main content
Loading...

https://wikimapia.org/external_link?url=https%3A%2F%2Fspiderindexer.com

URL is Crawlable
User-agent: *

Disallow: /sys/
Disallow: /object/
Disallow: /photo.php
Disallow: /history.php
Disallow: /p/u/
Disallow: /s/
Disallow: /z1/
Disallow: /wikij/
Disallow: /showphoto/
Disallow: /user/
Disallow: /ajax/
Disallow: /guest/
Disallow: /ads/
Disallow: /wiki/index.php?*

Crawl-delay: 15

robots.txt
Lines in robots.txt

Page tested on 30th November 2024 at 19:09