URL is Crawlable
User-agent: *
Disallow: /cgi-bin
Disallow: /smellycat
Disallow: /go
Disallow: /goto
Disallow: /recommends
Disallow: /recommended
Disallow: /goto.php
Disallow: /wp-content
Disallow: /wp-admin
Disallow: /wp-includes
Disallow: /tag
Disallow: /tags
Disallow: /wp-
Disallow: /?p=
Disallow: /*trackback
Disallow: /news.php
Disallow: /page
Disallow: /page/*
Disallow: /a
User-agent: Mediapartners-Google*
Disallow:
User-agent: TurnitinBot
Disallow: /
robots.txt
Lines in robots.txt
Page tested on 22nd December 2024 at 00:12
What Else Could We Find on This Page?
Page Authority: | 0 | View Report |
---|---|---|
Page Speed: | 95/100 Mobile / 100/100 Desktop | View Report |
Page Language: | en-US | View Report |
Meta Description: | 74 characters | View Report |