URL is Crawlable
User-agent: *
Allow: /
Disallow: /dashboard/*
Disallow: /special/*
Disallow: /mediadrop/*
Disallow: /captcha/*
Disallow: /ckeditor*
Disallow: /ckfinder/*
Disallow: /core/*
Disallow: /cron-job/*
Disallow: /dAjax/*
Disallow: /social-connect/*
Disallow: /scripts/*
Disallow: /scan/*
Disallow: /static/adcode/*
Disallow: /static/tracking/*
Disallow: /story/*
Disallow: /logs/*
Disallow: /login/*
Disallow: /v3/login/*
Sitemap: https://beforeitsnews.com/sitemap.xml
robots.txt
Lines in robots.txt
Page tested on 25th November 2024 at 00:10
What Else Could We Find on This Page?
Page Authority: | 0 | View Report |
---|---|---|
Page Speed: | 31/100 Mobile / 98/100 Desktop | View Report |
Page Language: | en-US | View Report |
Meta Description: | 374 characters | View Report |