URL is Crawlable
#Allow crawlers to discover sitemap
Sitemap: https://talkmarkets.com/sitemap.xml
User-agent: Twitterbot/1.0
Allow: /
User-Agent: Mozilla/5.0 (compatible; YandexBot/3.0; +http://yandex.com/bots)
Disallow: /
User-agent: Yandex
Disallow: /
User-Agent: YandexBot/3.0
Disallow: /
User-agent: SISTRIX
Disallow: /
User-agent: magpie-crawler
Disallow: /
User-agent: Baiduspider
Disallow: /
User-agent: Mozilla/5.0 (compatible; Baiduspider/2.0; +http://www.baidu.com/search/spider.html)
Disallow: /
User-agent: BLEXBot
Disallow: /
User-agent: UnwindFetchor/1.0
Disallow: /
User-agent: Faraday v0.9.2
Disallow: /
User-Agent: Faraday v0.11.0
Disallow: /
User-Agent: Mozilla/5.0+(compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp)
Disallow: /
User-agent: Yahoo! Slurp
Disallow: /
User-Agent: trendictionbot
Disallow: /
User-Agent: MetaInspector/4.6.0
Disallow: /
User-Agent: Pcore-HTTP/v0.25.0
Disallow: /
User-Agent: ZmEu
Disallow: /
User-Agent: Mozilla/5.0 (compatible; DotBot/1.1; http://www.opensiteexplorer.org/dotbot, [email protected])
Disallow: /
User-agent: DotBot/1.1
Disallow: /
User-agent: SemrushBot
Disallow: /
User-agent: SemrushBot-BA
Disallow: /
User-agent: Mozilla/5.0 (compatible; SemrushBot-SI/0.97; +http://www.semrush.com/bot.html)
Disallow: /
User-agent: Mozilla/5.0 (compatible; SemrushBot/1.2~bl; +http://www.semrush.com/bot.html)
Disallow: /
User-agent: trendkite-akashic-crawler
Disallow: /
User-agent: Mozilla/5.0 (compatible; MarketwireBot/1.0; +http://www.marketwire.com)
Disallow: /
User-agent: istellabot/t.1.13
Disallow: /
User-agent: ScoutJet
Disallow: /
User-agent: Mozilla/5.0 (X11; compatible; semantic-visions.com crawler; HTTPClient 3.1)
Disallow: /
User-agent: Mozilla/5.0 (compatible; PaperLiBot/2.1; http://support.paper.li/entries/20023257-what-is-paper-li)
Disallow: /
User-Agent: omgilibot
Disallow: /
User-Agent: omgili
Disallow: /
User-agent: SiteExplorer
Disallow: /
User-Agent: Mozilla/5.0 ( compatible ; Veooz/1.0 ; +http://www.veooz.com/veoozbot.html)
Disallow: /
User-Agent: dlvr.it/1.0 ( http://dlvr.it/)
Disallow: /
User-agent: Gigabot
Disallow: /
User-agent: SocialRankIOBot; http://socialrank.io/about
Disallow: /
User-Agent: Mozilla/5.0 (compatible; Embedly/0.2; http://support.embed.ly/)
Disallow: /
User-agent: ZoominfoBot (zoominfobot at zoominfo dot com)
Disallow: /
User-agent: LivelapBot
Disallow: /
User-Agent: Mozilla/5.0 (compatible; MJ12bot/v1.4.8; http://mj12bot.com/)
Disallow: /
User-Agent: MJ12bot
Disallow: /
User-agent: Pinterest
Disallow: /
User-agent: Mozilla/5.0 (compatible; MojeekBot/0.6; +https://www.mojeek.com/bot.html)
Disallow: /
User-agent: BUbiNG
Disallow: /
User-agent: *
Disallow:/c/
User-agent: TurnitinBot
Disallow: /
User-agent: SentiBot
Disallow: /
User-agent: Riddler
Disallow: /
User-agent:Mozilla/5.0 (Linux; Android 5.0) AppleWebKit/537.36 (KHTML, like Gecko) Mobile Safari/537.36 (compatible; Bytespider; [email protected])
Disallow: /
Sitemap: https://talkmarkets.com/sitemap.xml
robots.txt
Lines in robots.txt
Page tested on 12th June 2025 at 12:09
What Else Could We Find on This Page?
| Page Authority: | 0 | View Report |
|---|---|---|
| Page Speed: | 30/100 Mobile / 94/100 Desktop | View Report |
| Page Language: | View Report | |
| Meta Description: | 4 characters | View Report |