Skip to main content
Loading...

https://www.test4fit.uk/forum/general-discussions/considering-a-dedicated-uk-server-for-optimal-performance

URL is Crawlable
User-agent: *
Allow: /
Allow: */dynamic-pages-router/*
Allow: */cloud-data/*
Disallow: *?lightbox=
Disallow: /_api/*

# Optimization for Google Ads Bot
User-agent: AdsBot-Google-Mobile
User-agent: AdsBot-Google
Disallow: /_partials*
Disallow: /pro-gallery-webapp/v1/galleries/*

# Block PetalBot
User-agent: PetalBot
Disallow: /

# Crawl delay for overly enthusiastic bots
User-agent: dotbot
Crawl-delay: 10
User-agent: AhrefsBot
Crawl-delay: 10

Sitemap: https://www.test4fit.uk/sitemap.xml

# Auto generated, go to SEO Tools > Robots.txt Editor to change this
robots.txt
Lines in robots.txt

Page tested on 28th August 2025 at 12:28