### 28/8/25 WP Hosting - added to reduce bots over-consuming resources # Allow Google, Bing User-agent: Googlebot Disallow: Crawl-delay: 10 User-agent: Bingbot Disallow: Crawl-delay: 10 # Block known spammy / malicious bots User-agent: AhrefsBot Disallow: / Crawl-delay: 10 User-agent: MJ12bot Disallow: / Crawl-delay: 10 User-agent: SemrushBot Disallow: / Crawl-delay: 10 User-agent: DotBot Disallow: / Crawl-delay: 10 User-agent: Baiduspider Disallow: / Crawl-delay: 10 User-agent: Yandex Disallow: / Crawl-delay: 10 User-agent: ClaudeBot Disallow: / Crawl-delay: 10 # Catch-all: slow down all other bots (crawl-delay) User-agent: * Crawl-delay: 10 Disallow: /wp-admin/ Disallow: /wp-login.php Disallow: /cgi-bin/ Disallow: /tmp/ Disallow: /private/