{"id":1474,"date":"2026-07-20T15:08:52","date_gmt":"2026-07-20T15:08:52","guid":{"rendered":"https:\/\/boostify.cl\/blog\/cloudflare-blocks-ai-bots-what-your-b2b-sme-should-do\/"},"modified":"2026-07-20T15:08:52","modified_gmt":"2026-07-20T15:08:52","slug":"cloudflare-blocks-ai-bots-what-your-b2b-sme-should-do","status":"publish","type":"post","link":"https:\/\/boostify.cl\/blog\/cloudflare-blocks-ai-bots-what-your-b2b-sme-should-do\/","title":{"rendered":"Cloudflare Blocks AI Bots: What Your B2B SME Should Do"},"content":{"rendered":"\n<h2 class=\"wp-block-heading\">What changed at Cloudflare, and why it can make your business invisible to AI<\/h2>\n\n\n\n<p class=\"wp-block-paragraph\">On July 1, 2026, Cloudflare announced that starting <strong>September 15, 2026<\/strong>, every new domain onboarding to its network will block \u00abTraining\u00bb and \u00abAgent\u00bb AI bots <strong>by default<\/strong> on any page that displays advertising. Only \u00abSearch\u00bb bots will remain allowed automatically. If your blog or corporate site runs on Cloudflare, this could mean ChatGPT, Perplexity, or Gemini stop being able to read your content to answer your customers&#8217; questions \u2014 even while your site still ranks fine on Google.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">The good news: if your site is already on Cloudflare before September 15, the default setting <strong>won&#8217;t silently change<\/strong>. But many B2B SMEs spin up new domains, switch providers, or simply never reviewed this setting \u2014 and could be unknowingly blocking the traffic that today comes from <a href=\"https:\/\/boostify.cl\/blog\/geo-in-2026-7-steps-to-get-chatgpt-to-cite-your-b2b-business\/\">GEO (Generative Engine Optimization)<\/a>, meaning an AI model citing you as a source.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\">The 3 types of AI bots you need to tell apart<\/h2>\n\n\n\n<p class=\"wp-block-paragraph\">Cloudflare classifies AI traffic into three categories, and each plays a different role for your business:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li><strong>Search:<\/strong> crawl your site to cite it in AI answers (e.g. Claude-SearchBot, OAI-SearchBot). These are the ones you always want to let through \u2014 the Googlebot equivalent for the AI era.<\/li>\n<li><strong>Agent:<\/strong> act when a user asks an AI assistant to research or buy something on their behalf (e.g. an agent comparing B2B vendors for a prospective buyer). Blocking these means losing \u00abinvisible\u00bb visits that actually convert.<\/li>\n<li><strong>Training:<\/strong> collect content to train future models. Many companies choose to block these to protect original content, without losing visibility in search or AI answers.<\/li>\n<\/ul>\n\n\n\n<p class=\"wp-block-paragraph\">The real risk isn&#8217;t blocking training bots \u2014 it&#8217;s accidentally blocking Search and Agent bots, the ones bringing you customers via ChatGPT or Gemini right now.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\">How to check if your site is already blocking AI bots without knowing it<\/h2>\n\n\n\n<p class=\"wp-block-paragraph\">Before changing anything, check your current status with these three steps:<\/p>\n\n\n\n<ol class=\"wp-block-list\">\n<li>Open your Cloudflare dashboard \u2192 <strong>Security \u2192 Bots \u2192 AI Crawl Control<\/strong> (or \u00abBot Management\u00bb on older plans) and check which categories are allowed.<\/li>\n<li>Visit your-domain.com\/robots.txt and look for <code>Disallow<\/code> lines next to names like <code>GPTBot<\/code>, <code>ClaudeBot<\/code>, <code>Claude-SearchBot<\/code>, <code>PerplexityBot<\/code>, or <code>Google-Extended<\/code>.<\/li>\n<li>If you run WordPress, check whether a security plugin (firewall, anti-scraping) is blocking AI user-agents at the server level, outside Cloudflare&#8217;s control.<\/li>\n<\/ol>\n\n\n\n<h2 class=\"wp-block-heading\">Step-by-step guide to configure Cloudflare without losing AI visibility<\/h2>\n\n\n\n<p class=\"wp-block-paragraph\">If you confirmed something is blocked, or want your setup to be ready before September, follow these steps:<\/p>\n\n\n\n<ol class=\"wp-block-list\">\n<li><strong>Always allow the Search category.<\/strong> It&#8217;s what feeds your brand&#8217;s citations in ChatGPT, Perplexity, and Google AI Overviews.<\/li>\n<li><strong>Consider allowing Agent<\/strong> if your product or service is bought or quoted through comparison (software, professional services, B2B supplies): these are real users delegating research to an assistant.<\/li>\n<li><strong>Decide on Training case by case.<\/strong> If your content is your competitive edge (proprietary methodologies, reports, pricing), blocking it is reasonable and doesn&#8217;t hurt your visibility in search or AI answers.<\/li>\n<li><strong>Use the new \u00abuse\u00bb parameter of Content Signals<\/strong> in your robots.txt if you manage the file manually, to explicitly declare what use you allow for each bot.<\/li>\n<li><strong>Check again in August<\/strong>, before the default change takes effect on September 15, especially if you&#8217;re switching providers or launching a new domain.<\/li>\n<\/ol>\n\n\n\n<h2 class=\"wp-block-heading\">Not on Cloudflare? The same problem can still hit you<\/h2>\n\n\n\n<p class=\"wp-block-paragraph\">Other hosting and CDN providers are adopting similar default-block policies for AI bots, following the same \u00abprotect monetized content\u00bb logic. If you use a different provider, explicitly ask your technical team or agency to confirm the status of <code>robots.txt<\/code> and any web application firewall (WAF) regarding the main AI user-agents. This matters even more if you&#8217;re simultaneously investing in getting <a href=\"https:\/\/boostify.cl\/blog\/google-integrates-ads-into-ai-responses-what-b2b-smes-must-change-now\/\">Google to feature your brand inside AI-generated answers<\/a>: optimizing content is pointless if the bot can never read it.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\">The decision your B2B SME needs to make this week<\/h2>\n\n\n\n<p class=\"wp-block-paragraph\">There&#8217;s no single \u00abblock everything\u00bb or \u00aballow everything\u00bb answer: it depends on whether your competitive edge lives in the content itself (block Training) or in being found and recommended by an AI assistant (allow Search and Agent). What&#8217;s a mistake, without exception, is not reviewing your settings and discovering in October that your AI-driven traffic dropped to zero because a default changed and nobody noticed.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">If you&#8217;d like us to review your site&#8217;s setup alongside your GEO strategy, Boostify can run a quick audit before Cloudflare&#8217;s change takes effect.<\/p>\n\n","protected":false},"excerpt":{"rendered":"<p>On July 1, 2026, Cloudflare announced that starting September 15, 2026, every new domain onboarding to its network will block \u00abTraining\u00bb and \u00abAgent\u00bb AI\u2026<\/p>\n","protected":false},"author":1,"featured_media":1471,"comment_status":"","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[64,163,167],"tags":[197,190,166,198,191],"class_list":["post-1474","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-en","category-ia-aplicada","category-marketing-digital-b2b","tag-cloudflare","tag-geo","tag-pymes-b2b","tag-robots-txt","tag-seo-con-ia"],"blocksy_meta":[],"_links":{"self":[{"href":"https:\/\/boostify.cl\/blog\/wp-json\/wp\/v2\/posts\/1474","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/boostify.cl\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/boostify.cl\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/boostify.cl\/blog\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/boostify.cl\/blog\/wp-json\/wp\/v2\/comments?post=1474"}],"version-history":[{"count":0,"href":"https:\/\/boostify.cl\/blog\/wp-json\/wp\/v2\/posts\/1474\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/boostify.cl\/blog\/wp-json\/wp\/v2\/media\/1471"}],"wp:attachment":[{"href":"https:\/\/boostify.cl\/blog\/wp-json\/wp\/v2\/media?parent=1474"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/boostify.cl\/blog\/wp-json\/wp\/v2\/categories?post=1474"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/boostify.cl\/blog\/wp-json\/wp\/v2\/tags?post=1474"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}