Content Signals in robots.txt: a use declaration, not a block
The robots.txt directive Cloudflare created in 2025: how to write it, what search, ai-input and ai-train mean, and why it declares use without blocking any access.
BLOG
Cloudflare
How to configure Cloudflare so your store loads fast and search engines and AI bots can read it: caching, Workers, robots.txt and per-bot control.
Robots.txt editor: one switch per bot, published via Cloudflare
Your platform writes robots.txt and Cloudflare rewrites it. How the editor works: it reads your real file, one switch per bot, and publishes the result through a Worker.
How to set up Cloudflare for SEO and GEO (no code needed)
Put your store behind Cloudflare in one afternoon, free and without code: 5 plain-language steps and the 3 mistakes that can make you invisible on Google and ChatGPT.
Cloudflare for SEO and GEO: technical configuration guide
DNS, TLS, cache, Bot Fight Mode and AI Crawl Control: the exact Cloudflare settings that decide whether Googlebot, Bingbot and AI search bots can see your store.
Can AIs read your store? Accessibility and indexing with Cloudflare
Over half of web traffic is bots. If AI crawlers can't read your store, you don't exist in ChatGPT. Audit it in Cloudflare in 15 minutes — no redesign needed.
Cloudflare Workers: publish your IndexNow key without touching your store
How to serve the {key}.txt file at the root of a SaaS-hosted domain: free Workers, key-agnostic routes and the real case of A records bypassing your zone.