AI bot configuration

Assess

Platforms

Cloudflare settings for controlling how AI-related crawlers and agents are handled.

Why it's here

Placed in Assess: 1 article(s) of evidence from 1 source(s), led by product launches, with 0 in the last 30 days. Confidence 24%. Low accumulated evidence, so it defaults conservatively pending more signal.

Evidence (1)

6Cloudflare Blog·8/21/2026product_launch
Cloudflare launches Bot Preference Sync
Cloudflare introduced Bot Preference Sync, a feature that synchronizes AI bot preferences configured in Cloudflare with the site's robots.txt file. The tool is available to all customers and can be enabled or disabled at any time to help site owners align stated crawler preferences with enforced policies for search, agent, and training traffic.