u/Cloudflare

• What it is: Bot Preference Sync automatically keeps your robots.txt aligned with the AI bot preferences you've already set in the Cloudflare dashboard, across Search, Agent, and Training categories.
• How it works: Sync content is prepended to your existing robots.txt without touching any rules you've already set. Toggle it on or off at any time.
• Granular controls: Allow, block on ad-serving pages, or block entirely for Search and Agent bots; opt out of Training with a single setting.
• New transparency bar: Mixed-use crawlers that blend search, agent use, and training must now honor no-training signals, offer opt-outs from AI summaries, and provide URL-level visibility into what was accessed.
• Available now for all plans, Free through Enterprise.

https://cfl.re/4wAAJi5