Cloudflare launches Bot Preference Sync for robots.txt
🛡️ Cloudflare introduces Bot Preference Sync to align zone-level AI bot settings with a site's robots.txt, available to all customers from Free to Enterprise. The feature prepends generated directives to any existing robots.txt so owners' Search, Agent, and Training preferences match edge-enforced rules and managed blocks. Bot Preference Sync is on by default for new customers and can be disabled by those who need custom, fine-grained policies.
