
Advanced Guide
Cloudflare Bot Preference Sync + robots.txt: A Practical Policy for AI Crawlers Without Blocking Googlebot
Copy-ready playbook to restrict AI crawlers using robots.txt plus Cloudflare Bot Preference Sync and edge rules—while explicitly protecting Googlebot/Bingbot, with verification and rollback steps.
Nadia Gastrom | | 4 min read











