Cloudflare’s forthcoming AI crawler defaults raise Googlebot issue

Cloudflare’s 15 September changes classify crawlers by Search, Agent and Training behaviour. Because some crawlers are multi-purpose, blocking training activity can also block a crawler involved in Search.

Category: This Week
Previous Post
AI Crawler Traffic in 2026
Next Post
Internal-link restructuring reportedly increased