[Cloudflare] Redirects for AI Training: Canonicals Become 301s
What if your deprecated docs are poisoning AI models? Cloudflare just flipped canonical tags into hard redirects for training bots— a sly fix to a sneaky problem.
⚡ Key Takeaways
- Canonical tags become automatic 301 redirects for verified AI training crawlers, ignoring deprecation banners that bots treat as content. 𝕏
- Cloudflare Radar now tracks AI response codes (2xx/3xx/etc.) across web traffic, revealing enforcement gaps. 𝕏
- Scales better than manual rules—no UA tracking or path-by-path config needed. 𝕏
- Unique insight: Mirrors early web hotlink wars, giving content owners prescriptive control over AI data diets. 𝕏
Worth sharing?
Get the best Developer Tools stories of the week in your inbox — no noise, no spam.
Originally reported by Cloudflare Blog
Related Stories
AI Dev Tools
Cloudflare's Sneaky React Bot Trap: Reverse-Engineered and Ripe for Bypassing
Open Source
32% of Web Traffic Is Bots — And AI's Wrecking Caches for Everyone Else
Cloud & Infrastructure
Cloudflare's 500 Tbps: Flex or Fluff?
Cloud & Infrastructure