Digiday

FromDigiday Daily ([email protected])
Subject (95)Cloudflare updates robots.txt for the AI era – but publishers still want more bite against bots
Preheader (150)September 29, 2025 Presented by As publishers continue their face off with AI bots scraping their content, they want solutions with real teeth. So whi
Typography
Arial
Colors
Text Analysis
Body Words683
Subject Words16
Body Emojis
Subject Emojis
Media Analysis
Text Links32
Image Links10
Total Links42
Images15
Technical Metrics
Performance
HTML Size, Kb
Pixel Length, px5795 px
X-Spam Score-0.1
Preheader OptimizedNo
Timing
Day of WeekFriday
TimeMorning

Cloudflare updates robots.txt for the AI era – but publishers still want more bite against bots

September 29, 2025 Presented by As publishers continue their face off with AI bots scraping their content, they want solutions with real teeth. So whi
Cloudflare updates robots.txt for the AI era – but publishers still want more bite against bots