Get the latest tech news

Cloudflare adds option to block AI scrapers and crawlers


Attached: 1 image Interesting that Cloudflare offers this feature now. It's not 100% clear how it works, but happy to flip it on. It doesn't appear to do anything with robots.txt so it's probably more UA based.

Get the Android app

Or read this on Hacker News

Read more on:

Photo of option

option

Photo of Cloudflare

Cloudflare

Photo of crawlers

crawlers

Related news:

News photo

Cloudflare: We never authorized polyfill.io to use our name

News photo

Cloudflare automatically fixes Polyfill.io for free sites

News photo

iCloud 'Keep Downloaded' Option Included in iOS 18 and macOS Sequoia