Get the latest tech news
Cloudflare experiment will block AI bot scrapers unless they pay a fee
Every new domain customer that signs up with Cloudflare to manage their website traffic will now be asked if they want to allow AI crawlers or to block them altogether.
To start with, every new domain customer that signs up with the company to manage their website traffic will now be asked if they want to allow AI crawlers or to block them altogether. Matthew Prince, Cloudflare's CEO, recently went on record to say that publishers are facing an existential threat, because people aren't clicking on chatbots' source links. Cloudflare believes publishers should be able to charge AI bots for access if they want to, and pay per crawl is its first experiment for that particular purpose.
Or read this on Endgadget
