Get the latest tech news

Cloudflare launches a marketplace that lets websites charge AI bots for scraping


Cloudflare is launching a new marketplace that reimagines the relationship between publishers and AI companies.

Cloudflare, a cloud infrastructure provider that serves 20% of the web, announced Tuesday the launch of a new marketplace that reimagines the relationship between website owners and AI companies — ideally giving publishers greater control over their content. In a 2024 interview, Cloudflare CEO Matthew Prince told TechCrunch these products were laying a foundation for a new type of marketplace in which publishers could distribute their content to AI companies and be compensated for it. Several large publishers, including Conde Nast, TIME, The Associated Press, The Atlantic, ADWEEK, and Fortune, have signed on with Cloudflare to block AI crawlers by default in support of the company’s broader goal of a “permission-based approach to crawling.”

Get the Android app

Or read this on TechCrunch

Read more on:

Photo of Websites

Websites

Photo of marketplace

marketplace

Photo of Cloudflare

Cloudflare

Related news:

News photo

Cloudflare Is Blocking AI Crawlers by Default

News photo

Russia’s throttling of Cloudflare makes sites inaccessible

News photo

Show HN: PRSS Site Creator – Create Blogs and Websites from Your Desktop