Get the latest tech news
Cloudflare says AI companies have been “scraping content without limits” – now it’s letting website owners block crawlers and force them to pay
The move by Cloudflare looks to improve transparency and support publishers
“This significant shift means that every new domain starts with the default of control and eliminates the need for webpage owners to manually configure their settings to opt out,” Cloudflare said in a statement. The move by Cloudflare comes amidst long-running disputes between media organizations and AI companies over the use of crawlers to scrape data from the web for training purposes. “This is a critical step toward creating a fair value exchange on the Internet that protects creators, supports quality journalism and holds AI companies accountable.”
Or read this on r/technology