Get the latest tech news

Common Crawl Criticized for 'Quietly Funneling Paywalled Articles to AI Developers'

For more than a decade, the nonprofit Common Crawl "has been scraping billions of webpages to build a massive archive of the internet," notes the Atlantic, making it freely available for research. "In recent years, however, this archive has been put to a controversial purpose: AI companies including...

None

Get the Android app