Get the latest tech news

AI companies are reportedly still scraping websites despite protocols meant to block them


According to a letter by a startup called TollBit, as reported by Reuters, multiple AI companies are ignoring "do not crawl" instructions in the robots.txt protocol and scraping websites to get content used to train their technologies.

Apple said on Friday that it would delay iOS 18’s marquee AI features in the European Union, conveniently blaming Digital Markets Act (DMA) regulations. The company claimed it would block the launch of Apple Intelligence, iPhone Mirroring on the Mac and SharePlay Screen Sharing in the EU this year. The biggest news stories this morning: More than 1,000 students pledge not to work at Google and Amazon due to Project Nimbus, Netflix House will open two locations in Texas and Pennsylvania in 2025, The Webb Telescope’s dazzling nebula image supports a long-held theory.

Get the Android app

Or read this on Endgadget

Read more on:

Photo of Websites

Websites

Photo of AI companies

AI companies

Photo of protocols

protocols

Related news:

News photo

iOS 18 and macOS Sequoia Let Websites and Apps Automatically Update Existing Logins to Passkeys

News photo

Show HN: Explore Websites by Chosen Color

News photo

Media Companies Are Making a Huge Mistake With AI | News organizations rushing to absolve AI companies of theft are acting against their own interests.