Get the latest tech news

TechCrunch Minute: Reddit is taking a stand against AI crawlers


The battle for content for the AI machine continues as Reddit makes a move to block AI companies from crawling their content.

In its latest earnings report, Match Group acknowledged growing pains for its dating app Tinder, where the paid user base shrank for the sixth quarter… When you run a website whose business model involves attracting clicks and eyeballs, there’s not much appeal in letting AI companies hoover up your content and then they don’t send you any traffic — and in some cases, they outright plagiarize your work. So by by changing its robots.txt file, and also by continuing to rate limit and block unknown bots and crawlers, Reddit seems to be working to prevent the practices that companies like Perplexity AI have been criticized for.

Get the Android app

Or read this on TechCrunch

Read more on:

Photo of Reddit

Reddit

Photo of Stand

Stand

Photo of AI crawlers

AI crawlers

Related news:

News photo

Reddit hopes robots.txt tweak will do the trick in scaring off AI training data scrapers

News photo

Reddit puts AI scrapers on notice

News photo

Reddit’s upcoming changes attempt to safeguard the platform against AI crawlers