Get the latest tech news

Online publishers face a dilemma: Allow AI scraping from Google or lose search visibility


Online publications increasingly face a lose-lose dilemma: allow Google to use their published content to produce inline AI-generated search “answers” or lose visibility in the company’s search engine.

The crux of the problem lies in the Googlebot, the crawler that scours and indexes the live web to produce the results you see when you enter search terms. Other options it’s reportedly weighing include forcing Google to share search data with competitors or relinquishing its default search-engine deals, like the$18 billion one it inked with Apple. iFixit CEO Kyle Wiens told Bloomberg, “I can block ClaudeBot [Anthropic’s crawler for its Claude chatbot] from indexing us without harming our business.

Get the Android app

Or read this on Endgadget

Read more on:

Photo of Google

Google

Photo of dilemma

dilemma

Photo of Allow

Allow

Related news:

News photo

You can't buy the original Pixel Fold right now, but Google says it'll return

News photo

Judge tells Google: Play Store shakeup coming; punishment for running a monopoly

News photo

Google quietly opens Imagen 3 access to all U.S. users