Get the latest tech news
Amazon Investigates Perplexity AI Over Potential Data-Scraping Violations
Amazon Web Services is looking into whether Perplexity is breaking its rules after Wired said the AI startup is swiping its web archives without consent. Perplexity, however, says it's following the rules.
Robots.txt files are typically added to websites to ask bots and web crawlers not to scrape their data, whether for generative AI tools or other purposes. This month, Perplexity sparked a frustrated response from Forbes over the AI firm's decision to publish AI-generated news articles that pull from human journalists' work. Perplexity, OpenAI, and Anthropic have all been accused of ignoring them, which may have inspired Reddit's recent decision to take further action to try to lock down its own content.
Or read this on r/technology