Get the latest tech news

Document poisoning in RAG systems: How attackers corrupt AI's sources


I injected three fabricated documents into a ChromaDB knowledge base. Here’s what the LLM said next.

None

Get the Android app

Or read this on Hacker News

Read more on:

Photo of sources

sources

Photo of attackers

attackers

Photo of corrupt AI

corrupt AI

Related news:

News photo

Agents need vector search more than RAG ever did

News photo

U.S. military is using AI to help plan Iran air attacks, sources say, as lawmakers call for oversight

News photo

ChatGPT, Gemini, and other chatbots helped teens plan shootings, bombings, and political violence, study shows / Of the 10 major chatbots tested, only one, Claude, reliably shut down would-be attackers.