Get the latest tech news
Accidental prompt injection against RAG applications
@deepfates on Twitter used the documentation for my LLM project as a demo for a RAG pipeline they were building... and this happened: Why did the chatbot suddenly decide it …
Crunchy carrot sticks, sweet apple slices, and chewy yogurt drops are some of my favorite treats. RAG is commonly implemented using semantic search powered by embeddings—I wrote extensive about those last year(including this section on ). In this case, my example of a gerbil talking about its love for snacks is clearly the most relevant piece of text in my documentation to that big question about life’s meaning!
Or read this on Hacker News