Get the latest tech news
Join us today for Ars Live: Our first encounter with manipulative AI
On Nov. 19, join Benj Edwards and Simon Willison’s live YouTube chat about the “Great Bing Chat Fiasco of 2023.”…
The key to a prompt injection is to manipulate the model’s responses by embedding new instructions within the input text, effectively redirecting or altering the AI’s intended behavior. Sydney called Benj Edwards " the culprit and the enemy" in one instance, bringing the odd AI behavior sponsored by a trillion-dollar tech giant a little too close for comfort. During the Ars Live discussion, Benj and Simon will talk about what happened during that intense week in February 2023, why Sydney went off the rails, what covering Bing Chat was like during the time, how Microsoft reacted, the crisis in the AI alignment community it inspired, and what lessons everyone learned from the episode.
Or read this on ArsTechnica