Get the latest tech news
Man tricks OpenAI’s voice bot into duet of The Beatles’ “Eleanor Rigby”
OpenAI doesn’t want its chatbot to sing, but sometimes the ability slips through.
On Thursday, a software architect named AJ Smith tweeted a video of himself playing a duet of The Beatles' 1966 song "Eleanor Rigby" with AVM. OpenAI possibly added this restriction because AVM may otherwise reproduce copyrighted content, such as songs that were found in the training data used to create the AI model itself. That's what is happening here to a limited extent, so in a sense, Smith has discovered a form of what researchers call a " prompt injection," which is a way of convincing an AI model to produce outputs that go against its system instructions.
Or read this on ArsTechnica
