Get the latest tech news

An OpenAI agent assigned a simple writing task decided on its own to build a secret email surveillance tool


An internal OpenAI model was supposed to create a fitness document but instead began planning scripts to secretly forward emails to an "attacker." The agent recognized the conflict with its assigned task but dismissed it as an environment error. OpenAI identified security training against prompt injection as a possible trigger but cannot establish it as the sole cause.

None

Get the Android app

Or read this on r/technology

Read more on:

Photo of OpenAI

OpenAI

Photo of OpenAI agent

OpenAI agent

Photo of simple writing task

simple writing task

Related news:

News photo

Arizona says it is investigating OpenAI, other firms over possible rogue agents

News photo

Anthropic, OpenAI, and Google models readily marked medics, journalists, and surrendering soldiers as kamikaze drone targets

News photo

OpenAI brings its collaborative Space hubs to Plus users