Get the latest tech news
Anthropic tasked an AI with running a vending machine in its offices, and it not only sold some products at a big loss but it invented people, meetings, and experienced a bizarre identity crisis
It's all funny to watch an AI have an existential moment in a little experiment, but it's a stark reminder of the limitations that LLMs have.
So, Anthropic clearly wants to be in a position where it can pitch AI models to the retail industry, replacing people from handling online stores or managing inventory, returns, and so on. (Image credit: Anthropic)Worse still, when responding to a surge of demand for 'metal cubes', the AI carried out no searches for suitable prices and thus sold them at a significant loss. With a level of understatement on a galactic scale, Anthropic writes that "this kind of behavior would have the potential to be distressing to the customers and coworkers of an AI agent in the real world."
Or read this on r/technology