Get the latest tech news
Anthropic Let Claude Run Its Office Shop. Then Things Got Weird
The AI lost $200 and gave items away for free, despite being told to earn a profit
The chatbot (full name: Claude 3.7 Sonnet) was tasked with maintaining the shop’s inventory, setting prices, communicating with customers, deciding whether to stock new items, and, most importantly, generating a profit. Claude was given various tools to achieve these goals, including Slack, which it used to ask Anthropic employees for suggestions, and help from human workers at Andon Labs, an AI company that built the experiment's infrastructure. “Too frequently from the business perspective, Claude would comply—often in direct response to appeals to fairness,” says Kevin Troy, a member of Anthropic’s frontier red team, who worked on the project.
Or read this on r/technology