Get the latest tech news

Anthropic Let Claude Run Its Office Shop. Then Things Got Weird


The AI lost $200 and gave items away for free, despite being told to earn a profit

The chatbot (full name: Claude 3.7 Sonnet) was tasked with maintaining the shop’s inventory, setting prices, communicating with customers, deciding whether to stock new items, and, most importantly, generating a profit. Claude was given various tools to achieve these goals, including Slack, which it used to ask Anthropic employees for suggestions, and help from human workers at Andon Labs, an AI company that built the experiment's infrastructure. “Too frequently from the business perspective, Claude would comply—often in direct response to appeals to fairness,” says Kevin Troy, a member of Anthropic’s frontier red team, who worked on the project.

Get the Android app

Or read this on r/technology

Read more on:

Photo of things

things

Photo of Anthropic

Anthropic

Photo of Claude

Claude

Related news:

News photo

Show HN: A tool to benchmark LLM APIs (OpenAI, Claude, local/self-hosted)

News photo

As job losses loom, Anthropic launches program to track AI’s economic fallout

News photo

Project Vend: Can Claude run a small shop? (And why does that matter?)