Get the latest tech news

Carnegie Mellon staffed a fake company with AI agents. It was a total disaster.


A new study tested how AI agents performed in the workplace. The results show that AI isn't ready to do your job.

Set up by a group of Carnegie Mellon University researchers, the simulation mimicked the trappings of a small software company with internal websites, a Slack-like chat program, an employee handbook, and designated bots — an HR manager and chief technology officer — to contact for help. To test this out, the Carnegie Mellon researchers instructed artificial intelligence models from Google, OpenAI, Anthropic, and Meta to complete tasks a real employee might carry out in fields such as finance, administration, and software engineering. While it's too early to tell how effective Moody's approach is, its managing director of AI, Sergio Gago, says the firm is actively exploring what kinds of work — like analyzing the financials of a small business — agents could take over.

Get the Android app

Or read this on r/technology

Read more on:

Photo of AI agents

AI agents

Photo of Carnegie Mellon

Carnegie Mellon

Photo of total disaster

total disaster

Related news:

News photo

AI isn’t ready to replace human coders for debugging, researchers say | Even when given access to tools, AI agents can't reliably debug software.

News photo

Carnegie Mellon student with one semester left learns his visa was revoked

News photo

Did someone say AI agents, Google asks, bursting in