Get the latest tech news

The first big AI disaster is yet to happen


The first public passenger locomotive, Locomotion No. 1, began service in September 1825. The first mass-casualty railway disaster happened seventeen years…

Eleven years later, the first mass-casualty airline disaster happened, when a flight to Milan disintegrated mid-air, killing all twelve passengers. Likewise, OpenAI’s recent sycophancy incident could plausibly have contributed to violence (though I’m not aware of any specific cases, so maybe they caught it in time). I expect anyone hooking up an AI to a high-stakes agentic system will be cautious enough - because they’ll likely be a government or large company - to use a proven, safe model.

Get the Android app

Or read this on Hacker News

Read more on:

Photo of big AI disaster

big AI disaster