Get the latest tech news
Leaders at the Paris AI Summit Must Set Global Standards or Risk a Destructive Race
The Paris AI Summit could be a turning point for global AI governance.
While a single autonomous trading algorithm malfunction in 2012 caused Knight Capital to lose$440 million in just 45 minutes, general purpose AI systems are likely to be deployed far more widely across sectors, multiplying the potential for costly accidents. Because AI systems are essentially "black boxes" whose decision-making are not fully understood, we can't always reliably predict how they will behave once deployed; they might, for instance, actively resist being shut down if continued operation better serves the objective they have been assigned by humans. Finally, the creation of a shared incident reporting system could establish a crucial feedback loop, enabling the global AI community to rapidly learn from and adapt to emerging safety challenges.
Or read this on r/technology