Get the latest tech news

Trusting your own judgement on 'AI' is a risk


Web dev at the end of the world, from Hveragerði, Iceland

He described it as a process where the mechanics of cognitive optimisation in the brain could be deceptively triggered into a semi-automatic sequence that bypassed your regular judgement – his very eighties metaphor was like that of a tape in your mind that went “click whirr” and played in response to specific stimuli. It’s like we had a new wonder drug on the market but we had no way of knowing if its risk dynamic is Thalidomide (brutal and horrible deformities), Paracetamol (low lethal overdose threshold), or Penicillin (systemic overuse destroys its effect). This is exactly the kind of psychological hazard – lot to gain, subjective experiences, observations free of the context of its impact on other parts of the organisation or society – that might as well be tailor-made to trick developers who are simultaneously overwhelmingly convinced of their own intelligence and completely unaware of their own biases and limitations.

Get the Android app

Or read this on Hacker News

Read more on:

Photo of risk

risk

Photo of judgement

judgement

Related news:

News photo

OneDrive File Picker flaw grants full drive access when users share a single file | Careless Microsoft security puts OneDrive users at serious risk

News photo

The rise of judgement over technical skill

News photo

Millions at risk after attackers steal UK legal aid data dating back 15 years