Get the latest tech news

Australian lawyer referred to legal regulator after submitting documents with case citations hallucinated by Anthropic's Claude AI


Judge warns of ‘inherent dangers’ of lawyers relying solely on AI amid growing number of fake citations or other errors

The lawyer told the court in an affidavit that he had relied on Anthropic’s Claude AI “as a research tool to identify potentially relevant authorities and to improve my legal arguments and position”, and then used Microsoft Copilot to validate the submissions. “I had an incorrect assumption that content generated by AI tools would be inherently reliable, which led me to neglect independently verifying all citations through established legal databases,” the lawyer said in the affidavit. In a NSW supreme court decision this month a self-represented litigant in a trusts case admitted to the chief justice, Andrew Bell, to have used AI to prepare her speech for the appeal hearing.

Get the Android app

Or read this on r/technology

Read more on:

Photo of Claude AI

Claude AI

Photo of documents

documents

Photo of australian

australian

Related news:

News photo

Intel engineer who stole documents for Microsoft job fined $34,000 but avoids prison | The engineer is leaving the technology industry to pursue a new career in vineyard management

News photo

Anthropic's Claude AI now has the ability to end 'distressing' conversations

News photo

Anthropic says some Claude models can now end ‘harmful or abusive’ conversations