"Artificial intelligence (AI)" and the law thread 🧵
-
_CEO Asks ChatGPT How to Void $250 Million Contract, Ignores His Lawyers, Loses Terribly in Court_
https://www.404media.co/ceo-ignores-lawyers-asks-chatgpt-how-to-void-250-million-contract-loses-terribly-in-court/Third case about a lawyer reprimanded for fake cases in their factum, likely because of the use of artificial intelligence.
https://www.crookston.ca/wp/2026/03/12/false-quotes-fake-citations-and-artificial-intelligence/
-
Third case about a lawyer reprimanded for fake cases in their factum, likely because of the use of artificial intelligence.
https://www.crookston.ca/wp/2026/03/12/false-quotes-fake-citations-and-artificial-intelligence/
Added a fourth to that page.
Zhang v Chen, 2024 BCSC 285.
-
Wait a second, I may have just taken on a second job.
i just searched "artificial intelligence" and hallucination, and 138 results popped up.
The majority are not articles about the topic but actual cases where the decision maker has made comments that the cases before it are hallucinated.
Edit: Upon review, the vast majority are self-represented people using AI. That they do so is not helpful, but at least understandable. I won't be focussing on these cases here.
-
Wait a second, I may have just taken on a second job.
i just searched "artificial intelligence" and hallucination, and 138 results popped up.
The majority are not articles about the topic but actual cases where the decision maker has made comments that the cases before it are hallucinated.
Edit: Upon review, the vast majority are self-represented people using AI. That they do so is not helpful, but at least understandable. I won't be focussing on these cases here.
It is very clear from the sheer volume of such decisions that the courts and tribunals are getting absolutely PUMMELLED with this garbage.
-
It is very clear from the sheer volume of such decisions that the courts and tribunals are getting absolutely PUMMELLED with this garbage.
A federal judge just disqualified both parties' lawyers from practicing before the courts for 2 years. They were also each fined about $3,000.
Each side had used "artificial intelligence" to generate their materials and the materials were full of fake cases. Good times.
-
A federal judge just disqualified both parties' lawyers from practicing before the courts for 2 years. They were also each fined about $3,000.
Each side had used "artificial intelligence" to generate their materials and the materials were full of fake cases. Good times.
"Aycock barred the lawyers on each side who either used AI for legal research or for drafting the filings at issue — Kathleen Wilson and Kathryn Williams — from appearing in the Northern District of Mississippi for two years. Wilson was fined $2,500, and Williams was fined $3,500."
-
"Aycock barred the lawyers on each side who either used AI for legal research or for drafting the filings at issue — Kathleen Wilson and Kathryn Williams — from appearing in the Northern District of Mississippi for two years. Wilson was fined $2,500, and Williams was fined $3,500."
We just tested* a legal LLM and at least about 1 3rd of the cases it returned were not relevant to the question or the cases did not exist.
I tested it filing in citations only and it seemed to do that reasonably well but it still got two wrong. This was just looking up the actual citations of a case with a given name.
(Edit: *I should clarify that this thing came bundled in another service we already have. So this is not a service we sought out. It was shoved into my face.)
-
We just tested* a legal LLM and at least about 1 3rd of the cases it returned were not relevant to the question or the cases did not exist.
I tested it filing in citations only and it seemed to do that reasonably well but it still got two wrong. This was just looking up the actual citations of a case with a given name.
(Edit: *I should clarify that this thing came bundled in another service we already have. So this is not a service we sought out. It was shoved into my face.)
This appears to be a huge waste of time and money and energy and this isn't anything I would pay for.
I think I've pointed out elsewhere that when I ran a search in the AI search box versus the regular search box, I basically got the same results back.
I presume the tests that they run these things against are tailored to produce great results and that's how they conclude that they're operating at a PhD level. Because it's giving me garbage.
-
This appears to be a huge waste of time and money and energy and this isn't anything I would pay for.
I think I've pointed out elsewhere that when I ran a search in the AI search box versus the regular search box, I basically got the same results back.
I presume the tests that they run these things against are tailored to produce great results and that's how they conclude that they're operating at a PhD level. Because it's giving me garbage.
I just asked CoPilot to check names of cases and provide me with links as a test. After six queries, it made two lists, one “confirmed CanLII links” and the second unconfirmed but likely links.
The very first item on the “confirmed” link was incorrect.
Its output:
"Clean master list of CanLII links
Confirmed CanLII URLs
Animal House Investments Inc. v. Lisgar Development Ltd. (2007), 2007 CanLII 82794 (ON SC): https://canlii.ca/t/1x827"
-
I just asked CoPilot to check names of cases and provide me with links as a test. After six queries, it made two lists, one “confirmed CanLII links” and the second unconfirmed but likely links.
The very first item on the “confirmed” link was incorrect.
Its output:
"Clean master list of CanLII links
Confirmed CanLII URLs
Animal House Investments Inc. v. Lisgar Development Ltd. (2007), 2007 CanLII 82794 (ON SC): https://canlii.ca/t/1x827"
Of the about 9 cases it said it could not find citations for, I found 6.
This is basic, basic work right here. Not even research. And this thing cannot do it.
-
P Pteryx the Puzzle Secretary shared this topic on
-
K Kichae crossposted this topicto General on
-
K Kichae moved this topic from World
Hello! It looks like you're interested in this conversation, but you don't have an account yet.
Getting fed up of having to scroll through the same posts each visit? When you register for an account, you'll always come back to exactly where you were before, and choose to be notified of new replies (either via email, or push notification). You'll also be able to save bookmarks and upvote posts to show your appreciation to other community members.
With your input, this post could be even better 💗
Register Login