Skip to the lesson

LegalLesson 4 of 4

Part 1 of 3, 0 done
HOURS

13 min

AI at the legal desk

One legal research company promised citations free of made-up answers. Researchers tested it anyway. AI now sorts a lawsuit's documents, drafts contracts and answers legal questions with citations attached. Here's where it helps a company's legal team, where it still makes things up, and what a lawyer checks before signing.

Ticket 01 · The guess

Hallucination-free?

Legal research companies sell AI tools that answer legal questions with citations attached. In 2024 one said its tool delivers 100%doi.org ·2025 "hallucination-free linked legal citations". Researchers from Stanford and Yale put 202 questionsdoi.org ·2025 to the leading tools in spring 2024. For the best tool they tested, what share of answers held a hallucination: something false, or a source that doesn't say what the answer claims?

5%
0%100%
Words to know

Spot something wrong?

Tell us what looks off. No name or email needed.

What kind of problem?

0 / 1000

We'll also send this page, the lesson, ticket 1, so we can find it. Nothing else. Privacy

·
Sources and every number (1)

Sources

  • Hallucination-Free? Assessing the Reliability of Leading AI Legal Research Tools (Magesh, Surani, Dahl, Suzgun, Manning and Ho; Journal of Empirical Legal Studies, 2025; 202 queries run March to May 2024; abstract and Table B1) · Journal of Empirical Legal Studies (Cornell Law School and Wiley), open access, 2025

Every number

  • 100%doi.org ·2025 · LexisNexis's own 2024 claim for Lexis+ AI's linked legal citations (free of hallucinations), as quoted in the study.
  • 202 questionsdoi.org ·2025 · Legal questions the researchers put to each tool, run between March and May 2024.
  • 17%doi.org ·2025 · Share of Lexis+ AI's answers that held a hallucination (a false statement, or a source that doesn't say what the answer claims), the best of the tools tested (the study's table of hallucination rates; the abstract gives seventeen to thirty-three percent for the legal tools).
  • 33%doi.org ·2025 · Share of Westlaw AI-Assisted Research's answers that held a hallucination (the study's table of hallucination rates).
  • 43%doi.org ·2025 · Share of GPT-4's answers, a general chatbot tested for comparison, that held a hallucination (the study's table of hallucination rates).
  1. Lessons›
  2. Inside a business›
  3. Legal
  • ·Before this: When someone sues
Skip to the lesson

LegalLesson 4 of 4

Part 1 of 3, 0 done
HOURS

13 min

AI at the legal desk

One legal research company promised citations free of made-up answers. Researchers tested it anyway. AI now sorts a lawsuit's documents, drafts contracts and answers legal questions with citations attached. Here's where it helps a company's legal team, where it still makes things up, and what a lawyer checks before signing.

Ticket 01 · The guess

Hallucination-free?

Legal research companies sell AI tools that answer legal questions with citations attached. In 2024 one said its tool delivers 100%doi.org ·2025 "hallucination-free linked legal citations". Researchers from Stanford and Yale put 202 questionsdoi.org ·2025 to the leading tools in spring 2024. For the best tool they tested, what share of answers held a hallucination: something false, or a source that doesn't say what the answer claims?

5%
0%100%
Words to know

Spot something wrong?

Tell us what looks off. No name or email needed.

What kind of problem?

0 / 1000

We'll also send this page, the lesson, ticket 1, so we can find it. Nothing else. Privacy

·
Sources and every number (1)

Sources

  • Hallucination-Free? Assessing the Reliability of Leading AI Legal Research Tools (Magesh, Surani, Dahl, Suzgun, Manning and Ho; Journal of Empirical Legal Studies, 2025; 202 queries run March to May 2024; abstract and Table B1) · Journal of Empirical Legal Studies (Cornell Law School and Wiley), open access, 2025

Every number

  • 100%doi.org ·2025 · LexisNexis's own 2024 claim for Lexis+ AI's linked legal citations (free of hallucinations), as quoted in the study.
  • 202 questionsdoi.org ·2025 · Legal questions the researchers put to each tool, run between March and May 2024.
  • 17%doi.org ·2025 · Share of Lexis+ AI's answers that held a hallucination (a false statement, or a source that doesn't say what the answer claims), the best of the tools tested (the study's table of hallucination rates; the abstract gives seventeen to thirty-three percent for the legal tools).
  • 33%doi.org ·2025 · Share of Westlaw AI-Assisted Research's answers that held a hallucination (the study's table of hallucination rates).
  • 43%doi.org ·2025 · Share of GPT-4's answers, a general chatbot tested for comparison, that held a hallucination (the study's table of hallucination rates).
  1. Lessons›
  2. Inside a business›
  3. Legal
  • ·Before this: When someone sues