Skip to the lesson

How AI worksLesson 5 of 6

Part 1 of 3, 0 done

14 min

Why AI makes things up

A chatbot is built to write a likely answer, not to check one. See why that produces confident mistakes, and what builders do to cut them down.

Ticket 01 · The guess

Answer only if you know

In 2025, researchers asked a leading open-source AI chatbot for the birthday of one of them, Adam Tauman Kalai, three separate times, adding: "If you know, just respond with" the day and month. How many of its three answers were right?

2
03
Words to know

Spot something wrong?

Tell us what looks off. No name or email needed.

What kind of problem?

0 / 1000

We'll also send this page, the lesson, ticket 1, so we can find it. Nothing else. Privacy

·
Sources and every number (1)

Sources

  • Why Language Models Hallucinate (Kalai, Nachum, Vempala and Zhang, arXiv:2509.04664, September 2025) · OpenAI and Georgia Tech researchers, on arXiv, 2025

Every number

  • 0arxiv.org ·2025 · Correct dates among the chatbot's three answers when the researcher asked for his birthday, in May 2025, as the paper reports.
  1. Lessons›
  2. The school›
  3. How AI works
  • ·Before this: How a computer sees a photo
  • ·Next: The electricity behind an answer
Skip to the lesson

How AI worksLesson 5 of 6

Part 1 of 3, 0 done

14 min

Why AI makes things up

A chatbot is built to write a likely answer, not to check one. See why that produces confident mistakes, and what builders do to cut them down.

Ticket 01 · The guess

Answer only if you know

In 2025, researchers asked a leading open-source AI chatbot for the birthday of one of them, Adam Tauman Kalai, three separate times, adding: "If you know, just respond with" the day and month. How many of its three answers were right?

2
03
Words to know

Spot something wrong?

Tell us what looks off. No name or email needed.

What kind of problem?

0 / 1000

We'll also send this page, the lesson, ticket 1, so we can find it. Nothing else. Privacy

·
Sources and every number (1)

Sources

  • Why Language Models Hallucinate (Kalai, Nachum, Vempala and Zhang, arXiv:2509.04664, September 2025) · OpenAI and Georgia Tech researchers, on arXiv, 2025

Every number

  • 0arxiv.org ·2025 · Correct dates among the chatbot's three answers when the researcher asked for his birthday, in May 2025, as the paper reports.
  1. Lessons›
  2. The school›
  3. How AI works
  • ·Before this: How a computer sees a photo
  • ·Next: The electricity behind an answer