Why does hallucination happen?
"The model is lying" is the wrong frame. The model is doing exactly what it was trained to do; the problem is in what it was trained to do.
2 steps
120 XP
A free account is needed
Start the lesson →
Sources
- Ji, Z. et al. 2023 · Survey of Hallucination in Natural Language Generation · ACM Computing Surveys, 55(12)
- Kalai, A. & Vempala, S. 2024 · Calibrated Language Models Must Hallucinate · STOC 2024
- Lin, S. et al. 2022 · TruthfulQA: Measuring How Models Mimic Human Falsehoods · ACL 2022
- Farquhar, S. et al. 2024 · Detecting Hallucinations Using Semantic Entropy · Nature, 630
ML Academy · an interactive machine learning course that runs in your browser ·
All lessons