Perplexity: measuring a model's surprise
We measure it in a setup where we know the true entropy of the source, so perplexity can be tested against a ceiling.
4 steps
175 XP
A free account is needed
Start the lesson →
Sources
- Shannon, C. E. 1951 · Prediction and Entropy of Printed English · Bell System Technical Journal 30(1)
- Jelinek, F. et al. 1977 · Perplexity: A Measure of the Difficulty of Speech Recognition Tasks · JASA 62(S1)
- Jurafsky, D. & Martin, J. H. 2024 · Speech and Language Processing, 3. baskı taslağı, Bölüm 3 · Stanford
ML Academy · an interactive machine learning course that runs in your browser ·
All lessons