When the ground moves: distribution shift
Not a single line of the model changed and its accuracy fell from 96% to 52%. The fault is not in the model but in the world moving.
4 steps
160 XP
A free account is needed
Start the lesson →
Sources
- Quiñonero-Candela, J. et al. 2009 · Dataset Shift in Machine Learning · MIT Press
- Sculley, D. et al. 2015 · Hidden Technical Debt in Machine Learning Systems · NeurIPS 2015
- Huyen, C. 2024 · AI Engineering, veri kayması bölümü · O'Reilly
ML Academy · an interactive machine learning course that runs in your browser ·
All lessons