The curse of dimensionality: why neighbours move away
In the k-NN lesson we said "ask the nearest neighbour". In 100 dimensions the nearest neighbour is only 40% closer than the furthest one. So who are you going to ask?
4 steps
160 XP
A free account is needed
Start the lesson →
Sources
- Bellman, R. 1961 · Adaptive Control Processes: A Guided Tour · Princeton University Press
- Beyer, K. et al. 1999 · When Is Nearest Neighbor Meaningful? · ICDT 1999, 217-235
- Hastie, Tibshirani, Friedman 2009 · The Elements of Statistical Learning, Bölüm 2.5 · Springer
ML Academy · an interactive machine learning course that runs in your browser ·
All lessons