The Hessian: measuring the curvature of the curve
The same loss, the same learning rate rule. When the valley is round it finishes in one step; turn it into a narrow canyon and it takes 363.
4 steps
175 XP
A free account is needed
Start the lesson →
Sources
- Nocedal, J. & Wright, S. J. 2006 · Numerical Optimization, Bölüm 3.3 · Springer
- LeCun, Y. et al. 1998 · Efficient BackProp · Neural Networks: Tricks of the Trade, Springer
- Goodfellow, Bengio, Courville 2016 · Deep Learning, Bölüm 4.3.1 ve 8.2 · MIT Press
ML Academy · an interactive machine learning course that runs in your browser ·
All lessons