Foundation models: one model for everything
The value of a foundation model comes not from its size but from the shared representation it finds at the intersection of many tasks. We can measure that intersection.
4 steps
225 XP
A free account is needed
Start the lesson →
Sources
- Bommasani, R. et al. 2021 · On the Opportunities and Risks of Foundation Models · arXiv:2108.07258
- Caruana, R. 1997 · Multitask Learning · Machine Learning 28(1)
- Maurer, A. et al. 2016 · The Benefit of Multitask Representation Learning · JMLR 17(81)
- Tripuraneni, N. et al. 2021 · Provable Meta-Learning of Linear Representations · ICML 2021
ML Academy · an interactive machine learning course that runs in your browser ·
All lessons