Prompt Arena: blind comparison
Assigning an absolute score is hard, saying "which one is better" is easy. The idea behind Chatbot Arena and modern evaluation.
1 steps
60 XP
A free account is needed
Start the lesson →
Sources
- Chiang, W.-L. et al. 2024 · Chatbot Arena: An Open Platform for Evaluating LLMs by Human Preference · ICML 2024
- Elo, A. 1978 · The Rating of Chessplayers, Past and Present · Arco Publishing
- Bradley, R. & Terry, M. 1952 · Rank Analysis of Incomplete Block Designs · Biometrika, 39(3–4)
ML Academy · an interactive machine learning course that runs in your browser ·
All lessons