Conversation memory: what does the model remember
The model remembers nothing; it knows whatever you carry to it on each call. Three strategies for carrying have three different shapes of forgetting.
4 steps
225 XP
A free account is needed
Start the lesson →
Sources
- Liu, N. F. et al. 2024 · Lost in the Middle: How Language Models Use Long Contexts · TACL 2024
- Lewis, P. et al. 2020 · Retrieval-Augmented Generation for Knowledge-Intensive NLP Tasks · NeurIPS 2020
- Packer, C. et al. 2023 · MemGPT: Towards LLMs as Operating Systems · arXiv:2310.08560
- Xu, P. et al. 2024 · Retrieval Meets Long Context Large Language Models · ICLR 2024
ML Academy · an interactive machine learning course that runs in your browser ·
All lessons