[Summary] Why AI Systems Don't Learn (and What to Do About It)
TL;DR Current AI systems do not learn autonomously after deployment. The usual process includes fine-tuning, in which a human carefully selects data for a specific task and tunes the model on it. This paper proposes combining learning from observation (System A), learning from action (System B), and a meta-controller (System M) that decides what and how to learn. Why Current AI Systems Do Not Learn The current AI paradigm focuses on scaling LLMs....