AI Pulse
📄 论文解读

AI 学习不再只靠改参数,整个系统都在进化

我们一直以为 AI 的「持续学习」就是不断调整内部参数,像人记新知识。但新综述指出,这个时代正在过去:学习可以发生在训练时、推理时,甚至模型之外的记忆库、技能库和交互规则里。研究者用「何时、如何、何处」三个轴重新梳理了这条进化线,发现前沿已经从「改参数」转向「改系统」。它不是你明天能用上的东西,但它告诉你:AI 的下一个能力跃迁,可能不再靠更大的模型,而是靠更聪明的「外部装备」和「学习时机」。

📄 原文摘要(英文)

Classical continual learning (CL) has primarily focused on enabling models to update and retain knowledge through parameter-centric mechanisms, e.g., training strategies, architectural designs, and weight adaptation. However, emerging paradigms are reshaping the scope of CL beyond this traditional model adaptation view. For instance, on-policy learning broadens the space of update mechanisms; test-time training extends CL from the training phase to inference; and external harness components such as memory, skill libraries, and interaction protocols extend the evolutionary boundaries of model capabilities far beyond the static parameter space. Collectively, these developments indicate a transition from parameter-centric learning toward system-level adaptation. To characterize this transition, we examine the evolution of continual learning through three dimensions: When, How, and Where learning occurs. The How dimension encompasses off-policy, on-policy, and beyond-gradient optimization mechanics. The When dimension captures evolution across pre-training, post-training, and inference-time stages. The Where dimension delineates updates occurring within internal parameters versus external structural constraints. Anchored by this tri-axial framework, we systematically survey representative methods, trace the ongoing transition of continual learning, and discuss the key challenges, broader implications, and future directions arising from this paradigm shift.

arXiv 原文

订阅 AI Pulse

每天 08:00 · 12:30 · 18:30 · 23:50 更新