AI Pulse
📄 论文解读

AI 终于有了原生记忆,不再靠外挂

现在的 AI 助手记不住事,是因为记忆是外挂的:要么把聊天记录塞进上下文,要么靠外部数据库检索。这篇论文提出把记忆直接做进模型内部——历史信息被压缩成模型自身的一个状态,每次对话都自动更新,不需要额外训练,推理时模型权重冻结,记忆靠一次前向传播就完成。它让 AI 的记忆从「每次重新读笔记」变成「真正长在脑子里」。这不是你明天就能用上的功能,但它指向一个方向:AI 的长期记忆可能不再是插件,而是模型的天性。

📄 原文摘要(英文)

Recent advances in AI agents have increasingly internalized native capabilities into their underlying foundation models, giving rise to multimodal foundation models and large reasoning models. However, agent memory is still primarily implemented through external modules, leaving the native memory capability largely unexplored. In this paper, we take a first step toward this direction by introducing memory foundation models, which empower foundation models with native memory capabilities. We formalize native memory from two perspectives: a persistent and dynamically evolving memory state within the backbone, and native memory procedures that autonomously store and utilize information through model computation. We show that native memory offers advantages in architecture, end-to-end optimization, and efficiency. Based on this formulation, we propose Metis, the first prototype of memory foundation models. Metis introduces a new architecture that equips a foundation model with a native memory state, allowing historical information to be compressed into the model and accessed through memory attention. We construct large-scale memory-specific training data and introduce multiple optimization objectives to acquire these native memory procedures through mid-training. The online memory maintenance of Metis is gradient-free, and the memory update requires only a forward pass. At inference time, all learned model weights remain frozen, while the native memory states are autonomously transformed through standard forward computation. Through extensive experiments, we show that Metis exhibits native memory capabilities and further provide a detailed analysis of its strengths, limitations, and behaviors. To facilitate future research on memory foundation models, we release our project and model checkpoints.

arXiv 原文

📬 订阅 AI Pulse

每天三次更新,不错过重要信号

▲ 回到顶部