让AI读懂自己的“学习笔记”
大模型一直在学，却从不知道自己学了什么——就像人失忆了，但大脑里还留着记忆的痕迹。这篇论文训练了一个“阅读器”，专门去读模型更新参数时留下的痕迹，把它翻译成人话。更关键的是，这个阅读器还能反过来指导模型改自己：只动0.5%的参数，就让模型拒绝有害提问的比例从57.9%升到64.1%，还能让数学推理更会拆步骤。它不是你明天能用上的，但“AI能读懂并修改自己的学习过程”这件事，第一次有了可行的路径。
📄 原文摘要(英文)
As language models take a growing role in AI development, a natural aspiration is for them to reflect on their own learning process, as humans do, and use that reflection to improve themselves. At the same time, these models have an advantage that human learners lack, since training leaves parameter-level traces that can, in principle, be inspected directly. However, current models cannot decode these traces into an explicit account of what they have learned. To this end, we introduce the Imprint Reader, a model trained with Semantic Mount-and-Read Tuning (SaRT) to describe frozen weight updates. SMaRT mounts each update onto the Reader and uses an anchor-free meta-query to elicit a natural-language description, while no-change and random-perturbation controls discourage unsupported claims. On held-out updates, the joint Reader reaches judge-based Pass@100 of 2% for knowledge and 16% for behavior. These results demonstrate the feasibility of natural-language readout while pointing to reliability across updates as the next step. Beyond free-form generation, the Reader provides a differentiable proxy for the gap between a specified target behavior and a candidate weight update. Its coordinate-aligned gradients support intervention through MetaEdit. At a 0.5% pruning rate, Reader-guided selection raises measured harmful-prompt refusal from 57.9% to 64.1% under a safety-maintenance target. Using behavior descriptions without target-task training data, MetaEdit increases the frequency of backtracking and sub-goal expressions in mathematical reasoning traces and raises BFCL Overall from 41.69% to 44.60%.