AI Pulse
📄 论文解读

视频AI的“失忆”其实是没执行

我们总以为视频AI记不住刚才的画面,但新研究拆开一看:它压根没做你让它做的那个动作。研究者把“布置场景”和“执行变化”分成两步测,发现模型场景记得好好的,指令却没执行——不是记忆坏了,是手脚没动。他们据此做了个M3-Agent,把指令细节反复修订直到模型真去做,测试分数直接翻三倍。这提醒我们:AI表现差,别急着怪“记性”,先看它有没有真动手。

📄 原文摘要(英文)

A memory test for a video world model should say whether the scene was set, whether the asked change was carried out, and whether the last frame shows the result. Current tests fold these into one number, so a low score is easy to read as forgetting. When the change is not carried out, the hidden state transition cannot appear, so the test is not really a test of memory. We introduce MIST, an evaluation that separates the change from the memory it should leave behind. The model first sets the scene while the change stays hidden, and only later is asked to show it, with leakage before that point kept under control. This separation locates the bottleneck: the model sets the scene but does not carry out the instructed change. The same gap appears in general memory evaluations. On that basis we propose M3-Agent (Make the Missing Move), which recursively revises the details of the input instruction so that the model successfully carries out the requested instruction. Relative to the baseline, it more than triples the MIST reveal score. On the benchmarks, WRBench's score T rises by 26.1% and MBench-T's score U by 52.7%. The method meets the problem from the execution side: it shows what the frozen model can do once the move is stated, and it sets a stricter baseline.

arXiv 原文

订阅 AI Pulse

每天 08:00 · 12:30 · 18:30 · 23:50 更新