AI Pulse
📄 论文解读

AI 世界模型终于能记住你,不再聊两句就失忆

现在的 AI 视频生成,你让它生成一段世界,它就像金鱼——聊到第 10 秒就忘了前面发生什么,因为它的记忆全塞在生成器里,越长越贵。这篇把记忆搬到了体外:一个按镜头索引的「世界状态库」,每次只取当前视角需要的那一小块,所以聊多久都不爆内存。同时它换了个更聪明的老师来教学生,让 3 步就能出图的学生模型也能扛住长时间不跑偏。结果是在一张 H200 显卡上,每生成 1.5 秒画面只要 2.11 秒,而且能无限续写、随时改剧情。这不是你明天能用的产品,但它是「AI 能陪你玩一局完整游戏」的关键一步。

📄 原文摘要(英文)

Interactive world models must support persistent memory, responsive interaction, and long-horizon generation, yet these requirements place conflicting demands on the model. Maintaining history in the denoiser context or key-value cache incurs growing cost, forcing a trade-off between session length and retained memory, while low-latency interaction relies on few-step generation whose capabilities are bounded by its teacher. Evoke addresses both limitations by externalizing persistent world state and redesigning the teacher for long-horizon interactive generation. Scene geometry is maintained in an external, camera-indexed world state bank, from which only view-relevant information is retrieved, keeping the denoiser context bounded as the session grows. Rather than treating the teacher as a fixed generator, we design it for long-horizon supervision: its sparse attention combines chunk-wise grouping, retrieval of selected distant frames, and a linear-attention global state, yielding linear growth in memory and compute while enabling supervision over long horizons. Such supervision exposes content drift that stays locally plausible within short windows, while per-chunk conditioning enables prompt changes and event control throughout the sequence. A 30-second distribution-matching objective, applied under self-forced rollouts, transfers both capabilities to a three-step student that uses no classifier-free guidance, improving resistance to long-term drift while preserving responsive conditioning. With bounded context and recurrent external memory, Evoke supports open-ended, continuously evolving generation; on a single H200 at 384times 640, each 1.5,s chunk is generated in 2.11,s. As a three-step world model, Evoke achieves state-of-the-art performance on WBench while remaining competitive on VBench-Long and VBench-2.0.

arXiv 原文

订阅 AI Pulse

每天 08:00 · 12:30 · 18:30 · 23:50 更新