AI Pulse
📄 论文解读

让AI世界按你定的规则运转

游戏里的规则是人为定的:火能烧、水能导电、某个道具能开门。这篇让生成式世界模型也照你定的规则走,而不是只按现实物理。难点有两个:一是规则和世界状态要能存档读档后还在,读回来世界仍按老规矩运转;二是规则生效的视觉后果要落在对的物体上,哪怕那个物体当时还没出现在画面里。做法是把规则定义、依赖关系和物体状态编成一张可执行的 3D 规则图,让规则执行、视频生成、感知反馈闭环联动;物体动态绑定把规则点名的实体锚到具体画面上,并用存下的状态从它第一次出现就约束生成。他们还做了属性状态替换和反事实重建训练,让被规则改动的物体长相和动作对得上、又不干扰无关内容,并用 GTA-V 和 Habitat 搭了自动采集标注管线,造出 RuleVerse 数据集,专门覆盖「规则先生效、受影响物体后出现」的情况。实验显示存档读档后规则与状态保持一致,规则后果也准确落在指定物体和属性上。做游戏、做可交互世界模拟的人,这是能直接改工作方式的东西;普通读者可以把它当成「AI 世界开始有自定义规则」的信号。

📄 原文摘要(英文)

Rules govern how player actions change interactive worlds. Different rules create distinct gameplay experiences within similar scenes and action spaces. For customizable gameplay, generative world models must follow user-defined rules beyond real-world behaviors. However, realizing user-defined rules presents two challenges: Rule-State Persistence and Rule-to-Visual Realization. The former requires preserving rule definitions, dependencies, and world states across saving and loading, so that restored worlds follow the established rules. The latter requires accurately realizing rule-induced changes on designated objects and attributes, particularly when affected objects are unseen. In this paper, we propose WorldRuler, which organizes rule definitions, dependencies, and object states in an executable 3D rule graph and connects rule execution, video generation, and perceptual feedback in a closed loop. The graph supports joint saving and restoration of rules and world states, while dynamic object binding grounds rule-specified entities in visual instances and uses stored states to constrain generation from their first appearance. We further introduce object attribute state replacement and counterfactual reconstruction training, enabling accurate attribute control and compatible appearance and motion changes while limiting interference with unrelated content. We develop an automated data collection and annotation pipeline using GTA-V and Habitat to construct RuleVerse, a dataset of rule-driven interactions with detailed state and event annotations, including cases where rules take effect before affected objects become visible. Extensive experiments demonstrate the effectiveness of WorldRuler in preserving rule-state consistency across saving and loading and accurately realizing rule outcomes on designated objects and attributes.

arXiv 原文

订阅 AI Pulse

每天 08:00 · 12:30 · 18:30 · 23:50 更新