AI Pulse
📄 论文解读

AI机器人看着未来走对,但手脚却不听使唤

机器人领域的新范式「世界-动作模型」号称更安全:它一边想象未来画面,一边决定动作。但研究者发现,只要在输入图像上施加微小扰动,就能让模型「想象的世界正常,但实际动作跑偏」——比如它看到前方有障碍,想象中绕开了,但实际却撞上去。攻击分两种:一种直接让动作失败(成功率从96.5%暴跌至43.1%),另一种更隐蔽,保持未来画面看起来合理,但动作已错。这不是你明天能用上的技术,但它提醒:AI的「一致性」比看起来脆弱。

📄 原文摘要(英文)

World-action models (WAMs) are emerging as a promising foundation for embodied control: rather than predicting actions alone, they learn representations that couple action generation with future world prediction. This coupling is often viewed as a source of robustness, interpretability, and safety, as a robot's action can in principle be checked against its imagined future. In this paper, we show that this assumption is fragile. We introduce BadWAM, a unified framework for modeling and evaluating World-Action Drift Attacks: a new class of WAM-specific adversarial attacks that use small visual perturbations to break the alignment between what a WAM imagines and what it executes. BadWAM characterizes this attack surface along two natural criteria: attack strength and stealthiness. When the adversary prioritizes disruption, BadWAM instantiates an action-only adversarial attack, which directly drives the model toward task-failing actions. When the adversary additionally prioritizes stealth, BadWAM instantiates an imagination-preserving adversarial attack, which seeks to induce harmful action shifts while keeping the model's predicted future close to its clean imagination. Together, these two attacks capture a spectrum of WAM-specific failures: from overt action hijacking to stealthier cases where the model appears to imagine a plausible future but executes a desynchronized action. We evaluate BadWAM across different variants of WAMs. Results show that our attacks substantially reduce task success rates under closed-loop execution. For example, our action-only attack reduces the model performance from 96.5% to 43.1% success. The results of our imagination-preserving attack further exposes a WAM-specific vulnerability: moderate future-preserving regularization can maintain strong attack performance while reducing future imagination drift.

arXiv 原文

📬 订阅 AI Pulse

每天三次更新,不错过重要信号

▲ 回到顶部