AI 助手看着你干活，但真能帮上忙吗
我们总以为 AI 助手「看着你干活」就能指导你；这篇用可验证的模拟环境测了一下，发现它远没到能用的程度。研究者搭了个「助手指挥、真人执行」的闭环场景：AI 看画面、下指令，真人照着做，环境再反馈新画面，120 个多轮任务覆盖找东西、做饭、规划等六类。12 个最强模型里，表现最好的 Claude Fable 5.1 在长程指导和规划任务上成功率也只有 20% 和 25%。它不是你明天能用上的东西，但给「AI 到底能不能在真实世界帮人」这个悬而未决的问题，立了第一把尺子。
📄 原文摘要(英文)
People have long dreamed of an assistant that is always there to guide them and remind what they forget, from new dishes to lost keys. Powered by multimodal large language models (MLLMs), egocentric AI assistants on wearable devices are bringing this dream within reach: they see what the user sees and give instructions for user's physical work when necessary. However, testing such assistance is challenging and usually requires real people. The expensive and rare real interaction data leaves a key question unanswered: Can today's MLLMs truly help people in physical world? To answer this question, we propose InteractiveWorld, the first verifiable environment for closed-loop interaction between human and AI assistant. Unlike existing robot-centric simulators, InteractiveWorld lets the assistant guide a human agent who observes the scene, understands instructions, and acts independently. It thus realistically simulates how AI assistant collaborates with human: the assistant instructs, the human acts, and the environment executes actions and updates what they see next. Building on it, we introduce InteractiveBench, the first dynamic benchmark for egocentric AI assistants, with 120 multi-turn tasks across six categories. In each task, the assistant guides the human in real time, and every instruction shapes the outcome, which is scored by verifiable, state-based rewards. Experiments with 12 frontier MLLMs show they are still far from reliable assistants. Even the strongest model, Claude Fable 5.1, achieves at most 20% and 25% on long-horizon Guidance and Planning tasks, respectively. Overall, our work offers a verifiable platform and a rigorous evaluation set, laying a solid foundation for research on interactive MLLM assistants that truly help people in the physical world.