AI 开始自己操作你的手机和电脑了
我们总把 AI 当聊天框里的助手；这篇把它放进了真实设备里，让它像人一样点屏幕、敲命令、跨应用干活。Qwen-UI-Agent 不只是看网页截图，它真的跑在手机和电脑上，能同时操作 GUI 和命令行，一次生成一串动作，还能在超过 100 步的长任务里自己纠错、自己规划。在手机操作测试里，它拿到了 82% 到 97% 的完成率，电脑和浏览器任务上也追平甚至超过了 GPT-5.6 这类顶级模型。它不是你明天就能用的产品，但这是 AI 从「会说话」走向「会动手」的一个真实拐点。
📄 原文摘要(英文)
GUI agents have the potential to become a general purpose executor over existing digital devices. To advance them toward real-world use, we envision agents that operate reliably on real devices, execute workflows across platforms, combine GUI interaction with CLI execution, complete long-horizon tasks, proactively initiate useful services, and autonomously improve their capabilities with minimal human effort. Guided by this vision, we present Qwen-UI-Agent, a real-world centric foundation GUI agent spanning mobile, computer-use, web, and DeepSearch environments. Qwen-UI-Agent combines diverse sandbox environments with a large-scale real-device mobile runtime. Its unified action space interleaves GUI operations with CLI execution and generates batched actions in a single model turn. An AutoResearch-style data flywheel uses agents to construct tasks and environments, diagnose failures, and plan subsequent iterations. Online RL supports training on trajectories exceeding 100 turns, with over 10,000 concurrent environments accelerating rollout. A lightweight harness layer supports proactive service initiation and stateful workflows across mobile and computer. Across a broad suite of evaluations, Qwen-UI-Agent sets state-of-the-art performance on mobile-use benchmarks while delivering competitive performance on computer- and browser-use tasks against frontier models, including Opus 4.8, Gemini 3.1 Pro, and GPT-5.6 Sol. On mobile use, it achieves 82.1% on MobileWorld, 92.2% on MobileWorld-Real, and 97.5% on AndroidDaily. On computer use, it achieves 79.5% on OSWorld-Verified and a 40.0% partial-progress score on OSWorld-v2. On browser use and GUI grounding, it achieves 73.6% on WebArena and 81.5% on ScreenSpot-Pro, respectively.