AI Pulse
📄 论文解读

AI学会了“世界模型”:不只看下一帧,而是理解世界状态

大多数AI模型只做一件事:预测下一个词、下一帧画面或下一个动作。Orca打破了这种割裂——它试图学习一个统一的“世界潜在空间”,把视频、语言、动作信号都映射进去,然后通过轻量解码器输出文本、图像或机器人指令。训练方式也反直觉:一边用125K小时连续视频做“无意识学习”(捕捉密集状态变化),一边用1.6亿条事件标注做“有意识学习”(理解稀疏但关键的事件)。结果证明,世界模型越强,下游任务表现越好,甚至超过专门训练的模型。这不是你明天能用的工具,但它指向一个方向:AI不再只是模式匹配,而是开始像人一样,在脑中构建一个可预测、可操作的世界模型。

📄 原文摘要(英文)

We introduce Orca, an initial instantiation of a general world foundation model. Orca learns a unified world latent space from multimodal world signals and exposes it through multimodal readout interfaces. Rather than optimizing isolated next-token, next-frame, or next-action prediction, we are centered on Next-State-Prediction modeling, offering a unified state-transition modeling route toward understanding, predicting, and acting upon the world. Orca learns through two complementary paradigms: unconscious learning captures dense natural state transitions from continuous videos, and conscious learning models sparse meaningful state transitions by language-described events and VQA supervision. For pre-training, we construct a large-scale world-learning inventory data, including 125K hours of video data and 160M event annotations. After pre-training, Orca learns a unified world latent space. To examine whether the learned latent supports downstream, we evaluate it by three representative downstream readouts: text generation, image prediction, and embodied action generation. Orca's backbone is frozen, and only the lightweight modality-specific decoders are trainable. Experiments show the scalability of the proposed paradigm and verify that stronger world latent enables stronger downstream readouts. Orca outperforms similar-sized specialized baselines. These results show that Orca, as a general world foundation model, presents a promising approach to understanding, predicting, and acting upon the world. Finally, we discuss the current limitations, aiming to provide useful insights and inspiration for the community.

arXiv 原文

订阅 AI Pulse

每天 08:00 · 12:30 · 18:30 · 23:50 更新