AI造世界:你打字,它生成可探索的虚拟空间
你想象过像打字一样生成一个可以走进去、持续演变的虚拟世界吗?AlayaWorld做到了:输入文字或图片,它就能实时生成24帧/秒、540p/720p的视频世界,你可以用摄像头轨迹操控视角,随时切换文字指令改变场景。它不像传统游戏开发那样需要建模、动画、编程,而是靠一个150亿参数的视频扩散模型,像写小说一样逐段生成,但通过“持久帧+压缩历史+空间记忆”等技巧保持画面连贯不崩。更厉害的是,它把原本30步的推理压缩到4步,响应够快。目前它在长时生成基准上表现最佳。这不是你明天能用的产品,但它是通往“一句话生成可玩世界”的关键一步。
📄 原文摘要(英文)
Unlike conventional video game development, which relies on labor-intensive pipelines for asset production, animation, physics, and programming, video world models generate interactive environments from user inputs instantly. It enable us to create customized, explorable, and continuously evolving virtual world from text, an image, or video. Realizing this vision requires four tightly coupled capabilities: interaction, persistent spatiotemporal consistency, stable long-horizon generation, and efficient response. We present AlayaWorld, an interactive long-horizon video world model that generates 24-fps video at 540p and 720p. Built on a 15B video diffusion transformer, AlayaWorld generates short latent chunks autoregressively under camera trajectories and switchable text prompts. Its bounded visual context combines a persistent sink frame, compressed temporal history, geometry-aligned spatial memory, and recent-frame conditioning. To reduce long-term drift, the model is trained with corrupted histories and prediction residuals collected from its own roll-outs. We further introduce a discrete autoregressive distillation formulation that combines distribution-matching distillation, self-forcing++, and consistency distillation, reducing inference from approximately 30 sampling steps to four steps per chunk. On iWorld-Bench, AlayaWorld achieves the best performance over long-horizon generation. Conceived as a full-stack, open-source, and long-term project, AlayaWorld is intended to provide an extensible foundation for future research on interactive video world models.