你也能当导演:让AI生成视频像玩游戏一样自由
现在的AI视频生成,你只能给个开头,然后看它自由发挥。DreamX-World 1.0让你像玩游戏一样控制镜头:你可以让镜头平移、拉近、甚至回到之前看过的地方,还能在视频中途触发事件(比如让角色挥手)。它怎么做到的?核心是把视频生成拆成两步:先让AI记住场景的3D结构,再根据你的指令一步步生成后续画面。为了不跑偏,它用了一种叫“因果强制”的训练技巧,让AI只看自己之前生成的内容来继续,而不是依赖外部参考。结果就是,你可以在5秒的视频里自由控制镜头,而且画面风格不会漂移。虽然目前需要8张顶级显卡才能实时运行,但这项技术让AI视频从“单向播放”变成了“可交互世界”。它不是你明天就能用的工具,但指明了方向:未来的AI视频,你说了算。
📄 原文摘要(英文)
DreamX-World 1.0 is a general-purpose interactive text/image-to-video world model for controllable long-horizon generation. It supports camera navigation, revisits to previously observed regions, and promptable events across photorealistic, game-style, and stylized domains. Our data engine combines camera-accurate Unreal Engine rendering, action-rich gameplay recordings, and real-world videos with recovered camera geometry. For camera control, we introduce E-PRoPE, a lightweight variant of projective positional encoding that retains PRoPE's projective camera geometry while applying camera-aware attention to spatially reduced tokens. We convert a bidirectional video generator into a few-step autoregressive world model using causal forcing, DMD-style distillation, and long-rollout training. Training on self-generated long-horizon contexts exposes the model to its own generated history and reduces the style and color drift that accumulates across autoregressive chunks. Memory-Conditioned Scene Persistence retrieves earlier views through camera-geometry-based retrieval, while residual recycling makes the conditioning path less sensitive to imperfect memory latents. Event Instruction Tuning adds composable event control, and reinforcement learning alignment recovers camera control and visual quality after distillation. With mixed-precision DiT execution, residual reuse, 75\%-pruned VAE decoding, and asynchronous pipeline parallelism, DreamX-World 1.0 reaches up to 16\,FPS on eight RTX\,5090 GPUs. On our 5-second basic evaluation, DreamX-World 1.0 achieves a camera-control score of 73.75 and an overall score of 84.76, outperforming HY-WorldPlay 1.5 and LingBot-World in overall score, which achieve 80.79 and 80.45, respectively.