AI渲染引擎提速56倍，实时生成可交互游戏世界
你玩过的游戏画面都是显卡算出来的，但AI现在能直接“想象”出每一帧。这篇论文把原本每秒只能生成半帧的AI渲染器提速到31帧，达到可玩水平。它不靠文字或图片提示，而是直接读取物理引擎输出的场景结构（物体位置、材质等），然后像人脑一样“脑补”出完整画面。关键是它保留了用户控制能力——你可以修改场景结构，AI会实时生成对应的新画面。虽然目前还只是技术演示，但意味着未来游戏可能不再需要传统图形渲染管线，AI直接根据游戏逻辑生成视觉，甚至能实现“你改物理规则，画面自动适配”的玩法。
📄 原文摘要(英文)
Generative world renderer AlayaRenderer receives structured world states exported from physics engines and synthesizes RGB frames. Unlike models that generate frames from text/control-hints prompts, AlayaRenderer preserves scene structure without altering the underlying world dynamics. This demonstrates an alternative path toward interactive world modeling and user-controllable play. However, the original AlayaRenderer is too computationally expensive for real-time deployment. This technical report introduces AlayaRenderer-Flash, a real-time-oriented generative forward world renderer that pushes AlayaRenderer from 0.56 FPS to 31.54 FPS, reaching the speed of play. AlayaRenderer-Flash reformulates the original renderer as a few-step autoregressive streaming model and introduces lightweight distilled codecs for efficient latent encoding and frame reconstruction. It retains the teacher model's G-buffer and text-prompt interfaces while enabling continuous rendering over input streams of unbounded length. We evaluate AlayaRenderer-Flash on G-buffer streams across content preservation, temporal consistency, cross-window stability, prompt controllability, and runtime efficiency. Our results show that AlayaRenderer-Flash substantially reduces inference cost while preserving the core rendering capabilities of the teacher model. By integrating AlayaRenderer-Flash with a physics engine, we build a fully playable generative world running at 30 FPS.