AI Pulse
📄 论文解读

AI渲染引擎跑出30帧,游戏世界可以实时生成了

游戏画面通常由显卡渲染,但有一类AI模型试图直接“生成”每一帧画面,代价是慢到没法玩。这篇把生成速度从0.56帧拉到31.54帧,达到可玩水平。做法是把原来的大模型拆成几步自回归的流式模型,再用轻量编解码器压缩中间数据,同时保留了场景结构和文字控制接口。最终接上物理引擎,跑出一个30帧的、可交互的生成世界。它不是你明天能玩到的游戏,但指向一条路:未来游戏画面可能不再靠显卡算,而是靠AI实时生成。

📄 原文摘要(英文)

Generative world renderer AlayaRenderer receives structured world states exported from physics engines and synthesizes RGB frames. Unlike models that generate frames from text/control-hints prompts, AlayaRenderer preserves scene structure without altering the underlying world dynamics. This demonstrates an alternative path toward interactive world modeling and user-controllable play. However, the original AlayaRenderer is too computationally expensive for real-time deployment. This technical report introduces AlayaRenderer-Flash, a real-time-oriented generative forward world renderer that pushes AlayaRenderer from 0.56 FPS to 31.54 FPS, reaching the speed of play. AlayaRenderer-Flash reformulates the original renderer as a few-step autoregressive streaming model and introduces lightweight distilled codecs for efficient latent encoding and frame reconstruction. It retains the teacher model's G-buffer and text-prompt interfaces while enabling continuous rendering over input streams of unbounded length. We evaluate AlayaRenderer-Flash on G-buffer streams across content preservation, temporal consistency, cross-window stability, prompt controllability, and runtime efficiency. Our results show that AlayaRenderer-Flash substantially reduces inference cost while preserving the core rendering capabilities of the teacher model. By integrating AlayaRenderer-Flash with a physics engine, we build a fully playable generative world running at 30 FPS.

arXiv 原文

订阅 AI Pulse

每天 08:00 · 12:30 · 18:30 · 23:50 更新