AI Pulse
📄 论文解读

视频生成提速新思路:把缓存当接力棒

生成20秒以上的AI视频,现在要一帧帧算,慢得像在等渲染。这篇论文发现,每算完一段画面,中间产物其实已经能当下一段的“记忆”用,不用再额外重算一遍。它把4个GPU排成流水线,各管一段,同时开工,速度比现有方法快1.4到2.9倍,画质还更稳。代价是记忆有点“脏”,所以它额外存几个干净的“锚点”画面来纠偏。这不是你明天就能用的工具,但它指向一个明确趋势:视频生成的瓶颈正在从“画得清”转向“跑得快”,而省算力的关键,是别浪费每一次计算。

📄 原文摘要(英文)

Few-step autoregressive video diffusion generates a long video by splitting the video into temporal chunks and generating chunk-by-chunk, each through a short sequence of denoising stages. To memorize chunks that are already generated, previous methods reconstruct a clean or less-noisy key--value (KV) cache by additional forwards to build the cache without advancing an output latent. However, every denoising forward itself already computes the in-flight KV of the current chunk. We introduce FlashForward, which directly reuses this cache to avoid the heavy cache-update-only model forwards. After the current chunk completes one denoising stage, its stage-specific cache is already available for the next chunk. Assigning one GPU to each stage therefore lets different chunks occupy different stages concurrently. This early availability has a quality cost: the resulting stage-matched history is noisy, causing appearance and motion drift among chunks. To complement it, FlashForward produces sparse auxiliary clean anchor latents before the corresponding region is generated so the generation trajectories can be stabilized by this two-sided conditioning. The two memories operate at different temporal scales: sparse clean anchor KV supplies coarse, long-range two-sided structural guidance, while dense stage-matched history preserves fine, recent evolution. With up to four GPUs, FlashForward runs 1.16--1.69times faster than HiAR and 1.42--2.92times faster than Self-Forcing for 16 FPS videos of 20 seconds or longer across 1.3B and 14B backbone scales at 480p and 720p. On VBench, for the 1.3B model at 480p, it achieves higher scores and remains stable at longer durations, demonstrating that FlashForward generates high-quality and temporally consistent videos across durations of 20s, 35s and 65s at a much faster generation speed.

arXiv 原文

订阅 AI Pulse

每天 08:00 · 12:30 · 18:30 · 23:50 更新