给AI一支画笔,你终于能说先画哪
现在的AI画过程视频,要么只能按固定轮廓走,要么只能整体快进,你没法说“先画眼睛再画嘴”。这篇给AI加了一张“变化地图”:把作画过程拆成1000个时间点,每个点记录画面哪里在变、变多少,用颜色编码成一张图。你改这张图,就能精确指挥AI先画哪、后画哪、哪里反复涂改,正向画和反向擦除都适用。它不是你明天就能用的工具,但这是“AI作画过程可控”从黑盒走向可指挥的第一步。
📄 原文摘要(英文)
Digital art generation has undergone a massive paradigm shift, moving from static image synthesis to dynamic video generation that can mimic the human painting process. While existing models can synthesize visually stunning time-lapses of paintings being created or "unpainted," they largely treat the creative process as a black box. Current conditioning mechanisms are either too rigid, relying on static geometric cues like Canny edges or depth maps, or too holistic, utilizing simple scalar progress variables that offer no localized control. Consequently, users lack the agency to steer how a painting evolves over time. In this work, we argue that true control over the video generation of artwork requires a joint understanding of two fundamental dimensions: where an artist acts, and when those actions take place. To achieve this, we introduce the Painting Change Map, a novel spatio-temporal control mechanism that explicitly tracks normalized structural changes across a 1,000-timestep continuum, a resolution sufficient to capture fine-grained stroke-level changes while remaining computationally tractable. By mapping localized visual differences into an encoded RGB space, our representation enables fine-grained guidance for both the forward painting and reverse unpainting processes. Extensive benchmarking demonstrates the efficacy of our approach. We outperform existing control baselines and achieve competitive or superior results compared to state-of-the-art painting methods. Furthermore, under oracle conditions, our method surpasses all baselines by a significant margin. Code is available at https://github.com/Markus-Pobitzer/painting-change-map.