AI 拍视频终于知道物体背面长什么样了
现在的 AI 视频生成有个老毛病：你给它几张同一个物体的照片，让它绕着物体拍一段视频，转到背面时它就开始瞎编——因为训练数据里根本没有「同一个物体从各个角度都真实存在」的样本，模型只能靠猜。这篇论文换了个思路：先造数据，再教模型。他们用 3D 资产自动渲染出 4000 段视频，每段都严格保证「转了一圈还是同一个物体」，同时把物体的表面法线图(一种描述表面朝向的几何信息)喂给模型，相当于提前告诉它「背面长这样」。结果在保持物体身份和 3D 一致性上超过了现有方法。它不是你明天能用上的工具，但这是 AI 视频从「会动」走向「真的懂物体」的关键一步。
📄 原文摘要(英文)
Generating videos of a specific subject from a few reference images remains challenging when the camera reveals surfaces that are not visible in the input. Early subject-to-video (S2V) methods condition on a single reference image and must therefore infer the subject's unseen appearance and geometry as the viewpoint changes. To address this limitation, recent methods extend S2V to multiple reference views, providing more information about the subject from different viewpoints. However, they do not explicitly specify the 3D structure that connects these observations. In addition, existing training data do not guarantee that viewpoint changes preserve the same underlying 3D subject. We present OmniShowcase, built on two components: (i) a fully automated data synthesis pipeline that produces training videos along diverse camera trajectories, with viewpoint variation driven by underlying subject geometry, even spanning full 360-degree orbits; and (ii) a geometry-conditioning method that provides the video model with a turntable of surface-normal maps reconstructed from the reference views without requiring temporal alignment with the generated frames. We construct Showcase-4K, a corpus of 3D-asset-based videos covering twelve camera motions across 88 trajectory configurations with reconstruction-derived surface-normal conditioning, and ShowcaseBench, a held-out evaluation set with the source meshes and camera parameters used to render each video. Experiments show state-of-the-art subject identity and 3D consistency while maintaining competitive video quality and motion. Project page: justin4ai.github.io/OmniShowcase