AI看视频的考试，从答题改成动手重建
现在的AI视频理解考试，基本是给模型看一段视频然后问问题——这就像用选择题考人有没有看懂电影，蒙也能蒙对几分。这篇论文换了个考法：让AI用Blender(一个3D建模软件)把真实视频重新做出来，像动画片那样一帧帧重建。考得怎么样？最强模型重建出来的画面和原视频在观感上已经很接近(相似度88.6%)，但问它视频里到底发生了什么、物体怎么动、先后顺序如何，它只答对了53.7%。也就是说，AI能画出个像样的画面，却没真正看懂内容。更值得注意的是，研究者让15个人盲评，发现人眼觉得好的重建，恰恰是画面相似度高的那些——这意味着我们很容易被AI的“表面功夫”骗过，以为它懂了，其实它只是学会了模仿。这不是你明天能用上的工具，但它提醒我们：当AI越来越会“装懂”，考试方式也得跟着变。
📄 原文摘要(英文)
Multimodal agents can create complex videos in software such as Blender by coding without relying on diffusion models. Yet video understanding benchmarks still evaluate models mainly through question answering. If an agent truly understands a video, it can reconstruct it programmatically. We introduce BVB, Blender-VideoBench, a benchmark that tests this ability by asking agents to reconstruct real-world videos as animated Blender scenes. To ensure fair comparison, each agent programs the reconstruction through a lightweight harness, Mini-BVB, in an identical sandbox under a shared cost limit. The benchmark renders each reconstruction from its animated camera and evaluates it on two axes: (1) Dual VQA measures how many spatiotemporal facts the reconstruction preserves. (2) Latent Similarity measures how closely the reconstruction matches the source video perceptually. Our overall score, a square-root mean, favors balanced performance. We evaluate 51 configurations from 10 model families and analyze semantic retention, perceptual similarity, reasoning effort, and cost. The best model reaches 88.6 Latent Similarity but retains only 53.7% of the source-correct spatiotemporal answers. Additional reasoning improves visual similarity but does not close this gap in factual accuracy. In a blind study with 15 raters and five configurations, Latent Similarity correlates strongly with human preference. These results show that programmatic reconstruction is a viable test of agentic video understanding, and that semantic retention remains the main challenge.