AI视频看着流畅,但物理上全是错的
现在的AI生成视频,画面流畅不代表物理正确:杯子掉下去可能穿桌,人走路可能飘。过去我们只有一个「质量分」,告诉你这段视频好不好,却说不清哪里错、为什么错。VeriPhy换了个思路:先让一个纯文本的规划器把提示词翻译成「物理义务清单」——比如「杯子应该落在桌上」——再派一组冻结的专家工具(分割、追踪、计数、测距、深度、OCR、音频)去逐条核对,每条结论都带着证据链,最后给出「合理/不合理/无法判断」三态判定。在149条带人工标注缺陷的视频上,它找出了228处问题,比现有方法多出近四成。它不是你明天能用上的产品,但它是把AI视频从「看着像」推向「经得起查」的关键一步:每个判定都能追溯到具体证据,这意味着未来可以用它反过来指导生成——哪里错了,就改哪里。
📄 原文摘要(英文)
Visual fluency in generated video does not imply physical reliability, and a scalar quality score alone is incapable of indicating the obligation a clip violates or the moment it fails. We present VeriPhy, an auditable physical-verification system in which a text-only planner compiles the prompt into typed physical obligations and a statically validated execution plan before any frame is observed. During execution, observations gate and scope only declared calls to frozen low-level experts (e.g., segmentation and tracking, counting, eleven typed physical measurements over the resulting tracks, depth, OCR, and audio-event detection). Each action returns a provenance-carrying evidence record whose payload, when usable, is either a typed measurement or an explicitly tagged learned state. Typed resolvers and fixed composition map usable records to a three-valued state (supported, contradicted, or unknown, surfaced as plausible, implausible, or abstain) with full provenance, so that every verdict is traceable to the evidence that produced it. We anchor evaluation in a 1,500-clip corpus of human-annotated flaw records that localize real generation failures in prompt reference, space, and time. On a 149-clip core carrying 304 such records, VeriPhy accounts for 228, against 164 for a published question-decomposition evaluator given the same clips and the same claims. Recall alone does not separate it from prompting the same backbone monolithically, which reaches 222; what separates them is that each decision retains its evidence record and provenance, making the traces auditable one verdict at a time and usable as the interface through which a critic verdict could be written back into generation.