AI 看视频时太急着下结论，现在学会先憋住
现在的多模态 AI 一边看视频一边听声音，常常在画面刚出现、话还没说完时就抢先下了结论，而且这个结论一旦进了记忆，后面就算声音明确反驳，它也会继续嘴硬。研究者把这种毛病叫「过早跨模态承诺」，并给出一套新机制：让 AI 把「我看到了什么」「我猜接下来会听到什么」「我据此下的判断」分开写出来，每个判断先标为「待验证」，等音频证据到齐后再回头核对，发现矛盾就降低这条判断的权重、重新更新状态。在 5 个基准上，这套方法比最强开源模型平均提升超 10%，还专门做了一个「画面不变、只改音频」的测试集，AI 分辨矛盾与一致的能力从 d-prime 1.38 涨到 2.95，顺带减少了「被画面带偏的幻听」。它不是你明天能用上的东西，但它指向一个关键方向：AI 的「自信」不该来自抢先，而该来自敢等。
📄 原文摘要(英文)
Streaming omni-modal models must decide what and when to answer from the video chunks and synchronized audio observed so far. Visual cues often support an interpretation before an utterance or sound event is complete. If that interpretation enters memory as a fact, later reasoning can keep relaying it even after audio contradicts it. We call this failure premature cross-modal commitment. We propose Omni-Streaming Thinking (OST), which generates structured outputs that include evidence observed so far, forecasts of future evidence, and claims based on this evidence. Each claim is initially marked as pending and linked to a future verification interval. Audio and visual evidence are stored separately, and OST checks a claim against the evidence from the specified modality at the end of the verification interval. When contradictory evidence is detected, a refutation process reduces the influence of the claim and its dependent states, and then guides a state update using the new evidence. An answer gate decides whether the answer-critical claims meet the conditions for giving a response. Using a frozen Qwen3-Omni-30B-A3B-Instruct backbone with lightweight adaptation, OST outperforms the strongest open baselines on five streaming and audio-visual benchmarks by more than 10% relative on average. We also introduce OST-DiagBench, which holds video fixed and edits audio to test agreement, absence, contradiction, coexistence, and subtitle-speech conflict. OST reaches d-prime = 2.95, compared with at most 1.38 for open baselines, while reducing vision-induced auditory hallucinations.