AI 不再只会说对错,开始给过程打分
过去让 AI 检查一张图是否符合要求,它只会回你「对」或「错」,像批卷老师只给红叉。这篇换了个思路:把复杂要求自动拆成一条条小规则,逐条打分,比如「图里有没有猫」「猫是不是在沙发上」「光线对不对」,最后汇总成细颗粒的分数。这个做法让 AI 在没见过的任务上也更会挑毛病。研究者还发现,当手头有标准答案图时,让 AI 两两对比着评,比单独打分更准。它不是你明天就能用的功能,但「从只会说对错到会指出哪里差几分」,是 AI 从玩具走向能当裁判的关键一步。
📄 原文摘要(英文)
Generative visual verifiers play a crucial role in advancing multimodal intelligence. To enhance the robustness of visual verifiers in complex multimodal scenarios involving compositional requirements, we move beyond conventional binary verifiers that produce only True/False discrete judgments and introduce a verifier that automatically decomposes complex prompts or environmental rules into fine-grained components and assigns pointwise scores to provide a continuous and more informative critique signal. Our experiments further demonstrate that these structured and interpretable outputs improve the verifier's generalization to out-of-domain multimodal critic tasks. To train this verifier, we introduce a Decoupled RL training strategy that jointly optimizes sub-question-level binary judgment and global alignment scoring, using precise local feedback to develop fine-grained verification capabilities that provide a foundation for reliable continuous scoring at the global level. Under a general reinforcement learning framework, we first empirically demonstrate that the proposed pointwise graded verifier significantly outperforms binary verifiers in traditional text-to-image scenarios. We then extend our investigation to rule-governed generative world modeling where generative models are leveraged for world simulation and world reasoning under explicit rules. From a theoretical standpoint, we further show that a pairwise verification paradigm yields more accurate critiques than the pointwise formulation when ground-truth images are available, with empirical results on diverse structured world-modeling tasks such as Maze and Sudoku further validating the effectiveness of our approach. Overall, our findings suggest a key insight: the transition from generative models to structured world-modeling agents critically hinges on the availability of accurate pairwise graded visual verifiers.