AI终于能边想边画了：统一决策让图文推理不再割裂
现在的多模态AI（比如能同时理解文字和图片的模型）在生成图文混合内容时，往往文字和图片是分开训练的——文字部分用强化学习优化，图片部分却用监督学习，导致模型无法在整体推理中协调两者。这篇论文提出了一个叫BRAID的框架，它把多轮图文生成统一成一个完整的决策过程：模型每生成一段文字或一张图片，都当作一个决策步骤，用同一个强化学习目标来优化。关键创新是，它用一个视觉语言模型作为裁判，对每一步生成的图片打分（比如这张图对后续推理有没有用），从而让模型学会在正确的时候画图、画正确的图。实验表明，在空间推理和视觉感知任务上，BRAID显著优于现有方法。它不是你明天就能用的工具，但它指向了一个方向：未来的AI可能不再割裂地处理文字和图像，而是像人一样边想边画、边画边想。
📄 原文摘要(英文)
Unified multi-modal models (UMMs) have shown promising interleaved text-image reasoning capabilities, yet effectively optimizing such multi-turn generation via reinforcement learning (RL) remains an open challenge. Existing approaches apply RL exclusively to text steps, relegating image generation to supervised surrogates, preventing policy gradients from propagating through the full interleaved trajectory across heterogeneous modalities. This leaves the potential of RL for UMMs largely untapped. In the paper, we introduce BRAID (Bridging inteRleAved multI-modal reasoning as a unified Decision process), a simple framework that casts multi-turn text-image-text reasoning as a unified Markov decision process (MDP), enabling joint optimization of textual and visual generation via a single, principled RL objective. BRAID computes a shared trajectory-level advantage and propagates it coherently into both text tokens and image denoising paths, each optimized through its modality-native policy gradient mechanism. To further address long-horizon credit assignment, BRAID employs a vision-language model (VLM) judge that scores each intermediate image on its reasoning utility, supplying dense turn-level feedback to sharpen learning at critical visual branches. Experiments on spatial reasoning and visual perception benchmarks show that BRAID consistently outperforms various baselines, confirming that a unified MDP formulation with vision-thinking guidance is essential for effective multi-modal reasoning.