AI看病不再一步错步步错
AI在医学影像问答中常犯一个致命错误：第一步推理错了，后面全跟着错，最终答案也错。研究者发现，64%的错误都源于这种“级联失败”。他们提出一个新训练方法MRPO，核心是：当AI答错时，不是简单惩罚最终答案，而是重点惩罚最早出错的那几步推理——越早的错罚得越重，从而切断错误链条。在三个模型上测试，早期推理失败率从64%降到13%，最终准确率也超过更大模型。这不是你明天能用上的工具，但它揭示了一个关键趋势：AI推理的质量，比答案本身更值得优化。
📄 原文摘要(英文)
Recent multimodal large language models have shown great promise in clinical image reasoning, but existing post-training pipelines remain predominantly outcome-centric, relying on final answer correctness or sequence-level preferences. This suffers from sparse credit assignment, making it difficult to optimize the reasoning process essential for clinical applications. Our analysis reveals that cascading errors from early-stage reasoning failures are a leading cause of incorrect predictions in medical visual question answering (VQA) benchmarks. Motivated by this, we propose Medical Reasoning-aware Policy Optimization (MRPO), an RL algorithm that incorporates step-wise process rewards. When the final answer is incorrect, MRPO assigns exponentially larger penalties to tokens in earlier invalid reasoning steps, breaking failure cascades without compromising successful paths. Across three multimodal LLM backbones, MRPO consistently outperforms standard GRPO and a recent RL baseline, and on Qwen3-VL-8B-Instruct even surpasses substantially larger medical MLLMs such as HuatuoGPT-Vision-34B by 2.79 points. Moreover, MRPO reduces early-stage reasoning failures from 64.0% to 13.0%, showing that targeted mitigation of cascading failures improves both reasoning quality and final answer accuracy. Our code is available at https://github.com/dmis-lab/MRPO