AI Pulse
📄 论文解读

AI 现在会主动建议你下一步怎么改图了

聊天里让 AI 画图,它不再只等你下一条指令,而是会主动给你几个「下一步改哪」的选项。这套系统从真实用户的上百万次对话里学,发现八成以上的后续修改都跟当前图片有关,于是把「该改什么」拆成意图、偏好、画面一致性三层来训练,最终让建议的视觉违和率从 3.7% 降到 0.9%,点选率涨了三成。它不是你明天就能用上的功能,但说明 AI 助手正在从「听令执行」走向「替你多想一步」。

📄 原文摘要(英文)

Conversational assistants increasingly recommend follow-up edits to help users continue a task. Existing systems primarily target text-only interactions, leaving image-creation conversations underexplored. In image-creation tasks, useful follow-up edit suggestions must reflect user preferences, offer diverse directions, and remain executable on the current image. We collected 100,000 real multi-turn image-creation conversation samples from Qwen App and found that 80.1% are image-dependent, underscoring the need for multimodal recommendation. We address this setting with a three-stage framework. In Stage 1, we use real online data to build a human-reviewed table of appropriate follow-up editing intents, then create SFT targets and fine-tune a multimodal policy. In Stage 2, to align rule-guided SFT suggestions with actual user choices, we use user click feedback to optimize the policy through multi-objective reinforcement learning. In Stage 3, to reduce visual inconsistencies between suggested edits and the current image, we introduce a visual verifier as additional training supervision. Extensive experiments demonstrate that our framework significantly outperforms baselines on both automatic and human evaluations. In a live user-randomized A/B test with millions of users, our final framework reduces visual inconsistency from 3.7% to 0.9%. Furthermore, it significantly improves recommendation CTR by 32.70%, image take-away rate by 16.32%, and average conversation turns per user by 39.90% (all p<0.05).

arXiv 原文

订阅 AI Pulse

每天 08:00 · 12:30 · 18:30 · 23:50 更新