AI主动帮忙前,先学会不招人烦
AI 主动帮忙这件事,一直有个尴尬:它干对了活,却可能看错你的处境、打断你的节奏,反而让你更不信任它。这篇论文把「主动」拆成三个必须同时满足的条件——活干得对、时机算得准、信任守得住,并用一个模拟环境测了 23 种模型配置,发现差距巨大,而且 AI 自己的评判官经常把「活干得好」和「值得信任」混为一谈。30 人的真人实验更直接:哪怕结果正确,只要干预时机不对,信任就断崖式下跌;而睡眠时间收到不完美的帮助,大家反而愿意接受,因为不打断专注。它不是你明天能用上的功能,但它划出了一条线:AI 主动性的下一步,不是更会猜,而是更懂什么时候闭嘴。
📄 原文摘要(英文)
Proactive LLM agents can turn idle compute into useful support before users ask. Yet even correct work can misread user context, impose review costs, or undermine trust. This work proposes foundations for designing, realizing, and evaluating proactive LLM agents around three joint principles (3T): Task Capability, anticipating relevant needs and correctly performing useful work; Temporal Allocation, allocating compute according to resource availability and when results are needed; and Trust, sustaining users' confidence and appropriate reliance on the agent. We connect these objectives to a design space organized around five dimensions: task scope, anticipation horizon, activation trigger, processing timing, and intervention depth, and specify the situation and system modeling needed to support its choices, including user and environment representations, backbone LLMs, and agent harnesses. Lastly, we propose PROACTIVITY-GYM, a simulation-based evaluation testbed including multi-day scenarios, stateful environments, and persona-conditioned simulated users that can evaluate the consequences of proactive assistance across interactions. Evaluations across 23 model-harness configurations uncover substantial performance gaps across 3T and reveal that LLM judges often conflate task capability and trust. A human study with 30 participants demonstrates the importance of the joint 3T optimization: participants show sharp trust declines after intervention misalignment despite correct outcomes, and prefer sleep-time assistance, even when imperfect, to preserve ongoing focus. Together, these findings support designing and evaluating proactive agents through the joint consideration of useful work, compute allocation, and evolving user trust.