AI Pulse
📄 论文解读

AI助手翻旧账,翻对了才有用

现在的个人AI助手会翻你的操作历史来猜你想干嘛,但研究者发现:它翻到的「相关记录」只在第一步有用,后面90%的操作基本帮不上忙。原因很直白——相关不等于适用:一条历史记录能告诉你从哪开始,却不一定适用于当前这个屏幕。于是他们换了个思路,不再把历史一股脑塞给AI,而是让AI在每一步先判断「此刻这个画面,历史上有没有对应的操作」,有才拿出来用;对于「你是不是又要重复上次的例行操作」,也要看时间和场景够不够像才提醒。结果在四个AI底座上,中途步骤成功率平均提升28%,用的历史记录只有原来的五分之一。这不是你明天就能用上的功能,但它点破了一个被忽视的事实:AI记性好没用,得知道什么时候该翻旧账。

📄 原文摘要(英文)

Personal Graphical User Interface (GUI) agents rely on interaction history to infer what a user wants from ambiguous instructions and to anticipate recurring routines. Existing approaches retrieve task-relevant history and append it to the policy's context, implicitly assuming that experience relevant to a task remains useful for each decision within it. We find that this help is largely spent at the first decision: retrieved history strongly improves the opening step of an episode, yet provides little sustained benefit over the remaining 90\% of steps, and offers weak guidance on whether a proactive suggestion is warranted. A relevant record may tell the agent where to begin, but not which past action applies to the current screen or whether a routine is due now. The underlying issue is that relevance does not imply applicability}: relevance is determined at the task level, whereas applicability depends on the situation at decision time. We therefore recast personalization as experience activation and introduce ExpActivator, a training-free framework that activates only the experience applicable to the current situation. During execution, ExpActivator matches each new screen to historical states in the frozen GUI backbone's latent space and supplies the corresponding action as a reference. Before execution, it activates a recurring intent only when the current time and scenario provide sufficient support, and otherwise abstains. Across four GUI backbones, ExpActivator improves within-trajectory step success by 28\% on average, achieves the best personalized execution on every backbone while using about one-fifth as many history tokens, and reaches approximately 2.3times the Matthews correlation coefficient of the strongest proactive baseline. Experience pays where it is activated, not where it is appended.

arXiv 原文

订阅 AI Pulse

每天 08:00 · 12:30 · 18:30 · 23:50 更新