AI Pulse
📄 论文解读

让大模型从写手变审稿,速度翻倍还不掉分

现在的 AI 智能体每走一步都要大模型亲自想,哪怕只是查个日历、读个文件这种熟路。这篇把分工倒过来:小模型先跑腿,把只读的查询都做了,遇到真要改系统的动作就停下来;大模型不再一步步写,而是拿一整段草稿一次性过目,只挑它觉得靠谱的前缀放行,错了才出手修。结果是:成功率只差 1 个点,但内存流量和耗时砍掉近一半。它不是你明天能用上的,但指向一个明确趋势——大模型的价值在把关,不在代劳。

📄 原文摘要(英文)

Large language model agents solve tasks through long sequences of tool calls, and the prevailing design has a single strong model generate every step, although many steps are routine enough for a much smaller model. Existing ways of sharing this work keep the strong model as the generator: routers and collaborative agents decide which model handles each query or step, and speculative methods check a small model's drafts one step at a time, usually against the strong model's own action. We introduce SpecAgent, a collaboration protocol that turns the strong model from the author of each step into a reviewer of steps drafted by a weak model. The weak model executes read-only tool calls as it drafts, so that every step is grounded in real observations, and holds the first action that would modify the environment. The strong model then verifies the drafted segment in a single prefill pass, commits the longest prefix it judges semantically valid, and repairs the first rejected step. Because verification replaces autoregressive decoding with parallel prefill, the strong model decodes only short verdicts and occasional repairs rather than every step. On τ^2-Bench, SpecAgent comes within one point of the strong model's success rate while roughly halving memory traffic and wall time, and on AutomationBench and VitaBench it recovers 44-75% of the quality gap while lowering both. In an edge-cloud deployment on MCP-Atlas with three cloud models, it closes 53-75% of the weak-strong quality gap while the strong model generates at most half as many tokens. These results suggest that a strong model need not author every step of an agent: reviewing grounded drafts retains most of its quality while cutting both latency and memory traffic.

arXiv 原文

订阅 AI Pulse

每天 08:00 · 12:30 · 18:30 · 23:50 更新