让贵模型干一半就换人,省65%
跑长任务的 AI 代理,最贵的不是答一次,而是几十步都让最贵的模型扛。这篇试了一件很朴素的事:任务做到一半,把活交给便宜模型接着干。方向很关键——便宜的先上、贵的来收尾,基本没用,钱没省多少、效果还更差;反过来,贵的先做、在合适的进度点交给便宜的,准确率基本不掉、有时还更高,成本却大幅下降。他们据此做了个轻量探测器,从任务进度的重复模式里学「什么时候该换人」,在 11 组模型搭配、两个基准上平均省 65.9% 的 API 费,准确率最多还高出 8.8 个百分点。它不是你明天能直接装上的工具,但如果你在按 token 付费跑代理,这就是「别全程用最贵的」的第一个可操作答案。
📄 原文摘要(英文)
Solving long-horizon agentic tasks requires language agents to interact with their environments over multiple steps, and reliable performance often comes from the expensive capable models available through cloud providers. Meanwhile, alternative efficient models with inferior performance but a much lower cost are emerging, including lower-tier cloud models and smaller open-weights models deployable on local hardware. This raises a natural question that remains less explored than traditional query-level routing: can capable and efficient models collaborate within a single long-horizon agentic task to substantially reduce cost while preserving task accuracy? In this paper, we systematically investigate key design choices for such collaboration through model handoffs, where one model takes over from another, focusing on handoff direction and context transfer. We find that efficient-to-capable handoffs generally underperform capable-only execution with limited or even no cost reduction, whereas capable-to-efficient handoffs at suitable stages of task progress largely preserve or even improve accuracy while substantially reducing cost. These findings suggest that a one-time, simple, well-timed handoff strategy is good enough for cost-effective agent collaboration, motivating AgentBaton, a lightweight detector that learns when to hand off from recurring patterns in task progress. Across 11 model pairs and two representative benchmarks, AgentBaton reduces API costs by 65.9% on average while largely preserving task accuracy, with accuracy gains of up to 8.8 percentage points over capable-only execution. Experiments across various reasoning-effort settings further show that AgentBaton extends the empirical accuracy-cost Pareto frontier.