机器人学会“边跑边改主意”:一条指令让它钻杆不撞
机器人被要求“走过去”时,通常要么死板地照原轨迹走,要么完全重新规划。这篇让机器人两样都要:大部分动作照旧,但遇到新目标(比如前方突然多了根1.25米的横杆)时,它能在不重新训练的情况下,现场“微调”自己的动作——成功率从2%提到90%。关键是把“改主意”变成对生成动作的噪声做优化,而不是改模型本身。真机测试里,它钻过1.1米低杆、跨过12厘米障碍都没摔倒。它不是你明天能买到的产品,但“边执行边改目标”正是机器人进真实世界最缺的能力。
📄 原文摘要(英文)
Deployment objectives often specify desired outcomes without providing revised trajectories, while parts of the original reference must still be followed. We present OneSteer, a one-step diffusion whole-body controller that combines general motion tracking with selective test-time steering. To accommodate new objectives, differentiable task costs guide optimization of the generator's input noise with frozen weights, while body-group reference masks relax selected tracking requirements. Predicted state-action plans provide a shared interface for task optimization and feedback-conditioned execution. For nominal tracking, the model trained from scratch achieves the lowest local tracking error among the evaluated baselines on successful held-out AMASS and BONES clips. For steering, one frozen distilled controller adapts across diverse deployment objectives in simulation, raising the clean passage rate under a 1.25 m bar from 2% to 90%. On a physical Unitree G1, OneSteer completes all 27 nominal tracking trials across nine diverse whole-body motion sequences without falling. With a steering cost derived from a signed distance field built using only onboard LiDAR, it also passes under a 1.1 m low bar in four of five attempts and steps over a 12 cm hurdle without falling in all three attempts. Beyond control, prediction variation in the model trained from scratch ranks likely tracking failures without physics rollouts. This scoring method is more than 10x faster than simulation-based scoring with five rollouts per clip and guides targeted fine-tuning. Project page: https://onesteer.github.io