AI Pulse
📄 论文解读

十台人形机器人,靠喊话协作

两台机器人一起搬东西,难点不在力气,在「谁先动、往哪使劲」——而这篇让它们不靠网络通信,靠「喊话」同步。做法分两层:底层把一个单机人形的基础控制模型,用多智能体后训练改成能应对机器人之间物理耦合的协同控制,每台只凭自己看到的局部信息就能配合;上层训了一个视觉语言规划器,再加一套语音主导-跟随机制,让分散执行的机器人靠说话对齐节奏,不需要联网。训练时只用两台一模一样的机器人,却能扩展到十台,还能直接应付型号不同的混编队伍,不用重训。他们同时发布了 HH-Bench,12 个任务覆盖 2 到 10 台机器人。真机实验里,这套分散协作在困难任务上表现稳定。它不是你明天能用上的东西——人形机器人本身还没进你家;但它指出的方向值得记住:多机器人协作的瓶颈可能不是算力或通信带宽,而是怎么像工地上的人一样,用最原始的方式对齐动作。

📄 原文摘要(英文)

Collaboration promises to extend humanoid capabilities beyond what individual robots can achieve. However, realizing this potential requires coordinated whole-body interactions, coherent long-horizon planning, and precise synchronization across robots. We introduce Heave-Ho, a decentralized framework for long-horizon collaborative multi-humanoid loco-manipulation. At the low level, we develop a multi-agent post-training framework that adapts a humanoid foundation tracking model to physically coupled interactions between humanoids, enabling coordinated decentralized control from local observations alone. At the high level, we train a vision-language planner and design a speech-based leader-follower coordination mechanism to synchronize decentralized execution without network communication. Trained with two identical humanoids, our system scales to teams of up to ten robots and generalizes to heterogeneous teams without retraining. To benchmark these capabilities, we introduce HH-Bench, comprising 12 tasks involving teams of 2 to 10 humanoids, including heterogeneous teams. Systematic evaluations show that Heave-Ho consistently outperforms baseline methods, while real-world experiments demonstrate robust decentralized collaboration across challenging tasks.

arXiv 原文

订阅 AI Pulse

每天 08:00 · 12:30 · 18:30 · 23:50 更新