AI Pulse
📄 论文解读

教机器人干活,终于不用人跟着跑了

教机器人做家务,过去要么人拿着遥控器一步步指挥,要么人亲自上手推着它走——前者慢,后者累,而且人一离开,机器人就学不会了。这篇 HALO 系统换了个思路:让人直接推着机器人的手臂做动作,脚底下踩一个轻便滑板跟着走,机器人自己记住身体怎么配合。采集速度比老方法快 2.9 倍,而且教出来的机器人能独立完成六步长任务,成功率 73.3%,连扎带这种精细活都会。它不是你明天就能买回家的,但这是机器人学「干体力活」从实验室走向真实家庭的关键一步。

📄 原文摘要(英文)

Learning whole-body mobile manipulation requires demonstrations that coordinate bimanual actions with locomotion across extended workspaces. However, existing interfaces trade off direct robot control, perception and action alignment, and natural operator mobility, making such demonstrations difficult to collect. We introduce HALO, a human-aligned data collection system for whole-body mobile manipulation. The system aligns the operator's perception and action space with the robot while preserving direct physical feedback and natural locomotion. Operators guide the robot end-effectors through kinesthetic teaching and move a low-resistance platform without the deployed mobile base while performing bimanual manipulation. This interface enables more natural whole-body demonstrations, but the close human-robot coupling introduces discrepancies between the demonstration and deployment settings. We address these discrepancies with deployment-aligned demonstration processing, which calibrates and temporally aligns platform motion with the deployed base response and masks and inpaints demonstrator hands in recorded observations. Compared with Mobile ALOHA and VR teleoperation, HALO enables up to 2.9x faster demonstration collection while maintaining comparable or higher success rates. Policies trained with HALO perform precise manipulation tasks, including zip-tie fastening, and achieve a 73.3% success rate on a six-stage long-horizon mobile manipulation task involving repeated coordinated base and arm motion. Project page: https://robbyant-research.github.io/Lingbot-ALOHA/

arXiv 原文

订阅 AI Pulse

每天 08:00 · 12:30 · 18:30 · 23:50 更新