Humanoid Policy ~ Human Policy
Abstrak
Training manipulation policies for humanoid robots with diverse data enhances their robustness and generalization across tasks and platforms. However, learning solely from robot demonstrations is labor-intensive, requiring expensive tele-operated data collection which is difficult to scale. This paper investigates a more scalable data source, egocentric human demonstrations, to serve as cross-embodiment training data for robot learning. We mitigate the embodiment gap between humanoids and humans from both the data and modeling perspectives. We collect an egocentric task-oriented dataset (PH2D) that is directly aligned with humanoid manipulation demonstrations. We then train a human-humanoid behavior policy, which we term Human Action Transformer (HAT). The state-action space of HAT is unified for both humans and humanoid robots and can be differentiably retargeted to robot actions. Co-trained with smaller-scale robot data, HAT directly models humanoid robots and humans as different embodiments without additional supervision. We show that human data improves both generalization and robustness of HAT with significantly better data collection efficiency. Code and data: https://human-as-robot.github.io/
Topik & Kata Kunci
Penulis (15)
Ri-Zhao Qiu
Shiqi Yang
Xuxin Cheng
Chaitanya Chawla
Jialong Li
Tairan He
Ge Yan
David J. Yoon
Ryan Hoque
Lars Paulsen
Ge Yang
Jian Zhang
Sha Yi
Guanya Shi
Xiaolong Wang
Akses Cepat
- Tahun Terbit
- 2025
- Bahasa
- en
- Total Sitasi
- 61×
- Sumber Database
- Semantic Scholar
- DOI
- 10.48550/arXiv.2503.13441
- Akses
- Open Access ✓