Aligning cyber space with physical world: A comprehensive survey on embodied ai

Y Liu, W Chen, Y Bai, X Liang, G Li, W Gao… - arXiv preprint arXiv …, 2024 - arxiv.org
Embodied Artificial Intelligence (Embodied AI) is crucial for achieving Artificial General
Intelligence (AGI) and serves as a foundation for various applications that bridge cyberspace …

Open-television: Teleoperation with immersive active visual feedback

X Cheng, J Li, S Yang, G Yang, X Wang - arXiv preprint arXiv:2407.01512, 2024 - arxiv.org
Teleoperation serves as a powerful method for collecting on-robot data essential for robot
learning from demonstrations. The intuitiveness and ease of use of the teleoperation system …

Bunny-visionpro: Real-time bimanual dexterous teleoperation for imitation learning

R Ding, Y Qin, J Zhu, C Jia, S Yang, R Yang… - arXiv preprint arXiv …, 2024 - arxiv.org
Teleoperation is a crucial tool for collecting human demonstrations, but controlling robots
with bimanual dexterous hands remains a challenge. Existing teleoperation systems …

Robot utility models: General policies for zero-shot deployment in new environments

H Etukuru, N Naka, Z Hu, S Lee, J Mehu… - arXiv preprint arXiv …, 2024 - arxiv.org
Robot models, particularly those trained with large amounts of data, have recently shown a
plethora of real-world manipulation and navigation capabilities. Several independent efforts …

Okami: Teaching humanoid robots manipulation skills through single video imitation

J Li, Y Zhu, Y Xie, Z Jiang, M Seo… - … Annual Conference on …, 2024 - openreview.net
We study the problem of teaching humanoid robots manipulation skills by imitating from
single video demonstrations. We introduce OKAMI, a method that generates a manipulation …

Lessons from Learning to Spin" Pens"

J Wang, Y Yuan, H Che, H Qi, Y Ma, J Malik… - arXiv preprint arXiv …, 2024 - arxiv.org
In-hand manipulation of pen-like objects is an important skill in our daily lives, as many tools
such as hammers and screwdrivers are similarly shaped. However, current learning-based …

Generalizable humanoid manipulation with improved 3d diffusion policies

Y Ze, Z Chen, W Wang, T Chen, X He, Y Yuan… - arXiv preprint arXiv …, 2024 - arxiv.org
Humanoid robots capable of autonomous operation in diverse environments have long
been a goal for roboticists. However, autonomous manipulation by humanoid robots has …

Arcap: Collecting high-quality human demonstrations for robot learning with augmented reality feedback

S Chen, C Wang, K Nguyen, L Fei-Fei… - arXiv preprint arXiv …, 2024 - arxiv.org
Recent progress in imitation learning from human demonstrations has shown promising
results in teaching robots manipulation skills. To further scale up training datasets, recent …

Bimanual dexterity for complex tasks

K Shaw, Y Li, J Yang, MK Srirama, R Liu… - arXiv preprint arXiv …, 2024 - arxiv.org
To train generalist robot policies, machine learning methods often require a substantial
amount of expert human teleoperation data. An ideal robot for humans collecting data is one …

Hover: Versatile neural whole-body controller for humanoid robots

T He, W Xiao, T Lin, Z Luo, Z Xu, Z Jiang… - arXiv preprint arXiv …, 2024 - arxiv.org
Humanoid whole-body control requires adapting to diverse tasks such as navigation, loco-
manipulation, and tabletop manipulation, each demanding a different mode of control. For …