A survey of imitation learning: Algorithms, recent developments, and challenges

M Zare, PM Kebria, A Khosravi… - IEEE Transactions on …, 2024 - ieeexplore.ieee.org
In recent years, the development of robotics and artificial intelligence (AI) systems has been
nothing short of remarkable. As these systems continue to evolve, they are being utilized in …

Voxposer: Composable 3d value maps for robotic manipulation with language models

W Huang, C Wang, R Zhang, Y Li, J Wu… - arXiv preprint arXiv …, 2023 - arxiv.org
Large language models (LLMs) are shown to possess a wealth of actionable knowledge that
can be extracted for robot manipulation in the form of reasoning and planning. Despite the …

Open x-embodiment: Robotic learning datasets and rt-x models

A Padalkar, A Pooley, A Jain, A Bewley… - arXiv preprint arXiv …, 2023 - arxiv.org
Large, high-capacity models trained on diverse datasets have shown remarkable successes
on efficiently tackling downstream applications. In domains from NLP to Computer Vision …

Mobile aloha: Learning bimanual mobile manipulation with low-cost whole-body teleoperation

Z Fu, TZ Zhao, C Finn - arXiv preprint arXiv:2401.02117, 2024 - arxiv.org
Imitation learning from human demonstrations has shown impressive performance in
robotics. However, most results focus on table-top manipulation, lacking the mobility and …

Xskill: Cross embodiment skill discovery

M Xu, Z Xu, C Chi, M Veloso… - Conference on Robot …, 2023 - proceedings.mlr.press
Human demonstration videos are a widely available data source for robot learning and an
intuitive user interface for expressing desired behavior. However, directly extracting …

Foundation models in robotics: Applications, challenges, and the future

R Firoozi, J Tucker, S Tian, A Majumdar, J Sun… - arXiv preprint arXiv …, 2023 - arxiv.org
We survey applications of pretrained foundation models in robotics. Traditional deep
learning models in robotics are trained on small datasets tailored for specific tasks, which …

Human-in-the-loop task and motion planning for imitation learning

A Mandlekar, CR Garrett, D Xu… - Conference on Robot …, 2023 - proceedings.mlr.press
Imitation learning from human demonstrations can teach robots complex manipulation skills,
but is time-consuming and labor intensive. In contrast, Task and Motion Planning (TAMP) …

Towards a richer 2D understanding of hands at scale

T Cheng, D Shan, A Hassen… - Advances in Neural …, 2023 - proceedings.neurips.cc
As humans, we learn a lot about how to interact with the world by observing others
interacting with their hands. To help AI systems obtain a better understanding of hand …

Towards generalizable zero-shot manipulation via translating human interaction plans

H Bharadhwaj, A Gupta, V Kumar… - 2024 IEEE International …, 2024 - ieeexplore.ieee.org
We pursue the goal of developing robots that can interact zero-shot with generic unseen
objects via a diverse repertoire of manipulation skills and show how passive human videos …

AirExo: Low-Cost Exoskeletons for Learning Whole-Arm Manipulation in the Wild

H Fang, HS Fang, Y Wang, J Ren… - … on Robotics and …, 2024 - ieeexplore.ieee.org
While humans can use parts of their arms other than the hands for manipulations like
gathering and supporting, whether robots can effectively learn and perform the same type of …