Large language models for robotics: A survey
The human ability to learn, generalize, and control complex manipulation tasks through multi-
modality feedback suggests a unique capability, which we refer to as dexterity intelligence …
modality feedback suggests a unique capability, which we refer to as dexterity intelligence …
A survey on deep learning and deep reinforcement learning in robotics with a tutorial on deep reinforcement learning
This article is about deep learning (DL) and deep reinforcement learning (DRL) works
applied to robotics. Both tools have been shown to be successful in delivering data-driven …
applied to robotics. Both tools have been shown to be successful in delivering data-driven …
Lm-nav: Robotic navigation with large pre-trained models of language, vision, and action
Goal-conditioned policies for robotic navigation can be trained on large, unannotated
datasets, providing for good generalization to real-world settings. However, particularly in …
datasets, providing for good generalization to real-world settings. However, particularly in …
Navigation with large language models: Semantic guesswork as a heuristic for planning
Navigation in unfamiliar environments presents a major challenge for robots: while mapping
and planning techniques can be used to build up a representation of the world, quickly …
and planning techniques can be used to build up a representation of the world, quickly …
Maskvit: Masked visual pre-training for video prediction
The ability to predict future visual observations conditioned on past observations and motor
commands can enable embodied agents to plan solutions to a variety of tasks in complex …
commands can enable embodied agents to plan solutions to a variety of tasks in complex …
ViNT: A foundation model for visual navigation
General-purpose pre-trained models (" foundation models") have enabled practitioners to
produce generalizable solutions for individual machine learning problems with datasets that …
produce generalizable solutions for individual machine learning problems with datasets that …
Badgr: An autonomous self-supervised learning-based navigation system
Mobile robot navigation is typically regarded as a geometric problem, in which the robot's
objective is to perceive the geometry of the environment in order to plan collision-free paths …
objective is to perceive the geometry of the environment in order to plan collision-free paths …
Behavior: Benchmark for everyday household activities in virtual, interactive, and ecological environments
We introduce BEHAVIOR, a benchmark for embodied AI with 100 activities in simulation,
spanning a range of everyday household chores such as cleaning, maintenance, and food …
spanning a range of everyday household chores such as cleaning, maintenance, and food …
Socially compliant navigation dataset (scand): A large-scale dataset of demonstrations for social navigation
Social navigation is the capability of an autonomous agent, such as a robot, to navigate in a
“socially compliant” manner in the presence of other intelligent agents such as humans. With …
“socially compliant” manner in the presence of other intelligent agents such as humans. With …
igibson 1.0: A simulation environment for interactive tasks in large realistic scenes
We present iGibson 1.0, a novel simulation environment to develop robotic solutions for
interactive tasks in large-scale realistic scenes. Our environment contains 15 fully interactive …
interactive tasks in large-scale realistic scenes. Our environment contains 15 fully interactive …