Integrated task and motion planning

CR Garrett, R Chitnis, R Holladay, B Kim… - Annual review of …, 2021 - annualreviews.org
The problem of planning for a robot that operates in environments containing a large
number of objects, taking actions to move itself through the world as well as to change the …

[HTML][HTML] Deliberation for autonomous robots: A survey

F Ingrand, M Ghallab - Artificial Intelligence, 2017 - Elsevier
Autonomous robots facing a diversity of open environments and performing a variety of tasks
and interactions need explicit deliberation in order to fulfill their missions. Deliberation is …

Text2motion: From natural language instructions to feasible plans

K Lin, C Agia, T Migimatsu, M Pavone, J Bohg - Autonomous Robots, 2023 - Springer
Abstract We propose Text2Motion, a language-based planning framework enabling robots
to solve sequential manipulation tasks that require long-horizon reasoning. Given a natural …

Inner monologue: Embodied reasoning through planning with language models

W Huang, F Xia, T Xiao, H Chan, J Liang… - arXiv preprint arXiv …, 2022 - arxiv.org
Recent works have shown how the reasoning capabilities of Large Language Models
(LLMs) can be applied to domains beyond natural language processing, such as planning …

Do as i can, not as i say: Grounding language in robotic affordances

M Ahn, A Brohan, N Brown, Y Chebotar… - arXiv preprint arXiv …, 2022 - arxiv.org
Large language models can encode a wealth of semantic knowledge about the world. Such
knowledge could be extremely useful to robots aiming to act upon high-level, temporally …

Alfworld: Aligning text and embodied environments for interactive learning

M Shridhar, X Yuan, MA Côté, Y Bisk… - arXiv preprint arXiv …, 2020 - arxiv.org
Given a simple request like Put a washed apple in the kitchen fridge, humans can reason in
purely abstract terms by imagining action sequences and scoring their likelihood of success …

Grounded decoding: Guiding text generation with grounded models for robot control

W Huang, F Xia, D Shah, D Driess, A Zeng, Y Lu… - arXiv preprint arXiv …, 2023 - arxiv.org
Recent progress in large language models (LLMs) has demonstrated the ability to learn and
leverage Internet-scale knowledge through pre-training with autoregressive models …

Overcoming exploration in reinforcement learning with demonstrations

A Nair, B McGrew, M Andrychowicz… - … on robotics and …, 2018 - ieeexplore.ieee.org
Exploration in environments with sparse rewards has been a persistent problem in
reinforcement learning (RL). Many tasks are natural to specify with a sparse reward, and …

Rearrangement: A challenge for embodied ai

D Batra, AX Chang, S Chernova, AJ Davison… - arXiv preprint arXiv …, 2020 - arxiv.org
We describe a framework for research and evaluation in Embodied AI. Our proposal is
based on a canonical task: Rearrangement. A standard task can focus the development of …

Rekep: Spatio-temporal reasoning of relational keypoint constraints for robotic manipulation

W Huang, C Wang, Y Li, R Zhang, L Fei-Fei - arXiv preprint arXiv …, 2024 - arxiv.org
Representing robotic manipulation tasks as constraints that associate the robot and the
environment is a promising way to encode desired robot behaviors. However, it remains …