Teach: Task-driven embodied agents that chat

A Padmakumar, J Thomason, A Shrivastava… - Proceedings of the …, 2022 - ojs.aaai.org
Robots operating in human spaces must be able to engage in natural language interaction,
both understanding and executing instructions, and using conversation to resolve ambiguity …

Learning language-conditioned robot behavior from offline data and crowd-sourced annotation

S Nair, E Mitchell, K Chen… - Conference on Robot …, 2022 - proceedings.mlr.press
We study the problem of learning a range of vision-based manipulation tasks from a large
offline dataset of robot interaction. In order to accomplish this, humans need easy and …

A review of NASA human-robot interaction in space

K Hambuchen, J Marquez, T Fong - Current Robotics Reports, 2021 - Springer
Abstract Purpose of Review This review provides an overview of the motivation, challenges,
state-of-the-art, and recent research for human-robot interaction (HRI) in space. For context …

Visual language navigation: A survey and open challenges

SM Park, YG Kim - Artificial Intelligence Review, 2023 - Springer
With the recent development of deep learning, AI models are widely used in various
domains. AI models show good performance for definite tasks such as image classification …

LISA: Learning interpretable skill abstractions from language

D Garg, S Vaidyanath, K Kim… - Advances in Neural …, 2022 - proceedings.neurips.cc
Learning policies that effectively utilize language instructions in complex, multi-task
environments is an important problem in imitation learning. While it is possible to condition …

Aprel: A library for active preference-based reward learning algorithms

E Bıyık, A Talati, D Sadigh - 2022 17th ACM/IEEE International …, 2022 - ieeexplore.ieee.org
Reward learning is a fundamental problem in human-robot interaction to have robots that
operate in alignment with what their human user wants. Many preference-based learning …

Flight, camera, action! using natural language and mixed reality to control a drone

B Huang, D Bayazit, D Ullman… - … on robotics and …, 2019 - ieeexplore.ieee.org
With increasing autonomy, robots like drones are increasingly accessible to untrained users.
Most users control drones using a low-level interface, such as a radio-controlled (RC) …

Ground manipulator primitive tasks to executable actions using large language models

Y Cao, CSG Lee - Proceedings of the AAAI Symposium Series, 2023 - ojs.aaai.org
Layered architectures have been widely used in robot systems. The majority of them
implement planning and execution functions in separate layers. However, there still lacks a …

Exploring Large Language Models to Facilitate Variable Autonomy for Human-Robot Teaming

Y Lakhnati, M Pascher, J Gerken - arXiv preprint arXiv:2312.07214, 2023 - arxiv.org
In a rapidly evolving digital landscape autonomous tools and robots are becoming
commonplace. Recognizing the significance of this development, this paper explores the …

Embodied scene description

S Tan, D Guo, H Liu, X Zhang, F Sun - Autonomous robots, 2022 - Springer
Embodiment is an important characteristic for all intelligent agents, while existing scene
description tasks mainly focus on analyzing images passively and the semantic …