Spoken language interaction with robots: Recommendations for future research

M Marge, C Espy-Wilson, NG Ward, A Alwan… - Computer Speech & …, 2022 - Elsevier
With robotics rapidly advancing, more effective human–robot interaction is increasingly
needed to realize the full potential of robots for society. While spoken language must be part …

Towards collaborative plan acquisition through theory of mind modeling in situated dialogue

CP Bara, Z Ma, Y Yu, J Shah, J Chai - arXiv preprint arXiv:2305.11271, 2023 - arxiv.org
Collaborative tasks often begin with partial task knowledge and incomplete initial plans from
each partner. To complete these tasks, agents need to engage in situated communication …

How should agents ask questions for situated learning? an annotated dialogue corpus

F Gervits, A Roque, G Briggs, M Scheutz… - arXiv preprint arXiv …, 2021 - arxiv.org
Intelligent agents that are confronted with novel concepts in situated environments will need
to ask their human teammates questions to learn about the physical world. To better …

Unpacking human teachers' intentions for natural interactive task learning

P Ramaraj, CL Ortiz, S Mohan - 2021 30th IEEE International …, 2021 - ieeexplore.ieee.org
Interactive Task Learning (ITL) is an emerging research agenda that studies the design of
complex intelligent robots that can acquire new knowledge through natural human teacher …

Spoken language interaction with robots: Research issues and recommendations, report from the NSF future directions workshop

M Marge, C Espy-Wilson, N Ward - arXiv preprint arXiv:2011.05533, 2020 - arxiv.org
With robotics rapidly advancing, more effective human-robot interaction is increasingly
needed to realize the full potential of robots for society. While spoken language must be part …

Decision-theoretic question generation for situated reference resolution: An empirical study and computational model

F Gervits, G Briggs, A Roque, GA Kadomatsu… - Proceedings of the …, 2021 - dl.acm.org
Dialogue agents that interact with humans in situated environments need to manage
referential ambiguity across multiple modalities and ask for help as needed. However, it is …

DOROTHIE: Spoken dialogue for handling unexpected situations in interactive autonomous driving agents

Z Ma, B VanDerPloeg, CP Bara, H Yidong… - arXiv preprint arXiv …, 2022 - arxiv.org
In the real world, autonomous driving agents navigate in highly dynamic environments full of
unexpected situations where pre-trained models are unreliable. In these situations, what is …

SCOUT: A Situated and Multi-Modal Human-Robot Dialogue Corpus

SM Lukin, C Bonial, M Marge, T Hudson… - arXiv preprint arXiv …, 2024 - arxiv.org
We introduce the Situated Corpus Of Understanding Transactions (SCOUT), a multi-modal
collection of human-robot dialogue in the task domain of collaborative exploration. The …

A two-level interpretation of modality in human-robot dialogue

L Donatelli, K Lai, J Pustejovsky - Proceedings of the 28th …, 2020 - aclanthology.org
We analyze the use and interpretation of modal expressions in a corpus of situated human-
robot dialogue and ask how to effectively represent these expressions for automatic …

Analysis of Situated Interactive Non-Expert Instruction of A Hierarchical Task to a Learning Robot

P Ramaraj - 2023 - deepblue.lib.umich.edu
Interactive Task Learning (ITL) is an approach to designing robots that can learn tasks on
the fly from human instruction and demonstration in a shared environment. ITL approaches …