Interactively picking real-world objects with unconstrained spoken language instructions
Comprehension of spoken natural language is an essential skill for robots to communicate
with humans effectively. However, handling unconstrained spoken instructions is …
with humans effectively. However, handling unconstrained spoken instructions is …
Decision-making for bidirectional communication in sequential human-robot collaborative tasks
Communication is critical to collaboration; however, too much of it can degrade
performance. Motivated by the need for effective use of a robot's communication modalities …
performance. Motivated by the need for effective use of a robot's communication modalities …
Ingress: Interactive visual grounding of referring expressions
This article presents INGRESS, a robot system that follows human natural language
instructions to pick and place everyday objects. The key question here is to ground referring …
instructions to pick and place everyday objects. The key question here is to ground referring …
A Review of Natural-Language-Instructed Robot Execution Systems
It is natural and efficient to use human natural language (NL) directly to instruct robot task
executions without prior user knowledge of instruction patterns. Currently, NL-instructed …
executions without prior user knowledge of instruction patterns. Currently, NL-instructed …
Recent advancements in multimodal human–robot interaction
Robotics have advanced significantly over the years, and human–robot interaction (HRI) is
now playing an important role in delivering the best user experience, cutting down on …
now playing an important role in delivering the best user experience, cutting down on …
Towards open-world interactive disambiguation for robotic grasping
Language-based communications are essential in human-robot interaction, especially for
the majority of non-expert users. In this paper, we present SeeAsk, an open-world interactive …
the majority of non-expert users. In this paper, we present SeeAsk, an open-world interactive …
Mixed reality as a bidirectional communication interface for human-robot interaction
We present a decision-theoretic model and robot system that interprets multimodal human
communication to disambiguate item references by asking questions via a mixed reality …
communication to disambiguate item references by asking questions via a mixed reality …
Robot object retrieval with contextual natural language queries
Natural language object retrieval is a highly useful yet challenging task for robots in human-
centric environments. Previous work has primarily focused on commands specifying the …
centric environments. Previous work has primarily focused on commands specifying the …
Verbally Soliciting Human Feedback in Continuous Human-Robot Collaboration: Effects of the Framing and Timing of Reminders
Humans expect robots to learn from their feedback and adapt to their preferences. However,
there are limitations with how humans provide feedback to robots, eg, humans may give less …
there are limitations with how humans provide feedback to robots, eg, humans may give less …
Interactive robotic grasping with attribute-guided disambiguation
Interactive robotic grasping using natural language is one of the most fundamental tasks in
human-robot interaction. However, language can be a source of ambiguity, particularly …
human-robot interaction. However, language can be a source of ambiguity, particularly …