Incremental learning of humanoid robot behavior from natural interaction and large language models

L Bärmann, R Kartmann, F Peller-Konrad… - Frontiers in Robotics …, 2024 - frontiersin.org
Natural-language dialog is key for an intuitive human–robot interaction. It can be used not
only to express humans' intents but also to communicate instructions for improvement if a …

Decomplex: Task planning from complex natural instructions by a collocating robot

P Pramanick, HB Barua, C Sarkar - 2020 IEEE/RSJ …, 2020 - ieeexplore.ieee.org
As the number of robots in our daily surroundings like home, office, restaurants, factory
floors, etc. are increasing rapidly, the development of natural human-robot interaction …

Semantic scene manipulation based on 3d spatial object relations and language instructions

R Kartmann, D Liu, T Asfour - 2020 IEEE-RAS 20th International …, 2021 - ieeexplore.ieee.org
Robot understanding of spatial object relations is key for a symbiotic human-robot
interaction. Understanding the meaning of such relations between objects in a current scene …

Assembly planning by recognizing a graphical instruction manual

I Sera, N Yamanobe, IG Ramirez-Alpizar… - 2021 IEEE/RSJ …, 2021 - ieeexplore.ieee.org
This paper proposes a robot assembly planning method by automatically reading the
graphical instruction manuals designed for humans. Essentially, the method generates an …

SpaTiaL: monitoring and planning of robotic tasks using spatio-temporal logic specifications

C Pek, GF Schuppe, F Esposito, J Tumova… - Autonomous Robots, 2023 - Springer
Many tasks require robots to manipulate objects while satisfying a complex interplay of
spatial and temporal constraints. For instance, a table setting robot first needs to place a …

Representing spatial object relations as parametric polar distribution for scene manipulation based on verbal commands

R Kartmann, Y Zhou, D Liu, F Paus… - 2020 IEEE/RSJ …, 2020 - ieeexplore.ieee.org
Understanding spatial relations is a key element for natural human-robot interaction.
Especially, a robot must be able to manipulate a given scene according to a human verbal …

Learning Spatial Bimanual Action Models Based on Affordance Regions and Human Demonstrations

BS Plonka, C Dreher, A Meixner… - 2024 IEEE-RAS 23rd …, 2024 - ieeexplore.ieee.org
In this paper, we present a novel approach for learning bimanual manipulation actions from
human demonstration by extracting spatial constraints between affordance regions, termed …

Cognitive Approach to Hierarchical Task Selection for Human-Robot Interaction in Dynamic Environments

STS Bukhari, BA Anima, D Feil-Seifer… - 2023 IEEE/RSJ …, 2023 - ieeexplore.ieee.org
In an efficient and flexible human-robot collaborative work environment, a robot team
member must be able to recognize both explicit requests and implied actions from human …

Interactive and incremental learning of spatial object relations from human demonstrations

R Kartmann, T Asfour - Frontiers in Robotics and AI, 2023 - frontiersin.org
Humans use semantic concepts such as spatial relations between objects to describe
scenes and communicate tasks such as “Put the tea to the right of the cup” or “Move the …

Distributed Dynamic Hierarchical Task Assignment for Human-Robot Teams

BA Anima - 2022 - search.proquest.com
This work implements a joint task architecture for human-robot collaborative task execution
using a hierarchical task planner. This architecture allowed humans and robots to work …