Partially observable markov decision processes in robotics: A survey

M Lauri, D Hsu, J Pajarinen - IEEE Transactions on Robotics, 2022 - ieeexplore.ieee.org
Noisy sensing, imperfect control, and environment changes are defining characteristics of
many real-world robot tasks. The partially observable Markov decision process (POMDP) …

Invigorate: Interactive visual grounding and grasping in clutter

H Zhang, Y Lu, C Yu, D Hsu, X Lan, N Zheng - arXiv preprint arXiv …, 2021 - arxiv.org
This paper presents INVIGORATE, a robot system that interacts with human through natural
language and grasps a specified object in clutter. The objects may occlude, obstruct, or even …

Reasoning with scene graphs for robot planning under partial observability

S Amiri, K Chandan, S Zhang - IEEE Robotics and Automation …, 2022 - ieeexplore.ieee.org
Robot planning in partially observable domains is difficult, because a robot needs to
estimate the current state and plan actions at the same time. When the domain includes …

Learning dynamic attribute-factored world models for efficient multi-object reinforcement learning

F Feng, S Magliacane - Advances in Neural Information …, 2024 - proceedings.neurips.cc
In many reinforcement learning tasks, the agent has to learn to interact with many objects of
different types and generalize to unseen combinations and numbers of objects. Often a task …

Partially Observable Monte Carlo Planning with state variable constraints for mobile robot navigation

A Castellini, E Marchesini, A Farinelli - Engineering Applications of Artificial …, 2021 - Elsevier
Autonomous mobile robots employed in industrial applications often operate in complex and
uncertain environments. In this paper we propose an approach based on an extension of …

Towards optimal correlational object search

K Zheng, R Chitnis, Y Sung… - … on Robotics and …, 2022 - ieeexplore.ieee.org
In realistic applications of object search, robots will need to locate target objects in complex
environments while coping with unreliable sensors, especially for small or hard-to-detect …

POMDP planning for object search in partially unknown environment

Y Chen, H Kurniawati - Advances in Neural Information …, 2024 - proceedings.neurips.cc
Efficiently searching for target objects in complex environments that contain various types of
furniture, such as shelves, tables, and beds, is crucial for mobile robots, but it poses …

ASystem for Generalized 3D Multi-Object Search

K Zheng, A Paul, S Tellex - 2023 IEEE International …, 2023 - ieeexplore.ieee.org
Searching for objects is a fundamental skill for robots. As such, we expect object search to
eventually become an off-the-shelf capability for robots, similar to eg, object detection and …

Open scene graphs for open world object-goal navigation

J Loo, Z Wu, D Hsu - arXiv preprint arXiv:2407.02473, 2024 - arxiv.org
How can we build robots for open-world semantic navigation tasks, like searching for target
objects in novel scenes? While foundation models have the rich knowledge and …

pomdp_py: A framework to build and solve POMDP problems

K Zheng, S Tellex - arXiv preprint arXiv:2004.10099, 2020 - arxiv.org
In this paper, we present pomdp_py, a general purpose Partially Observable Markov
Decision Process (POMDP) library written in Python and Cython. Existing POMDP libraries …