Verification of indefinite-horizon POMDPs

A Bork, S Junges, JP Katoen, T Quatmann - … Technology for Verification …, 2020 - Springer
… However, those verification results are often overly pessimistic. … The verification problem for
POMDPs with indefinite horizon … Nevertheless, the analysis of POMDPs is a vibrant research …

[PDF][PDF] Indefinite-horizon POMDPs with action-based termination

EA Hansen - AAAI, 2007 - cdn.aaai.org
… are difficult or impossible to verify in practice, its applicability is questionable. In the rest of
this paper, we consider an alternative model of indefinite-horizon POMDPs that does not rely …

Inductive synthesis of finite-state controllers for POMDPs

R Andriushchenko, M Češka… - Uncertainty in …, 2022 - proceedings.mlr.press
… We use an evaluation framework that supports indefinite horizon queries, eg, queries with a
… of our approach using benchmarks from the verification literature. While the comparison with …

Verification of Indefinite-Horizon POMDPs

T Quatmann - Automated Technology for Verification and Analysis - Springer
… The verification problem for POMDPs with indefinite horizon specifications such as …
Nevertheless, the analysis of POMDPs is a vibrant research area. Traditionally, the focus has been …

[PDF][PDF] Achieving goals in decentralized POMDPs

C Amato, S Zilberstein - … of The 8th International Conference on …, 2009 - ifaamas.org
… to model these problems as indefinite-horizon decentralized POMDPs, suitable for many …
We then provide the DEC-POMDP model and an algorithm to solve it, including a proof that …

Sound Heuristic Search Value Iteration for Undiscounted POMDPs with Reachability Objectives

QH Ho, MS Feather, F Rossi, ZN Sunberg… - arXiv preprint arXiv …, 2024 - arxiv.org
… problem in POMDPs known as the (indefinite-horizon) … This is also a core problem in model
checking with logical … probabilities of POMDPs in an anytime manner, (iii) proof of asymptotic …

Under-approximating expected total rewards in POMDPs

A Bork, JP Katoen, T Quatmann - … Conference on Tools and Algorithms for …, 2022 - Springer
POMDP below a given threshold? We thus consider an infinite-horizon objective without
discounting—also called an indefinite-horizon … value function in model checking of POMDPs [8]. …

Indefinite-horizon reachability in Goal-DEC-POMDPs

K Chatterjee, M Chmelík - Proceedings of the International Conference …, 2016 - ojs.aaai.org
Indefinite-horizon objectives. In this work we consider DEC-POMDPs with indefinite-horizon
objectives. We consider DEC-POMDPs with a set of target (or goal) states, and a cost …

Correct-by-construction policies for POMDPs

N Jansen, S Junges, JP Katoen, T Quatmann… - Proceedings of the Fifth …, 2019 - dl.acm.org
… The underlying method is achieved via a marriage of formal verification and … POMDPs.
We require these FSCs to be provably correct for given specifications such as indefinite-horizon

[PDF][PDF] Goal-HSVI: Heuristic Search Value Iteration for Goal POMDPs.

K Horák, B Bosanský, K Chatterjee - IJCAI, 2018 - ijcai.org
… However, using any fixed depth limit for all indefinitehorizon POMDPs is not sound (consider
a POMDP where more than 200 precisely timed steps have to be taken to reach the goal). …