A practitioner's guide to MDP model checking algorithms

A Hartmanns, S Junges, T Quatmann… - … Conference on Tools …, 2023 - Springer
Abstract Model checking undiscounted reachability and expected-reward properties on
Markov decision processes (MDPs) is key for the verification of systems that act under …

Stopping criteria for value iteration on stochastic games with quantitative objectives

J Křetínský, T Meggendorfer… - 2023 38th Annual ACM …, 2023 - ieeexplore.ieee.org
A classic solution technique for Markov decision processes (MDP) and stochastic games
(SG) is value iteration (VI). Due to its good practical performance, this approximative …

Optimistic and topological value iteration for simple stochastic games

M Azeem, A Evangelidis, J Křetínský… - … for Verification and …, 2022 - Springer
While value iteration (VI) is a standard solution approach to simple stochastic games
(SSGs), it suffered from the lack of a stopping criterion. Recently, several solutions have …

Multi-agent verification and control with probabilistic model checking

D Parker - International Conference on Quantitative Evaluation of …, 2023 - Springer
Probabilistic model checking is a technique for formal automated reasoning about software
or hardware systems that operate in the context of uncertainty or stochasticity. It builds upon …

[HTML][HTML] Strategy synthesis for zero-sum neuro-symbolic concurrent stochastic games

R Yan, G Santos, G Norman, D Parker… - Information and …, 2024 - Elsevier
Neuro-symbolic approaches to artificial intelligence, which combine neural networks with
classical symbolic techniques, are growing in prominence, necessitating formal approaches …

[HTML][HTML] Entropic risk for turn-based stochastic games

C Baier, K Chatterjee, T Meggendorfer… - Information and …, 2024 - Elsevier
Entropic risk (ERisk) is an established risk measure in finance, quantifying risk by an
exponential re-weighting of rewards. We study ERisk for the first time in the context of turn …

Playing Games with Your PET: Extending the Partial Exploration Tool to Stochastic Games

T Meggendorfer, M Weininger - International Conference on Computer …, 2024 - Springer
We present version 2.0 of the Partial Exploration Tool (Pet), a tool for verification of
probabilistic systems. We extend the previous version by adding support for stochastic …

Learning Algorithms for Verification of Markov Decision Processes

T Brázdil, K Chatterjee, M Chmelik, V Forejt… - arXiv preprint arXiv …, 2024 - arxiv.org
We present a general framework for applying learning algorithms and heuristical guidance
to the verification of Markov decision processes (MDPs), based on the ideas of Br\'azdil, T. et …

Efficient Formally Verified Maximal End Component Decomposition for MDPs

A Hartmanns, B Kohlen, P Lammich - International Symposium on Formal …, 2024 - Springer
Identifying a Markov decision process's maximal end components is a prerequisite for
applying sound probabilistic model checking algorithms. In this paper, we present the first …

Tools at the Frontiers of Quantitative Verification

R Andriushchenko, A Bork, CE Budde, M Češka… - arXiv preprint arXiv …, 2024 - arxiv.org
The analysis of formal models that include quantitative aspects such as timing or
probabilistic choices is performed by quantitative verification tools. Broad and mature tool …