A practitioner's guide to MDP model checking algorithms
Abstract Model checking undiscounted reachability and expected-reward properties on
Markov decision processes (MDPs) is key for the verification of systems that act under …
Markov decision processes (MDPs) is key for the verification of systems that act under …
Stopping criteria for value iteration on stochastic games with quantitative objectives
J Křetínský, T Meggendorfer… - 2023 38th Annual ACM …, 2023 - ieeexplore.ieee.org
A classic solution technique for Markov decision processes (MDP) and stochastic games
(SG) is value iteration (VI). Due to its good practical performance, this approximative …
(SG) is value iteration (VI). Due to its good practical performance, this approximative …
Optimistic and topological value iteration for simple stochastic games
While value iteration (VI) is a standard solution approach to simple stochastic games
(SSGs), it suffered from the lack of a stopping criterion. Recently, several solutions have …
(SSGs), it suffered from the lack of a stopping criterion. Recently, several solutions have …
Multi-agent verification and control with probabilistic model checking
D Parker - International Conference on Quantitative Evaluation of …, 2023 - Springer
Probabilistic model checking is a technique for formal automated reasoning about software
or hardware systems that operate in the context of uncertainty or stochasticity. It builds upon …
or hardware systems that operate in the context of uncertainty or stochasticity. It builds upon …
[HTML][HTML] Strategy synthesis for zero-sum neuro-symbolic concurrent stochastic games
Neuro-symbolic approaches to artificial intelligence, which combine neural networks with
classical symbolic techniques, are growing in prominence, necessitating formal approaches …
classical symbolic techniques, are growing in prominence, necessitating formal approaches …
[HTML][HTML] Entropic risk for turn-based stochastic games
Entropic risk (ERisk) is an established risk measure in finance, quantifying risk by an
exponential re-weighting of rewards. We study ERisk for the first time in the context of turn …
exponential re-weighting of rewards. We study ERisk for the first time in the context of turn …
Playing Games with Your PET: Extending the Partial Exploration Tool to Stochastic Games
T Meggendorfer, M Weininger - International Conference on Computer …, 2024 - Springer
We present version 2.0 of the Partial Exploration Tool (Pet), a tool for verification of
probabilistic systems. We extend the previous version by adding support for stochastic …
probabilistic systems. We extend the previous version by adding support for stochastic …
Learning Algorithms for Verification of Markov Decision Processes
We present a general framework for applying learning algorithms and heuristical guidance
to the verification of Markov decision processes (MDPs), based on the ideas of Br\'azdil, T. et …
to the verification of Markov decision processes (MDPs), based on the ideas of Br\'azdil, T. et …
Efficient Formally Verified Maximal End Component Decomposition for MDPs
Identifying a Markov decision process's maximal end components is a prerequisite for
applying sound probabilistic model checking algorithms. In this paper, we present the first …
applying sound probabilistic model checking algorithms. In this paper, we present the first …
Tools at the Frontiers of Quantitative Verification
The analysis of formal models that include quantitative aspects such as timing or
probabilistic choices is performed by quantitative verification tools. Broad and mature tool …
probabilistic choices is performed by quantitative verification tools. Broad and mature tool …