Probabilistic model checking and autonomy
M Kwiatkowska, G Norman… - Annual review of control …, 2022 - annualreviews.org
The design and control of autonomous systems that operate in uncertain or adversarial
environments can be facilitated by formal modeling and analysis. Probabilistic model …
environments can be facilitated by formal modeling and analysis. Probabilistic model …
PRISM-games 3.0: Stochastic game verification with concurrency, equilibria and time
We present a major new release of the PRISM-games model checker, featuring multiple
significant advances in its support for verification and strategy synthesis of stochastic games …
significant advances in its support for verification and strategy synthesis of stochastic games …
A practitioner's guide to MDP model checking algorithms
Abstract Model checking undiscounted reachability and expected-reward properties on
Markov decision processes (MDPs) is key for the verification of systems that act under …
Markov decision processes (MDPs) is key for the verification of systems that act under …
Optimistic value iteration
A Hartmanns, BL Kaminski - International Conference on Computer Aided …, 2020 - Springer
Markov decision processes are widely used for planning and verification in settings that
combine controllable or adversarial choices with probabilistic behaviour. The standard …
combine controllable or adversarial choices with probabilistic behaviour. The standard …
PAC statistical model checking for Markov decision processes and stochastic games
Statistical model checking (SMC) is a technique for analysis of probabilistic systems that
may be (partially) unknown. We present an SMC algorithm for (unbounded) reachability …
may be (partially) unknown. We present an SMC algorithm for (unbounded) reachability …
On correctness, precision, and performance in quantitative verification: QComp 2020 competition report
Quantitative verification tools compute probabilities, expected rewards, or steady-state
values for formal models of stochastic and timed systems. Exact results often cannot be …
values for formal models of stochastic and timed systems. Exact results often cannot be …
Automatic verification of concurrent stochastic systems
Automated verification techniques for stochastic games allow formal reasoning about
systems that feature competitive or collaborative behaviour among rational agents in …
systems that feature competitive or collaborative behaviour among rational agents in …
[HTML][HTML] Value iteration for simple stochastic games: Stopping criterion and learning algorithm
J Eisentraut, E Kelmendi, J Křetínský… - Information and …, 2022 - Elsevier
The classical problem of reachability in simple stochastic games is typically solved by value
iteration (VI), which produces a sequence of under-approxima-tions of the value of the …
iteration (VI), which produces a sequence of under-approxima-tions of the value of the …
Equilibria-based probabilistic model checking for concurrent stochastic games
Probabilistic model checking for stochastic games enables formal verification of systems that
comprise competing or collaborating entities operating in a stochastic environment. Despite …
comprise competing or collaborating entities operating in a stochastic environment. Despite …
Matrix norm based hybrid Shapley and iterative methods for the solution of stochastic matrix games
In this paper, we present four alternative solution methods to Shapley iteration for the
solution of stochastic matrix games. We first combine the extended matrix norm method for …
solution of stochastic matrix games. We first combine the extended matrix norm method for …