Probabilistic model checking and autonomy

M Kwiatkowska, G Norman… - Annual review of control …, 2022 - annualreviews.org
The design and control of autonomous systems that operate in uncertain or adversarial
environments can be facilitated by formal modeling and analysis. Probabilistic model …

PRISM-games 3.0: Stochastic game verification with concurrency, equilibria and time

M Kwiatkowska, G Norman, D Parker… - … Aided Verification: 32nd …, 2020 - Springer
We present a major new release of the PRISM-games model checker, featuring multiple
significant advances in its support for verification and strategy synthesis of stochastic games …

A practitioner's guide to MDP model checking algorithms

A Hartmanns, S Junges, T Quatmann… - … Conference on Tools …, 2023 - Springer
Abstract Model checking undiscounted reachability and expected-reward properties on
Markov decision processes (MDPs) is key for the verification of systems that act under …

Optimistic value iteration

A Hartmanns, BL Kaminski - International Conference on Computer Aided …, 2020 - Springer
Markov decision processes are widely used for planning and verification in settings that
combine controllable or adversarial choices with probabilistic behaviour. The standard …

PAC statistical model checking for Markov decision processes and stochastic games

P Ashok, J Křetínský, M Weininger - … Conference, CAV 2019, New York City …, 2019 - Springer
Statistical model checking (SMC) is a technique for analysis of probabilistic systems that
may be (partially) unknown. We present an SMC algorithm for (unbounded) reachability …

On correctness, precision, and performance in quantitative verification: QComp 2020 competition report

CE Budde, A Hartmanns, M Klauck, J Křetínský… - … applications of formal …, 2020 - Springer
Quantitative verification tools compute probabilities, expected rewards, or steady-state
values for formal models of stochastic and timed systems. Exact results often cannot be …

Automatic verification of concurrent stochastic systems

M Kwiatkowska, G Norman, D Parker… - Formal Methods in System …, 2021 - Springer
Automated verification techniques for stochastic games allow formal reasoning about
systems that feature competitive or collaborative behaviour among rational agents in …

[HTML][HTML] Value iteration for simple stochastic games: Stopping criterion and learning algorithm

J Eisentraut, E Kelmendi, J Křetínský… - Information and …, 2022 - Elsevier
The classical problem of reachability in simple stochastic games is typically solved by value
iteration (VI), which produces a sequence of under-approxima-tions of the value of the …

Equilibria-based probabilistic model checking for concurrent stochastic games

M Kwiatkowska, G Norman, D Parker… - … Symposium on Formal …, 2019 - Springer
Probabilistic model checking for stochastic games enables formal verification of systems that
comprise competing or collaborating entities operating in a stochastic environment. Despite …

Matrix norm based hybrid Shapley and iterative methods for the solution of stochastic matrix games

B İzgi, M Özkaya, NK Üre, M Perc - Applied Mathematics and Computation, 2024 - Elsevier
In this paper, we present four alternative solution methods to Shapley iteration for the
solution of stochastic matrix games. We first combine the extended matrix norm method for …