Automatic verification of concurrent stochastic systems

M Kwiatkowska, G Norman, D Parker… - Formal Methods in System …, 2021 - Springer
Automated verification techniques for stochastic games allow formal reasoning about
systems that feature competitive or collaborative behaviour among rational agents in …

Compositional Value Iteration with Pareto Caching

K Watanabe, M Vegt, S Junges, I Hasuo - International Conference on …, 2024 - Springer
The de-facto standard approach in MDP verification is based on value iteration (VI). We
propose compositional VI, a framework for model checking compositional MDPs, that …

[HTML][HTML] Value iteration for simple stochastic games: Stopping criterion and learning algorithm

J Eisentraut, E Kelmendi, J Křetínský… - Information and …, 2022 - Elsevier
The classical problem of reachability in simple stochastic games is typically solved by value
iteration (VI), which produces a sequence of under-approxima-tions of the value of the …

Stopping criteria for value iteration on stochastic games with quantitative objectives

J Křetínský, T Meggendorfer… - 2023 38th Annual ACM …, 2023 - ieeexplore.ieee.org
A classic solution technique for Markov decision processes (MDP) and stochastic games
(SG) is value iteration (VI). Due to its good practical performance, this approximative …

[HTML][HTML] Comparison of algorithms for simple stochastic games

J Křetínský, E Ramneantu, A Slivinskiy… - Information and …, 2022 - Elsevier
Simple stochastic games are turn-based 2½-player zero-sum graph games with a
reachability objective. The problem is to compute the winning probabilities as well as the …

Stochastic games with lexicographic objectives

K Chatterjee, JP Katoen, S Mohr, M Weininger… - Formal Methods in …, 2023 - Springer
We study turn-based stochastic zero-sum games with lexicographic preferences over
objectives. Stochastic games are standard models in control, verification, and synthesis of …

Multi-objective optimization of long-run average and total rewards

T Quatmann, JP Katoen - Tools and Algorithms for the Construction and …, 2021 - Springer
This paper presents an efficient procedure for multi-objective model checking of long-run
average reward (aka: mean pay-off) and total reward objectives as well as their combination …

Verification of multi-objective Markov models

T Quatmann - 2023 - openreview.net
Probabilistische Systeme werden von Umgebungsereignissen beeinflusst, welche mit einer
gewissen Wahrscheinlichkeit auftreten. Damit solche Systeme einwandfrei funktionieren …

Different strokes in randomised strategies: Revisiting Kuhn's theorem under finite-memory assumptions

JCA Main, M Randour - Information and Computation, 2024 - Elsevier
Two-player (antagonistic) games on (possibly stochastic) graphs are a prevalent model in
theoretical computer science, notably as a framework for reactive synthesis. Optimal …

Widest paths and global propagation in bounded value iteration for stochastic games

K Phalakarn, T Takisaka, T Haas, I Hasuo - … Los Angeles, CA, USA, July 21 …, 2020 - Springer
Solving stochastic games with the reachability objective is a fundamental problem,
especially in quantitative verification and synthesis. For this purpose, bounded value …