Automatic verification of concurrent stochastic systems
Automated verification techniques for stochastic games allow formal reasoning about
systems that feature competitive or collaborative behaviour among rational agents in …
systems that feature competitive or collaborative behaviour among rational agents in …
Compositional Value Iteration with Pareto Caching
The de-facto standard approach in MDP verification is based on value iteration (VI). We
propose compositional VI, a framework for model checking compositional MDPs, that …
propose compositional VI, a framework for model checking compositional MDPs, that …
[HTML][HTML] Value iteration for simple stochastic games: Stopping criterion and learning algorithm
J Eisentraut, E Kelmendi, J Křetínský… - Information and …, 2022 - Elsevier
The classical problem of reachability in simple stochastic games is typically solved by value
iteration (VI), which produces a sequence of under-approxima-tions of the value of the …
iteration (VI), which produces a sequence of under-approxima-tions of the value of the …
Stopping criteria for value iteration on stochastic games with quantitative objectives
J Křetínský, T Meggendorfer… - 2023 38th Annual ACM …, 2023 - ieeexplore.ieee.org
A classic solution technique for Markov decision processes (MDP) and stochastic games
(SG) is value iteration (VI). Due to its good practical performance, this approximative …
(SG) is value iteration (VI). Due to its good practical performance, this approximative …
[HTML][HTML] Comparison of algorithms for simple stochastic games
J Křetínský, E Ramneantu, A Slivinskiy… - Information and …, 2022 - Elsevier
Simple stochastic games are turn-based 2½-player zero-sum graph games with a
reachability objective. The problem is to compute the winning probabilities as well as the …
reachability objective. The problem is to compute the winning probabilities as well as the …
Stochastic games with lexicographic objectives
We study turn-based stochastic zero-sum games with lexicographic preferences over
objectives. Stochastic games are standard models in control, verification, and synthesis of …
objectives. Stochastic games are standard models in control, verification, and synthesis of …
Multi-objective optimization of long-run average and total rewards
T Quatmann, JP Katoen - Tools and Algorithms for the Construction and …, 2021 - Springer
This paper presents an efficient procedure for multi-objective model checking of long-run
average reward (aka: mean pay-off) and total reward objectives as well as their combination …
average reward (aka: mean pay-off) and total reward objectives as well as their combination …
Verification of multi-objective Markov models
T Quatmann - 2023 - openreview.net
Probabilistische Systeme werden von Umgebungsereignissen beeinflusst, welche mit einer
gewissen Wahrscheinlichkeit auftreten. Damit solche Systeme einwandfrei funktionieren …
gewissen Wahrscheinlichkeit auftreten. Damit solche Systeme einwandfrei funktionieren …
Different strokes in randomised strategies: Revisiting Kuhn's theorem under finite-memory assumptions
Two-player (antagonistic) games on (possibly stochastic) graphs are a prevalent model in
theoretical computer science, notably as a framework for reactive synthesis. Optimal …
theoretical computer science, notably as a framework for reactive synthesis. Optimal …
Widest paths and global propagation in bounded value iteration for stochastic games
Solving stochastic games with the reachability objective is a fundamental problem,
especially in quantitative verification and synthesis. For this purpose, bounded value …
especially in quantitative verification and synthesis. For this purpose, bounded value …