Automatic verification of competitive stochastic systems

T Chen, V Forejt, M Kwiatkowska, D Parker… - Formal Methods in …, 2013 - Springer
We present automatic verification techniques for the modelling and analysis of probabilistic
systems that incorporate competitive behaviour. These systems are modelled as turn-based …

PAC statistical model checking for Markov decision processes and stochastic games

P Ashok, J Křetínský, M Weininger - … Conference, CAV 2019, New York City …, 2019 - Springer
Statistical model checking (SMC) is a technique for analysis of probabilistic systems that
may be (partially) unknown. We present an SMC algorithm for (unbounded) reachability …

PRISM-games: verification and strategy synthesis for stochastic multi-player games with multiple objectives

M Kwiatkowska, D Parker, C Wiltsche - International Journal on Software …, 2018 - Springer
PRISM-games is a tool for modelling, verification and strategy synthesis for stochastic multi-
player games. These allow models to incorporate both probability, to represent uncertainty …

Simple strategies in multi-objective MDPs

F Delgrange, JP Katoen, T Quatmann… - … Conference on Tools …, 2020 - Springer
We consider the verification of multiple expected reward objectives at once on Markov
decision processes (MDPs). This enables a trade-off analysis among multiple objectives by …

Formal verification of bayesian mechanisms

M Mittelmann, B Maubert, A Murano… - Proceedings of the AAAI …, 2023 - ojs.aaai.org
In this paper, for the first time, we study the formal verification of Bayesian mechanisms
through strategic reasoning. We rely on the framework of Probabilistic Strategy Logic (PSL) …

[HTML][HTML] Value iteration for simple stochastic games: Stopping criterion and learning algorithm

J Eisentraut, E Kelmendi, J Křetínský… - Information and …, 2022 - Elsevier
The classical problem of reachability in simple stochastic games is typically solved by value
iteration (VI), which produces a sequence of under-approxima-tions of the value of the …

Permissive controller synthesis for probabilistic systems

K Drager, V Forejt, M Kwiatkowska… - Logical Methods in …, 2015 - lmcs.episciences.org
We propose novel controller synthesis techniques for probabilistic systems modelled using
stochastic two-player games: one player acts as a controller, the second represents its …

Value iteration for simple stochastic games: Stopping criterion and learning algorithm

E Kelmendi, J Krämer, J Křetínský… - … conference on computer …, 2018 - Springer
Simple stochastic games can be solved by value iteration (VI), which yields a sequence of
under-approximations of the value of the game. This sequence is guaranteed to converge to …

Model checking for adversarial multi-agent reinforcement learning with reactive defense methods

D Gross, C Schmidl, N Jansen, GA Pérez - Proceedings of the …, 2023 - ojs.aaai.org
Cooperative multi-agent reinforcement learning (CMARL) enables agents to achieve a
common objective. However, the safety (aka robustness) of the CMARL agents operating in …

Strategic abilities of forgetful agents in stochastic environments

F Belardinelli, W Jamroga, M Mittelmann… - arXiv preprint arXiv …, 2023 - arxiv.org
In this paper, we investigate the probabilistic variants of the strategy logics ATL and ATL*
under imperfect information. Specifically, we present novel decidability and complexity …