Automatic verification of competitive stochastic systems
We present automatic verification techniques for the modelling and analysis of probabilistic
systems that incorporate competitive behaviour. These systems are modelled as turn-based …
systems that incorporate competitive behaviour. These systems are modelled as turn-based …
PAC statistical model checking for Markov decision processes and stochastic games
Statistical model checking (SMC) is a technique for analysis of probabilistic systems that
may be (partially) unknown. We present an SMC algorithm for (unbounded) reachability …
may be (partially) unknown. We present an SMC algorithm for (unbounded) reachability …
PRISM-games: verification and strategy synthesis for stochastic multi-player games with multiple objectives
M Kwiatkowska, D Parker, C Wiltsche - International Journal on Software …, 2018 - Springer
PRISM-games is a tool for modelling, verification and strategy synthesis for stochastic multi-
player games. These allow models to incorporate both probability, to represent uncertainty …
player games. These allow models to incorporate both probability, to represent uncertainty …
Simple strategies in multi-objective MDPs
We consider the verification of multiple expected reward objectives at once on Markov
decision processes (MDPs). This enables a trade-off analysis among multiple objectives by …
decision processes (MDPs). This enables a trade-off analysis among multiple objectives by …
Formal verification of bayesian mechanisms
In this paper, for the first time, we study the formal verification of Bayesian mechanisms
through strategic reasoning. We rely on the framework of Probabilistic Strategy Logic (PSL) …
through strategic reasoning. We rely on the framework of Probabilistic Strategy Logic (PSL) …
[HTML][HTML] Value iteration for simple stochastic games: Stopping criterion and learning algorithm
J Eisentraut, E Kelmendi, J Křetínský… - Information and …, 2022 - Elsevier
The classical problem of reachability in simple stochastic games is typically solved by value
iteration (VI), which produces a sequence of under-approxima-tions of the value of the …
iteration (VI), which produces a sequence of under-approxima-tions of the value of the …
Permissive controller synthesis for probabilistic systems
We propose novel controller synthesis techniques for probabilistic systems modelled using
stochastic two-player games: one player acts as a controller, the second represents its …
stochastic two-player games: one player acts as a controller, the second represents its …
Value iteration for simple stochastic games: Stopping criterion and learning algorithm
E Kelmendi, J Krämer, J Křetínský… - … conference on computer …, 2018 - Springer
Simple stochastic games can be solved by value iteration (VI), which yields a sequence of
under-approximations of the value of the game. This sequence is guaranteed to converge to …
under-approximations of the value of the game. This sequence is guaranteed to converge to …
Model checking for adversarial multi-agent reinforcement learning with reactive defense methods
Cooperative multi-agent reinforcement learning (CMARL) enables agents to achieve a
common objective. However, the safety (aka robustness) of the CMARL agents operating in …
common objective. However, the safety (aka robustness) of the CMARL agents operating in …
Strategic abilities of forgetful agents in stochastic environments
In this paper, we investigate the probabilistic variants of the strategy logics ATL and ATL*
under imperfect information. Specifically, we present novel decidability and complexity …
under imperfect information. Specifically, we present novel decidability and complexity …