Formal synthesis of controllers for safety-critical autonomous systems: Developments and challenges

X Yin, B Gao, X Yu - Annual Reviews in Control, 2024 - Elsevier
In recent years, formal methods have been extensively used in the design of autonomous
systems. By employing mathematically rigorous techniques, formal methods can provide …

A practitioner's guide to MDP model checking algorithms

A Hartmanns, S Junges, T Quatmann… - … Conference on Tools …, 2023 - Springer
Abstract Model checking undiscounted reachability and expected-reward properties on
Markov decision processes (MDPs) is key for the verification of systems that act under …

[HTML][HTML] Value iteration for simple stochastic games: Stopping criterion and learning algorithm

J Eisentraut, E Kelmendi, J Křetínský… - Information and …, 2022 - Elsevier
The classical problem of reachability in simple stochastic games is typically solved by value
iteration (VI), which produces a sequence of under-approxima-tions of the value of the …

Stopping criteria for value iteration on stochastic games with quantitative objectives

J Křetínský, T Meggendorfer… - 2023 38th Annual ACM …, 2023 - ieeexplore.ieee.org
A classic solution technique for Markov decision processes (MDP) and stochastic games
(SG) is value iteration (VI). Due to its good practical performance, this approximative …

Optimistic and topological value iteration for simple stochastic games

M Azeem, A Evangelidis, J Křetínský… - … for Verification and …, 2022 - Springer
While value iteration (VI) is a standard solution approach to simple stochastic games
(SSGs), it suffered from the lack of a stopping criterion. Recently, several solutions have …

Multi-agent verification and control with probabilistic model checking

D Parker - International Conference on Quantitative Evaluation of …, 2023 - Springer
Probabilistic model checking is a technique for formal automated reasoning about software
or hardware systems that operate in the context of uncertainty or stochasticity. It builds upon …

Symbolic verification and strategy synthesis for turn-based stochastic games

M Kwiatkowska, G Norman, D Parker… - Principles of Systems …, 2022 - Springer
Stochastic games are a convenient formalism for modelling systems that comprise rational
agents competing or collaborating within uncertain environments. Probabilistic model …

[HTML][HTML] Strategy synthesis for zero-sum neuro-symbolic concurrent stochastic games

R Yan, G Santos, G Norman, D Parker… - Information and …, 2024 - Elsevier
Neuro-symbolic approaches to artificial intelligence, which combine neural networks with
classical symbolic techniques, are growing in prominence, necessitating formal approaches …

A generic strategy improvement method for simple stochastic games

D Auger, XB de Montjoye, Y Strozecki - arXiv preprint arXiv:2102.04922, 2021 - arxiv.org
We present a generic strategy iteration algorithm (GSIA) to find an optimal strategy of a
simple stochastic game (SSG). We prove the correctness of GSIA, and derive a general …

Playing Games with Your PET: Extending the Partial Exploration Tool to Stochastic Games

T Meggendorfer, M Weininger - International Conference on Computer …, 2024 - Springer
We present version 2.0 of the Partial Exploration Tool (Pet), a tool for verification of
probabilistic systems. We extend the previous version by adding support for stochastic …