The probabilistic model checker Storm

C Hensel, S Junges, JP Katoen, T Quatmann… - International Journal on …, 2022 - Springer
We present the probabilistic model checker Storm. Storm supports the analysis of discrete-
and continuous-time variants of both Markov chains and Markov decision processes. Storm …

A practitioner's guide to MDP model checking algorithms

A Hartmanns, S Junges, T Quatmann… - … Conference on Tools …, 2023 - Springer
Abstract Model checking undiscounted reachability and expected-reward properties on
Markov decision processes (MDPs) is key for the verification of systems that act under …

[HTML][HTML] Evaluating railway junction infrastructure: A queueing-based, timetable-independent analysis

T Emunds, N Nießen - Transportation Research Part C: Emerging …, 2024 - Elsevier
Many infrastructure managers have the goal to increase the capacity of their railway
infrastructure due to an increasing demand. While methods for performance calculations of …

Compositional value iteration with pareto caching

K Watanabe, M Vegt, S Junges, I Hasuo - International Conference on …, 2024 - Springer
The de-facto standard approach in MDP verification is based on value iteration (VI). We
propose compositional VI, a framework for model checking compositional MDPs, that …

Model checking finite-horizon Markov chains with probabilistic inference

S Holtzen, S Junges, M Vazquez-Chanlatte… - … on Computer Aided …, 2021 - Springer
We revisit the symbolic verification of Markov chains with respect to finite horizon
reachability properties. The prevalent approach iteratively computes step-bounded state …

Tools at the frontiers of quantitative verification: QComp 2023 competition report

R Andriushchenko, A Bork, CE Budde, M Češka… - International …, 2024 - Springer
The analysis of formal models that include quantitative aspects such as timing or
probabilistic choices is performed by quantitative verification tools. Broad and mature tool …

Pareto Curves for Compositionally Model Checking String Diagrams of MDPs

K Watanabe, M van der Vegt, I Hasuo, J Rot… - … Conference on Tools …, 2024 - Springer
Computing schedulers that optimize reachability probabilities in MDPs is a standard
verification task. To address scalability concerns, we focus on MDPs that are compositionally …

Towards verifying robotic systems using statistical model checking in STORM

M Lampacrescia, M Klauck, M Palmas - … on Bridging the Gap between AI …, 2024 - Springer
Robust autonomy and interaction of robots with their environment, even in rare or new
situations, is an ultimate goal of robotics research. We settle on Statistical Model Checking …

Distillation of rl policies with formal guarantees via variational abstraction of markov decision processes

F Delgrange, A Nowé, GA Pérez - … of the AAAI Conference on Artificial …, 2022 - ojs.aaai.org
We consider the challenge of policy simplification and verification in the context of policies
learned through reinforcement learning (RL) in continuous environments. In well-behaved …

Correct probabilistic model checking with floating-point arithmetic

A Hartmanns - International Conference on Tools and Algorithms for …, 2022 - Springer
Probabilistic model checking computes probabilities and expected values related to
designated behaviours of interest in Markov models. As a formal verification approach, it is …