Parameter synthesis in markov models: A gentle survey

N Jansen, S Junges, JP Katoen - … of Systems Design: Essays Dedicated to …, 2022 - Springer
This paper surveys the analysis of parametric Markov models whose transitions are labelled
with functions over a finite set of parameters. These models are symbolic representations of …

Parameter Synthesis for Markov Models: Covering the Parameter Space

S Junges, E Ábrahám, C Hensel, N Jansen… - arXiv preprint arXiv …, 2019 - arxiv.org
Markov chain analysis is a key technique in formal verification. A practical obstacle is that all
probabilities in Markov models need to be known. However, system quantities such as …

Sampling-based verification of CTMCs with uncertain rates

TS Badings, N Jansen, S Junges, M Stoelinga… - … on Computer Aided …, 2022 - Springer
We employ uncertain parametric CTMCs with parametric transition rates and a prior on the
parameter values. The prior encodes uncertainty about the actual transition rates, while the …

Qualitative and quantitative monitoring of spatio-temporal properties with SSTL

L Nenzi, L Bortolussi, V Ciancia… - Logical Methods in …, 2018 - lmcs.episciences.org
In spatially located, large scale systems, time and space dynamics interact and drives the
behaviour. Examples of such systems can be found in many smart city applications and …

Mining road traffic rules with signal temporal logic and grammar-based genetic programming

F Pigozzi, E Medvet, L Nenzi - Applied Sciences, 2021 - mdpi.com
Traffic systems, where human and autonomous drivers interact, are a very relevant instance
of complex systems and produce behaviors that can be regarded as trajectories over time …

Convex optimization for parameter synthesis in MDPs

M Cubuktepe, N Jansen, S Junges… - … on Automatic Control, 2021 - ieeexplore.ieee.org
Probabilistic model-checking aims to prove whether a Markov decision process (MDP)
satisfies a temporal logic specification. The underlying methods rely on an often unrealistic …

The complexity of reachability in parametric Markov decision processes

S Junges, JP Katoen, GA Pérez, T Winkler - Journal of Computer and …, 2021 - Elsevier
This article presents the complexity of reachability decision problems for parametric Markov
decision processes (pMDPs), an extension to Markov decision processes (MDPs) where …

Scenario-based verification of uncertain parametric MDPs

T Badings, M Cubuktepe, N Jansen, S Junges… - International Journal on …, 2022 - Springer
We consider parametric Markov decision processes (pMDPs) that are augmented with
unknown probability distributions over parameter values. The problem is to compute the …

On the complexity of reachability in parametric markov decision processes

T Winkler, S Junges, GA Pérez, JP Katoen - arXiv preprint arXiv …, 2019 - arxiv.org
This paper studies parametric Markov decision processes (pMDPs), an extension to Markov
decision processes (MDPs) where transitions probabilities are described by polynomials …

Scenario-based verification of uncertain MDPs

M Cubuktepe, N Jansen, S Junges, JP Katoen… - … conference on tools and …, 2020 - Springer
We consider Markov decision processes (MDPs) in which the transition probabilities and
rewards belong to an uncertainty set parametrized by a collection of random variables. The …