Parameter synthesis in markov models: A gentle survey

N Jansen, S Junges, JP Katoen - … of Systems Design: Essays Dedicated to …, 2022 - Springer
This paper surveys the analysis of parametric Markov models whose transitions are labelled
with functions over a finite set of parameters. These models are symbolic representations of …

Probabilistic program verification via inductive synthesis of inductive invariants

K Batz, M Chen, S Junges, BL Kaminski… - … Conference on Tools …, 2023 - Springer
Essential tasks for the verification of probabilistic programs include bounding expected
outcomes and proving termination in finite expected runtime. We contribute a simple yet …

Search and explore: symbiotic policy synthesis in POMDPs

R Andriushchenko, A Bork, M Češka, S Junges… - … on Computer Aided …, 2023 - Springer
This paper marries two state-of-the-art controller synthesis methods for partially observable
Markov decision processes (POMDPs), a prominent model in sequential decision making …

PAYNT: A tool for inductive synthesis of probabilistic programs

R Andriushchenko, M Češka, S Junges… - … on Computer Aided …, 2021 - Springer
This paper presents PAYNT, a tool to automatically synthesise probabilistic programs.
PAYNT enables the synthesis of finite-state probabilistic programs from a program sketch …

Abstraction-refinement for hierarchical probabilistic models

S Junges, MTJ Spaan - International Conference on Computer Aided …, 2022 - Springer
Markov decision processes are a ubiquitous formalism for modelling systems with non-
deterministic and probabilistic behavior. Verification of these models is subject to the famous …

Gradient-descent for randomized controllers under partial observability

L Heck, J Spel, S Junges, J Moerman… - … Conference on Verification …, 2022 - Springer
Randomization is a powerful technique to create robust controllers, in particular in partially
observable settings. The degrees of randomization have a significant impact on the system …

Deterministic training of generative autoencoders using invertible layers

G Silvestri, D Roos, L Ambrogioni - arXiv preprint arXiv:2205.09546, 2022 - arxiv.org
In this work, we provide a deterministic alternative to the stochastic variational training of
generative autoencoders. We refer to these new generative autoencoders as AutoEncoders …

Probabilistic loop synthesis from sequences of moments

M Stankovič, E Bartocci - … on Quantitative Evaluation of Systems and …, 2024 - Springer
Probabilistic program synthesis consists in automatically creating programs generating
random values adhering to specified distributions. We consider here the family of …

[PDF][PDF] Certificates and Witnesses for Probabilistic Model Checking

S Jantsch - 2022 - core.ac.uk
The ability to provide succinct information about why a property does, or does not, hold in a
given system is a key feature in the context of formal verification and model checking. It can …

Policies Grow on Trees: Model Checking Families of MDPs

R Andriushchenko, M Češka, S Junges… - arXiv preprint arXiv …, 2024 - arxiv.org
Markov decision processes (MDPs) provide a fundamental model for sequential decision
making under process uncertainty. A classical synthesis task is to compute for a given MDP …