Search and explore: symbiotic policy synthesis in POMDPs

R Andriushchenko, A Bork, M Češka, S Junges… - … on Computer Aided …, 2023 - Springer
This paper marries two state-of-the-art controller synthesis methods for partially observable
Markov decision processes (POMDPs), a prominent model in sequential decision making …

Automated quantum software engineering

A Sarkar - Automated Software Engineering, 2024 - Springer
As bigger quantum processors with hundreds of qubits become increasingly available, the
potential for quantum computing to solve problems intractable for classical computers is …

Learning Explainable and Better Performing Representations of POMDP Strategies

A Bork, D Chakraborty, K Grover, J Křetínský… - … Conference on Tools …, 2024 - Springer
Strategies for partially observable Markov decision processes (POMDP) typically require
memory. One way to represent this memory is via automata. We present a method to learn …

Weakest precondition inference for non-deterministic linear array programs

S Sumanth Prabhu, D D'Souza, S Chakraborty… - … Conference on Tools …, 2024 - Springer
Precondition inference is an important problem with many applications. Existing
precondition inference techniques for programs with arrays have limited ability to find and …

Robust almost-sure reachability in multi-environment mdps

M van der Vegt, N Jansen, S Junges - … on Tools and Algorithms for the …, 2023 - Springer
Abstract Multiple-environment MDPs (MEMDPs) capture finite sets of MDPs that share the
states but differ in the transition dynamics. These models form a proper subclass of partially …

Tools at the frontiers of quantitative verification: QComp 2023 competition report

R Andriushchenko, A Bork, CE Budde, M Češka… - International …, 2024 - Springer
The analysis of formal models that include quantitative aspects such as timing or
probabilistic choices is performed by quantitative verification tools. Broad and mature tool …

Probabilistic loop synthesis from sequences of moments

M Stankovič, E Bartocci - … on Quantitative Evaluation of Systems and …, 2024 - Springer
Probabilistic program synthesis consists in automatically creating programs generating
random values adhering to specified distributions. We consider here the family of …

[PDF][PDF] Certificates and Witnesses for Probabilistic Model Checking

S Jantsch - 2022 - core.ac.uk
The ability to provide succinct information about why a property does, or does not, hold in a
given system is a key feature in the context of formal verification and model checking. It can …

Policies Grow on Trees: Model Checking Families of MDPs

R Andriushchenko, M Češka, S Junges… - arXiv preprint arXiv …, 2024 - arxiv.org
Markov decision processes (MDPs) provide a fundamental model for sequential decision
making under process uncertainty. A classical synthesis task is to compute for a given MDP …

A PSPACE Algorithm for Almost-Sure Rabin Objectives in Multi-Environment MDPs

M Suilen, M van der Vegt, S Junges - arXiv preprint arXiv:2407.07006, 2024 - arxiv.org
Markov Decision Processes (MDPs) model systems with uncertain transition dynamics.
Multiple-environment MDPs (MEMDPs) extend MDPs. They intuitively reflect finite sets of …