Multi-objective robust strategy synthesis for interval Markov decision processes

EM Hahn, V Hashemi, H Hermanns… - … Evaluation of Systems, 2017 - Springer
International Conference on Quantitative Evaluation of Systems, 2017Springer
Interval Markov decision processes (IMDP s) generalise classical MDPs by having interval-
valued transition probabilities. They provide a powerful modelling tool for probabilistic
systems with an additional variation or uncertainty that prevents the knowledge of the exact
transition probabilities. In this paper, we consider the problem of multi-objective robust
strategy synthesis for interval MDPs, where the aim is to find a robust strategy that
guarantees the satisfaction of multiple properties at the same time in face of the transition …
Abstract
Interval Markov decision processes (IMDPs) generalise classical MDPs by having interval-valued transition probabilities. They provide a powerful modelling tool for probabilistic systems with an additional variation or uncertainty that prevents the knowledge of the exact transition probabilities. In this paper, we consider the problem of multi-objective robust strategy synthesis for interval MDPs, where the aim is to find a robust strategy that guarantees the satisfaction of multiple properties at the same time in face of the transition probability uncertainty. We first show that this problem is PSPACE-hard. Then, we provide a value iteration-based decision algorithm to approximate the Pareto set of achievable points. We finally demonstrate the practical effectiveness of our proposals by applying them on several real-world case studies.
Springer
以上显示的是最相近的搜索结果。 查看全部搜索结果

Google学术搜索按钮

example.edu/paper.pdf
搜索
获取 PDF 文件
引用
References