[PDF][PDF] Metrics for Finite Markov Decision Processes.

N Ferns, P Panangaden, D Precup - UAI, 2004 - cdn.aaai.org
Markov decision processes (MDPs) offer a popular mathematical tool for planning and
learning in the presence of uncertainty (Boutilier, Dean, & Hanks 1999). MDPs are a …

The Kantorovich metric in computer science: A brief survey

Y Deng, W Du - Electronic Notes in Theoretical Computer Science, 2009 - Elsevier
In contrast to its wealth of applications in mathematics, the Kantorovich metric started to be
noticed in computer science only in recent years. We give a brief survey of its applications in …

Bisimulation metrics for continuous Markov decision processes

N Ferns, P Panangaden, D Precup - SIAM Journal on Computing, 2011 - SIAM
In recent years, various metrics have been developed for measuring the behavioral similarity
of states in probabilistic transition systems [J. Desharnais et al., Proceedings of …

Discounting the future in systems theory

L De Alfaro, TA Henzinger, R Majumdar - International Colloquium on …, 2003 - Springer
Discounting the future means that the value, today, of a unit payoffis 1 if the payoffo ccurs
today, a if it occurs tomorrow, a 2 if it occurs the day after tomorrow, and so on, for some real …

Approximate analysis of probabilistic processes: Logic, simulation and games

J Desharnais, F Laviolette… - 2008 Fifth International …, 2008 - ieeexplore.ieee.org
We tackle the problem of non robustness of simulation and bisimulation when dealing with
probabilistic processes. It is important to ignore tiny deviations in probabilities because …

A semantic account of metric preservation

A Azevedo de Amorim, M Gaboardi, J Hsu… - ACM SIGPLAN …, 2017 - dl.acm.org
Program sensitivity measures how robust a program is to small changes in its input, and is a
fundamental notion in domains ranging from differential privacy to cyber-physical systems. A …

Parametric probabilistic transition systems for system design and analysis

R Lanotte, A Maggiolo-Schettini, A Troina - Formal Aspects of Computing, 2007 - Springer
We develop a model of parametric probabilistic transition Systems (PPTSs), where
probabilities associated with transitions may be parameters. We show how to find instances …

A behavioral distance for fuzzy-transition systems

Y Cao, SX Sun, H Wang, G Chen - IEEE Transactions on Fuzzy …, 2012 - ieeexplore.ieee.org
In contrast with the existing approaches to exact bisimulation for fuzzy systems, we introduce
a robust notion of behavioral distance to measure the behavioral similarity of …

Generalized bisimulation metrics

K Chatzikokolakis, D Gebler, C Palamidessi… - … on Concurrency Theory, 2014 - Springer
The bisimilarity pseudometric based on the Kantorovich lifting is one of the most popular
metrics for probabilistic processes proposed in the literature. However, its application in …

Metrics for Markov decision processes with infinite state spaces

N Ferns, P Panangaden, D Precup - arXiv preprint arXiv:1207.1386, 2012 - arxiv.org
We present metrics for measuring state similarity in Markov decision processes (MDPs) with
infinitely many states, including MDPs with continuous state spaces. Such metrics provide a …