Probabilistic model checking: Advances and applications

M Kwiatkowska, G Norman, D Parker - … System Verification: State-of the-Art …, 2018 - Springer
Probabilistic model checking is a powerful technique for formally verifying quantitative
properties of systems that exhibit stochastic behaviour. Such systems are found in many …

Approximate information state for approximate planning and reinforcement learning in partially observed systems

J Subramanian, A Sinha, R Seraj, A Mahajan - Journal of Machine …, 2022 - jmlr.org
We propose a theoretical framework for approximate planning and learning in partially
observed systems. Our framework is based on the fundamental notion of information state …

Verification and control of partially observable probabilistic systems

G Norman, D Parker, X Zou - Real-Time Systems, 2017 - Springer
We present automated techniques for the verification and control of partially observable,
probabilistic systems for both discrete and dense models of time. For the discrete-time case …

Interpretable apprenticeship learning with temporal logic specifications

D Kasenberg, M Scheutz - 2017 IEEE 56th Annual Conference …, 2017 - ieeexplore.ieee.org
Recent work has addressed using formulas in linear temporal logic (LTL) as specifications
for agents planning in Markov Decision Processes (MDPs). We consider the inverse …

Enforcing almost-sure reachability in POMDPs

S Junges, N Jansen, SA Seshia - International Conference on Computer …, 2021 - Springer
Abstract Partially-Observable Markov Decision Processes (POMDPs) are a well-known
stochastic model for sequential decision making under limited information. We consider the …

Learning and planning for temporally extended tasks in unknown environments

C Bradley, A Pacheck, GJ Stein… - … on Robotics and …, 2021 - ieeexplore.ieee.org
We propose a novel planning technique for satisfying tasks specified in temporal logic in
partially revealed environments. We define high-level actions derived from the environment …

Point-based methods for model checking in partially observable Markov decision processes

M Bouton, J Tumova, MJ Kochenderfer - … of the AAAI Conference on Artificial …, 2020 - aaai.org
Autonomous systems are often required to operate in partially observable environments.
They must reliably execute a specified objective even with incomplete information about the …

Bounded policy synthesis for POMDPs with safe-reachability objectives

Y Wang, S Chaudhuri, LE Kavraki - arXiv preprint arXiv:1801.09780, 2018 - arxiv.org
Planning robust executions under uncertainty is a fundamental challenge for building
autonomous robots. Partially Observable Markov Decision Processes (POMDPs) provide a …

A symbolic SAT-based algorithm for almost-sure reachability with small strategies in POMDPs

K Chatterjee, M Chmelik, J Davies - … of the AAAI Conference on Artificial …, 2016 - ojs.aaai.org
POMDPs are standard models for probabilistic planning problems, where an agent interacts
with an uncertain environment. We study the problem of almost-sure reachability, where …

Trust-aware motion planning for human-robot collaboration under distribution temporal logic specifications

P Yu, S Dong, S Sheng, L Feng… - … on Robotics and …, 2024 - ieeexplore.ieee.org
Recent work has considered trust-aware decision making for human-robot collaboration
(HRC) with a focus on model learning. In this paper, we are interested in enabling the HRC …