Synthesis for robots: Guarantees and feedback for robot behavior

H Kress-Gazit, M Lahijanian… - Annual Review of Control …, 2018 - annualreviews.org
Robot control for tasks such as moving around obstacles or grasping objects has advanced
significantly in the last few decades. However, controlling robots to perform complex tasks is …

Probabilistic model checking and autonomy

M Kwiatkowska, G Norman… - Annual review of control …, 2022 - annualreviews.org
The design and control of autonomous systems that operate in uncertain or adversarial
environments can be facilitated by formal modeling and analysis. Probabilistic model …

A storm is coming: A modern probabilistic model checker

C Dehnert, S Junges, JP Katoen, M Volk - Computer Aided Verification …, 2017 - Springer
We launch the new probabilistic model checker S torm. It features the analysis of discrete-
and continuous-time variants of both Markov chains and MDPs. It supports the P rism and …

[HTML][HTML] The probabilistic model checker Storm

C Hensel, S Junges, JP Katoen, T Quatmann… - International Journal on …, 2022 - Springer
We present the probabilistic model checker Storm. Storm supports the analysis of discrete-
and continuous-time variants of both Markov chains and Markov decision processes. Storm …

Automated verification and synthesis of stochastic hybrid systems: A survey

A Lavaei, S Soudjani, A Abate, M Zamani - Automatica, 2022 - Elsevier
Stochastic hybrid systems have received significant attentions as a relevant modeling
framework describing many systems, from engineering to the life sciences: they enable the …

Safe reinforcement learning using probabilistic shields

N Jansen, B Könighofer, S Junges… - 31st International …, 2020 - drops.dagstuhl.de
This paper concerns the efficient construction of a safety shield for reinforcement learning.
We specifically target scenarios that incorporate uncertainty and use Markov decision …

Reinforcement learning for temporal logic control synthesis with probabilistic satisfaction guarantees

M Hasanbeig, Y Kantaros, A Abate… - 2019 IEEE 58th …, 2019 - ieeexplore.ieee.org
We present a model-free reinforcement learning algorithm to synthesize control policies that
maximize the probability of satisfying high-level control objectives given as Linear Temporal …

Control synthesis from linear temporal logic specifications using model-free reinforcement learning

AK Bozkurt, Y Wang, MM Zavlanos… - 2020 IEEE International …, 2020 - ieeexplore.ieee.org
We present a reinforcement learning (RL) frame-work to synthesize a control policy from a
given linear temporal logic (LTL) specification in an unknown stochastic environment that …

Reinforcement learning of adaptive energy management with transition probability for a hybrid electric tracked vehicle

T Liu, Y Zou, D Liu, F Sun - IEEE Transactions on Industrial …, 2015 - ieeexplore.ieee.org
A reinforcement learning-based adaptive energy management (RLAEM) is proposed for a
hybrid electric tracked vehicle (HETV) in this paper. A control oriented model of the HETV is …

[HTML][HTML] Omega-regular objectives in model-free reinforcement learning

EM Hahn, M Perez, S Schewe, F Somenzi… - … conference on tools and …, 2019 - Springer
We provide the first solution for model-free reinforcement learning of ω-regular objectives for
Markov decision processes (MDPs). We present a constructive reduction from the almost …