Risk-averse autonomous systems: A brief history and recent developments from the perspective of optimal control

Y Wang, MP Chapman - Artificial Intelligence, 2022 - Elsevier
We present an historical overview about the connections between the analysis of risk and
the control of autonomous systems. We offer two main contributions. Our first contribution is …

Linear quadratic control with risk constraints

A Tsiamis, DS Kalogerias, A Ribeiro… - arXiv preprint arXiv …, 2021 - arxiv.org
We propose a new risk-constrained formulation of the classical Linear Quadratic (LQ)
stochastic control problem for general partially-observed systems. Our framework is …

Policy evaluation in distributional lqr

Z Wang, Y Gao, S Wang, MM Zavlanos… - … for Dynamics and …, 2023 - proceedings.mlr.press
Distributional reinforcement learning (DRL) enhances the understanding of the effects of the
randomness in the environment by letting agents learn the distribution of a random return …

Classical risk-averse control for a finite-horizon Borel model

MP Chapman, KM Smith - IEEE Control Systems Letters, 2021 - ieeexplore.ieee.org
We study a risk-averse optimal control problem for a finite-horizon Borel model, where a
cumulative cost is assessed via exponential utility. The setting permits non-linear dynamics …

A Risk-Aware Control: Integrating Worst-Case CVaR with Control Barrier Function

M Kishida - arXiv preprint arXiv:2308.14265, 2023 - arxiv.org
This paper proposes a risk-aware control approach to enforce safety for discrete-time
nonlinear systems subject to stochastic uncertainties. We derive some useful results on the …

Risk‐aware self‐triggered linear quadratic control

M Kishida - IET Control Theory & Applications, 2023 - Wiley Online Library
This paper presents a self‐triggered control approach with the view of risks for discrete‐time
linear stochastic systems. More specifically, under the assumption that the first two moments …

Risk-aware stability, ultimate boundedness, and positive invariance

M Kishida - IEEE Transactions on Automatic Control, 2023 - ieeexplore.ieee.org
This article introduces the notions of stability, ultimate boundedness, and positive invariance
for stochastic systems in view of risk. More specifically, those notions are defined in terms of …

Risk-averse Learning with Non-Stationary Distributions

S Wang, Z Wang, X Yi, MM Zavlanos… - arXiv preprint arXiv …, 2024 - arxiv.org
Considering non-stationary environments in online optimization enables decision-maker to
effectively adapt to changes and improve its performance over time. In such cases, it is …

Policy Evaluation in Distributional LQR (Extended Version)

Z Wang, Y Gao, S Wang, MM Zavlanos, A Abate… - arXiv preprint arXiv …, 2023 - arxiv.org
Distributional reinforcement learning (DRL) enhances the understanding of the effects of the
randomness in the environment by letting agents learn the distribution of a random return …

Performance-Robustness Tradeoffs in Adversarially Robust Control and Estimation

BD Lee, TTCK Zhang, H Hassani… - IEEE Transactions on …, 2024 - ieeexplore.ieee.org
Efforts by the reinforcement learning community to close the sim-to-real gap have resulted in
policy optimization objectives which are distinct from, though related to, existing objectives in …