Safety assurance of artificial intelligence-based systems: A systematic literature review on the state of the art and guidelines for future work

AVS Neto, JB Camargo, JR Almeida… - IEEE Access, 2022 - ieeexplore.ieee.org
The objective of this research is to present the state of the art of the safety assurance of
Artificial Intelligence (AI)-based systems and guidelines on future correlated work. For this …

Rap: Risk-aware prediction for robust planning

H Nishimura, J Mercat, B Wulfe… - … on Robot Learning, 2023 - proceedings.mlr.press
Robust planning in interactive scenarios requires predicting the uncertain future to make risk-
aware decisions. Unfortunately, due to long-tail safety-critical events, the risk is often under …

Orlicz risks for assessing stochastic streamflow environments: a static optimization approach

H Yoshioka, H Tomobe, Y Yoshioka - Stochastic Environmental Research …, 2024 - Springer
This study applies novel risk measures, called Orlicz risks, to the risk and uncertainty
evaluation of the streamflow discharge as a primary driver of hydrological and hydraulic …

Risk-adaptive approaches to learning and decision making: A survey

JO Royset - arXiv preprint arXiv:2212.00856, 2022 - arxiv.org
Uncertainty is prevalent in engineering design, statistical learning, and decision making
broadly. Due to inherent risk-averseness and ambiguity about assumptions, it is common to …

Risk verification of stochastic systems with neural network controllers

M Cleaveland, L Lindemann, R Ivanov, GJ Pappas - Artificial Intelligence, 2022 - Elsevier
Motivated by the fragility of neural network (NN) controllers in safety-critical applications, we
present a data-driven framework for verifying the risk of stochastic dynamical systems with …

Data-driven risk-sensitive model predictive control for safe navigation in multi-robot systems

A Navsalkar, AR Hota - 2023 IEEE International Conference on …, 2023 - ieeexplore.ieee.org
Safe navigation is a fundamental challenge in multi-robot systems due to the uncertainty
surrounding the future trajectory of the robots that act as obstacles for each other. In this …

On optimizing the conditional value-at-risk of a maximum cost for risk-averse safety analysis

MP Chapman, M Fauß, KM Smith - IEEE Transactions on …, 2022 - ieeexplore.ieee.org
The popularity of Conditional Value-at-Risk (CVaR), a risk functional from finance, has been
growing in the control systems community due to its intuitive interpretation and axiomatic …

Formal verification and control with conformal prediction

L Lindemann, Y Zhao, X Yu, GJ Pappas… - arXiv preprint arXiv …, 2024 - arxiv.org
In this survey, we design formal verification and control algorithms for autonomous systems
with practical safety guarantees using conformal prediction (CP), a statistical tool for …

Recovery policies for safe exploration of lunar permanently shadowed regions by a solar-powered rover

O Lamarre, S Malhotra, J Kelly - Acta Astronautica, 2023 - Elsevier
The success of a multi-kilometre drive by a solar-powered rover at the lunar south pole
depends upon careful planning in space and time due to highly dynamic solar illumination …

Eliciting Risk Aversion with Inverse Reinforcement Learning via Interactive Questioning

Z Cheng, A Coache, S Jaimungal - arXiv preprint arXiv:2308.08427, 2023 - arxiv.org
This paper proposes a novel framework for identifying an agent's risk aversion using
interactive questioning. Our study is conducted in two scenarios: a one-period case and an …