Efficient global robustness certification of neural networks via interleaving twin-network encoding

Z Wang, C Huang, Q Zhu - 2022 Design, Automation & Test in …, 2022 - ieeexplore.ieee.org
The robustness of deep neural networks has received significant interest recently, especially
when being deployed in safety-critical systems, as it is important to analyze how sensitive …

Polar-express: Efficient and precise formal reachability analysis of neural-network controlled systems

Y Wang, W Zhou, J Fan, Z Wang, J Li… - … on Computer-Aided …, 2023 - ieeexplore.ieee.org
Neural networks (NNs) playing the role of controllers have demonstrated impressive
empirical performance on challenging control problems. However, the potential adoption of …

Waving the double-edged sword: Building resilient cavs with edge and cloud computing

X Liu, Y Luo, A Goeckner, T Chakraborty… - 2023 60th ACM/IEEE …, 2023 - ieeexplore.ieee.org
The rapid advancement of edge and cloud computing platforms, vehicular ad-hoc networks,
and machine learning techniques have brought both opportunities and challenges for next …

Safe exploration in reinforcement learning: A generalized formulation and algorithms

A Wachi, W Hashimoto, X Shen… - Advances in Neural …, 2024 - proceedings.neurips.cc
Safe exploration is essential for the practical use of reinforcement learning (RL) in many real-
world scenarios. In this paper, we present a generalized safe exploration (GSE) problem as …

Provably safe reinforcement learning with step-wise violation constraints

N Xiong, Y Du, L Huang - Advances in Neural Information …, 2024 - proceedings.neurips.cc
We investigate a novel safe reinforcement learning problem with step-wise violation
constraints. Our problem differs from existing works in that we focus on stricter step-wise …

Joint differentiable optimization and verification for certified reinforcement learning

Y Wang, S Zhan, Z Wang, C Huang, Z Wang… - Proceedings of the …, 2023 - dl.acm.org
Model-based reinforcement learning has been widely studied for controller synthesis in
cyber-physical systems (CPSs). In particular, for safety-critical CPSs, it is important to …

State-wise safe reinforcement learning with pixel observations

SS Zhan, Y Wang, Q Wu, R Jiao, C Huang… - arXiv preprint arXiv …, 2023 - arxiv.org
Reinforcement Learning (RL) in the context of safe exploration has long grappled with the
challenges of the delicate balance between maximizing rewards and minimizing safety …

A Survey of Constraint Formulations in Safe Reinforcement Learning

A Wachi, X Shen, Y Sui - arXiv preprint arXiv:2402.02025, 2024 - arxiv.org
Ensuring safety is critical when applying reinforcement learning (RL) to real-world problems.
Consequently, safe RL emerges as a fundamental and powerful paradigm for safely …

Iterative Reachability Estimation for Safe Reinforcement Learning

M Ganai, Z Gong, C Yu, S Herbert… - Advances in Neural …, 2024 - proceedings.neurips.cc
Ensuring safety is important for the practical deployment of reinforcement learning (RL).
Various challenges must be addressed, such as handling stochasticity in the environments …

Reduced Policy Optimization for Continuous Control with Hard Constraints

S Ding, J Wang, Y Du, Y Shi - Advances in Neural …, 2024 - proceedings.neurips.cc
Recent advances in constrained reinforcement learning (RL) have endowed reinforcement
learning with certain safety guarantees. However, deploying existing constrained RL …