Enforcing hard constraints with soft barriers: Safe reinforcement learning in unknown stochastic environments

Y Wang, SS Zhan, R Jiao, Z Wang… - International …, 2023 - proceedings.mlr.press
It is quite challenging to ensure the safety of reinforcement learning (RL) agents in an
unknown and stochastic environment under hard constraints that require the system state …

Efficient global robustness certification of neural networks via interleaving twin-network encoding

Z Wang, C Huang, Q Zhu - 2022 Design, Automation & Test in …, 2022 - ieeexplore.ieee.org
The robustness of deep neural networks has received significant interest recently, especially
when being deployed in safety-critical systems, as it is important to analyze how sensitive …

Physics-aware safety-assured design of hierarchical neural network based planner

X Liu, C Huang, Y Wang, B Zheng… - 2022 ACM/IEEE 13th …, 2022 - ieeexplore.ieee.org
Neural networks have shown great promises in planning, control, and general decision
making for learning-enabled cyber-physical systems (LE-CPSs), especially in improving …

Polar-express: Efficient and precise formal reachability analysis of neural-network controlled systems

Y Wang, W Zhou, J Fan, Z Wang, J Li… - … on Computer-Aided …, 2023 - ieeexplore.ieee.org
Neural networks (NNs) playing the role of controllers have demonstrated impressive
empirical performance on challenging control problems. However, the potential adoption of …

Know the unknowns: Addressing disturbances and uncertainties in autonomous systems

Q Zhu, W Li, H Kim, Y Xiang, K Wardega… - Proceedings of the 39th …, 2020 - dl.acm.org
Future autonomous systems will employ complex sensing, computation, and communication
components for their perception, planning, control, and coordination, and could operate in …

Waving the double-edged sword: Building resilient cavs with edge and cloud computing

X Liu, Y Luo, A Goeckner, T Chakraborty… - 2023 60th ACM/IEEE …, 2023 - ieeexplore.ieee.org
The rapid advancement of edge and cloud computing platforms, vehicular ad-hoc networks,
and machine learning techniques have brought both opportunities and challenges for next …

Safety-assured design and adaptation of learning-enabled autonomous systems

Q Zhu, C Huang, R Jiao, S Lan, H Liang, X Liu… - Proceedings of the 26th …, 2021 - dl.acm.org
Future autonomous systems will employ sophisticated machine learning techniques for the
sensing and perception of the surroundings and the making corresponding decisions for …

Design-while-verify: correct-by-construction control learning with verification in the loop

Y Wang, C Huang, Z Wang, Z Wang… - Proceedings of the 59th …, 2022 - dl.acm.org
In the current control design of safety-critical cyber-physical systems, formal verification
techniques are typically applied after the controller is designed to evaluate whether the …

Joint differentiable optimization and verification for certified reinforcement learning

Y Wang, S Zhan, Z Wang, C Huang, Z Wang… - Proceedings of the …, 2023 - dl.acm.org
Model-based reinforcement learning has been widely studied for controller synthesis in
cyber-physical systems (CPSs). In particular, for safety-critical CPSs, it is important to …

Learning-based optoelectronically innervated tactile finger for rigid-soft interactive grasping

L Yang, X Han, W Guo, F Wan, J Pan… - IEEE Robotics and …, 2021 - ieeexplore.ieee.org
This letter presents a novel design of a soft tactile finger with omni-directional adaptation
using multi-channel optical fibers for rigid-soft interactive grasping. Machine learning …