Formalizing generalization and adversarial robustness of neural networks to weight perturbations

YL Tsai, CY Hsu, CM Yu… - Advances in Neural …, 2021 - proceedings.neurips.cc
Studying the sensitivity of weight perturbation in neural networks and its impacts on model
performance, including generalization and robustness, is an active research topic due to its …

Complexity measures for neural networks with general activation functions using path-based norms

Z Li, C Ma, L Wu - arXiv preprint arXiv:2009.06132, 2020 - arxiv.org
A simple approach is proposed to obtain complexity controls for neural networks with
general activation functions. The approach is motivated by approximating the general …

Formalizing generalization and robustness of neural networks to weight perturbations

YL Tsai, CY Hsu, CM Yu, PY Chen - arXiv preprint arXiv:2103.02200, 2021 - arxiv.org
Studying the sensitivity of weight perturbation in neural networks and its impacts on model
performance, including generalization and robustness, is an active research topic due to its …

Path-BN: Towards effective batch normalization in the Path Space for ReLU networks

X Luo, Q Meng, W Chen, Y Wang… - Uncertainty in Artificial …, 2021 - proceedings.mlr.press
Neural networks with ReLU activation functions (abbrev. ReLU Networks), have
demonstrated their success in many applications. Recently, researchers noticed that ReLU …