Stability analysis and generalization bounds of adversarial training

J Xiao, Y Fan, R Sun, J Wang… - Advances in Neural …, 2022 - proceedings.neurips.cc
In adversarial machine learning, deep neural networks can fit the adversarial examples on
the training dataset but have poor generalization ability on the test set. This phenomenon is …

Relating adversarially robust generalization to flat minima

D Stutz, M Hein, B Schiele - Proceedings of the IEEE/CVF …, 2021 - openaccess.thecvf.com
Adversarial training (AT) has become the de-facto standard to obtain models robust against
adversarial examples. However, AT exhibits severe robust overfitting: cross-entropy loss on …

Improving fast adversarial training with prior-guided knowledge

X Jia, Y Zhang, X Wei, B Wu, K Ma… - IEEE Transactions on …, 2024 - ieeexplore.ieee.org
Fast adversarial training (FAT) is an efficient method to improve robustness in white-box
attack scenarios. However, the original FAT suffers from catastrophic overfitting, which …

Stochastic weight averaging revisited

H Guo, J Jin, B Liu - Applied Sciences, 2023 - mdpi.com
Averaging neural network weights sampled by a backbone stochastic gradient descent
(SGD) is a simple-yet-effective approach to assist the backbone SGD in finding better …

PeerAiD: Improving Adversarial Distillation from a Specialized Peer Tutor

J Jung, H Jang, J Song, J Lee - Proceedings of the IEEE …, 2024 - openaccess.thecvf.com
Adversarial robustness of the neural network is a significant concern when it is applied to
security-critical domains. In this situation adversarial distillation is a promising option which …

Generating Less Certain Adversarial Examples Improves Robust Generalization

M Zhang, M Backes, X Zhang - arXiv preprint arXiv:2310.04539, 2023 - arxiv.org
Recent studies have shown that deep neural networks are vulnerable to adversarial
examples. Numerous defenses have been proposed to improve model robustness, among …

SRoUDA: meta self-training for robust unsupervised domain adaptation

W Zhu, JL Yin, BH Chen, X Liu - … of the AAAI Conference on Artificial …, 2023 - ojs.aaai.org
As acquiring manual labels on data could be costly, unsupervised domain adaptation
(UDA), which transfers knowledge learned from a rich-label dataset to the unlabeled target …

Conserve-Update-Revise to Cure Generalization and Robustness Trade-off in Adversarial Training

S Gowda, B Zonooz, E Arani - arXiv preprint arXiv:2401.14948, 2024 - arxiv.org
Adversarial training improves the robustness of neural networks against adversarial attacks,
albeit at the expense of the trade-off between standard and robust generalization. To unveil …

Towards Trustworthy Unsupervised Domain Adaptation: A Representation Learning Perspective for Enhancing Robustness, Discrimination, and Generalization

JL Yin, H Zheng, X Liu - arXiv preprint arXiv:2406.13180, 2024 - arxiv.org
Robust Unsupervised Domain Adaptation (RoUDA) aims to achieve not only clean but also
robust cross-domain knowledge transfer from a labeled source domain to an unlabeled …

Understanding and improving robustness and uncertainty estimation in deep learning

D Stutz - 2022 - publikationen.sulb.uni-saarland.de
Deep learning is becoming increasingly relevant for many high-stakes applications such as
autonomous driving or medical diagnosis where wrong decisions can have massive impact …