Min-max optimization without gradients: Convergence and applications to black-box evasion and poisoning attacks

S Liu, S Lu, X Chen, Y Feng, K Xu… - International …, 2020 - proceedings.mlr.press
In this paper, we study the problem of constrained min-max optimization in a black-box
setting, where the desired optimizer cannot access the gradients of the objective function but …

Friedrichs learning: Weak solutions of partial differential equations via deep learning

F Chen, J Huang, C Wang, H Yang - SIAM Journal on Scientific Computing, 2023 - SIAM
This paper proposes Friedrichs learning as a novel deep learning methodology that can
learn the weak solutions of PDEs via a minimax formulation, which transforms the PDE …

Runtime analysis of competitive co-evolutionary algorithms for maximin optimisation of a bilinear function

PK Lehre - Proceedings of the Genetic and Evolutionary …, 2022 - dl.acm.org
Co-evolutionary algorithms have a wide range of applications, such as in hardware design,
evolution of strategies for board games, and patching software bugs. However, these …

Zeroth-order algorithms for nonconvex minimax problems with improved complexities

Z Wang, K Balasubramanian, S Ma… - arXiv preprint arXiv …, 2020 - arxiv.org
In this paper, we study zeroth-order algorithms for minimax optimization problems that are
nonconvex in one variable and strongly-concave in the other variable. Such minimax …

Spatial coevolution for generative adversarial network training

E Hemberg, J Toutouh, A Al-Dujaili… - ACM Transactions on …, 2021 - dl.acm.org
Generative Adversarial Networks (GANs) are difficult to train because of pathologies such as
mode and discriminator collapse. Similar pathologies have been studied and addressed in …

Saddle point optimization with approximate minimization oracle and its application to robust berthing control

Y Akimoto, Y Miyauchi, A Maki - ACM Transactions on Evolutionary …, 2022 - dl.acm.org
We propose an approach to saddle point optimization relying only on oracles that solve
minimization problems approximately. We analyze its convergence property on a strongly …

Zeroth-order algorithms for nonconvex–strongly-concave minimax problems with improved complexities

Z Wang, K Balasubramanian, S Ma… - Journal of Global …, 2023 - Springer
In this paper, we study zeroth-order algorithms for minimax optimization problems that are
nonconvex in one variable and strongly-concave in the other variable. Such minimax …

Data dieting in gan training

J Toutouh, E Hemberg, UM O'Reilly - Deep Neural Evolution: Deep …, 2020 - Springer
Abstract We investigate training Generative Adversarial Networks, GANs, with less data.
Subsets of the training dataset can express empirical sample diversity while reducing …

Zeroth-order single-loop algorithms for nonconvex-linear minimax problems

J Shen, Z Wang, Z Xu - Journal of Global Optimization, 2023 - Springer
Nonconvex minimax problems have attracted significant interest in machine learning and
many other fields in recent years. In this paper, we propose a new zeroth-order alternating …

Lipizzaner: a system that scales robust generative adversarial network training

T Schmiedlechner, INZ Yong, A Al-Dujaili… - arXiv preprint arXiv …, 2018 - arxiv.org
GANs are difficult to train due to convergence pathologies such as mode and discriminator
collapse. We introduce Lipizzaner, an open source software system that allows machine …