Differentiable game mechanics

A Letcher, D Balduzzi, S Racaniere, J Martens… - Journal of Machine …, 2019 - jmlr.org
Deep learning is built on the foundational guarantee that gradient descent on an objective
function converges to local minima. Unfortunately, this guarantee fails in settings, such as …

The mechanics of n-player differentiable games

D Balduzzi, S Racaniere, J Martens… - International …, 2018 - proceedings.mlr.press
The cornerstone underpinning deep learning is the guarantee that gradient descent on an
objective converges to local minima. Unfortunately, this guarantee fails in settings, such as …

Negative momentum for improved game dynamics

G Gidel, RA Hemmat, M Pezeshki… - The 22nd …, 2019 - proceedings.mlr.press
Games generalize the single-objective optimization paradigm by introducing different
objective functions for different players. Differentiable games often proceed by simultaneous …

Global convergence to the equilibrium of gans using variational inequalities

I Gemp, S Mahadevan - arXiv preprint arXiv:1808.01531, 2018 - arxiv.org
In optimization, the negative gradient of a function denotes the direction of steepest descent.
Furthermore, traveling in any direction orthogonal to the gradient maintains the value of the …

Stochastic hamiltonian gradient methods for smooth games

N Loizou, H Berard… - International …, 2020 - proceedings.mlr.press
The success of adversarial formulations in machine learning has brought renewed
motivation for smooth games. In this work, we focus on the class of stochastic Hamiltonian …

From chaos to order: Symmetry and conservation laws in game dynamics

SG Nagarajan, D Balduzzi… - … Conference on Machine …, 2020 - proceedings.mlr.press
Games are an increasingly useful tool for training and testing learning algorithms. Recent
examples include GANs, AlphaZero and the AlphaStar league. However, multi-agent …

Gradients are not all you need

L Metz, CD Freeman, SS Schoenholz… - arXiv preprint arXiv …, 2021 - arxiv.org
Differentiable programming techniques are widely used in the community and are
responsible for the machine learning renaissance of the past several decades. While these …

Implicit learning dynamics in stackelberg games: Equilibria characterization, convergence analysis, and empirical study

T Fiez, B Chasnov, L Ratliff - International Conference on …, 2020 - proceedings.mlr.press
Contemporary work on learning in continuous games has commonly overlooked the
hierarchical decision-making structure present in machine learning problems formulated as …

Convergence of learning dynamics in stackelberg games

T Fiez, B Chasnov, LJ Ratliff - arXiv preprint arXiv:1906.01217, 2019 - arxiv.org
This paper investigates the convergence of learning dynamics in Stackelberg games. In the
class of games we consider, there is a hierarchical game being played between a leader …

Interaction matters: A note on non-asymptotic local convergence of generative adversarial networks

T Liang, J Stokes - The 22nd International Conference on …, 2019 - proceedings.mlr.press
Motivated by the pursuit of a systematic computational and algorithmic understanding of
Generative Adversarial Networks (GANs), we present a simple yet unified non-asymptotic …