Efficient and modular implicit differentiation

M Blondel, Q Berthet, M Cuturi… - Advances in neural …, 2022 - proceedings.neurips.cc
Automatic differentiation (autodiff) has revolutionized machine learning. Itallows to express
complex computations by composing elementary ones in creativeways and removes the …

Online training through time for spiking neural networks

M Xiao, Q Meng, Z Zhang, D He… - Advances in neural …, 2022 - proceedings.neurips.cc
Spiking neural networks (SNNs) are promising brain-inspired energy-efficient models.
Recent progress in training methods has enabled successful deep SNNs on large-scale …

Deep equilibrium optical flow estimation

S Bai, Z Geng, Y Savani… - Proceedings of the IEEE …, 2022 - openaccess.thecvf.com
Many recent state-of-the-art (SOTA) optical flow models use finite-step recurrent update
operations to emulate traditional algorithms by encouraging iterative refinements toward a …

Object representations as fixed points: Training iterative refinement algorithms with implicit differentiation

M Chang, T Griffiths, S Levine - Advances in Neural …, 2022 - proceedings.neurips.cc
Current work in object-centric learning has been motivated by developing learning
algorithms that infer independent and symmetric entities from the perceptual input. This often …

Deep equilibrium approaches to diffusion models

A Pokle, Z Geng, JZ Kolter - Advances in Neural …, 2022 - proceedings.neurips.cc
Diffusion-based generative models are extremely effective in generating high-quality
images, with generated samples often surpassing the quality of those produced by other …

Optimization-induced graph implicit nonlinear diffusion

Q Chen, Y Wang, Y Wang, J Yang… - … on Machine Learning, 2022 - proceedings.mlr.press
Due to the over-smoothing issue, most existing graph neural networks can only capture
limited dependencies with their inherently finite aggregation layers. To overcome this …

Improving object-centric learning with query optimization

B Jia, Y Liu, S Huang - arXiv preprint arXiv:2210.08990, 2022 - arxiv.org
The ability to decompose complex natural scenes into meaningful object-centric abstractions
lies at the core of human perception and reasoning. In the recent culmination of …

Mgnni: Multiscale graph neural networks with implicit layers

J Liu, B Hooi, K Kawaguchi… - Advances in Neural …, 2022 - proceedings.neurips.cc
Recently, implicit graph neural networks (GNNs) have been proposed to capture long-range
dependencies in underlying graphs. In this paper, we introduce and justify two weaknesses …

Recurrence without recurrence: Stable video landmark detection with deep equilibrium models

P Micaelli, A Vahdat, H Yin, J Kautz… - Proceedings of the …, 2023 - openaccess.thecvf.com
Cascaded computation, whereby predictions are recurrently refined over several stages, has
been a persistent theme throughout the development of landmark detection models. In this …

Eliminating gradient conflict in reference-based line-art colorization

Z Li, Z Geng, Z Kang, W Chen, Y Yang - European Conference on …, 2022 - Springer
Reference-based line-art colorization is a challenging task in computer vision. The color,
texture, and shading are rendered based on an abstract sketch, which heavily relies on the …