Neural functional transformers

A Zhou, K Yang, Y Jiang, K Burns… - Advances in neural …, 2024 - proceedings.neurips.cc
The recent success of neural networks as implicit representation of data has driven growing
interest in neural functionals: models that can process other neural networks as input by …

Graph neural networks for learning equivariant representations of neural networks

M Kofinas, B Knyazev, Y Zhang, Y Chen… - arXiv preprint arXiv …, 2024 - arxiv.org
Neural networks that process the parameters of other neural networks find applications in
domains as diverse as classifying implicit neural representations, generating neural network …

Neural Redshift: Random Networks are not Random Functions

D Teney, AM Nicolicioiu, V Hartmann… - Proceedings of the …, 2024 - openaccess.thecvf.com
Our understanding of the generalization capabilities of neural networks NNs is still
incomplete. Prevailing explanations are based on implicit biases of gradient descent GD but …

Universal neural functionals

A Zhou, C Finn, J Harrison - arXiv preprint arXiv:2402.05232, 2024 - arxiv.org
A challenging problem in many modern machine learning tasks is to process weight-space
features, ie, to transform or extract information from the weights and gradients of a neural …

How to Train Neural Field Representations: A Comprehensive Study and Benchmark

S Papa, R Valperga, D Knigge… - Proceedings of the …, 2024 - openaccess.thecvf.com
Neural fields (NeFs) have recently emerged as a versatile method for modeling signals of
various modalities including images shapes and scenes. Subsequently a number of works …

Connecting NeRFs Images and Text

F Ballerini, PZ Ramirez, R Mirabella… - Proceedings of the …, 2024 - openaccess.thecvf.com
Abstract Neural Radiance Fields (NeRFs) have emerged as a standard framework for
representing 3D scenes and objects introducing a novel data type for information exchange …

Generating behaviorally diverse policies with latent diffusion models

S Hegde, S Batra, KR Zentner… - Advances in Neural …, 2023 - proceedings.neurips.cc
Abstract Recent progress in Quality Diversity Reinforcement Learning (QD-RL) has enabled
learning a collection of behaviorally diverse, high performing policies. However, these …

Deep Learning on Object-centric 3D Neural Fields

PZ Ramirez, L De Luigi, D Sirocchi… - … on Pattern Analysis …, 2024 - ieeexplore.ieee.org
In recent years, Neural Fields (NF s) have emerged as an effective tool for encoding diverse
continuous signals such as images, videos, audio, and 3D shapes. When applied to 3D …

Equivariant deep weight space alignment

A Navon, A Shamsian, E Fetaya, G Chechik… - arXiv preprint arXiv …, 2023 - arxiv.org
Permutation symmetries of deep networks make simple operations like model averaging
and similarity estimation challenging. In many cases, aligning the weights of the networks …

Fleet Policy Learning via Weight Merging and An Application to Robotic Tool-Use

L Wang, K Zhang, A Zhou, M Simchowitz… - arXiv preprint arXiv …, 2023 - arxiv.org
Fleets of robots ingest massive amounts of streaming data generated by interacting with
their environments, far more than those that can be stored or transmitted with ease. At the …