Graph neural networks for learning equivariant representations of neural networks

M Kofinas, B Knyazev, Y Zhang, Y Chen… - arXiv preprint arXiv …, 2024 - arxiv.org
Neural networks that process the parameters of other neural networks find applications in
domains as diverse as classifying implicit neural representations, generating neural network …

Universal neural functionals

A Zhou, C Finn, J Harrison - arXiv preprint arXiv:2402.05232, 2024 - arxiv.org
A challenging problem in many modern machine learning tasks is to process weight-space
features, ie, to transform or extract information from the weights and gradients of a neural …

Connecting NeRFs Images and Text

F Ballerini, PZ Ramirez, R Mirabella… - Proceedings of the …, 2024 - openaccess.thecvf.com
Abstract Neural Radiance Fields (NeRFs) have emerged as a standard framework for
representing 3D scenes and objects introducing a novel data type for information exchange …

Deep Learning on Object-centric 3D Neural Fields

PZ Ramirez, L De Luigi, D Sirocchi… - … on Pattern Analysis …, 2024 - ieeexplore.ieee.org
In recent years, Neural Fields (NF s) have emerged as an effective tool for encoding diverse
continuous signals such as images, videos, audio, and 3D shapes. When applied to 3D …

Equivariant deep weight space alignment

A Navon, A Shamsian, E Fetaya, G Chechik… - arXiv preprint arXiv …, 2023 - arxiv.org
Permutation symmetries of deep networks make simple operations like model averaging
and similarity estimation challenging. In many cases, aligning the weights of the networks …

Improved generalization of weight space networks via augmentations

A Shamsian, A Navon, DW Zhang, Y Zhang… - arXiv preprint arXiv …, 2024 - arxiv.org
Learning in deep weight spaces (DWS), where neural networks process the weights of other
neural networks, is an emerging research direction, with applications to 2D and 3D neural …

Deep learning on 3D neural fields

PZ Ramirez, L De Luigi, D Sirocchi, A Cardace… - arXiv preprint arXiv …, 2023 - arxiv.org
In recent years, Neural Fields (NFs) have emerged as an effective tool for encoding diverse
continuous signals such as images, videos, audio, and 3D shapes. When applied to 3D …

Graph metanetworks for processing diverse neural architectures

D Lim, H Maron, MT Law, J Lorraine… - arXiv preprint arXiv …, 2023 - arxiv.org
Neural networks efficiently encode learned information within their parameters.
Consequently, many tasks can be unified by treating neural networks themselves as input …

Data Augmentations in Deep Weight Spaces

A Shamsian, DW Zhang, A Navon, Y Zhang… - arXiv preprint arXiv …, 2023 - arxiv.org
Learning in weight spaces, where neural networks process the weights of other deep neural
networks, has emerged as a promising research direction with applications in various fields …

Efficient construction and convergence analysis of sparse convolutional neural networks

S Zhao, Q Fan, Q Dong, Z Xing, X Yang, X He - Neurocomputing, 2024 - Elsevier
In this paper, a new variant of convolutional neural network (CNN) based on L 1
regularization is proposed. The main consideration is to generate a sparse weight matrix, ie …