Universal neural functionals

A Zhou, C Finn, J Harrison - arXiv preprint arXiv:2402.05232, 2024 - arxiv.org
A challenging problem in many modern machine learning tasks is to process weight-space
features, ie, to transform or extract information from the weights and gradients of a neural …

How to Train Neural Field Representations: A Comprehensive Study and Benchmark

S Papa, R Valperga, D Knigge… - Proceedings of the …, 2024 - openaccess.thecvf.com
Neural fields (NeFs) have recently emerged as a versatile method for modeling signals of
various modalities including images shapes and scenes. Subsequently a number of works …

Connecting NeRFs Images and Text

F Ballerini, PZ Ramirez, R Mirabella… - Proceedings of the …, 2024 - openaccess.thecvf.com
Abstract Neural Radiance Fields (NeRFs) have emerged as a standard framework for
representing 3D scenes and objects introducing a novel data type for information exchange …

Grounding Continuous Representations in Geometry: Equivariant Neural Fields

DR Wessels, DM Knigge, S Papa, R Valperga… - arXiv preprint arXiv …, 2024 - arxiv.org
Recently, Neural Fields have emerged as a powerful modelling paradigm to represent
continuous signals. In a conditional neural field, a field is represented by a latent variable …

The Empirical Impact of Neural Parameter Symmetries, or Lack Thereof

D Lim, M Putterman, R Walters, H Maron… - arXiv preprint arXiv …, 2024 - arxiv.org
Many algorithms and observed phenomena in deep learning appear to be affected by
parameter symmetries--transformations of neural network parameters that do not change the …

Towards Scalable and Versatile Weight Space Learning

K Schürholt, MW Mahoney, D Borth - arXiv preprint arXiv:2406.09997, 2024 - arxiv.org
Learning representations of well-trained neural network models holds the promise to
provide an understanding of the inner workings of those models. However, previous work …

Scale Equivariant Graph Metanetworks

I Kalogeropoulos, G Bouritsas, Y Panagakis - arXiv preprint arXiv …, 2024 - arxiv.org
This paper pertains to an emerging machine learning paradigm: learning higher-order
functions, ie functions whose inputs are functions themselves, $\textit {particularly when …

LLaNA: Large Language and NeRF Assistant

A Amaduzzi, PZ Ramirez, G Lisanti, S Salti… - arXiv preprint arXiv …, 2024 - arxiv.org
Multimodal Large Language Models (MLLMs) have demonstrated an excellent
understanding of images and 3D data. However, both modalities have shortcomings in …

On the Origin of Llamas: Model Tree Heritage Recovery

E Horwitz, A Shul, Y Hoshen - arXiv preprint arXiv:2405.18432, 2024 - arxiv.org
The rapid growth of neural network models shared on the internet has made model weights
an important data modality. However, this information is underutilized as the weights are …