A brief review of hypernetworks in deep learning

VK Chauhan, J Zhou, P Lu, S Molaei… - Artificial Intelligence …, 2024 - Springer
Hypernetworks, or hypernets for short, are neural networks that generate weights for another
neural network, known as the target network. They have emerged as a powerful deep …

Layer-wised model aggregation for personalized federated learning

X Ma, J Zhang, S Guo, W Xu - Proceedings of the IEEE/CVF …, 2022 - openaccess.thecvf.com
Abstract Personalized Federated Learning (pFL) not only can capture the common priors
from broad range of distributed data, but also support customized models for heterogeneous …

Implicit neural representations with periodic activation functions

V Sitzmann, J Martel, A Bergman… - Advances in neural …, 2020 - proceedings.neurips.cc
Implicitly defined, continuous, differentiable signal representations parameterized by neural
networks have emerged as a powerful paradigm, offering many possible benefits over …

Personalized federated learning using hypernetworks

A Shamsian, A Navon, E Fetaya… - … on Machine Learning, 2021 - proceedings.mlr.press
Personalized federated learning is tasked with training machine learning models for multiple
clients, each with its own data distribution. The goal is to train personalized models …

Blindly assess image quality in the wild guided by a self-adaptive hyper network

S Su, Q Yan, Y Zhu, C Zhang, X Ge… - Proceedings of the …, 2020 - openaccess.thecvf.com
Blind image quality assessment (BIQA) for authentically distorted images has always been a
challenging problem, since images captured in the wild include varies contents and diverse …

Hyperseg: Patch-wise hypernetwork for real-time semantic segmentation

Y Nirkin, L Wolf, T Hassner - … of the IEEE/CVF conference on …, 2021 - openaccess.thecvf.com
We present a novel, real-time, semantic segmentation network in which the encoder both
encodes and generates the parameters (weights) of the decoder. Furthermore, to allow …

Adversarial generation of continuous images

I Skorokhodov, S Ignatyev… - Proceedings of the …, 2021 - openaccess.thecvf.com
In most existing learning systems, images are typically viewed as 2D pixel arrays. However,
in another paradigm gaining popularity, a 2D image is represented as an implicit neural …

Csp: Self-supervised contrastive spatial pre-training for geospatial-visual representations

G Mai, N Lao, Y He, J Song… - … Conference on Machine …, 2023 - proceedings.mlr.press
Geo-tagged images are publicly available in large quantities, whereas labels such as object
classes are rather scarce and expensive to collect. Meanwhile, contrastive learning has …

Modulated periodic activations for generalizable local functional representations

I Mehta, M Gharbi, C Barnes… - Proceedings of the …, 2021 - openaccess.thecvf.com
Abstract Multi-Layer Perceptrons (MLPs) make powerful functional representations for
sampling and reconstruction problems involving low-dimensional signals like images …

Multiplicative filter networks

R Fathony, AK Sahu, D Willmott… - … Conference on Learning …, 2020 - openreview.net
Although deep networks are typically used to approximate functions over high dimensional
inputs, recent work has increased interest in neural networks as function approximators for …