Personalized federated learning with first order model optimization

M Zhang, K Sapra, S Fidler, S Yeung… - arXiv preprint arXiv …, 2020 - arxiv.org
While federated learning traditionally aims to train a single global model across
decentralized local datasets, one model may not always be ideal for all participating clients …

Personalized federated learning for heterogeneous clients with clustered knowledge transfer

YJ Cho, J Wang, T Chiruvolu, G Joshi - arXiv preprint arXiv:2109.08119, 2021 - arxiv.org
Personalized federated learning (FL) aims to train model (s) that can perform well for
individual clients that are highly data and system heterogeneous. Most work in personalized …

Flis: Clustered federated learning via inference similarity for non-iid data distribution

M Morafah, S Vahidian, W Wang… - IEEE Open Journal of the …, 2023 - ieeexplore.ieee.org
Conventional federated learning (FL) approaches are ineffective in scenarios where clients
have significant differences in the distributions of their local data. The Non-IID data …

Personalized federated learning through local memorization

O Marfoq, G Neglia, R Vidal… - … Conference on Machine …, 2022 - proceedings.mlr.press
Federated learning allows clients to collaboratively learn statistical models while keeping
their data local. Federated learning was originally used to train a unique global model to be …

Motley: Benchmarking heterogeneity and personalization in federated learning

S Wu, T Li, Z Charles, Y Xiao, Z Liu, Z Xu… - arXiv preprint arXiv …, 2022 - arxiv.org
Personalized federated learning considers learning models unique to each client in a
heterogeneous network. The resulting client-specific models have been purported to …

Efficient personalized federated learning via sparse model-adaptation

D Chen, L Yao, D Gao, B Ding… - … Conference on Machine …, 2023 - proceedings.mlr.press
Federated Learning (FL) aims to train machine learning models for multiple clients without
sharing their own private data. Due to the heterogeneity of clients' local data distribution …

Spectral co-distillation for personalized federated learning

Z Chen, H Yang, T Quek… - Advances in Neural …, 2023 - proceedings.neurips.cc
Personalized federated learning (PFL) has been widely investigated to address the
challenge of data heterogeneity, especially when a single generic model is inadequate in …

Clustered sampling: Low-variance and improved representativity for clients selection in federated learning

Y Fraboni, R Vidal, L Kameni… - … on Machine Learning, 2021 - proceedings.mlr.press
This work addresses the problem of optimizing communications between server and clients
in federated learning (FL). Current sampling approaches in FL are either biased, or non …

Federated learning from pre-trained models: A contrastive learning approach

Y Tan, G Long, J Ma, L Liu, T Zhou… - Advances in neural …, 2022 - proceedings.neurips.cc
Federated Learning (FL) is a machine learning paradigm that allows decentralized clients to
learn collaboratively without sharing their private data. However, excessive computation and …

Exploiting shared representations for personalized federated learning

L Collins, H Hassani, A Mokhtari… - … on machine learning, 2021 - proceedings.mlr.press
Deep neural networks have shown the ability to extract universal feature representations
from data such as images and text that have been useful for a variety of learning tasks …