Heterogeneous federated learning: State-of-the-art and research challenges

M Ye, X Fang, B Du, PC Yuen, D Tao - ACM Computing Surveys, 2023 - dl.acm.org
Federated learning (FL) has drawn increasing attention owing to its potential use in large-
scale industrial applications. Existing FL works mainly focus on model homogeneous …

A state-of-the-art survey on solving non-iid data in federated learning

X Ma, J Zhu, Z Lin, S Chen, Y Qin - Future Generation Computer Systems, 2022 - Elsevier
Federated Learning (FL) proposed in recent years has received significant attention from
researchers in that it can enable multiple clients to cooperatively train global models without …

Federated learning from pre-trained models: A contrastive learning approach

Y Tan, G Long, J Ma, L Liu, T Zhou… - Advances in neural …, 2022 - proceedings.neurips.cc
Federated Learning (FL) is a machine learning paradigm that allows decentralized clients to
learn collaboratively without sharing their private data. However, excessive computation and …

Layer-wised model aggregation for personalized federated learning

X Ma, J Zhang, S Guo, W Xu - Proceedings of the IEEE/CVF …, 2022 - openaccess.thecvf.com
Abstract Personalized Federated Learning (pFL) not only can capture the common priors
from broad range of distributed data, but also support customized models for heterogeneous …

Fedproto: Federated prototype learning across heterogeneous clients

Y Tan, G Long, L Liu, T Zhou, Q Lu, J Jiang… - Proceedings of the …, 2022 - ojs.aaai.org
Heterogeneity across clients in federated learning (FL) usually hinders the optimization
convergence and generalization performance when the aggregation of clients' knowledge …

Dispfl: Towards communication-efficient personalized federated learning via decentralized sparse training

R Dai, L Shen, F He, X Tian… - … conference on machine …, 2022 - proceedings.mlr.press
Personalized federated learning is proposed to handle the data heterogeneity problem
amongst clients by learning dedicated tailored local models for each user. However, existing …

Federated learning with partial model personalization

K Pillutla, K Malik, AR Mohamed… - International …, 2022 - proceedings.mlr.press
We consider two federated learning algorithms for training partially personalized models,
where the shared and personal parameters are updated either simultaneously or alternately …

On bridging generic and personalized federated learning for image classification

HY Chen, WL Chao - arXiv preprint arXiv:2107.00778, 2021 - arxiv.org
Federated learning is promising for its capability to collaboratively train models with multiple
clients without accessing their data, but vulnerable when clients' data distributions diverge …

Fedala: Adaptive local aggregation for personalized federated learning

J Zhang, Y Hua, H Wang, T Song, Z Xue… - Proceedings of the …, 2023 - ojs.aaai.org
A key challenge in federated learning (FL) is the statistical heterogeneity that impairs the
generalization of the global model on each client. To address this, we propose a method …

Fedbabu: Towards enhanced representation for federated image classification

J Oh, S Kim, SY Yun - arXiv preprint arXiv:2106.06042, 2021 - arxiv.org
Federated learning has evolved to improve a single global model under data heterogeneity
(as a curse) or to develop multiple personalized models using data heterogeneity (as a …