Fusion of global and local knowledge for personalized federated learning

T Huang, L Shen, Y Sun, W Lin, D Tao - arXiv preprint arXiv:2302.11051, 2023 - arxiv.org
Personalized federated learning, as a variant of federated learning, trains customized
models for clients using their heterogeneously distributed data. However, it is still …

ZooPFL: Exploring black-box foundation models for personalized federated learning

W Lu, H Yu, J Wang, D Teney, H Wang, Y Chen… - arXiv preprint arXiv …, 2023 - arxiv.org
When personalized federated learning (FL) meets large foundation models, new challenges
arise from various limitations in resources. In addition to typical limitations such as data …

Personalized federated learning with contextualized generalization

X Tang, S Guo, J Guo - arXiv preprint arXiv:2106.13044, 2021 - arxiv.org
The prevalent personalized federated learning (PFL) usually pursues a trade-off between
personalization and generalization by maintaining a shared global model to guide the …

Personalized federated learning with clustered generalization

X Tang, S Guo, J Guo - 2021 - openreview.net
The prevalent personalized federated learning (PFL) usually pursues a trade-off between
personalization and generalization by maintaining a shared global model to guide the …

Efficient personalized federated learning via sparse model-adaptation

D Chen, L Yao, D Gao, B Ding… - … Conference on Machine …, 2023 - proceedings.mlr.press
Federated Learning (FL) aims to train machine learning models for multiple clients without
sharing their own private data. Due to the heterogeneity of clients' local data distribution …

FedCR: Personalized federated learning based on across-client common representation with conditional mutual information regularization

H Zhang, C Li, W Dai, J Zou… - … Conference on Machine …, 2023 - proceedings.mlr.press
In personalized federated learning (PFL), multiple clients train customized models to fulfill
their personal objectives, which, however, are prone to overfitting to local data due to the …

Spectral co-distillation for personalized federated learning

Z Chen, H Yang, T Quek… - Advances in Neural …, 2023 - proceedings.neurips.cc
Personalized federated learning (PFL) has been widely investigated to address the
challenge of data heterogeneity, especially when a single generic model is inadequate in …

Fed-CO: Cooperation of Online and Offline Models for Severe Data Heterogeneity in Federated Learning

Z Cai, Y Shi, W Huang, J Wang - Advances in Neural …, 2024 - proceedings.neurips.cc
Federated Learning (FL) has emerged as a promising distributed learning paradigm that
enables multiple clients to learn a global model collaboratively without sharing their private …

Efficient federated learning via local adaptive amended optimizer with linear speedup

Y Sun, L Shen, H Sun, L Ding, D Tao - arXiv preprint arXiv:2308.00522, 2023 - arxiv.org
Adaptive optimization has achieved notable success for distributed learning while extending
adaptive optimizer to federated Learning (FL) suffers from severe inefficiency, including (i) …

Fedpara: Low-rank hadamard product for communication-efficient federated learning

N Hyeon-Woo, M Ye-Bin, TH Oh - arXiv preprint arXiv:2108.06098, 2021 - arxiv.org
In this work, we propose a communication-efficient parameterization, FedPara, for federated
learning (FL) to overcome the burdens on frequent model uploads and downloads. Our …