Window-based model averaging improves generalization in heterogeneous federated learning

D Caldarola, B Caputo… - Proceedings of the IEEE …, 2023 - openaccess.thecvf.com
Federated Learning (FL) aims to learn a global model from distributed users while protecting
their privacy. However, when data are distributed heterogeneously the learning process …

Understanding how consistency works in federated learning via stage-wise relaxed initialization

Y Sun, L Shen, D Tao - Advances in Neural Information …, 2024 - proceedings.neurips.cc
Federated learning (FL) is a distributed paradigm that coordinates massive local clients to
collaboratively train a global model via stage-wise local training processes on the …

Diversifying the mixture-of-experts representation for language models with orthogonal optimizer

B Liu, L Ding, L Shen, K Peng, Y Cao, D Cheng… - arXiv preprint arXiv …, 2023 - arxiv.org
The Mixture of Experts (MoE) has emerged as a highly successful technique in deep
learning, based on the principle of divide-and-conquer to maximize model capacity without …

Federated learning with manifold regularization and normalized update reaggregation

X An, L Shen, H Hu, Y Luo - Advances in Neural …, 2023 - proceedings.neurips.cc
Federated Learning (FL) is an emerging collaborative machine learning framework where
multiple clients train the global model without sharing their own datasets. In FL, the model …

FedSOL: Stabilized Orthogonal Learning with Proximal Restrictions in Federated Learning

G Lee, M Jeong, S Kim, J Oh… - Proceedings of the IEEE …, 2024 - openaccess.thecvf.com
Federated Learning (FL) aggregates locally trained models from individual clients to
construct a global model. While FL enables learning a model with data privacy it often …

Which mode is better for federated learning? Centralized or Decentralized

Y Sun, L Shen, D Tao - arXiv preprint arXiv:2310.03461, 2023 - arxiv.org
Both centralized and decentralized approaches have shown excellent performance and
great application value in federated learning (FL). However, current studies do not provide …

Fedimpro: Measuring and improving client update in federated learning

Z Tang, Y Zhang, S Shi, X Tian, T Liu, B Han… - arXiv preprint arXiv …, 2024 - arxiv.org
Federated Learning (FL) models often experience client drift caused by heterogeneous data,
where the distribution of data differs across clients. To address this issue, advanced …

Personalized Federated Learning With Multi-View Geometry Structure

Y Yan, S Wang, F Sun, X Tong - IEEE Internet of Things Journal, 2024 - ieeexplore.ieee.org
Federated learning (FL) is a distributed machine learning paradigm ensuring data privacy.
However, the statistical heterogeneity poses a challenge to building a single model that can …

Accelerating Federated Learning via Sequential Training of Grouped Heterogeneous Clients

A Silvi, A Rizzardi, D Caldarola, B Caputo… - IEEE …, 2024 - ieeexplore.ieee.org
Federated Learning (FL) allows training machine learning models in privacy-constrained
scenarios by enabling the cooperation of edge devices without requiring local data sharing …

FedSoL: Bridging Global Alignment and Local Generality in Federated Learning

G Lee, M Jeong, S Kim, J Oh, SY Yun - arXiv preprint arXiv:2308.12532, 2023 - arxiv.org
Federated Learning (FL) aggregates locally trained models from individual clients to
construct a global model. While FL enables learning a model with data privacy, it often …