[PDF][PDF] Understanding federated learning through loss landscape visualizations: A pilot study

Z Li, HY Chen, HW Shen, WLC Chao - NeurIPS 2022, 2022 - par.nsf.gov
Federated learning aims to train a machine learning model (eg, a neural network) in a data-
decentralized fashion. The key challenge is the potential data heterogeneity among clients …

What do we mean by generalization in federated learning?

H Yuan, W Morningstar, L Ning, K Singhal - arXiv preprint arXiv …, 2021 - arxiv.org
Federated learning data is drawn from a distribution of distributions: clients are drawn from a
meta-distribution, and their data are drawn from local data distributions. Thus generalization …

Understanding and improving model averaging in federated learning on heterogeneous data

T Zhou, Z Lin, J Zhang… - IEEE Transactions on …, 2024 - ieeexplore.ieee.org
Model averaging is a widely adopted technique in federated learning (FL) that aggregates
multiple client models to obtain a global model. Remarkably, model averaging in FL yields a …

FLex&Chill: Improving Local Federated Learning Training with Logit Chilling

K Lee, S Kim, JG Ko - arXiv preprint arXiv:2401.09986, 2024 - arxiv.org
Federated learning are inherently hampered by data heterogeneity: non-iid distributed
training data over local clients. We propose a novel model training approach for federated …

On large-cohort training for federated learning

Z Charles, Z Garrett, Z Huo… - Advances in neural …, 2021 - proceedings.neurips.cc
Federated learning methods typically learn a model by iteratively sampling updates from a
population of clients. In this work, we explore how the number of clients sampled at each …

Maximizing global model appeal in federated learning

YJ Cho, D Jhunjhunwala, T Li, V Smith… - arXiv preprint arXiv …, 2022 - arxiv.org
Federated learning typically considers collaboratively training a global model using local
data at edge clients. Clients may have their own individual requirements, such as having a …

Mode connectivity and data heterogeneity of federated learning

T Zhou, J Zhang, DHK Tsang - arXiv preprint arXiv:2309.16923, 2023 - arxiv.org
Federated learning (FL) enables multiple clients to train a model while keeping their data
private collaboratively. Previous studies have shown that data heterogeneity between clients …

Understanding and mitigating dimensional collapse in federated learning

Y Shi, J Liang, W Zhang, C Xue… - IEEE Transactions on …, 2023 - ieeexplore.ieee.org
Federated learning aims to train models collaboratively across different clients without
sharing data for privacy considerations. However, one major challenge for this learning …

Federated learning with server learning: Enhancing performance for non-iid data

VS Mai, RJ La, T Zhang - arXiv preprint arXiv:2210.02614, 2022 - arxiv.org
Federated Learning (FL) has emerged as a means of distributed learning using local data
stored at clients with a coordinating server. Recent studies showed that FL can suffer from …

Prototype helps federated learning: Towards faster convergence

Y Qiao, SB Park, SM Kang, CS Hong - arXiv preprint arXiv:2303.12296, 2023 - arxiv.org
Federated learning (FL) is a distributed machine learning technique in which multiple clients
cooperate to train a shared model without exchanging their raw data. However …