Heterogeneous federated learning: State-of-the-art and research challenges

M Ye, X Fang, B Du, PC Yuen, D Tao - ACM Computing Surveys, 2023 - dl.acm.org
Federated learning (FL) has drawn increasing attention owing to its potential use in large-
scale industrial applications. Existing FL works mainly focus on model homogeneous …

Out-of-distribution generalization of federated learning via implicit invariant relationships

Y Guo, K Guo, X Cao, T Wu… - … Conference on Machine …, 2023 - proceedings.mlr.press
Out-of-distribution generalization is challenging for non-participating clients of federated
learning under distribution shifts. A proven strategy is to explore those invariant relationships …

Bayesian federated learning: A survey

L Cao, H Chen, X Fan, J Gama, YS Ong… - arXiv preprint arXiv …, 2023 - arxiv.org
Federated learning (FL) demonstrates its advantages in integrating distributed infrastructure,
communication, computing and learning in a privacy-preserving manner. However, the …

To Distill or Not To Distill: Towards Fast, Accurate and Communication Efficient Federated Distillation Learning

Y Zhang, W Zhang, L Pu, T Lin… - IEEE Internet of Things …, 2023 - ieeexplore.ieee.org
Apart from the promising potential, Federated Learning (FL) faces challenges such as high
communication costs and client heterogeneity. Although numerous works have been …

FGSS: Federated global self-supervised framework for large-scale unlabeled data

C Zhang, Z Xie, B Yu, C Wen, Y Xie - Applied Soft Computing, 2023 - Elsevier
Due to the unique advantages of collaborative learning on isolated yet unlabeled data,
federated self-supervised learning has received increasing attention from both academic …

Improved Communication Efficiency in Federated Natural Policy Gradient via ADMM-based Gradient Updates

G Lan, H Wang, J Anderson, C Brinton… - arXiv preprint arXiv …, 2023 - arxiv.org
Federated reinforcement learning (FedRL) enables agents to collaboratively train a global
policy without sharing their individual data. However, high communication overhead …

Incentive mechanism for federated learning based on random client sampling

H Wu, X Tang, YJA Zhang, L Gao - 2022 IEEE Globecom …, 2022 - ieeexplore.ieee.org
Federated learning (FL) is a distributed machine learning paradigm that enables edge
devices to participate in training as clients, and at the same time protect their privacy. Recent …

DIN: A decentralized inexact Newton algorithm for consensus optimization

A Ghalkha, CB Issaid, A Elgabli… - IEEE Transactions on …, 2024 - ieeexplore.ieee.org
This paper tackles a challenging decentralized consensus optimization problem defined
over a network of interconnected devices. The devices work collaboratively to solve a …

[HTML][HTML] SHED: A Newton-type algorithm for federated learning based on incremental Hessian eigenvector sharing

N Dal Fabbro, S Dey, M Rossi, L Schenato - Automatica, 2024 - Elsevier
There is a growing interest in the distributed optimization framework that goes under the
name of Federated Learning (FL). In particular, much attention is being turned to FL …

Communication-efficient and privacy-preserving large-scale federated learning counteracting heterogeneity

X Zhou, G Yang - Information Sciences, 2024 - Elsevier
Federated learning is a commonly distributed framework for large-scale learning, where a
model is learned over massively distributed remote devices without sharing information on …