Heterogeneous federated learning: State-of-the-art and research challenges

M Ye, X Fang, B Du, PC Yuen, D Tao - ACM Computing Surveys, 2023 - dl.acm.org
Federated learning (FL) has drawn increasing attention owing to its potential use in large-
scale industrial applications. Existing FL works mainly focus on model homogeneous …

End-edge-cloud collaborative computing for deep learning: A comprehensive survey

Y Wang, C Yang, S Lan, L Zhu… - … Surveys & Tutorials, 2024 - ieeexplore.ieee.org
The booming development of deep learning applications and services heavily relies on
large deep learning models and massive data in the cloud. However, cloud-based deep …

Fine-tuning global model via data-free knowledge distillation for non-iid federated learning

L Zhang, L Shen, L Ding, D Tao… - Proceedings of the …, 2022 - openaccess.thecvf.com
Federated Learning (FL) is an emerging distributed learning paradigm under privacy
constraint. Data heterogeneity is one of the main challenges in FL, which results in slow …

Learn from others and be yourself in heterogeneous federated learning

W Huang, M Ye, B Du - … of the IEEE/CVF Conference on …, 2022 - openaccess.thecvf.com
Federated learning has emerged as an important distributed learning paradigm, which
normally involves collaborative updating with others and local updating on private data …

Towards personalized federated learning

AZ Tan, H Yu, L Cui, Q Yang - IEEE Transactions on Neural …, 2022 - ieeexplore.ieee.org
In parallel with the rapid adoption of artificial intelligence (AI) empowered by advances in AI
research, there has been growing awareness and concerns of data privacy. Recent …

Robust federated learning with noisy and heterogeneous clients

X Fang, M Ye - Proceedings of the IEEE/CVF Conference …, 2022 - openaccess.thecvf.com
Abstract Model heterogeneous federated learning is a challenging task since each client
independently designs its own model. Due to the annotation difficulty and free-riding …

Generalized federated learning via sharpness aware minimization

Z Qu, X Li, R Duan, Y Liu, B Tang… - … conference on machine …, 2022 - proceedings.mlr.press
Federated Learning (FL) is a promising framework for performing privacy-preserving,
distributed learning with a set of clients. However, the data distribution among clients often …

Feddisco: Federated learning with discrepancy-aware collaboration

R Ye, M Xu, J Wang, C Xu, S Chen… - … on Machine Learning, 2023 - proceedings.mlr.press
This work considers the category distribution heterogeneity in federated learning. This issue
is due to biased labeling preferences at multiple clients and is a typical setting of data …

Towards building the federatedGPT: Federated instruction tuning

J Zhang, S Vahidian, M Kuo, C Li… - ICASSP 2024-2024 …, 2024 - ieeexplore.ieee.org
While" instruction-tuned" generative large language models (LLMs) have demonstrated an
impressive ability to generalize to new tasks, the training phases heavily rely on large …

Fedala: Adaptive local aggregation for personalized federated learning

J Zhang, Y Hua, H Wang, T Song, Z Xue… - Proceedings of the …, 2023 - ojs.aaai.org
A key challenge in federated learning (FL) is the statistical heterogeneity that impairs the
generalization of the global model on each client. To address this, we propose a method …