Federated Distillation: A Survey

L Li, J Gou, B Yu, L Du, ZYD Tao - arXiv preprint arXiv:2404.08564, 2024 - arxiv.org
Federated Learning (FL) seeks to train a model collaboratively without sharing private
training data from individual clients. Despite its promise, FL encounters challenges such as …

Like attracts like: Personalized federated learning in decentralized edge computing

Z Ma, Y Xu, H Xu, J Liu, Y Xue - IEEE Transactions on Mobile …, 2022 - ieeexplore.ieee.org
The emerging Personalized Federated Learning (PFL) methods aim to produce
personalized models for different users, so as to keep track of their individualized …

Joint selection of local trainers and resource allocation for federated learning in open RAN intelligent controllers

AK Singh, KK Nguyen - 2022 IEEE Wireless Communications …, 2022 - ieeexplore.ieee.org
Recently, Federated Learning (FL) has been applied in various research domains specially
because of its privacy preserving and decentralized approach of model training. However …

DPP-based client selection for federated learning with non-iid data

Y Zhang, C Xu, HH Yang, X Wang… - ICASSP 2023-2023 …, 2023 - ieeexplore.ieee.org
This paper proposes a client selection (CS) method to tackle the communication bottleneck
of federated learning (FL) while concurrently coping with FL's data heterogeneity issue …

Quantization and knowledge distillation for efficient federated learning on edge devices

X Qu, J Wang, J Xiao - … Conference on Smart City; IEEE 6th …, 2020 - ieeexplore.ieee.org
Federated learning enables distributed machine learning for decentralized data on edge
devices. As communication is a critical bottleneck for federated learning, we utilize model …

Joint Local Relational Augmentation and Global Nash Equilibrium for Federated Learning with Non-IID Data

X Liao, C Chen, W Liu, P Zhou, H Zhu, S Shen… - Proceedings of the 31st …, 2023 - dl.acm.org
Federated learning (FL) is a distributed machine learning paradigm that needs collaboration
between a server and a series of clients with decentralized data. To make FL effective in real …

Federated learning by employing knowledge distillation on edge devices with limited hardware resources

E Tanghatari, M Kamal, A Afzali-Kusha, M Pedram - Neurocomputing, 2023 - Elsevier
This paper presents a federated learning approach based on utilizing computational
resources of the IoT edge devices for training deep neural networks. In this approach, the …

Fedmmd: Heterogenous federated learning based on multi-teacher and multi-feature distillation

Q Yang, J Chen, X Yin, J Xie… - 2022 7th International …, 2022 - ieeexplore.ieee.org
Federated distillation, a new algorithmic paradigm in Federated learning, enables clients to
train different network architectures. In federated distillation, students can learn information …

[HTML][HTML] Intelligent digital twin for federated learning in aiot networks

A Rizwan, R Ahmad, AN Khan, R Xu, DH Kim - Internet of Things, 2023 - Elsevier
Federated Learning (FL) promises to solve the data privacy problem by training the local
model on each node and sharing the model parameters instead of the data itself. Next, the …

Communication-efficient diffusion strategy for performance improvement of federated learning with non-iid data

S Ahn, S Kim, Y Kwon, J Park, J Youn… - arXiv preprint arXiv …, 2022 - arxiv.org
Federated learning (FL) is a novel learning paradigm that addresses the privacy leakage
challenge of centralized learning. However, in FL, users with non-independent and …