Communication-efficient federated learning via knowledge distillation

C Wu, F Wu, L Lyu, Y Huang, X Xie - Nature communications, 2022 - nature.com
Federated learning is a privacy-preserving machine learning technique to train intelligent
models from decentralized data, which enables exploiting private data by communicating …

Preserving privacy in federated learning with ensemble cross-domain knowledge distillation

X Gong, A Sharma, S Karanam, Z Wu, T Chen… - Proceedings of the …, 2022 - ojs.aaai.org
Federated Learning (FL) is a machine learning paradigm where local nodes collaboratively
train a central model while the training data remains decentralized. Existing FL methods …

Fedmd: Heterogenous federated learning via model distillation

D Li, J Wang - arXiv preprint arXiv:1910.03581, 2019 - arxiv.org
Federated learning enables the creation of a powerful centralized model without
compromising data privacy of multiple participants. While successful, it does not incorporate …

Knowledge distillation for federated learning: a practical guide

A Mora, I Tenison, P Bellavista, I Rish - arXiv preprint arXiv:2211.04742, 2022 - arxiv.org
Federated Learning (FL) enables the training of Deep Learning models without centrally
collecting possibly sensitive raw data. This paves the way for stronger privacy guarantees …

Federated model distillation with noise-free differential privacy

L Sun, L Lyu - arXiv preprint arXiv:2009.05537, 2020 - arxiv.org
Conventional federated learning directly averages model weights, which is only possible for
collaboration between models with homogeneous architectures. Sharing prediction instead …

Fedclip: Fast generalization and personalization for clip in federated learning

W Lu, X Hu, J Wang, X Xie - arXiv preprint arXiv:2302.13485, 2023 - arxiv.org
Federated learning (FL) has emerged as a new paradigm for privacy-preserving
computation in recent years. Unfortunately, FL faces two critical challenges that hinder its …

Joint privacy enhancement and quantization in federated learning

N Lang, E Sofer, T Shaked… - IEEE Transactions on …, 2023 - ieeexplore.ieee.org
Federated learning (FL) is an emerging paradigm for training machine learning models
using possibly private data available at edge devices. The distributed operation of FL gives …

Communication-efficient vertical federated learning

A Khan, M ten Thij, A Wilbik - Algorithms, 2022 - mdpi.com
Federated learning (FL) is a privacy-preserving distributed learning approach that allows
multiple parties to jointly build machine learning models without disclosing sensitive data …

[HTML][HTML] Privacy-preserving Federated Learning and its application to natural language processing

B Nagy, I Hegedűs, N Sándor, B Egedi… - Knowledge-Based …, 2023 - Elsevier
State-of-the-art edge devices are capable of not only inferring machine learning (ML)
models but also training them on the device with local data. When this local data is sensitive …

DAdaQuant: Doubly-adaptive quantization for communication-efficient federated learning

R Hönig, Y Zhao, R Mullins - International Conference on …, 2022 - proceedings.mlr.press
Federated Learning (FL) is a powerful technique to train a model on a server with data from
several clients in a privacy-preserving manner. FL incurs significant communication costs …