Federated Learning via Input-Output Collaborative Distillation

X Gong, S Li, Y Bao, B Yao, Y Huang, Z Wu… - Proceedings of the …, 2024 - ojs.aaai.org
Federated learning (FL) is a machine learning paradigm in which distributed local nodes
collaboratively train a central model without sharing individually held private data. Existing …

Preserving privacy in federated learning with ensemble cross-domain knowledge distillation

X Gong, A Sharma, S Karanam, Z Wu, T Chen… - Proceedings of the …, 2022 - ojs.aaai.org
Federated Learning (FL) is a machine learning paradigm where local nodes collaboratively
train a central model while the training data remains decentralized. Existing FL methods …

Federated Learning Empowered by Generative Content

R Ye, X Zhu, J Chai, S Chen, Y Wang - arXiv preprint arXiv:2312.05807, 2023 - arxiv.org
Federated learning (FL) enables leveraging distributed private data for model training in a
privacy-preserving way. However, data heterogeneity significantly limits the performance of …

FedHPL: Efficient Heterogeneous Federated Learning with Prompt Tuning and Logit Distillation

Y Ma, L Cheng, Y Wang, Z Zhong, X Xu… - arXiv preprint arXiv …, 2024 - arxiv.org
Federated learning (FL) is a popular privacy-preserving paradigm that enables distributed
clients to collaboratively train models with a central server while keeping raw data locally. In …

Overcoming resource constraints in federated learning: Large models can be trained with only weak clients

Y Niu, S Prakash, S Kundu, S Lee… - … on Machine Learning …, 2023 - openreview.net
Federated Learning (FL) is emerging as a popular, promising decentralized learning
framework that enables collaborative training among clients, with no need to share private …

FedMap: Iterative Magnitude-Based Pruning for Communication-Efficient Federated Learning

A Herzog, R Southam, I Mavromatis, A Khan - arXiv preprint arXiv …, 2024 - arxiv.org
Federated Learning (FL) is a distributed machine learning approach that enables training on
decentralized data while preserving privacy. However, FL systems often involve resource …

Private federated learning with domain adaptation

D Peterson, P Kanani, VJ Marathe - arXiv preprint arXiv:1912.06733, 2019 - arxiv.org
Federated Learning (FL) is a distributed machine learning (ML) paradigm that enables
multiple parties to jointly re-train a shared model without sharing their data with any other …

Ensemble attention distillation for privacy-preserving federated learning

X Gong, A Sharma, S Karanam, Z Wu… - Proceedings of the …, 2021 - openaccess.thecvf.com
We consider the problem of Federated Learning (FL) where numerous decentralized
computational nodes collaborate with each other to train a centralized machine learning …

Fedclip: Fast generalization and personalization for clip in federated learning

W Lu, X Hu, J Wang, X Xie - arXiv preprint arXiv:2302.13485, 2023 - arxiv.org
Federated learning (FL) has emerged as a new paradigm for privacy-preserving
computation in recent years. Unfortunately, FL faces two critical challenges that hinder its …

DFRD: data-free robustness distillation for heterogeneous federated learning

K Luo, S Wang, Y Fu, X Li, Y Lan, M Gao - arXiv preprint arXiv:2309.13546, 2023 - arxiv.org
Federated Learning (FL) is a privacy-constrained decentralized machine learning paradigm
in which clients enable collaborative training without compromising private data. However …