Federated learning review: Fundamentals, enabling technologies, and future applications

S Banabilah, M Aloqaily, E Alsayed, N Malik… - Information processing & …, 2022 - Elsevier
Federated Learning (FL) has been foundational in improving the performance of a wide
range of applications since it was first introduced by Google. Some of the most prominent …

Federated learning meets natural language processing: A survey

M Liu, S Ho, M Wang, L Gao, Y Jin, H Zhang - arXiv preprint arXiv …, 2021 - arxiv.org
Federated Learning aims to learn machine learning models from multiple decentralized
edge devices (eg mobiles) or servers without sacrificing local data privacy. Recent Natural …

A survey of what to share in federated learning: Perspectives on model utility, privacy leakage, and communication efficiency

J Shao, Z Li, W Sun, T Zhou, Y Sun, L Liu, Z Lin… - arXiv preprint arXiv …, 2023 - arxiv.org
Federated learning (FL) has emerged as a secure paradigm for collaborative training among
clients. Without data centralization, FL allows clients to share local information in a privacy …

Fedprompt: Communication-efficient and privacy-preserving prompt tuning in federated learning

H Zhao, W Du, F Li, P Li, G Liu - ICASSP 2023-2023 IEEE …, 2023 - ieeexplore.ieee.org
Federated learning (FL) has enabled global model training on decentralized data in a
privacy-preserving way. However, for tasks that utilize pre-trained language models (PLMs) …

Selective knowledge sharing for privacy-preserving federated distillation without a good teacher

J Shao, F Wu, J Zhang - Nature Communications, 2024 - nature.com
While federated learning (FL) is promising for efficient collaborative learning without
revealing local data, it remains vulnerable to white-box privacy attacks, suffers from high …

Scaling language model size in cross-device federated learning

JH Ro, T Breiner, L McConnaughey, M Chen… - arXiv preprint arXiv …, 2022 - arxiv.org
Most studies in cross-device federated learning focus on small models, due to the server-
client communication and on-device computation bottlenecks. In this work, we leverage …

A tutorial on federated learning from theory to practice: Foundations, software frameworks, exemplary use cases, and selected trends

MV Luzón, N Rodríguez-Barroso… - IEEE/CAA Journal of …, 2024 - ieeexplore.ieee.org
When data privacy is imposed as a necessity, Federated learning (FL) emerges as a
relevant artificial intelligence field for developing machine learning (ML) models in a …

Private heterogeneous federated learning without a trusted server revisited: Error-optimal and communication-efficient algorithms for convex losses

C Gao, A Lowy, X Zhou, SJ Wright - arXiv preprint arXiv:2407.09690, 2024 - arxiv.org
We revisit the problem of federated learning (FL) with private data from people who do not
trust the server or other silos/clients. In this context, every silo (eg hospital) has data from …

On Disentanglement of Asymmetrical Knowledge Transfer for Modality-Task Agnostic Federated Learning

J Chen, A Zhang - Proceedings of the AAAI Conference on Artificial …, 2024 - ojs.aaai.org
There has been growing concern regarding data privacy during the development and
deployment of Multimodal Foundation Models for Artificial General Intelligence (AGI), while …

Federated split bert for heterogeneous text classification

Z Lit, S Sit, J Wang, J Xiao - 2022 International Joint Conference …, 2022 - ieeexplore.ieee.org
Pre-trained BERT models have achieved impressive performance in many natural language
processing (NLP) tasks. However, in many real-world situations, textual data are usually …