Advances and open challenges in federated learning with foundation models

C Ren, H Yu, H Peng, X Tang, A Li, Y Gao… - arXiv preprint arXiv …, 2024 - arxiv.org
The integration of Foundation Models (FMs) with Federated Learning (FL) presents a
transformative paradigm in Artificial Intelligence (AI), offering enhanced capabilities while …

Position paper: Assessing robustness, privacy, and fairness in federated learning integrated with foundation models

X Li, J Wang - arXiv preprint arXiv:2402.01857, 2024 - arxiv.org
Federated Learning (FL), while a breakthrough in decentralized machine learning, contends
with significant challenges such as limited data availability and the variability of …

When foundation model meets federated learning: Motivations, challenges, and future directions

W Zhuang, C Chen, L Lyu - arXiv preprint arXiv:2306.15546, 2023 - arxiv.org
The intersection of the Foundation Model (FM) and Federated Learning (FL) provides mutual
benefits, presents a unique opportunity to unlock new possibilities in AI research, and …

Federated Learning: A Cutting-Edge Survey of the Latest Advancements and Applications

A Akhtarshenas, MA Vahedifar, N Ayoobi… - arXiv preprint arXiv …, 2023 - arxiv.org
In the realm of machine learning (ML) systems featuring client-host connections, the
enhancement of privacy security can be effectively achieved through federated learning (FL) …

A systematic literature review on federated learning: From a model quality perspective

Y Liu, L Zhang, N Ge, G Li - arXiv preprint arXiv:2012.01973, 2020 - arxiv.org
As an emerging technique, Federated Learning (FL) can jointly train a global model with the
data remaining locally, which effectively solves the problem of data privacy protection …

A survey on efficient federated learning methods for foundation model training

H Woisetschläger, A Isenko, S Wang, R Mayer… - arXiv preprint arXiv …, 2024 - arxiv.org
Federated Learning (FL) has become an established technique to facilitate privacy-
preserving collaborative training. However, new approaches to FL often discuss their …

Heterogeneous federated learning: State-of-the-art and research challenges

M Ye, X Fang, B Du, PC Yuen, D Tao - ACM Computing Surveys, 2023 - dl.acm.org
Federated learning (FL) has drawn increasing attention owing to its potential use in large-
scale industrial applications. Existing FL works mainly focus on model homogeneous …

A survey on heterogeneous federated learning

D Gao, X Yao, Q Yang - arXiv preprint arXiv:2210.04505, 2022 - arxiv.org
Federated learning (FL) has been proposed to protect data privacy and virtually assemble
the isolated data silos by cooperatively training models among organizations without …

FedSiKD: Clients Similarity and Knowledge Distillation: Addressing Non-iid and Constraints in Federated Learning

Y Alsenani, R Mishra, KR Ahmed… - arXiv preprint arXiv …, 2024 - arxiv.org
In recent years, federated learning (FL) has emerged as a promising technique for training
machine learning models in a decentralized manner while also preserving data privacy. The …

Which mode is better for federated learning? Centralized or Decentralized

Y Sun, L Shen, D Tao - arXiv preprint arXiv:2310.03461, 2023 - arxiv.org
Both centralized and decentralized approaches have shown excellent performance and
great application value in federated learning (FL). However, current studies do not provide …