Automated federated pipeline for parameter-efficient fine-tuning of large language models

Z Fang, Z Lin, Z Chen, X Chen, Y Gao… - arXiv preprint arXiv …, 2024 - arxiv.org
Recently, there has been a surge in the development of advanced intelligent generative
content (AIGC), especially large language models (LLMs). However, for many downstream …

Adaptive asynchronous federated learning

R Lu, W Zhang, Q Li, H He, X Zhong, H Yang… - Future Generation …, 2024 - Elsevier
Federated Learning enables data owners to train an artificial intelligence model
collaboratively while keeping all the training data locally, reducing the possibility of personal …

PI-Fed: Continual Federated Learning With Parameter-Level Importance Aggregation

L Yu, L Ge, G Wang, J Yin, Q Chen… - IEEE Internet of Things …, 2024 - ieeexplore.ieee.org
Federated Learning (FL) has drawn much attention for distributed system over the Internet of
Things (IoT), since it enables collaborative machine learning on heterogeneous devices …

FLHetBench: Benchmarking Device and State Heterogeneity in Federated Learning

J Zhang, S Zeng, M Zhang, R Wang… - Proceedings of the …, 2024 - openaccess.thecvf.com
Federated learning (FL) is a powerful technology that enables collaborative training of
machine learning models without sharing private data among clients. The fundamental …

Artificial intelligence of things: A survey

SI Siam, H Ahn, L Liu, S Alam, H Shen, Z Cao… - ACM Transactions on …, 2024 - dl.acm.org
The integration of the Internet of Things (IoT) and modern Artificial Intelligence (AI) has given
rise to a new paradigm known as the Artificial Intelligence of Things (AIoT). In this survey, we …

FLOAT: Federated Learning Optimizations with Automated Tuning

AF Khan, AA Khan, AM Abdelmoniem… - Proceedings of the …, 2024 - dl.acm.org
Federated Learning (FL) has emerged as a powerful approach that enables collaborative
distributed model training without the need for data sharing. However, FL grapples with …

Asynchronous Local-SGD Training for Language Modeling

B Liu, R Chhaparia, A Douillard, S Kale… - arXiv preprint arXiv …, 2024 - arxiv.org
Local stochastic gradient descent (Local-SGD), also referred to as federated averaging, is
an approach to distributed optimization where each device performs more than one SGD …

Flrce: Resource-efficient federated learning with early-stopping strategy

Z Niu, H Dong, AK Qin, T Gu - IEEE Transactions on Mobile …, 2024 - ieeexplore.ieee.org
Federated Learning (FL) achieves great popularity in the Internet of Things (IoT) as a
powerful interface to offer intelligent services to customers while maintaining data privacy …

Adaptive Federated Learning via New Entropy Approach

S Zheng, W Yuan, X Wang… - IEEE Transactions on …, 2024 - ieeexplore.ieee.org
Federated Learning (FL) has emerged as a prominent distributed machine learning
framework that enables geographically discrete clients to train a global model …

FedTSA: A Cluster-based Two-Stage Aggregation Method for Model-heterogeneous Federated Learning

B Fan, C Wu, X Su, P Hui - arXiv preprint arXiv:2407.05098, 2024 - arxiv.org
Despite extensive research into data heterogeneity in federated learning (FL), system
heterogeneity remains a significant yet often overlooked challenge. Traditional FL …