Efficient split-mix federated learning for on-demand and in-situ customization

J Hong, H Wang, Z Wang, J Zhou - arXiv preprint arXiv:2203.09747, 2022 - arxiv.org
Federated learning (FL) provides a distributed learning framework for multiple participants to
collaborate learning without sharing raw data. In many practical FL scenarios, participants …

HADFL: Heterogeneity-aware decentralized federated learning framework

J Cao, Z Lian, W Liu, Z Zhu, C Ji - 2021 58th ACM/IEEE Design …, 2021 - ieeexplore.ieee.org
Federated learning (FL) supports training models on geographically distributed devices.
However, traditional FL systems adopt a centralized synchronous strategy, putting high …

Speed up federated learning in heterogeneous environment: A dynamic tiering approach

SMS Mohammadabadi, S Zawad, F Yan… - arXiv preprint arXiv …, 2023 - arxiv.org
Federated learning (FL) enables collaboratively training a model while keeping the training
data decentralized and private. However, one significant impediment to training a model …

Tailorfl: Dual-personalized federated learning under system and data heterogeneity

Y Deng, W Chen, J Ren, F Lyu, Y Liu, Y Liu… - Proceedings of the 20th …, 2022 - dl.acm.org
Federated learning (FL) enables distributed mobile devices to collaboratively learn a shared
model without exposing their raw data. However, heterogeneous devices usually have …

Fedtune: A deep dive into efficient federated fine-tuning with pre-trained transformers

J Chen, W Xu, S Guo, J Wang, J Zhang… - arXiv preprint arXiv …, 2022 - arxiv.org
Federated Learning (FL) is an emerging paradigm that enables distributed users to
collaboratively and iteratively train machine learning models without sharing their private …

Zerofl: Efficient on-device training for federated learning with local sparsity

X Qiu, J Fernandez-Marques, PPB Gusmao… - arXiv preprint arXiv …, 2022 - arxiv.org
When the available hardware cannot meet the memory and compute requirements to
efficiently train high performing machine learning models, a compromise in either the …

Motley: Benchmarking heterogeneity and personalization in federated learning

S Wu, T Li, Z Charles, Y Xiao, Z Liu, Z Xu… - arXiv preprint arXiv …, 2022 - arxiv.org
Personalized federated learning considers learning models unique to each client in a
heterogeneous network. The resulting client-specific models have been purported to …

Gpt-fl: Generative pre-trained model-assisted federated learning

T Zhang, T Feng, S Alam, D Dimitriadis… - arXiv preprint arXiv …, 2023 - arxiv.org
In this work, we propose GPT-FL, a generative pre-trained model-assisted federated
learning (FL) framework. At its core, GPT-FL leverages generative pre-trained models to …

[PDF][PDF] Fedat: A communication-efficient federated learning method with asynchronous tiers under non-iid data

Z Chai, Y Chen, L Zhao, Y Cheng, H Rangwala - ArXivorg, 2020 - par.nsf.gov
Federated learning (FL) involves training a model over massive distributed devices, while
keeping the training data localized. This form of collaborative learning exposes new …

[PDF][PDF] Oort: Informed participant selection for scalable federated learning

F Lai, X Zhu, HV Madhyastha… - arXiv preprint arXiv …, 2020 - sands.kaust.edu.sa
Federated Learning (FL) is an emerging direction in distributed machine learning (ML) that
enables in-situ model training and testing on edge data. Despite having the same end goals …