Partial synchronization to accelerate federated learning over relay-assisted edge networks

Z Qu, S Guo, H Wang, B Ye, Y Wang… - IEEE Transactions …, 2021 - ieeexplore.ieee.org
… —Federated Learning (FL) is a promising machine learning … aggregation and model
synchronization among large-scale … a novel synchronization scheme named Partial

Papaya: Practical, private, and scalable federated learning

D Huba, J Nguyen, K Malik, R Zhu… - … Machine Learning …, 2022 - proceedings.mlsys.org
Federated Learning (FL) is a distributed learning paradigm with several challenges that
differentiate it from traditional distributed learning, … – they perform a synchronized aggregation of …

Communication-efficient federated learning with adaptive parameter freezing

C Chen, H Xu, W Wang, B Li, B Li… - 2021 IEEE 41st …, 2021 - ieeexplore.ieee.org
… exclude them from synchronization (but still update them locally), and only synchronize the
rest of the model to the central server. We find that such a partial synchronization method may …

HADFL: Heterogeneity-aware decentralized federated learning framework

J Cao, Z Lian, W Liu, Z Zhu, C Ji - 2021 58th ACM/IEEE Design …, 2021 - ieeexplore.ieee.org
… other schemes, which is caused by our partial synchronization and local update strategy. In
[4, … By allowing more GPUs to participate in partial synchronization, the training effect can be …

Fedpa: An adaptively partial model aggregation strategy in federated learning

J Liu, JH Wang, C Rong, Y Xu, T Yu, J Wang - Computer Networks, 2021 - Elsevier
… goal in federated learning and has attracted attention from many researchers. Parameter
synchronization (… synchronization, ie, communication efficiency problem and straggler problem. …

Synchronize only the immature parameters: Communication-efficient federated learning by freezing parameters adaptively

C Chen, H Xu, W Wang, B Li, B Li… - IEEE Transactions on …, 2023 - ieeexplore.ieee.org
… Abstract—Federated learning allows edge devices to collaboratively train a global …
synchronize the rest of the model to the central server. We find that such a partial synchronization

Decentralized federated learning: A segmented gossip approach

C Hu, J Jiang, Z Wang - arXiv preprint arXiv:1908.07782, 2019 - arxiv.org
federated learning, which allows nodes to only synchronize the locally-trained models instead
their own original data. Conventional federated learning … , in real-world federated learning

[PDF][PDF] Elfish: Resource-aware federated learning on heterogeneous edge devices

Z Xu, Z Yang, J Xiong, J Yang, X Chen - Ratio, 2019 - researchgate.net
… We can easily find that, synchronized federated learning will achieve the best
convergence in terms of accuracy and speed. While, when the asynchronized straggler parameter …

[HTML][HTML] Asynchronous federated learning system based on permissioned blockchains

R Wang, WT Tsai - Sensors, 2022 - mdpi.com
… system based on permissioned blockchains that can effectively alleviate the overhead of
the synchronous federated learning algorithm on the synchronization problem, while the …

Semi-synchronous federated learning for energy-efficient training and accelerated convergence in cross-silo settings

D Stripelis, PM Thompson, JL Ambite - ACM Transactions on Intelligent …, 2022 - dl.acm.org
… In this work, we introduce a novel energy-efficient Semi-Synchronous Federated Learning
… We define the synchronization time period based on the data amounts and computational …