Federated learning in edge computing: a systematic survey

HG Abreha, M Hayajneh, MA Serhani - Sensors, 2022 - mdpi.com
Edge Computing (EC) is a new architecture that extends Cloud Computing (CC) services
closer to data sources. EC combined with Deep Learning (DL) is a promising technology …

Communication-efficient distributed learning: An overview

X Cao, T Başar, S Diggavi, YC Eldar… - IEEE journal on …, 2023 - ieeexplore.ieee.org
Distributed learning is envisioned as the bedrock of next-generation intelligent networks,
where intelligent agents, such as mobile devices, robots, and sensors, exchange information …

Cocktailsgd: Fine-tuning foundation models over 500mbps networks

J Wang, Y Lu, B Yuan, B Chen… - International …, 2023 - proceedings.mlr.press
Distributed training of foundation models, especially large language models (LLMs), is
communication-intensive and so has heavily relied on centralized data centers with fast …

Federated learning with compression: Unified analysis and sharp guarantees

F Haddadpour, MM Kamani… - International …, 2021 - proceedings.mlr.press
In federated learning, communication cost is often a critical bottleneck to scale up distributed
optimization algorithms to collaboratively learn a model from millions of devices with …

Sparsified SGD with memory

SU Stich, JB Cordonnier… - Advances in neural …, 2018 - proceedings.neurips.cc
Huge scale machine learning problems are nowadays tackled by distributed optimization
algorithms, ie algorithms that leverage the compute power of many devices for training. The …

A survey of federated learning for edge computing: Research problems and solutions

Q Xia, W Ye, Z Tao, J Wu, Q Li - High-Confidence Computing, 2021 - Elsevier
Federated Learning is a machine learning scheme in which a shared prediction model can
be collaboratively learned by a number of distributed nodes using their locally stored data. It …

Machine learning at the wireless edge: Distributed stochastic gradient descent over-the-air

MM Amiri, D Gündüz - IEEE Transactions on Signal Processing, 2020 - ieeexplore.ieee.org
We study federated machine learning (ML) at the wireless edge, where power-and
bandwidth-limited wireless devices with local datasets carry out distributed stochastic …

Error feedback fixes signsgd and other gradient compression schemes

SP Karimireddy, Q Rebjock, S Stich… - … on Machine Learning, 2019 - proceedings.mlr.press
Sign-based algorithms (eg signSGD) have been proposed as a biased gradient
compression technique to alleviate the communication bottleneck in training large neural …

SAFA: A semi-asynchronous protocol for fast federated learning with low overhead

W Wu, L He, W Lin, R Mao, C Maple… - IEEE Transactions on …, 2020 - ieeexplore.ieee.org
Federated learning (FL) has attracted increasing attention as a promising approach to
driving a vast number of end devices with artificial intelligence. However, it is very …

Communication-efficient and distributed learning over wireless networks: Principles and applications

J Park, S Samarakoon, A Elgabli, J Kim… - Proceedings of the …, 2021 - ieeexplore.ieee.org
Machine learning (ML) is a promising enabler for the fifth-generation (5G) communication
systems and beyond. By imbuing intelligence into the network edge, edge nodes can …