Communication-efficient distributed learning: An overview

X Cao, T Başar, S Diggavi, YC Eldar… - IEEE journal on …, 2023 - ieeexplore.ieee.org
Distributed learning is envisioned as the bedrock of next-generation intelligent networks,
where intelligent agents, such as mobile devices, robots, and sensors, exchange information …

Distributed learning for wireless communications: Methods, applications and challenges

L Qian, P Yang, M Xiao, OA Dobre… - IEEE Journal of …, 2022 - ieeexplore.ieee.org
With its privacy-preserving and decentralized features, distributed learning plays an
irreplaceable role in the era of wireless networks with a plethora of smart terminals, an …

Distributed learning in wireless networks: Recent progress and future challenges

M Chen, D Gündüz, K Huang, W Saad… - IEEE Journal on …, 2021 - ieeexplore.ieee.org
The next-generation of wireless networks will enable many machine learning (ML) tools and
applications to efficiently analyze various types of data collected by edge devices for …

Communication-efficient distributed learning via lazily aggregated quantized gradients

J Sun, T Chen, G Giannakis… - Advances in Neural …, 2019 - proceedings.neurips.cc
The present paper develops a novel aggregated gradient approach for distributed machine
learning that adaptively compresses the gradient communication. The key idea is to first …

On maintaining linear convergence of distributed learning and optimization under limited communication

S Magnússon, H Shokri-Ghadikolaei… - IEEE Transactions on …, 2020 - ieeexplore.ieee.org
In distributed optimization and machine learning, multiple nodes coordinate to solve large
problems. To do this, the nodes need to compress important algorithm information to bits so …

[HTML][HTML] Straggler-aware distributed learning: Communication–computation latency trade-off

E Ozfatura, S Ulukus, D Gündüz - Entropy, 2020 - mdpi.com
When gradient descent (GD) is scaled to many parallel workers for large-scale machine
learning applications, its per-iteration computation time is limited by straggling workers …

Communication-efficient and distributed learning over wireless networks: Principles and applications

J Park, S Samarakoon, A Elgabli, J Kim… - Proceedings of the …, 2021 - ieeexplore.ieee.org
Machine learning (ML) is a promising enabler for the fifth-generation (5G) communication
systems and beyond. By imbuing intelligence into the network edge, edge nodes can …

Decentralized federated learning with unreliable communications

H Ye, L Liang, GY Li - IEEE journal of selected topics in signal …, 2022 - ieeexplore.ieee.org
Decentralized federated learning, inherited from decentralized learning, enables the edge
devices to collaborate on model training in a peer-to-peer manner without the assistance of …

Communication-efficient distributed deep learning: A comprehensive survey

Z Tang, S Shi, W Wang, B Li, X Chu - arXiv preprint arXiv:2003.06307, 2020 - arxiv.org
Distributed deep learning (DL) has become prevalent in recent years to reduce training time
by leveraging multiple computing devices (eg, GPUs/TPUs) due to larger models and …

Distributed learning in the nonconvex world: From batch data to streaming and beyond

TH Chang, M Hong, HT Wai… - IEEE Signal Processing …, 2020 - ieeexplore.ieee.org
Distributed learning has become a critical enabler of the massively connected world that
many people envision. This article discusses four key elements of scalable distributed …