Communication-efficient distributed learning: An overview

X Cao, T Başar, S Diggavi, YC Eldar… - IEEE journal on …, 2023 - ieeexplore.ieee.org
Distributed learning is envisioned as the bedrock of next-generation intelligent networks,
where intelligent agents, such as mobile devices, robots, and sensors, exchange information …

Gradient and channel aware dynamic scheduling for over-the-air computation in federated edge learning systems

J Du, B Jiang, C Jiang, Y Shi… - IEEE Journal on Selected …, 2023 - ieeexplore.ieee.org
To satisfy the expected plethora of computation-heavy applications, federated edge learning
(FEEL) is a new paradigm featuring distributed learning to carry the capacities of low-latency …

Quantization enabled privacy protection in decentralized stochastic optimization

Y Wang, T Başar - IEEE Transactions on Automatic Control, 2022 - ieeexplore.ieee.org
By enabling multiple agents to cooperatively solve a global optimization problem in the
absence of a central coordinator, decentralized stochastic optimization is gaining increasing …

Service delay minimization for federated learning over mobile devices

R Chen, D Shi, X Qin, D Liu, M Pan… - IEEE Journal on …, 2023 - ieeexplore.ieee.org
Federated learning (FL) over mobile devices has fostered numerous intriguing
applications/services, many of which are delay-sensitive. In this paper, we propose a service …

Zero-regret performative prediction under inequality constraints

W Yan, X Cao - Advances in Neural Information Processing …, 2024 - proceedings.neurips.cc
Performative prediction is a recently proposed framework where predictions guide decision-
making and hence influence future data distributions. Such performative phenomena are …

Performance optimization for variable bitwidth federated learning in wireless networks

S Wang, M Chen, CG Brinton, C Yin… - IEEE Transactions on …, 2023 - ieeexplore.ieee.org
This paper considers improving wireless communication and computation efficiency in
federated learning (FL) via model quantization. In the proposed bitwidth FL scheme, edge …

Communication-efficient distributed learning over networks—Part I: Sufficient conditions for accuracy

Z Liu, A Conti, SK Mitter, MZ Win - IEEE Journal on Selected …, 2023 - ieeexplore.ieee.org
Distributed learning is an important task in emerging applications such as localization and
navigation, Internet-of-Things, and autonomous vehicles. This paper establishes a …

Communication-efficient distributed learning over networks—Part II: Necessary conditions for accuracy

Z Liu, A Conti, SK Mitter, MZ Win - IEEE Journal on Selected …, 2023 - ieeexplore.ieee.org
Distributed learning is crucial for many applications such as localization and tracking,
autonomy, and crowd sensing. This paper investigates communication-efficient distributed …

Decentralized online convex optimization with compressed communications

X Cao, T Başar - Automatica, 2023 - Elsevier
Due to the iterative information exchange between agents, decentralized multi-agent
optimization algorithms often incur large communication overhead, which is not affordable in …

SWIFT: Rapid decentralized federated learning via wait-free model communication

M Bornstein, T Rabbani, E Wang, AS Bedi… - arXiv preprint arXiv …, 2022 - arxiv.org
The decentralized Federated Learning (FL) setting avoids the role of a potentially unreliable
or untrustworthy central host by utilizing groups of clients to collaboratively train a model via …