Communication-efficient distributed learning: An overview

X Cao, T Başar, S Diggavi, YC Eldar… - IEEE journal on …, 2023 - ieeexplore.ieee.org
Distributed learning is envisioned as the bedrock of next-generation intelligent networks,
where intelligent agents, such as mobile devices, robots, and sensors, exchange information …

Gradient and channel aware dynamic scheduling for over-the-air computation in federated edge learning systems

J Du, B Jiang, C Jiang, Y Shi… - IEEE Journal on Selected …, 2023 - ieeexplore.ieee.org
To satisfy the expected plethora of computation-heavy applications, federated edge learning
(FEEL) is a new paradigm featuring distributed learning to carry the capacities of low-latency …

SPARQ-SGD: Event-triggered and compressed communication in decentralized optimization

N Singh, D Data, J George… - IEEE Transactions on …, 2022 - ieeexplore.ieee.org
In this article, we propose and analyze SParsified Action Regulated Quantized–Stochastic
Gradient Descent (SPARQ-SGD), a communication-efficient algorithm for decentralized …

Decentralized nonconvex optimization with guaranteed privacy and accuracy

Y Wang, T Başar - Automatica, 2023 - Elsevier
Privacy protection and nonconvexity are two challenging problems in decentralized
optimization and learning involving sensitive data. Despite some recent advances …

Event-triggered distributed stochastic mirror descent for convex optimization

M Xiong, B Zhang, DWC Ho, D Yuan… - IEEE Transactions on …, 2022 - ieeexplore.ieee.org
This article is concerned with the distributed convex constrained optimization over a time-
varying multiagent network in the non-Euclidean sense, where the bandwidth limitation of …

Distributed online adaptive gradient descent with event-triggered communication

K Oakamoto, N Hayashi, S Takai - IEEE Transactions on …, 2023 - ieeexplore.ieee.org
This article proposes an event-triggered adaptive gradient descent method for distributed
online optimization with a constraint set. In the proposed method, a group of agents …

Game-theoretic distributed empirical risk minimization with strategic network design

S Liu, T Li, Q Zhu - … on Signal and Information Processing over …, 2023 - ieeexplore.ieee.org
This article considers a game-theoretic framework for distributed empirical risk minimization
(ERM) problems over networks where the information acquisition at a node is modeled as a …

Event-triggered distributed online convex optimization with delayed bandit feedback

M Xiong, B Zhang, D Yuan, Y Zhang, J Chen - Applied Mathematics and …, 2023 - Elsevier
This paper is concerned with an online distributed convex-constrained optimization problem
over a multi-agent network, where the limited network bandwidth and potential feedback …

Privacy-preserving decentralized dual averaging for online optimization over directed networks

Q Lü, K Zhang, S Deng, Y Li, H Li… - IEEE Transactions on …, 2023 - ieeexplore.ieee.org
In this article, we study a decentralized online constrained optimization problem with a
common constraint set, in which the main purpose is to optimize the problem over a certain …

Asymptotic analysis of federated learning under event-triggered communication

X He, X Yi, Y Zhao, KH Johansson… - IEEE Transactions on …, 2023 - ieeexplore.ieee.org
Federated learning (FL) is a collaborative machine learning (ML) paradigm based on
persistent communication between a central server and multiple edge devices. However …