Communication-efficient and distributed learning over wireless networks: Principles and applications

J Park, S Samarakoon, A Elgabli, J Kim… - Proceedings of the …, 2021 - ieeexplore.ieee.org
Machine learning (ML) is a promising enabler for the fifth-generation (5G) communication
systems and beyond. By imbuing intelligence into the network edge, edge nodes can …

6G white paper on edge intelligence

E Peltonen, M Bennis, M Capobianco… - arXiv preprint arXiv …, 2020 - arxiv.org
In this white paper we provide a vision for 6G Edge Intelligence. Moving towards 5G and
beyond the future 6G networks, intelligent solutions utilizing data-driven machine learning …

Federated and meta learning over non-wireless and wireless networks: A tutorial

X Liu, Y Deng, A Nallanathan, M Bennis - arXiv preprint arXiv:2210.13111, 2022 - arxiv.org
In recent years, various machine learning (ML) solutions have been developed to solve
resource management, interference management, autonomy, and decision-making …

Heterosag: Secure aggregation with heterogeneous quantization in federated learning

AR Elkordy, AS Avestimehr - IEEE Transactions on …, 2022 - ieeexplore.ieee.org
Secure model aggregation across many users is a key component of federated learning
systems. The state-of-the-art protocols for secure model aggregation, which are based on …

Dynamic aggregation for heterogeneous quantization in federated learning

S Chen, C Shen, L Zhang… - IEEE Transactions on …, 2021 - ieeexplore.ieee.org
Communication is widely known as the primary bottleneck of federated learning, and
quantization of local model updates before uploading to the parameter server is an effective …

FedNew: A communication-efficient and privacy-preserving Newton-type method for federated learning

A Elgabli, CB Issaid, AS Bedi… - International …, 2022 - proceedings.mlr.press
Newton-type methods are popular in federated learning due to their fast convergence. Still,
they suffer from two main issues, namely: low communication efficiency and low privacy due …

Wireless edge machine learning: Resource allocation and trade-offs

M Merluzzi, P Di Lorenzo, S Barbarossa - IEEE Access, 2021 - ieeexplore.ieee.org
The aim of this paper is to propose a resource allocation strategy for dynamic training and
inference of machine learning tasks at the edge of the wireless network, with the goal of …

rTop-k: A Statistical Estimation Approach to Distributed SGD

LP Barnes, HA Inan, B Isik… - IEEE Journal on Selected …, 2020 - ieeexplore.ieee.org
The large communication cost for exchanging gradients between different nodes
significantly limits the scalability of distributed training for large-scale learning models …

Two-stage community energy trading under end-edge-cloud orchestration

X Li, C Li, X Liu, G Chen… - IEEE Internet of Things …, 2022 - ieeexplore.ieee.org
The end-edge-cloud orchestration of the virtual power plant (VPP) enables the edge server
to timely serve community users. By deploying the community energy storage system …

Distributed learning with sparsified gradient differences

Y Chen, RS Blum, M Takáč… - IEEE Journal of Selected …, 2022 - ieeexplore.ieee.org
A very large number of communications are typically required to solve distributed learning
tasks, and this critically limits scalability and convergence speed in wireless communications …