Federated and meta learning over non-wireless and wireless networks: A tutorial

X Liu, Y Deng, A Nallanathan, M Bennis - arXiv preprint arXiv:2210.13111, 2022 - arxiv.org
In recent years, various machine learning (ML) solutions have been developed to solve
resource management, interference management, autonomy, and decision-making …

FedNew: A communication-efficient and privacy-preserving Newton-type method for federated learning

A Elgabli, CB Issaid, AS Bedi… - International …, 2022 - proceedings.mlr.press
Newton-type methods are popular in federated learning due to their fast convergence. Still,
they suffer from two main issues, namely: low communication efficiency and low privacy due …

Communication and Energy Efficient Decentralized Learning over D2D Networks

S Liu, G Yu, D Wen, X Chen, M Bennis… - IEEE Transactions on …, 2023 - ieeexplore.ieee.org
Device-to-device (D2D)-assisted decentralized learning has been proposed for mobile
devices to collaboratively train artificial intelligence networks without the centralized …

Federated Learning and Meta Learning: Approaches, Applications, and Directions

X Liu, Y Deng, A Nallanathan… - … Surveys & Tutorials, 2023 - ieeexplore.ieee.org
Over the past few years, significant advancements have been made in the field of machine
learning (ML) to address resource management, interference management, autonomy, and …

On the decentralized stochastic gradient descent with markov chain sampling

T Sun, D Li, B Wang - IEEE Transactions on Signal Processing, 2023 - ieeexplore.ieee.org
The decentralized stochastic gradient method emerges as a promising solution for solving
large-scale machine learning problems. This paper studies the decentralized Markov chain …

Communication-efficient federated learning: A second order newton-type method with analog over-the-air aggregation

M Krouka, A Elgabli, CB Issaid… - IEEE Transactions on …, 2022 - ieeexplore.ieee.org
Owing to their fast convergence, second-order Newton-type learning methods have recently
received attention in the federated learning (FL) setting. However, current solutions are …

Decentralized ADMM with compressed and event-triggered communication

Z Zhang, S Yang, W Xu - Neural Networks, 2023 - Elsevier
This paper considers the decentralized optimization problem, where agents in a network
cooperate to minimize the sum of their local objective functions by communication and local …

DIN: A decentralized inexact Newton algorithm for consensus optimization

A Ghalkha, CB Issaid, A Elgabli… - IEEE Transactions on …, 2024 - ieeexplore.ieee.org
This paper tackles a challenging decentralized consensus optimization problem defined
over a network of interconnected devices. The devices work collaboratively to solve a …

DR-DSGD: A distributionally robust decentralized learning algorithm over graphs

CB Issaid, A Elgabli, M Bennis - arXiv preprint arXiv:2208.13810, 2022 - arxiv.org
In this paper, we propose to solve a regularized distributionally robust learning problem in
the decentralized setting, taking into account the data distribution shift. By adding a Kullback …

Decentralized Over-the-Air Federated Learning by Second-Order Optimization Method

P Yang, Y Jiang, D Wen, T Wang… - IEEE Transactions on …, 2023 - ieeexplore.ieee.org
Federated learning (FL) is an emerging technique that enables privacy-preserving
distributed learning. Most related works focus on centralized FL, which leverages the …