A survey on federated learning for resource-constrained IoT devices

A Imteaj, U Thakker, S Wang, J Li… - IEEE Internet of Things …, 2021 - ieeexplore.ieee.org
Federated learning (FL) is a distributed machine learning strategy that generates a global
model by learning from multiple decentralized edge clients. FL enables on-device training …

Demystifying parallel and distributed deep learning: An in-depth concurrency analysis

T Ben-Nun, T Hoefler - ACM Computing Surveys (CSUR), 2019 - dl.acm.org
Deep Neural Networks (DNNs) are becoming an important tool in modern computing
applications. Accelerating their training is a major challenge and techniques range from …

Federated multi-task learning under a mixture of distributions

O Marfoq, G Neglia, A Bellet… - Advances in Neural …, 2021 - proceedings.neurips.cc
The increasing size of data generated by smartphones and IoT devices motivated the
development of Federated Learning (FL), a framework for on-device collaborative training of …

Federated learning with buffered asynchronous aggregation

J Nguyen, K Malik, H Zhan… - International …, 2022 - proceedings.mlr.press
Scalability and privacy are two critical concerns for cross-device federated learning (FL)
systems. In this work, we identify that synchronous FL–cannot scale efficiently beyond a few …

Advances and open problems in federated learning

P Kairouz, HB McMahan, B Avent… - … and trends® in …, 2021 - nowpublishers.com
Federated learning (FL) is a machine learning setting where many clients (eg, mobile
devices or whole organizations) collaboratively train a model under the orchestration of a …

[HTML][HTML] Privacy preservation in federated learning: An insightful survey from the GDPR perspective

N Truong, K Sun, S Wang, F Guitton, YK Guo - Computers & Security, 2021 - Elsevier
In recent years, along with the blooming of Machine Learning (ML)-based applications and
services, ensuring data privacy and security have become a critical obligation. ML-based …

Asynchronous federated optimization

C Xie, S Koyejo, I Gupta - arXiv preprint arXiv:1903.03934, 2019 - arxiv.org
Federated learning enables training on a massive number of edge devices. To improve
flexibility and scalability, we propose a new asynchronous federated optimization algorithm …

Decentralized federated averaging

T Sun, D Li, B Wang - IEEE Transactions on Pattern Analysis …, 2022 - ieeexplore.ieee.org
Federated averaging (FedAvg) is a communication-efficient algorithm for distributed training
with an enormous number of clients. In FedAvg, clients keep their data locally for privacy …

Adaptive federated learning in resource constrained edge computing systems

S Wang, T Tuor, T Salonidis, KK Leung… - IEEE journal on …, 2019 - ieeexplore.ieee.org
Emerging technologies and applications including Internet of Things, social networking, and
crowd-sourcing generate large amounts of data at the network edge. Machine learning …

Parallel restarted SGD with faster convergence and less communication: Demystifying why model averaging works for deep learning

H Yu, S Yang, S Zhu - Proceedings of the AAAI conference on artificial …, 2019 - ojs.aaai.org
In distributed training of deep neural networks, parallel minibatch SGD is widely used to
speed up the training process by using multiple workers. It uses multiple workers to sample …