Byzantine machine learning: A primer

R Guerraoui, N Gupta, R Pinot - ACM Computing Surveys, 2024 - dl.acm.org
The problem of Byzantine resilience in distributed machine learning, aka Byzantine machine
learning, consists of designing distributed algorithms that can train an accurate model …

Iot malware analysis using federated learning: A comprehensive survey

M Venkatasubramanian, AH Lashkari, S Hakak - IEEE Access, 2023 - ieeexplore.ieee.org
The Internet of Things (IoT) has paved the way to a highly connected society where all things
are interconnected and exchanging information has become more accessible through the …

Exploiting shared representations for personalized federated learning

L Collins, H Hassani, A Mokhtari… - … on machine learning, 2021 - proceedings.mlr.press
Deep neural networks have shown the ability to extract universal feature representations
from data such as images and text that have been useful for a variety of learning tasks …

Proxskip: Yes! local gradient steps provably lead to communication acceleration! finally!

K Mishchenko, G Malinovsky, S Stich… - International …, 2022 - proceedings.mlr.press
We introduce ProxSkip—a surprisingly simple and provably efficient method for minimizing
the sum of a smooth ($ f $) and an expensive nonsmooth proximable ($\psi $) function. The …

Fednest: Federated bilevel, minimax, and compositional optimization

DA Tarzanagh, M Li… - … on Machine Learning, 2022 - proceedings.mlr.press
Standard federated optimization methods successfully apply to stochastic problems with
single-level structure. However, many contemporary ML problems-including adversarial …

Fedavg with fine tuning: Local updates lead to representation learning

L Collins, H Hassani, A Mokhtari… - Advances in Neural …, 2022 - proceedings.neurips.cc
Abstract The Federated Averaging (FedAvg) algorithm, which consists of alternating
between a few local stochastic gradient updates at client nodes, followed by a model …

Accelerated federated learning with decoupled adaptive optimization

J Jin, J Ren, Y Zhou, L Lyu, J Liu… - … on Machine Learning, 2022 - proceedings.mlr.press
The federated learning (FL) framework enables edge clients to collaboratively learn a
shared inference model while keeping privacy of training data on clients. Recently, many …

Communication-efficient device scheduling for federated learning using stochastic optimization

J Perazzone, S Wang, M Ji… - IEEE INFOCOM 2022 …, 2022 - ieeexplore.ieee.org
Federated learning (FL) is a useful tool in distributed machine learning that utilizes users'
local datasets in a privacy-preserving manner. When deploying FL in a constrained wireless …

SoteriaFL: A unified framework for private federated learning with communication compression

Z Li, H Zhao, B Li, Y Chi - Advances in Neural Information …, 2022 - proceedings.neurips.cc
To enable large-scale machine learning in bandwidth-hungry environments such as
wireless networks, significant progress has been made recently in designing communication …

Variance reduced proxskip: Algorithm, theory and application to federated learning

G Malinovsky, K Yi, P Richtárik - Advances in Neural …, 2022 - proceedings.neurips.cc
We study distributed optimization methods based on the {\em local training (LT)} paradigm,
ie, methods which achieve communication efficiency by performing richer local gradient …