Byzantine machine learning: A primer

R Guerraoui, N Gupta, R Pinot - ACM Computing Surveys, 2024 - dl.acm.org
The problem of Byzantine resilience in distributed machine learning, aka Byzantine machine
learning, consists of designing distributed algorithms that can train an accurate model …

Differential privacy and byzantine resilience in SGD: Do they add up?

R Guerraoui, N Gupta, R Pinot, S Rouault… - Proceedings of the 2021 …, 2021 - dl.acm.org
This paper addresses the problem of combining Byzantine resilience with privacy in
machine learning (ML). Specifically, we study if a distributed implementation of the …

zPROBE: Zero peek robustness checks for federated learning

Z Ghodsi, M Javaheripi, N Sheybani… - Proceedings of the …, 2023 - openaccess.thecvf.com
Privacy-preserving federated learning allows multiple users to jointly train a model with
coordination of a central server. The server only learns the final aggregation result, thereby …

Systemization of knowledge: robust deep learning using hardware-software co-design in centralized and federated settings

R Zhang, S Hussain, H Chen, M Javaheripi… - ACM Transactions on …, 2023 - dl.acm.org
Deep learning (DL) models are enabling a significant paradigm shift in a diverse range of
fields, including natural language processing and computer vision, as well as the design …

Zenops: A distributed learning system integrating communication efficiency and security

C Xie, O Koyejo, I Gupta - Algorithms, 2022 - mdpi.com
Distributed machine learning is primarily motivated by the promise of increased computation
power for accelerating training and mitigating privacy concerns. Unlike machine learning on …

On the advantages of P2P ML on mobile devices

R Basmadjian, K Boubouh, A Boussetta… - Proceedings of the …, 2022 - dl.acm.org
Many fields make use nowadays of machine learning (ML) enhanced applications for cost
optimization, scheduling or forecasting, including the energy sector. However, these very ML …

Practical Byzantine-resilient Stochastic Gradient Descent

SLA Rouault - 2022 - infoscience.epfl.ch
Algorithms are everywhere. The recipe for the frangipane cake is an algorithm. If all the
listed ingredients are available and the cook is sufficiently deft, after a finite number of small …

Byzantine-resilient multi-agent system

R Guerraoui, A Maurer - IEEE Transactions on Dependable …, 2021 - ieeexplore.ieee.org
We consider the problem of making a multi-agent system (MAS) resilient to Byzantine
failures through replication. We consider a very general model of MAS, where randomness …

Linear Scalarization for Byzantine-robust learning on non-IID data

L Errami, EH Bergou - arXiv preprint arXiv:2210.08287, 2022 - arxiv.org
In this work we study the problem of Byzantine-robust learning when data among clients is
heterogeneous. We focus on poisoning attacks targeting the convergence of SGD. Although …

Democratizing Machine Learning: Resilient Distributed Learning with Heterogeneous Participants

K Boubouh, A Boussetta, N Gupta… - 2022 41st …, 2022 - ieeexplore.ieee.org
The increasing prevalence of personal devices motivates the design of algorithms that can
leverage their computing power, together with the data they generate, in order to build …