Explainable AI (XAI): Core ideas, techniques, and solutions

R Dwivedi, D Dave, H Naik, S Singhal, R Omer… - ACM Computing …, 2023 - dl.acm.org
As our dependence on intelligent machines continues to grow, so does the demand for more
transparent and interpretable models. In addition, the ability to explain the model generally …

A survey on distributed machine learning

J Verbraeken, M Wolting, J Katzy… - Acm computing surveys …, 2020 - dl.acm.org
The demand for artificial intelligence has grown significantly over the past decade, and this
growth has been fueled by advances in machine learning techniques and the ability to …

Efficient large-scale language model training on gpu clusters using megatron-lm

D Narayanan, M Shoeybi, J Casper… - Proceedings of the …, 2021 - dl.acm.org
Large language models have led to state-of-the-art accuracies across several tasks.
However, training these models efficiently is challenging because: a) GPU memory capacity …

A survey on federated learning

C Zhang, Y Xie, H Bai, B Yu, W Li, Y Gao - Knowledge-Based Systems, 2021 - Elsevier
Federated learning is a set-up in which multiple clients collaborate to solve machine
learning problems, which is under the coordination of a central aggregator. This setting also …

Privacy preserving machine learning with homomorphic encryption and federated learning

H Fang, Q Qian - Future Internet, 2021 - mdpi.com
Privacy protection has been an important concern with the great success of machine
learning. In this paper, it proposes a multi-party privacy preserving machine learning …

Exploiting unintended feature leakage in collaborative learning

L Melis, C Song, E De Cristofaro… - 2019 IEEE symposium …, 2019 - ieeexplore.ieee.org
Collaborative machine learning and related techniques such as federated learning allow
multiple participants, each with his own training dataset, to build a joint model by training …

Deep learning in mobile and wireless networking: A survey

C Zhang, P Patras, H Haddadi - IEEE Communications surveys …, 2019 - ieeexplore.ieee.org
The rapid uptake of mobile devices and the rising popularity of mobile applications and
services pose unprecedented demands on mobile and wireless networking infrastructure …

Communication-efficient edge AI: Algorithms and systems

Y Shi, K Yang, T Jiang, J Zhang… - … Surveys & Tutorials, 2020 - ieeexplore.ieee.org
Artificial intelligence (AI) has achieved remarkable breakthroughs in a wide range of fields,
ranging from speech processing, image classification to drug discovery. This is driven by the …

Deep gradient compression: Reducing the communication bandwidth for distributed training

Y Lin, S Han, H Mao, Y Wang, WJ Dally - arXiv preprint arXiv:1712.01887, 2017 - arxiv.org
Large-scale distributed training requires significant communication bandwidth for gradient
exchange that limits the scalability of multi-node training, and requires expensive high …

The convergence of sparsified gradient methods

D Alistarh, T Hoefler, M Johansson… - Advances in …, 2018 - proceedings.neurips.cc
Distributed training of massive machine learning models, in particular deep neural networks,
via Stochastic Gradient Descent (SGD) is becoming commonplace. Several families of …