H Xu, CY Ho, AM Abdelmoniem, A Dutta, EH Bergou… - 2021 - repository.kaust.edu.sa
Powerful computer clusters are used nowadays to train complex deep neural networks
(DNN) on large datasets. Distributed training increasingly becomes communication bound …