Y Lu, C De Sa - arXiv preprint arXiv:2006.08085, 2020 - thetalkingmachines.com
Decentralization is a promising method of scaling up parallel machine learning systems. In
this paper, we provide a tight lower bound on the iteration complexity for such methods in a …