Similarity, compression and local steps: three pillars of efficient communications for distributed variational inequalities

A Beznosikov, M Takác… - Advances in Neural …, 2024 - proceedings.neurips.cc
Variational inequalities are a broad and flexible class of problems that includes
minimization, saddle point, and fixed point problems as special cases. Therefore, variational …

Asynchronous decentralized learning over unreliable wireless networks

E Jeong, M Zecchin… - ICC 2022-IEEE …, 2022 - ieeexplore.ieee.org
Decentralized learning enables edge users to collaboratively train models by exchanging
information via device-to-device communication, yet prior works have been limited to …

Towards Stability and Generalization Bounds in Decentralized Minibatch Stochastic Gradient Descent

J Wang, H Chen - Proceedings of the AAAI Conference on Artificial …, 2024 - ojs.aaai.org
Decentralized Stochastic Gradient Descent (D-SGD) represents an efficient communication
approach tailored for mastering insights from vast, distributed datasets. Inspired by parallel …

Robust Machine Learning Approaches to Wireless Communication Networks

M Zecchin - 2022 - theses.hal.science
Artificial intelligence is widely viewed as a key enabler of sixth generation wireless systems.
In this thesis we target fundamental problems arising from the interaction between these two …

[PDF][PDF] Hydra: An Optimized Data System for Large Multi-Model Deep Learning

K Nagrecha, A Kumar - adalabucsd.github.io
In many deep learning (DL) applications, the desire for ever higher accuracy and the new
ubiquity of transfer learning has led to a marked increase in the size and depth of model …