Wyner-Ziv estimators: Efficient distributed mean estimation with side-information

P Mayekar, AT Suresh, H Tyagi - … Conference on Artificial …, 2021 - proceedings.mlr.press
Communication efficient distributed mean estimation is an important primitive that arises in
many distributed learning and optimization scenarios such as federated learning. Without …

Communication-efficient coded distributed multi-task learning

H Tang, H Hu, K Yuan, Y Wu - 2021 IEEE Global …, 2021 - ieeexplore.ieee.org
Consider a distributed multi-task learning (MTL) framework where the distributed users first
train their own models based on the local data and then send the local updates to the server …

Correlation Aware Sparsified Mean Estimation Using Random Projection

S Jiang, P Sharma, G Joshi - arXiv preprint arXiv:2310.18868, 2023 - arxiv.org
We study the problem of communication-efficient distributed vector mean estimation, a
commonly used subroutine in distributed optimization and Federated Learning (FL). Rand …

Compression for Distributed Optimization and Timely Updates

P Mayekar - arXiv preprint arXiv:2301.04364, 2023 - arxiv.org
The goal of this thesis is to study the compression problems arising in distributed computing
systematically. In the first part of the thesis, we study gradient compression for distributed first …

Coded distributed computing for hierarchical multi-task learning

H Hu, S Li, M Cheng, Y Wu - 2023 IEEE Information Theory …, 2023 - ieeexplore.ieee.org
In this paper, we consider a hierarchical distributed multi-task learning (MTL) system where
distributed users wish to jointly learn different models orchestrated by a central server with …

Wyner-Ziv compression is (almost) optimal for distributed optimization

P Mayekar, SK Jha, H Tyagi - 2022 IEEE International …, 2022 - ieeexplore.ieee.org
Consider distributed optimization of smooth convex functions over ℝ d where K independent
clients can provide estimates of the gradient. Assume that all the gradient estimates are …

Wyner-Ziv Estimators for Distributed Mean Estimation with Side Information and Optimization

P Mayekar, S Jha, AT Suresh… - IEEE Transactions on …, 2023 - ieeexplore.ieee.org
Communication efficient distributed mean estimation is an important primitive that arises in
many distributed learning and optimization scenarios such as federated learning. Without …