A fundamental tradeoff between computation and communication in distributed computing

S Li, MA Maddah-Ali, Q Yu… - IEEE Transactions on …, 2017 - ieeexplore.ieee.org
How can we optimally trade extra computing power to reduce the communication load in
distributed computing? We answer this question by characterizing a fundamental tradeoff …

Over-the-air function computation in sensor networks

O Abari, H Rahul, D Katabi - arXiv preprint arXiv:1612.02307, 2016 - arxiv.org
Many sensor applications are interested in computing a function over measurements (eg,
sum, average, max) as opposed to collecting all sensor data. Today, such data aggregation …

Coded computing: Mitigating fundamental bottlenecks in large-scale distributed computing and machine learning

S Li, S Avestimehr - Foundations and Trends® in …, 2020 - nowpublishers.com
We introduce the concept of “coded computing”, a novel computing paradigm that utilizes
coding theory to effectively inject and leverage data/computation redundancy to mitigate …

Compression with exact error distribution for federated learning

M Hegazy, R Leluc, CT Li, A Dieuleveut - arXiv preprint arXiv:2310.20682, 2023 - arxiv.org
Compression schemes have been extensively used in Federated Learning (FL) to reduce
the communication cost of distributed learning. While most approaches rely on a bounded …

Network coding for computing: Cut-set bounds

R Appuswamy, M Franceschetti… - IEEE Transactions …, 2011 - ieeexplore.ieee.org
The following network computing problem is considered. Source nodes in a directed acyclic
network generate independent messages and a single receiver node computes a target …

On network coding for sum-networks

BK Rai, BK Dey - IEEE Transactions on Information Theory, 2012 - ieeexplore.ieee.org
A directed acyclic network is considered where all the terminals need to recover the sum of
the symbols generated at all the sources. We call such a network a sum-network. It is shown …

The capacity of classical summation over a quantum MAC with arbitrarily distributed inputs and entanglements

Y Yao, SA Jafar - IEEE Transactions on Information Theory, 2024 - ieeexplore.ieee.org
The Σ-QMAC problem is introduced, involving S servers, K classical (F d) data streams, and
T independent quantum systems. Data stream W k, k∈[K] is replicated at a subset of servers …

On network functional compression

S Feizi, M Médard - IEEE transactions on information theory, 2014 - ieeexplore.ieee.org
In this paper, we consider different aspects of the problem of compressing for function
computation across a network, which we call network functional compression. In network …

CONDENSE: A reconfigurable knowledge acquisition architecture for future 5G IoT

D Vukobratovic, D Jakovetic, V Skachek… - IEEE …, 2016 - ieeexplore.ieee.org
In forthcoming years, the Internet of Things (IoT) will connect billions of smart devices
generating and uploading a deluge of data to the cloud. If successfully extracted, the …

Computing linear functions by linear coding over networks

R Appuswamy, M Franceschetti - IEEE transactions on …, 2013 - ieeexplore.ieee.org
We consider the scenario in which a set of sources generates messages in a network and a
receiver node demands an arbitrary linear function of these messages. We formulate an …