Beyond transmitting bits: Context, semantics, and task-oriented communications
Communication systems to date primarily aim at reliably communicating bit sequences.
Such an approach provides efficient engineering designs that are agnostic to the meanings …
Such an approach provides efficient engineering designs that are agnostic to the meanings …
On the information bottleneck problems: Models, connections, applications and information theoretic views
A Zaidi, I Estella-Aguerri, S Shamai - Entropy, 2020 - mdpi.com
This tutorial paper focuses on the variants of the bottleneck problem taking an information
theoretic perspective and discusses practical methods to solve it, as well as its connection to …
theoretic perspective and discusses practical methods to solve it, as well as its connection to …
Distributed variational representation learning
IE Aguerri, A Zaidi - IEEE transactions on pattern analysis and …, 2019 - ieeexplore.ieee.org
The problem of distributed representation learning is one in which multiple sources of
information X 1,..., XK are processed separately so as to learn as much information as …
information X 1,..., XK are processed separately so as to learn as much information as …
The broadcast approach in communication networks
In this paper we review the theoretical and practical principles of the broadcast approach to
communication over state-dependent channels and networks in which the transmitters have …
communication over state-dependent channels and networks in which the transmitters have …
Machine-Learning Optimized Measurements of Chaotic Dynamical Systems via the Information Bottleneck
KA Murphy, DS Bassett - Physical Review Letters, 2024 - APS
Deterministic chaos permits a precise notion of a “perfect measurement” as one that, when
obtained repeatedly, captures all of the information created by the system's evolution with …
obtained repeatedly, captures all of the information created by the system's evolution with …
Bottleneck problems: An information and estimation-theoretic view
Information bottleneck (IB) and privacy funnel (PF) are two closely related optimization
problems which have found applications in machine learning, design of privacy algorithms …
problems which have found applications in machine learning, design of privacy algorithms …
In-network learning: Distributed training and inference in networks
M Moldoveanu, A Zaidi - Entropy, 2023 - mdpi.com
In this paper, we study distributed inference and learning over networks which can be
modeled by a directed graph. A subset of the nodes observes different features, which are …
modeled by a directed graph. A subset of the nodes observes different features, which are …
On in-network learning. A comparative study with federated and split learning
M Moldoveanu, A Zaidi - 2021 IEEE 22nd International …, 2021 - ieeexplore.ieee.org
In this paper, we consider a problem in which distributively extracted features are used for
performing inference in wireless networks. We elaborate on our proposed architecture …
performing inference in wireless networks. We elaborate on our proposed architecture …
Distributed hypothesis testing with privacy constraints
We revisit the distributed hypothesis testing (or hypothesis testing with communication
constraints) problem from the viewpoint of privacy. Instead of observing the raw data directly …
constraints) problem from the viewpoint of privacy. Instead of observing the raw data directly …
Variational information bottleneck for unsupervised clustering: Deep gaussian mixture embedding
Y Uğur, G Arvanitakis, A Zaidi - Entropy, 2020 - mdpi.com
In this paper, we develop an unsupervised generative clustering framework that combines
the variational information bottleneck and the Gaussian mixture model. Specifically, in our …
the variational information bottleneck and the Gaussian mixture model. Specifically, in our …