Simple binary hypothesis testing under local differential privacy and communication constraints

A Pensia, AR Asadi, V Jog… - The Thirty Sixth Annual …, 2023 - proceedings.mlr.press
We study simple binary hypothesis testing under local differential privacy (LDP) and
communication constraints. Our results are either minimax optimal or instance optimal: the …

Bottleneck problems: An information and estimation-theoretic view

S Asoodeh, FP Calmon - Entropy, 2020 - mdpi.com
Information bottleneck (IB) and privacy funnel (PF) are two closely related optimization
problems which have found applications in machine learning, design of privacy algorithms …

The convex information bottleneck lagrangian

B Rodríguez Gálvez, R Thobaben, M Skoglund - Entropy, 2020 - mdpi.com
The information bottleneck (IB) problem tackles the issue of obtaining relevant compressed
representations T of some random variable X for the task of predicting Y. It is defined as a …

Binary partitions with approximate minimum impurity

E Laber, M Molinaro… - … Conference on Machine …, 2018 - proceedings.mlr.press
The problem of splitting attributes is one of the main steps in the construction of decision
trees. In order to decide the best split, impurity measures such as Entropy and Gini are …

On distributed quantization for classification

OA Hanna, YH Ezzeldin, T Sadjadpour… - IEEE Journal on …, 2020 - ieeexplore.ieee.org
We consider the problem of distributed feature quantization, where the goal is to enable a
pretrained classifier at a central node to carry out its classification on features that are …

Communication-constrained hypothesis testing: Optimality, robustness, and reverse data processing inequalities

A Pensia, V Jog, PL Loh - IEEE Transactions on Information …, 2023 - ieeexplore.ieee.org
We study hypothesis testing under communication constraints, where each sample is
quantized before being revealed to a statistician. Without communication constraints, it is …

Likelihood-free hypothesis testing

PR Gerber, Y Polyanskiy - IEEE Transactions on Information …, 2024 - ieeexplore.ieee.org
Consider the problem of binary hypothesis testing. Given Z coming from either P⊗ m or Q⊗
m, to decide between the two with small probability of error it is sufficient, and in many cases …

Forward-aware information bottleneck-based vector quantization for noisy channels

S Hassanpour, T Monsees, D Wübben… - IEEE Transactions on …, 2020 - ieeexplore.ieee.org
The main focus will be on the indirect Joint Source-Channel Coding problem in which a
noisy observation of the source has to be quantized ahead of transmission over an error …

Dynamic programming for sequential deterministic quantization of discrete memoryless channels

X He, K Cai, W Song, Z Mei - IEEE Transactions on …, 2021 - ieeexplore.ieee.org
In this article, under a general cost function C, we present a dynamic programming (DP)
method to obtain an optimal sequential deterministic quantizer (SDQ) for q-ary input discrete …

Bounds on the entropy of a function of a random variable and their applications

F Cicalese, L Gargano… - IEEE Transactions on …, 2017 - ieeexplore.ieee.org
It is well known that the entropy H (X) of a discrete random variable X is always greater than
or equal to the entropy H (f (X)) of a function f of X, with equality if and only if f is one-to-one …