Manifold learning-based methods for analyzing single-cell RNA-sequencing data

KR Moon, JS Stanley III, D Burkhardt, D van Dijk… - Current Opinion in …, 2018 - Elsevier
Recent advances in single-cell RNA sequencing technologies enable deep insights into
cellular development, gene regulation, and phenotypic diversity by measuring gene …

Scalable mutual information estimation using dependence graphs

M Noshad, Y Zeng, AO Hero - ICASSP 2019-2019 IEEE …, 2019 - ieeexplore.ieee.org
The Mutual Information (MI) is an often used measure of dependency between two random
variables utilized in information theory, statistics and machine learning. Recently several MI …

Ensemble estimation of mutual information

KR Moon, K Sricharan, AO Hero - 2017 IEEE International …, 2017 - ieeexplore.ieee.org
We derive the mean squared error convergence rates of kernel density-based plug-in
estimators of mutual information measures between two multidimensional random variables …

Direct estimation of information divergence using nearest neighbor ratios

M Noshad, KR Moon, SY Sekeh… - 2017 IEEE International …, 2017 - ieeexplore.ieee.org
We propose a direct estimation method for Rényi and f-divergence measures based on a
new graph theoretical interpretation. Suppose that we are given two sample sets X and Y …

Conditional mutual information estimation for mixed, discrete and continuous data

OC Mesner, CR Shalizi - IEEE Transactions on Information …, 2020 - ieeexplore.ieee.org
Fields like public health, public policy, and social science often want to quantify the degree
of dependence between variables whose relationships take on unknown functional forms …

Analysis of KNN information estimators for smooth distributions

P Zhao, L Lai - IEEE Transactions on Information Theory, 2019 - ieeexplore.ieee.org
KSG mutual information estimator, which is based on the distances of each sample to its k-th
nearest neighbor, is widely used to estimate mutual information between two continuous …

Learning to bound the multi-class Bayes error

SY Sekeh, B Oselio, AO Hero - IEEE Transactions on Signal …, 2020 - ieeexplore.ieee.org
In the context of supervised learning, meta learning uses features, metadata and other
information to learn about the difficulty, behavior, or composition of the problem. Using this …

Geometric estimation of multivariate dependency

S Yasaei Sekeh, AO Hero - Entropy, 2019 - mdpi.com
This paper proposes a geometric estimator of dependency between a pair of multivariate
random variables. The proposed estimator of dependency is based on a randomly permuted …

Scalable hash-based estimation of divergence measures

M Noshad, A Hero - International Conference on Artificial …, 2018 - proceedings.mlr.press
We propose a scalable divergence estimation method based on hashing. Consider two
continuous random variables $ X $ and $ Y $ whose densities have bounded support. We …

A dimension-independent discriminant between distributions

SY Sekeh, B Oselio, AO Hero - 2018 IEEE International …, 2018 - ieeexplore.ieee.org
Henze-Penrose divergence is a non-parametric divergence measure that can be used to
estimate a bound on the Bayes error in a binary classification problem. In this paper, we …