Dice: Diversity in deep ensembles via conditional redundancy adversarial estimation

A Rame, M Cord - arXiv preprint arXiv:2101.05544, 2021 - arxiv.org
Deep ensembles perform better than a single network thanks to the diversity among their
members. Recent approaches regularize predictions to increase diversity; however, they …

Conditional mutual information for disentangled representations in reinforcement learning

M Dunion, T McInroe, KS Luck… - Advances in Neural …, 2024 - proceedings.neurips.cc
Reinforcement Learning (RL) environments can produce training data with spurious
correlations between features due to the amount of training data or its limited feature …

CapMax: A framework for dynamic network representation learning from the view of multiuser communication

C Yang, H Wen, B Hooi, L Zhou - IEEE Transactions on Neural …, 2022 - ieeexplore.ieee.org
In this article, a modified mutual information maximization (InfoMax) framework, named
channel capacity maximization (CapMax), is proposed and applied to learn informative …

Benchmarking neural capacity estimation: Viability and reliability

F Mirkarimi, S Rini, N Farsad - IEEE Transactions on …, 2023 - ieeexplore.ieee.org
Recently, several methods have been proposed for estimating the mutual information from
sample data using deep neural networks. This approach is referred to as (). s differ from …

Disentanglement and generalization under correlation shifts

CM Funke, P Vicol, KC Wang… - Conference on …, 2022 - proceedings.mlr.press
Correlations between factors of variation are prevalent in real-world data. Exploiting such
correlations may increase predictive performance on noisy data; however, often correlations …

Neural estimator of information for time-series data with dependency

S Molavipour, H Ghourchian, G Bassi, M Skoglund - Entropy, 2021 - mdpi.com
Novel approaches to estimate information measures using neural networks are well-
celebrated in recent years both in the information theory and machine learning communities …

Diffeomorphic information neural estimation

B Duong, T Nguyen - Proceedings of the AAAI Conference on Artificial …, 2023 - ojs.aaai.org
Abstract Mutual Information (MI) and Conditional Mutual Information (CMI) are multi-purpose
tools from information theory that are able to naturally measure the statistical dependencies …

A perspective on neural capacity estimation: Viability and reliability

F Mirkarimi, S Rini, N Farsad - arXiv preprint arXiv:2203.11793, 2022 - arxiv.org
Recently, several methods have been proposed for estimating the mutual information from
sample data using deep neural networks. These estimators ar referred to as neural mutual …

Statistical inference of information in networks: Causality and directed information graphs

S Molavipour - 2021 - diva-portal.org
Over the last decades, the advancements in measurement, collection, and storage of data
have provided tremendous amounts of information. Thus, it has become crucial to extract …

Конференция «Ломоносов-2022»

ТМ Мударисов - conf.msu.ru
Использование нейронных сетей для аппроксимации исследуемой функции
предложено в [1]. Было показано, что в рамках модели однослойной нейронной сети …