Exploration of synergistic and redundant information sharing in static and dynamical Gaussian systems

AB Barrett - Physical Review E, 2015 - APS
To fully characterize the information that two source variables carry about a third target
variable, one must decompose the total information into redundant, unique, and synergistic …

Unique information via dependency constraints

RG James, J Emenheiser… - Journal of Physics A …, 2018 - iopscience.iop.org
The partial information decomposition (PID) is perhaps the leading proposal for resolving
information shared between a set of sources and a target into redundant, synergistic, and …

JIDT: An information-theoretic toolkit for studying the dynamics of complex systems

JT Lizier - Frontiers in Robotics and AI, 2014 - frontiersin.org
Complex systems are increasingly being viewed as distributed information processing
systems, particularly in the domains of computational neuroscience, bioinformatics, and …

Practical measures of integrated information for time-series data

AB Barrett, AK Seth - PLoS computational biology, 2011 - journals.plos.org
A recent measure of 'integrated information', ΦDM, quantifies the extent to which a system
generates more information than the sum of its parts as it transitions between states …

Information decomposition and synergy

E Olbrich, N Bertschinger, J Rauh - Entropy, 2015 - mdpi.com
Recently, a series of papers addressed the problem of decomposing the information of two
random variables into shared information, unique information and synergistic information …

Introducing a differentiable measure of pointwise shared information

A Makkeh, AJ Gutknecht, M Wibral - Physical Review E, 2021 - APS
Partial information decomposition of the multivariate mutual information describes the
distinct ways in which a set of source variables contains information about a target variable …

Measuring the dynamics of information processing on a local scale in time and space

JT Lizier - Directed information measures in neuroscience, 2014 - Springer
Studies of how information is processed in natural systems, in particular in nervous systems,
are rapidly gaining attention. Less known however is that the local dynamics of such …

Synergy, redundancy, and multivariate information measures: an experimentalist's perspective

N Timme, W Alford, B Flecker, JM Beggs - Journal of computational …, 2014 - Springer
Abstract Information theory has long been used to quantify interactions between two
variables. With the rise of complex systems research, multivariate information measures …

Information integration in large brain networks

D Toker, FT Sommer - PLoS computational biology, 2019 - journals.plos.org
An outstanding problem in neuroscience is to understand how information is integrated
across the many modules of the brain. While classic information-theoretic measures have …

Bivariate measure of redundant information

M Harder, C Salge, D Polani - Physical Review E—Statistical, Nonlinear, and …, 2013 - APS
We define a measure of redundant information based on projections in the space of
probability distributions. Redundant information between random variables is information …