Quantifying spuriousness of biased datasets using partial information decomposition
Spurious patterns refer to a mathematical association between two or more variables in a
dataset that are not causally related. However, this notion of spuriousness, which is usually …
dataset that are not causally related. However, this notion of spuriousness, which is usually …
Quantifying Knowledge Distillation Using Partial Information Decomposition
Knowledge distillation provides an effective method for deploying complex machine learning
models in resource-constrained environments. It typically involves training a smaller student …
models in resource-constrained environments. It typically involves training a smaller student …
Analytically deriving Partial Information Decomposition for affine systems of stable and convolution-closed distributions
Bivariate partial information decomposition (PID) has emerged as a promising tool for
analyzing interactions in complex systems, particularly in neuroscience. PID achieves this by …
analyzing interactions in complex systems, particularly in neuroscience. PID achieves this by …
Formalizing Limits of Knowledge Distillation Using Partial Information Decomposition
Knowledge distillation provides an effective method for deploying complex machine learning
models in resource-constrained environments. It typically involves training a smaller student …
models in resource-constrained environments. It typically involves training a smaller student …