Demystifying local and global fairness trade-offs in federated learning using partial information decomposition

F Hamman, S Dutta - arXiv preprint arXiv:2307.11333, 2023 - arxiv.org
In this paper, we present an information-theoretic perspective to group fairness trade-offs in
federated learning (FL) with respect to sensitive attributes, such as gender, race, etc …

Quantifying spuriousness of biased datasets using partial information decomposition

B Halder, F Hamman, P Dissanayake, Q Zhang… - arXiv preprint arXiv …, 2024 - arxiv.org
Spurious patterns refer to a mathematical association between two or more variables in a
dataset that are not causally related. However, this notion of spuriousness, which is usually …

Demystifying local and global fairness trade-offs in federated learning using information theory

F Hamman, S Dutta - Federated Learning and Analytics in Practice …, 2023 - openreview.net
We present an information-theoretic perspective to group fairness trade-offs in federated
learning (FL) with respect to sensitive attributes, such as gender, race, etc. Existing works …

Causal information splitting: Engineering proxy features for robustness to distribution shifts

B Mazaheri, A Mastakouri… - Uncertainty in …, 2023 - proceedings.mlr.press
Statistical prediction models are often trained on data that is drawn from different probability
distributions than their eventual use cases. One approach to proactively prepare for these …

A Unified View of Group Fairness Tradeoffs Using Partial Information Decomposition

F Hamman, S Dutta - arXiv preprint arXiv:2406.04562, 2024 - arxiv.org
This paper introduces a novel information-theoretic perspective on the relationship between
prominent group fairness notions in machine learning, namely statistical parity, equalized …

Quantifying Knowledge Distillation Using Partial Information Decomposition

P Dissanayake, F Hamman, B Halder… - arXiv preprint arXiv …, 2024 - arxiv.org
Knowledge distillation provides an effective method for deploying complex machine learning
models in resource-constrained environments. It typically involves training a smaller student …

Combining Sources and Leveraging Contexts

B Mazaheri - 2024 - search.proquest.com
In this thesis we discuss two levels of knowledge beyond regression and classification. The
first involves the identification of exchangeable scenarios or individuals from which causal …

Analytically deriving Partial Information Decomposition for affine systems of stable and convolution-closed distributions

C Goswami, A Merkley - The Thirty-eighth Annual Conference on Neural … - openreview.net
Bivariate partial information decomposition (PID) has emerged as a promising tool for
analyzing interactions in complex systems, particularly in neuroscience. PID achieves this by …

Gone With the Bits: Benchmarking Bias in Facial Phenotype Degradation Under Low-Rate Neural Compression

T Qiu, A Nichani, R Tadayon, H Jeong - ICML 2024 Next Generation of AI … - openreview.net
In this study, we investigate how facial phenotypes are distorted under neural image
compression and the disparity of this distortion across racial groups. Neural compression …

Formalizing Limits of Knowledge Distillation Using Partial Information Decomposition

P Dissanayake, F Hamman, B Halder… - Workshop on Machine … - openreview.net
Knowledge distillation provides an effective method for deploying complex machine learning
models in resource-constrained environments. It typically involves training a smaller student …