Can querying for bias leak protected attributes? achieving privacy with smooth sensitivity

F Hamman, J Chen, S Dutta - Proceedings of the 2023 ACM Conference …, 2023 - dl.acm.org
Existing regulations often prohibit model developers from accessing protected attributes
(gender, race, etc.) during training. This leads to scenarios where fairness assessments …

A comprehensive survey and classification of evaluation criteria for trustworthy artificial intelligence

L McCormack, M Bendechache - AI and Ethics, 2024 - Springer
This paper presents a systematic review of the literature on evaluation criteria for
Trustworthy Artificial Intelligence (TAI), with a focus on the seven EU principles of TAI. This …

Demystifying local and global fairness trade-offs in federated learning using partial information decomposition

F Hamman, S Dutta - arXiv preprint arXiv:2307.11333, 2023 - arxiv.org
In this paper, we present an information-theoretic perspective to group fairness trade-offs in
federated learning (FL) with respect to sensitive attributes, such as gender, race, etc …

Online fairness auditing through iterative refinement

P Maneriker, C Burley, S Parthasarathy - Proceedings of the 29th ACM …, 2023 - dl.acm.org
A sizable proportion of deployed machine learning models make their decisions in a black-
box manner. Such decision-making procedures are susceptible to intrinsic biases, which …

Statistical inference for fairness auditing

JJ Cherian, EJ Candès - Journal of Machine Learning Research, 2024 - jmlr.org
Before deploying a black-box model in high-stakes problems, it is important to evaluate the
model's performance on sensitive subpopulations. For example, in a recidivism prediction …

Measures of disparity and their efficient estimation

H Singh, R Chunara - Proceedings of the 2023 AAAI/ACM Conference …, 2023 - dl.acm.org
Quantifying disparities, that is differences in outcomes among population groups, is an
important task in public health, economics, and increasingly in machine learning. In this …

Cross-gan auditing: Unsupervised identification of attribute level similarities and differences between pretrained generative models

ML Olson, S Liu, R Anirudh… - Proceedings of the …, 2023 - openaccess.thecvf.com
Abstract Generative Adversarial Networks (GANs) are notoriously difficult to train especially
for complex distributions and with limited data. This has driven the need for interpretable …

XAudit: A Theoretical Look at Auditing with Explanations

C Yadav, M Moshkovitz, K Chaudhuri - arXiv preprint arXiv:2206.04740, 2022 - arxiv.org
Responsible use of machine learning requires models to be audited for undesirable
properties. While a body of work has proposed using explanations for auditing, how to do so …

Fairness auditing with multi-agent collaboration

M de Vos, A Dhasade, J Garcia Bourrée… - ECAI 2024, 2024 - ebooks.iospress.nl
Existing work in fairness auditing assumes that each audit is performed independently. In
this paper, we consider multiple agents working together, each auditing the same platform …

From Transparency to Accountability and Back: A Discussion of Access and Evidence in AI Auditing

SH Cen, R Alur - Proceedings of the 4th ACM Conference on Equity and …, 2024 - dl.acm.org
Artificial intelligence (AI) is increasingly intervening in our lives, raising widespread concern
about its unintended and undeclared side effects. These developments have brought …