A framework for assurance audits of algorithmic systems

K Lam, B Lange, B Blili-Hamelin, J Davidovic… - The 2024 ACM …, 2024 - dl.acm.org
An increasing number of regulations propose 'AI audits' as a mechanism for achieving
transparency and accountability for artificial intelligence (AI) systems. Despite some …

Who Audits the Auditors? Recommendations from a field scan of the algorithmic auditing ecosystem

S Costanza-Chock, ID Raji, J Buolamwini - Proceedings of the 2022 …, 2022 - dl.acm.org
Algorithmic audits (or 'AI audits') are an increasingly popular mechanism for algorithmic
accountability; however, they remain poorly defined. Without a clear understanding of audit …

Closing the AI accountability gap: Defining an end-to-end framework for internal algorithmic auditing

ID Raji, A Smart, RN White, M Mitchell… - Proceedings of the …, 2020 - dl.acm.org
Rising concern for the societal implications of artificial intelligence systems has inspired a
wave of academic and journalistic literature in which deployed systems are audited for harm …

AI audit washing and accountability

EP Goodman, J Trehu - Available at SSRN 4227350, 2022 - papers.ssrn.com
Algorithmic decision systems, many using artificial intelligence, are reshaping the provision
of private and public services across the globe. There is an urgent need for algorithmic …

Rethinking artificial intelligence: algorithmic bias and ethical issues| making algorithms public: reimagining auditing from matters of fact to matters of concern

RS Geiger, U Tandon, A Gakhokidze, L Song… - International Journal of …, 2023 - ijoc.org
Stakeholders concerned with bias, discrimination, and fairness in algorithmic systems are
increasingly turning to audits, which typically apply generalizable methods and formal …

Outsider oversight: Designing a third party audit ecosystem for ai governance

ID Raji, P Xu, C Honigsberg, D Ho - Proceedings of the 2022 AAAI/ACM …, 2022 - dl.acm.org
Much attention has focused on algorithmic audits and impact assessments to hold
developers and users of algorithmic systems accountable. But existing algorithmic …

Auditing work: Exploring the New York City algorithmic bias audit regime

L Groves, J Metcalf, A Kennedy, B Vecchione… - The 2024 ACM …, 2024 - dl.acm.org
In July 2023, New York City (NYC) implemented the first attempt to create an algorithm
auditing regime for commercial machine-learning systems. Local Law 144 (LL 144), requires …

Audit and assurance of AI algorithms: a framework to ensure ethical algorithmic practices in artificial intelligence

R Akula, I Garibay - arXiv preprint arXiv:2107.14046, 2021 - arxiv.org
Algorithms are becoming more widely used in business, and businesses are becoming
increasingly concerned that their algorithms will cause significant reputational or financial …

Auditing algorithms: On lessons learned and the risks of data minimization

G Galdon Clavell, M Martín Zamorano… - Proceedings of the …, 2020 - dl.acm.org
In this paper, we present the Algorithmic Audit (AA) of REM! X, a personalized well-being
recommendation app developed by Telefónica Innovación Alpha. The main goal of the AA …

Feeling fixes: Mess and emotion in algorithmic audits

O Keyes, J Austin - Big Data & Society, 2022 - journals.sagepub.com
Efforts to address algorithmic harms have gathered particular steam over the last few years.
One area of proposed opportunity is the notion of an “algorithmic audit,” specifically an …