Closing the AI accountability gap: Defining an end-to-end framework for internal algorithmic auditing

ID Raji, A Smart, RN White, M Mitchell… - Proceedings of the …, 2020 - dl.acm.org
Rising concern for the societal implications of artificial intelligence systems has inspired a
wave of academic and journalistic literature in which deployed systems are audited for harm …

Towards AI Accountability Infrastructure: Gaps and Opportunities in AI Audit Tooling

V Ojewale, R Steed, B Vecchione, A Birhane… - arXiv preprint arXiv …, 2024 - arxiv.org
Audits are critical mechanisms for identifying the risks and limitations of deployed artificial
intelligence (AI) systems. However, the effective execution of AI audits remains incredibly …

Outsider oversight: Designing a third party audit ecosystem for ai governance

ID Raji, P Xu, C Honigsberg, D Ho - Proceedings of the 2022 AAAI/ACM …, 2022 - dl.acm.org
Much attention has focused on algorithmic audits and impact assessments to hold
developers and users of algorithmic systems accountable. But existing algorithmic …

Making it possible for the auditing of ai: A systematic review of ai audits and ai auditability

Y Li, S Goel - Information Systems Frontiers, 2024 - Springer
Artificial intelligence (AI) technologies have become the key driver of innovation in society.
However, numerous vulnerabilities of AI systems can lead to negative consequences for …

Understanding Practices, Challenges, and Opportunities for User-Engaged Algorithm Auditing in Industry Practice

WH Deng, B Guo, A Devrio, H Shen, M Eslami… - Proceedings of the …, 2023 - dl.acm.org
Recent years have seen growing interest among both researchers and practitioners in user-
engaged approaches to algorithm auditing, which directly engage users in detecting …

Towards a multi-stakeholder value-based assessment framework for algorithmic systems

M Yurrita, D Murray-Rust, A Balayn… - Proceedings of the 2022 …, 2022 - dl.acm.org
In an effort to regulate Machine Learning-driven (ML) systems, current auditing processes
mostly focus on detecting harmful algorithmic biases. While these strategies have proven to …

The algorithm audit: Scoring the algorithms that score us

S Brown, J Davidovic, A Hasan - Big Data & Society, 2021 - journals.sagepub.com
In recent years, the ethical impact of AI has been increasingly scrutinized, with public
scandals emerging over biased outcomes, lack of transparency, and the misuse of data. This …

An action-oriented AI policy toolkit for technology audits by community advocates and activists

PM Krafft, M Young, M Katell, JE Lee… - Proceedings of the …, 2021 - dl.acm.org
Motivated by the extensive documented disparate harms of artificial intelligence (AI), many
recent practitioner-facing reflective tools have been created to promote responsible AI …

Toward trustworthy AI development: mechanisms for supporting verifiable claims

M Brundage, S Avin, J Wang, H Belfield… - arXiv preprint arXiv …, 2020 - arxiv.org
With the recent wave of progress in artificial intelligence (AI) has come a growing awareness
of the large-scale impacts of AI systems, and recognition that existing regulations and norms …

Ethics-based auditing to develop trustworthy AI

J Mökander, L Floridi - Minds and Machines, 2021 - Springer
A series of recent developments points towards auditing as a promising mechanism to
bridge the gap between principles and practice in AI ethics. Building on ongoing discussions …