Towards a multi-stakeholder value-based assessment framework for algorithmic systems

M Yurrita, D Murray-Rust, A Balayn… - Proceedings of the 2022 …, 2022 - dl.acm.org
In an effort to regulate Machine Learning-driven (ML) systems, current auditing processes
mostly focus on detecting harmful algorithmic biases. While these strategies have proven to …

Closing the AI accountability gap: Defining an end-to-end framework for internal algorithmic auditing

ID Raji, A Smart, RN White, M Mitchell… - Proceedings of the …, 2020 - dl.acm.org
Rising concern for the societal implications of artificial intelligence systems has inspired a
wave of academic and journalistic literature in which deployed systems are audited for harm …

Evaluation gaps in machine learning practice

B Hutchinson, N Rostamzadeh, C Greer… - Proceedings of the …, 2022 - dl.acm.org
Forming a reliable judgement of a machine learning (ML) model's appropriateness for an
application ecosystem is critical for its responsible use, and requires considering a broad …

Audit and assurance of AI algorithms: a framework to ensure ethical algorithmic practices in artificial intelligence

R Akula, I Garibay - arXiv preprint arXiv:2107.14046, 2021 - arxiv.org
Algorithms are becoming more widely used in business, and businesses are becoming
increasingly concerned that their algorithms will cause significant reputational or financial …

A framework for assurance audits of algorithmic systems

K Lam, B Lange, B Blili-Hamelin, J Davidovic… - The 2024 ACM …, 2024 - dl.acm.org
An increasing number of regulations propose 'AI audits' as a mechanism for achieving
transparency and accountability for artificial intelligence (AI) systems. Despite some …

Towards accountability for machine learning datasets: Practices from software engineering and infrastructure

B Hutchinson, A Smart, A Hanna, E Denton… - Proceedings of the …, 2021 - dl.acm.org
Datasets that power machine learning are often used, shared, and reused with little visibility
into the processes of deliberation that led to their creation. As artificial intelligence systems …

The algorithm audit: Scoring the algorithms that score us

S Brown, J Davidovic, A Hasan - Big Data & Society, 2021 - journals.sagepub.com
In recent years, the ethical impact of AI has been increasingly scrutinized, with public
scandals emerging over biased outcomes, lack of transparency, and the misuse of data. This …

Supporting human-ai collaboration in auditing llms with llms

C Rastogi, M Tulio Ribeiro, N King, H Nori… - Proceedings of the 2023 …, 2023 - dl.acm.org
Large language models (LLMs) are increasingly becoming all-powerful and pervasive via
deployment in sociotechnical systems. Yet these language models, be it for classification or …

[PDF][PDF] Ethical AI: Addressing bias in machine learning models and software applications

CO Oyeniran, AO Adewusi, AG Adeleke… - Computer Science & …, 2022 - researchgate.net
Oyeniran, Adewusi, Adeleke, Akwawa, & Azubuko, P. 115-126 Page 116 implementing
robust auditing processes. We also review existing ethical guidelines and frameworks, such …

[PDF][PDF] Towards a framework for ethical audits of AI algorithms

RC LaBrie, G Steinke - 2019 - scholar.archive.org
In recent years there has been much talk about the advancements in artificial intelligence
(AI). Large strides have been made particularly in the area of machines learning algorithms …