Towards algorithm auditing: a survey on managing legal, ethical and technological risks of AI, ML and associated algorithms

A Koshiyama, E Kazim, P Treleaven, P Rai, L Szpruch… - 2021 - papers.ssrn.com
… A new industry is envisaged: Auditing and Assurance of … We also anticipate the nature and
scope of the auditing levels and … key areas necessary to perform auditing and assurance, and …

Towards algorithm auditing: managing legal, ethical and technological risks of AI, ML and associated algorithms

A Koshiyama, E Kazim, P Treleaven… - Royal Society …, 2024 - royalsocietypublishing.org
… As with financial audits, we envisage that algorithm auditing will increasingly become a
legal requirement as the AI regulatory landscape continues to evolve. However, granular …

Problematic machine behavior: A systematic literature review of algorithm audits

J Bandy - Proceedings of the acm on human-computer …, 2021 - dl.acm.org
… in the context of broader research working toward algorithmic justice. … review reports what
previous algorithm audits have done (RQ1) and what remains to be done in future audits (RQ2)…

[PDF][PDF] Towards a framework for ethical audits of AI algorithms

RC LaBrie, G Steinke - 2019 - scholar.archive.org
… our Ethical AI Algorithm Audit framework is composed of two functions. First an ethical algorithm
must … Second, an ethical algorithm must pass an audit procedure that would analyze the …

[PDF][PDF] Towards Algorithm Auditing

A Koshiyama, E Kazim, P Treleaven, P Rai… - A Survey On Managing …, 2021 - core.ac.uk
… area of Algorithm Audit. The following sections present the key components that cover the
Algorithm Audit research and practice, namely: algorithms, verticals of auditing, mitigation …

Auditing algorithms: Understanding algorithmic systems from the outside in

D Metaxa, JS Park, RE Robertson… - … and Trends® in …, 2021 - nowpublishers.com
algorithm audit methodology, including the history of audit studies in the social sciences from
which this method is derived; a summary of key algorithm auditsalgorithm audits, and in …

Toward User-Driven Algorithm Auditing: Investigating users' strategies for uncovering harmful algorithmic behavior

A DeVos, A Dhabalia, H Shen, K Holstein… - Proceedings of the 2022 …, 2022 - dl.acm.org
… To help inform our broader project — toward designing ways to facilitate more effective
everyday algorithm audits — we also iterated on other aspects of the workshop implementation …

[PDF][PDF] Algorithm assurance: Auditing applications of artificial intelligence

A Boer, L de Beer, F van Praat - Advanced Digital Auditing, 2023 - library.oapen.org
… are often combined to work towards a single decision. In such situations, solely auditing an
algorithm itself would make no sense. Understanding the context of an algorithm requires an …

Everyday algorithm auditing: Understanding the power of everyday users in surfacing harmful algorithmic behaviors

H Shen, A DeVos, M Eslami, K Holstein - Proceedings of the ACM on …, 2021 - dl.acm.org
… lies ahead, toward bridging the gaps between formal auditingalgorithm auditing may be
most powerful when audits are … process model of everyday algorithm audits inform a series …

Machine learning for health: algorithm auditing & quality control

L Oala, AG Murchison, P Balachandran… - Journal of medical …, 2021 - Springer
… We are convinced that success on the path towards a framework for algorithm auditing and
… refinement of auditing processes should routinely be accompanied by trial audits. In trial …