Everyday algorithm auditing: Understanding the power of everyday users in surfacing harmful algorithmic behaviors
A growing body of literature has proposed formal approaches to audit algorithmic systems
for biased and harmful behaviors. While formal auditing approaches have been greatly …
for biased and harmful behaviors. While formal auditing approaches have been greatly …
Toward User-Driven Algorithm Auditing: Investigating users' strategies for uncovering harmful algorithmic behavior
A DeVos, A Dhabalia, H Shen, K Holstein… - Proceedings of the 2022 …, 2022 - dl.acm.org
Recent work in HCI suggests that users can be powerful in surfacing harmful algorithmic
behaviors that formal auditing approaches fail to detect. However, it is not well understood …
behaviors that formal auditing approaches fail to detect. However, it is not well understood …
Problematic machine behavior: A systematic literature review of algorithm audits
J Bandy - Proceedings of the acm on human-computer …, 2021 - dl.acm.org
While algorithm audits are growing rapidly in commonality and public importance, relatively
little scholarly work has gone toward synthesizing prior work and strategizing future research …
little scholarly work has gone toward synthesizing prior work and strategizing future research …
Understanding Practices, Challenges, and Opportunities for User-Engaged Algorithm Auditing in Industry Practice
Recent years have seen growing interest among both researchers and practitioners in user-
engaged approaches to algorithm auditing, which directly engage users in detecting …
engaged approaches to algorithm auditing, which directly engage users in detecting …
Auditing algorithms: Understanding algorithmic systems from the outside in
Algorithms are ubiquitous and critical sources of information online, increasingly acting as
gatekeepers for users accessing or sharing information about virtually any topic, including …
gatekeepers for users accessing or sharing information about virtually any topic, including …
Sociotechnical Audits: Broadening the Algorithm Auditing Lens to Investigate Targeted Advertising
Algorithm audits are powerful tools for studying black-box systems without direct knowledge
of their inner workings. While very effective in examining technical components, the method …
of their inner workings. While very effective in examining technical components, the method …
Harms from increasingly agentic algorithmic systems
A Chan, R Salganik, A Markelius, C Pang… - Proceedings of the …, 2023 - dl.acm.org
Research in Fairness, Accountability, Transparency, and Ethics (FATE) 1 has established
many sources and forms of algorithmic harm, in domains as diverse as health care, finance …
many sources and forms of algorithmic harm, in domains as diverse as health care, finance …
Outsider oversight: Designing a third party audit ecosystem for ai governance
Much attention has focused on algorithmic audits and impact assessments to hold
developers and users of algorithmic systems accountable. But existing algorithmic …
developers and users of algorithmic systems accountable. But existing algorithmic …
Sociotechnical harms of algorithmic systems: Scoping a taxonomy for harm reduction
Understanding the landscape of potential harms from algorithmic systems enables
practitioners to better anticipate consequences of the systems they build. It also supports the …
practitioners to better anticipate consequences of the systems they build. It also supports the …
The algorithm audit: Scoring the algorithms that score us
In recent years, the ethical impact of AI has been increasingly scrutinized, with public
scandals emerging over biased outcomes, lack of transparency, and the misuse of data. This …
scandals emerging over biased outcomes, lack of transparency, and the misuse of data. This …