Understanding Practices, Challenges, and Opportunities for User-Engaged Algorithm Auditing in Industry Practice

WH Deng, B Guo, A Devrio, H Shen, M Eslami… - Proceedings of the …, 2023 - dl.acm.org
Recent years have seen growing interest among both researchers and practitioners in user-
engaged approaches to algorithm auditing, which directly engage users in detecting …

Investigating how practitioners use human-ai guidelines: A case study on the people+ ai guidebook

N Yildirim, M Pushkarna, N Goyal… - Proceedings of the …, 2023 - dl.acm.org
Artificial intelligence (AI) presents new challenges for the user experience (UX) of products
and services. Recently, practitioner-facing resources and design guidelines have become …

[HTML][HTML] Harnessing human and machine intelligence for planetary-level climate action

R Debnath, F Creutzig, BK Sovacool… - npj Climate Action, 2023 - nature.com
The ongoing global race for bigger and better artificial intelligence (AI) systems is expected
to have a profound societal and environmental impact by altering job markets, disrupting …

Designerly understanding: Information needs for model transparency to support design ideation for AI-powered user experience

QV Liao, H Subramonyam, J Wang… - Proceedings of the …, 2023 - dl.acm.org
Despite the widespread use of artificial intelligence (AI), designing user experiences (UX) for
AI-powered systems remains challenging. UX designers face hurdles understanding AI …

Designing responsible ai: Adaptations of ux practice to meet responsible ai challenges

Q Wang, M Madaio, S Kane, S Kapania… - Proceedings of the …, 2023 - dl.acm.org
Technology companies continue to invest in efforts to incorporate responsibility in their
Artificial Intelligence (AI) advancements, while efforts to audit and regulate AI systems …

Zeno: An interactive framework for behavioral evaluation of machine learning

ÁA Cabrera, E Fu, D Bertucci, K Holstein… - Proceedings of the …, 2023 - dl.acm.org
Machine learning models with high accuracy on test data can still produce systematic
failures, such as harmful biases and safety issues, when deployed in the real world. To …

Investigating Practices and Opportunities for Cross-functional Collaboration around AI Fairness in Industry Practice

WH Deng, N Yildirim, M Chang, M Eslami… - Proceedings of the …, 2023 - dl.acm.org
An emerging body of research indicates that ineffective cross-functional collaboration–the
interdisciplinary work done by industry practitioners across roles–represents a major barrier …

A hunt for the snark: Annotator diversity in data practices

S Kapania, AS Taylor, D Wang - … of the 2023 CHI Conference on Human …, 2023 - dl.acm.org
Diversity in datasets is a key component to building responsible AI/ML. Despite this
recognition, we know little about the diversity among the annotators involved in data …

Seeing like a toolkit: How toolkits envision the work of AI ethics

RY Wong, MA Madaio, N Merrill - Proceedings of the ACM on Human …, 2023 - dl.acm.org
Numerous toolkits have been developed to support ethical AI development. However,
toolkits, like all tools, encode assumptions in their design about what work should be done …

Out of Context: Investigating the Bias and Fairness Concerns of “Artificial Intelligence as a Service”

K Lewicki, MSA Lee, J Cobbe, J Singh - … of the 2023 CHI Conference on …, 2023 - dl.acm.org
“AI as a Service”(AIaaS) is a rapidly growing market, offering various plug-and-play AI
services and tools. AIaaS enables its customers (users)—who may lack the expertise, data …