Human-ai collaboration for ux evaluation: Effects of explanation and synchronization

M Fan, X Yang, TT Yu, QV Liao, J Zhao - Proceedings of the ACM on …, 2022 - dl.acm.org
Analyzing usability test videos is arduous. Although recent research showed the promise of
AI in assisting with such tasks, it remains largely unknown how AI should be designed to …

Crafting Human-AI Collaborative Analysis for User Experience Evaluation

E Kuang - Extended Abstracts of the 2023 CHI Conference on …, 2023 - dl.acm.org
AI has been increasingly adopted in user experience (UX) analysis, in which UX evaluators
review test recordings to identify usability problems. However, most AI-infused systems …

Enhancing UX Evaluation Through Collaboration with Conversational AI Assistants: Effects of Proactive Dialogue and Timing

E Kuang, M Li, M Fan, K Shinohara - … of the CHI Conference on Human …, 2024 - dl.acm.org
Usability testing is vital for enhancing the user experience (UX) of interactive systems.
However, analyzing test videos is complex and resource-intensive. Recent AI advancements …

Collaboration with conversational AI assistants for UX evaluation: Questions and how to ask them (voice vs. text)

E Kuang, E Jahangirzadeh Soure, M Fan… - Proceedings of the …, 2023 - dl.acm.org
AI is promising in assisting UX evaluators with analyzing usability tests, but its judgments are
typically presented as non-interactive visualizations. Evaluators may have questions about …

CoUX: collaborative visual analysis of think-aloud usability test videos for digital interfaces

EJ Soure, E Kuang, M Fan… - IEEE Transactions on …, 2021 - ieeexplore.ieee.org
Reviewing a think-aloud video is both time-consuming and demanding as it requires UX
(user experience) professionals to attend to many behavioral signals of the user in the video …

How Do UX Practitioners Communicate AI as a Design Material? Artifacts, Conceptions, and Propositions

KJK Feng, MJ Coppock, DW McDonald - Proceedings of the 2023 ACM …, 2023 - dl.acm.org
UX practitioners (UXPs) face novel challenges when working with and communicating
artificial intelligence (AI) as a design material. We explore how UXPs communicate AI …

Adapting user experience research methods for AI-driven experiences

C Kliman-Silver, O Siy, K Awadalla, A Lentz… - Extended Abstracts of …, 2020 - dl.acm.org
This short paper describes how to adapt user experience research methods for artificial
intelligence (AI)-driven applications. Presently, there is a dearth of guidance for conducting …

How UX practitioners produce findings in usability testing

S Reeves - ACM Transactions on Computer-Human Interaction …, 2019 - dl.acm.org
Usability testing has long been a core interest of HCI research and forms a key element of
industry practice. Yet our knowledge of it harbours striking absences. There are few, if any …

A textual feedback tool for empowering participants in usability and UX evaluations

A Sivaji, SF Nielsen, T Clemmensen - International Journal of …, 2017 - Taylor & Francis
The usability movement has historically always sought to empower end-users of computers
so that they understand what is happening and can control the outcome. In this article, we …

Understanding the effect of out-of-distribution examples and interactive explanations on human-ai decision making

H Liu, V Lai, C Tan - Proceedings of the ACM on Human-Computer …, 2021 - dl.acm.org
Although AI holds promise for improving human decision making in societally critical
domains, it remains an open question how human-AI teams can reliably outperform AI alone …