Toward user-driven sound recognizer personalization with people who are d/deaf or hard of hearing

SM Goodman, P Liu, D Jain, EJ McDonnell… - Proceedings of the …, 2021 - dl.acm.org
Automated sound recognition tools can be a useful complement to d/Deaf and hard of
hearing (DHH) people's typical communication and environmental awareness strategies …

Understanding Personalized Accessibility through Teachable AI: Designing and Evaluating Find My Things for People who are Blind or Low Vision

C Morrison, M Grayson, RF Marques… - Proceedings of the 25th …, 2023 - dl.acm.org
The opportunity for artificial intelligence, or AI, to enable accessibility is rapidly growing, but
widely impactful applications can be challenging to build given the diversity of user need …

“Not There Yet”: Feasibility and Challenges of Mobile Sound Recognition to Support Deaf and Hard-of-Hearing People

JZ Huang, H Chhabria, D Jain - Proceedings of the 25th International …, 2023 - dl.acm.org
While recent advances have enabled mobile sound recognition tools for deaf and hard of
hearing (DHH) people, these tools have only been studied in the lab or through short …

SpaceEditing: A Latent Space Editing Interface for Integrating Human Knowledge into Deep Neural Networks

J Wei, D Xia, H Xie, CM Chang, C Li… - Proceedings of the 29th …, 2024 - dl.acm.org
Human-centered AI aims to bridge the gap between machine decision-making and human
understanding. However, even for classification tasks where deep neural networks have …

Reimagining Machine Learning's Role in Assistive Technology by Co-Designing Exergames with Children Using a Participatory Machine Learning Design Probe

J Duval, L Turmo Vidal, E Márquez Segura… - Proceedings of the 25th …, 2023 - dl.acm.org
The paramount measure of success for a machine learning model has historically been
predictive power and accuracy, but even a gold-standard accuracy benchmark fails when it …

Technical understanding from interactive machine learning experience: a study through a public event for science museum visitors

W Kawabe, Y Nakao, A Shitara… - Interacting with …, 2024 - academic.oup.com
While AI technology is becoming increasingly prevalent in our daily lives, the
comprehension of machine learning (ML) among non-experts remains limited. Interactive …

DuetML: Human-LLM Collaborative Machine Learning Framework for Non-Expert Users

W Kawabe, Y Sugano - arXiv preprint arXiv:2411.18908, 2024 - arxiv.org
Machine learning (ML) models have significantly impacted various domains in our everyday
lives. While large language models (LLMs) offer intuitive interfaces and versatility, task …

Image-to-Text Translation for Interactive Image Recognition: A Comparative User Study with Non-expert Users

W Kawabe, Y Sugano - Journal of Information Processing, 2024 - jstage.jst.go.jp
Interactive machine learning (IML) allows users to build their custom machine learning
models without expert knowledge. While most existing IML systems are designed with …

Find My Things: Personalized Accessibility through Teachable AI for People who are Blind or Low Vision

LY Wen, C Morrison, M Grayson, RF Marques… - Extended Abstracts of …, 2024 - dl.acm.org
The opportunity for artificial intelligence, or AI, to enable accessibility is rapidly growing, but
widely impactful applications can be challenging to build given the diversity of user need …

A Multimodal LLM-based Assistant for User-Centric Interactive Machine Learning

W Kawabe, Y Sugano - SIGGRAPH Asia 2024 Posters, 2024 - dl.acm.org
This paper proposes a system based on a multimodal large language model (MLLM) to
assist non-expert users without prior experience in machine learning (ML) development. The …