What's in an ALT Tag? Exploring Caption Content Priorities through Collaborative Captioning

A Muehlbradt, SK Kane - ACM Transactions on Accessible Computing …, 2022 - dl.acm.org
Evaluating the quality of accessible image captions with human raters is difficult, as it may
be difficult for a visually impaired user to know how comprehensive a caption is, whereas a …

Toward scalable social alt text: Conversational crowdsourcing as a tool for refining vision-to-language technology for the blind

E Salisbury, E Kamar, M Morris - … of the AAAI Conference on Human …, 2017 - ojs.aaai.org
The access of visually impaired users to imagery in social media is constrained by the
availability of suitable alt text. It is unknown how imperfections in emerging tools for …

[PDF][PDF] Evaluating and Complementing Vision-to-Language Technology for People who are Blind with Conversational Crowdsourcing.

E Salisbury, E Kamar, MR Morris - IJCAI, 2018 - ijcai.org
We study how real-time crowdsourcing can be used both for evaluating the value provided
by existing automated approaches and for enabling workflows that provide scalable and …

ImageExplorer: Multi-layered touch exploration to encourage skepticism towards imperfect AI-generated image captions

J Lee, J Herskovitz, YH Peng, A Guo - … of the 2022 CHI Conference on …, 2022 - dl.acm.org
Blind users rely on alternative text (alt-text) to understand an image; however, alt-text is often
missing. AI-generated captions are a more scalable alternative, but they often miss crucial …

Captioning images taken by people who are blind

D Gurari, Y Zhao, M Zhang, N Bhattacharya - Computer Vision–ECCV …, 2020 - Springer
While an important problem in the vision community is to design algorithms that can
automatically caption images, few publicly-available datasets for algorithm development …

Multi-modal image captioning for the visually impaired

H Ahsan, N Bhalla, D Bhatt, K Shah - arXiv preprint arXiv:2105.08106, 2021 - arxiv.org
One of the ways blind people understand their surroundings is by clicking images and
relying on descriptions generated by image captioning systems. Current work on captioning …

Caption crawler: Enabling reusable alternative text descriptions using reverse image search

D Guinness, E Cutrell, MR Morris - … of the 2018 chi conference on human …, 2018 - dl.acm.org
Accessing images online is often difficult for users with vision impairments. This population
relies on text descriptions of images that vary based on website authors' accessibility …

" I Hope This Is Helpful" Understanding Crowdworkers' Challenges and Motivations for an Image Description Task

RN Simons, D Gurari, KR Fleischmann - Proceedings of the ACM on …, 2020 - dl.acm.org
AI image captioning challenges encourage broad participation in designing algorithms that
automatically create captions for a variety of images and users. To create large datasets …

Methods for evaluation of imperfect captioning tools by deaf or hard-of-hearing users at different reading literacy levels

L Berke, S Kafle, M Huenerfauth - … of the 2018 CHI Conference on …, 2018 - dl.acm.org
As Automatic Speech Recognition (ASR) improves in accuracy, it may become useful for
transcribing spoken text in real-time for Deaf and Hard-of-Hearing (DHH) individuals. To …

Understanding and evaluating racial biases in image captioning

D Zhao, A Wang… - Proceedings of the IEEE …, 2021 - openaccess.thecvf.com
Image captioning is an important task for benchmarking visual reasoning and for enabling
accessibility for people with vision impairments. However, as in many machine learning …