Toward scalable social alt text: Conversational crowdsourcing as a tool for refining vision-to-language technology for the blind

E Salisbury, E Kamar, M Morris - … of the AAAI Conference on Human …, 2017 - ojs.aaai.org
The access of visually impaired users to imagery in social media is constrained by the
availability of suitable alt text. It is unknown how imperfections in emerging tools for …

What's in an ALT Tag? Exploring Caption Content Priorities through Collaborative Captioning

A Muehlbradt, SK Kane - ACM Transactions on Accessible Computing …, 2022 - dl.acm.org
Evaluating the quality of accessible image captions with human raters is difficult, as it may
be difficult for a visually impaired user to know how comprehensive a caption is, whereas a …

" I Hope This Is Helpful" Understanding Crowdworkers' Challenges and Motivations for an Image Description Task

RN Simons, D Gurari, KR Fleischmann - Proceedings of the ACM on …, 2020 - dl.acm.org
AI image captioning challenges encourage broad participation in designing algorithms that
automatically create captions for a variety of images and users. To create large datasets …

Automatic alt-text: Computer-generated image descriptions for blind users on a social network service

S Wu, J Wieland, O Farivar, J Schiller - … of the 2017 ACM conference on …, 2017 - dl.acm.org
We designed and deployed automatic alt-text (AAT), a system that applies computer vision
technology to identify faces, objects, and themes from photos to generate photo alt-text for …

ImageExplorer: Multi-layered touch exploration to encourage skepticism towards imperfect AI-generated image captions

J Lee, J Herskovitz, YH Peng, A Guo - … of the 2022 CHI Conference on …, 2022 - dl.acm.org
Blind users rely on alternative text (alt-text) to understand an image; however, alt-text is often
missing. AI-generated captions are a more scalable alternative, but they often miss crucial …

GenAssist: Making image generation accessible

M Huh, YH Peng, A Pavel - Proceedings of the 36th Annual ACM …, 2023 - dl.acm.org
Blind and low vision (BLV) creators use images to communicate with sighted audiences.
However, creating or retrieving images is challenging for BLV creators as it is difficult to use …

Captioning images taken by people who are blind

D Gurari, Y Zhao, M Zhang, N Bhattacharya - Computer Vision–ECCV …, 2020 - Springer
While an important problem in the vision community is to design algorithms that can
automatically caption images, few publicly-available datasets for algorithm development …

Caption crawler: Enabling reusable alternative text descriptions using reverse image search

D Guinness, E Cutrell, MR Morris - … of the 2018 chi conference on human …, 2018 - dl.acm.org
Accessing images online is often difficult for users with vision impairments. This population
relies on text descriptions of images that vary based on website authors' accessibility …

Multi-modal image captioning for the visually impaired

H Ahsan, N Bhalla, D Bhatt, K Shah - arXiv preprint arXiv:2105.08106, 2021 - arxiv.org
One of the ways blind people understand their surroundings is by clicking images and
relying on descriptions generated by image captioning systems. Current work on captioning …

How do we talk about other people? group (un) fairness in natural language image descriptions

J Otterbacher, P Barlas, S Kleanthous… - Proceedings of the AAAI …, 2019 - aaai.org
Crowdsourcing plays a key role in developing algorithms for image recognition or
captioning. Major datasets, such as MS COCO or Flickr30K, have been built by eliciting …