Caption crawler: Enabling reusable alternative text descriptions using reverse image search

D Guinness, E Cutrell, MR Morris - … of the 2018 chi conference on human …, 2018 - dl.acm.org
Accessing images online is often difficult for users with vision impairments. This population
relies on text descriptions of images that vary based on website authors' accessibility …

What's in an ALT Tag? Exploring Caption Content Priorities through Collaborative Captioning

A Muehlbradt, SK Kane - ACM Transactions on Accessible Computing …, 2022 - dl.acm.org
Evaluating the quality of accessible image captions with human raters is difficult, as it may
be difficult for a visually impaired user to know how comprehensive a caption is, whereas a …

Toward scalable social alt text: Conversational crowdsourcing as a tool for refining vision-to-language technology for the blind

E Salisbury, E Kamar, M Morris - … of the AAAI Conference on Human …, 2017 - ojs.aaai.org
The access of visually impaired users to imagery in social media is constrained by the
availability of suitable alt text. It is unknown how imperfections in emerging tools for …

ImageExplorer: Multi-layered touch exploration to encourage skepticism towards imperfect AI-generated image captions

J Lee, J Herskovitz, YH Peng, A Guo - … of the 2022 CHI Conference on …, 2022 - dl.acm.org
Blind users rely on alternative text (alt-text) to understand an image; however, alt-text is often
missing. AI-generated captions are a more scalable alternative, but they often miss crucial …

Context matters for image descriptions for accessibility: Challenges for referenceless evaluation metrics

E Kreiss, C Bennett, S Hooshmand, E Zelikman… - arXiv preprint arXiv …, 2022 - arxiv.org
Few images on the Web receive alt-text descriptions that would make them accessible to
blind and low vision (BLV) users. Image-based NLG systems have progressed to the point …

Going beyond one-size-fits-all image descriptions to satisfy the information wants of people who are blind or have low vision

A Stangl, N Verma, KR Fleischmann… - Proceedings of the 23rd …, 2021 - dl.acm.org
Image descriptions are how people who are blind or have low vision (BLV) access
information depicted within images. To our knowledge, no prior work has examined how a …

WebInSight: making web images accessible

JP Bigham, RS Kaminsky, RE Ladner… - Proceedings of the 8th …, 2006 - dl.acm.org
Images without alternative text are a barrier to equal web access for blind users. To illustrate
the problem, we conducted a series of studies that conclusively show that a large fraction of …

Multi-modal image captioning for the visually impaired

H Ahsan, N Bhalla, D Bhatt, K Shah - arXiv preprint arXiv:2105.08106, 2021 - arxiv.org
One of the ways blind people understand their surroundings is by clicking images and
relying on descriptions generated by image captioning systems. Current work on captioning …

Textcaps: a dataset for image captioning with reading comprehension

O Sidorov, R Hu, M Rohrbach, A Singh - … 23–28, 2020, Proceedings, Part II …, 2020 - Springer
Image descriptions can help visually impaired people to quickly understand the image
content. While we made significant progress in automatically describing images and optical …

Captioning images taken by people who are blind

D Gurari, Y Zhao, M Zhang, N Bhattacharya - Computer Vision–ECCV …, 2020 - Springer
While an important problem in the vision community is to design algorithms that can
automatically caption images, few publicly-available datasets for algorithm development …