High-order interaction learning for image captioning

Y Wang, N Xu, AA Liu, W Li… - IEEE Transactions on …, 2021 - ieeexplore.ieee.org
Image captioning aims at understanding various semantic concepts (eg, objects and
relationships) from an image and integrating them in a sentence-level description. Hence, it …

“It's complicated”: Negotiating accessibility and (mis) representation in image descriptions of race, gender, and disability

CL Bennett, C Gleason, MK Scheuerman… - Proceedings of the …, 2021 - dl.acm.org
Content creators are instructed to write textual descriptions of visual content to make it
accessible; yet existing guidelines lack specifics on how to write about people's appearance …

Communicating visualizations without visuals: Investigation of visualization alternative text for people with visual impairments

C Jung, S Mehta, A Kulkarni, Y Zhao… - IEEE transactions on …, 2021 - ieeexplore.ieee.org
Alternative text is critical in communicating graphics to people who are blind or have low
vision. Especially for graphics that contain rich information, such as visualizations, poorly …

" Person, Shoes, Tree. Is the Person Naked?" What People with Vision Impairments Want in Image Descriptions

A Stangl, MR Morris, D Gurari - Proceedings of the 2020 chi conference …, 2020 - dl.acm.org
Access to digital images is important to people who are blind or have low vision (BLV). Many
contemporary image description efforts do not take into account this population's nuanced …

Measuring representational harms in image captioning

A Wang, S Barocas, K Laird, H Wallach - Proceedings of the 2022 ACM …, 2022 - dl.acm.org
Previous work has largely considered the fairness of image captioning systems through the
underspecified lens of “bias.” In contrast, we present a set of techniques for measuring five …

Understanding blind people's experiences with computer-generated captions of social media images

H MacLeod, CL Bennett, MR Morris… - proceedings of the 2017 …, 2017 - dl.acm.org
Research advancements allow computational systems to automatically caption social media
images. Often, these captions are evaluated with sighted humans using the image as a …

Towards unsupervised image captioning with shared multimodal embeddings

I Laina, C Rupprecht, N Navab - Proceedings of the IEEE …, 2019 - openaccess.thecvf.com
Understanding images without explicit supervision has become an important problem in
computer vision. In this paper, we address image captioning by generating language …

SciCap: Generating captions for scientific figures

TY Hsu, CL Giles, THK Huang - arXiv preprint arXiv:2110.11624, 2021 - arxiv.org
Researchers use figures to communicate rich, complex information in scientific papers. The
captions of these figures are critical to conveying effective messages. However, low-quality …

Going beyond one-size-fits-all image descriptions to satisfy the information wants of people who are blind or have low vision

A Stangl, N Verma, KR Fleischmann… - Proceedings of the 23rd …, 2021 - dl.acm.org
Image descriptions are how people who are blind or have low vision (BLV) access
information depicted within images. To our knowledge, no prior work has examined how a …

Supporting accessible data visualization through audio data narratives

A Siu, G SH Kim, S O'Modhrain, S Follmer - Proceedings of the 2022 CHI …, 2022 - dl.acm.org
Online data visualizations play an important role in informing public opinion but are often
inaccessible to screen reader users. To address the need for accessible data …