ImageExplorer: Multi-layered touch exploration to encourage skepticism towards imperfect AI-generated image captions

J Lee, J Herskovitz, YH Peng, A Guo - … of the 2022 CHI Conference on …, 2022 - dl.acm.org
… Quantitatively, our results show that for image caption quality C (inaccurate captions), the
touchbased systems made participants decrease the accuracy ratings signifcantly more (µ = −…

Image Explorer: Multi-layered touch exploration to make images accessible

J Lee, YH Peng, J Herskovitz, A Guo - Proceedings of the 23rd …, 2021 - dl.acm.org
image captions, we present Image Explorer, a touch-based image exploration system that
divides image information into multiple layers to allow users to explore the spatial layout and …

Pictures in your mind: using interactive gesture-controlled reliefs to explore art

A Reichinger, HG Carrizosa, J Wood… - ACM Transactions on …, 2018 - dl.acm.org
explore museums using audio guides, live audio described tours, large-print guides, Braille
gallery guides, Braille captions, and touch … to the visual arts of images, photos, and paintings, …

ImageAssist: Tools for Enhancing Touchscreen-Based Image Exploration Systems for Blind and Low Vision Users

V Nair, HH Zhu, BA Smith - Proceedings of the 2023 CHI Conference on …, 2023 - dl.acm.org
… a brief caption of the image before exploration in order to reduce the cognitive demands
associated with gaining a global understanding of the image [1, 37]; providing a brief caption

PictureSensation–a mobile application to help the blind explore the visual world through touch and sound

M Banf, R Mikalay, B Watzke… - Journal of rehabilitation …, 2016 - journals.sagepub.com
… Therefore, PictureSensation harnesses our exploration paradigm 5 of multi-level image
information, which is inspired by how blind people explore a bas-relief image or Braille texts …

Learning rich touch representations through cross-modal self-supervision

M Zambelli, Y Aytar, F Visin, Y Zhou… - Conference on Robot …, 2021 - proceedings.mlr.press
… In this situation, reaching with a hand in the bag allows us to explore using touch alone but,
… Show, attend and tell: Neural image caption generation with visual attention. In International …

Eyedescribe: Combining eye gaze and speech to automatically create accessible touch screen artwork

K Reinholt, D Guinness, SK Kane - Proceedings of the 2019 ACM …, 2019 - dl.acm.org
… We define spatial captioning as the creation of an image description that includes both text
… After documenting the creation of spatial captions using EyeDescribe, we then explore how …

Self-guided Spatial Composition as an Additional Layer of Information to Enhance Accessibility of Images for Blind Users

R Hervás, A Díaz, M Amor, A Chaves… - Proceedings of the XXIV …, 2024 - dl.acm.org
… This work explores the combination of image captioning and … -the-art algorithms of image
captioning and object detection will … image; and (2) blind users will guide the exploration of the …

Towards Comprehensive Multimodal Perception: Introducing the Touch-Language-Vision Dataset

N Cheng, Y Li, J Gao, B Fang, J Xu, W Han - arXiv preprint arXiv …, 2024 - arxiv.org
… modalities, with limited exploration in the domain of language. … by incorporating detailed
and qualitative captions, fostering a … For visual images where no object is touched, we do not …

Language of gleam: impressionism artwork automatic caption generation for people with visual impairments

D Lee, H Hwang, MS Jabbar… - … Conference on Machine …, 2021 - spiedigitallibrary.org
… visual artworks through image caption generation using … the stability of generated image
captioning for stylized MS-… to choose any artwork for exploration in detail using existing methods…