Learning from Observer Gaze: Zero-Shot Attention Prediction Oriented by Human-Object Interaction Recognition

Y Zhou, L Liu, C Gou - … of the IEEE/CVF Conference on …, 2024 - openaccess.thecvf.com
Most existing attention prediction research focuses on salient instances like humans and
objects. However the more complex interaction-oriented attention arising from the …

Visual Scanpath transformer: guiding computers to see the world

M Qiu, Q Rong, D Liang, H Tu - 2023 IEEE International …, 2023 - ieeexplore.ieee.org
We propose to exploit the scanpath prediction technology to simulate human visual system
to automatically generate gaze scanpaths for VR/AR applications, to alleviate the equipment …

Unifying Top-down and Bottom-up Scanpath Prediction Using Transformers

Z Yang, S Mondal, S Ahn, R Xue… - Proceedings of the …, 2024 - openaccess.thecvf.com
Most models of visual attention aim at predicting either top-down or bottom-up control as
studied using different visual search and free-viewing tasks. In this paper we propose the …

EyeFormer: predicting personalized scanpaths with transformer-guided reinforcement learning

Y Jiang, Z Guo, HR Tavakoli, LA Leiva… - arXiv preprint arXiv …, 2024 - arxiv.org
From a visual perception perspective, modern graphical user interfaces (GUIs) comprise a
complex graphics-rich two-dimensional visuospatial arrangement of text, images, and …

Beyond Average: Individualized Visual Scanpath Prediction

X Chen, M Jiang, Q Zhao - … of the IEEE/CVF Conference on …, 2024 - openaccess.thecvf.com
Understanding how attention varies across individuals has significant scientific and societal
impacts. However existing visual scanpath models treat attention uniformly neglecting …

Trends, Applications, and Challenges in Human Attention Modelling

G Cartella, M Cornia, V Cuculo, A D'Amelio… - arXiv preprint arXiv …, 2024 - arxiv.org
Human attention modelling has proven, in recent years, to be particularly useful not only for
understanding the cognitive processes underlying visual exploration, but also for providing …

Gaze Scanpath Transformer: Predicting Visual Search Target by Spatiotemporal Semantic Modeling of Gaze Scanpath

T Nishiyasu, Y Sato - … of the IEEE/CVF Conference on …, 2024 - openaccess.thecvf.com
We introduce a new method called the Gaze Scanpath Transformer for predicting a search
target category during a visual search task. Previous methods for estimating visual search …

UniAR: Unifying Human Attention and Response Prediction on Visual Content

P Li, J He, G Li, R Bhargava, S Shen… - arXiv preprint arXiv …, 2023 - arxiv.org
Progress in human behavior modeling involves understanding both implicit, early-stage
perceptual behavior such as human attention and explicit, later-stage behavior such as …

Learning User Embeddings from Human Gaze for Personalised Saliency Prediction

F Strohm, M Bâce, A Bulling - Proceedings of the ACM on Human …, 2024 - dl.acm.org
Reusable embeddings of user behaviour have shown significant performance
improvements for the personalised saliency prediction task. However, prior works require …

Gaze-based Opportunistic Privacy-preserving Human-Agent Collaboration

J Grau, S Mayer, J Strecker, K Garcia… - Extended Abstracts of the …, 2024 - dl.acm.org
This paper introduces a novel system to enhance the spatiotemporal alignment of human
abilities in agent-based workflows. This optimization is realized through the application of …