fMRI-based perceptual validation of a computational model for visual and auditory saliency in videos

G Panagiotaropoulou, P Koutras… - … on Image Processing …, 2016 - ieeexplore.ieee.org
In this study, we make use of brain activation data to investigate the perceptual plausibility of
a visual and an auditory model for visual and auditory saliency in video processing. These …

Audio-visual temporal saliency modeling validated by fmri data

P Koutras, G Panagiotaropoulou… - Proceedings of the …, 2018 - openaccess.thecvf.com
In this work we propose an audio-visual model for pre-dicting temporal saliency in videos,
that we validate and evaluate in an alternative way by employing fMRI data. We intend to …

Towards a behaviorally-validated computational audiovisual saliency model

A Tsiami, A Katsamanis, P Maragos… - … on Acoustics, Speech …, 2016 - ieeexplore.ieee.org
Computational saliency models aim at predicting, in a bottom-up fashion, where human
attention is drawn in the presented (visual, auditory or audiovisual) scene and have been …

Audio-visual saliency map: Overview, basic models and hardware implementation

S Ramenahalli, DR Mendat… - 2013 47th Annual …, 2013 - ieeexplore.ieee.org
In this paper we provide an overview of audiovisual saliency map models. In the simplest
model, the location of auditory source is modeled as a Gaussian and use different methods …

A temporal saliency map for modeling auditory attention

EM Kaya, M Elhilali - 2012 46th Annual Conference on …, 2012 - ieeexplore.ieee.org
The auditory system is flooded with information throughout our daily lives. Rather than
processing all of this information, we selectively shift our attention to various auditory events …

Towards understanding and modeling audiovisual saliency based on talking faces

NO Sidaty, MC Larabi… - 2014 Tenth International …, 2014 - ieeexplore.ieee.org
Usual attention is an important mechanism of the human visual system. It allows reducing
the amount of information to be processed and accelerates the overall process of vision …

A behaviorally inspired fusion approach for computational audiovisual saliency modeling

A Tsiami, P Koutras, A Katsamanis, A Vatakis… - Signal Processing …, 2019 - Elsevier
Human attention is highly influenced by multi-modal combinations of perceived sensory
information and especially audiovisual information. Although systematic behavioral …

Towards multimodal saliency detection: An enhancement of audio-visual correlation estimation

A Rodríguez-Hidalgo, C Peláez-Moreno… - 2017 IEEE 16th …, 2017 - ieeexplore.ieee.org
This work is focused on the task of multimodal saliency detection. Very few works have been
developed in the field, and there are no well-established baselines or benchmarks …

Using auditory saliency to understand complex auditory scenes

V Duangudom, DV Anderson - 2007 15th European Signal …, 2007 - ieeexplore.ieee.org
In this paper, we present a computational model for predicting pre-attentive, bottom-up
auditory saliency. The model determines perceptually what in a scene stands out to …

FMRI-Guided Time-Symmetric Joint Model for Visual Attention Prediction

Y Wei, C Ma, T Zhong, L Du, T Zhang… - 2023 IEEE …, 2023 - ieeexplore.ieee.org
Visual attention prediction is linked to brain activity, cognition, and behavior. Despite the
availability of brain activity features, previous studies have not fully utilized them, resulting in …