Attention drives visual processing and audiovisual integration during multimodal communication

N Seijdel, JM Schoffelen, P Hagoort… - Journal of …, 2024 - Soc Neuroscience
During communication in real-life settings, our brain often needs to integrate auditory and
visual information and at the same time actively focus on the relevant sources of information …

[HTML][HTML] Audiovisual integration in children with cochlear implants revealed through EEG and fNIRS

R Alemi, J Wolfe, S Neumann, J Manning… - Brain Research …, 2023 - Elsevier
Sensory deprivation can offset the balance of audio versus visual information in multimodal
processing. Such a phenomenon could persist for children born deaf, even after they receive …

IIANet: An Intra-and Inter-Modality Attention Network for Audio-Visual Speech Separation

K Li, R Yang, F Sun, X Hu - Forty-first International Conference on …, 2024 - openreview.net
Recent research has made significant progress in designing fusion modules for audio-visual
speech separation. However, they predominantly focus on multi-modal fusion at a single …

The effect of gaze on EEG measures of multisensory integration in a cocktail party scenario

F Ahmed, AR Nidiffer, EC Lalor - Frontiers in Human Neuroscience, 2023 - frontiersin.org
Seeing the speaker's face greatly improves our speech comprehension in noisy
environments. This is due to the brain's ability to combine the auditory and the visual …

Dynamic modeling of EEG responses to natural speech reveals earlier processing of predictable words

J Dou, AJ Anderson, AS White, SV Norman-Haignere… - bioRxiv, 2024 - biorxiv.org
In recent years, it has become clear that EEG indexes the comprehension of natural,
narrative speech. One particularly compelling demonstration of this fact can be seen by …

Dissociable neural correlates of multisensory coherence and selective attention

F Peng, JK Bizley, JW Schnupp… - Journal of …, 2023 - Soc Neuroscience
Previous work has demonstrated that performance in an auditory selective attention task can
be enhanced or impaired, depending on whether a task-irrelevant visual stimulus is …

Increases in sensory noise predict attentional disruptions to audiovisual speech perception

VL Fisher, CL Dean, CS Nave, EV Parkins… - Frontiers in Human …, 2023 - frontiersin.org
We receive information about the world around us from multiple senses which combine in a
process known as multisensory integration. Multisensory integration has been shown to be …

The impact of face masks on face-to-face neural tracking of speech: auditory and visual obstacles

M Fantoni, A Federici, I Camponogara, G Handjaras… - bioRxiv, 2024 - biorxiv.org
Face masks provide fundamental protection against the transmission of respiratory viruses
but hamper communication. We estimated auditory and visual obstacles generated by face …

Electrophysiological Investigations of Attention and Audiovisual Integration During Naturalistic Speech Perception

F Ahmed - 2023 - search.proquest.com
We live in a world that is full of distractions where we find ourselves constantly bombarded
with a multitude of sensory information. Our listening environment extends beyond mere …

Harmonizing with nature: Unpacking the neurophysiological impacts of biophilic sound in virtual classroom design

N Kim, JS Gero, D Jung - 2024 - dl.designresearchsociety.org
This paper presents the results of an experiment on the effects of biophilic sound on
electroencephalography (EEG) activations by comparing two virtual classroom designs: one …