[HTML][HTML] Audio in VR: Effects of a soundscape and movement-triggered step sounds on presence

AC Kern, W Ellermeier - Frontiers in Robotics and AI, 2020 - frontiersin.org
… the perceived synchronicity of the sensor-triggered step sounds was … kinds of audio
manipulations on perceived presence and … than that of including footstep sounds, possibly due to …

Soundspaces: Audio-visual navigation in 3d environments

C Chen, U Jain, C Schissler, SVA Gari… - Computer Vision–ECCV …, 2020 - Springer
sound sources in an array of real-world scanned environments. Our results show that audio
greatly benefits embodied visual … We present the first audio-visual simulator for AI agent …

Music gesture for visual sound separation

C Gan, D Huang, H Zhao… - … on Computer Vision …, 2020 - openaccess.thecvf.com
… -based video representations to guide the sound source separation. • We propose a
novel audio-visual fusion module to associate human body motion cues with the sound signals. …

Look, listen, and act: Towards audio-visual embodied navigation

C Gan, Y Zhang, J Wu, B Gong… - … on Robotics and …, 2020 - ieeexplore.ieee.org
… humans can mentally infer the sound locations, here we introduce a sound perception module
used for estimating the coordinates of the goal, ie, the location of the sound source in our …

[HTML][HTML] What you see is what you hear: Twenty years of research using the Sound-Induced Flash Illusion

RJ Hirst, DP McGovern, A Setti, L Shams… - … & Biobehavioral Reviews, 2020 - Elsevier
… In the Sound-Induced Flash Illusion (SIFI) sound dramatically alters visual perception, as
presenting a single flash with two beeps results in the perception of two flashes. In this …

[HTML][HTML] Efficiency of sensory substitution devices alone and in combination with self-motion for spatial navigation in sighted and visually impaired

C Jicol, T Lloyd-Esenkaya, MJ Proulx… - Frontiers in …, 2020 - frontiersin.org
… Here, we examine this possibility by first testing whether combining a vision-to-sound and
a vision-to-tactile information as provided by two SSDs can enhance navigation performance …

[HTML][HTML] How fly neurons compute the direction of visual motion

A Borst, J Haag, AS Mauss - Journal of Comparative Physiology A, 2020 - Springer
… Such neurons, termed lobula plate tangential cells (LPTCs), respond with depolarization
to visual motion in their preferred direction and hyperpolarization to motion in the opposite …

Movement-related signals in sensory areas: roles in natural behavior

PRL Parker, MA Brown, MC Smear, CM Niell - Trends in neurosciences, 2020 - cell.com
… As the authors note, ‘much of the single-trial activity that is often assumed to be noise or to
reflect random network fluctuations is instead related to uninstructed movements’. Similar to …

Evidence for a third visual pathway specialized for social perception

D Pitcher, LG Ungerleider - Trends in Cognitive Sciences, 2021 - cell.com
… connection that projects from primary visual cortex (V1) directly into the motion-selective
area MT. MT has direct anatomical connections with anterior visual motion areas in the medial …

Learning to set waypoints for audio-visual navigation

C Chen, S Majumder, Z Al-Halah, R Gao… - arXiv preprint arXiv …, 2020 - arxiv.org
… model under noisy audio perception, we consider two sources of audio noise: environment
noise and microphone noise. For environment noise, we add distractor sounds (eg human …