Multimodality in VR: A survey

D Martin, S Malpica, D Gutierrez, B Masia… - ACM Computing …, 2022 - dl.acm.org
Virtual reality (VR) is rapidly growing, with the potential to change the way we create and
consume content. In VR, users integrate multimodal sensory information they receive to …

Guidance in cinematic virtual reality-taxonomy, research status and challenges

S Rothe, D Buschek, H Hußmann - Multimodal Technologies and …, 2019 - mdpi.com
In Cinematic Virtual Reality (CVR), the viewer of an omnidirectional movie can freely choose
the viewing direction when watching a movie. Therefore, traditional techniques in filmmaking …

Predicting head movement in panoramic video: A deep reinforcement learning approach

M Xu, Y Song, J Wang, ML Qiao… - IEEE transactions on …, 2018 - ieeexplore.ieee.org
Panoramic video provides immersive and interactive experience by enabling humans to
control the field of view (FoV) through head movement (HM). Thus, HM plays a key role in …

Cube padding for weakly-supervised saliency prediction in 360 videos

HT Cheng, CH Chao, JD Dong… - Proceedings of the …, 2018 - openaccess.thecvf.com
Automatic saliency prediction in 360 videos is critical for viewpoint guidance applications
(eg, Facebook 360 Guide). We propose a spatial-temporal network which is (1) …

Deep 360 pilot: Learning a deep agent for piloting through 360 sports videos

HN Hu, YC Lin, MY Liu, HT Cheng… - … IEEE Conference on …, 2017 - ieeexplore.ieee.org
Watching a 360° sports video requires a viewer to continuously select a viewing angle,
either through a sequence of mouse clicks or head movements. To relieve the viewer from …

Kernel transformer networks for compact spherical convolution

YC Su, K Grauman - … of the IEEE/CVF Conference on …, 2019 - openaccess.thecvf.com
Ideally, 360deg imagery could inherit the deep convolutional neural networks (CNNs)
already trained with great success on perspective projection images. However, existing …

Self-supervised learning of depth and camera motion from 360 videos

FE Wang, HN Hu, HT Cheng, JT Lin, ST Yang… - Asian Conference on …, 2018 - Springer
As 360^ ∘ cameras become prevalent in many autonomous systems (eg, self-driving cars
and drones), efficient 360^ ∘ perception becomes more and more important. We propose a …

A survey on optimizing mobile delivery of 360° videos: Edge caching and multicasting

M Mahmoud, S Rizou, AS Panayides… - IEEE …, 2023 - ieeexplore.ieee.org
Recently, there has been an ever-growing demand for virtual reality (VR) and 360° video
applications. Different from conventional 2D videos, 360° videos take users into an …

Sense of presence, attitude change, perspective-taking and usability in first-person split-sphere 360 video

T Aitamurto, S Zhou, S Sakshuwong… - Proceedings of the …, 2018 - dl.acm.org
This paper examines the sense of presence, attitude change, perspective-taking, and
usability of a split-sphere, first-person perspective 360 degree video about gender …

Outside-in: Visualizing out-of-sight regions-of-interest in a 360 video using spatial picture-in-picture previews

YT Lin, YC Liao, SY Teng, YJ Chung, L Chan… - Proceedings of the 30th …, 2017 - dl.acm.org
360-degree video contains a full field of environmental content. However, browsing these
videos, either on screens or through head-mounted displays (HMDs), users consume only a …