Spherical convolution empowered viewport prediction in 360 video multicast with limited FoV feedback

J Li, L Han, C Zhang, Q Li, Z Liu - ACM Transactions on Multimedia …, 2023 - dl.acm.org
… a spherical convolution-empowered FoV prediction method, which is a multi-source
prediction … A spherical convolutional neural network is used instead of a traditional two-dimensional …

A spherical convolution approach for learning long term viewport prediction in 360 immersive video

C Wu, R Zhang, Z Wang, L Sun - … of the AAAI Conference on Artificial …, 2020 - ojs.aaai.org
… Existing studies based on planar convolutional neural network (CNN) suffer from the image
… the sphere-to-plane projection. In this paper, we start by proposing a spherical convolution

Single and sequential viewports prediction for 360-degree video streaming

Q Yang, J Zou, K Tang, C Li… - 2019 IEEE International …, 2019 - ieeexplore.ieee.org
… and past viewports, we develop a single viewport prediction model using convolutional neural
viewport area in the whole spherical image. Following the correlation filters with weighted …

Very long term field of view prediction for 360-degree video streaming

C Li, W Zhang, Y Liu, Y Wang - 2019 IEEE Conference on …, 2019 - ieeexplore.ieee.org
… on the predicted heatmap. We propose a convolutional LSTM[1] based model to predict the
… precoded into different viewports covering different portions of the sphere surface. Based on …

[PDF][PDF] Transformer-based Long-Term Viewport Prediction in 360° Video: Scanpath is All You Need.

FY Chao, C Ozcinar, A Smolic - MMSP, 2021 - people.rennes.inria.fr
… we propose a novel viewport prediction model to address viewport prediction as a time series
forecasting problem. Unlike … Sun, “A spherical convolution approach for learning long term …

Viewport prediction for panoramic video with multi-CNN

X Li, S Wang, C Zhu, L Song, R Xie… - 2019 IEEE International …, 2019 - ieeexplore.ieee.org
… To solve this, we add 4 convolution layer after the attention model to extend the intra-frame
salient information to the entire receptive field. Through this operation, our model can make a …

Viewport-sphere-Branch Network for Blind Quality Assessment of stitched 360 omnidirectional images

C Tian, F Shao, X Chai, Q Jiang, L Xu… - IEEE Transactions on …, 2022 - ieeexplore.ieee.org
… through deformable convolutions to eliminate 2D-to-Sphere intrinsic sampling distortions
and use multilayer perceptron to predict score of the whole sphere. The final prediction score is …

Spherical Convolution empowered FoV Prediction in 360-degree Video Multicast with Limited FoV Feedback

J Li, L Han, C Zhang, Q Li, Z Liu - arXiv preprint arXiv:2201.12525, 2022 - arxiv.org
… a spherical convolution-empowered FoV prediction method, which is a multi-source prediction
… Jiang, “A viewport prediction framework for panoramic videos,” in 2020 International Joint …

Viewport proposal CNN for 360° video quality assessment

C Li, M Xu, L Jiang, S Zhang… - 2019 IEEE/CVF conference …, 2019 - ieeexplore.ieee.org
… Thus, this paper proposes a viewportbased convolutional … tasks of viewport proposal and
viewport saliency prediction. … the spherical CNN [5] in our VP-net to extract spherical features…

360-degree image classification and viewport prediction using deep neural networks

SS Drisya, A Mahapatra, S Priyadharshini - Advances in Distributed …, 2022 - Springer
… for single viewport prediction with polling layers are dropped and more convolution layers
… video coding based on projection format adaptation and spherical neighboring relationship. …