State-of-the-art in 360 video/image processing: Perception, assessment and compression

M Xu, C Li, S Zhang, P Le Callet - IEEE Journal of Selected …, 2020 - ieeexplore.ieee.org
Nowadays, 360° video/image has been increasingly popular and drawn great attention. The
spherical viewing range of 360° video/image accounts for huge data, which pose the …

Review on panoramic imaging and its applications in scene understanding

S Gao, K Yang, H Shi, K Wang… - IEEE Transactions on …, 2022 - ieeexplore.ieee.org
With the rapid development of high-speed communication and artificial intelligence
technologies, human perception of real-world scenes is no longer limited to the use of small …

On translation invariance in cnns: Convolutional layers can exploit absolute spatial location

OS Kayhan, JC Gemert - … of the IEEE/CVF Conference on …, 2020 - openaccess.thecvf.com
In this paper we challenge the common assumption that convolutional layers in modern
CNNs are translation invariant. We show that CNNs can and will exploit the absolute spatial …

Improving data‐driven global weather prediction using deep convolutional neural networks on a cubed sphere

JA Weyn, DR Durran, R Caruana - Journal of Advances in …, 2020 - Wiley Online Library
We present a significantly improved data‐driven global weather forecasting framework using
a deep convolutional neural network (CNN) to forecast several basic atmospheric variables …

Omnifusion: 360 monocular depth estimation via geometry-aware fusion

Y Li, Y Guo, Z Yan, X Huang… - Proceedings of the …, 2022 - openaccess.thecvf.com
A well-known challenge in applying deep-learning methods to omnidirectional images is
spherical distortion. In dense regression tasks such as depth estimation, where structural …

Hohonet: 360 indoor holistic understanding with latent horizontal features

C Sun, M Sun, HT Chen - … of the IEEE/CVF Conference on …, 2021 - openaccess.thecvf.com
We present HoHoNet, a versatile and efficient framework for holistic understanding of an
indoor 360-degree panorama using a Latent Horizontal Feature (LHFeat). The compact …

Partial convolution for padding, inpainting, and image synthesis

G Liu, A Dundar, KJ Shih, TC Wang… - … on Pattern Analysis …, 2022 - ieeexplore.ieee.org
Partial convolution weights convolutions with binary masks and renormalizes on valid pixels.
It was originally proposed for image inpainting task because a corrupted image processed …

Bifuse: Monocular 360 depth estimation via bi-projection fusion

FE Wang, YH Yeh, M Sun… - Proceedings of the …, 2020 - openaccess.thecvf.com
Depth estimation from a monocular 360 image is an emerging problem that gains popularity
due to the availability of consumer-level 360 cameras and the complete surrounding …

Learning representations from audio-visual spatial alignment

P Morgado, Y Li… - Advances in Neural …, 2020 - proceedings.neurips.cc
We introduce a novel self-supervised pretext task for learning representations from audio-
visual content. Prior work on audio-visual representation learning leverages …

Pano-avqa: Grounded audio-visual question answering on 360deg videos

H Yun, Y Yu, W Yang, K Lee… - Proceedings of the IEEE …, 2021 - openaccess.thecvf.com
Abstract 360deg videos convey holistic views for the surroundings of a scene. It provides
audio-visual cues beyond predetermined normal field of views and displays distinctive …