Super resolve dynamic scene from continuous spike streams

J Zhao, J Xie, R Xiong, J Zhang… - Proceedings of the …, 2021 - openaccess.thecvf.com
Proceedings of the IEEE/CVF International Conference on …, 2021openaccess.thecvf.com
Recently, a novel retina-inspired camera, namely spike camera, has shown great potential
for recording high-speed dynamic scenes. Unlike the conventional digital cameras that
compact the visual information within the exposure interval into a single snapshot, the spike
camera continuously outputs binary spike streams to record the dynamic scenes, yielding a
very high temporal resolution. Most of the existing reconstruction methods for spike camera
focus on reconstructing images with the same resolution as spike camera. However, as a …
Abstract
Recently, a novel retina-inspired camera, namely spike camera, has shown great potential for recording high-speed dynamic scenes. Unlike the conventional digital cameras that compact the visual information within the exposure interval into a single snapshot, the spike camera continuously outputs binary spike streams to record the dynamic scenes, yielding a very high temporal resolution. Most of the existing reconstruction methods for spike camera focus on reconstructing images with the same resolution as spike camera. However, as a trade-off of high temporal resolution, the spatial resolution of spike camera is limited, resulting in inferior details of the reconstruction. To address this issue, we develop a spike camera super-resolution framework, aiming to super resolve high-resolution intensity images from the low-resolution binary spike streams. Due to the relative motion between the camera and the objects to capture, the spikes fired by the same sensor pixel no longer describes the same points in the external scene. In this paper, we properly exploit the relative motion and derive the relationship between light intensity and each spike, so as to recover the external scene with both high temporal and high spatial resolution. Experimental results demonstrate that the proposed method can reconstruct pleasant high-resolution images from low-resolution spike streams.
openaccess.thecvf.com
以上显示的是最相近的搜索结果。 查看全部搜索结果

Google学术搜索按钮

example.edu/paper.pdf
搜索
获取 PDF 文件
引用
References