SharpFormer: Learning local feature preserving global representations for image deblurring

Q Yan, D Gong, P Wang, Z Zhang… - IEEE Transactions on …, 2023 - ieeexplore.ieee.org
IEEE Transactions on Image Processing, 2023ieeexplore.ieee.org
The goal of dynamic scene deblurring is to remove the motion blur presented in a given
image. To recover the details from the severe blurs, conventional convolutional neural
networks (CNNs) based methods typically increase the number of convolution layers, kernel-
size, or different scale images to enlarge the receptive field. However, these methods
neglect the non-uniform nature of blurs, and cannot extract varied local and global
information. Unlike the CNNs-based methods, we propose a Transformer-based model for …
The goal of dynamic scene deblurring is to remove the motion blur presented in a given image. To recover the details from the severe blurs, conventional convolutional neural networks (CNNs) based methods typically increase the number of convolution layers, kernel-size, or different scale images to enlarge the receptive field. However, these methods neglect the non-uniform nature of blurs, and cannot extract varied local and global information. Unlike the CNNs-based methods, we propose a Transformer-based model for image deblurring, named SharpFormer, that directly learns long-range dependencies via a novel Transformer module to overcome large blur variations. Transformer is good at learning global information but is poor at capturing local information. To overcome this issue, we design a novel Locality preserving Transformer (LTransformer) block to integrate sufficient local information into global features. In addition, to effectively apply LTransformer to the medium-resolution features, a hybrid block is introduced to capture intermediate mixed features. Furthermore, we use a dynamic convolution (DyConv) block, which aggregates multiple parallel convolution kernels to handle the non-uniform blur of inputs. We leverage a powerful two-stage attentive framework composed of the above blocks to learn the global, hybrid, and local features effectively. Extensive experiments on the GoPro and REDS datasets show that the proposed SharpFormer performs favourably against the state-of-the-art methods in blurred image restoration.
ieeexplore.ieee.org
以上显示的是最相近的搜索结果。 查看全部搜索结果