Image Demoiréing via Multi-scale Fusion Networks with Moiré Data Augmentation

YT Peng, CH Hou, YC Lee, AJ Yoon… - IEEE Sensors …, 2024 - ieeexplore.ieee.org
YT Peng, CH Hou, YC Lee, AJ Yoon, Z Chen, YT Lin, WC Lien
IEEE Sensors Journal, 2024ieeexplore.ieee.org
In digital imaging, Moiré patterns pose a significant challenge, appearing as rainbow-
colored, warped grid patterns. These artifacts emerge when two overlapping patterns create
color distortions due to their slight differences. The limitations of Complementary metal-oxide-
semiconductor active pixel sensors become apparent in photos, as these sensors capture
information discretely in pixels. This is particularly pronounced when photographing
patterned items, mainly due to misalignment issues between the sensor and the regularly …
In digital imaging, Moiré patterns pose a significant challenge, appearing as rainbow-colored, warped grid patterns. These artifacts emerge when two overlapping patterns create color distortions due to their slight differences. The limitations of Complementary metal-oxide-semiconductor active pixel sensors become apparent in photos, as these sensors capture information discretely in pixels. This is particularly pronounced when photographing patterned items, mainly due to misalignment issues between the sensor and the regularly spaced, overlapping stripes. This process creates a disparity between real-world continuous lines and digital screens, thereby complicating the work of professional photographers. In response to this challenge, we propose the Demoiréing Multi-Scale Fusion Network (DMSFN). By leveraging dilated-dense attention, multi-scale feature interaction, and multi-kernel strip pooling, our approach effectively detects and removes Moiré patterns from sensor outputs. To enhance the demoiréing performance, we augment the training data by transferring Moiré patterns to clean images. Our experimental results indicate that our proposed model outperforms existing state-of-the-art demoiréing methods, as validated on benchmark datasets. This work contributes to advancing the quality of digital sensor outputs in the presence of Moiré patterns and addressing challenges encountered in practical applications.
ieeexplore.ieee.org
以上显示的是最相近的搜索结果。 查看全部搜索结果