Propainter: Improving propagation and transformer for video inpainting

S Zhou, C Li, KCK Chan… - Proceedings of the IEEE …, 2023 - openaccess.thecvf.com
Flow-based propagation and spatiotemporal Transformer are two mainstream mechanisms
in video inpainting (VI). Despite the effectiveness of these components, they still suffer from …

Towards an end-to-end framework for flow-guided video inpainting

Z Li, CZ Lu, J Qin, CL Guo… - Proceedings of the IEEE …, 2022 - openaccess.thecvf.com
Optical flow, which captures motion information across frames, is exploited in recent video
inpainting methods through propagating pixels along its trajectories. However, the hand …

Fuseformer: Fusing fine-grained information in transformers for video inpainting

R Liu, H Deng, Y Huang, X Shi, L Lu… - Proceedings of the …, 2021 - openaccess.thecvf.com
Transformer, as a strong and flexible architecture for modelling long-range relations, has
been widely explored in vision tasks. However, when used in video inpainting that requires …

Towards language-driven video inpainting via multimodal large language models

J Wu, X Li, C Si, S Zhou, J Yang… - Proceedings of the …, 2024 - openaccess.thecvf.com
We introduce a new task--language-driven video inpainting which uses natural language
instructions to guide the inpainting process. This approach overcomes the limitations of …

Inertia-guided flow completion and style fusion for video inpainting

K Zhang, J Fu, D Liu - … of the IEEE/CVF conference on …, 2022 - openaccess.thecvf.com
Physical objects have inertia, which resists changes in the velocity and motion direction.
Inspired by this, we introduce inertia prior that optical flow, which reflects object motion in a …

Dlformer: Discrete latent transformer for video inpainting

J Ren, Q Zheng, Y Zhao, X Xu… - Proceedings of the IEEE …, 2022 - openaccess.thecvf.com
Video inpainting remains a challenging problem to fill with plausible and coherent content in
unknown areas in video frames despite the prevalence of data-driven methods. Although …

Progressive temporal feature alignment network for video inpainting

X Zou, L Yang, D Liu, YJ Lee - Proceedings of the IEEE/CVF …, 2021 - openaccess.thecvf.com
Video inpainting aims to fill spatio-temporal" corrupted" regions with plausible content. To
achieve this goal, it is necessary to find correspondences from neighbouring frames to …

Decoupled spatial-temporal transformer for video inpainting

R Liu, H Deng, Y Huang, X Shi, L Lu, W Sun… - arXiv preprint arXiv …, 2021 - arxiv.org
Video inpainting aims to fill the given spatiotemporal holes with realistic appearance but is
still a challenging task even with prosperous deep learning approaches. Recent works …

Error compensation framework for flow-guided video inpainting

J Kang, SW Oh, SJ Kim - European conference on computer vision, 2022 - Springer
The key to video inpainting is to use correlation information from as many reference frames
as possible. Existing flow-based propagation methods split the video synthesis process into …

Deep learning-based image and video inpainting: A survey

W Quan, J Chen, Y Liu, DM Yan, P Wonka - International Journal of …, 2024 - Springer
Image and video inpainting is a classic problem in computer vision and computer graphics,
aiming to fill in the plausible and realistic content in the missing areas of images and videos …