Vid2avatar: 3d avatar reconstruction from videos in the wild via self-supervised scene decomposition

C Guo, T Jiang, X Chen, J Song… - Proceedings of the …, 2023 - openaccess.thecvf.com
Abstract We present Vid2Avatar, a method to learn human avatars from monocular in-the-
wild videos. Reconstructing humans that move naturally from monocular in-the-wild videos …

Matting anything

J Li, J Jain, H Shi - … of the IEEE/CVF Conference on …, 2024 - openaccess.thecvf.com
In this paper we propose the Matting Anything Model (MAM) an efficient and versatile
framework for estimating the alpha matte of any instance in an image with flexible and …

Real-time high-resolution background matting

S Lin, A Ryabtsev, S Sengupta… - Proceedings of the …, 2021 - openaccess.thecvf.com
We introduce a real-time, high-resolution background replacement technique which
operates at 30fps in 4K resolution, and 60fps for HD on a modern GPU. Our technique is …

Makelttalk: speaker-aware talking-head animation

Y Zhou, X Han, E Shechtman, J Echevarria… - ACM Transactions On …, 2020 - dl.acm.org
We present a method that generates expressive talking-head videos from a single facial
image with audio as the only input. In contrast to previous attempts to learn direct mappings …

Robust high-resolution video matting with temporal guidance

S Lin, L Yang, I Saleemi… - Proceedings of the IEEE …, 2022 - openaccess.thecvf.com
We introduce a robust, real-time, high-resolution human video matting method that achieves
new state-of-the-art performance. Our method is much lighter than previous approaches and …

Ash: Animatable gaussian splats for efficient and photoreal human rendering

H Pang, H Zhu, A Kortylewski… - Proceedings of the …, 2024 - openaccess.thecvf.com
Real-time rendering of photorealistic and controllable human avatars stands as a
cornerstone in Computer Vision and Graphics. While recent advances in neural implicit …

Matteformer: Transformer-based image matting via prior-tokens

GT Park, SJ Son, JY Yoo, SH Kim… - Proceedings of the …, 2022 - openaccess.thecvf.com
In this paper, we propose a transformer-based image matting model called MatteFormer,
which takes full advantage of trimap information in the transformer block. Our method first …

[PDF][PDF] Total relighting: learning to relight portraits for background replacement.

R Pandey, S Orts-Escolano, C Legendre, C Haene… - ACM Trans …, 2021 - 3dvar.com
Compositing a person into a scene to look like they are really there is a fundamental
technique in visual effects, with many other applications such as smartphone photography …

Deep image matting: A comprehensive survey

J Li, J Zhang, D Tao - arXiv preprint arXiv:2304.04672, 2023 - arxiv.org
Image matting refers to extracting precise alpha matte from natural images, and it plays a
critical role in various downstream applications, such as image editing. Despite being an ill …

Modnet: Real-time trimap-free portrait matting via objective decomposition

Z Ke, J Sun, K Li, Q Yan, RWH Lau - … of the AAAI Conference on Artificial …, 2022 - ojs.aaai.org
Existing portrait matting methods either require auxiliary inputs that are costly to obtain or
involve multiple stages that are computationally expensive, making them less suitable for …