Megaportraits: One-shot megapixel neural head avatars

N Drobyshev, J Chelishev, T Khakhulin… - Proceedings of the 30th …, 2022 - dl.acm.org
N Drobyshev, J Chelishev, T Khakhulin, A Ivakhnenko, V Lempitsky, E Zakharov
Proceedings of the 30th ACM International Conference on Multimedia, 2022dl.acm.org
In this work, we advance the neural head avatar technology to the megapixel resolution
while focusing on the particularly challenging task of cross-driving synthesis, ie, when the
appearance of the driving image is substantially different from the animated source image.
We propose a set of new neural architectures and training methods that can leverage both
medium-resolution video data and high-resolution image data to achieve the desired levels
of rendered image quality and generalization to novel views and motion. We demonstrate …
In this work, we advance the neural head avatar technology to the megapixel resolution while focusing on the particularly challenging task of cross-driving synthesis, i.e., when the appearance of the driving image is substantially different from the animated source image. We propose a set of new neural architectures and training methods that can leverage both medium-resolution video data and high-resolution image data to achieve the desired levels of rendered image quality and generalization to novel views and motion. We demonstrate that suggested architectures and methods produce convincing high-resolution neural avatars, outperforming the competitors in the cross-driving scenario. Lastly, we show how a trained high-resolution neural avatar model can be distilled into a lightweight student model which runs in real-time and locks the identities of neural avatars to several dozens of pre-defined source images. Real-time operation and identity lock are essential for many practical applications head avatar systems.
ACM Digital Library
以上显示的是最相近的搜索结果。 查看全部搜索结果