FaceClone: Interactive facial shape and motion cloning system using multi-view images

K Lee, J Lee, H Lee, M Jang, S Lee… - 2023 IEEE International …, 2023 - ieeexplore.ieee.org
K Lee, J Lee, H Lee, M Jang, S Lee, S Lee
2023 IEEE International Conference on Multimedia and Expo …, 2023ieeexplore.ieee.org
We present an interactive face cloning system that imitates users' facial expressions in
virtual space. To do this, we construct a multi-view capture studio. Our system consists of
offline and online stages. In the offline stage, facial shapes and light conditions are jointly
optimized to obtain a realistic facial scan from static multi-view images. In the online stage,
the facial scan is parameterized using landmarks and it is deformed according to the users'
facial expressions. Furthermore, our system provides a GUI to allow user interaction with the …
We present an interactive face cloning system that imitates users' facial expressions in virtual space. To do this, we construct a multi-view capture studio. Our system consists of offline and online stages. In the offline stage, facial shapes and light conditions are jointly optimized to obtain a realistic facial scan from static multi-view images. In the online stage, the facial scan is parameterized using landmarks and it is deformed according to the users' facial expressions. Furthermore, our system provides a GUI to allow user interaction with the generated facial clone. We demonstrate our system enables immersive communication in a virtual world.
ieeexplore.ieee.org
以上显示的是最相近的搜索结果。 查看全部搜索结果