Emotional listener portrait: Neural listener head generation with emotion

L Song, G Yin, Z Jin, X Dong… - Proceedings of the IEEE …, 2023 - openaccess.thecvf.com
Listener head generation centers on generating non-verbal behaviors (eg, smile) of a
listener in reference to the information delivered by a speaker. A significant challenge when …

Mfr-net: Multi-faceted responsive listening head generation via denoising diffusion model

J Liu, X Wang, X Fu, Y Chai, C Yu, J Dai… - Proceedings of the 31st …, 2023 - dl.acm.org
Face-to-face communication is a common scenario including roles of speakers and
listeners. Most existing research methods focus on producing speaker videos, while the …

Emotional listener portrait: Realistic listener motion simulation in conversation

L Song, G Yin, Z Jin, X Dong… - 2023 IEEE/CVF …, 2023 - ieeexplore.ieee.org
Listener head generation centers on generating non-verbal behaviors (eg, smile) of a
listener in reference to the information delivered by a speaker. A significant challenge when …

CustomListener: Text-guided Responsive Interaction for User-friendly Listening Head Generation

X Liu, Y Guo, C Zhen, T Li, Y Ao… - Proceedings of the …, 2024 - openaccess.thecvf.com
Listening head generation aims to synthesize a non-verbal responsive listener head by
modeling the correlation between the speaker and the listener in dynamic conversion. The …

Video-driven speaker-listener generation based on Transformer and neural renderer

D Yang, Q Yang, W Jiang, J Chen, Z Shao… - Multimedia Tools and …, 2024 - Springer
The traditional speaker-centric synthesis methods prioritize language accuracy but overlook
emotional connection and feedback mechanisms with the audience. This paper is dedicated …

Leveraging WaveNet for Dynamic Listening Head Modeling from Speech

MD Nguyen, HJ Yang, SW Kim, JE Shin… - arXiv preprint arXiv …, 2024 - arxiv.org
The creation of listener facial responses aims to simulate interactive communication
feedback from a listener during a face-to-face conversation. Our goal is to generate …

ListenFormer: Responsive Listening Head Generation with Non-autoregressive Transformers

M Liu, J Wang, X Qian, H Li - ACM Multimedia 2024 - openreview.net
As one of the crucial elements in human-robot interaction, responsive listening head
generation has attracted considerable attention from researchers. It aims to generate a …

Why Don't You Speak?: A Smartphone Application to Engage Museum Visitors Through Deepfakes Creation

M Zaramella, I Amerini, P Russo - Proceedings of the 5th Workshop on …, 2023 - dl.acm.org
In this paper, we offer a gamification-based application for the cultural heritage sector that
aims to enhance the learning and fruition of museum artworks. The application encourages …