Unifarn: Unified transformer for facial reaction generation

C Liang, J Wang, H Zhang, B Tang, J Huang… - Proceedings of the 31st …, 2023 - dl.acm.org
We propose the Unified Transformer for Facial Reaction GeneratioN (UniFaRN) framework
for facial reaction prediction in dyadic interactions. Given the video and audio of one side …

React2023: The first multiple appropriate facial reaction generation challenge

S Song, M Spitale, C Luo, G Barquero… - Proceedings of the 31st …, 2023 - dl.acm.org
The Multiple Appropriate Facial Reaction Generation Challenge (REACT2023) is the first
competition event focused on evaluating multimedia processing and machine learning …

Leveraging the latent diffusion models for offline facial multiple appropriate reactions generation

J Yu, J Zhao, G Xie, F Chen, Y Yu, L Peng… - Proceedings of the 31st …, 2023 - dl.acm.org
Offline Multiple Appropriate Facial Reaction Generation (OMAFRG) aims to predict the
reaction of different listeners given a speaker, which is useful in the senario of human …

React 2024: the second multiple appropriate facial reaction generation challenge

S Song, M Spitale, C Luo, C Palmero… - arXiv preprint arXiv …, 2024 - arxiv.org
In dyadic interactions, humans communicate their intentions and state of mind using verbal
and non-verbal cues, where multiple different facial reactions might be appropriate in …

BEAMER: Behavioral Encoder to Generate Multiple Appropriate Facial Reactions

X Hoque, A Mann, G Sharma, A Dhall - Proceedings of the 31st ACM …, 2023 - dl.acm.org
This paper presents a framework for generating appropriate facial expressions for a listener
engaged in a dyadic conversation. The ability to produce contextually suitable facial …

Perfrdiff: Personalised weight editing for multiple appropriate facial reaction generation

H Zhu, X Kong, W Xie, X Huang, L Shen, L Liu… - Proceedings of the …, 2024 - dl.acm.org
Human facial reactions play crucial roles in dyadic human-human interactions, where
individuals (ie, listeners) with varying cognitive process styles may display different but …

Vector quantized diffusion models for multiple appropriate reactions generation

MD Nguyen, HJ Yang, NH Ho, SH Kim… - 2024 IEEE 18th …, 2024 - ieeexplore.ieee.org
In the realm of dyadic interactions, the ability to generate appropriate facial reactions is
paramount for the conveyance of empathy and understanding. This paper introduces a …

EVAC 2024–Empathic Virtual Agent Challenge: Appraisal-based Recognition of Affective States

F Ringeval, B Schuller, G Bailly, S Azzakhnini… - Proceedings of the 26th …, 2024 - dl.acm.org
As autonomous interactive agents become increasingly prevalent, it is crucial for these
virtual agents to understand and respond to both our verbal content and emotions, enabling …

Multiple facial reaction generation using gaussian mixture of models and multimodal bottleneck transformer

DK Nguyen, P Paudel, SW Kim, JE Shin… - 2024 IEEE 18th …, 2024 - ieeexplore.ieee.org
Facial reaction generation has gained prominence in recent years. However, while there
has been extensive research on synthesizing facial expressions from the perspective of the …

Finite scalar quantization as facial tokenizer for dyadic reaction generation

QT Dam, TTN Nguyen, DT Tran… - 2024 IEEE 18th …, 2024 - ieeexplore.ieee.org
Creating a human-like interface in human-robot interaction is a formidable challenge. Many
efforts have been made to mimic the human ability of attentive listening and synchronous …