Bodily behaviors in social interaction: Novel annotations and state-of-the-art evaluation
Body language is an eye-catching social signal and its automatic analysis can significantly
advance artificial intelligence systems to understand and actively participate in social …
advance artificial intelligence systems to understand and actively participate in social …
MultiMediate'22: Backchannel Detection and Agreement Estimation in Group Interactions
Backchannels, ie short interjections of the listener, serve important meta-conversational
purposes like signifying attention or indicating agreement. Despite their key role, automatic …
purposes like signifying attention or indicating agreement. Despite their key role, automatic …
MultiMediate'23: Engagement Estimation and Bodily Behaviour Recognition in Social Interactions
Automatic analysis of human behaviour is a fundamental prerequisite for the creation of
machines that can effectively interact with-and support humans in social interactions. In …
machines that can effectively interact with-and support humans in social interactions. In …
Graph-based group modelling for backchannel detection
The brief responses given by listeners in group conversations are known as backchannels
rendering the task of backchannel detection an essential facet of group interaction analysis …
rendering the task of backchannel detection an essential facet of group interaction analysis …
Gaze-enhanced crossmodal embeddings for emotion recognition
Emotional expressions are inherently multimodal--integrating facial behavior, speech, and
gaze--but their automatic recognition is often limited to a single modality, eg speech during a …
gaze--but their automatic recognition is often limited to a single modality, eg speech during a …
Using motion histories for eye contact detection in multiperson group conversations
EY Fu, MW Ngai - Proceedings of the 29th ACM International …, 2021 - dl.acm.org
Eye contact detection in group conversations is the key to developing artificial mediators that
can understand and interact with a group. In this paper, we propose to model a group's …
can understand and interact with a group. In this paper, we propose to model a group's …
Data Augmentation for Human Behavior Analysis in Multi-Person Conversations
In this paper, we present the solution of our team HFUT-VUT for the MultiMediate Grand
Challenge 2023 at ACM Multimedia 2023. The solution covers three sub-challenges: bodily …
Challenge 2023 at ACM Multimedia 2023. The solution covers three sub-challenges: bodily …
Backchannel Detection and Agreement Estimation from Video with Transformer Networks
A Amer, C Bhuvaneshwara, GK Addluri… - … Joint Conference on …, 2023 - ieeexplore.ieee.org
Listeners use short interjections, so-called backchannels, to signify attention or express
agreement. The automatic analysis of this behavior is of key importance for human …
agreement. The automatic analysis of this behavior is of key importance for human …
Group-level focus of visual attention for improved next speaker prediction
In this work we address the Next Speaker Prediction sub challenge of the ACM'21
MultiMediate Grand Challenge. This challenge poses the problem of turn taking prediction in …
MultiMediate Grand Challenge. This challenge poses the problem of turn taking prediction in …
TA-CNN: A Unified Network for Human Behavior Analysis in Multi-Person Conversations
Human behavior analysis in multi-person conversations has been one of the most important
research issues for natural human-robot interaction. However, previous datasets and studies …
research issues for natural human-robot interaction. However, previous datasets and studies …