Zero-shot style transfer for gesture animation driven by text and speech using adversarial disentanglement of multimodal style encoding
Modeling virtual agents with behavior style is one factor for personalizing human-agent
interaction. We propose an efficient yet effective machine learning approach to synthesize …
interaction. We propose an efficient yet effective machine learning approach to synthesize …
The relative importance of social cues in immersive mediated communication
Effective interpersonal communication is important to maintain relationships and build trust,
empathy, and confidence. In this digital age, communication has become mediated, which …
empathy, and confidence. In this digital age, communication has become mediated, which …
Data-Driven Communicative Behaviour Generation: A Survey
N Oralbayeva, A Aly, A Sandygulova… - ACM Transactions on …, 2024 - dl.acm.org
The development of data-driven behaviour generating systems has recently become the
focus of considerable attention in the fields of human–agent interaction and human–robot …
focus of considerable attention in the fields of human–agent interaction and human–robot …
Transformer network for semantically-aware and speech-driven upper-face generation
We propose a semantically-aware speech driven model to generate expressive and natural
upper-facial and head motion for Embodied Conversational Agents (ECA). In this work, we …
upper-facial and head motion for Embodied Conversational Agents (ECA). In this work, we …
Zero-shot style transfer for multimodal data-driven gesture synthesis
We propose a multimodal speech driven approach to generate 2D upper-body gestures for
virtual agents, in the communicative style of different speakers, seen or unseen by our model …
virtual agents, in the communicative style of different speakers, seen or unseen by our model …
The Impression of Phones and Prosody Choice in the Gibberish Speech of the Virtual Embodied Conversational Agent Kotaro
AGC Gonzalez, WS Lo, I Mizuuchi - Applied Sciences, 2023 - mdpi.com
The number of smart devices is expected to exceed 100 billion by 2050, and many will
feature conversational user interfaces. Thus, methods for generating appropriate prosody for …
feature conversational user interfaces. Thus, methods for generating appropriate prosody for …
META4: semantically-aligned generation of metaphoric gestures using self-supervised text and speech representation
Image Schemas are repetitive cognitive patterns that influence the way we conceptualize
and reason about various concepts present in speech. These patterns are deeply …
and reason about various concepts present in speech. These patterns are deeply …
Diffusion models for virtual agent facial expression generation in Motivational interviewing
N Younsi, C Pelachaud, L Chaby - Proceedings of the 2024 International …, 2024 - dl.acm.org
Motivational interviewing (MI) is a client-centered counseling style that addresses (the client)
user's motivation for behavior change. In this paper, we present a behavior generation …
user's motivation for behavior change. In this paper, we present a behavior generation …
Facial expression generation of 3D avatar based on semantic analysis
D Mukashev, M Kairgaliyev, U Alibekov… - 2021 30th IEEE …, 2021 - ieeexplore.ieee.org
3D avatars are widely used in various fields of emerging technology, from augmented reality
to social robots. To interact in a natural way with the user, they must be able to show at least …
to social robots. To interact in a natural way with the user, they must be able to show at least …
I-Brow: Hierarchical and Multimodal Transformer Model for Eyebrows Animation Synthesis
The human face is a key channel of communication in human-human interaction. When
communicating, humans spontaneously and continuously display various facial gestures …
communicating, humans spontaneously and continuously display various facial gestures …