Building culturally-valid dynamic facial expressions for a conversational virtual agent using human perception

C Chen, OGB Garrod, RAA Ince, ME Foster… - Proceedings of the 20th …, 2020 - dl.acm.org
Proceedings of the 20th ACM International Conference on Intelligent Virtual …, 2020dl.acm.org
Facial expressions are used to facilitate daily interactions including conversations, in every
culture. However, little is known about which specific facial expressions convey
conversational messages, which limits the social signalling capabilities of conversational
virtual agents. We address this critical knowledge gap by modeling the facial expressions of
key conversational messages directly from cultural perception, and transferring them to a
conversational virtual agent. Using a novel data-driven psychology-based method, we …
Facial expressions are used to facilitate daily interactions including conversations, in every culture. However, little is known about which specific facial expressions convey conversational messages, which limits the social signalling capabilities of conversational virtual agents. We address this critical knowledge gap by modeling the facial expressions of key conversational messages directly from cultural perception, and transferring them to a conversational virtual agent. Using a novel data-driven psychology-based method, we modelled facial expressions of 'thinking,' 'interested,' 'bored' and 'confused' directly from the cultural perception of 40 participants across two distinct cultures (Western European, East Asian). We then transferred these facial expression models to a popular conversational virtual agent and validated them with a new group of cultural participants. Results showed that, in both cultures, the majority of our culturally derived conversational facial expression models successfully transferred to the agent. A further cross-cultural analysis of the conversational facial expressions showed systematic similarities (e.g., eye brow raising in 'interested') and differences (e.g., Westerners use horizontal mouth stretch and East Asians use vertical mouth opening to show confusion) that could facilitate or hinder cross-cultural communication. Our results demonstrate the power of using a culturally sensitive perception-based psychological approach to develop psychologically impactful facial expressions for conversational virtual agents. We anticipate that our facial expression models will enhance virtual agent social signalling capabilities and their global marketability.
ACM Digital Library
以上显示的是最相近的搜索结果。 查看全部搜索结果