BERT meets LIWC: Exploring state-of-the-art language models for predicting communication behavior in couples' conflict interactions

J Biggiogera, G Boateng, P Hilpert, M Vowels… - … Publication of the 2021 …, 2021 - dl.acm.org
Many processes in psychology are complex, such as dyadic interactions between two
interacting partners (eg, patient-therapist, intimate relationship partners). Nevertheless …

Multimodal embeddings from language models for emotion recognition in the wild

SY Tseng, S Narayanan… - IEEE Signal Processing …, 2021 - ieeexplore.ieee.org
Word embeddings such as ELMo and BERT have been shown to model word usage in
language with greater efficacy through contextualized learning on large-scale language …

Towards real-time multimodal emotion recognition among couples

G Boateng - Proceedings of the 2020 International Conference on …, 2020 - dl.acm.org
Researchers are interested in understanding the emotions of couples as it relates to
relationship quality and dyadic management of chronic diseases. Currently, the process of …

Predicting behavior in cancer-afflicted patient and spouse interactions using speech and language

SN Chakravarthula, H Li, SY Tseng, M Reblin… - arXiv preprint arXiv …, 2019 - arxiv.org
Cancer impacts the quality of life of those diagnosed as well as their spouse caregivers, in
addition to potentially influencing their day-to-day behaviors. There is evidence that effective …

“You made me feel this way”: Investigating Partners' Influence in Predicting Emotions in Couples' Conflict Interactions using Speech Data

G Boateng, P Hilpert, G Bodenmann… - … Publication of the 2021 …, 2021 - dl.acm.org
How romantic partners interact with each other during a conflict influences how they feel at
the end of the interaction and is predictive of whether the partners stay together in the long …

An analysis of observation length requirements for machine understanding of human behaviors from spoken language

SN Chakravarthula, BRW Baucom, S Narayanan… - Computer Speech & …, 2021 - Elsevier
The task of quantifying human behavior by observing interaction cues is an important and
useful one across a range of domains in psychological research and practice. Machine …

Multimodal embeddings from language models

SY Tseng, P Georgiou, S Narayanan - arXiv preprint arXiv:1909.04302, 2019 - arxiv.org
Word embeddings such as ELMo have recently been shown to model word semantics with
greater efficacy through contextualized learning on large-scale language corpora, resulting …

" Are you okay, honey?": Recognizing Emotions among Couples Managing Diabetes in Daily Life using Multimodal Real-World Smartwatch Data

G Boateng, X Zhao, M Speichert, E Fleisch… - arXiv preprint arXiv …, 2022 - arxiv.org
Couples generally manage chronic diseases together and the management takes an
emotional toll on both patients and their romantic partners. Consequently, recognizing the …

Real‐Time Human‐Music Emotional Interaction Based on Deep Learning and Multimodal Sentiment Analysis

T Jiang, S Deng, P Wu, H Jiang - … Communications and Mobile …, 2023 - Wiley Online Library
Music, as an integral component of culture, holds a prominent position and is widely
accessible. There has been growing interest in studying sentiment represented by music …

Real-time Human-Music Emotional Interaction Based on Multimodal Analysis

T Jiang, S Deng, P Wu, H Jiang - … International Conference on …, 2022 - ieeexplore.ieee.org
Music, as an important part of the culture, occupies a significant position and can be easily
accessed. The research on the sentiment represented by music and its effect on the …