Didn't see that coming: a survey on non-verbal social human behavior forecasting

G Barquero, J Núnez, S Escalera, Z Xu… - … Social Behavior in …, 2022 - proceedings.mlr.press
Non-verbal social human behavior forecasting has increasingly attracted the interest of the
research community in recent years. Its direct applications to human-robot interaction and …

TalkTive: a conversational agent using backchannels to engage older adults in neurocognitive disorders screening

Z Ding, J Kang, TOT Ho, KH Wong, HH Fung… - Proceedings of the …, 2022 - dl.acm.org
Conversational agents (CAs) have the great potential in mitigating the clinicians' burden in
screening for neurocognitive disorders among older adults. It is important, therefore, to …

BPM_MT: Enhanced backchannel prediction model using multi-task learning

JY Jang, S Kim, M Jung, S Shin… - Proceedings of the 2021 …, 2021 - aclanthology.org
Backchannel (BC), a short reaction signal of a listener to a speaker's utterances, helps to
improve the quality of the conversation. Several studies have been conducted to predict BC …

MultiMediate'22: Backchannel Detection and Agreement Estimation in Group Interactions

P Müller, M Dietz, D Schiller, D Thomas… - Proceedings of the 30th …, 2022 - dl.acm.org
Backchannels, ie short interjections of the listener, serve important meta-conversational
purposes like signifying attention or indicating agreement. Despite their key role, automatic …

Annotation of communicative functions of short feedback tokens in switchboard

C Figueroa, A Adigwe, M Ochs… - Proceedings of the …, 2022 - aclanthology.org
There has been a lot of work on predicting the timing of feedback in conversational systems.
However, there has been less focus on predicting the prosody and lexical form of feedback …

Backchannel generation model for a third party listener agent

D Lala, K Inoue, T Kawahara, K Sawada - Proceedings of the 10th …, 2022 - dl.acm.org
In this work we propose a listening agent which can be used in a conversation between two
humans. We firstly conduct a corpus analysis to identify three different categories of …

ADVISER: A toolkit for developing multi-modal, multi-domain and socially-engaged conversational agents

CY Li, D Ortega, D Väth, F Lux, L Vanderlyn… - arXiv preprint arXiv …, 2020 - arxiv.org
We present ADVISER-an open-source, multi-domain dialog system toolkit that enables the
development of multi-modal (incorporating speech, text and vision), socially-engaged (eg …

Dialogue act-aided backchannel prediction using multi-task learning

W Liermann, YH Park, YS Choi… - Findings of the Association …, 2023 - aclanthology.org
Produced in the form of small injections such as “Yeah!” or “Uh-Huh” by listeners in a
conversation, supportive verbal feedback (ie, backchanneling) is essential for natural …

Joint streaming model for backchannel prediction and automatic speech recognition

YS Choi, JU Bang, SH Kim - ETRI Journal, 2024 - Wiley Online Library
In human conversations, listeners often utilize brief backchannels such as “uh‐huh” or
“yeah.” Timely backchannels are crucial to understanding and increasing trust among …

Joint Learning of Context and Feedback Embeddings in Spoken Dialogue

L Qian, G Skantze - arXiv preprint arXiv:2406.07291, 2024 - arxiv.org
Short feedback responses, such as backchannels, play an important role in spoken
dialogue. So far, most of the modeling of feedback responses has focused on their timing …