[HTML][HTML] Turn-taking in conversational systems and human-robot interaction: a review

G Skantze - Computer Speech & Language, 2021 - Elsevier
The taking of turns is a fundamental aspect of dialogue. Since it is difficult to speak and listen
at the same time, the participants need to coordinate who is currently speaking and when …

Multimodal language processing in human communication

J Holler, SC Levinson - Trends in Cognitive Sciences, 2019 - cell.com
The natural ecology of human language is face-to-face interaction comprising the exchange
of a plethora of multimodal signals. Trying to understand the psycholinguistic processing of …

The CANDOR corpus: Insights from a large multimodal dataset of naturalistic conversation

A Reece, G Cooney, P Bull, C Chung, B Dawson… - Science …, 2023 - science.org
People spend a substantial portion of their lives engaged in conversation, and yet, our
scientific understanding of conversation is still in its infancy. Here, we introduce a large …

Generative spoken dialogue language modeling

TA Nguyen, E Kharitonov, J Copet, Y Adi… - Transactions of the …, 2023 - direct.mit.edu
We introduce dGSLM, the first “textless” model able to generate audio samples of naturalistic
spoken dialogues. It uses recent work on unsupervised spoken unit discovery coupled with …

Fast response times signal social connection in conversation

EM Templeton, LJ Chang… - Proceedings of the …, 2022 - National Acad Sciences
Clicking is one of the most robust metaphors for social connection. But how do we know
when two people" click"? We asked pairs of friends and strangers to talk with each other and …

Turn-taking in human communication–origins and implications for language processing

SC Levinson - Trends in cognitive sciences, 2016 - cell.com
Most language usage is interactive, involving rapid turn-taking. The turn-taking system has a
number of striking properties: turns are short and responses are remarkably rapid, but turns …

The now-or-never bottleneck: A fundamental constraint on language

MH Christiansen, N Chater - Behavioral and brain sciences, 2016 - cambridge.org
Memory is fleeting. New material rapidly obliterates previous material. How, then, can the
brain deal successfully with the continual deluge of linguistic input? We argue that, to deal …

A speech planning network for interactive language use

GA Castellucci, CK Kovach, MA Howard III… - Nature, 2022 - nature.com
During conversation, people take turns speaking by rapidly responding to their partners
while simultaneously avoiding interruption,. Such interactions display a remarkable degree …

Eye contact marks the rise and fall of shared attention in conversation

S Wohltjen, T Wheatley - Proceedings of the National …, 2021 - National Acad Sciences
Conversation is the platform where minds meet: the venue where information is shared,
ideas cocreated, cultural norms shaped, and social bonds forged. Its frequency and ease …

Social diffusion: Long-term multiple human motion anticipation

J Tanke, L Zhang, A Zhao, C Tang… - Proceedings of the …, 2023 - openaccess.thecvf.com
Abstract We propose Social Diffusion, a novel method for short-term and long-term
forecasting of the motion of multiple persons as well as their social interactions. Jointly …