[HTML][HTML] Turn-taking in conversational systems and human-robot interaction: a review

G Skantze - Computer Speech & Language, 2021 - Elsevier
The taking of turns is a fundamental aspect of dialogue. Since it is difficult to speak and listen
at the same time, the participants need to coordinate who is currently speaking and when …

Generative spoken dialogue language modeling

TA Nguyen, E Kharitonov, J Copet, Y Adi… - Transactions of the …, 2023 - direct.mit.edu
We introduce dGSLM, the first “textless” model able to generate audio samples of naturalistic
spoken dialogues. It uses recent work on unsupervised spoken unit discovery coupled with …

Modeling feedback in interaction with conversational agents—a review

A Axelsson, H Buschmeier, G Skantze - Frontiers in Computer Science, 2022 - frontiersin.org
Intelligent agents interacting with humans through conversation (such as a robot, embodied
conversational agent, or chatbot) need to receive feedback from the human to make sure …

Towards a general, continuous model of turn-taking in spoken dialogue using LSTM recurrent neural networks

G Skantze - Proceedings of the 18th Annual SIGdial Meeting on …, 2017 - aclanthology.org
Previous models of turn-taking have mostly been trained for specific turn-taking decisions,
such as discriminating between turn shifts and turn retention in pauses. In this paper, we …

A survey on syntactic processing techniques

X Zhang, R Mao, E Cambria - Artificial Intelligence Review, 2023 - Springer
Computational syntactic processing is a fundamental technique in natural language
processing. It normally serves as a pre-processing method to transform natural language …

Voice activity projection: Self-supervised learning of turn-taking events

E Ekstedt, G Skantze - arXiv preprint arXiv:2205.09812, 2022 - arxiv.org
The modeling of turn-taking in dialog can be viewed as the modeling of the dynamics of
voice activity of the interlocutors. We extend prior work and define the predictive task of …

Turngpt: a transformer-based language model for predicting turn-taking in spoken dialog

E Ekstedt, G Skantze - arXiv preprint arXiv:2010.10874, 2020 - arxiv.org
Syntactic and pragmatic completeness is known to be important for turn-taking prediction,
but so far machine learning models of turn-taking have used such linguistic information in a …

Human versus computer partner in the paired oral discussion test

GJ Ockey, E Chukharev-Hudilainen - Applied Linguistics, 2021 - academic.oup.com
A challenge of large-scale oral communication assessments is to feasibly assess a broad
construct that includes interactional competence. One possible approach in addressing this …

Assessing interactional competence: ICE versus a human partner

GJ Ockey, E Chukharev-Hudilainen… - Language Assessment …, 2023 - Taylor & Francis
Most second language assessment researchers agree that interactional competence (IC) is
an important part of the construct of oral communication. However, measurement of IC has …

A multimodal model for predicting conversational feedbacks

A Boudin, R Bertrand, S Rauzy, M Ochs… - … conference on text …, 2021 - Springer
We propose in this paper a statistical model in the perspective of predicting listener's
feedbacks in a conversation. The first contribution of the paper is a study of the prediction of …