Not channels but composite signals: Speech, gesture, diagrams and object demonstrations are integrated in multimodal explanations

RA Engle - Proceedings of the twentieth annual conference of …, 2022 - api.taylorfrancis.com
… sufficiently consistent with the lock demonstration to be a composite signal that the
learner would understand and acknowledge (as the learner did soon after segment 9). …

The emancipation of gestures

J Streeck - Interactional Linguistics, 2021 - jbe-platform.com
… and insubstantial: We do not consciously attend to most of each other’s gestures when we
talk to one another, we … Once we understand that emancipation is the process by which some …

The origins of gestures and language: history, current advances and proposed theories

J Prieur, S Barbu, C Blois‐Heulin… - Biological …, 2020 - Wiley Online Library
… First, we assess the current understanding of primate … gestures (which generate a mainly
visual component with no … , teaching) and could explain why gradually speech became the main …

Easier said than done? Task difficulty's influence on temporal alignment, semantic similarity, and complexity matching between gestures and speech

L De Jonge‐Hoekstra, RFA Cox… - Cognitive …, 2021 - Wiley Online Library
… , and we interpreted this as a way for gestures and speech to stabilize together when
entrainment is difficult to impossible. However, complexity matching did not predict participant's …

No gestures left behind: Learning relationships between spoken language and freeform gestures

C Ahuja, DW Lee, R Ishii… - Findings of the Association …, 2020 - aclanthology.org
… to improvements in natural language understanding and speech recognition. With an eye on
the … gestures (which go beyond just a pre-defined dictionary of gesture animations). In other …

Gesticulator: A framework for semantically-aware speech-driven gesture generation

T Kucherenko, P Jonell, S Van Waveren… - Proceedings of the …, 2020 - dl.acm.org
… model predictions back to the model as can be seen in the figure, to ensure motion continuity…
, so the minimum-expected-loss output gestures do not have to be close to our ground truth. …

The annotation of gesture and gesture/prosody synchronization in multimodal speech corpora

M Moneglia - Journal of Speech Sciences, 2020 - flore.unifi.it
… us to understand the linguistic scope of the gesture, supporting its interpretation. Gestures
may be … However, we encountered not just speech without gesture, but also gesture without

Constructing a system of communication with gestures and words.

EV Clark, BF Kelly - 2022 - psycnet.apa.org
… acquisition must consider communicative gestures as well as speech… of this can be seen first
in children’s early gesture + word … When gesturespeech combinations do and do not index …

Style‐controllable speech‐driven gesture synthesis using normalising flows

S Alexanderson, GE Henter… - Computer Graphics …, 2020 - Wiley Online Library
… that the synthetic gestures obey the style control without … method not only is capable of
generating upper body gestures, … s t alongside the speech-feature inputs a t , as seen in Fig. 1, in …

Beat gestures influence which speech sounds you hear

HR Bosker, D Peeters - Proceedings of the Royal Society …, 2021 - royalsocietypublishing.org
… level speech perception should be considered an initial step in our understanding of how
bodily gestures, in general, may … In fact, we explicitly do not claim that the manual McGurk effect …