Multimodal language processing in human communication

J Holler, SC Levinson - Trends in Cognitive Sciences, 2019 - cell.com
The natural ecology of human language is face-to-face interaction comprising the exchange
of a plethora of multimodal signals. Trying to understand the psycholinguistic processing of …

Why we should study multimodal language

P Perniss - Frontiers in psychology, 2018 - frontiersin.org
What do we study when we study language? Our theories of language, and particularly our
theories of the cognitive and neural underpinnings of language, have developed primarily …

Universals and diversity in gesture: Research past, present, and future

K Cooperrider - Gesture, 2019 - jbe-platform.com
At the dawn of anthropology, gesture was widely considered a “universal language”. In the
20th century, however, this framing fell out of favor as anthropologists rejected universalism …

Handling talk: A cross-linguistic perspective on discursive functions of gestures in German and Savosavo

J Bressem, C Wegener - Gesture, 2021 - jbe-platform.com
This paper discusses how a particular type of recurrent gesture, the holding away gesture,
highlights and structures spoken utterances in German and Savosavo, a Papuan language …

Covert negation in Israeli Hebrew: Evidence from co-speech gestures

A Inbar, L Shor - Journal of Pragmatics, 2019 - Elsevier
The present study examines various uses of the gestures that are usually associated with
explicitly expressed negation (overt negation) in spoken Israeli Hebrew. The analysis of …

'Away'gestures associated with negative expressions in narrative discourse in Syuba (Kagate, Nepal) speakers

L Gawne - Semiotica, 2021 - degruyter.com
This article examines the formal and functional features of a recurring 'away'gesture in
Syuba (Tibeto-Burman, Nepal). The formal properties of this gesture include a pronation of …

Emblems: Meaning at the interface of language and gesture

L Gawne, K Cooperrider - Glossa: a journal of general linguistics, 2024 - glossa-journal.org
In March 2022, the NBA basketball player Taurean Prince was fined $15,000 (USD) for
extending a finger. He had presented the “bird”—a raised middle digit—to another player …

Kin cognition and communication: What talking, gesturing, and drawing about family can tell us about the way we think about this core social structure

S Devylder, J Hinnell, J van de Weier… - Cognitive …, 2024 - Wiley Online Library
When people talk about kinship systems, they often use co‐speech gestures and other
representations to elaborate. This paper investigates such polysemiotic (spoken, gestured …

Primate origins of discourse-managing gestures: the case of hand fling

P Patel-Grosz, M Henderson, PG Grosz… - Linguistics …, 2024 - degruyter.com
The last decades have seen major advances in the study of gestures both in humans and
non-human primates. In this paper, we seriously examine the idea that there may be …

The feel of a recurrent gesture: Embedding the Vertical Palm within a gift-giving episode in China (aka the 'seesaw battle')

S Harrison - Gesture, 2021 - jbe-platform.com
The inner workings of recurrent gestures can now be distilled from almost three decades'
worth of fine-grained studies into gesture form variants, kinesic organization with speech …