More than words: Word predictability, prosody, gesture and mouth movements in natural language comprehension

Y Zhang, D Frassinelli, J Tuomainen… - … of the Royal …, 2021 - royalsocietypublishing.org
The ecology of human language is face-to-face interaction, comprising cues such as
prosody, co-speech gestures and mouth movements. Yet, the multimodal context is usually …

The role of multimodal cues in second language comprehension

Y Zhang, R Ding, D Frassinelli, J Tuomainen… - Scientific Reports, 2023 - nature.com
In face-to-face communication, multimodal cues such as prosody, gestures, and mouth
movements can play a crucial role in language processing. While several studies have …

[HTML][HTML] Modulation of brain activity by psycholinguistic information during naturalistic speech comprehension and production

W Wu, M Morales, T Patel, MJ Pickering, P Hoffman - Cortex, 2022 - Elsevier
Abstract Language processing requires the integration of diverse sources of information
across multiple levels of processing. A range of psycholinguistic properties have been …

Context in neurolinguistics

PB Schumacher - What is a Context, 2012 - torrossa.com
Context represents a broad range of aspects, comprising for example the conversational
setting (including speaker and hearer), mutual knowledge, inter-and intratextual information …

[HTML][HTML] Electrophysiological correlates of semantic dissimilarity reflect the comprehension of natural, narrative speech

MP Broderick, AJ Anderson, GM Di Liberto, MJ Crosse… - Current Biology, 2018 - cell.com
People routinely hear and understand speech at rates of 120–200 words per minute [1, 2].
Thus, speech comprehension must involve rapid, online neural mechanisms that process …

A tradeoff between acoustic and linguistic feature encoding in spoken language comprehension

F Tezcan, H Weissbart, AE Martin - Elife, 2023 - elifesciences.org
When we comprehend language from speech, the phase of the neural response aligns with
particular features of the speech input, resulting in a phenomenon referred to as neural …

Great expectations: Specific lexical anticipation influences the processing of spoken language

M Otten, MS Nieuwland, JJA Van Berkum - BMC neuroscience, 2007 - Springer
Background Recently several studies have shown that people use contextual information to
make predictions about the rest of the sentence or story as the text unfolds. Using event …

Quasi-compositional mapping from form to meaning: A neural network-based approach to capturing neural responses during human language comprehension

M Rabovsky, JL McClelland - … Transactions of the …, 2020 - royalsocietypublishing.org
We argue that natural language can be usefully described as quasi-compositional and we
suggest that deep learning-based neural language models bear long-term promise to …

Dynamic EEG analysis during language comprehension reveals interactive cascades between perceptual processing and sentential expectations

MCE Sarrett, B McMurray, EC Kapnoula - Brain and Language, 2020 - Elsevier
Understanding spoken language requires analysis of the rapidly unfolding speech signal at
multiple levels: acoustic, phonological, and semantic. However, there is not yet a …

Two sides of the same coin: Speech and gesture mutually interact to enhance comprehension

SD Kelly, A Özyürek, E Maris - Psychological science, 2010 - journals.sagepub.com
Gesture and speech are assumed to form an integrated system during language production.
Based on this view, we propose the integrated-systems hypothesis, which explains two ways …