On-line integration of semantic information from speech and gesture: Insights from event-related brain potentials

A Özyürek, RM Willems, S Kita… - Journal of cognitive …, 2007 - direct.mit.edu
During language comprehension, listeners use the global semantic representation from
previous sentence or discourse context to immediately integrate the meaning of each …

Neural correlates of bimodal speech and gesture comprehension

SD Kelly, C Kravitz, M Hopkins - Brain and language, 2004 - Elsevier
The present study examined the neural correlates of speech and hand gesture
comprehension in a naturalistic context. Fifteen participants watched audiovisual segments …

Gesture facilitates the syntactic analysis of speech

H Holle, C Obermeier, M Schmidt-Kassow… - Frontiers in …, 2012 - frontiersin.org
Recent research suggests that the brain routinely binds together information from gesture
and speech. However, most of this research focused on the integration of representational …

[HTML][HTML] Electrophysiological correlates of semantic dissimilarity reflect the comprehension of natural, narrative speech

MP Broderick, AJ Anderson, GM Di Liberto, MJ Crosse… - Current Biology, 2018 - cell.com
People routinely hear and understand speech at rates of 120–200 words per minute [1, 2].
Thus, speech comprehension must involve rapid, online neural mechanisms that process …

Co‐speech gestures influence neural activity in brain regions associated with processing semantic information

AS Dick, S Goldin‐Meadow, U Hasson… - Human brain …, 2009 - Wiley Online Library
Everyday communication is accompanied by visual information from several sources,
including co‐speech gestures, which provide semantic information listeners use to help …

Hearing and seeing meaning in speech and gesture: Insights from brain and behaviour

A Özyürek - … Transactions of the Royal Society B …, 2014 - royalsocietypublishing.org
As we speak, we use not only the arbitrary form–meaning mappings of the speech channel
but also motivated form–meaning correspondences, ie iconic gestures that accompany …

Beyond the sentence given

P Hagoort, J Van Berkum - Philosophical Transactions of …, 2007 - royalsocietypublishing.org
A central and influential idea among researchers of language is that our language faculty is
organized according to Fregean compositionality, which states that the meaning of an …

Oscillatory brain responses reflect anticipation during comprehension of speech acts in spoken dialog

RS Gisladottir, S Bögels, SC Levinson - Frontiers in human …, 2018 - frontiersin.org
Everyday conversation requires listeners to quickly recognize verbal actions, so-called
speech acts, from the underspecified linguistic code and prepare a relevant response within …

Beat that word: How listeners integrate beat gesture and focus in multimodal speech discourse

D Dimitrova, M Chu, L Wang, A Özyürek… - Journal of Cognitive …, 2016 - direct.mit.edu
Communication is facilitated when listeners allocate their attention to important information
(focus) in the message, a process called “information structure.” Linguistic cues like the …

Exploring the activation of semantic and phonological codes during speech planning with event-related brain potentials

JD Jescheniak, H Schriefers, MF Garrett… - Journal of Cognitive …, 2002 - direct.mit.edu
We present a new technique for studying the activation of semantic and phonological codes
in speech planning using event-related brain potentials (ERPs) that extend a well …