Multimodal language processing in human communication

J Holler, SC Levinson - Trends in Cognitive Sciences, 2019 - cell.com
The natural ecology of human language is face-to-face interaction comprising the exchange
of a plethora of multimodal signals. Trying to understand the psycholinguistic processing of …

Arbitrariness, iconicity, and systematicity in language

M Dingemanse, DE Blasi, G Lupyan… - Trends in cognitive …, 2015 - cell.com
The notion that the form of a word bears an arbitrary relation to its meaning accounts only
partly for the attested relations between form and meaning in the languages of the world …

The CANDOR corpus: Insights from a large multimodal dataset of naturalistic conversation

A Reece, G Cooney, P Bull, C Chung, B Dawson… - Science …, 2023 - science.org
People spend a substantial portion of their lives engaged in conversation, and yet, our
scientific understanding of conversation is still in its infancy. Here, we introduce a large …

Turn-taking in human communication–origins and implications for language processing

SC Levinson - Trends in cognitive sciences, 2016 - cell.com
Most language usage is interactive, involving rapid turn-taking. The turn-taking system has a
number of striking properties: turns are short and responses are remarkably rapid, but turns …

The bridge of iconicity: from a world of experience to the experience of language

P Perniss, G Vigliocco - … of the Royal Society B: Biological …, 2014 - royalsocietypublishing.org
Iconicity, a resemblance between properties of linguistic form (both in spoken and signed
languages) and meaning, has traditionally been considered to be a marginal, irrelevant …

Language as a multimodal phenomenon: implications for language learning, processing and evolution

G Vigliocco, P Perniss… - … Transactions of the …, 2014 - royalsocietypublishing.org
Our understanding of the cognitive and neural underpinnings of language has traditionally
been firmly based on spoken Indo-European languages and on language studied as …

Taking turns: bridging the gap between human and animal communication

S Pika, R Wilkinson, KH Kendrick… - Proceedings of the …, 2018 - royalsocietypublishing.org
Language, humans' most distinctive trait, still remains a 'mystery'for evolutionary theory. It is
underpinned by a universal infrastructure—cooperative turn-taking—which has been …

Multimodal communication and language origins: integrating gestures and vocalizations

M Fröhlich, C Sievers, SW Townsend… - Biological …, 2019 - Wiley Online Library
The presence of divergent and independent research traditions in the gestural and vocal
domains of primate communication has resulted in major discrepancies in the definition and …

Pantomime as the original human-specific communicative system

J Zlatev, P Żywiczyński… - Journal of Language …, 2020 - academic.oup.com
We propose reframing one of the key questions in the field of language evolution as what
was the original human-specific communicative system? With the help of cognitive …

[图书][B] Why we gesture: The surprising role of hand movements in communication

D McNeill - 2016 - books.google.com
Gestures are fundamental to the way we communicate, yet our understanding of this
communicative impulse is clouded by a number of ingrained assumptions. Are gestures …