Bringing the nonlinearity of the movement system to gestural theories of language use: Multifractal structure of spoken English supports the compensation for …

RM Ward, DG Kelty-Stephen - Frontiers in physiology, 2018 - frontiersin.org
Coarticulation is the tendency for speech vocalization and articulation even at the phonemic
level to change with context, and compensation for coarticulation (CfC) reflects the striking …

Perceiving and remembering speech depend on multifractal nonlinearity in movements producing and exploring speech

L Bloomfield, E Lane, M Mangalam… - Journal of the …, 2021 - royalsocietypublishing.org
Speech perception and memory for speech require active engagement. Gestural theories
have emphasized mainly the effect of speaker's movements on speech perception. They fail …

Energy flows in gesture-speech physics: exploratory findings and pre-registration of confirmatory analysis

W Pouw, SJ Harrison, N Esteve-Gibert, JA Dixon - 2019 - osf.io
A well-known phenomenon of multimodal language is the synchronous coupling of prosodic
contours in speech with salient kinematic changes in co-speech hand-gesture motions …

Converging sources of evidence for dissecting articulatory movements into core gestures

SE Boyce, RA Krakow, F Bell-Berti, CE Gelfer - Journal of Phonetics, 1990 - Elsevier
Explaining and modeling the process of coarticulation is one of the central tasks of speech
research. At the same time, the literature on the temporal extent of anticipatory coarticulation …

Comparing speech and nonspeech context effects across timescales in coarticulatory contexts

N Viswanathan, DG Kelty-Stephen - Attention, Perception, & …, 2018 - Springer
Context effects are ubiquitous in speech perception and reflect the ability of human listeners
to successfully perceive highly variable speech signals. In the study of how listeners …

Perception grammars and sound change

PS Beddor - The initiation of sound change, 2012 - torrossa.com
The acoustic consequences of gestural overlap afford listeners multiple, timevarying cues for
a given linguistic percept. Findings from “offline” perceptual tasks and “online” real-time …

Dissecting coarticulation: How locus equations happen

B Lindblom, HM Sussman - Journal of phonetics, 2012 - Elsevier
A programmatic series of studies aimed at expanding our understanding of coarticulation in
V1· CV2 sequences is presented. The common thread was examining coarticulatory …

Multimodal coordination and pragmatic modes in conversation

C Alviar, CT Kello, R Dale - Language Sciences, 2023 - Elsevier
Abstract Language is intrinsically multimodal. Speakers use gestures, prosody, gaze, and
facial expressions as cues that complement and expand the meaning expressed in their …

Using cognitive models to understand multimodal processes: The case for speech and gesture production

S Kopp, K Bergmann - … , and Common Modality Combinations-Volume 1, 2017 - dl.acm.org
Multimodal behavior has been studied for a long time and in many fields, eg, in psychology,
linguistics, communication studies, education, and ergonomics. One of the main motivations …

Articulatory mediation of speech perception: a causal analysis of multi-modal imaging data

DW Gow Jr, JA Segawa - Cognition, 2009 - Elsevier
The inherent confound between the organization of articulation and the acoustic–phonetic
structure of the speech signal makes it exceptionally difficult to evaluate the competing …