The annotation of gesture and gesture/prosody synchronization in multimodal speech corpora
G Cantalini, M Moneglia - Journal of Speech Sciences, 2020 - econtents.bc.unicamp.br
… the two sections independent during the annotation phase, so … presence of continuous
co-verbal gestures. However, we must … two distinct types of tasks involved in the annotation of the …
co-verbal gestures. However, we must … two distinct types of tasks involved in the annotation of the …
[PDF][PDF] The MultiModal MultiDimensional (M3D) labelling scheme for the annotation of audiovisual corpora
… Yet referential gestures often align with spoken prominence, and beat-like … While gesture
phasing is considered to be an aspect of the Form dimension, it is annotated on a separate “…
phasing is considered to be an aspect of the Form dimension, it is annotated on a separate “…
Abstract meaning representation for gesture
… In developing Gesture AMR, we consider how gesture form and meaning relate; how …
A coding system with independent annotations of gesture forms and functions during verbal …
A coding system with independent annotations of gesture forms and functions during verbal …
[HTML][HTML] Quantifying the speech-gesture relation with massive multimodal datasets: Informativity in time expressions
… As Fig 4 shows, this analysis revealed a fairly close … the likelihood of a gesture signal
co-occurring with a verbal signal (R2 … of individual expressions and independently of any semantic …
co-occurring with a verbal signal (R2 … of individual expressions and independently of any semantic …
[HTML][HTML] Action-depicting gestures and morphosyntax: The function of gesture-speech alignment in the conversational turn
P Urbanik, J Svennevig - Frontiers in Psychology, 2021 - frontiersin.org
… 12 out of 14 gestures in our data that are independently synchronized with their … of the
analysis of this extract, which is typical of this category of gestures, we argue that the pre-verbal …
analysis of this extract, which is typical of this category of gestures, we argue that the pre-verbal …
The secret multimodal life of IREs: Looking more closely at representational gestures in a familiar questioning sequence
VJ Flood - Linguistics and Education, 2021 - Elsevier
… don't just separate long amounts of code; they also help … Adding representational gestures
to spoken contributions is … In particular, this analysis shows how representational gesture in …
to spoken contributions is … In particular, this analysis shows how representational gesture in …
[HTML][HTML] Speeding up the detection of non-iconic and iconic gestures (SPUDNIG): A toolkit for the automatic detection of hand movements and gestures in video data
J Ripperda, L Drijvers, J Holler - Behavior research methods, 2020 - Springer
… Spoken language is mostly used in multimodal, face-to-face … was counted as a separate
gesture annotation, regardless of … gesture was not annotated by SPUDNIG, but was annotated …
gesture annotation, regardless of … gesture was not annotated by SPUDNIG, but was annotated …
Co-speech gestures in a naming task: Developmental data
S Stefanini, A Bello, MC Caselli… - … -Gesture, 2020 - taylorfrancis.com
… principle, produce multiple spoken utterances and multiple gestures and we defined these
… We conducted a one way analysis of variance (A NOVA) with Age Group as the independent …
… We conducted a one way analysis of variance (A NOVA) with Age Group as the independent …
Co-speech gesture in bimodal bilinguals
S Casey, K Emmorey - Speech Accompanying-Gesture, 2020 - taylorfrancis.com
… Turkish speakers produce separate gestures to express manner … , except for the analysis
of beat gestures, where no difference … that are produced during spoken English narratives. …
of beat gestures, where no difference … that are produced during spoken English narratives. …
Not channels but composite signals: Speech, gesture, diagrams and object demonstrations are integrated in multimodal explanations
RA Engle - Proceedings of the twentieth annual conference of …, 2022 - api.taylorfrancis.com
… One episode from each explanation was selected for intensive analysis. Each episode was
… be expressed in both verbal and nonverbal channels. What a separate channels view would …
… be expressed in both verbal and nonverbal channels. What a separate channels view would …