The annotation of gesture and gesture/prosody synchronization in multimodal speech corpora

G Cantalini, M Moneglia - Journal of Speech Sciences, 2020 - econtents.bc.unicamp.br
… the two sections independent during the annotation phase, so … presence of continuous
co-verbal gestures. However, we must … two distinct types of tasks involved in the annotation of the …

[PDF][PDF] The MultiModal MultiDimensional (M3D) labelling scheme for the annotation of audiovisual corpora

PL Rohrer, I Vilà-Giménez, J Florit-Pons… - Gesture and Speech …, 2020 - researchgate.net
… Yet referential gestures often align with spoken prominence, and beat-like … While gesture
phasing is considered to be an aspect of the Form dimension, it is annotated on a separate “…

Abstract meaning representation for gesture

R Brutti, L Donatelli, K Lai, J Pustejovsky - Proceedings of the thirteenth …, 2022 - par.nsf.gov
… In developing Gesture AMR, we consider how gesture form and meaning relate; how …
A coding system with independent annotations of gesture forms and functions during verbal

[HTML][HTML] Quantifying the speech-gesture relation with massive multimodal datasets: Informativity in time expressions

C Pagán Cánovas, J Valenzuela, D Alcaraz Carrión… - Plos one, 2020 - journals.plos.org
… As Fig 4 shows, this analysis revealed a fairly close … the likelihood of a gesture signal
co-occurring with a verbal signal (R2 … of individual expressions and independently of any semantic …

[HTML][HTML] Action-depicting gestures and morphosyntax: The function of gesture-speech alignment in the conversational turn

P Urbanik, J Svennevig - Frontiers in Psychology, 2021 - frontiersin.org
… 12 out of 14 gestures in our data that are independently synchronized with their … of the
analysis of this extract, which is typical of this category of gestures, we argue that the pre-verbal

The secret multimodal life of IREs: Looking more closely at representational gestures in a familiar questioning sequence

VJ Flood - Linguistics and Education, 2021 - Elsevier
… don't just separate long amounts of code; they also help … Adding representational gestures
to spoken contributions is … In particular, this analysis shows how representational gesture in …

[HTML][HTML] Speeding up the detection of non-iconic and iconic gestures (SPUDNIG): A toolkit for the automatic detection of hand movements and gestures in video data

J Ripperda, L Drijvers, J Holler - Behavior research methods, 2020 - Springer
Spoken language is mostly used in multimodal, face-to-face … was counted as a separate
gesture annotation, regardless of … gesture was not annotated by SPUDNIG, but was annotated

Co-speech gestures in a naming task: Developmental data

S Stefanini, A Bello, MC Caselli… - … -Gesture, 2020 - taylorfrancis.com
… principle, produce multiple spoken utterances and multiple gestures and we defined these
… We conducted a one way analysis of variance (A NOVA) with Age Group as the independent

Co-speech gesture in bimodal bilinguals

S Casey, K Emmorey - Speech Accompanying-Gesture, 2020 - taylorfrancis.com
… Turkish speakers produce separate gestures to express manner … , except for the analysis
of beat gestures, where no difference … that are produced during spoken English narratives. …

Not channels but composite signals: Speech, gesture, diagrams and object demonstrations are integrated in multimodal explanations

RA Engle - Proceedings of the twentieth annual conference of …, 2022 - api.taylorfrancis.com
… One episode from each explanation was selected for intensive analysis. Each episode was
… be expressed in both verbal and nonverbal channels. What a separate channels view would …