Humanoid Tactile Gesture Production using a Hierarchical SOM-based Encoding

2014 ◽  
Vol 6 (2) ◽  
pp. 153-167 ◽  
Author(s):  
Georgios Pierris ◽  
Torbjorn S. Dahl
Keyword(s):  
Hierarchical Som ◽  
Gesture Production

The Production of Gesture and Speech by People With Aphasia: Influence of Communicative Constraints

2019 ◽  
Vol 62 (12) ◽  
pp. 4417-4432 ◽  
Author(s):  
Carola de Beer ◽  
Jan P. de Ruiter ◽  
Martina Hielscher-Fastabend ◽  
Katharina Hogrefe
Keyword(s):  
Language Impairment ◽  
Daily Living ◽  
Linguistic Performance ◽  
Task Effects ◽  
Communicative Abilities ◽  
Gesture Production ◽  
And Task ◽  
Group Effects

Purpose People with aphasia (PWA) use different kinds of gesture spontaneously when they communicate. Although there is evidence that the nature of the communicative task influences the linguistic performance of PWA, so far little is known about the influence of the communicative task on the production of gestures by PWA. We aimed to investigate the influence of varying communicative constraints on the production of gesture and spoken expression by PWA in comparison to persons without language impairment. Method Twenty-six PWA with varying aphasia severities and 26 control participants (CP) without language impairment participated in the study. Spoken expression and gesture production were investigated in 2 different tasks: (a) spontaneous conversation about topics of daily living and (b) a cartoon narration task, that is, retellings of short cartoon clips. The frequencies of words and gestures as well as of different gesture types produced by the participants were analyzed and tested for potential effects of group and task. Results Main results for task effects revealed that PWA and CP used more iconic gestures and pantomimes in the cartoon narration task than in spontaneous conversation. Metaphoric gestures, deictic gestures, number gestures, and emblems were more frequently used in spontaneous conversation than in cartoon narrations by both participant groups. Group effects show that, in both tasks, PWA's gesture-to-word ratios were higher than those for the CP. Furthermore, PWA produced more interactive gestures than the CP in both tasks, as well as more number gestures and pantomimes in spontaneous conversation. Conclusions The current results suggest that PWA use gestures to compensate for their verbal limitations under varying communicative constraints. The properties of the communicative task influence the use of different gesture types in people with and without aphasia. Thus, the influence of communicative constraints needs to be considered when assessing PWA's multimodal communicative abilities.

scholarly journals The influence of conversation parameters on gesture production in aphasia

2019 ◽  
Vol 34 (8) ◽  
pp. 693-717
Author(s):  
Judith Kistner ◽  
Jane Marshall ◽  
Lucy T. Dipper
Keyword(s):  
Gesture Production

Gesture production and language delay: A helping hand

1996 ◽  
Vol 19 ◽  
pp. 777
Author(s):  
Donna Thal ◽  
Catherine Brown ◽  
Mindy Granberry ◽  
Michelle Monson
Keyword(s):  
Language Delay ◽  
Gesture Production

Contribution of working memory to gesture production in toddlers

2021 ◽  
Vol 60 ◽  
pp. 101113
Author(s):  
Naziye Güneş-Acar ◽  
Ercan Alp ◽  
Aylin Küntay ◽  
Ayhan Aksu-Koç
Keyword(s):  
Working Memory ◽  
Gesture Production

The communicative import of gestures

Gesture ◽  
2009 ◽  
Vol 9 (1) ◽  
pp. 97-126 ◽  
Author(s):  
Lisette Mol ◽  
Emiel Krahmer ◽  
Fons Maes ◽  
Marc Swerts
Keyword(s):  
Social Interaction ◽  
Native Speakers ◽  
Semantic Content ◽  
Animated Cartoon ◽  
Pointing Gestures ◽  
Gesture Production

Does gesturing primarily serve speaker internal purposes, or does it mostly facilitate communication, for example by conveying semantic content, or easing social interaction? To address this question, we asked native speakers of Dutch to retell an animated cartoon to a presumed audiovisual summarizer, a presumed addressee in another room (through web cam), or an addressee in the same room, who could either see them and be seen by them or not.
We found that participants produced the least number of gestures when talking to the presumed summarizer. In addition, they produced a smaller proportion of large gestures and almost no pointing gestures. Two perception experiments revealed that observers are sensitive to this difference in gesturing. We conclude that gesture production is not a fully automated speech facilitation process, and that it can convey information about the communicative setting a speaker is in.

Raise your hand if you’re spatial

Gesture ◽  
2007 ◽  
Vol 7 (1) ◽  
pp. 73-95 ◽  
Author(s):  
Autumn B. Hostetter ◽  
Martha W. Alibali
Keyword(s):  
Individual Differences ◽  
Cognitive Skills ◽  
Spatial Visualization ◽  
Semantic Fluency ◽  
Spatial Skills ◽  
Verbal Skill ◽  
Spatial Skill ◽  
Phonemic Fluency ◽  
Representational Gestures ◽  
Gesture Production

Individuals differ greatly in how often they gesture when they speak. This study investigated relations between speakers’ verbal and spatial skills and their gesture rates. Two types of verbal skill were measured: semantic fluency, which is thought to index efficiency with lexical access, and phonemic fluency, which is thought to index efficiency with organizing the lexicon in novel ways. Spatial skill was measured with a visualization task. We hypothesized that individuals with low verbal skill but high spatial visualization skill would gesture most often, due to having mental images not closely linked to verbal forms. This hypothesis was supported for phonemic fluency, but not for semantic fluency. We also found that individuals with low phonemic fluency and individuals with high phonemic fluency produced representational gestures at higher rates than individuals with average phonemic fluency. The findings indicate that individual differences in gesture production are associated with individual differences in cognitive skills.

scholarly journals The frequency, variation, and semantic integration of co-speech gesture production in verbal adolescents diagnosed with Autism Spectrum Disorder

2020 ◽  
Author(s):  
Renáta Longauerová
Keyword(s):  
Autism Spectrum Disorder ◽  
Verbal Working Memory ◽  
Autism Spectrum ◽  
Semantic Integration ◽  
Spectrum Disorder ◽  
Frequency Variation ◽  
Animated Cartoon ◽  
Significant Difference ◽  
Gesture Production ◽  
Adolescents With Asd

Gestures play an important role in communication, but for populations with atypical language development, gestures are often an area of significant difficulty, especially for individuals with Autism Spectrum Disorder (ASD). Research on younger children with ASD show a significant delay in gesture production, as well as a complete absence of certain types of gestures. However, previous work leaves open the question of whether the frequency and variation of gesture production is impaired also in adolescents with ASD. Moreover, very little is known about the semantic integration of speech and gesture in this population. In the present study, 5 adolescents with ASD and 5 typically-developing adolescents completed a narrative task, in which they were asked to retell a story of 4 animated cartoon clips. The results show that while there is no significant difference between the two groups in the frequency of gesture production and the types of gestures they produce, the frequency of gesture production in the individuals with ASD significantly depends on their verbal working memory skills. Moreover, it seems that many impairments that were confirmed by earlier studies for ASD children in early and late childhood seem to be mere delays that get resolved over time, such as the usage of supplementary gestures.

Gesture development in Peruvianchildren and its relationship with vocalizations and vocabulary

Gesture ◽  
2021 ◽  
Vol 20 (1) ◽  
pp. 1-29
Author(s):  
María Fernández-Flecha ◽  
María Blume ◽  
Andrea Junyent ◽  
Talía Tijero Neyra
Keyword(s):  
Index Finger ◽  
Age Effects ◽  
Older Children ◽  
Linguistic Development ◽  
Communicative Development ◽  
Gesture Development ◽  
Significant Change ◽  
Pointing Gesture ◽  
Gesture Production

Abstract We examine gestural development, and correlations between gesture types, vocalizations and vocabulary at ages 8 to 15 months, employing data from MacArthur-Bates Communicative Development Inventories for Peruvian Spanish, in the first such study with Peruvian children. Results show (1) significant change with age in the production of gesture types, with older children producing more; (2) important correlations between gesture types, and both vocalization types and vocabulary after controlling for age effects; and (3) correlations between the trajectory of the pointing gesture in its two modalities (whole-hand and index-finger) with age, vocalizations, and vocabulary, an effect that persists with respect to vocalizations after controlling for age. Our findings, based on a sample from a non-weird population, support a key role for gesture production in early communicative and linguistic development.

Sign in / Sign up

Export Citation Format

Share Document