scholarly journals Pre‐schoolers use head gestures rather than prosodic cues to highlight important information in speech

2021 ◽  
Author(s):  
Núria Esteve‐Gibert ◽  
Hélène Lœvenbruck ◽  
Marion Dohen ◽  
Mariapaola D'Imperio
Keyword(s):  
Prosodic Cues ◽  
Head Gestures

Investigating the Multimodal Nature of Human Communication

2009 ◽  
Vol 23 (2) ◽  
pp. 63-76 ◽  
Author(s):  
Silke Paulmann ◽  
Sarah Jessen ◽  
Sonja A. Kotz
Keyword(s):  
Visual Information ◽  
Empirical Studies ◽  
Physical Property ◽  
Event Related Potentials ◽  
Accurate Information ◽  
Human Communication ◽  
Channel Condition ◽  
Prosodic Cues ◽  
Early Processing ◽  
Related Potentials

The multimodal nature of human communication has been well established. Yet few empirical studies have systematically examined the widely held belief that this form of perception is facilitated in comparison to unimodal or bimodal perception. In the current experiment we first explored the processing of unimodally presented facial expressions. Furthermore, auditory (prosodic and/or lexical-semantic) information was presented together with the visual information to investigate the processing of bimodal (facial and prosodic cues) and multimodal (facial, lexic, and prosodic cues) human communication. Participants engaged in an identity identification task, while event-related potentials (ERPs) were being recorded to examine early processing mechanisms as reflected in the P200 and N300 component. While the former component has repeatedly been linked to physical property stimulus processing, the latter has been linked to more evaluative “meaning-related” processing. A direct relationship between P200 and N300 amplitude and the number of information channels present was found. The multimodal-channel condition elicited the smallest amplitude in the P200 and N300 components, followed by an increased amplitude in each component for the bimodal-channel condition. The largest amplitude was observed for the unimodal condition. These data suggest that multimodal information induces clear facilitation in comparison to unimodal or bimodal information. The advantage of multimodal perception as reflected in the P200 and N300 components may thus reflect one of the mechanisms allowing for fast and accurate information processing in human communication.

A Study of Lexical and Prosodic Cues to Segmentation in a Hindi-English Code-switched Discourse

2018 ◽  
Author(s):  
Preeti Rao ◽  
Mugdha Pandya ◽  
Kamini Sabu ◽  
Kanhaiya Kumar ◽  
Nandini Bondale
Keyword(s):  
Prosodic Cues

Relations between prominence and articulatory-prosodic cues in emotional speech

2016 ◽  
Author(s):  
Jangwon Kim ◽  
Anil Ramakrishna ◽  
Sungbok Lee ◽  
Shrikanth Narayanan
Keyword(s):  
Emotional Speech ◽  
Prosodic Cues

Recognising regional varieties of Danish

2020 ◽  
Vol 6 (s1) ◽  
Author(s):  
John Tøndering ◽  
Nicolai Pharao
Keyword(s):  
Online Survey ◽  
Stress Group ◽  
Reliable Identification ◽  
Prosodic Cues ◽  
Regional Background ◽  
Group Pattern

AbstractRegional varieties of Danish are distinguished mainly by prosodic cues, in particular the tonal stress group pattern. We test the hypothesis that prosody is a strong cue for identifying the regional background of speakers. This hypothesis was studied using an online survey in which listeners were asked to identify the origin of speakers based on examples from four different regional varieties of Danish. Listeners identified speaker origin on the basis of both natural, monotonised and delexicalised speech samples. The results show that although most listeners are able to identify the four regional varieties correctly, it is more reasonable to say that Danes categorise the regional varieties into broader categories of Western and Eastern Danish. Prosody clearly plays an important role in the identification of the varieties, but reliable identification is difficult based on prosody alone.

scholarly journals USING PROSODY TO PREDICT UPCOMING REFERENTS IN THE L1 AND THE L2

2020 ◽  
pp. 1-28
Author(s):  
Anouschka Foltz
Keyword(s):  
Language Learners ◽  
Second Language Learners ◽  
Exposure Period ◽  
Predictive Processing ◽  
Bilingual Speakers ◽  
Prosodic Cues ◽  
Resource Deficit ◽  
L1 And L2 ◽  
Pitch Accents

Abstract While monolingual speakers can use contrastive pitch accents to predict upcoming referents, bilingual speakers do not always use this cue predictively in their L2. The current study examines the role of recent exposure for predictive processing in native German (L1) second language learners of English (L2). In Experiment 1, participants followed instructions to click on two successive objects, for example, Click on the red carrot/duck. Click on the green/GREEN carrot (where CAPS indicate a contrastive L + H* accent). Participants predicted a repeated noun following a L + H* accent in the L1, but not in the L2, where processing was delayed. Experiment 2 shows that after an exposure period with highly consistent prosodic cues, bilinguals engaged in predictive processing in both their L1 and L2. However, inconsistent prosodic cues showed different effects on bilinguals’ L1 and L2 predictive processing. The results are discussed in terms of exposure-based and resource-deficit models of processing.

scholarly journals HeadBanger: controlling switchable software with head gesture

2016 ◽  
Vol 10 (1) ◽  
pp. 2-10 ◽  
Author(s):  
Matthew Oppenheim
Keyword(s):  
Design Methodology ◽  
Contact Method ◽  
User Group ◽  
Control Software ◽  
Content Type ◽  
Target User ◽  
Test Platform ◽  
Virtual Target ◽  
Head Gestures ◽  
Practical Implications

Purpose – The purpose of this paper is to present a novel non-contact method of using head movement to control software without the need for wearable devices. Design/methodology/approach – A webcam and software are used to track head position. When the head is moved through a virtual target, a keystroke is simulated. The system was assessed by participants with impaired mobility using Sensory Software’s Grid 2 software as a test platform. Findings – The target user group could effectively use this system to interact with switchable software. Practical implications – Physical head switches could be replaced with virtual devices, reducing fatigue and dissatisfaction. Originality/value – Using a webcam to control software using head gestures where the participant does not have to wear any specialised technology or a marker. This system is shown to be of benefit to motor impaired participants for operating switchable software.

scholarly journals Zebra finches are sensitive to prosodic features of human speech

2014 ◽  
Vol 281 (1787) ◽  
pp. 20140480 ◽  
Author(s):  
Michelle J. Spierings ◽  
Carel ten Cate
Keyword(s):  
Speech Perception ◽  
Emotional State ◽  
The Other ◽  
Zebra Finches ◽  
Prosodic Features ◽  
Human Speech ◽  
Prosodic Cues ◽  
Paralinguistic Information ◽  
Final Syllable ◽  
Human Specific

Variation in pitch, amplitude and rhythm adds crucial paralinguistic information to human speech. Such prosodic cues can reveal information about the meaning or emphasis of a sentence or the emotional state of the speaker. To examine the hypothesis that sensitivity to prosodic cues is language independent and not human specific, we tested prosody perception in a controlled experiment with zebra finches. Using a go/no-go procedure, subjects were trained to discriminate between speech syllables arranged in XYXY patterns with prosodic stress on the first syllable and XXYY patterns with prosodic stress on the final syllable. To systematically determine the salience of the various prosodic cues (pitch, duration and amplitude) to the zebra finches, they were subjected to five tests with different combinations of these cues. The zebra finches generalized the prosodic pattern to sequences that consisted of new syllables and used prosodic features over structural ones to discriminate between stimuli. This strong sensitivity to the prosodic pattern was maintained when only a single prosodic cue was available. The change in pitch was treated as more salient than changes in the other prosodic features. These results show that zebra finches are sensitive to the same prosodic cues known to affect human speech perception.

scholarly journals Analysis of engagement behavior in children during dyadic interactions using prosodic cues

2016 ◽  
Vol 37 ◽  
pp. 47-66 ◽  
Author(s):  
Rahul Gupta ◽  
Daniel Bone ◽  
Sungbok Lee ◽  
Shrikanth Narayanan
Keyword(s):  
Dyadic Interactions ◽  
Prosodic Cues ◽  
Engagement Behavior
Sign in / Sign up

Export Citation Format

Share Document