A studyforrest extension, simultaneous fMRI and eye gaze recordings during prolonged natural stimulation

Michael Hanke; Nico Adelhöfer; Daniel Kottke; Vittorio Iacovella; Ayan Sengupta; Falko R. Kaule; Roland Nigbur; Alexander Q. Waite; Florian Baumgartner; Jörg Stadler

doi:10.1038/sdata.2016.92

Simultaneous fMRI and eye gaze recordings during prolonged natural stimulation - a studyforrest extension

10.1101/046581 ◽

2016 ◽

Cited By ~ 3

Author(s):

Michael Hanke ◽

Nico Adelhöfer ◽

Daniel Kottke ◽

Vittorio Iacovella ◽

Ayan Sengupta ◽

...

Keyword(s):

Language Processing ◽

Eye Gaze ◽

Fmri Data ◽

Stimulus Motion ◽

Natural Stimulus ◽

Attentional Processes ◽

Natural Stimulation ◽

Potential Impact ◽

Response Congruency ◽

Additional Sample

AbstractHere we present an update of the studyforrest (http://studyforrest.org) dataset that complements the previously released functional magnetic resonance imaging (fMRI) data for natural language processing with a new two-hour 3Tesla fMRI acquisition while 15 of the original participants were shown an audio-visual version of the stimulus motion picture. We demonstrate with two validation analyses that these new data support modeling specific properties of the complex natural stimulus, as well as a substantial within-subject BOLD response congruency in brain areas related to the processing of auditory inputs, speech, and narrative when compared to the existing fMRI data for audio-only stimulation. In addition, we provide participants’ eye gaze location as recorded simultaneously with fMRI, and an additional sample of 15 control participants whose eye gaze trajectories for the entire movie were recorded in a lab setting — to enable studies on attentional processes and comparative investigations on the potential impact of the stimulation setting on these processes.

Download Full-text

Case Studies for Telepractice in AAC

Perspectives on Augmentative and Alternative Communication ◽

10.1044/aac23.1.42 ◽

2014 ◽

Vol 23 (1) ◽

pp. 42-54 ◽

Cited By ~ 1

Author(s):

Tanya Rose Curtis

Keyword(s):

Service Delivery ◽

Case Studies ◽

Eye Gaze ◽

Cognitive Impairments ◽

Perceived Barriers ◽

Computer Experience ◽

Access Methods ◽

Complex Communication Needs ◽

Barriers To Service ◽

Communication Needs

As the field of telepractice grows, perceived barriers to service delivery must be anticipated and addressed in order to provide appropriate service delivery to individuals who will benefit from this model. When applying telepractice to the field of AAC, additional barriers are encountered when clients with complex communication needs are unable to speak, often present with severe quadriplegia and are unable to position themselves or access the computer independently, and/or may have cognitive impairments and limited computer experience. Some access methods, such as eye gaze, can also present technological challenges in the telepractice environment. These barriers can be overcome, and telepractice is not only practical and effective, but often a preferred means of service delivery for persons with complex communication needs.

Download Full-text

Supporting the Use of Rudimentary Vocalizations

Perspectives on Augmentative and Alternative Communication ◽

10.1044/aac23.3.132 ◽

2014 ◽

Vol 23 (3) ◽

pp. 132-139 ◽

Cited By ~ 1

Author(s):

Lauren Zubow ◽

Richard Hurtig

Keyword(s):

Rett Syndrome ◽

Visual Cues ◽

Acoustic Analysis ◽

Eye Gaze ◽

Research Question ◽

Primary Research ◽

Multiple Modalities ◽

Face To Face ◽

Perceptual Judgments ◽

The Face

Children with Rett Syndrome (RS) are reported to use multiple modalities to communicate although their intentionality is often questioned (Bartolotta, Zipp, Simpkins, & Glazewski, 2011; Hetzroni & Rubin, 2006; Sigafoos et al., 2000; Sigafoos, Woodyatt, Tuckeer, Roberts-Pennell, & Pittendreigh, 2000). This paper will present results of a study analyzing the unconventional vocalizations of a child with RS. The primary research question addresses the ability of familiar and unfamiliar listeners to interpret unconventional vocalizations as “yes” or “no” responses. This paper will also address the acoustic analysis and perceptual judgments of these vocalizations. Pre-recorded isolated vocalizations of “yes” and “no” were presented to 5 listeners (mother, father, 1 unfamiliar, and 2 familiar clinicians) and the listeners were asked to rate the vocalizations as either “yes” or “no.” The ratings were compared to the original identification made by the child's mother during the face-to-face interaction from which the samples were drawn. Findings of this study suggest, in this case, the child's vocalizations were intentional and could be interpreted by familiar and unfamiliar listeners as either “yes” or “no” without contextual or visual cues. The results suggest that communication partners should be trained to attend to eye-gaze and vocalizations to ensure the child's intended choice is accurately understood.

Download Full-text