Eye-tracking as a window on language processing in ASD.

2016 ◽  
pp. 13-33 ◽  
Author(s):  
Courtenay Frazier Norbury
Keyword(s):  
Eye Tracking ◽  
Language Processing

The Opposition of Surprisal and Semantic Similarity in the Prediction of Language Processing: Evidence from Eye-tracking Data

2020 ◽  
Author(s):  
Kun Sun
Keyword(s):  
Eye Tracking ◽  
Semantic Similarity ◽  
Cognitive Processing ◽  
Language Processing ◽  
Language Comprehension ◽  
Word Processing ◽  
Reading Time ◽  
Computational Models ◽  
Tracking Data ◽  
Dynamic Approach

Expectations or predictions about upcoming content play an important role during language comprehension and processing. One important aspect of recent studies of language comprehension and processing concerns the estimation of the upcoming words in a sentence or discourse. Many studies have used eye-tracking data to explore computational and cognitive models for contextual word predictions and word processing. Eye-tracking data has previously been widely explored with a view to investigating the factors that influence word prediction. However, these studies are problematic on several levels, including the stimuli, corpora, statistical tools they applied. Although various computational models have been proposed for simulating contextual word predictions, past studies usually preferred to use a single computational model. The disadvantage of this is that it often cannot give an adequate account of cognitive processing in language comprehension. To avoid these problems, this study draws upon a massive natural and coherent discourse as stimuli in collecting the data on reading time. This study trains two state-of-art computational models (surprisal and semantic (dis)similarity from word vectors by linear discriminative learning (LDL)), measuring knowledge of both the syntagmatic and paradigmatic structure of language. We develop a `dynamic approach' to compute semantic (dis)similarity. It is the first time that these two computational models have been merged. Models are evaluated using advanced statistical methods. Meanwhile, in order to test the efficiency of our approach, one recently developed cosine method of computing semantic (dis)similarity based on word vectors data adopted is used to compare with our `dynamic' approach. The two computational and fixed-effect statistical models can be used to cross-verify the findings, thus ensuring that the result is reliable. All results support that surprisal and semantic similarity are opposed in the prediction of the reading time of words although both can make good predictions. Additionally, our `dynamic' approach performs better than the popular cosine method. The findings of this study are therefore of significance with regard to acquiring a better understanding how humans process words in a real-world context and how they make predictions in language cognition and processing.

scholarly journals A Survey on Using Gaze Behaviour for Natural Language Processing

2020 ◽  
Author(s):  
Sandeep Mathias ◽  
Diptesh Kanojia ◽  
Abhijit Mishra ◽  
Pushpak Bhattacharya
Keyword(s):  
Natural Language Processing ◽  
Natural Language ◽  
Eye Tracking ◽  
Language Processing ◽  
Word Identification ◽  
Test Time ◽  
Gaze Behaviour ◽  
Cognitive Information ◽  
Essay Grading ◽  
Multiple Languages

Gaze behaviour has been used as a way to gather cognitive information for a number of years. In this paper, we discuss the use of gaze behaviour in solving different tasks in natural language processing (NLP) without having to record it at test time. This is because the collection of gaze behaviour is a costly task, both in terms of time and money. Hence, in this paper, we focus on research done to alleviate the need for recording gaze behaviour at run time. We also mention different eye tracking corpora in multiple languages, which are currently available and can be used in natural language processing. We conclude our paper by discussing applications in a domain - education - and how learning gaze behaviour can help in solving the tasks of complex word identification and automatic essay grading.

scholarly journals The male bias of a masculine generic pronoun: Evidence from eye-tracking and sentence evaluation

2020 ◽  
Author(s):  
Theresa Redl ◽  
Stefan L. Frank ◽  
Peter de Swart ◽  
Helen de Hoop
Keyword(s):  
Eye Tracking ◽  
Language Processing ◽  
Possessive Pronoun ◽  
Male Bias ◽  
Gender Information

Two experiments tested whether the Dutch possessive pronoun zijn ‘his’ gives rise to a gender inference and thus causes a male bias when used generically in sentences such as Everyone was putting on his shoes. Experiment 1 (N = 120, 48 male) was a conceptual replication of a previous eye-tracking study that had not found evidence of a male bias. The results of the current eye-tracking experiment showed the masculine generic pronoun to trigger a gender inference and cause a male bias, but for male participants and in neutral stereotype contexts only. No evidence for a male bias was thus found in stereotypically female and male contexts and for female participants altogether. Experiment 2 (N = 80, 40 male) used the same stimuli as Experiment 1, but employed the sentence evaluation paradigm. No evidence of a male bias was found in Experiment 2. Taken together, the results suggest that the masculine generic pronoun zijn ‘his’ can cause a male bias for male participants when no other gender information is provided, but only surfaces with a method such as eye-tracking, which taps directly into automatic language processing. Furthermore, the results suggest that the intended generic reading of the masculine possessive pronoun zijn ‘his’ is readily available for women.

scholarly journals Divergence point analyses of visual world data: applications to bilingual research

2020 ◽  
pp. 1-9
Author(s):  
Kate Stone ◽  
Sol Lago ◽  
Daniel J. Schad
Keyword(s):  
Confidence Interval ◽  
Eye Tracking ◽  
Language Processing ◽  
Multiple Comparisons ◽  
Individual Factors ◽  
Visual World ◽  
World Data ◽  
Divergence Point ◽  
L2 Processing ◽  
Divergence Points

Abstract Much work has shown that differences in the timecourse of language processing are central to comparing native (L1) and non-native (L2) speakers. However, estimating the onset of experimental effects in timecourse data presents several statistical problems including multiple comparisons and autocorrelation. We compare several approaches to tackling these problems and illustrate them using an L1-L2 visual world eye-tracking dataset. We then present a bootstrapping procedure that allows not only estimation of an effect onset, but also of a temporal confidence interval around this divergence point. We describe how divergence points can be used to demonstrate timecourse differences between speaker groups or between experimental manipulations, two important issues in evaluating L2 processing accounts. We discuss possible extensions of the bootstrapping procedure, including determining divergence points for individual speakers and correlating them with individual factors like L2 exposure and proficiency. Data and an analysis tutorial are available at https://osf.io/exbmk/.

scholarly journals Monolingual and bilingual children's processing of coarticulation cues during spoken word recognition

2020 ◽  
Vol 47 (6) ◽  
pp. 1189-1206
Author(s):  
Félix DESMEULES-TRUDEL ◽  
Charlotte MOORE ◽  
Tania S. ZAMUNER
Keyword(s):  
Word Recognition ◽  
Eye Tracking ◽  
Old English ◽  
Language Processing ◽  
Spoken Word Recognition ◽  
Spoken Word ◽  
Bilingual Children ◽  
Phonetic Cues ◽  
Vowel Nasalization ◽  
English Monolingual

AbstractBilingual children cope with a significant amount of phonetic variability when processing speech, and must learn to weigh phonetic cues differently depending on the cues’ respective roles in their two languages. For example, vowel nasalization is coarticulatory and contrastive in French, but coarticulatory-only in English. In this study, we extended an investigation of the processing of coarticulation in two- to three-year-old English monolingual children (Zamuner, Moore & Desmeules-Trudel, 2016) to a group of four- to six-year-old English monolingual children and age-matched English–French bilingual children. Using eye tracking, we found that older monolingual children and age-matched bilingual children showed more sensitivity to coarticulation cues than the younger children. Moreover, when comparing the older monolinguals and bilinguals, we found no statistical differences between the two groups. These results offer support for the specification of coarticulation in word representations, and indicate that, in some cases, bilingual children possess language processing skills similar to monolinguals.

scholarly journals Common Ground Information Affects Reference Resolution: Evidence From Behavioral Data, ERPs, and Eye-Tracking

2020 ◽  
Vol 11 ◽  
Author(s):  
Maria Richter ◽  
Mariella Paul ◽  
Barbara Höhle ◽  
Isabell Wartenburger
Keyword(s):  
Eye Tracking ◽  
Language Processing ◽  
Cognitive Skills ◽  
Common Ground ◽  
Event Related Potentials ◽  
Referential Communication ◽  
Reference Resolution ◽  
Early Integration ◽  
Related Potentials ◽  
Socially Situated

One of the most important social cognitive skills in humans is the ability to “put oneself in someone else’s shoes,” that is, to take another person’s perspective. In socially situated communication, perspective taking enables the listener to arrive at a meaningful interpretation of what is said (sentence meaning) and what is meant (speaker’s meaning) by the speaker. To successfully decode the speaker’s meaning, the listener has to take into account which information he/she and the speaker share in their common ground (CG). We here further investigated competing accounts about when and how CG information affects language comprehension by means of reaction time (RT) measures, accuracy data, event-related potentials (ERPs), and eye-tracking. Early integration accounts would predict that CG information is considered immediately and would hence not expect to find costs of CG integration. Late integration accounts would predict a rather late and effortful integration of CG information during the parsing process that might be reflected in integration or updating costs. Other accounts predict the simultaneous integration of privileged ground (PG) and CG perspectives. We used a computerized version of the referential communication game with object triplets of different sizes presented visually in CG or PG. In critical trials (i.e., conflict trials), CG information had to be integrated while privileged information had to be suppressed. Listeners mastered the integration of CG (response accuracy 99.8%). Yet, slower RTs, and enhanced late positivities in the ERPs showed that CG integration had its costs. Moreover, eye-tracking data indicated an early anticipation of referents in CG but an inability to suppress looks to the privileged competitor, resulting in later and longer looks to targets in those trials, in which CG information had to be considered. Our data therefore support accounts that foresee an early anticipation of referents to be in CG but a rather late and effortful integration if conflicting information has to be processed. We show that both perspectives, PG and CG, contribute to socially situated language processing and discuss the data with reference to theoretical accounts and recent findings on the use of CG information for reference resolution.

scholarly journals Look before you leap

2014 ◽  
Vol 4 (1) ◽  
pp. 3-24 ◽  
Author(s):  
Ruth Koops van ’t Jagt ◽  
John Hoeks ◽  
Gillis J. Dorleijn ◽  
Petra Hendriks
Keyword(s):  
Eye Tracking ◽  
Dynamic Model ◽  
Language Processing ◽  
Reading Patterns ◽  
Physical Layout ◽  
Integrative Processes

This study describes two eye tracking experiments investigating the processing of poetry with and without enjambments. In Experiment 1, poetic fragments with authentic prospective (syntactically incomplete) or retrospective (syntactically complete) enjambments were investigated; in Experiment 2, enjambments were created — for the purpose of the experiment — from poetry that did not originally contain enjambments. We hypothesized that the layout of the text in poetic fragments would affect the degree to which integrative processes take place: in case of prospective enjambments, the syntactic incompleteness may preclude integration at the end of the line (before going to the next line), whereas retrospective enjambments may cause considerable re-interpretation at the next line. We indeed found significant differences in reading patterns between prose and poetry, poetry with and without enjambment, and poetry with prospective and retrospective enjambment. We interpret these results as favoring a dynamic model of language processing, where the amount and type of integration is determined by syntactic (in)completeness, semantic (in)completeness, but also the physical layout of the text.

Sign in / Sign up

Export Citation Format

Share Document