scholarly journals Eye Tracking During Visually Situated Language Comprehension: Flexibility and Limitations in Uncovering Visual Context Effects

10.3791/57694 ◽  
2018 ◽  
Author(s):  
Camilo Rodriguez Ronderos ◽  
Katja Münster ◽  
Ernesto Guerra ◽  
Helene Kreysa ◽  
Alba Rodríguez ◽  
...  
Keyword(s):  
Eye Tracking ◽  
Language Comprehension ◽  
Context Effects ◽  
Visual Context

Activation and Persistence of Implicit Causality Information in Spoken Language Comprehension

2010 ◽  
Vol 57 (1) ◽  
pp. 5-16 ◽  
Author(s):  
Pirita Pyykkönen ◽  
Juhani Järvikivi
Keyword(s):  
Eye Tracking ◽  
Language Comprehension ◽  
Spoken Language ◽  
Visual World ◽  
Implicit Causality ◽  
Causality Information ◽  
Spoken Language Comprehension

A visual world eye-tracking study investigated the activation and persistence of implicit causality information in spoken language comprehension. We showed that people infer the implicit causality of verbs as soon as they encounter such verbs in discourse, as is predicted by proponents of the immediate focusing account ( Greene & McKoon, 1995 ; Koornneef & Van Berkum, 2006 ; Van Berkum, Koornneef, Otten, & Nieuwland, 2007 ). Interestingly, we observed activation of implicit causality information even before people encountered the causal conjunction. However, while implicit causality information was persistent as the discourse unfolded, it did not have a privileged role as a focusing cue immediately at the ambiguous pronoun when people were resolving its antecedent. Instead, our study indicated that implicit causality does not affect all referents to the same extent, rather it interacts with other cues in the discourse, especially when one of the referents is already prominently in focus.

The Opposition of Surprisal and Semantic Similarity in the Prediction of Language Processing: Evidence from Eye-tracking Data

2020 ◽  
Author(s):  
Kun Sun
Keyword(s):  
Eye Tracking ◽  
Semantic Similarity ◽  
Cognitive Processing ◽  
Language Processing ◽  
Language Comprehension ◽  
Word Processing ◽  
Reading Time ◽  
Computational Models ◽  
Tracking Data ◽  
Dynamic Approach

Expectations or predictions about upcoming content play an important role during language comprehension and processing. One important aspect of recent studies of language comprehension and processing concerns the estimation of the upcoming words in a sentence or discourse. Many studies have used eye-tracking data to explore computational and cognitive models for contextual word predictions and word processing. Eye-tracking data has previously been widely explored with a view to investigating the factors that influence word prediction. However, these studies are problematic on several levels, including the stimuli, corpora, statistical tools they applied. Although various computational models have been proposed for simulating contextual word predictions, past studies usually preferred to use a single computational model. The disadvantage of this is that it often cannot give an adequate account of cognitive processing in language comprehension. To avoid these problems, this study draws upon a massive natural and coherent discourse as stimuli in collecting the data on reading time. This study trains two state-of-art computational models (surprisal and semantic (dis)similarity from word vectors by linear discriminative learning (LDL)), measuring knowledge of both the syntagmatic and paradigmatic structure of language. We develop a `dynamic approach' to compute semantic (dis)similarity. It is the first time that these two computational models have been merged. Models are evaluated using advanced statistical methods. Meanwhile, in order to test the efficiency of our approach, one recently developed cosine method of computing semantic (dis)similarity based on word vectors data adopted is used to compare with our `dynamic' approach. The two computational and fixed-effect statistical models can be used to cross-verify the findings, thus ensuring that the result is reliable. All results support that surprisal and semantic similarity are opposed in the prediction of the reading time of words although both can make good predictions. Additionally, our `dynamic' approach performs better than the popular cosine method. The findings of this study are therefore of significance with regard to acquiring a better understanding how humans process words in a real-world context and how they make predictions in language cognition and processing.

scholarly journals A novel multi-word paradigm for investigating semantic context effects in language production

2019 ◽  
Author(s):  
Cornelia van Scherpenberg ◽  
Rasha Abdel Rahman ◽  
Hellmuth Obrig
Keyword(s):  
Eye Tracking ◽  
Picture Naming ◽  
Language Production ◽  
Context Effects ◽  
Semantic Context ◽  
The Novel ◽  
Target Picture ◽  
Novel Variant ◽  
Lexical Interference ◽  
Respective Category

Semantic context modulates precision and speed of language production. Using different experimental designs including the Picture-Word-Interference (PWI) paradigm, it has consistently been shown that categorically related distractor words (e.g., cat) inhibit retrieval of the target picture name (dog). Here we introduce a novel variant of the PWI paradigm in which we present 8 words prior to a to be named target picture. Within this set, the number of words categorically related was varied between 3 and 5, and the picture to be named was either related or unrelated to the respective category. To disentangle interacting effects of semantic context we combined different naming paradigms manipulating the number of competitors, and assessing the effect of repeated naming instances. Evaluating processing of the cohort by eye-tracking provided us with a metric of the (implicit) recognition of the semantic cohort. Results replicate the interference effect in that overall naming of pictures categorically related to the distractor set was slower compared to unrelated pictures. However, interference did not increase with increasing number of distractors. Tracking this effect across naming repetitions, we found that interference is prominent at the first naming instance of every picture only, whereby it is stable across distractor conditions, but dissipates across the experiment. Regarding eye-tracking our data show that participants fixated longer on semantically related items, indicating the identification of the lexico-semantic cohort. Our findings confirm the validity of the novel paradigm and indicate that besides interference during first exposure, repeated exposure to the semantic context may facilitate picture naming and counteract lexical interference.

Auditory–visual context effects in a speech and nonspeech condition

2000 ◽  
Vol 107 (5) ◽  
pp. 2887-2887
Author(s):  
Linda W. Norrix ◽  
Iris Oved ◽  
Lawrence D. Rosenblum
Keyword(s):  
Context Effects ◽  
Visual Context

scholarly journals Incrementality and efficiency shape pragmatics across languages

2020 ◽  
Vol 117 (24) ◽  
pp. 13399-13404 ◽  
Author(s):  
Paula Rubio-Fernandez ◽  
Julian Jara-Ettinger
Keyword(s):  
Eye Tracking ◽  
Language Processing ◽  
Context Information ◽  
Visual Context ◽  
Human Communication ◽  
Pragmatic Information ◽  
Incoming Information ◽  
Speaker Intentions ◽  
Pragmatic Reasoning

To correctly interpret a message, people must attend to the context in which it was produced. Here we investigate how this process, known as pragmatic reasoning, is guided by two universal forces in human communication: incrementality and efficiency, with speakers of all languages interpreting language incrementally and making the most efficient use of the incoming information. Crucially, however, the interplay between these two forces results in speakers of different languages having different pragmatic information available at each point in processing, including inferences about speaker intentions. In particular, the position of adjectives relative to nouns (e.g., “black lamp” vs. “lamp black”) makes visual context information available in reverse orders. In an eye-tracking study comparing four unrelated languages that have been understudied with regard to language processing (Catalan, Hindi, Hungarian, and Wolof), we show that speakers of languages with an adjective–noun order integrate context by first identifying properties (e.g., color, material, or size), whereas speakers of languages with a noun–adjective order integrate context by first identifying kinds (e.g., lamps or chairs). Most notably, this difference allows listeners of adjective–noun descriptions to infer the speaker’s intention when using an adjective (e.g., “the black…” as implying “not the blue one”) and anticipate the target referent, whereas listeners of noun–adjective descriptions are subject to temporary ambiguity when deriving the same interpretation. We conclude that incrementality and efficiency guide pragmatic reasoning across languages, with different word orders having different pragmatic affordances.

scholarly journals Preschoolers' comprehension of pronouns and reflexives: the impact of the task

2011 ◽  
Vol 39 (4) ◽  
pp. 777-803 ◽  
Author(s):  
CHRISTINA BERGMANN ◽  
MARKUS PAULUS ◽  
PAULA FIKKERT
Keyword(s):  
Eye Tracking ◽  
Language Comprehension ◽  
Age Groups ◽  
Cognitive Resources ◽  
Ongoing Debate ◽  
Typical Response ◽  
On Line ◽  
Referential Expressions ◽  
The Impact ◽  
New Evidence

ABSTRACTPronouns seem to be acquired in an asymmetrical way, where children confuse the meaning of pronouns with reflexives up to the age of six, but not vice versa. Children's production of the same referential expressions is appropriate at the age of four. However, response-based tasks, the usual means to investigate child language comprehension, are very demanding given children's limited cognitive resources. Therefore, they might affect performance. To assess the impact of the task, we investigated learners of Dutch (three- and four-year-olds) using both eye-tracking, a non-demanding on-line method, and a typical response-based task. Eye-tracking results show an emerging ability to correctly comprehend pronouns at the age of four. A response-based task fails to indicate this ability across age groups, replicating results of earlier studies. Additionally, biases seem to influence the outcome of the response-based task. These results add new evidence to the ongoing debate of the asymmetrical acquisition of pronouns and reflexives and suggest that there is less of an asymmetry than previously assumed.

Sign in / Sign up

Export Citation Format

Share Document