scholarly journals Mountain or Molehill? A Simulation Study on the Impact of Response Styles

2016 ◽  
Vol 77 (1) ◽  
pp. 32-53 ◽  
Author(s):  
Hansjörg Plieninger
Keyword(s):  
Systematic Investigation ◽  
Response Style ◽  
Response Styles ◽  
Self Report ◽  
Item Response Model ◽  
Extreme Response Style ◽  
Extreme Response ◽  
Scale Scores ◽  
Self Report Data ◽  
The Impact

Even though there is an increasing interest in response styles, the field lacks a systematic investigation of the bias that response styles potentially cause. Therefore, a simulation was carried out to study this phenomenon with a focus on applied settings (reliability, validity, scale scores). The influence of acquiescence and extreme response style was investigated, and independent variables were, for example, the number of reverse-keyed items. Data were generated from a multidimensional item response model. The results indicated that response styles may bias findings based on self-report data and that this bias may be substantial if the attribute of interest is correlated with response style. However, in the absence of such correlations, bias was generally very small, especially for extreme response style and if acquiescence was controlled for by reverse-keyed items. An empirical example was used to illustrate and validate the simulations. In summary, it is concluded that the threat of response styles may be smaller than feared.

scholarly journals “All or nothing”

Psico ◽  
2021 ◽  
Vol 52 (1) ◽  
pp. e35441
Author(s):  
Bruno Bonfá-Araujo ◽  
Nelson Hauck Filho
Keyword(s):  
Cognitive Processes ◽  
Significant Relationship ◽  
Dark Triad ◽  
Response Style ◽  
Response Styles ◽  
Extreme Response Style ◽  
Extreme Response ◽  
Dichotomous Thinking ◽  
The Relationship ◽  
Positive Effect

In the current study, we investigated the unique associations between dichotomous thinking, extreme response style (ERS), and the Dark Triad of personality, namely, Machiavellianism, narcissism, and psychopathy. We hypothesized that dichotomous thinking would exhibit a positive effect on ERS, and that dichotomous thinking would be positively associated with the Dark Triad even after accounting for ERS. Participants were 488 adults with a mean age of 29.54 years (SD = 10.38). Results confirmed dichotomous thinking positively predicts ERS, that the relationship between dichotomous thinking and the Dark Triad domains remains positive and significant even after accounting for ERS. Moreover, ERS manifested weak negative associations with the Dark Triad, with a significant relationship only with psychopathy. Findings from the current study help expand the understanding of both the substantive nature of response styles and the cognitive processes underlying the Dark Triad of personality.

scholarly journals A Mixture IRTree Model for Extreme Response Style: Accounting for Response Process Uncertainty

2020 ◽  
pp. 001316442091391
Author(s):  
Nana Kim ◽  
Daniel M. Bolt
Keyword(s):  
Real Data ◽  
Response Style ◽  
Response Styles ◽  
Individual Level ◽  
Process Uncertainty ◽  
Extreme Response Style ◽  
Learning Mathematics ◽  
Extreme Response ◽  
The Individual ◽  
Mathematics And Science

This paper presents a mixture item response tree (IRTree) model for extreme response style. Unlike traditional applications of single IRTree models, a mixture approach provides a way of representing the mixture of respondents following different underlying response processes (between individuals), as well as the uncertainty present at the individual level (within an individual). Simulation analyses reveal the potential of the mixture approach in identifying subgroups of respondents exhibiting response behavior reflective of different underlying response processes. Application to real data from the Students Like Learning Mathematics (SLM) scale of Trends in International Mathematics and Science Study (TIMSS) 2015 demonstrates the superior comparative fit of the mixture representation, as well as the consequences of applying the mixture on the estimation of content and response style traits. We argue that methodology applied to investigate response styles should attend to the inherent uncertainty of response style influence due to the likely influence of both response styles and the content trait on the selection of extreme response categories.

Association of MMPI Validity Scales and Therapist Ratings of Psychopathology in Adolescent Psychiatric Inpatients

Assessment ◽  
1997 ◽  
Vol 4 (1) ◽  
pp. 17-27 ◽  
Author(s):  
David L. Pogge ◽  
John M. Stokes ◽  
Julian Frank ◽  
Hazel Wong ◽  
Philip D. Harvey
Keyword(s):  
Minnesota Multiphasic Personality Inventory ◽  
Psychiatric Inpatients ◽  
Response Style ◽  
Response Styles ◽  
Self Report ◽  
Strongly Correlated ◽  
Report Data ◽  
Observer Ratings ◽  
Self Report Data ◽  
Participant Response

Although some self-report instruments (e.g., the Minnesota Multiphasic Personality Inventory, MMPI) have specifically been designed to consider the effects of participants' response styles in their disclosure of psychopathology, many of the most commonly used instruments (e.g., the revised edition of the Symptom Checklist-90, SCL-90-R; the Beck Depression Inventory, BDI) do not. This may compromise the accuracy of these measures, particularly in patient populations that may be liable to biased self-reports. Although observer ratings are often preferred to self-report data, no effort has been made to determine whether or not participant response styles might influence ratings provided by clinicians. This study examined 235 adolescent psychiatric inpatients with both self-report and therapist ratings of depression and nondepressive psychopathology together with common measures of response styles. Confirmatory factor analysis revealed that MMPI scales sensitive to response style were strongly correlated with both self-report and therapist ratings of the severity of psychopathology. Both transparent self-report measures and therapist ratings of psychopathology were significantly higher in patients with high F scales, with both of these ratings significantly lower in individuals with high L or K scales. Despite arguments regarding the desirability of observer ratings to avoid the influence of response bias, these results suggest that they also share variance with measures of response style.

Why Ecological Momentary Assessment Surveys Go Incomplete?: When It Happens and How It Impacts Data

2020 ◽  
Author(s):  
Yu-Hsiang Wu ◽  
Jingjing Xu ◽  
Elizabeth Stangl ◽  
Shareka Pentony ◽  
Dhruv Vyas ◽  
...  
Keyword(s):  
Real Time ◽  
Self Report ◽  
Data Logging ◽  
Time Data ◽  
Real Time Data ◽  
Report Data ◽  
Self Report Data ◽  
Ecological Momentary ◽  
The Impact ◽  
Momentary Assessment

Abstract Background Ecological momentary assessment (EMA) often requires respondents to complete surveys in the moment to report real-time experiences. Because EMA may seem disruptive or intrusive, respondents may not complete surveys as directed in certain circumstances. Purpose This article aims to determine the effect of environmental characteristics on the likelihood of instances where respondents do not complete EMA surveys (referred to as survey incompletion), and to estimate the impact of survey incompletion on EMA self-report data. Research Design An observational study. Study Sample Ten adults hearing aid (HA) users. Data Collection and Analysis Experienced, bilateral HA users were recruited and fit with study HAs. The study HAs were equipped with real-time data loggers, an algorithm that logged the data generated by HAs (e.g., overall sound level, environment classification, and feature status including microphone mode and amount of gain reduction). The study HAs were also connected via Bluetooth to a smartphone app, which collected the real-time data logging data as well as presented the participants with EMA surveys about their listening environments and experiences. The participants were sent out to wear the HAs and complete surveys for 1 week. Real-time data logging was triggered when participants completed surveys and when participants ignored or snoozed surveys. Data logging data were used to estimate the effect of environmental characteristics on the likelihood of survey incompletion, and to predict participants' responses to survey questions in the instances of survey incompletion. Results Across the 10 participants, 715 surveys were completed and survey incompletion occurred 228 times. Mixed effects logistic regression models indicated that survey incompletion was more likely to happen in the environments that were less quiet and contained more speech, noise, and machine sounds, and in the environments wherein directional microphones and noise reduction algorithms were enabled. The results of survey response prediction further indicated that the participants could have reported more challenging environments and more listening difficulty in the instances of survey incompletion. However, the difference in the distribution of survey responses between the observed responses and the combined observed and predicted responses was small. Conclusion The present study indicates that EMA survey incompletion occurs systematically. Although survey incompletion could bias EMA self-report data, the impact is likely to be small.

scholarly journals Kernel Causality Among Teacher Self-Efficacy, Job Satisfaction, School Climate, and Workplace Well-Being and Stress in TALIS

2021 ◽  
Vol 12 ◽  
Author(s):  
Xue Zhang ◽  
Chunyang Zhao ◽  
Yuqiao Xu ◽  
Shanhuai Liu ◽  
Zhihui Wu
Keyword(s):  
Job Satisfaction ◽  
School Climate ◽  
Self Efficacy ◽  
Teaching And Learning ◽  
Well Being ◽  
Individual Characteristics ◽  
Response Style ◽  
Extreme Response Style ◽  
Extreme Response ◽  
Teacher Self Efficacy

Teachers play an important role in the educational system. Teacher self-efficacy, job satisfaction, school climate, and workplace well-being and stress are four individual characteristics shown to be associated with tendency to turnover. In this article, data from the Teaching and Learning International Survey (TALIS) 2018 teacher questionnaire are analyzed, with the goal to understand the interplay amongst these four individual characteristics. The main purposes of this study are to (1) measure extreme response style for each scale using unidimensional nominal response models, and (2) investigate the kernel causal paths among teacher self-efficacy, job satisfaction, school climate, and workplace well-being and stress in the TALIS-PISA linked countries/economies. Our findings support the existence of extreme response style, the rational non-normal distribution assumption of latent traits, and the feasibility of kernel causal inference in the educational sector. Results of the present study inform the development of future correlational research and policy making in education.

Sign in / Sign up

Export Citation Format

Share Document