Combining mixture distribution and multidimensional IRTree models for the measurement of extreme response styles

2019 ◽  
Vol 72 (3) ◽  
pp. 538-559 ◽  
Author(s):  
Lale Khorramdel ◽  
Matthias Davier ◽  
Artur Pokropek
Author(s):  
Eunike Wetzel ◽  
Jan R. Böhnke ◽  
Anna Brown

Response biases comprise a variety of systematic tendencies of responding to questionnaire items. Response biases exert an influence on item responses in addition to any constructs that the questionnaire is designed to measure and can therefore potentially bias the corresponding trait level estimates. This chapter addresses general response biases that are independent of item content, including response styles (e.g., extreme response style, acquiescence) and rater biases (halo effect, leniency/severity bias), as well as response biases that are related to item content and depend strongly on the context (socially desirable responding). The chapter summarizes research on correlates of response biases and research on inter-individual and cross-cultural differences in engaging in response styles and rater biases. It describes different methods that can be applied at the test construction stage to prevent or minimize the occurrence of response biases. Finally, it depicts methods developed for correcting for the effects of response biases.


2021 ◽  
Author(s):  
Zhaojun Li ◽  
Bo Zhang ◽  
Mengyang Cao ◽  
Louis Tay

Many researchers have found that unfolding models may better represent how respondents answer Liker-type items and response styles (RSs) often have moderate to strong presence in responses to such items. However, the two research lines have been growing largely in parallel. The present study proposed an unfolding item response tree (UIRTree) model that can account for unfolding response process and RSs simultaneously. An empirical illustration showed that the UIRTree model could fit a personality dataset well and produced more reasonable parameter estimates. Strong presence of the extreme response style (ERS) was also revealed by the UIRTree model. We further conducted a Monte Carlo simulation study to examine the performance of the UIRTree model compared to three other models for Likert-scale responses: the Samejima’s graded response model, the generalized graded unfolding model, and the dominance item response tree (DIRTree) model. Results showed that when data followed unfolding response process and contained the ERS, the AIC was able to select the UIRTree model, while BIC was biased towards the DIRTree model in many conditions. In addition, model parameters in the UIRTree model could be accurately recovered under realistic conditions, and wrongly assuming the item response process or ignoring RSs was detrimental to the estimation of key parameters. In general, the UIRTree model is expected to help in better understanding of responses to Liker-type items theoretically and contribute to better scale development practically. Future studies on multi-trait UIRTree models and UIRTree models accounting for different types of RSs are expected.


2019 ◽  
Vol 27 (2) ◽  
pp. 309-323
Author(s):  
Ariela Raissa L. Costa ◽  
Nelson H. Filho

2019 ◽  
Vol 79 (5) ◽  
pp. 911-930 ◽  
Author(s):  
Minjeong Park ◽  
Amery D. Wu

Item response tree (IRTree) models are recently introduced as an approach to modeling response data from Likert-type rating scales. IRTree models are particularly useful to capture a variety of individuals’ behaviors involving in item responding. This study employed IRTree models to investigate response styles, which are individuals’ tendencies to prefer or avoid certain response categories in a rating scale. Specifically, we introduced two types of IRTree models, descriptive and explanatory models, perceived under a larger modeling framework, called explanatory item response models, proposed by De Boeck and Wilson. This extends the typical application of IRTree models for studying response styles. As a demonstration, we applied the descriptive and explanatory IRTree models to examine acquiescence and extreme response styles in Rosenberg’s Self-Esteem Scale. Our findings suggested the presence of two distinct extreme response styles and acquiescence response style in the scale.


2000 ◽  
Vol 16 (1) ◽  
pp. 20-30 ◽  
Author(s):  
Michael Eid ◽  
Michael Rauber

Summary: The problem of measurement invariance in organizational surveys is discussed, and it is shown how mixture distribution models can be used to detect response styles in organizational surveys. The results of an analysis of a leadership performance scale with the polytomous mixed Rasch model is reported (N = 4578). The results revealed that two latent classes differing in response styles could be detected: One class (size: 71%) using the whole response scale without a strong preference for specific categories and one class (size: 29%) preferring the extreme response categories and avoiding the middle ones. Furthermore, it was shown that the two latent classes differ in demographic and other organizational variables. Finally, the implications of this study for comparing individuals across divisions and organizations as well as for future research on organizational assessment methods are discussed.


1976 ◽  
Vol 7 (3) ◽  
pp. 357-364 ◽  
Author(s):  
Alvin H. Shapiro ◽  
Lorne Rosenblood ◽  
Geoffrey M. Berlyne ◽  
John Finberg

Psico ◽  
2021 ◽  
Vol 52 (1) ◽  
pp. e35441
Author(s):  
Bruno Bonfá-Araujo ◽  
Nelson Hauck Filho

In the current study, we investigated the unique associations between dichotomous thinking, extreme response style (ERS), and the Dark Triad of personality, namely, Machiavellianism, narcissism, and psychopathy. We hypothesized that dichotomous thinking would exhibit a positive effect on ERS, and that dichotomous thinking would be positively associated with the Dark Triad even after accounting for ERS. Participants were 488 adults with a mean age of 29.54 years (SD = 10.38). Results confirmed dichotomous thinking positively predicts ERS, that the relationship between dichotomous thinking and the Dark Triad domains remains positive and significant even after accounting for ERS. Moreover, ERS manifested weak negative associations with the Dark Triad, with a significant relationship only with psychopathy. Findings from the current study help expand the understanding of both the substantive nature of response styles and the cognitive processes underlying the Dark Triad of personality.


2017 ◽  
Vol 33 (5) ◽  
pp. 352-364 ◽  
Author(s):  
Eunike Wetzel ◽  
Claus H. Carstensen

Abstract. Response styles can influence item responses in addition to a respondent’s latent trait level. A common concern is that comparisons between individuals based on sum scores may be rendered invalid by response style effects. This paper investigates a multidimensional approach to modeling traits and response styles simultaneously. Models incorporating different response styles as well as personality traits (Big Five facets) were compared regarding model fit. Relationships between traits and response styles were investigated and different approaches to modeling extreme response style (ERS) were compared regarding their effects on trait estimates. All multidimensional models showed a better fit than the unidimensional models, indicating that response styles influenced item responses with ERS showing the largest incremental variance explanation. ERS and midpoint response style were mainly trait-independent whereas acquiescence and disacquiescence were strongly related to several personality traits. Expected a posteriori estimates of participants’ trait levels did not differ substantially between two-dimensional and unidimensional models when a set of heterogeneous items was used to model ERS. A minor adjustment of trait estimates occurred when the same items were used to model ERS and the trait, though the ERS dimension in this approach only reflected scale-specific ERS, rather than a general ERS tendency.


2017 ◽  
Vol 8 ◽  
Author(s):  
Min Liu ◽  
Allen G. Harbaugh ◽  
Jeffrey R. Harring ◽  
Gregory R. Hancock

2016 ◽  
Vol 51 (2) ◽  
pp. 941-958 ◽  
Author(s):  
Mingnan Liu ◽  
Frederick G. Conrad ◽  
Sunghee Lee

Sign in / Sign up

Export Citation Format

Share Document