scholarly journals The Effect of Extreme Response and Non-extreme Response Styles on Testing Measurement Invariance

2017 ◽  
Vol 8 ◽  
Author(s):  
Min Liu ◽  
Allen G. Harbaugh ◽  
Jeffrey R. Harring ◽  
Gregory R. Hancock
Keyword(s):  
Measurement Invariance ◽  
Response Styles ◽  
Extreme Response

Detecting Measurement Invariance in Organizational Surveys* * The original data upon which this paper is based are available at www.hhpub.com/journals/ejpa

2000 ◽  
Vol 16 (1) ◽  
pp. 20-30 ◽  
Author(s):  
Michael Eid ◽  
Michael Rauber
Keyword(s):  
Measurement Invariance ◽  
Class Size ◽  
Original Data ◽  
Response Styles ◽  
Future Research ◽  
Latent Classes ◽  
Response Scale ◽  
Distribution Models ◽  
Extreme Response ◽  
Organizational Surveys

Summary: The problem of measurement invariance in organizational surveys is discussed, and it is shown how mixture distribution models can be used to detect response styles in organizational surveys. The results of an analysis of a leadership performance scale with the polytomous mixed Rasch model is reported (N = 4578). The results revealed that two latent classes differing in response styles could be detected: One class (size: 71%) using the whole response scale without a strong preference for specific categories and one class (size: 29%) preferring the extreme response categories and avoiding the middle ones. Furthermore, it was shown that the two latent classes differ in demographic and other organizational variables. Finally, the implications of this study for comparing individuals across divisions and organizations as well as for future research on organizational assessment methods are discussed.

Response Biases

2016 ◽  
pp. 349-363 ◽  
Author(s):  
Eunike Wetzel ◽  
Jan R. Böhnke ◽  
Anna Brown
Keyword(s):  
Cultural Differences ◽  
Test Construction ◽  
Response Styles ◽  
Cross Cultural Differences ◽  
Extreme Response ◽  
Trait Level ◽  
Item Responses ◽  
Item Content ◽  
General Response ◽  
Response Biases

Response biases comprise a variety of systematic tendencies of responding to questionnaire items. Response biases exert an influence on item responses in addition to any constructs that the questionnaire is designed to measure and can therefore potentially bias the corresponding trait level estimates. This chapter addresses general response biases that are independent of item content, including response styles (e.g., extreme response style, acquiescence) and rater biases (halo effect, leniency/severity bias), as well as response biases that are related to item content and depend strongly on the context (socially desirable responding). The chapter summarizes research on correlates of response biases and research on inter-individual and cross-cultural differences in engaging in response styles and rater biases. It describes different methods that can be applied at the test construction stage to prevent or minimize the occurrence of response biases. Finally, it depicts methods developed for correcting for the effects of response biases.

scholarly journals Accounting for Item Response Process and Response Styles Using the Unfolding Item Response Tree (UIRTree) Model

2021 ◽  
Author(s):  
Zhaojun Li ◽  
Bo Zhang ◽  
Mengyang Cao ◽  
Louis Tay
Keyword(s):  
Item Response ◽  
Response Styles ◽  
Parameter Estimates ◽  
Model Parameters ◽  
Response Process ◽  
Monte Carlo Simulation Study ◽  
Graded Response ◽  
Extreme Response ◽  
Generalized Graded Unfolding Model ◽  
Unfolding Models

Many researchers have found that unfolding models may better represent how respondents answer Liker-type items and response styles (RSs) often have moderate to strong presence in responses to such items. However, the two research lines have been growing largely in parallel. The present study proposed an unfolding item response tree (UIRTree) model that can account for unfolding response process and RSs simultaneously. An empirical illustration showed that the UIRTree model could fit a personality dataset well and produced more reasonable parameter estimates. Strong presence of the extreme response style (ERS) was also revealed by the UIRTree model. We further conducted a Monte Carlo simulation study to examine the performance of the UIRTree model compared to three other models for Likert-scale responses: the Samejima’s graded response model, the generalized graded unfolding model, and the dominance item response tree (DIRTree) model. Results showed that when data followed unfolding response process and contained the ERS, the AIC was able to select the UIRTree model, while BIC was biased towards the DIRTree model in many conditions. In addition, model parameters in the UIRTree model could be accurately recovered under realistic conditions, and wrongly assuming the item response process or ignoring RSs was detrimental to the estimation of key parameters. In general, the UIRTree model is expected to help in better understanding of responses to Liker-type items theoretically and contribute to better scale development practically. Future studies on multi-trait UIRTree models and UIRTree models accounting for different types of RSs are expected.

scholarly journals Methods for the Control of Extreme Response Styles in Self-Report Instruments: A Review

2019 ◽  
Vol 27 (2) ◽  
pp. 309-323
Author(s):  
Ariela Raissa L. Costa ◽  
Nelson H. Filho
Keyword(s):  
Response Styles ◽  
Self Report ◽  
Extreme Response

scholarly journals Item Response Tree Models to Investigate Acquiescence and Extreme Response Styles in Likert-Type Rating Scales

2019 ◽  
Vol 79 (5) ◽  
pp. 911-930 ◽  
Author(s):  
Minjeong Park ◽  
Amery D. Wu
Keyword(s):  
Item Response ◽  
Rating Scales ◽  
Rating Scale ◽  
Explanatory Models ◽  
Response Styles ◽  
Modeling Framework ◽  
Typical Application ◽  
Item Response Models ◽  
Extreme Response ◽  
Tree Models

Item response tree (IRTree) models are recently introduced as an approach to modeling response data from Likert-type rating scales. IRTree models are particularly useful to capture a variety of individuals’ behaviors involving in item responding. This study employed IRTree models to investigate response styles, which are individuals’ tendencies to prefer or avoid certain response categories in a rating scale. Specifically, we introduced two types of IRTree models, descriptive and explanatory models, perceived under a larger modeling framework, called explanatory item response models, proposed by De Boeck and Wilson. This extends the typical application of IRTree models for studying response styles. As a demonstration, we applied the descriptive and explanatory IRTree models to examine acquiescence and extreme response styles in Rosenberg’s Self-Esteem Scale. Our findings suggested the presence of two distinct extreme response styles and acquiescence response style in the scale.

The Relationship of Test Familiarity to Extreme Response Styles in Bedouin and Moroccan Boys

1976 ◽  
Vol 7 (3) ◽  
pp. 357-364 ◽  
Author(s):  
Alvin H. Shapiro ◽  
Lorne Rosenblood ◽  
Geoffrey M. Berlyne ◽  
John Finberg
Keyword(s):  
Response Styles ◽  
Extreme Response ◽  
Relationship Of ◽  
The Relationship

scholarly journals “All or nothing”

Psico ◽  
2021 ◽  
Vol 52 (1) ◽  
pp. e35441
Author(s):  
Bruno Bonfá-Araujo ◽  
Nelson Hauck Filho
Keyword(s):  
Cognitive Processes ◽  
Significant Relationship ◽  
Dark Triad ◽  
Response Style ◽  
Response Styles ◽  
Extreme Response Style ◽  
Extreme Response ◽  
Dichotomous Thinking ◽  
The Relationship ◽  
Positive Effect

In the current study, we investigated the unique associations between dichotomous thinking, extreme response style (ERS), and the Dark Triad of personality, namely, Machiavellianism, narcissism, and psychopathy. We hypothesized that dichotomous thinking would exhibit a positive effect on ERS, and that dichotomous thinking would be positively associated with the Dark Triad even after accounting for ERS. Participants were 488 adults with a mean age of 29.54 years (SD = 10.38). Results confirmed dichotomous thinking positively predicts ERS, that the relationship between dichotomous thinking and the Dark Triad domains remains positive and significant even after accounting for ERS. Moreover, ERS manifested weak negative associations with the Dark Triad, with a significant relationship only with psychopathy. Findings from the current study help expand the understanding of both the substantive nature of response styles and the cognitive processes underlying the Dark Triad of personality.

Multidimensional Modeling of Traits and Response Styles

2017 ◽  
Vol 33 (5) ◽  
pp. 352-364 ◽  
Author(s):  
Eunike Wetzel ◽  
Claus H. Carstensen
Keyword(s):  
Personality Traits ◽  
Latent Trait ◽  
Response Style ◽  
Response Styles ◽  
Extreme Response ◽  
Item Responses ◽  
A Posteriori Estimates ◽  
Sum Scores ◽  
Different Response ◽  
A Minor

Abstract. Response styles can influence item responses in addition to a respondent’s latent trait level. A common concern is that comparisons between individuals based on sum scores may be rendered invalid by response style effects. This paper investigates a multidimensional approach to modeling traits and response styles simultaneously. Models incorporating different response styles as well as personality traits (Big Five facets) were compared regarding model fit. Relationships between traits and response styles were investigated and different approaches to modeling extreme response style (ERS) were compared regarding their effects on trait estimates. All multidimensional models showed a better fit than the unidimensional models, indicating that response styles influenced item responses with ERS showing the largest incremental variance explanation. ERS and midpoint response style were mainly trait-independent whereas acquiescence and disacquiescence were strongly related to several personality traits. Expected a posteriori estimates of participants’ trait levels did not differ substantially between two-dimensional and unidimensional models when a set of heterogeneous items was used to model ERS. A minor adjustment of trait estimates occurred when the same items were used to model ERS and the trait, though the ERS dimension in this approach only reflected scale-specific ERS, rather than a general ERS tendency.

Comparing acquiescent and extreme response styles in face-to-face and web surveys

2016 ◽  
Vol 51 (2) ◽  
pp. 941-958 ◽  
Author(s):  
Mingnan Liu ◽  
Frederick G. Conrad ◽  
Sunghee Lee
Keyword(s):  
Response Styles ◽  
Web Surveys ◽  
Face To Face ◽  
Extreme Response
Sign in / Sign up

Export Citation Format

Share Document