scholarly journals Methods for the Control of Extreme Response Styles in Self-Report Instruments: A Review

2019 ◽  
Vol 27 (2) ◽  
pp. 309-323
Author(s):  
Ariela Raissa L. Costa ◽  
Nelson H. Filho
Keyword(s):  
Response Styles ◽  
Self Report ◽  
Extreme Response

scholarly journals Mountain or Molehill? A Simulation Study on the Impact of Response Styles

2016 ◽  
Vol 77 (1) ◽  
pp. 32-53 ◽  
Author(s):  
Hansjörg Plieninger
Keyword(s):  
Systematic Investigation ◽  
Response Style ◽  
Response Styles ◽  
Self Report ◽  
Item Response Model ◽  
Extreme Response Style ◽  
Extreme Response ◽  
Scale Scores ◽  
Self Report Data ◽  
The Impact

Even though there is an increasing interest in response styles, the field lacks a systematic investigation of the bias that response styles potentially cause. Therefore, a simulation was carried out to study this phenomenon with a focus on applied settings (reliability, validity, scale scores). The influence of acquiescence and extreme response style was investigated, and independent variables were, for example, the number of reverse-keyed items. Data were generated from a multidimensional item response model. The results indicated that response styles may bias findings based on self-report data and that this bias may be substantial if the attribute of interest is correlated with response style. However, in the absence of such correlations, bias was generally very small, especially for extreme response style and if acquiescence was controlled for by reverse-keyed items. An empirical example was used to illustrate and validate the simulations. In summary, it is concluded that the threat of response styles may be smaller than feared.

Response Biases

2016 ◽  
pp. 349-363 ◽  
Author(s):  
Eunike Wetzel ◽  
Jan R. Böhnke ◽  
Anna Brown
Keyword(s):  
Cultural Differences ◽  
Test Construction ◽  
Response Styles ◽  
Cross Cultural Differences ◽  
Extreme Response ◽  
Trait Level ◽  
Item Responses ◽  
Item Content ◽  
General Response ◽  
Response Biases

Response biases comprise a variety of systematic tendencies of responding to questionnaire items. Response biases exert an influence on item responses in addition to any constructs that the questionnaire is designed to measure and can therefore potentially bias the corresponding trait level estimates. This chapter addresses general response biases that are independent of item content, including response styles (e.g., extreme response style, acquiescence) and rater biases (halo effect, leniency/severity bias), as well as response biases that are related to item content and depend strongly on the context (socially desirable responding). The chapter summarizes research on correlates of response biases and research on inter-individual and cross-cultural differences in engaging in response styles and rater biases. It describes different methods that can be applied at the test construction stage to prevent or minimize the occurrence of response biases. Finally, it depicts methods developed for correcting for the effects of response biases.

scholarly journals Accounting for Item Response Process and Response Styles Using the Unfolding Item Response Tree (UIRTree) Model

2021 ◽  
Author(s):  
Zhaojun Li ◽  
Bo Zhang ◽  
Mengyang Cao ◽  
Louis Tay
Keyword(s):  
Item Response ◽  
Response Styles ◽  
Parameter Estimates ◽  
Model Parameters ◽  
Response Process ◽  
Monte Carlo Simulation Study ◽  
Graded Response ◽  
Extreme Response ◽  
Generalized Graded Unfolding Model ◽  
Unfolding Models

Many researchers have found that unfolding models may better represent how respondents answer Liker-type items and response styles (RSs) often have moderate to strong presence in responses to such items. However, the two research lines have been growing largely in parallel. The present study proposed an unfolding item response tree (UIRTree) model that can account for unfolding response process and RSs simultaneously. An empirical illustration showed that the UIRTree model could fit a personality dataset well and produced more reasonable parameter estimates. Strong presence of the extreme response style (ERS) was also revealed by the UIRTree model. We further conducted a Monte Carlo simulation study to examine the performance of the UIRTree model compared to three other models for Likert-scale responses: the Samejima’s graded response model, the generalized graded unfolding model, and the dominance item response tree (DIRTree) model. Results showed that when data followed unfolding response process and contained the ERS, the AIC was able to select the UIRTree model, while BIC was biased towards the DIRTree model in many conditions. In addition, model parameters in the UIRTree model could be accurately recovered under realistic conditions, and wrongly assuming the item response process or ignoring RSs was detrimental to the estimation of key parameters. In general, the UIRTree model is expected to help in better understanding of responses to Liker-type items theoretically and contribute to better scale development practically. Future studies on multi-trait UIRTree models and UIRTree models accounting for different types of RSs are expected.

scholarly journals Item Response Tree Models to Investigate Acquiescence and Extreme Response Styles in Likert-Type Rating Scales

2019 ◽  
Vol 79 (5) ◽  
pp. 911-930 ◽  
Author(s):  
Minjeong Park ◽  
Amery D. Wu
Keyword(s):  
Item Response ◽  
Rating Scales ◽  
Rating Scale ◽  
Explanatory Models ◽  
Response Styles ◽  
Modeling Framework ◽  
Typical Application ◽  
Item Response Models ◽  
Extreme Response ◽  
Tree Models

Item response tree (IRTree) models are recently introduced as an approach to modeling response data from Likert-type rating scales. IRTree models are particularly useful to capture a variety of individuals’ behaviors involving in item responding. This study employed IRTree models to investigate response styles, which are individuals’ tendencies to prefer or avoid certain response categories in a rating scale. Specifically, we introduced two types of IRTree models, descriptive and explanatory models, perceived under a larger modeling framework, called explanatory item response models, proposed by De Boeck and Wilson. This extends the typical application of IRTree models for studying response styles. As a demonstration, we applied the descriptive and explanatory IRTree models to examine acquiescence and extreme response styles in Rosenberg’s Self-Esteem Scale. Our findings suggested the presence of two distinct extreme response styles and acquiescence response style in the scale.

Detecting Measurement Invariance in Organizational Surveys* * The original data upon which this paper is based are available at www.hhpub.com/journals/ejpa

2000 ◽  
Vol 16 (1) ◽  
pp. 20-30 ◽  
Author(s):  
Michael Eid ◽  
Michael Rauber
Keyword(s):  
Measurement Invariance ◽  
Class Size ◽  
Original Data ◽  
Response Styles ◽  
Future Research ◽  
Latent Classes ◽  
Response Scale ◽  
Distribution Models ◽  
Extreme Response ◽  
Organizational Surveys

Summary: The problem of measurement invariance in organizational surveys is discussed, and it is shown how mixture distribution models can be used to detect response styles in organizational surveys. The results of an analysis of a leadership performance scale with the polytomous mixed Rasch model is reported (N = 4578). The results revealed that two latent classes differing in response styles could be detected: One class (size: 71%) using the whole response scale without a strong preference for specific categories and one class (size: 29%) preferring the extreme response categories and avoiding the middle ones. Furthermore, it was shown that the two latent classes differ in demographic and other organizational variables. Finally, the implications of this study for comparing individuals across divisions and organizations as well as for future research on organizational assessment methods are discussed.

Are the Relationships Between NEO PI-R and Rorschach Markers of Openness to Experience Dependent on the Patient’s Test-Taking Attitude?

2005 ◽  
Vol 27 (1) ◽  
pp. 30-50
Author(s):  
Jean-Michel Petot
Keyword(s):  
Openness To Experience ◽  
Response Style ◽  
Response Styles ◽  
Self Report ◽  
Present Formulation ◽  
Test Taking ◽  
Strongly Connected ◽  
Control Response ◽  
The One ◽  
Rorschach Variables

The low correlations reported between self-report measures and the Rorschach raise questions about the validity of both kinds of instruments. Meyer (1996) suggested that these low correlations are an artefact, due to the failure to control response style. Correlations would be high and positive when subjects have the same response style on both methods, and high and negative when they have divergent response styles. But response style is assessed according to criteria strongly connected with distress, and the enhancement of correlations may be tautologically limited to distress scales. The objective of this research is to verify whether the response style hypothesis applies to Openness to Experience, a dimension unrelated with distress. Correlations were computed between on the one hand Openness and Neuroticism, and on the second one several selected Rorschach variables. Analyses were conducted on the whole sample (n = 96) and on separate subgroups of patients with convergent (n = 29) or divergent (n = 22) test-taking attitude. The findings establish Openness is related to Rorschach low L, high blends, morbid responses, and combinatory special scores. They also establish that response style moderates correlations between Neuroticism and the Rorschach, but not between Openness and the Rorschach. These results seem to confirm the tautological nature of the present formulation of the response style hypothesis, but further refinement in the analysis of test-taking attitude could help reconsider things.

The Relationship of Test Familiarity to Extreme Response Styles in Bedouin and Moroccan Boys

1976 ◽  
Vol 7 (3) ◽  
pp. 357-364 ◽  
Author(s):  
Alvin H. Shapiro ◽  
Lorne Rosenblood ◽  
Geoffrey M. Berlyne ◽  
John Finberg
Keyword(s):  
Response Styles ◽  
Extreme Response ◽  
Relationship Of ◽  
The Relationship
Sign in / Sign up

Export Citation Format

Share Document