Modeling Response Styles in Cross‐Country Self‐Reports: An Application of a Multilevel Multidimensional Nominal Response Model

2019 ◽  
Vol 56 (1) ◽  
pp. 169-191 ◽  
Author(s):  
Unhee Ju ◽  
Carl F. Falk
Keyword(s):  
Response Styles ◽  
Response Model ◽  
Nominal Response Model ◽  
Self Reports ◽  
Cross Country ◽  
Nominal Response

Nominal Response Model Is Useful for Scoring Multiple-Choice Situational Judgment Tests

2018 ◽  
Vol 23 (2) ◽  
pp. 342-366 ◽  
Author(s):  
Jiyun Zu ◽  
Patrick C. Kyllonen
Keyword(s):  
Multiple Choice ◽  
Test Theory ◽  
Parameter Estimates ◽  
Response Model ◽  
Scoring Methods ◽  
Response Curves ◽  
Situational Judgment ◽  
Situational Judgment Tests ◽  
Nominal Response Model ◽  
Nominal Response

We evaluated the use of the nominal response model (NRM) to score multiple-choice (also known as “select the best option”) situational judgment tests (SJTs). Using data from two large studies, we compared the reliability and correlations of NRM scores with those from various classical and item response theory (IRT) scoring methods. The SJTs measured emotional management (Study 1) and teamwork and collaboration (Study 2). In Study 1 the NRM scoring method was shown to be superior in reliability and in yielding higher correlations with external measures to three classical test theory–based and four other IRT-based methods. In Study 2, only slight differences between scoring methods were observed. An explanation for the discrepancy in findings is that in cases where item keys are ambiguous (as in Study 1), the NRM accommodates that ambiguity, but in cases where item keys are clear (as in Study 2), different methods provide interchangeable scores. We characterize ambiguous and clear keys using category response curves based on parameter estimates of the NRM and discuss the relationships between our findings and those from the wisdom-of-the-crowd literature.

scholarly journals Asymptotic Standard Errors of Parameter Scale Transformation Coefficients in Test Equating Under the Nominal Response Model

2020 ◽  
pp. 014662162096574
Author(s):  
Zhonghua Zhang
Keyword(s):  
Multiple Imputation ◽  
Imputation Method ◽  
Delta Method ◽  
Scale Transformation ◽  
Standard Errors ◽  
Response Model ◽  
Test Equating ◽  
Nominal Response Model ◽  
Multiple Imputation Method ◽  
Nominal Response

Researchers have developed a characteristic curve procedure to estimate the parameter scale transformation coefficients in test equating under the nominal response model. In the study, the delta method was applied to derive the standard error expressions for computing the standard errors for the estimates of the parameter scale transformation coefficients. This brief report presents the results of a simulation study that examined the accuracy of the derived formulas and compared the performance of this analytical method with that of the multiple imputation method. The results indicated that the standard errors produced by the delta method were very close to the criterion standard errors as well as those yielded by the multiple imputation method under all the simulation conditions.

scholarly journals Applying the Nominal Response Model Within a Longitudinal Framework to Construct the Positive Family Relationships Scale

2015 ◽  
Vol 75 (6) ◽  
pp. 901-930 ◽  
Author(s):  
Kathleen Suzanne Johnson Preston ◽  
Skye N. Parral ◽  
Allen W. Gottfried ◽  
Pamella H. Oliver ◽  
Adele Eskeles Gottfried ◽  
...  
Keyword(s):  
Family Relationships ◽  
Response Model ◽  
Nominal Response Model ◽  
Nominal Response

Test Design Optimization in CAT Early Stage with the Nominal Response Model

2007 ◽  
Vol 31 (3) ◽  
pp. 213-232 ◽  
Author(s):  
Valeria Lima Passos ◽  
Martijn P. F. Berger ◽  
Frans E. Tan
Keyword(s):  
Design Optimization ◽  
Early Stage ◽  
Test Design ◽  
Response Model ◽  
Nominal Response Model ◽  
Nominal Response
Sign in / Sign up

Export Citation Format

Share Document