scholarly journals Can you crowdsource expertise? Comparing expert and crowd‐based scoring keys for three situational judgment tests

2021 ◽  
Author(s):  
Matt I. Brown ◽  
Michael A. Grossenbacher ◽  
Michelle P. Martin‐Raugh ◽  
Jonathan Kochert ◽  
Matthew S. Prewett
Keyword(s):  
Situational Judgment ◽  
Situational Judgment Tests

Using situational judgment tests to measure teamwork and communication

2010 ◽  
Author(s):  
James N. Kurtessis ◽  
Kelley J. Krokos ◽  
Barbara A. Fritzsche
Keyword(s):  
Situational Judgment ◽  
Situational Judgment Tests

Empirical Keying of Situational Judgment Tests: Rationale and Some Examples

2004 ◽  
Author(s):  
Kelley J. Krokos ◽  
Adam W. Meade ◽  
April R. Cantwell ◽  
Samuel B. Pond ◽  
Mark A. Wilson
Keyword(s):  
Situational Judgment ◽  
Situational Judgment Tests ◽  
Empirical Keying

scholarly journals Situational Judgment Tests as a method for measuring personality: Development and validity evidence for a test of Dependability

PLoS ONE ◽  
2019 ◽  
Vol 14 (2) ◽  
pp. e0211884 ◽  
Author(s):  
Gabriel Olaru ◽  
Jeremy Burrus ◽  
Carolyn MacCann ◽  
Franklin M. Zaromb ◽  
Oliver Wilhelm ◽  
...  
Keyword(s):  
Personality Development ◽  
Validity Evidence ◽  
Situational Judgment ◽  
Situational Judgment Tests

Nominal Response Model Is Useful for Scoring Multiple-Choice Situational Judgment Tests

2018 ◽  
Vol 23 (2) ◽  
pp. 342-366 ◽  
Author(s):  
Jiyun Zu ◽  
Patrick C. Kyllonen
Keyword(s):  
Multiple Choice ◽  
Test Theory ◽  
Parameter Estimates ◽  
Response Model ◽  
Scoring Methods ◽  
Response Curves ◽  
Situational Judgment ◽  
Situational Judgment Tests ◽  
Nominal Response Model ◽  
Nominal Response

We evaluated the use of the nominal response model (NRM) to score multiple-choice (also known as “select the best option”) situational judgment tests (SJTs). Using data from two large studies, we compared the reliability and correlations of NRM scores with those from various classical and item response theory (IRT) scoring methods. The SJTs measured emotional management (Study 1) and teamwork and collaboration (Study 2). In Study 1 the NRM scoring method was shown to be superior in reliability and in yielding higher correlations with external measures to three classical test theory–based and four other IRT-based methods. In Study 2, only slight differences between scoring methods were observed. An explanation for the discrepancy in findings is that in cases where item keys are ambiguous (as in Study 1), the NRM accommodates that ambiguity, but in cases where item keys are clear (as in Study 2), different methods provide interchangeable scores. We characterize ambiguous and clear keys using category response curves based on parameter estimates of the NRM and discuss the relationships between our findings and those from the wisdom-of-the-crowd literature.

Situational judgment tests: Who knows the right answers?

2017 ◽  
Vol 39 (12) ◽  
pp. 1293-1294 ◽  
Author(s):  
Rebecca Beesley ◽  
Angelica Sharma ◽  
Jason Leo Walsh ◽  
David John Wilson ◽  
Benjamin Howell Lole Harris
Keyword(s):  
Situational Judgment ◽  
Situational Judgment Tests ◽  
The Right
Sign in / Sign up

Export Citation Format

Share Document