Development of a forced-choice rating scale for engineer evaluation.

1963 ◽  
Vol 47 (2) ◽  
pp. 87-88 ◽  
Author(s):  
J. Richard Lepkowski
Keyword(s):  
Rating Scale ◽  
Forced Choice

Perceived Importance of Selected Psychological Strategies Among Elite Malaysian Athletes

2018 ◽  
Vol 12 (2) ◽  
pp. 129-143 ◽  
Author(s):  
Vellapandian Ponnusamy ◽  
Michelle Guerrero ◽  
Jeffrey J. Martin
Keyword(s):  
Rating Scale ◽  
Forced Choice ◽  
Choice Procedure ◽  
Self Talk ◽  
Likert Rating Scale ◽  
Perceived Importance ◽  
Sport Type ◽  
Forced Choice Procedure ◽  
And Gender ◽  
Different Response

Elite Malaysian athletes (N = 179) from integrated and segregated sports rated the perceived importance of eight psychological strategies for improving performance using two different response format methods, a Likert rating scale and forced-choice. A forced-choice procedure produced better discrimination among the skills than a Likert rating scale procedure. We also found that the ratings of importance differed as a function of sport type and gender. Specifically, athletes in integrated sports placed more importance on setting team goals and clarifying roles/responsibilities compared to athletes in segregated sports. At the same time, participants in segregated sports viewed setting personal goals, psych-up strategies, and imagery as more important for performance than those in integrated sports. Significant interaction effects indicated that, within segregated sports, females rated positive self-talk higher than males, but communication skills were rated higher by males than by females.

Development of the forced-choice rating scale technique.

1965 ◽  
Vol 63 (2) ◽  
pp. 117-124 ◽  
Author(s):  
Albert Zavala
Keyword(s):  
Rating Scale ◽  
Forced Choice

scholarly journals An exploratory, cross-cultural study on perception of putative cyclical changes in facial fertility cues

2021 ◽  
Vol 11 (1) ◽  
Author(s):  
Urszula M. Marcinkowska ◽  
Benedict C. Jones ◽  
Huaijan Cai ◽  
Jorge Contreras-Garduno ◽  
Ike E. Onyishi ◽  
...  
Keyword(s):  
Culturally Diverse ◽  
Rating Scale ◽  
Facial Attractiveness ◽  
Forced Choice ◽  
Living Environment ◽  
Cyclical Fluctuation ◽  
Cross Cultural Study ◽  
Current Fertility ◽  
Facial Preferences ◽  
Robust Evidence

AbstractAlthough many researchers have argued that facial traits evolved as honest cues to women’s current fertility (possibly via changes in facial femininity), evidence that women’s facial attractiveness is significantly, positively related to probability of conception throughout menstrual cycle is mixed. These mixed results could reflect differences among studies in the methods used to assess facial attractiveness (i.e., forced choice versus rating-scale methods), differences in how fertility was assessed, differences in perceiver characteristics (e.g., their own attractiveness), and facial preferences possibly being moderated by the characteristics of the living environment. Consequently, the current study investigated the putative effect of cyclical changes in fertility on women’s facial attractiveness and femininity (1) using forced choice and rating-scale method, (2) conducting both ovulation tests and repeated daily measures of estradiol assessing the conception probability, (3) based on a culturally diverse sample of perceivers, while (4) controlling for inter-individual variation. Although we found some limited evidence that women’s faces became more attractive when conception probability increased, these effects differed depending on the methods used to assess both attractiveness and fertility. Moreover, where statistically significant effects were observed, the effect sizes were extremely small. Similarly, there was little robust evidence that perceivers’ characteristics reliably predicted preferences for fertility cues. Collectively, these results suggest that mixed results in previous studies examining cyclical fluctuation in women’s facial attractiveness are unlikely to reflect inter-cultural differences and are more likely to reflect differences in the methods used to assess facial attractiveness and fertility.

scholarly journals On the Statistical and Practical Limitations of Thurstonian IRT Models

2019 ◽  
Vol 79 (5) ◽  
pp. 827-854 ◽  
Author(s):  
Paul-Christian Bürkner ◽  
Niklas Schulte ◽  
Heinz Holling
Keyword(s):  
Rating Scale ◽  
R Package ◽  
Forced Choice ◽  
Model Specification ◽  
Estimation Methods ◽  
High Stakes ◽  
Irt Model ◽  
Irt Models ◽  
Response Biases ◽  
Sizable Number

Forced-choice questionnaires have been proposed to avoid common response biases typically associated with rating scale questionnaires. To overcome ipsativity issues of trait scores obtained from classical scoring approaches of forced-choice items, advanced methods from item response theory (IRT) such as the Thurstonian IRT model have been proposed. For convenient model specification, we introduce the thurstonianIRT R package, which uses Mplus, lavaan, and Stan for model estimation. Based on practical considerations, we establish that items within one block need to be equally keyed to achieve similar social desirability, which is essential for creating forced-choice questionnaires that have the potential to resist faking intentions. According to extensive simulations, measuring up to five traits using blocks of only equally keyed items does not yield sufficiently accurate trait scores and inter-trait correlation estimates, neither for frequentist nor for Bayesian estimation methods. As a result, persons’ trait scores remain partially ipsative and, thus, do not allow for valid comparisons between persons. However, we demonstrate that trait scores based on only equally keyed blocks can be improved substantially by measuring a sizable number of traits. More specifically, in our simulations of 30 traits, scores based on only equally keyed blocks were non-ipsative and highly accurate. We conclude that in high-stakes situations where persons are motivated to give fake answers, Thurstonian IRT models should only be applied to tests measuring a sizable number of traits.

scholarly journals Comparing the validity of trait estimates from the multidimensional forced-choice format and the rating scale format

2019 ◽  
Author(s):  
Eunike Wetzel ◽  
Susanne Frick
Keyword(s):  
Construct Validity ◽  
Big Five ◽  
Rating Scales ◽  
Rating Scale ◽  
Forced Choice ◽  
Self And Other ◽  
Personality Questionnaires ◽  
Response Biases ◽  
Test Retest Reliability ◽  
Scale Format

The multidimensional forced-choice (MFC) format has been proposed as an alternative to rating scales (RS) that may be less susceptible to response biases. The goal of this study was to compare the validity of trait estimates from the MFC and the RS format when using normative scoring for both formats. We focused on construct validity and criterion-related validity. In addition, we investigated test-retest reliability over a period of six months. Participants were randomly assigned the MFC (N = 593) or the RS (N = 622) version of the Big Five Triplets. In addition to self-ratings on the Big Five Triplets and other personality questionnaires and criteria, we also obtained other-ratings (N = 770) for the Big Five Triplets. The Big Five in the Big Five Triplets corresponded well with the Big Five in the Big Five Inventory except for agreeableness in the MFC version. The majority of the construct validity coefficients differed between the MFC and the RS version whereas criterion-related validities were very similar. The self- and other-rated Big Five Triplets showed higher correlations in the MFC format than in the RS format. The reliability of test scores on the Big Five and test-retest reliabilities were lower for MFC compared to RS. For the MFC format to be able to replace the RS format, more research on how to obtain ideal constellations of items that are matched in their desirability is needed.

Sign in / Sign up

Export Citation Format

Share Document