scholarly journals A valid and reliable measure of nothing: disentangling the “Gavagai effect” in survey data

PeerJ ◽  
2020 ◽  
Vol 8 ◽  
pp. e10209
Author(s):  
Victor B. Arias ◽  
Fernando P. Ponce ◽  
Martin Bruggeman ◽  
Noelia Flores ◽  
Cristina Jenaro
Keyword(s):  
Factor Analysis ◽  
Psychometric Properties ◽  
Common Factor ◽  
Response Styles ◽  
Sufficient Evidence ◽  
Actual Structure ◽  
Factorial Model ◽  
Suitable Structure ◽  
High Internal Consistency ◽  
Central Term

Background In three recent studies, Maul demonstrated that sets of nonsense items can acquire excellent psychometric properties. Our aim was to find out why responses to nonsense items acquire a well-defined structure and high internal consistency. Method We designed two studies. In the first study, 610 participants responded to eight items where the central term (intelligence) was replaced by the term “gavagai”. In the second study, 548 participants responded to seven items whose content was totally invented. We asked the participants if they gave any meaning to “gavagai”, and conducted analyses aimed at uncovering the most suitable structure for modeling responses to meaningless items. Results In the first study, 81.3% of the sample gave “gavagai” meaning, while 18.7% showed they had given it no interpretation. The factorial structures of the two groups were very different from each other. In the second study, the factorial model fitted almost perfectly. However, further analysis revealed that the structure of the data was not continuous but categorical with three unordered classes very similar to midpoint, disacquiescent, and random response styles. Discussion Apparently good psychometric properties on meaningless scales may be due to (a) respondents actually giving an interpretation to the item and responding according to that interpretation, or (b) a false positive because the statistical fit of the factorial model is not sensitive to cases where the actual structure of the data does not come from a common factor. In conclusion, the problem is not in factor analysis, but in the ability of the researcher to elaborate substantive hypotheses about the structure of the data, to employ analytical procedures congruent with those hypotheses, and to understand that a good fit in factor analysis does not have a univocal interpretation and is not sufficient evidence of either validity nor good psychometric properties.

Psychometric Properties of the Reassurance-Seeking Scale in a Turkish Sample

2005 ◽  
Vol 96 (1) ◽  
pp. 47-50 ◽  
Author(s):  
Tülin Gençöz ◽  
Faruk Gençöz
Keyword(s):  
Factor Analysis ◽  
Psychometric Properties ◽  
Undergraduate Students ◽  
Internal Consistency Reliability ◽  
Self Esteem ◽  
Beck Anxiety Inventory ◽  
Reassurance Seeking ◽  
Partial Correlations ◽  
High Internal Consistency ◽  
High Internal Consistency Reliability

This study examined the psychometric properties of the Reassurance-Seeking Scale in a sample of 102 Turkish undergraduate students. High internal consistency reliability was found for the Reassurance-Seeking Scale (alpha = .86). Factor analysis of the scale identified a single component that accounted for 71% of the total variance. The scale was significantly positively correlated with the Beck Depression Inventory and Beck Anxiety Inventory and had a significantly negative correlation with the Rosenberg Self-esteem Scale. Partial correlations of Reassurance-seeking with Depression scores as controlled by Anxiety scores and with Anxiety scores as controlled by Depression scores indicated that Reassurance-seeking scores maintained association with Depression but not with Anxiety. All these findings were in line with expectations.

scholarly journals Psychometric properties and measurement invariance of the 7-item game addiction scale (GAS) among Chinese college students

2020 ◽  
Vol 20 (1) ◽  
Author(s):  
Yujie Liu ◽  
Qian Wang ◽  
Min Jou ◽  
Baohong Wang ◽  
Yang An ◽  
...  
Keyword(s):  
College Students ◽  
Factor Analysis ◽  
Psychometric Properties ◽  
Measurement Invariance ◽  
Internal Consistency ◽  
Educational Level ◽  
Concurrent Validity ◽  
Family Income ◽  
Factorial Model ◽  
Class Standing

Abstract Background The 7-item Gaming Addiction Scale (GAS) has been used as a screening tool for addictive game use worldwide, and this study aimed to examine its psychometric properties and measurement invariance among college students in China. Methods Full-time students from multiple colleges in China were recruited. A total of 1040 completed questionnaires were used in the final analysis. Reliability of the GAS was assessed by internal consistency and split-half reliability. Validity of the GAS was assessed by structural validity, convergent validity, discriminant validity, and concurrent validity. A series of Multigroup Confirmatory Factor Analysis (MG-CFA) were conducted to test and establish measurement invariance across gender, class standing, family income and parental educational level. Results Exploratory factor analysis revealed a unidimensional structure of the GAS. The GAS exhibited excellent internal consistency (Cronbach’s α = 0.951, theta coefficient = 0.953, omega coefficient = 0.959) and structural validity (χ2 /df = 0.877 (p < 0.05), CFI = 0.999, TIL = 0.996, RMSEA =0.000). Concurrent validity of the GAS was confirmed by its correlation with problematic internet use, sleep quality, nine dimensions of psychiatric symptoms, and substance use. The GAS also demonstrated measurement invariance across father’s educational level (Δχ2 (df) = 19.128 (12), ΔCFI = − 0.009, ΔRMSEA = 0.010 for weak factorial model; Δχ2 (df) = 50.109 (42), ΔCFI = − 0.010, ΔRMSEA = 0.007 for strict factorial model.) and mother’s educational level (Δχ2 (df) = 6.679 (12), ΔCFI = 0.007, ΔRMSEA = − 0.010 for weak factorial model; Δχ2 (df) =49.131 (42), ΔCFI = − 0.009, ΔRMSEA = − 0.004 for strict factorial model), as well as partial measurement invariance across gender (except for item 2), class standing (except for item 7) and family income (except for item 5). Conclusions The Chinese version of the 7-item GAS can be an adequate assessment tool to assess internet gaming disorder among the college student population in China.

scholarly journals Psychometric Properties of the SOC-13 Scale in Colombian Adults

2021 ◽  
Vol 18 (24) ◽  
pp. 13017
Author(s):  
Ana Cristina Mafla ◽  
Mauricio Herrera-López ◽  
Karen España-Fuelagan ◽  
Iván Ramírez-Solarte ◽  
Carmen Gallardo Pino ◽  
...  
Keyword(s):  
Factor Analysis ◽  
Psychometric Properties ◽  
Internal Consistency ◽  
Cross Validation ◽  
Factor Model ◽  
Confirmatory Factor ◽  
High Internal Consistency ◽  
Best Fit ◽  
Composite Reliability ◽  
Three Factor

The aim of this study was to determine the psychometric properties of the Spanish version of the SOC-13 in Colombian adults. The SOC-13 questionnaire was administered to 489 individuals aged ≥18 years who were in lockdown from March to July 2020 in Nariño County, Colombia. Psychometric properties of the scale were examined using a cross-validation method via exploratory factor analysis (EFA) and confirmatory factor analysis (CFA). Additionally, configural and metric invariance were tested. To determine the internal consistency of the questionnaire, McDonald’s omega (ω), Cronbach’s alpha (α), and composite reliability (CR) coefficients were estimated. The EFA determined that a three-factor structure best fit the data (comprehensibility, manageability, and meaningfulness) and CFA confirmed this three-factor model structure showing a good fit (χ2S-B = 188.530, χ2S-B/(62) = 3.615, p = 0.001; NNFI = 0.959; CFI = 0.968; RMSEA = 0.052 (90% CI [0.041–0.063]) and SRMR = 0.052).The invariance analysis indicated the same underlying theoretical structure between genders. Additionally, (ω), (α), and (CR) coefficients confirmed a high internal consistency of the instrument. The SOC-13 scale, reflecting comprehensibility, manageability, and meaningfulness, is a reliable and valid tool for assessing the sense of coherence in Colombian populations.

The Stigma of Suicide Scale

Crisis ◽  
2013 ◽  
Vol 34 (1) ◽  
pp. 13-21 ◽  
Author(s):  
Philip J. Batterham ◽  
Alison L. Calear ◽  
Helen Christensen
Keyword(s):  
Construct Validity ◽  
Psychometric Properties ◽  
Factor Structure ◽  
Internal Consistency ◽  
Concurrent Validity ◽  
Online Survey ◽  
National University ◽  
Stigmatizing Attitudes ◽  
High Internal Consistency ◽  
At Home

Background: There are presently no validated scales to adequately measure the stigma of suicide in the community. The Stigma of Suicide Scale (SOSS) is a new scale containing 58 descriptors of a “typical” person who completes suicide. Aims: To validate the SOSS as a tool for assessing stigma toward suicide, to examine the scale’s factor structure, and to assess correlates of stigmatizing attitudes. Method: In March 2010, 676 staff and students at the Australian National University completed the scale in an online survey. The construct validity of the SOSS was assessed by comparing its factors with factors extracted from the Suicide Opinion Questionnaire (SOQ). Results: Three factors were identified: stigma, isolation/depression, and glorification/normalization. Each factor had high internal consistency and strong concurrent validity with the Suicide Opinion Questionnaire. More than 25% of respondents agreed that people who suicided were “weak,” “reckless,” or “selfish.” Respondents who were female, who had a psychology degree, or who spoke only English at home were less stigmatizing. A 16-item version of the scale also demonstrated robust psychometric properties. Conclusions: The SOSS is the first attitudes scale designed to directly measure the stigma of suicide in the community. Results suggest that psychoeducation may successfully reduce stigma.

The Factor Structure and Psychometric Properties of the Resiliency Scale in Chinese Undergraduates

2010 ◽  
Vol 26 (3) ◽  
pp. 162-171 ◽  
Author(s):  
Lixia Cui ◽  
Xiujie Teng ◽  
Xupei Li ◽  
Tian P.S. Oei
Keyword(s):  
Factor Analysis ◽  
Psychometric Properties ◽  
Factor Structure ◽  
Undergraduate Students ◽  
Concurrent Validity ◽  
Higher Order ◽  
Criterion Variable ◽  
Confirmatory Factor ◽  
High Level ◽  
Chinese Undergraduates

The current study examined the factor structure and the psychometric properties of Sandra Prince-Embury’s Resiliency Scale for Adolescents (RESA) in Chinese undergraduates. A total of 726 undergraduate students were randomly divided into two subsamples: Sample A was used for the exploratory factor analysis (EFA) and Sample B was used for the confirmatory factor analysis (CFA). The EFA revealed that 56 items and a model of 10 factors with 3 higher order factors (as described by Sandra) were to be retained; CFA with Sample B confirmed this result. The overall scale and the subscales of the Chinese-RESA demonstrated a high level of internal consistency. Furthermore, concurrent validity was demonstrated by the correlation of the scale with other instruments such as the PANAS and the CSS, and the predictive validity was confirmed via three multiple regression analyses using the PANAS as a criterion variable: one for the 10 subscales of the C-RESA, one for the 3 higher order scales, and one for the total C-RESA. We concluded that the C-RESA may be used for research into Chinese undergraduates’ adaptive behaviors.

Psychometric characteristics of the Personality Belief Questionnaire – Short Form

2013 ◽  
Vol 14 (3) ◽  
Author(s):  
Donizete Tadeu Leite ◽  
Ederaldo José Lopes ◽  
Renata Ferrarez Fernandes Lopes
Keyword(s):  
College Students ◽  
Factor Analysis ◽  
Psychometric Properties ◽  
Personality Disorders ◽  
Short Form ◽  
Factorial Validity ◽  
Dysfunctional Beliefs ◽  
Psychometric Characteristics ◽  
Brazilian Version ◽  
Practical Tool

This study evaluated the psychometric properties of the Brazilian version of the Personality Belief Questionnaire – Short Form (PBQ-SF). A sample of 700 college students answered to the Brazilian version of the PBQ-SF. The results showed good estimates of reliability (Cronbach’s alpha) of the PBQ-SF scales, indicating a significant association between the beliefs of each of the scales. The results of factor analysis of the PBQ-SF were similar to its original version. Overall, the findings provide support for the existence of factorial validity for the Brazilian version of the PBQ-SF, suggesting that it is a practical tool for the measurement of dysfunctional beliefs related to personality disorders

Spectrum Decomposition through Maximum Likelihood Common Factor Analysis of the EPR Spectra of Na+ Containing Carbonated Apatites Dried at 400°C

1993 ◽  
Vol 53 (6) ◽  
pp. 416-423
Author(s):  
Peter D. W. Moens ◽  
Ronald M. H. Verbeeck ◽  
Paul J. De Volder ◽  
Freddy J. Callens ◽  
Erna A. P. De Maeyer
Keyword(s):  
Factor Analysis ◽  
Maximum Likelihood ◽  
Common Factor ◽  
Epr Spectra ◽  
Common Factor Analysis ◽  
Carbonated Apatites ◽  
Spectrum Decomposition

scholarly journals Psychometric properties of the critical thinking disposition assessment test amongst medical students in China: a cross-sectional study

2021 ◽  
Vol 21 (1) ◽  
Author(s):  
Liyuan Cui ◽  
Yaxin Zhu ◽  
Jinglou Qu ◽  
Liming Tie ◽  
Ziqi Wang ◽  
...  
Keyword(s):  
Factor Analysis ◽  
Critical Thinking ◽  
Medical Students ◽  
Psychometric Properties ◽  
Internal Consistency ◽  
Discriminant Validity ◽  
Retest Reliability ◽  
Critical Thinking Disposition ◽  
Thinking Disposition ◽  
Test Retest Reliability

Abstract Background Critical thinking disposition helps medical students and professionals overcome the effects of personal values and beliefs when exercising clinical judgment. The lack of effective instruments to measure critical thinking disposition in medical students has become an obstacle for training and evaluating students in undergraduate programs in China. The aim of this study was to evaluate the psychometric properties of the CTDA test. Methods A total of 278 students participated in this study and responded to the CTDA test. Cronbach’s α coefficient, internal consistency, test-retest reliability, floor effects and ceiling effects were measured to assess the reliability of the questionnaire. Construct validity of the pre-specified three-domain structure of the CTDA was evaluated by explanatory factor analysis (EFA) and confirmatory factor analysis (CFA). The convergent validity and discriminant validity were also analyzed. Results Cronbach’s alpha coefficient for the entire questionnaire was calculated to be 0.92, all of the domains showed acceptable internal consistency (0.81–0.86), and the test-retest reliability indicated acceptable intra-class correlation coefficients (ICCs) (0.93, p < 0.01). The EFA and the CFA demonstrated that the three-domain model fitted the data adequately. The test showed satisfactory convergent and discriminant validity. Conclusions The CTDA is a reliable and valid questionnaire to evaluate the disposition of medical students towards critical thinking in China and can reasonably be applied in critical thinking programs and medical education research.

Sign in / Sign up

Export Citation Format

Share Document