Bootstrap Reliability via Coefficient Omega

2011 ◽  
Author(s):  
Miguel Padilla ◽  
Matthew Newton
Keyword(s):  
Coefficient Omega

scholarly journals Don’t Forget the Model in Your Model-based Reliability Coefficients: A Reply to McNeish (2018)

2019 ◽  
Vol 5 (1) ◽  
Author(s):  
Victoria Savalei ◽  
Steven P. Reise
Keyword(s):  
Lower Bound ◽  
Latent Variable ◽  
Reliability Coefficient ◽  
Latent Variable Model ◽  
Reliability Measures ◽  
Variable Model ◽  
Large Samples ◽  
Model Based ◽  
Coefficient Omega ◽  
Reliability Coefficients

McNeish (2018) advocates that researchers abandon coefficient alpha in favor of alternative reliability measures, such as the 1-factor reliability (coefficient omega), a total reliability coefficient based on an exploratory bifactor solution (“Revelle’s omega total”), and the glb (“greatest lower bound”). McNeish supports this argument by demonstrating that these coefficients produce higher sample values in several examples. We express three main disagreements with this article. First, we show that McNeish exaggerates the extent to which alpha is different from omega when unidimensionality holds. Second, we argue that, when unidimensionality is violated, most alternative reliability coefficients are model-based, and it is critical to carefully select the underlying latent variable model rather than relying on software defaults. Third, we point out that higher sample reliability values do not necessarily capture population reliability better: many alternative reliability coefficients are upwardly biased except in very large samples. We conclude with a set of alternative recommendations for researchers.

scholarly journals Análisis factorial confirmatorio y propiedades psicométricas de la Escala de Desesperanza de Beck en estudiantes en contextos de pobreza en México

2019 ◽  
Vol 24 (2) ◽  
pp. 59
Author(s):  
Francisco Quiñonez Tapia ◽  
Tanya Elizabeth Méndez Luevano ◽  
Nicté Castañeda-Camey
Keyword(s):  
Factor Analysis ◽  
Confirmatory Factor Analysis ◽  
Least Square ◽  
Education Students ◽  
Weighted Least Square ◽  
Structure Reliability ◽  
Upper Secondary ◽  
Confirmatory Factor ◽  
Mean And Variance ◽  
Coefficient Omega

Abstract: Confirmatory factor analysis and psychometric properties of the Beck Hopelessness Scale in students in contexts of poverty in Mexico. Hopelessness predicts depression and suicide. In the world, suicide is the second cause of death in people between 15 and 29 years, and depression is the main cause of disability. The internal factorial structure, reliability and construct validity of the Hopelessness Scale were analyzed in upper secondary and higher education students in contexts of poverty in Mexico. 771 participants were evaluated. Reliability was examined with the coefficient omega, and validity with confirmatory factor analysis with the weighted least square mean and variance adjusted method. The value of omega was .89. The confirmatory factor analysis revealed an SRMR = .07, CFI = .95, TLI = .94, RMSEA = .05. The scale is valid and reliable for students in contexts of poverty in Mexico.Keywords: Reliability; validity; students; Beck Hopelessness Scale.Resumen: La desesperanza predice la depresión y el suicidio. En el mundo, el suicidio es la segunda causa de muerte en personas de 15 a 29 años, y la depresión es la principal causa de incapacidad. Se analizo la estructura factorial interna, fiabilidad y validez de constructo de la Escala de Desesperanza de Beck en estudiantes de educación media superior y superior en contextos de pobreza en México. 771 participantes fueron evaluados. Se examinó la fiabilidad con el coeficiente omega, y la validez con el análisis factorial confirmatorio con el método weighted least square mean and variance adjusted. El valor de omega fue de .89. El análisis factorial confirmatorio arrojó un SRMR = .07, CFI = .95, TLI = .94, RMSEA = .05. La escala es válida y fiable para los estudiantes en contextos de pobreza en México.Palabras clave: Fiabilidad; validez; estudiantes; Escala de Desesperanza de Beck.

Opposite-Sex Relationship Questionnaire for Male Adolescents: Development and Psychometric Evaluation

2018 ◽  
Vol 9 ◽  
Author(s):  
Nasim Bahrami ◽  
Masoumeh Sibmar ◽  
AbouAli Vedadhir ◽  
Hamid Alavi Majd ◽  
Averil Parker
Keyword(s):  
Content Validity ◽  
Psychometric Evaluation ◽  
Peer Pressure ◽  
Face Validity ◽  
Male Adolescents ◽  
Family Attitudes ◽  
Opposite Sex ◽  
Coefficient Omega ◽  
The Impact ◽  
Qualitative Phase

We used a mixed-methods, sequential, exploratory design. In the qualitative phase, an in-depth interview approach was used to identify the properties and dimensions to be included in the Opposite-Sex Relationship Questionnaire for Male Adolescents (OSRQMA). In the quantitative phase, the psychometric properties of the OSRQMA were evaluated according to the concepts of face, content, and construct validity. Reliability and stability were assessed with Cronbach's alpha (α) and McDonald's coefficient omega (ω), and with test–retest analysis respectively. A preliminary questionnaire was developed, including 61 items that emerged from the qualitative phase of the study. Based on the impact scores for face validity, and the cutoff points for the content validity ratio (CVR) and content validity index (CVI), the preliminary questionnaire was reduced to 53 items. The Kaiser criteria (eigenvalues >1) and scree plot tests demonstrated that 22 items forming four factors, which were labelled ‘innate predilection’, ‘abstinence’, ‘family attitudes’, and ‘peer pressure’, were optimum, accounting for an estimated 53.449% of the variance. These scales had acceptable levels of internal consistency (α = .854, ω = 0.977) and stability (r = .892, p < .001).

scholarly journals Nonlocal fractional $ p(\cdot) $-Kirchhoff systems with variable-order: Two and three solutions

2021 ◽  
Vol 6 (12) ◽  
pp. 13797-13823
Author(s):  
Weichun Bu ◽  
◽  
Tianqing An ◽  
Guoju Ye ◽  
Yating Guo ◽  
...  
Keyword(s):  
Laplace Operator ◽  
Elliptic Systems ◽  
Variable Order ◽  
Three Solutions ◽  
Variable Parameters ◽  
Differentiable Functions ◽  
Palais Smale Condition ◽  
Bounded Smooth ◽  
The Laplace Operator ◽  
Coefficient Omega

<abstract><p>In this article, we consider the following nonlocal fractional Kirchhoff-type elliptic systems</p> <p><disp-formula> <label/> <tex-math id="FE1"> \begin{document}$ \begin{equation*} \left\{\begin{array}{l} -M_{1}\left(\int_{\mathbb{R}^{N}\times\mathbb{R}^{N}}\frac{|\eta(x)-\eta(y)|^{^{p(x, y)}}}{p(x, y)|x-y|^{N+p(x, y)s(x, y)}}dxdy +\int_{\Omega}\frac{|\eta|^{\overline{p}(x)}}{\overline{p}(x)}dx\right) \left(\Delta_{p(\cdot)}^{s(\cdot)}\eta-|\eta|^{\overline{p}(x)}\eta\right)\\ \; \; \; = \lambda F_{\eta}(x, \eta, \xi)+\mu G_{\eta}(x, \eta, \xi), \; \; x \in \Omega, \\ -M_{2}\left(\int_{\mathbb{R}^{N}\times\mathbb{R}^{N}}\frac{|\xi(x)-\xi(y)|^{^{p(x, y)}}}{p(x, y)|x-y|^{N+p(x, y)s(x, y)}}dxdy +\int_{\Omega}\frac{|\xi|^{\overline{p}(x)}}{\overline{p}(x)}dx\right) \left(\Delta_{p(\cdot)}^{s(\cdot)}\xi-|\xi|^{\overline{p}(x)}\xi\right)\\ \; \; \; = \lambda F_{\xi}(x, \eta, \xi)+\mu G_{\xi}(x, \eta, \xi), \; \; x \in \Omega, \\ \; \eta = \xi = 0, \; \; x \in \mathbb{R}^{N}\backslash \Omega, \end{array} \right. \end{equation*} $\end{document} </tex-math></disp-formula></p> <p>where $ M_{1}(t), M_{2}(t) $ are the models of Kirchhoff coefficient, $ \Omega $ is a bounded smooth domain in $ \mathbb R^{N} $, $ (-\Delta)_{p(\cdot)}^{s(\cdot)} $ is a fractional Laplace operator, $ \lambda, \mu $ are two real parameters, $ F, G $ are continuous differentiable functions, whose partial derivatives are $ F_{\eta}, F_{\xi}, G_{\eta}, G_{\xi} $. With the help of direct variational methods, we study the existence of solutions for nonlocal fractional $ p(\cdot) $-Kirchhoff systems with variable-order, and obtain at least two and three weak solutions based on Bonanno's and Ricceri's critical points theorem. The outstanding feature is the case that the Palais-Smale condition is not requested. The major difficulties and innovations are nonlocal Kirchhoff functions with the presence of the Laplace operator involving two variable parameters.</p></abstract>

scholarly journals Your Coefficient Alpha Is Probably Wrong, but Which Coefficient Omega Is Right? A Tutorial on Using R to Obtain Better Reliability Estimates

2020 ◽  
Vol 3 (4) ◽  
pp. 484-501
Author(s):  
David B. Flora
Keyword(s):  
Coefficient Alpha ◽  
Analysis Model ◽  
Factor Analysis Model ◽  
Psychological Science ◽  
Confirmatory Factor Analysis Model ◽  
Reliability Estimates ◽  
Important Concern ◽  
Confirmatory Factor ◽  
Target Construct ◽  
Coefficient Omega

Measurement quality has recently been highlighted as an important concern for advancing a cumulative psychological science. An implication is that researchers should move beyond mechanistically reporting coefficient alpha toward more carefully assessing the internal structure and reliability of multi-item scales. Yet a researcher may be discouraged upon discovering that a prominent alternative to alpha, namely, coefficient omega, can be calculated in a variety of ways. In this Tutorial, I alleviate this potential confusion by describing alternative forms of omega and providing guidelines for choosing an appropriate omega estimate pertaining to the measurement of a target construct represented with a confirmatory factor analysis model. Several applied examples demonstrate how to compute different forms of omega in R.

scholarly journals 18-Item Version of the Short Gambling Harm Screen (SGHS-18): Validation of Screen for Assessing Gambling-Related Harm among Finnish Population

2021 ◽  
Vol 18 (21) ◽  
pp. 11552
Author(s):  
Tiina Latvala ◽  
Matthew Browne ◽  
Matthew Rockloff ◽  
Anne H. Salonen
Keyword(s):  
Convergent Validity ◽  
Factor Model ◽  
Bifactor Model ◽  
Mental Health Issue ◽  
General Factor ◽  
Web Based ◽  
Gambling Harm ◽  
Measurement Models ◽  
Coefficient Omega ◽  
Gambling Harms

Background and aims: It is common for gambling research to focus on problem and disordered gambling. Less is known about the prevalence of gambling-related harms among people in the general population. This study aimed to develop and validate the 18-item version of the Short Gambling Harms Screen (SGHS-18). Methods: Population-representative web-based and postal surveys were conducted in the three geographical areas of Finland (n = 7186, aged 18 or older). Reliability and internal structure of SGHS-18 was assessed using coefficient omega and via confirmatory factor analysis (CFA). Four measurement models of SGHS-18 were compared: one-factor, six-factor, a second-ordered factor model and a bifactor model (M4). Results: The analysis revealed that only the bifactor model had adequate fit for SGHS-18 (CFI = 0.953, TLI = 0.930, GFI = 0.974, RMSEA = 0.047, SRMR = 0.027). The general factor explained most of the common variance compared to specific factors. Coefficient omega hierarchical value for global gambling harm factor (0.80) was high, which suggested that SGHS-18 assessed the combination of general harm constructs sufficiently. The correlation with the Problem and Pathological Gambling Measures (PPGM) was 0.44, potentially reflecting that gambling harms are closely—although not perfectly—aligned with the mental health issue of problem gambling. SGHS-18 scores were substantially higher for participants who gambled more often, who spent more money or who had gambling problems, demonstrating convergent validity for the screen. Discussion: The SGHS-18 comprehensively measures the domains of gambling harm, while demonstrating desirable properties of internal consistency, and criterion and convergent validity.

scholarly journals Countertransference feelings and personality disorders: A psychometric evaluation of a brief version of the Feeling Word Checklist (FWC-BV)

2020 ◽  
Author(s):  
Randi Breivik ◽  
Theresa Wilberg ◽  
Julie Evensen ◽  
Jan Ivar Røssberg ◽  
Hanne Sofie Dahl ◽  
...  
Keyword(s):  
Factor Analysis ◽  
Psychometric Properties ◽  
Personality Disorders ◽  
Psychometric Evaluation ◽  
Self Report ◽  
Personality Pathology ◽  
Axis Ii ◽  
Working Alliance Inventory ◽  
Dsm Iv ◽  
Coefficient Omega

Abstract Background The Feeling Word Checklist (FWC) is a self-report questionnaire designed to assess therapists’ countertransference (CT) feelings. The primary aim of the study was to evaluate the psychometric properties of a brief, 12-item version of the Feeling Word Checklist (FWC-BV). The second aim was to validate the factor structure by examining the associations between the FWC-BV factors, patients’ personality pathology and therapeutic alliance (TA). Methods Therapists at 13 different outpatient units within the Norwegian Network of Personality Disorders participated, and the study includes therapies for a large sample of patients ( N =2425) with personality pathology. Over a period of 2.5 years, therapists completed the FWC-BV for each patient in therapy every 6 months. Statistical methods included exploratory (EFA) and confirmatory (CFA) factor analysis. Internal consistency was estimated using Mc Donald’s coefficient Omega (ω t ). The Structured Clinical Interview for DSM-IV – Axis II (SCID II) and Mini International Neuropsychiatric Interview (MINI) were used as diagnostic instruments, and patient-rated TA was assessed using the Working Alliance Inventory (WAI-SR). Results Factor analyses revealed three clinically meaningful factors: Inadequate , Idealised and Confident . These factors had acceptable psychometric properties. Most notably, a number of borderline PD criteria correlated positively with the factors Inadequate and Idealised , and negatively with the factor Confident . All the factors correlated significantly with at least one of the WAI-SR subscales Conclusions The FWC-BV measures three clinically meaningful aspects of therapists’ CT feelings. This brief version of the FWC seems satisfactory for use in further research and in clinical contexts. Keywords: Countertransference, Feeling Word Checklist, factor analysis, personality disorder, psychometrics

scholarly journals Translation, Cultural Adaptation, and Psychometric Features of the Persian Version of the Copenhagen Multi-Centre Psychological Infertility-Fertility Problem Stress Scales (COMPI-FPSS)

2021 ◽  
pp. 41-50
Author(s):  
Ladan Ahmad-Amraji ◽  
Fatemeh Jafarzadeh-Kenarsari ◽  
Kobra Abouzari-Gazafroodi ◽  
Ehsan Kazemnezhad Leyli ◽  
Robabeh Soleimani
Keyword(s):  
Cultural Adaptation ◽  
Psychometric Testing ◽  
Validity And Reliability ◽  
Alpha Coefficient ◽  
Cronbach’S Alpha ◽  
Fertility Problem ◽  
Cronbach's Alpha ◽  
Persian Version ◽  
North Of Iran ◽  
Coefficient Omega

Aims: This study was conducted for translation, cultural adaptation, and validation of the Persian version of the Copenhagen multi-centre psychological infertility-fertility problem stress scales (COMPI-FPSS). Study Design: This study was a methodological study. Place and Duration of Study: This research was done in an infertility clinic of an educational hospital in Rasht (north of Iran), from November 2019 to January 2020. Methodology: This study was performed in two phases including tool translation and psychometric testing. Totally, 200 infertile people selected through convenience sampling among subjects met inclusion criteria were included in the study. After obtaining permission from the original tool designer, the COMPI-FPSS (14 items) was translated into Persian using the forward-backward method. Face, content, and construct validity, as well as internal consistency (Cronbach's alpha coefficient and McDonald's coefficient omega) were evaluated, and test-retest was conducted. The data were analyzed using exploratory factor analysis (EFA) by SPSS software Ver. 16. Results: EFA led to retaining of 11 items with 3 factors of “personal domain”, “marital domain”, and “social domain”, which explained 54.42% of the total variance. Cronbach's alpha coefficient for the whole questionnaire was calculated as 0.89; also the overall McDonald's coefficient omega of the questionnaire was equal to 0.82. The correlation between the two test administrations with a 14-day interval was estimated as 0.93. Conclusion: The Persian version of the COMPI-FPSS with 11 items and 3 factors had the desired cultural adaptation, validity, and reliability and it is recommended to use it in the future studies and infertility treatment centers.

scholarly journals At What Sample Size Do Latent Variable Correlations Stabilize?

2018 ◽  
Author(s):  
Andre Kretzschmar ◽  
Gilles Gignac
Keyword(s):  
Monte Carlo Simulation ◽  
Monte Carlo ◽  
Measurement Error ◽  
Latent Variable ◽  
Composite Score ◽  
Sample Sizes ◽  
Population Correlation ◽  
Score Reliability ◽  
Coefficient Omega ◽  
Stable Measurement

We conducted a Monte-Carlo simulation within a latent variable framework by varying the following characteristics: population correlation (ρ = .10, .20, .30, .40, .50, .60, .70, .80, .90, and 1.00) and composite score reliability (coefficient omega: ω = .40, .50, .60, .70, .80, and .90). The sample sizes required to estimate stable measurement-error-free correlations were found to approach N = 490 for typical research scenarios (population correlation ρ = .20; composite score reliability ω = .70) and as high as N = 1,000+ for data associated with lower, but still sometimes observed, reliabilities (ω = .40 to .50). We encourage researchers to take into consideration reliability, when evaluating the sample sizes required to produce stable measurement-error-free correlations.

scholarly journals Utiliser le coefficient omega de McDonald à la place de l’alpha de Cronbach

2018 ◽  
Vol 52 (3) ◽  
pp. 791-804 ◽  
Author(s):  
Sébastien Béland ◽  
Denis Cousineau ◽  
Nathalie Loye
Keyword(s):  
Coefficient Alpha ◽  
Coefficient Omega

Des chercheurs discutaient récemment de l’importance de rester à jour au sujet des plus récentes avancées en méthodes quantitatives. À ce titre, de nombreux auteurs ont exposé leur souhait de voir les chercheurs abandonner le populaire coefficient alpha de Cronbach. C’est dans une optique de diffusion et de vulgarisation que ce court article a comme objectif de présenter l’alternative qui semble la plus prometteuse pour mesurer la fidélité d’un test, le coefficient omega de McDonald, qui est basée sur l’analyse factorielle à un facteur commun.

Sign in / Sign up

Export Citation Format

Share Document