An assessment of the construct validity of the CCSEQ Quality of Effort scales

1996 ◽  
Vol 37 (6) ◽  
pp. 711-730 ◽  
Author(s):  
Corinna A. Ethington ◽  
Tissy B. Polizzi
Keyword(s):  
Construct Validity ◽  
Quality Of Effort

Psychometric evaluation of the Mobile Application Rating Scale (MARS) (Preprint)

2020 ◽  
Author(s):  
Yannik Terhorst ◽  
Paula Philippi ◽  
Lasse Sander ◽  
Dana Schultchen ◽  
Sarah Paganini ◽  
...  
Keyword(s):  
Health Care ◽  
Construct Validity ◽  
Mobile Application ◽  
Concurrent Validity ◽  
Rating Scale ◽  
Psychometric Evaluation ◽  
Confirmatory Factor ◽  
Health Domains ◽  
Psychometric Quality

BACKGROUND Mobile health apps (MHA) have the potential to improve health care. The commercial MHA market is rapidly growing, but the content and quality of available MHA are unknown. Consequently, instruments of high psychometric quality for the assessment of the quality and content of MHA are highly needed. The Mobile Application Rating Scale (MARS) is one of the most widely used tools to evaluate the quality of MHA in various health domains. Only few validation studies investigating its psychometric quality exist with selected samples of MHAs. No study has evaluated the construct validity of the MARS and concurrent validity to other instruments. OBJECTIVE This study evaluates the construct validity, concurrent validity, reliability, and objectivity, of the MARS. METHODS MARS scoring data was pooled from 15 international app quality reviews to evaluate the psychometric properties of the MARS. The MARS measures app quality across four dimensions: engagement, functionality, aesthetics and information quality. App quality is determined for each dimension and overall. Construct validity was evaluated by assessing related competing confirmatory models that were explored by confirmatory factor analysis (CFA). A combination of non-centrality (RMSEA), incremental (CFI, TLI) and residual (SRMR) fit indices was used to evaluate the goodness of fit. As a measure of concurrent validity, the correlations between the MARS and 1) another quality assessment tool called ENLIGHT, and 2) user star-rating extracted from app stores were investigated. Reliability was determined using Omega. Objectivity was assessed in terms of intra-class correlation. RESULTS In total, MARS ratings from 1,299 MHA covering 15 different health domains were pooled for the analysis. Confirmatory factor analysis confirmed a bifactor model with a general quality factor and an additional factor for each subdimension (RMSEA=0.074, TLI=0.922, CFI=0.940, SRMR=0.059). Reliability was good to excellent (Omega 0.79 to 0.93). Objectivity was high (ICC=0.82). The overall MARS rating was positively associated with ENLIGHT (r=0.91, P<0.01) and user-ratings (r=0.14, P<0.01). CONCLUSIONS he psychometric evaluation of the MARS demonstrated its suitability for the quality assessment of MHAs. As such, the MARS could be used to make the quality of MHA transparent to health care stakeholders and patients. Future studies could extend the present findings by investigating the re-test reliability and predictive validity of the MARS.

scholarly journals Determining the psychometric properties of a novel questionnaire to measure “preparedness for the future” (Prep FQ)

2021 ◽  
Vol 19 (1) ◽  
Author(s):  
Daren K. Heyland ◽  
J. Paige Pope ◽  
Xuran Jiang ◽  
Andrew G. Day
Keyword(s):  
Quality Of Life ◽  
Construct Validity ◽  
Health Behaviors ◽  
Psychometric Properties ◽  
Well Being ◽  
High Quality ◽  
The Future ◽  
Quality Of Death ◽  
Test Retest Reliability

Abstract Background People are living longer than ever before. However, with living longer comes increased problems that negatively impact on quality of life and the quality of death. Tools are needed to help individuals assess whether they are practicing the best attitudes and behaviors that are associated with a future long life, high quality of life, high quality of death and a satisfying post-death legacy. The purpose of paper is to describe the process we used to develop a novel questionnaire (“Preparedness for the Future Questionnaire™ or Prep FQ”) and to define its psychometric properties. Methods Using a multi-step development procedure, items were generated, for the new questionnaire after which the psychometric properties were tested with a heterogeneous sample of 502 Canadians. Using an online polling panel, respondents were asked to complete demographic questions as well as the Prep-FQ, Global Rating of Life Satisfaction, the Keyes Psychological Well-Being scale and the Short-Form 12. Results The final version of the questionnaire contains 34 items in 8 distinct domains (“Medico-legal”, “Social”, “Psychological Well-being”, “Planning”, “Enrichment”, “Positive Health Behaviors”, “Negative Health Behaviors”, and “Late-life Planning”). We observed minimum missing data and good usage of all response options. The average overall Prep FQ score is 51.2 (SD = 13.3). The Cronbach alphas assessing internal reliability for the Prep FQ domains ranged from 0.33 to 0.88. The intra-class correlation coefficient (ICC) used to assess the test–retest reliability had an overall score of 0.87. For the purposes of establishing construct validity, all the pre-specified relationships between Prep FQ and the other questionnaires were met. Conclusion Analyses of this novel measure offered support for its face validity, construct validity, test–retest reliability, and internal consistency. With the development of this useful and valid scale, future research can utilize this measure to engage people in the process of comprehensively assessing and improving their state of preparedness for the future, tracking their progress along the way. Ultimately, this program of research aims to improve the quality and quantity of peoples live by helping them ‘think ahead’ and ‘plan ahead’ on the aspects of their daily life that matter to their future.

Examining the Construct Validity of the V-RQOL in Speakers Who Use Alaryngeal Voice

2014 ◽  
Vol 23 (2) ◽  
pp. 196-202 ◽  
Author(s):  
Catherine C. Bornbaum ◽  
Adam M. B. Day ◽  
Philip C. Doyle
Keyword(s):  
Factor Analysis ◽  
Construct Validity ◽  
Total Laryngectomy ◽  
Current Data ◽  
Social Emotional ◽  
Scoring Algorithm ◽  
Two Factors ◽  
Related Quality ◽  
The Voice

Purpose The construct validity of the Voice-Related Quality of Life (V-RQOL; Hogikyan & Sethuraman, 1999) measure was evaluated in a sample of 109 individuals who have undergone total laryngectomy. Method A principal components factor analysis was performed on participant responses to the 10-question V-RQOL measure. Results Factor analysis of the V-RQOL in our alaryngeal sample confirmed the presence of two factors (physical and social–emotional), which is consistent with the identified domains in the current V-RQOL. However, the current data indicate that some of the questions proposed by the original authors of the V-RQOL (Questions 7 and 9) do not align with their proposed domains in this postlaryngectomy sample. Conclusion The results indicate that some V-RQOL questions do not align with their proposed domains. Consequently, an alternative scoring algorithm may be warranted for alaryngeal populations, and the authors make suggestions for this change that are simple and efficient. Based on the findings of the present factor analysis, use of this modified scoring procedure may serve to increase the sensitivity of the V-RQOL for those who are laryngectomized and use alaryngeal methods of voice and speech. Consequently, the value and application of the V-RQOL may be expanded in the clinical setting.

scholarly journals Evaluating the measurement properties of the 26-item Expanded Prostate Cancer Index Composite (EPIC-26) with a multicenter cohort

2019 ◽  
Vol 14 (4) ◽  
Author(s):  
R. Trafford Crump ◽  
Alex Peterson ◽  
Camille Charbonneau ◽  
Kevin V. Carlson ◽  
Jason M. Sutherland ◽  
...  
Keyword(s):  
Quality Of Life ◽  
Prostate Cancer ◽  
Factor Analysis ◽  
Confirmatory Factor Analysis ◽  
Construct Validity ◽  
Localized Prostate Cancer ◽  
Measurement Properties ◽  
Confirmatory Factor ◽  
Ceiling Effects

Introduction: We aimed to evaluate the psychometric properties of the 26-item Expanded Prostate Cancer Index Composite (EPIC-26) for measuring the quality of life in patients treated for localized prostate cancer. The EPIC-26 is a patient-reported outcome instrument recommended for use with patients treated for localized prostate cancer. Methods: This study is based on data collected prospectively between September 2014 and February 2017 in Alberta, Canada. Men were treated with either radical prostatectomy or radiation therapy and administered the EPIC-26. Responses to the EPIC-26 were the primary outcome. Construct validity was measured using confirmatory factor analysis. Reliability was measured using Chronbach’s alpha and item-total correlation. Ceiling and floor effects were also investigated. Results: EPIC-26 response data from 205 participants (prostatectomy =138; radiation=60; both=7) were used in this analysis. The EPIC-26 was administered an average of 33.8 weeks after treatment. The confirmatory factor analysis model did not meet the threshold for adequate fit. Several items had near-zero factor loadings and were non-significant. Four out of the EPIC- 26’s five domains met the acceptable reliability threshold based on Cronbach’s alpha. Ceiling effects were observed in four out of five domains. Conclusions: The EPIC-26 demonstrated poor construct validity, adequate reliability, and large ceiling effects. Several issues were observed, suggesting that the instrument’s five domains were not well-defined by their respective items. The original EPIC’s conceptual framework should be reviewed and the shortened instrument revised to improve its performance for measuring post-treatment quality of life.

The Cerebral Palsy Quality of Life for Children (CP QOL-Child): Evidence of construct validity

2013 ◽  
Vol 34 (3) ◽  
pp. 994-1000 ◽  
Author(s):  
Kuan-Lin Chen ◽  
Hui-Yi Wang ◽  
Mei-Hui Tseng ◽  
Jeng-Yi Shieh ◽  
Lu Lu ◽  
...  
Keyword(s):  
Quality Of Life ◽  
Cerebral Palsy ◽  
Construct Validity

scholarly journals Construct Validity of the Professional Quality of Life (ProQoL) Scale in a Sample of Child Protection Workers

2019 ◽  
Vol 32 (4) ◽  
pp. 566-576 ◽  
Author(s):  
Steve Geoffrion ◽  
Josianne Lamothe ◽  
Julien Morizot ◽  
Charles‐Édouard Giguère
Keyword(s):  
Quality Of Life ◽  
Construct Validity ◽  
Child Protection ◽  
Professional Quality Of Life ◽  
Child Protection Workers ◽  
Professional Quality

Validity of the PROMIS-29 in a large Australian cohort of patients with systemic sclerosis

2017 ◽  
Vol 2 (3) ◽  
pp. 188-195 ◽  
Author(s):  
Kathleen Morrisroe ◽  
Wendy Stevens ◽  
Molla Huq ◽  
Joanne Sahhar ◽  
Gene-Siew Ngian ◽  
...  
Keyword(s):  
Quality Of Life ◽  
Systemic Sclerosis ◽  
Construct Validity ◽  
Short Form ◽  
Good Alternative ◽  
Measurement Information ◽  
Internal Reliability ◽  
Sf 36 ◽  
Patient Reported

Background We aimed to evaluate the construct validity of the Patient-Reported Outcomes Measurement Information System 29 (PROMIS-29) in Australian systemic sclerosis (SSc) patients. Methods SSc patients, identified through the Australian Scleroderma Cohort Study database, completed two quality-of-life instruments concurrently, the PROMIS-29 and the Medical Outcomes Study 36-Item Short Form Health Survey (SF-36). The construct validity of the PROMIS-29 was assessed by the correlations between the PROMIS-29 and the SF-36 and Health Assessment Questionnaire Disability Index (HAQ-DI). Cronbach's alpha was used to test the internal reliability of all instruments in Australian SSc patients and non-parametric correlation, including Spearman's correlation, was used to test the construct validity of PROMIS-29 against the SF-36 and HAQ-DI. Results A total of 477 completed questionnaires were returned, equating to a response rate of 59.6%. The mean (±SD) age of respondents at the time of the survey was 64.1 (±11.1) years. They were predominantly female (87.4%), with limited disease subtype (lcSSc) (77.8%) and long disease duration from onset of first non-Raynaud's phenomenon symptom at the time of survey (10.9 ± 11.1 years). For the correlation analysis between the PROMIS-29 and the legacy instruments, all Spearman correlation coefficients were in the logical direction and highly significant suggesting that the PROMIS-29 is a good alternative to other validated measures of disease burden. Conclusions Our study indicates that the PROMIS-29 questionnaire is a valid instrument for measuring health-related quality of life in Australian females with lcSSc of long duration.

Sign in / Sign up

Export Citation Format

Share Document