scholarly journals Rasch analysis of the Persian version of PedsQLTMOral Health Scale: further psychometric evaluation on item validity including differential item functioning

2016 ◽  
Vol 6 (3) ◽  
pp. 145-151 ◽  
Author(s):  
Chung-Ying Lin ◽  
Santhosh Kumar ◽  
Amir H. Pakpour
2013 ◽  
Vol 93 (11) ◽  
pp. 1507-1519 ◽  
Author(s):  
Clayon B. Hamilton ◽  
Bert M. Chesworth

Background The original 20-item Upper Extremity Functional Index (UEFI) has not undergone Rasch validation. Objective The purpose of this study was to determine whether Rasch analysis supports the UEFI as a measure of a single construct (ie, upper extremity function) and whether a Rasch-validated UEFI has adequate reproducibility for individual-level patient evaluation. Design This was a secondary analysis of data from a repeated-measures study designed to evaluate the measurement properties of the UEFI over a 3-week period. Methods Patients (n=239) with musculoskeletal upper extremity disorders were recruited from 17 physical therapy clinics across 4 Canadian provinces. Rasch analysis of the UEFI measurement properties was performed. If the UEFI did not fit the Rasch model, misfitting patients were deleted, items with poor response structure were corrected, and misfitting items and redundant items were deleted. The impact of differential item functioning on the ability estimate of patients was investigated. Results A 15-item modified UEFI was derived to achieve fit to the Rasch model where the total score was supported as a measure of upper extremity function only. The resultant UEFI-15 interval-level scale (0–100, worst to best state) demonstrated excellent internal consistency (person separation index=0.94) and test-retest reliability (intraclass correlation coefficient [2,1]=.95). The minimal detectable change at the 90% confidence interval was 8.1. Limitations Patients who were ambidextrous or bilaterally affected were excluded to allow for the analysis of differential item functioning due to limb involvement and arm dominance. Conclusion Rasch analysis did not support the validity of the 20-item UEFI. However, the UEFI-15 was a valid and reliable interval-level measure of a single dimension: upper extremity function. Rasch analysis supports using the UEFI-15 in physical therapist practice to quantify upper extremity function in patients with musculoskeletal disorders of the upper extremity.


2016 ◽  
Vol 46 (4) ◽  
pp. 462-476 ◽  
Author(s):  
Jacobus G Maree ◽  
Nicola Taylor

In this article, the authors report on the development of an interest inventory (the Maree Career Matrix) for South Africans with a minimum of Grade 9 second language English or Afrikaans proficiency. The instrument was completed by 1106 learners in Grade 11 in the Gauteng, Mpumalanga, and North West provinces of South Africa. Rasch analysis was done; inter-category correlations, reliability coefficients, and differential item functioning values were calculated; and validity and norm tables were established. We concluded that the Maree Career Matrix is easy to use and has good psychometric qualities, takes relatively little time to administer, provides reliable and valid results, is standardised, and can be applied to large groups with relative ease. Additional research is needed to gather data on the profiles of people in other age brackets and to trace their progress, the aim being to further investigate and enhance the predictive value of the Maree Career Matrix.


2021 ◽  
Vol 50 (Supplement_1) ◽  
Author(s):  
Jessica Stanhope ◽  
Philip Weinstein

Abstract Background Pain is often measured by asking people to rate their pain intensity at its worst, on average, and at its least, for the last 7 days using numeric rating scales. The three ratings are summed to produce a composite measure. The validity and reliability of this composite measure has not been examined using modern psychometric methods in any population. We examined the validity and reliability of this pain intensity measure for use with professional musicians, university music and science students, and university staff, all of whom had reported experiencing musculoskeletal symptoms in the last 7 days. Methods Data were collected using a questionnaire survey. The validity and reliability of the composite pain measure were examined using Rasch analysis. Differential item functioning was examined for age, gender, student status, musician status, and socioeconomic status. Results While the data fit one of the Rasch models, after several response categories were collapsed, differential item functioning was present. There was no solution found that fit one of the Rasch models, without differential item functioning. Conclusions Despite the recommendation for the three number ratings scales for pain to be combined, using Rasch analysis showed that this was not a valid approach for our study population. Our findings highlight the importance of using Rasch analysis to examine the utility of measures. Key messages Rasch analysis is a useful method for investigating the validity and reliability of scales. Combining pain ratings cannot be assumed to produce a valid and reliable measure.


2019 ◽  
Vol 31 (9) ◽  
pp. 1331-1341 ◽  
Author(s):  
Ashish Goel ◽  
Alden Gross

ABSTRACTIntroduction:The Longitudinal Aging Study in India (LASI) was initiated to capture data to be comparable to the Health and Retirement Survey (HRS) and hence used study instruments from the HRS. However, a rigorous psychometric evaluation before adaptation of cognitive tests may have indicated bias due to diversities across Indian states such as education, ethnicity, and urbanicity. In the present analysis, we evaluated if items show differential item functioning (DIF) by literacy, urbanicity, and education status.Methods:We calculated proportions for each item and weighted descriptive statistics of demographic characteristics in LASI. Next, we evaluated item-level measurement differences by testing for DIF using the alignment approach implemented using Mplus software.Observation:We found that cognitive items in the LASI interview demonstrate bias by education and literacy, but not urbanicity. Items relating to animal (word) fluency show DIF. The model rates correct identification of the prime minister as the most difficult binary response item whereas the day of the week and numeracy items are rated comparatively easier.Conclusions:Our study would facilitate comparison across education, literacy and urbancity to support analyses of differences in cognitive status. This would help future instrument development efforts by recognizing potentially problematic items in certain subgroups.


2021 ◽  
Vol 11 ◽  
Author(s):  
Amy Shaw ◽  
Jennifer J. Zhang

The present study analyses the psychometric properties of the irrational procrastination scale (IPS; Steel, 2002, 2010) in a sample of United States college students using the Rasch modeling approach. Results showed that the IPS items had a high level of reliability, good content validity, structural validity, and substantive validity, and no differential item functioning (DIF) effects in terms of gender. The IPS was found to be unidimensional, supporting the originally proposed theoretical structure by Steel (2002, 2010). Finally, psychometric implications derived from the results and study limitations are discussed; recommendations for future investigations are also offered.


2021 ◽  
pp. 026921552110621
Author(s):  
Antonio Caronni ◽  
Michela Picardi ◽  
Valentina Redaelli ◽  
Paola Antoniotti ◽  
Giuseppe Pintavalle ◽  
...  

Objective To test with the Rasch analysis the psychometric properties of the Falls Efficacy Scale International, a questionnaire for measuring concern about falling. Design Longitudinal observational study, before–after rehabilitation. Setting Inpatient rehabilitation. Subjects A total of 251 neurological patients with balance impairment. Interventions Physiotherapy and occupational therapy aimed at reducing the risk of falling. Main measures Participants (median age, first–third quartile: 74.0, 65.5–80.5 years; stroke and polyneuropathy: 43% and 21% of the sample, respectively) received a balance assessment (Falls Efficacy Scale International included) pre- and post-rehabilitation. Rasch analysis was used to evaluate the Falls Efficacy Scale International. Differential item functioning, which assesses the measures’ stability in different conditions (e.g. before vs. after treatment) and in different groups of individuals, was tested for several variables. Results Patients suffered a moderate balance impairment (Mini-BESTest median score; first–third quartile: 15; 11–19), mild–moderate concern about falling (Falls Efficacy Scale International: 28; 21–37) and motor disability (Functional Independence Measure, motor domain: 70.0; 57.0–76.5). Falls Efficacy Scale International items fitted the Rasch model (range of infit and outfit mean square statistics: 0.8–1.32 and 0.71–1.45, respectively) and the questionnaire's reliability was satisfactory (0.87). No differential item functioning was found for treatment, gender, age and balance impairment. Differential item functioning was found for diagnosis and disability severity, but it is shown that it is not such as to bias measures. Conclusions Falls Efficacy Scale International ordinal scores can be turned into interval measures, i.e. measures of the type of temperature. Being differential item functioning-free for treatment, these measures can be safely used to compare concern about falling before and after rehabilitation, such as when interested in assessing the rehabilitation effectiveness.


2013 ◽  
Vol 21 (spe) ◽  
pp. 163-171
Author(s):  
Erika de Souza Guedes ◽  
Luiz Carlos Orozco-Vargas ◽  
Ruth Natália Teresa Turrini ◽  
Regina Márcia Cardoso de Sousa ◽  
Mariana Alvina dos Santos ◽  
...  

OBJECTIVES: the objective of this study was to evaluate the items contained in the Brazilian version of the Power as Knowing Participation in Change Tool (PKPCT). METHOD: investigation of the psychometric properties of the mentioned questionnaire through Rasch analysis. RESULTS: the data from 952 nursing assistants and 627 baccalaureate nurses were analyzed (average age 44.1 (SD=9.5); 13.0% men). The subscales Choices, Awareness, Freedom and Involvement were tested separately and presented unidimensionality; the categories of the responses given to the items were compiled from 7 to 3 levels and the items fit the model well, except for the following/leading item, in which the infit and outfit values were above 1.4; this item has also presented Differential Item Functioning (DIF) according to the participant's role. The reliability of the items was of 0.99 and the reliability of the participants ranged from 0.80 to 0.84 in the subscales. Items with extremely high levels of difficulty were not identified. CONCLUSIONS: the PKPCT should not be viewed as unidimensional, items with extremely high levels of difficulty in the scale need to be created and the differential functioning of some items has to be further investigated.


Sign in / Sign up

Export Citation Format

Share Document