scholarly journals A Rasch Analysis of the Irrational Procrastination Scale (IPS)

2021 ◽  
Vol 11 ◽  
Author(s):  
Amy Shaw ◽  
Jennifer J. Zhang
Keyword(s):  
United States ◽  
College Students ◽  
Psychometric Properties ◽  
Differential Item Functioning ◽  
Content Validity ◽  
Rasch Analysis ◽  
Structural Validity ◽  
Theoretical Structure ◽  
Item Functioning ◽  
High Level

The present study analyses the psychometric properties of the irrational procrastination scale (IPS; Steel, 2002, 2010) in a sample of United States college students using the Rasch modeling approach. Results showed that the IPS items had a high level of reliability, good content validity, structural validity, and substantive validity, and no differential item functioning (DIF) effects in terms of gender. The IPS was found to be unidimensional, supporting the originally proposed theoretical structure by Steel (2002, 2010). Finally, psychometric implications derived from the results and study limitations are discussed; recommendations for future investigations are also offered.

scholarly journals Rasch Analysis of the Power as Knowing Participation in Change Tool - the Brazilian version

2013 ◽  
Vol 21 (spe) ◽  
pp. 163-171
Author(s):  
Erika de Souza Guedes ◽  
Luiz Carlos Orozco-Vargas ◽  
Ruth Natália Teresa Turrini ◽  
Regina Márcia Cardoso de Sousa ◽  
Mariana Alvina dos Santos ◽  
...  
Keyword(s):  
Psychometric Properties ◽  
Differential Item Functioning ◽  
Rasch Analysis ◽  
Nursing Assistants ◽  
Differential Functioning ◽  
Item Functioning ◽  
Brazilian Version ◽  
Baccalaureate Nurses

OBJECTIVES: the objective of this study was to evaluate the items contained in the Brazilian version of the Power as Knowing Participation in Change Tool (PKPCT). METHOD: investigation of the psychometric properties of the mentioned questionnaire through Rasch analysis. RESULTS: the data from 952 nursing assistants and 627 baccalaureate nurses were analyzed (average age 44.1 (SD=9.5); 13.0% men). The subscales Choices, Awareness, Freedom and Involvement were tested separately and presented unidimensionality; the categories of the responses given to the items were compiled from 7 to 3 levels and the items fit the model well, except for the following/leading item, in which the infit and outfit values were above 1.4; this item has also presented Differential Item Functioning (DIF) according to the participant's role. The reliability of the items was of 0.99 and the reliability of the participants ranged from 0.80 to 0.84 in the subscales. Items with extremely high levels of difficulty were not identified. CONCLUSIONS: the PKPCT should not be viewed as unidimensional, items with extremely high levels of difficulty in the scale need to be created and the differential functioning of some items has to be further investigated.

Internal validity of the revised HiMAT for people with neurological conditions

2011 ◽  
Vol 26 (8) ◽  
pp. 741-747 ◽  
Author(s):  
Gavin Williams ◽  
Bridget Hill ◽  
Julie F Pallant ◽  
Ken Greenwood
Keyword(s):  
Traumatic Brain Injury ◽  
Brain Injury ◽  
Differential Item Functioning ◽  
Rasch Analysis ◽  
Assessment Tool ◽  
Internal Validity ◽  
Mobility Limitations ◽  
Item Functioning ◽  
Neurological Conditions ◽  
High Level

Objective: The High-level Mobility Assessment Tool (HiMAT) was developed to measure high-level mobility limitations following traumatic brain injury. The aim of this study was to investigate if the revised HiMAT is valid for use with adults with neurological conditions other than traumatic brain injury. Design: Cross-sectional study. Subjects: Ninety-five participants with neurological conditions. Methods: HiMAT score sheets were retrieved from the central medical files of people who had attended a major rehabilitation facility for a neurological condition from January 2006 to October 2007. Additional HiMAT score sheets were submitted by therapists who participated in the HiMAT User’s Group. Rasch analysis (RUMM2030 software) was used to determine the overall fit of the model, individual item fit and differential item functioning. Results: Rasch analysis supported the internal validity of the revised eight-item HiMAT for individuals with neurological conditions. It showed good overall fit ( P = 0.74), no misfitting items and excellent internal consistency (Person Separation Index = 0.91). The HiMAT is unidimensional with no evidence of response dependency and no differential item functioning for age or sex. Conclusion: Further development of the revised HiMAT is required to investigate other aspects of validity, reliability and responsiveness in different neurological populations. However, the results support the internal validity of the revised HiMAT when used for people with neurological conditions who are able to walk without gait aids.

scholarly journals Psychometric properties of a condition-specific PROM for the psychosocial consequences of Labelling hypertension by using Rasch analysis

2021 ◽  
Vol 5 (1) ◽  
Author(s):  
János Valery Gyuricza ◽  
Karl Bang Christensen ◽  
Ana Flávia Pires Lucas d’Oliveira ◽  
John Brodersen
Keyword(s):  
Psychometric Properties ◽  
Rasch Model ◽  
Content Validity ◽  
Model Analysis ◽  
Qualitative Assessment ◽  
Future Research ◽  
Item Pool ◽  
Measurement Models ◽  
Item Functioning ◽  
Psychosocial Consequences

Abstract Background A previous qualitative assessment of the psychosocial consequences of labelling hypertension describes the diagnosis of hypertension as a labelling event with potential unintended negative long-term psychosocial consequences (labelling effects). Until now, the benefits of diagnosing hypertension have been far more reported than the harms. To obtain the net result of the preventive interventions for cardiovascular disease, such as diagnosing and treating mild hypertension, assessing benefits and harms in the most comprehensive way possible is necessary, including the psychosocial consequences of labelling. When measuring psychosocial consequences of labelling hypertension, a questionnaire with high content validity and adequate psychometric properties is needed. Objectives The aim of this study was to describe the psychometric parameters of face and content-validated pool of items. Other objectives were also to screen the item pool by using Rasch model analysis and confirmatory factor analysis (CFA) for identifying such items with sufficient fit to the hypothesised models. Methods We surveyed the pool of items as a draft questionnaire to Brazilians recruited via social networks, sending e-mails, WhatsApp® messages and posting on Facebook®. The inclusion criteria were to be older than 18 years old, to be healthy and to have only hypertension. We used Rasch model analysis to screen the item pool, discarding items that did not fit the hypothesised domain. We searched for local dependence and differential item functioning. We used CFA to confirm the derived measurement models and complementarily assessed reliability using Cronbach’s coefficient alpha. Results The validation sample consisted of 798 respondents. All 798 respondents completed Part I, whereas 285 (35.7%)—those with hypertension—completed Part II. A condition-specific questionnaire with high content validity and adequate psychometric properties was developed for people labelled with hypertension. This measure is called ‘Consequences of Labelling Hypertension Questionnaire’ and covers the psychosocial consequences of labelling hypertension in two parts, encompassing a total of 71 items in 15 subscales and 11 single items. Conclusion We developed a tool that can be used in future research involving hypertension, especially in scenarios of screening, prevention, population strategies and in intervention studies. Future use and testing of the questionnaire may still be required.

scholarly journals Development and psychometric properties of the Caring Behaviors Assessment Tool Nursing Version-Short Form

2020 ◽  
Vol 32 (10) ◽  
pp. 701-707
Author(s):  
Mehtap Akgün ◽  
Selma Turan Kavradim ◽  
İlkay Boz ◽  
Zeynep Özer
Keyword(s):  
Psychometric Properties ◽  
Root Mean Square ◽  
Internal Consistency ◽  
Content Validity ◽  
Assessment Tool ◽  
Short Form ◽  
Mean Square ◽  
Structural Validity ◽  
Caring Behaviors ◽  
Fit Index

Abstract Objectives To develop and examine the psychometric properties of the Caring Behaviors Assessment Tool Nursing Version-Short Form (CBAN-SF) based on the Theory of Human Caring to assess the nurses’ perceptions about caring behaviors. Design This study is based on the Consensus-based Standards for the Selection of Health Measurement Instruments checklist. Setting The study was conducted at the medical-surgical services of Akdeniz University Hospital between October 2019 and January 2020. Participants This study was conducted with 216 nurses working in the surgery and internal clinics. Main Outcome Measures Psychometric properties of the Turkish version of the CBAN-SF with 27 items. Results It was found that the Content Validity Index (CVI) for the items of the draft scale was between 0.972 and 1.00 and the instrument’s CVI had an average score of 0.994. The CBAN-SF had good fit indexes (chi-square goodness of fit / degrees of freedom = 2.914, root mean square error of approximation = 0.075, comparative fit index = 0.984, non-normed fit index = 0.983, normed fit index = 0.972 and standardized root mean square residuals = 0.054) in structural validity. For internal consistency, the Cronbach’s alpha, Spearman–Brown and the Guttman split-half coefficients were all 0.974. The Cronbach’s alpha coefficient for the seven subfactors of the scale ranged between 0.793 and 0.904 and had acceptable internal consistency. The item-total score correlation of the scale was 0.648–0.829, and the factor loadings were 0.455–0.769. Conclusion The structural validity, internal consistency and content validity of the CBAN-SF supported to be a reliable and valid tool for assessment of caring behaviors by nurses.

scholarly journals A Rasch-Validated Version of the Upper Extremity Functional Index for Interval-Level Measurement of Upper Extremity Function

2013 ◽  
Vol 93 (11) ◽  
pp. 1507-1519 ◽  
Author(s):  
Clayon B. Hamilton ◽  
Bert M. Chesworth
Keyword(s):  
Differential Item Functioning ◽  
Upper Extremity ◽  
Rasch Model ◽  
Rasch Analysis ◽  
Measurement Properties ◽  
Functional Index ◽  
Extremity Function ◽  
Item Functioning ◽  
Upper Extremity Function ◽  
The Rasch Model

Background The original 20-item Upper Extremity Functional Index (UEFI) has not undergone Rasch validation. Objective The purpose of this study was to determine whether Rasch analysis supports the UEFI as a measure of a single construct (ie, upper extremity function) and whether a Rasch-validated UEFI has adequate reproducibility for individual-level patient evaluation. Design This was a secondary analysis of data from a repeated-measures study designed to evaluate the measurement properties of the UEFI over a 3-week period. Methods Patients (n=239) with musculoskeletal upper extremity disorders were recruited from 17 physical therapy clinics across 4 Canadian provinces. Rasch analysis of the UEFI measurement properties was performed. If the UEFI did not fit the Rasch model, misfitting patients were deleted, items with poor response structure were corrected, and misfitting items and redundant items were deleted. The impact of differential item functioning on the ability estimate of patients was investigated. Results A 15-item modified UEFI was derived to achieve fit to the Rasch model where the total score was supported as a measure of upper extremity function only. The resultant UEFI-15 interval-level scale (0–100, worst to best state) demonstrated excellent internal consistency (person separation index=0.94) and test-retest reliability (intraclass correlation coefficient [2,1]=.95). The minimal detectable change at the 90% confidence interval was 8.1. Limitations Patients who were ambidextrous or bilaterally affected were excluded to allow for the analysis of differential item functioning due to limb involvement and arm dominance. Conclusion Rasch analysis did not support the validity of the 20-item UEFI. However, the UEFI-15 was a valid and reliable interval-level measure of a single dimension: upper extremity function. Rasch analysis supports using the UEFI-15 in physical therapist practice to quantify upper extremity function in patients with musculoskeletal disorders of the upper extremity.

Correction of Differentially Functioning Items: Basis for Maintaining and Enhancing Test Validity and Reliability

2016 ◽  
Vol 4 (1) ◽  
pp. 62
Author(s):  
Jose Q. Pedrajita
Keyword(s):  
Differential Item Functioning ◽  
Internal Consistency ◽  
Private School ◽  
Content Validity ◽  
Test Scores ◽  
Concurrent Validity ◽  
Test Validity ◽  
Internal Consistency Reliability ◽  
School Type ◽  
Item Functioning

This study looked into differentially functioning items in a Chemistry Achievement Test. It also<br />examined the effect of eliminating differentially functioning items on the content and concurrent validity,<br />and internal consistency reliability of the test. Test scores of two hundred junior high school students<br />matched on school type were subjected to Differential Item Functioning (DIF) analysis. One hundred<br />students came from a public school, while the other 100 were private school examinees. The<br />descriptive-comparative research design utilizing differential item functioning analysis and validity and<br />reliability analysis was employed. The Chi-Square, Distractor Response Analysis, Logistic Regression,<br />and the Mantel-Haenszel Statistic were the methods used in the DIF analysis. A six-point scale ranging<br />from inadequate to adequate was used to assess the content validity of the test. Pearson r was used in<br />the concurrent validity analysis. The KR-20 formula was used for estimating the internal consistency<br />reliability of the test. The findings revealed the presence of differentially functioning items between the<br />public and private school examinees. The DIF methods differed in the number of differentially<br />functioning items identified. However, there was a high degree of correspondence between the Logistic<br />Regression and Mantel-Haenszel Statistic. After the elimination of the differentially functioning items,<br />the content and the concurrent validity, and the internal consistency reliability differed per DIF method<br />used. The content validity of the test differed ranging from slightly adequate to moderately adequate in<br />the number of items retained. The concurrent validity of the test also differed but all were positive and<br />indicate moderate relationship between the examinees’ test scores and their GPA in Science III.<br />Likewise, the internal consistency reliability of the test differed. The more differentially functioning<br />items eliminated, the lesser was the content and concurrent validity, and internal consistency reliability<br />of the test becomes. Elimination of differentially functioning items diminishes content and concurrent<br />validity, and internal consistency reliability, but could be use as basis in enhancing content, concurrent<br />as well as internal consistency reliability by replacing eliminated DIF items.

scholarly journals A Mokken scale analysis of the Kessler-6 screening measure among Chinese older population: findings from a national survey

2020 ◽  
Vol 20 (1) ◽  
Author(s):  
Lisong Zhang ◽  
Zhongquan Li
Keyword(s):  
Psychological Distress ◽  
Psychometric Properties ◽  
Differential Item Functioning ◽  
Scale Analysis ◽  
Older Population ◽  
Old Chinese ◽  
Mokken Scale Analysis ◽  
Screening Measure ◽  
Item Functioning ◽  
Public Data

Abstract Background The aging population increases rapidly across the world. Timely and effective screening of their mental-health problems is important to individuals, families, and the whole society. The Kessler-6 screening measure (K6) is a very popular instrument for non-specific psychological distress. However, few studies have focused on the psychometric properties of this instrument in the older population. Methods The present study employed Mokken scale analysis to evaluate its dimensionality and structure. This study also used differential item functioning (DIF) to examine whether the same structure existed across sex in a national representative sample of old Chinese people. Data were drawn from a public data set, the 2010 China Family Panel Studies (CFPS2010), and responses from a total of 6450 participants aged 60 years old and above (3136 males and 3314 females) were included in the final analysis. Results Mokken scale analysis supported the unidimensional structure of the K6. Differential item functioning (DIF) analysis revealed that two of the six items (“Hopeless” and “Everything was an effort”) were marked for DIF based on the Chi-square. However, their impacts were negligible in terms of McFadden’s pseudo R2. Conclusions The K6 demonstrates adequate psychometric properties in the old Chinese population. The sum of all six items can be used as an indicator of non-specific psychological distress. Differences in the indicator across sex should be considered as a real difference in psychological distress between the female and the male.

scholarly journals Structural validity of the Boston Carpal Tunnel Questionnaire and its short version, the 6-Item CTS symptoms scale: a Rasch analysis one year after surgery

2020 ◽  
Vol 21 (1) ◽  
Author(s):  
Juhani Multanen ◽  
Jari Ylinen ◽  
Teemu Karjalainen ◽  
Joona Ikonen ◽  
Arja Häkkinen ◽  
...  
Keyword(s):  
Carpal Tunnel Syndrome ◽  
Differential Item Functioning ◽  
Carpal Tunnel ◽  
Response Category ◽  
Structural Validity ◽  
Item Functioning ◽  
Boston Carpal Tunnel Questionnaire ◽  
Tunnel Syndrome ◽  
Ordered Response ◽  
Carpal Tunnel Questionnaire

Abstract Background The Boston Carpal Tunnel Questionnaire (BCTQ) and its shorter version, the Six-Item Carpal Tunnel Symptoms Scale (CTS-6), are widely used for assessing function and/or symptoms in patients with carpal tunnel syndrome. This study examined the structural validity of the BCTQ and CTS-6 among patients who had undergone surgery for treatment of carpal tunnel syndrome. Methods The data for this cross-sectional analysis were obtained from 217 adult patients who had undergone carpal tunnel release surgery 1 year earlier. All patients completed the CTS-6, Symptom Severity Scale (SSS) and Functional Status Scale (FSS) of the BCTQ at 12 months after surgery. The Rasch Measurement Theory (RMT) was applied to investigate the unidimensionality, residual correlation, differential item functioning, scale coverage/targeting, and person separation of the CTS-6, SSS and FSS of the BCTQ. Results The FSS showed unidimensionality and good scale and item fit. All items showed ordered response category thresholds. Eight of the FSS items displayed differential item functioning favoring age or gender. The multidimensional structure of the CTS-6 was absorbed by creating a testlet for frequency of symptoms or testlets for pain and numbness. The testlets supported unidimensionality in the BCTQ SSS. One item in the CTS-6 and two items in the BCTQ SSS showed differential item functioning favoring age or gender. Four items in the BCTQ SSS and two items in the CTS-6 exhibited disordered response category thresholds. Merging of the relevant response categories led to ordered response category thresholds. The person separation indices were 0.73, 0.86 and 0.77 for the CTS-6, BCTQ SSS and FSS, respectively. Conclusions Based on the RMT analysis, the CTS-6 has superior psychometric properties compared to the BCTQ SSS in surgically treated patients. The CTS-6 might be more accurate when separated into item sets measuring pain or numbness. The FSS of the BCTQ has acceptable construct validity, although gender differences at some ages were observed in responses.

Sign in / Sign up

Export Citation Format

Share Document