Item Response Theory Analysis of the Big Five Questionnaire for Children–Short Form (BFC-SF): A Self-Report Measure of Personality in Children Aged 11–12 Years

2020 ◽  
Vol 34 (1) ◽  
pp. 40-63 ◽  
Author(s):  
Miles Bore ◽  
Kristin R. Laurens ◽  
Megan J. Hobbs ◽  
Melissa J. Green ◽  
Stacy Tzoumakis ◽  
...  
Keyword(s):  
Item Response Theory ◽  
Psychometric Properties ◽  
Item Response ◽  
Big Five ◽  
Short Form ◽  
Self Report ◽  
Big Five Personality ◽  
Response Theory ◽  
Personality Dimensions ◽  
Report Measure

Prior investigations indicate that the five core personality dimensions (the “Big Five”) are measurable by middle childhood. The aim of this research was to examine the psychometric properties of a short-form self-report measure of the Big Five personality dimensions in children that would be suitable for administration online in large population-based studies. Twenty-five questionnaire items in English, derived from the 65-item Big Five Questionnaire for Children in Italian (Barbaranelli, Caprara, Rabasca, & Pastorelli, 2003), were completed online by 27,415 Australian children in Year 6 (mean age 11.92 years). An item response theory approach evaluated the psychometric properties and resolved a 20-item short-form questionnaire. Exploratory and confirmatory factor analyses supported the Big Five structure. Construct validity was demonstrated via correlations between Big Five scores and the Strengths and Difficulties Questionnaire subscales (Goodman, 2001). The 20 items provide a brief, reliable, and valid child self-report measure of the Big Five personality dimensions.

Geriatric Anxiety Scale: item response theory analysis, differential item functioning, and creation of a ten-item short form (GAS-10)

2014 ◽  
Vol 27 (7) ◽  
pp. 1099-1111 ◽  
Author(s):  
Anne E. Mueller ◽  
Daniel L. Segal ◽  
Brandon Gavett ◽  
Meghan A. Marty ◽  
Brian Yochim ◽  
...  
Keyword(s):  
Older Adults ◽  
Item Response Theory ◽  
Psychometric Properties ◽  
Differential Item Functioning ◽  
Item Response ◽  
Short Form ◽  
Anxiety Scale ◽  
Response Theory ◽  
Item Functioning ◽  
The Impact

ABSTRACTBackground:The Geriatric Anxiety Scale (GAS; Segal et al. (Segal, D. L., June, A., Payne, M., Coolidge, F. L. and Yochim, B. (2010). Journal of Anxiety Disorders, 24, 709–714. doi:10.1016/j.janxdis.2010.05.002) is a self-report measure of anxiety that was designed to address unique issues associated with anxiety assessment in older adults. This study is the first to use item response theory (IRT) to examine the psychometric properties of a measure of anxiety in older adults.Method:A large sample of older adults (n = 581; mean age = 72.32 years, SD = 7.64 years, range = 60 to 96 years; 64% women; 88% European American) completed the GAS. IRT properties were examined. The presence of differential item functioning (DIF) or measurement bias by age and sex was assessed, and a ten-item short form of the GAS (called the GAS-10) was created.Results:All GAS items had discrimination parameters of 1.07 or greater. Items from the somatic subscale tended to have lower discrimination parameters than items on the cognitive or affective subscales. Two items were flagged for DIF, but the impact of the DIF was negligible. Women scored significantly higher than men on the GAS and its subscales. Participants in the young-old group (60 to 79 years old) scored significantly higher on the cognitive subscale than participants in the old-old group (80 years old and older).Conclusions:Results from the IRT analyses indicated that the GAS and GAS-10 have strong psychometric properties among older adults. We conclude by discussing implications and future research directions.

scholarly journals Psychometric evaluation of an Italian custom 4-item short form of the PROMIS anxiety item bank in immune-mediated inflammatory diseases: an item response theory analysis

PeerJ ◽  
2021 ◽  
Vol 9 ◽  
pp. e12100
Author(s):  
Marco Tullio Liuzza ◽  
Rocco Spagnuolo ◽  
Gabriella Antonucci ◽  
Rosa Daniela Grembiale ◽  
Cristina Cosco ◽  
...  
Keyword(s):  
Item Response Theory ◽  
Psychometric Properties ◽  
Item Response ◽  
Inflammatory Diseases ◽  
Short Form ◽  
Latent Trait ◽  
Test Reliability ◽  
Control Group ◽  
Response Theory ◽  
Patient Reported

Background There has recently been growing interest in the roles of inflammation in contributing to the development of anxiety in people with immune-mediated inflammatory diseases (IMID). Patient-reported outcome measures can facilitate the assessment of physical and psychological functioning. The National Institutes of Health (NIH)’s Patient-Reported Outcomes Measurement Information System (PROMIS®) is a set of Patient-Reported Outcomes (PROs) that cover physical appearance, mental health, and social health. The PROMIS has been built through an Item Response Theory approach (IRT), a model-based measurement in which trait level estimates depend on both persons’ responses and on the properties of the items that were administered. The aim of this study is to test the psychometric properties of an Italian custom four-item Short Form of the PROMIS Anxiety item bank in a cohort of outpatients with IMIDs. Methods We selected four items from the Italian standard Short Form Anxiety 8a and administered them to consecutive outpatients affected by Inflammatory Bowel disease (n = 246), rheumatological (n = 100) and dermatological (n = 43) diseases, and healthy volunteers (n = 280). Data was analyzed through an Item Response Theory (IRT) analysis in order to evaluate the psychometric properties of the Italian adaptation of the PROMIS anxiety short form. Results Taken together, Confirmatory Factor Analysis and Exploratory Factor analysis suggest that the unidimensionality assumption of the instrument holds. The instrument has excellent reliability from a Classical Theory of Test (CTT) standpoint (Cronbach’s α = 0.93, McDonald’s ω = 0.92). The 2PL Graded Response Model (GRM) model provided showed a better goodness of fit as compared to the 1PL GRM model, and local independence assumption appears to be met overall. We did not find signs of differential item functioning (DIF) for age and gender, but evidence for uniform (but not non-uniform) DIF was found in three out of four items for the patient vs. control group. Analysis of the test reliability curve suggested that the instrument is most reliable for higher levels of the latent trait of anxiety. The groups of patients exhibited higher levels of anxiety as compared to the control group (ps < 0.001, Bonferroni-corrected). The groups of patients were not different between themselves (p = 1, Bonferroni-corrected). T-scores based on estimated latent trait and raw scores were highly correlated (Pearson’s r = 0.98) and led to similar results. Discussion The Italian custom four-item short form from the PROMIS anxiety form 8a shows acceptable psychometric properties both from a CTT and an IRT standpoint. The Test Reliability Curve shows that this instrument is mostly informative for people with higher levels of anxiety, making it particularly suitable for clinical populations such as IMID patients.

Evaluation of the Psychometric Properties of the Asian Adolescent Depression Scale and Construction of a Short Form: An Item Response Theory Analysis

Assessment ◽  
2015 ◽  
Vol 24 (5) ◽  
pp. 660-676 ◽  
Author(s):  
Barbara Chuen Yee Lo ◽  
Yue Zhao ◽  
Alice Wai Yee Kwok ◽  
Wai Chan ◽  
Calais Kin Yuen Chan
Keyword(s):  
Item Response Theory ◽  
Psychometric Properties ◽  
Item Response ◽  
Adolescent Depression ◽  
Depressive Symptomatology ◽  
Short Form ◽  
Depression Scale ◽  
Response Theory ◽  
Item Response Theory Analysis ◽  
Full Form

The present study applied item response theory to examine the psychometric properties of the Asian Adolescent Depression Scale and to construct a short form among 1,084 teenagers recruited from secondary schools in Hong Kong. Findings suggested that some items of the full form reflected higher levels of severity and were more discriminating than others, and the Asian Adolescent Depression Scale was useful in measuring a broad range of depressive severity in community youths. Differential item functioning emerged in several items where females reported higher depressive severity than males. In the short form construction, preliminary validation suggested that, relative to the 20-item full form, our derived short form offered significantly greater diagnostic performance and stronger discriminatory ability in differentiating depressed and nondepressed groups, and simultaneously maintained adequate measurement precision with a reduced response burden in assessing depression in the Asian adolescents. Cultural variance in depressive symptomatology and clinical implications are discussed.

scholarly journals Item Response Theory, Computerized Adaptive Testing, and PROMIS: Assessment of Physical Function

2013 ◽  
Vol 41 (1) ◽  
pp. 153-158 ◽  
Author(s):  
James F. Fries ◽  
James Witter ◽  
Matthias Rose ◽  
David Cella ◽  
Dinesh Khanna ◽  
...  
Keyword(s):  
Item Response Theory ◽  
Physical Function ◽  
Item Response ◽  
Computerized Adaptive Testing ◽  
Short Form ◽  
Adaptive Testing ◽  
Self Report ◽  
Measurement Information ◽  
Response Theory ◽  
Patient Reported

Objective.Patient-reported outcome (PRO) questionnaires record health information directly from research participants because observers may not accurately represent the patient perspective. Patient-reported Outcomes Measurement Information System (PROMIS) is a US National Institutes of Health cooperative group charged with bringing PRO to a new level of precision and standardization across diseases by item development and use of item response theory (IRT).Methods.With IRT methods, improved items are calibrated on an underlying concept to form an item bank for a “domain” such as physical function (PF). The most informative items can be combined to construct efficient “instruments” such as 10-item or 20-item PF static forms. Each item is calibrated on the basis of the probability that a given person will respond at a given level, and the ability of the item to discriminate people from one another. Tailored forms may cover any desired level of the domain being measured. Computerized adaptive testing (CAT) selects the best items to sharpen the estimate of a person’s functional ability, based on prior responses to earlier questions. PROMIS item banks have been improved with experience from several thousand items, and are calibrated on over 21,000 respondents.Results.In areas tested to date, PROMIS PF instruments are superior or equal to Health Assessment Questionnaire and Medical Outcome Study Short Form-36 Survey legacy instruments in clarity, translatability, patient importance, reliability, and sensitivity to change.Conclusion.Precise measures, such as PROMIS, efficiently incorporate patient self-report of health into research, potentially reducing research cost by lowering sample size requirements. The advent of routine IRT applications has the potential to transform PRO measurement.

scholarly journals Two parallel short forms to measure disease- and treatment-associated knowledge in rheumatoid arthritis: application of item response theory

2020 ◽  
Vol 4 (2) ◽  
Author(s):  
Marieke J Spijk-de Jonge ◽  
Martijn A H Oude Voshaar ◽  
Lisanne Renskers ◽  
Anita M P Huis ◽  
Mart A F J van de Laar ◽  
...  
Keyword(s):  
Item Response Theory ◽  
Educational Attainment ◽  
Psychometric Properties ◽  
Item Response ◽  
Short Form ◽  
Item Bank ◽  
T Test ◽  
Response Theory ◽  
Short Forms ◽  
Paired T Test

Abstract Objective The aim was to develop two disease- and treatment-related knowledge about RA (DataK-RA) short forms using item response theory-based linear optimal test design. Methods We used the open source Excel add-in solver to program a linear optimization algorithm to develop two short forms from the DataK-RA item bank. The algorithm was instructed to optimize precision (i.e. reliability) of the scores for both short forms, subject to a number of constraints that served to ensure that each short form would include unique items and that the short forms would have similar psychometric properties. Agreement among item response theory scores obtained from the different short forms was assessed using the Bland–Altman method and Student’s paired t-test. Construct validity and relative efficiency of the short forms was evaluated by relating the score to age, sex and educational attainment. Results Two short forms were derived from the DataK-RA item bank that satisfied all content constraints. Both short forms included 15 unique items and yielded reliable scores (r &gt; 0.70), with low ceiling and floor effects. The short forms yielded statistically indistinguishable mean scores according to Student’s paired t-test and Bland–Altman analysis. Scores on short forms 1 and 2 were associated with age, sex and educational attainment to a similar extent. Conclusion In this study, we developed two DataK-RA short forms with unique items, yet similar psychometric properties, that can be used to assess patients pre- and post-test interventions aimed at improving disease-related knowledge in RA patients.

Psychometric evaluation of an Italian adaptation of the PROMIS® anxiety short form in Immune-Mediated Inflammatory Diseases. An Item Response Theory analysis.

2020 ◽  
Author(s):  
Rocco Spagnuolo ◽  
Gabriella Antonucci ◽  
Rosa Daniela Grembiale ◽  
Cristina Cosco ◽  
Vanessa Funari ◽  
...  
Keyword(s):  
Factor Analysis ◽  
Item Response Theory ◽  
Psychometric Properties ◽  
Item Response ◽  
Patient Reported Outcomes ◽  
Inflammatory Diseases ◽  
Short Form ◽  
Response Theory ◽  
Immune Mediated ◽  
Patient Reported

Background: The prevalence of anxiety is three times greater in patients with chronic diseases than in the general population. There has recently been growing interest in the roles of inflammation in contributing to the development of anxiety in people with Immune-mediated inflammatory diseases (IMID). Patient-reported outcome measures can facilitate the assessment of physical and psychological functioning. In recent years various patient outcome measures (PROMs) have been implemented. The National Institutes of Health (NIH)'s Patient-Reported Outcomes Measurement Information System (PROMIS®) is a set of publicly available and standardized Patient-Reported Outcomes (PROs) that cover physical appearance, mental health, and social health. The PROMIS® has been built through an Item Response Theory approach (IRT), a model-based measurement in which trait level estimates depend on both persons' responses and on the properties of the items that were administered. The aim of this study is to test the psychometric properties of the original anxiety items of the PROMIS® in a cohort of outpatients with IMIDs.Methods: We translated the original eight anxiety items from the PROMIS into Italian and administered them to consecutive outpatients affected by Inflammatory Bowel disease (n = 246), rheumatological (n = 100) and dermatological (n = 43) diseases, and healthy volunteers (n = 280). We analyzed the data through an Item Response Theory (IRT) analysis to evaluate the psychometric properties of the Italian adaptation of the PROMIS® anxiety short form.Results: Taken together, Confirmatory Factor Analysis and Exploratory Factor analysis suggested that the unidimensionality assumption if the instrument holds. The instrument has excellent reliability from a Classical Theory of Test (CTT) standpoint (Cronbach's ⍺ = .94, McDonald's ω = .95). The 1PL Graded Response Model (GRM) model provided a good balance between the goodness of fit and parsimony (BIC = 9099.82) as compared to the 2PL GRM model (BIC = 9111.02). We did not find signs of Differential Item Functioning (DIF), but we found that the local independence assumption was violated for some items. The analysis of the test reliability curve suggested that the instrument is most reliable for higher levels of the latent trait of anxiety.Discussion: The Italian adaptation of the PROMIS® anxiety short form shows acceptable psychometric properties both from a CTT and an IRT standpoint. Its compatibility with the 1 parameter logistic (1PL) model implies that its total score is a sufficient statistic for the latent anxiety trait. The TRC shows that this instrument is mostly informative for people with higher levels of anxiety, making it particularly suitable for clinical populations such as IMID patients.

scholarly journals The Self-Reflection and Insight Scale: Applying Item Response Theory to Craft an Efficient Short Form

2020 ◽  
Author(s):  
Paul Silvia
Keyword(s):  
Item Response Theory ◽  
Item Response ◽  
Item Difficulty ◽  
Short Form ◽  
The Self ◽  
Self Report ◽  
Response Theory ◽  
Self Reflection ◽  
Gender Based ◽  
The Many

The human ability for self-consciousness—the capacity to reflect on oneself and to think about one’s thoughts, experiences, and actions—is central to understanding personality and motivation. The present research examined the psychometric properties of the Self-reflection and Insight Scale (SRIS), a prominent self-report scale for measuring individual differences in private self-consciousness. Using tools from Rasch and item response theory models, the SRIS was evaluated using responses from a large sample of young adults (n = 1192). The SRIS had many strengths, including essentially zero gender-based differential item functioning (DIF), but a cluster of poor performing items was identified based on item misfit, high local dependence, and low item difficulty and discrimination. Based on the IRT analyses, a concise 12-item scale, evenly balanced between self-reflection and insight, was crafted. The short SRIS showed strong dimensionality, reliability, item fit, and local independence as well as essentially no gender DIF. Taken together, the many psychometric strengths of the SRIS support its popularity, and the short form will be useful for research and applied contexts where an efficient, concise version is needed.

Sign in / Sign up

Export Citation Format

Share Document