scholarly journals Identification of questionable data using validity indices and item response theory methods: Examinations with a teacher-rating scale.

2018 ◽  
Vol 30 (4) ◽  
pp. 500-511 ◽  
Author(s):  
Christine DiStefano ◽  
Jin Liu ◽  
Fred Greer
Keyword(s):  
Item Response Theory ◽  
Item Response ◽  
Rating Scale ◽  
Teacher Rating ◽  
Response Theory ◽  
Teacher Rating Scale ◽  
Validity Indices

Mokken Scale Analysis: Discussion and Application

2021 ◽  
Vol 8 (3) ◽  
pp. 672-695
Author(s):  
Thomas DeVaney
Keyword(s):  
Item Response Theory ◽  
Item Response ◽  
Rating Scale ◽  
Scale Analysis ◽  
Guttman Scale ◽  
Response Theory ◽  
Data Set ◽  
Mokken Scale Analysis ◽  
Irt Models ◽  
Guttman Scaling

This article presents a discussion and illustration of Mokken scale analysis (MSA), a nonparametric form of item response theory (IRT), in relation to common IRT models such as Rasch and Guttman scaling. The procedure can be used for dichotomous and ordinal polytomous data commonly used with questionnaires. The assumptions of MSA are discussed as well as characteristics that differentiate a Mokken scale from a Guttman scale. MSA is illustrated using the mokken package with R Studio and a data set that included over 3,340 responses to a modified version of the Statistical Anxiety Rating Scale. Issues addressed in the illustration include monotonicity, scalability, and invariant ordering. The R script for the illustration is included.

An Item Response Theory analysis of the Unified Multiple System Atrophy Rating Scale

2021 ◽  
Author(s):  
Alexandra Foubert-Samier ◽  
Anne Pavy-Le Traon ◽  
Tiphaine Saulnier ◽  
Mélanie Le-Goff ◽  
Margherita Fabbri ◽  
...  
Keyword(s):  
Item Response Theory ◽  
Multiple System Atrophy ◽  
Item Response ◽  
Rating Scale ◽  
Response Theory ◽  
Theory Analysis ◽  
Item Response Theory Analysis

scholarly journals A-08 Examination of Three Functional Living Scales Using Item Response Theory Modeling in a Mixed Sample

2020 ◽  
Vol 35 (6) ◽  
pp. 781-781
Author(s):  
W Goette ◽  
A Carlew ◽  
J Schaffert ◽  
H Rossetti ◽  
L Lacritz
Keyword(s):  
Higher Education ◽  
Item Response Theory ◽  
Item Response ◽  
Rating Scale ◽  
Functional Change ◽  
Response Theory ◽  
Clinical Dementia Rating ◽  
Predominately White ◽  
Multiple Observations ◽  
Item Functioning

Abstract Objective Characterize three functional living scales under item response theory and examine these scales for evidence of differential item functioning (DIF) by participant and/or informant ethnicity and education. Method Baseline data from 3155 participants [Mage = 70.59(9.55); Medu = 13.3(4.26); 61.72%female] enrolled in the Texas Alzheimer’s Research and Care Consortium with data from the Clinical Dementia Rating Scale (CDR; functional items), Physical Self-Maintenance Scale (PSMS), and Instrumental Activities of Daily Living Scale (IADL) were used. The sample was predominately white (93.94%) and 35.97% identified as Hispanic. Graded response models fit all three tests best. DIF was examined by iteratively dropping item-by-item constraints and then testing model fit. Results The CDR demonstrated overall good item functioning with clear separation between all of the rating categories for each item, while the PSMS and IADL did not, suggesting the item ratings should be reconsidered. DIF was observed by ethnicity (Hispanic v. non-Hispanic) and education (separated into low, average, high) for every item on all three scales (all ps ≤ .01 after adjustment for multiple observations). Hispanic ethnicity and higher education subjects were more likely to be rated as more impaired. Conclusions Results suggest these three commonly used functional scales have DIF depending on the ethnicity and education of the patient. This finding has implications for understanding functional change in certain populations, particularly the potential for mischaracterization of impairment in minority samples. The finding that individuals with higher education tended to be rated as more functionally impaired warrants further investigation.

scholarly journals A-16  Latent Item Response Theory Regression Using Neuropsychological Tests to Predict Functional Ability

2020 ◽  
Vol 35 (6) ◽  
pp. 790-790
Author(s):  
W Goette ◽  
A Carlew ◽  
J Schaffert ◽  
H Rossetti ◽  
L Lacritz
Keyword(s):  
Item Response Theory ◽  
Item Response ◽  
Functional Ability ◽  
Neuropsychological Tests ◽  
Rating Scale ◽  
Word Association ◽  
Digit Span ◽  
Outcome Variable ◽  
Functional Abilities ◽  
Response Theory

Abstract Objective Examine prediction of functional ability with neuropsychological tests using latent item response theory. Method The sample included 3155 individuals (Mage = 69.72, SD = 9.41; Median education =13.15, SD = 4.40; white = 92.81%; female = 62.03%; MCI = 25.13%; Dementia = 28.87%) from the Texas Alzheimer’s Research and Care Consortium who completed functional and cognitive assessments [Mini Mental State Examination (MMSE), Logical Memory (LM), Visual Reproduction (VR), Controlled Oral Word Association Test (COWAT), Trail Making Test (TMT), Boston Naming Test, and Digit Span]. Functional measures [Clinical Dementia Rating Scale, Physical Self Maintenance Scale, and Instrumental Activities of Daily Living)] were combined into a single outcome variable using confirmatory factor analysis. Item response theory (IRT) was used to fit the data, and latent regression to predict the latent trait score using neuropsychological data. Results All three functional scales loaded onto a single factor and demonstrated good construct coverage and measurement reliability (Supporting Figure). A graded response IRT model best fit the functional ability composite measure. MMSE (b = −1.08, p < .001), LM II (b = −0.58, p < .001), VR I and II (b = −0.09, p = .02 and b = −0.43, p < .001, respectively), COWAT (b = −0.10, p = .003), and TMT-B (b = −0.30, p < .001) all significantly predicted functional abilities, as did age (b = 0.61, p < .001) and education (b = 0.31, p < .001). Conclusions Global cognition, memory and executive function tests predicted functional abilities while attention and language tasks did not. These results suggest that certain neuropsychological tests meaningfully predict functional abilities in elderly cognitively normal and cognitively impaired individuals. Further research is needed to determine whether these cognitive domains are predictive of functional abilities in other clinical disorders.

scholarly journals Item Response Theory Analyses of Barkley’s Adult Attention-Deficit/Hyperactivity Disorder Rating Scales

2020 ◽  
Vol 35 (7) ◽  
pp. 1094-1108
Author(s):  
Morgan E Nitta ◽  
Brooke E Magnus ◽  
Paul S Marshall ◽  
James B Hoelzle
Keyword(s):  
Item Response Theory ◽  
Item Response ◽  
Adult Adhd ◽  
Rating Scales ◽  
Rating Scale ◽  
Self Report ◽  
Clinical Population ◽  
Response Theory ◽  
Item Level ◽  
Latent Traits

Abstract There are many challenges associated with assessment and diagnosis of ADHD in adulthood. Utilizing the graded response model (GRM) from item response theory (IRT), a comprehensive item-level analysis of adult ADHD rating scales in a clinical population was conducted with Barkley's Adult ADHD Rating Scale-IV, Self-Report of Current Symptoms (CSS), a self-report diagnostic checklist and a similar self-report measure quantifying retrospective report of childhood symptoms, Barkley's Adult ADHD Rating Scale-IV, Self-Report of Childhood Symptoms (BAARS-C). Differences in item functioning were also considered after identifying and excluding individuals with suspect effort. Items associated with symptoms of inattention (IA) and hyperactivity/impulsivity (H/I) are endorsed differently across the lifespan, and these data suggest that they vary in their relationship to the theoretical constructs of IA and H/I. Screening for sufficient effort did not meaningfully change item level functioning. The application IRT to direct item-to-symptom measures allows for a unique psychometric assessment of how the current DSM-5 symptoms represent latent traits of IA and H/I. Meeting a symptom threshold of five or more symptoms may be misleading. Closer attention given to specific symptoms in the context of the clinical interview and reported difficulties across domains may lead to more informed diagnosis.

scholarly journals Associating Psychotic Symptoms with Altered Brain Anatomy in Psychotic Disorders Using Multidimensional Item Response Theory Models

2019 ◽  
Vol 30 (5) ◽  
pp. 2939-2947 ◽  
Author(s):  
Ana D Stan ◽  
Carol A Tamminga ◽  
Kihwan Han ◽  
Jong Bae Kim ◽  
Jaya Padmanabhan ◽  
...  
Keyword(s):  
Item Response Theory ◽  
Item Response ◽  
Cortical Thickness ◽  
Psychotic Disorders ◽  
Rating Scale ◽  
Multidimensional Item Response Theory ◽  
Psychotic Symptoms ◽  
Multidimensional Item Response ◽  
Response Theory ◽  
Intermediate Phenotypes

Abstract Reduced cortical thickness has been demonstrated in psychotic disorders, but its relationship to clinical symptoms has not been established. We aimed to identify the regions throughout neocortex where clinical psychosis manifestations correlate with cortical thickness. Rather than perform a traditional correlation analysis using total scores on psychiatric rating scales, we applied multidimensional item response theory to identify a profile of psychotic symptoms that was related to a region where cortical thickness was reduced. This analysis was performed using a large population of probands with psychotic disorders (N = 865), their family members (N = 678) and healthy volunteers (N = 347), from the 5-site Bipolar-Schizophrenia Network for Intermediate Phenotypes. Regional cortical thickness from structural magnetic resonance scans was measured using FreeSurfer; individual symptoms were rated using the Positive and Negative Syndrome Scale, Montgomery-Asberg Depression Rating Scale, and Young Mania Rating Scale. A cluster of cortical regions whose thickness was inversely related to severity of psychosis symptoms was identified. The regions turned out to be located contiguously in a large region of heteromodal association cortex including temporal, parietal and frontal lobe regions, suggesting a cluster of contiguous neocortical regions important to psychosis expression. When we tested the relationship between reduced cortical surface area and high psychotic symptoms we found no linked regions describing a related cortical set.

Evaluation Properties of the Chinese Version of the Caring Factor Survey-Caring of Manager According to Classical Test Theory and Item Response Theory

2019 ◽  
Vol 23 (4) ◽  
pp. 275-283
Author(s):  
Ling Wang ◽  
John W. Nelson
Keyword(s):  
Item Response Theory ◽  
Psychometric Properties ◽  
Item Response ◽  
Rating Scale ◽  
Item Difficulty ◽  
Classical Test Theory ◽  
Chinese Version ◽  
Test Theory ◽  
Response Theory ◽  
Classical Test

The aim of the study is to evaluate psychometric properties of the Chinese version of Caring Factor Survey-Caring of Manager (CFS-CM), which evaluated by using with classical test theory (CTT) and item response theory (IRT). CTT analyses evaluate include internal consistence reliability, test–retest reliability and construct validity. IRT analyses were conducted to test the unidimensionality, item fit, item difficulty, the reliability, and rating scale analysis. CTT showed good psychometric properties of the CFS-CM. However, IRT revealed some problems of category level. Taking the above issue into consideration, it could be beneficial to perfect the CFS-CM in the future.

Sign in / Sign up

Export Citation Format

Share Document