Comparability and Validity of the Online and In-Person Administrations of the Inventory of Problems-29

While the psychometric equivalence of computerized versus paper-and-pencil administration formats has been documented for some tests, so far very few studies have focused on the comparability and validity of test scores obtained via in-person versus remote administrations, and none of them have researched a symptom validity test (SVT). To contribute to fill this gap in the literature, we investigated the scores of the Inventory of Problems-29 (IOP-29) generated by various administration formats. More specifically, Study 1 evaluated the equivalence of scores from nonclinical individuals administered the IOP-29 remotely (n = 146) versus in-person via computer (n = 140) versus in-person via paper-and-pencil format (n = 140). Study 2 reviewed published IOP-29 studies conducted using remote/online versus in-person, paper-and-pencil test administrations to determine if remote testing could adversely influence the validity of IOP-29 test results. Taken together, our findings suggest that the effectiveness of the IOP-29 is preserved when alternating between face-to-face and online/remote formats.

Psychometric Equivalence of Standard and Prorated Boston Naming Test Scores

This study compared prorated Boston Naming Test (BNT-P; omitting the noose item) and standard administration (BNT-S) scores in physical medicine and rehabilitation patients ( N = 480). The sample was 34% female and 91% White with average age and education of 46 ( SD = 15) and 14 ( SD = 3) years, respectively. BNT-P was calculated by summing correct responses excluding item 48 and estimating the 60-item score with cross multiplication and division. BNT-P and BNT-S scores were compared via concordance correlation (CC) coefficients; reflected and log transformed data were examined with equivalence tests. BNT-P and BNT-S scores showed almost perfect agreement (CC = .99). Transformed scores demonstrated equivalence (±1.1 points). Raw and scaled score differences were 0 in 88% and 96% of cases, respectively. Race and ethnicity accounted for item 48 outcomes while controlling for age and education. Findings support the utility of prorated BNT scores in rehabilitation patients.

Is the Assessment of Personality Comparable in Persons Who Have and Have Not Experienced Depressive, Anxiety, and Substance Use Disorders? An Examination of Measurement Invariance

Numerous studies have focused on characterizing personality differences between individuals with and without psychopathology. For drawing valid conclusions for these comparisons, the personality instruments used must demonstrate psychometric equivalence. However, we are unaware of any studies that examine measurement invariance in personality across individuals with and without psychopathology. This study conducted tests of measurement invariance for positive emotionality, negative emotionality, and disinhibition across individuals with and without histories of depressive, anxiety, and substance use disorders. We found consistent evidence that positive emotionality, negative emotionality, and disinhibition were assessed equivalently across all comparisons with each demonstrating strict invariance. Overall, results suggest that comparisons of personality measures between diagnostic groups satisfy the assumption of measurement invariance and these scales represent the same psychological constructs. Thus, mean-level comparisons across these groups are valid tests.

Psychometric equivalence of the Brazilian version of the Test of Pragmatic Language 2 - TOPL-2

INTRODUCTION: Considering the relevance of the investigation about the pragmatic function for language disorders diagnosis, as well as the relevance of validity evidence for test interpretation, this paper aimed to explore the psychometric equivalence between the American and Brazilian versions of the Test of Pragmatic Language, Second Edition (TOPL-2).METHODS: A total of 81 students from the third to seventh year from public elementary schools of São Paulo (63% girls; average age=9.42 years, SD=0.93) with no complaints or indicators of low school performance were selected. Students answered the verbal application of the TOPL-2 Brazilian-Portuguese version. Some of the psychometric inquiries reported in the original version of the test were reproduced focusing on the analyses of difficulty, internal consistency, discrimination, and differential item functioning.RESULTS: Most of the items (86%) presented similar difficulties to the American version. The internal consistency index had acceptable values (0.70). Few items (26%) showed adequate discrimination, but 49% were close to the desirable cutoffs. Eight items showed differential functioning; of which, five were favorable to boys.CONCLUSION: Despite sample limitations related to size and variability, almost half of the items showed psychometric equivalence to the American version.