scholarly journals Complementary evidence in the early-stage validation of language tests: Classical Test Theory and Rasch analyses

Per Linguam ◽  
2021 ◽  
Vol 36 (2) ◽  
Author(s):  
Albert Johannes Weideman
Keyword(s):  
Early Stage ◽  
Classical Test Theory ◽  
Test Theory ◽  
Classical Test ◽  
Language Tests ◽  
Rasch Analyses

scholarly journals Validating Insomnia Severity Index (ISI) in a Bangladeshi Population: Using Classical Test Theory and Rasch Analysis

2021 ◽  
Vol 19 (1) ◽  
pp. 225
Author(s):  
Mohammed A. Mamun ◽  
Zainab Alimoradi ◽  
David Gozal ◽  
Md Dilshad Manzar ◽  
Anders Broström ◽  
...  
Keyword(s):  
Mental Health ◽  
Suicidal Ideation ◽  
Psychometric Properties ◽  
Classical Test Theory ◽  
Severity Index ◽  
Test Theory ◽  
Insomnia Severity Index ◽  
Classical Test ◽  
Rasch Analyses ◽  
Insomnia Severity

The COVID-19 outbreak is associated with sleep problems and mental health issues among individuals. Therefore, there is a need to assess sleep efficiency during this tough period. Unfortunately, the commonly used instrument on insomnia severity—the Insomnia Severity Index (ISI)—has never been translated and validated among Bangladeshis. Additionally, the ISI has never been validated during a major protracted disaster (such as the COVID-19 outbreak) when individuals encounter mental health problems. The present study aimed to translate the ISI into Bangla language (ISI-Bangla) and validate its psychometric properties. First, the linguistic validity of the ISI-Bangla was established. Then, 9790 Bangladeshis (mean age = 26.7 years; SD = 8.5; 5489 [56.1%] males) completed the Bangla versions of the following questionnaires: ISI, Fear of COVID-19 Scale (FCV-19S), and Patient Health Questionnaire-9 (PHQ-9). All the participants also answered an item on suicidal ideation. Classical test theory and Rasch analyses were conducted to evaluate the psychometric properties of the ISI-Bangla. Both classical test theory and Rasch analyses support a one-factor structure for the ISI-Bangla. Moreover, no substantial differential item functioning was observed across different subgroups (gender, depression status (determined using PHQ-9), and suicidal ideation). Additionally, concurrent validity of the ISI-Bangla was supported by significant and moderate correlations with FCV-19S and PHQ-9; known-group validity was established by the significant difference of the ISI-Bangla scores between participants who experienced suicidal ideation and those without. The present psychometric validation conducted during the COVID-19 outbreak suggests that the ISI-Bangla is a promising and operationally adequate instrument to assess insomnia in Bangladeshis.

scholarly journals The comparison of the scores obtained by Bayesian nonparametric model and classical test theory methods

2021 ◽  
Vol 104 (3) ◽  
pp. 003685042110283
Author(s):  
Meltem Yurtcu ◽  
Hülya Kelecioglu ◽  
Edward L Boone
Keyword(s):  
Classical Test Theory ◽  
Small Sample ◽  
Test Theory ◽  
Nonparametric Model ◽  
Bayesian Nonparametric ◽  
Test Equating ◽  
Classical Test ◽  
A Value ◽  
Item Functioning ◽  
The Individual

Bayesian Nonparametric (BNP) modelling can be used to obtain more detailed information in test equating studies and to increase the accuracy of equating by accounting for covariates. In this study, two covariates are included in the equating under the Bayes nonparametric model, one is continuous, and the other is discrete. Scores equated with this model were obtained for a single group design for a small group in the study. The equated scores obtained with the model were compared with the mean and linear equating methods in the Classical Test Theory. Considering the equated scores obtained from three different methods, it was found that the equated scores obtained with the BNP model produced a distribution closer to the target test. Even the classical methods will give a good result with the smallest error when using a small sample, making equating studies valuable. The inclusion of the covariates in the model in the classical test equating process is based on some assumptions and cannot be achieved especially using small groups. The BNP model will be more beneficial than using frequentist methods, regardless of this limitation. Information about booklets and variables can be obtained from the distributors and equated scores that obtained with the BNP model. In this case, it makes it possible to compare sub-categories. This can be expressed as indicating the presence of differential item functioning (DIF). Therefore, the BNP model can be used actively in test equating studies, and it provides an opportunity to examine the characteristics of the individual participants at the same time. Thus, it allows test equating even in a small sample and offers the opportunity to reach a value closer to the scores in the target test.

Sign in / Sign up

Export Citation Format

Share Document