Testlet Effects on Standardized Log-likelihood Person Fit Index to Detect Aberrant Responses for the IRT Testlet Model

2013 ◽  
Author(s):  
Haiqin Chen
2019 ◽  
Vol 37 (2) ◽  
pp. 399-420
Author(s):  
Kevin Carl P. Santos ◽  
Jimmy de la Torre ◽  
Matthias von Davier

Author(s):  
Rashid Al-Mehrzi

Wright's residual-based person fit indices were the first person fit indices with dichotomous IRT model and commonly used with Rasch model software. Although there were number of studies which suggested modifications to improve the statistical properties of the Wright's indices, they remained to lack good statistical properties.The study presented a new person fit index and how it can be interpreted and applied for detecting person misfit. Moreover, through a simulated data, the study investigated the statistical properties and the power rates of the new index and compared it with Wright's indices. Results showed that the new index had superior statistical properties under different test conditions and overcome the Wright's index. 


2018 ◽  
Vol 19 (4) ◽  
pp. 75-118
Author(s):  
Sehee Hong ◽  
Yoona Jang ◽  
Joohan Kim ◽  
Young-san Yoo

2019 ◽  
Vol 35 (1) ◽  
pp. 126-136 ◽  
Author(s):  
Tour Liu ◽  
Tian Lan ◽  
Tao Xin

Abstract. Random response is a very common aberrant response behavior in personality tests and may negatively affect the reliability, validity, or other analytical aspects of psychological assessment. Typically, researchers use a single person-fit index to identify random responses. This study recommends a three-step person-fit analysis procedure. Unlike the typical single person-fit methods, the three-step procedure identifies both global misfit and local misfit individuals using different person-fit indices. This procedure was able to identify more local misfit individuals than single-index method, and a graphical method was used to visualize those particular items in which random response behaviors appear. This method may be useful to researchers in that it will provide them with more information about response behaviors, allowing better evaluation of scale administration and development of more plausible explanations. Real data were used in this study instead of simulation data. In order to create real random responses, an experimental test administration was designed. Four different random response samples were produced using this experimental system.


Author(s):  
Zaid S. Bani Ata

This study aimed at investigating the aberrant response patterns and their impacts on the Jordanian version Otis- Lennon as well as the accuracy in the estimation of a person's' ability and information function test.  To achieve this goal, the Jordanian version of  the Ability Test primary II level form K was administrated to 568 first-grade male and female students of Ajloun district public schools during  2016/2017. The Lz person fit index and the three-parameter  logistic model were used to analyze students' responses to test items to assess the person ability, information function test, and to detect aberrant response patterns. The results revealed that the response patterns of 56 students were aberrant based on Lz index; also the results showed that the factors responsible for the presence of this aberrant response were: guessing, cheating, laziness, and exponential creatively. The results indicated that when the aberrant patterns were excluded, both the accuracy person's estimating ability and the information function test had significantly increased at different ability levels.


2016 ◽  
Vol 41 (1) ◽  
pp. 44-59 ◽  
Author(s):  
Jorge N. Tendeiro

Although person-fit analysis has a long-standing tradition within item response theory, it has been applied in combination with dominance response models almost exclusively. In this article, a popular log likelihood-based parametric person-fit statistic under the framework of the generalized graded unfolding model is used. Results from a simulation study indicate that the person-fit statistic performed relatively well in detecting midpoint response style patterns and not so well in detecting extreme response style patterns.


Methodology ◽  
2010 ◽  
Vol 6 (1) ◽  
pp. 3-16 ◽  
Author(s):  
Yuri Goegebeur ◽  
Paul De Boeck ◽  
Geert Molenberghs

The local influence diagnostics, proposed by Cook (1986) , provide a flexible way to assess the impact of minor model perturbations on key model parameters’ estimates. In this paper, we apply the local influence idea to the detection of test speededness in a model describing nonresponse in test data, and compare this local influence approach to the optimal person fit index proposed by Drasgow and Levine (1986) , and the empirical Bayes estimate of the test speededness random effect. The performance of the methods is illustrated on the Chilean SIMCE mathematics test data. The data example indicates that the three statistics are promising when it comes to the detection of special profiles, and besides overlap to a considerable extent. Given that the statistics were developed for different purposes, they react of course differentially to the various characteristics of the response profiles, and hence also exhibit some specificity.


Methodology ◽  
2006 ◽  
Vol 2 (4) ◽  
pp. 142-148 ◽  
Author(s):  
Pere J. Ferrando

In the IRT person-fluctuation model, the individual trait levels fluctuate within a single test administration whereas the items have fixed locations. This article studies the relations between the person and item parameters of this model and two central properties of item and test scores: temporal stability and external validity. For temporal stability, formulas are derived for predicting and interpreting item response changes in a test-retest situation on the basis of the individual fluctuations. As for validity, formulas are derived for obtaining disattenuated estimates and for predicting changes in validity in groups with different levels of fluctuation. These latter formulas are related to previous research in the person-fit domain. The results obtained and the relations discussed are illustrated with an empirical example.


Sign in / Sign up

Export Citation Format

Share Document