scholarly journals A New Investigation of Fake Resistance of a Multidimensional Forced-Choice Measure: An Application of Differential Item/Test Functioning

2021 ◽  
Vol 7 (1) ◽  
Author(s):  
Philseok Lee ◽  
Seang-Hwane Joo
Keyword(s):  
Forced Choice ◽  
Future Research ◽  
Differential Test Functioning ◽  
Personnel Assessment ◽  
Item Functioning ◽  
Assessment Systems ◽  
Mean Differences ◽  
Scoring Accuracy ◽  
Practical Implications ◽  
Differential Test

To address faking issues associated with Likert-type personality measures, multidimensional forced-choice (MFC) measures have recently come to light as important components of personnel assessment systems. Despite various efforts to investigate the fake resistance of MFC measures, previous research has mainly focused on the scale mean differences between honest and faking conditions. Given the recent psychometric advancements in MFC measures (e.g., Brown & Maydeu-Olivares, 2011; Stark et al., 2005; Lee et al., 2019; Joo et al., 2019), there is a need to investigate the fake resistance of MFC measures through a new methodological lens. This research investigates the fake resistance of MFC measures through recently proposed differential item functioning (DIF) and differential test functioning (DTF) methodologies for MFC measures (Lee, Joo, & Stark, 2020). Overall, our results show that MFC measures are more fake resistant than Likert-type measures at the item and test levels. However, MFC measures may still be susceptible to faking if MFC measures include many mixed blocks consisting of positively and negatively keyed statements within a block. It may be necessary for future research to find an optimal strategy to design mixed blocks in the MFC measures to satisfy the goals of validity and scoring accuracy. Practical implications and limitations are discussed in the paper.

Differential Item and Test Functioning of the Autism Spectrum Rating Scales: A Follow-Up Evaluation in a Diverse, Nonclinical Sample

2020 ◽  
pp. 073428292094552
Author(s):  
Maryellen Brunson McClain ◽  
Bryn Harris ◽  
Sarah E. Schwartz ◽  
Megan E. Golson
Keyword(s):  
Rating Scales ◽  
Ethnically Diverse ◽  
The United States ◽  
Autism Spectrum ◽  
Future Research ◽  
Differential Test Functioning ◽  
Item Functioning ◽  
Racial Ethnic ◽  
Differential Test

Although the racial/ethnic demographics in the United States are changing, few studies evaluate the cultural and linguistic responsiveness of commonly used autism spectrum disorder screening and diagnostic assessment measures. The purpose of this study is to evaluate item and test functioning of the Autism Spectrum Rating Scales (ASRS) in a sample of racially/ethnically diverse parents of children (nonclinical) between the ages of 6–18 ( N = 806). This study is a follow-up to a prior publication examining the factor structure of the ASRS among a similar sample. The present study furthers the examination of measurement invariance of the ASRS in racially/ethnically diverse populations by conducting differential item functioning and differential test functioning with a larger sample. Results indicate test-level invariance; however, five items are noninvariant across parent reporters from different racial/ethnic groups. Implications for practice and directions for future research are discussed.

Testing for Differential Item Functioning Under the D-Scoring Method

2021 ◽  
pp. 001316442110015
Author(s):  
Dimiter M. Dimitrov ◽  
Dimitar V. Atanasov
Keyword(s):  
Differential Item Functioning ◽  
Item Response ◽  
Future Research ◽  
Scoring Method ◽  
Differential Test Functioning ◽  
Measurement Framework ◽  
Item Functioning ◽  
Statistical Hypotheses ◽  
Study Support ◽  
Differential Test

This study offers an approach to testing for differential item functioning (DIF) in a recently developed measurement framework, referred to as D-scoring method (DSM). Under the proposed approach, called P–Z method of testing for DIF, the item response functions of two groups (reference and focal) are compared by transforming their probabilities of correct item response, estimated under the DSM, into Z-scale normal deviates. Using the liner relationship between such Z-deviates, the testing for DIF is reduced to testing two basic statistical hypotheses about equal variances and equal means of the Z-deviates for the reference and focal groups. The results from a simulation study support the efficiency (low Type error and high power) of the proposed P–Z method. Furthermore, it is shown that the P–Z method is directly applicable in testing for differential test functioning. Recommendations for practical use and future research, including possible applications of the P–Z method in IRT context, are also provided.

Gender-Related Differential Item Functioning in Vocational Interest Measurement

2013 ◽  
Vol 34 (3) ◽  
pp. 170-183 ◽  
Author(s):  
Eunike Wetzel ◽  
Benedikt Hell
Keyword(s):  
Gender Differences ◽  
Differential Item Functioning ◽  
Scale Level ◽  
Interest Inventory ◽  
Men And Women ◽  
Differential Test Functioning ◽  
Item Functioning ◽  
Mean Differences ◽  
The Impact ◽  
Differential Test

Large mean differences are consistently found in the vocational interests of men and women. These differences may be attributable to real differences in the underlying traits. However, they may also depend on the properties of the instrument being used. It is conceivable that, in addition to the intended dimension, items assess a second dimension that differentially influences responses by men and women. This question is addressed in the present study by analyzing a widely used German interest inventory (Allgemeiner Interessen-Struktur-Test, AIST-R) regarding differential item functioning (DIF) using a DIF estimate in the framework of item response theory. Furthermore, the impact of DIF at the scale level is investigated using differential test functioning (DTF) analyses. Several items on the AIST-R’s scales showed significant DIF, especially on the Realistic, Social, and Enterprising scales. Removal of DIF items reduced gender differences on the Realistic scale, though gender differences on the Investigative, Artistic, and Social scales remained practically unchanged. Thus, responses to some AIST-R items appear to be influenced by a secondary dimension apart from the interest domain the items were intended to measure.

Psychometric Properties and Differential Item Functioning of a Web-Based Assessment of Children’s Emotion Recognition Skill

2019 ◽  
Vol 38 (5) ◽  
pp. 627-641
Author(s):  
Beyza Aksu Dunya ◽  
Clark McKown ◽  
Everett Smith
Keyword(s):  
Psychometric Properties ◽  
Emotion Recognition ◽  
Differential Item Functioning ◽  
Facial Expressions ◽  
Web Based ◽  
Differential Test Functioning ◽  
Item Fit ◽  
Item Functioning ◽  
Children's Emotion ◽  
Differential Test

Emotion recognition (ER) involves understanding what others are feeling by interpreting nonverbal behavior, including facial expressions. The purpose of this study is to evaluate the psychometric properties of a web-based social ER assessment designed for children in kindergarten through third grade. Data were collected from two separate samples of children. The first sample included 3,224 children and the second sample included 4,419 children. Data were calibrated using Rasch dichotomous model. Differential item and test functioning were also evaluated across gender and ethnicity. Across both samples, we found consistent item fit, unidimensional item structure, and adequate item targeting. Analyses of differential item functioning (DIF) found six out of 111 items displaying DIF across gender and no items demonstrating DIF across ethnicity. The analyses of person measure calibrations with and without DIF items yielded no evidence of differential test functioning (DTF) across gender and ethnicity groups in both samples.

Cross-Lagged Relationships Between Self-Esteem, Self-Construal, and Happiness in a Three-Wave Longitudinal Study

2019 ◽  
Vol 40 (3) ◽  
pp. 177-185
Author(s):  
Daniela Moza ◽  
Laurențiu Maricuțoiu ◽  
Alin Gavreliuc
Keyword(s):  
Structural Equation ◽  
Time Lag ◽  
Self Esteem ◽  
Equation Modeling ◽  
Future Research ◽  
Cross Sectional ◽  
Self Construal ◽  
Self Worth ◽  
Practical Implications ◽  
Independent Person

Abstract. Previous research established that an independent construal of the self is associated with higher self-esteem, which, in turn, is associated with increased happiness. Regarding the directionality of these relationships, theoretical arguments have suggested that self-construal precedes self-esteem and that self-esteem precedes happiness. However, most research in this area is cross-sectional, thus limiting any conclusions about directionality. The present study tested these relationships in 101 Romanian undergraduates using a 3-wave cross-lagged design with a 6-month time lag between every two waves. Structural equation modeling analyses revealed that self-esteem is an antecedent of both happiness and dimensions of independent self-construal (i.e., consistency vs. variability and self-expression vs. harmony). In other words, one’s positive evaluation of self-worth precedes one’s self-perception as being a happy and independent person. The findings are discussed with respect to the theoretical and practical implications, along with limitations and suggestions for future research.

The Relationship Between Leader–Member Exchange and Employees’ Proactive Behaviors

2019 ◽  
Vol 18 (2) ◽  
pp. 106-111
Author(s):  
Fong-Yi Lai ◽  
Szu-Chi Lu ◽  
Cheng-Chen Lin ◽  
Yu-Chin Lee
Keyword(s):  
Hierarchical Linear Modeling ◽  
Future Research ◽  
Leader Member Exchange ◽  
Voice Behavior ◽  
Linear Modeling ◽  
Team Members ◽  
Member Exchange ◽  
Multi Temporal ◽  
The Relationship ◽  
Practical Implications

Abstract. The present study proposed that, unlike prior leader–member exchange (LMX) research which often implicitly assumed that each leader develops equal-quality relationships with their supervisors (leader’s LMX; LLX), every leader develops different relationships with their supervisors and, in turn, receive different amounts of resources. Moreover, these differentiated relationships with superiors will influence how leader–member relationship quality affects team members’ voice and creativity. We adopted a multi-temporal (three wave) and multi-source (leaders and employees) research design. Hypotheses were tested on a sample of 227 bank employees working in 52 departments. Results of the hierarchical linear modeling (HLM) analysis showed that LLX moderates the relationship between LMX and team members’ voice behavior and creative performance. Strengths, limitations, practical implications, and directions for future research are discussed.

Sign in / Sign up

Export Citation Format

Share Document