Item Pool Design and Maintenance for Multistage Testing

2016 ◽  
pp. 77-92
Keyword(s):  
Item Pool ◽  
Multistage Testing ◽  
Item Pool Design

scholarly journals The Optimal Item Pool Design in Multistage Computerized Adaptive Tests With the p-Optimality Method

2020 ◽  
Vol 80 (5) ◽  
pp. 955-974
Author(s):  
Lihong Yang ◽  
Mark D. Reckase
Keyword(s):  
Exposure Control ◽  
Item Pool ◽  
Adaptive Tests ◽  
Computerized Adaptive Test ◽  
Computerized Adaptive Tests ◽  
Statistical Measures ◽  
Scoring Accuracy ◽  
Item Pools ◽  
Item Pool Design ◽  
The Rasch Model

The present study extended the p-optimality method to the multistage computerized adaptive test (MST) context in developing optimal item pools to support different MST panel designs under different test configurations. Using the Rasch model, simulated optimal item pools were generated with and without practical constraints of exposure control. A total number of 72 simulated optimal item pools were generated and evaluated by an overall sample and conditional sample using various statistical measures. Results showed that the optimal item pools built with the p-optimality method provide sufficient measurement accuracy under all simulated MST panel designs. Exposure control affected the item pool size, but not the item distributions and item pool characteristics. This study demonstrated that the p-optimality method can adapt to MST item pool design, facilitate the MST assembly process, and improve its scoring accuracy.

Die Früherkennung von Problemspielern: Entwicklung eines Screening-Instrumentes

2014 ◽  
Vol 60 (6) ◽  
pp. 323-330 ◽  
Author(s):  
Tobias Hayer ◽  
Jens Kalke ◽  
Sven Buth ◽  
Gerhard Meyer
Keyword(s):  
Qualitative Interviews ◽  
Item Pool

Einführung: Nach aktuellen rechtlichen Bestimmungen ist das Personal von Spielhallen in der Früherkennung problematischen Spielverhaltens zu schulen. Bisher werden von den Schulungsinstitutionen allerdings sehr heterogene und wissenschaftlich nicht überprüfte Checklisten eingesetzt. Zielsetzung: Das Forschungsprojekt verfolgte das Ziel, in einem systematischen Entwicklungsprozess ein empiriegestütztes Früherkennungsinstrument zu konzipieren, das einerseits die wichtigsten psychometrischen Gütekriterien erfüllt und gleichzeitig anwenderfreundlich sowie praxistauglich ist. Forschungsdesign: Das Instrument wurde in einem komplexen methodischen Prozess entwickelt, der im Kern folgende, aufeinander aufbauende Einzelschritte umfasst: Literaturrecherche, qualitative Interviews, Fokusgruppen-Gespräche, Befragung von Spielern und Spielstättenpersonal. Im Verlauf dieses Prozesses ließ sich der Item-Pool von 71 auf 18 Kriterien reduzieren. Ergebnis: Das Früherkennungsinstrument besteht aus insgesamt 18 Beobachtungsmerkmalen, die in erster Linie eine Kombination aus Kriterien der Verhaltensänderung, des aktuellen (Spiel‐)Verhaltens und des Umgangs mit Geld darstellen. Ausblick: Das Instrument müsste zukünftig in einem Praxistest mit einer angemessenen Stichprobengröße validiert werden. Zudem ist es erforderlich, die bisher in der Praxis angewendeten heterogenen Kriterienkataloge weiter zu vereinheitlichen.

International Personality Item Pool-NEO Personality Inventory-60

2019 ◽  
Author(s):  
Jessica L. Maples-Keller ◽  
Rachel L. Williamson ◽  
Chelsea E. Sleep ◽  
Nathan T. Carter ◽  
W. Keith Campbell ◽  
...  
Keyword(s):  
Personality Inventory ◽  
Item Pool ◽  
Neo Personality Inventory ◽  
Personality Item

120-Item International Personality Item Pool--Urdu Version

2019 ◽  
Author(s):  
Iftikhar Ahmed Khan ◽  
Ahmad Khan ◽  
Babar Nazir ◽  
Syed Sajid Hussain ◽  
Fiaz Khan ◽  
...  
Keyword(s):  
Item Pool ◽  
Personality Item

The Development of Preliminary HiTOP Internalizing Spectrum Scales

Assessment ◽  
2021 ◽  
pp. 107319112110039
Author(s):  
David Watson ◽  
Miriam K. Forbes ◽  
Holly F. Levin-Aspenson ◽  
Camilo J. Ruggero ◽  
Yuliya Kotelnikova ◽  
...  
Keyword(s):  
Internalizing Symptoms ◽  
Self Report ◽  
General Factor ◽  
Item Pool ◽  
Factor Analyses ◽  
Item Level ◽  
Formal Definitions ◽  
Body Dysmorphia ◽  
Item Writing ◽  
Report Measure

As part of a broader project to create a comprehensive self-report measure for the Hierarchical Taxonomy of Psychopathology consortium, we developed preliminary scales to assess internalizing symptoms. The item pool was created in four steps: (a) clarifying the range of content to be assessed, (b) identifying target constructs to guide item writing, (c) developing formal definitions for each construct, and (d) writing multiple items for each construct. This yielded 430 items assessing 57 target constructs. Responses from a heterogeneous scale development sample ( N = 1,870) were subjected to item-level factor analyses based on polychoric correlations. This resulted in 39 scales representing a total of 213 items. The psychometric properties of these scales replicated well across the development sample and an independent validation sample ( N = 496 adults). Internal consistency analyses established that most scales assess relatively narrow forms of psychopathology. Structural analyses demonstrated the presence of a strong general factor. Additional analyses of the 35 nonsexual dysfunction scales revealed a replicable four-factor structure with dimensions we labeled Distress, Fear, Body Dysmorphia, and Mania. A final set of analyses established that the internalizing scales varied widely—and consistently—in the strength of their associations with neuroticism and extraversion.

Initial development of the Dance Imagery Questionnaire for Children (DIQ-C): establishing content validity

2020 ◽  
Vol 15 (1) ◽  
Author(s):  
Irene Muir ◽  
Krista Munroe-Chandler
Keyword(s):  
Content Validity ◽  
Cognitive Interviews ◽  
Item Pool ◽  
Initial Development ◽  
Expert Rating ◽  
Content Relevance ◽  
Phase Study ◽  
Initial Item ◽  
Item Content ◽  
Dance Imagery

AbstractGiven the differences between young dancers’ and adult dancers’ use of imagery, a valid and reliable questionnaire specific to young dancers was necessary. The current study is the first phase of a multi-phase study in the development of the Dance Imagery Questionnaire for Children (DIQ-C). Specifically, the purpose of this study was to establish content validity of the DIQ-C. This was achieved through the following three stages: (1) definition, item, and scale development, (2) assessment of item clarity and appropriateness via cognitive interviews, and (3) assessment of item-content relevance via an expert rating panel. Guided by previous qualitative research with young dancers, 46 items representing seven subscales (i.e., imagery types) were developed. The initial item pool was then implemented during cognitive interviews with 16 dancers (15 females; Mage=10.63, SD=1.82), which led to the removal of 13 items and the modification of 21 items. Consequently, the revised 33-item pool was then administered to an expert panel of four imagery researchers and four dance instructors to measure item-content relevance. This resulted in the removal of eight items, the revision of four items, and the merging of two subscales. Overall, the current study provides content validity evidence for a 25-item pool (representing five subscales) to be used in further development of the DIQ-C (i.e., identifying and establishing factor structure).

Sign in / Sign up

Export Citation Format

Share Document