Item pool development and evaluation.

Author(s):  
Daniel O. Segall ◽  
Kathleen E. Moreno ◽  
Rebecca D. Hetter
Keyword(s):  
Author(s):  
Tobias Hayer ◽  
Jens Kalke ◽  
Sven Buth ◽  
Gerhard Meyer

Einführung: Nach aktuellen rechtlichen Bestimmungen ist das Personal von Spielhallen in der Früherkennung problematischen Spielverhaltens zu schulen. Bisher werden von den Schulungsinstitutionen allerdings sehr heterogene und wissenschaftlich nicht überprüfte Checklisten eingesetzt. Zielsetzung: Das Forschungsprojekt verfolgte das Ziel, in einem systematischen Entwicklungsprozess ein empiriegestütztes Früherkennungsinstrument zu konzipieren, das einerseits die wichtigsten psychometrischen Gütekriterien erfüllt und gleichzeitig anwenderfreundlich sowie praxistauglich ist. Forschungsdesign: Das Instrument wurde in einem komplexen methodischen Prozess entwickelt, der im Kern folgende, aufeinander aufbauende Einzelschritte umfasst: Literaturrecherche, qualitative Interviews, Fokusgruppen-Gespräche, Befragung von Spielern und Spielstättenpersonal. Im Verlauf dieses Prozesses ließ sich der Item-Pool von 71 auf 18 Kriterien reduzieren. Ergebnis: Das Früherkennungsinstrument besteht aus insgesamt 18 Beobachtungsmerkmalen, die in erster Linie eine Kombination aus Kriterien der Verhaltensänderung, des aktuellen (Spiel‐)Verhaltens und des Umgangs mit Geld darstellen. Ausblick: Das Instrument müsste zukünftig in einem Praxistest mit einer angemessenen Stichprobengröße validiert werden. Zudem ist es erforderlich, die bisher in der Praxis angewendeten heterogenen Kriterienkataloge weiter zu vereinheitlichen.


2019 ◽  
Author(s):  
Jessica L. Maples-Keller ◽  
Rachel L. Williamson ◽  
Chelsea E. Sleep ◽  
Nathan T. Carter ◽  
W. Keith Campbell ◽  
...  

2019 ◽  
Author(s):  
Iftikhar Ahmed Khan ◽  
Ahmad Khan ◽  
Babar Nazir ◽  
Syed Sajid Hussain ◽  
Fiaz Khan ◽  
...  
Keyword(s):  

Assessment ◽  
2021 ◽  
pp. 107319112110039
Author(s):  
David Watson ◽  
Miriam K. Forbes ◽  
Holly F. Levin-Aspenson ◽  
Camilo J. Ruggero ◽  
Yuliya Kotelnikova ◽  
...  

As part of a broader project to create a comprehensive self-report measure for the Hierarchical Taxonomy of Psychopathology consortium, we developed preliminary scales to assess internalizing symptoms. The item pool was created in four steps: (a) clarifying the range of content to be assessed, (b) identifying target constructs to guide item writing, (c) developing formal definitions for each construct, and (d) writing multiple items for each construct. This yielded 430 items assessing 57 target constructs. Responses from a heterogeneous scale development sample ( N = 1,870) were subjected to item-level factor analyses based on polychoric correlations. This resulted in 39 scales representing a total of 213 items. The psychometric properties of these scales replicated well across the development sample and an independent validation sample ( N = 496 adults). Internal consistency analyses established that most scales assess relatively narrow forms of psychopathology. Structural analyses demonstrated the presence of a strong general factor. Additional analyses of the 35 nonsexual dysfunction scales revealed a replicable four-factor structure with dimensions we labeled Distress, Fear, Body Dysmorphia, and Mania. A final set of analyses established that the internalizing scales varied widely—and consistently—in the strength of their associations with neuroticism and extraversion.


Author(s):  
Irene Muir ◽  
Krista Munroe-Chandler

AbstractGiven the differences between young dancers’ and adult dancers’ use of imagery, a valid and reliable questionnaire specific to young dancers was necessary. The current study is the first phase of a multi-phase study in the development of the Dance Imagery Questionnaire for Children (DIQ-C). Specifically, the purpose of this study was to establish content validity of the DIQ-C. This was achieved through the following three stages: (1) definition, item, and scale development, (2) assessment of item clarity and appropriateness via cognitive interviews, and (3) assessment of item-content relevance via an expert rating panel. Guided by previous qualitative research with young dancers, 46 items representing seven subscales (i.e., imagery types) were developed. The initial item pool was then implemented during cognitive interviews with 16 dancers (15 females; Mage=10.63, SD=1.82), which led to the removal of 13 items and the modification of 21 items. Consequently, the revised 33-item pool was then administered to an expert panel of four imagery researchers and four dance instructors to measure item-content relevance. This resulted in the removal of eight items, the revision of four items, and the merging of two subscales. Overall, the current study provides content validity evidence for a 25-item pool (representing five subscales) to be used in further development of the DIQ-C (i.e., identifying and establishing factor structure).


2021 ◽  
pp. 073428292110277
Author(s):  
Ioannis Tsaousis ◽  
Georgios D. Sideridis ◽  
Hannan M. AlGhamdi

This study evaluated the psychometric quality of a computerized adaptive testing (CAT) version of the general cognitive ability test (GCAT), using a simulation study protocol put forth by Han, K. T. (2018a). For the needs of the analysis, three different sets of items were generated, providing an item pool of 165 items. Before evaluating the efficiency of the GCAT, all items in the final item pool were linked (equated), following a sequential approach. Data were generated using a standard normal for 10,000 virtual individuals ( M = 0 and SD = 1). Using the measure’s 165-item bank, the ability value (θ) for each participant was estimated. maximum Fisher information (MFI) and maximum likelihood estimation with fences (MLEF) were used as item selection and score estimation methods, respectively. For item exposure control, the fade away method (FAM) was preferred. The termination criterion involved a minimum SE ≤ 0.33. The study revealed that the average number of items administered for 10,000 participants was 15. Moreover, the precision level in estimating the participant’s ability score was very high, as demonstrated by the CBIAS, CMAE, and CRMSE). It is concluded that the CAT version of the test is a promising alternative to administering the corresponding full-length measure since it reduces the number of administered items, prevents high rates of item exposure, and provides accurate scores with minimum measurement error.


2021 ◽  
Vol 5 (1) ◽  
Author(s):  
János Valery Gyuricza ◽  
Karl Bang Christensen ◽  
Ana Flávia Pires Lucas d’Oliveira ◽  
John Brodersen

Abstract Background A previous qualitative assessment of the psychosocial consequences of labelling hypertension describes the diagnosis of hypertension as a labelling event with potential unintended negative long-term psychosocial consequences (labelling effects). Until now, the benefits of diagnosing hypertension have been far more reported than the harms. To obtain the net result of the preventive interventions for cardiovascular disease, such as diagnosing and treating mild hypertension, assessing benefits and harms in the most comprehensive way possible is necessary, including the psychosocial consequences of labelling. When measuring psychosocial consequences of labelling hypertension, a questionnaire with high content validity and adequate psychometric properties is needed. Objectives The aim of this study was to describe the psychometric parameters of face and content-validated pool of items. Other objectives were also to screen the item pool by using Rasch model analysis and confirmatory factor analysis (CFA) for identifying such items with sufficient fit to the hypothesised models. Methods We surveyed the pool of items as a draft questionnaire to Brazilians recruited via social networks, sending e-mails, WhatsApp® messages and posting on Facebook®. The inclusion criteria were to be older than 18 years old, to be healthy and to have only hypertension. We used Rasch model analysis to screen the item pool, discarding items that did not fit the hypothesised domain. We searched for local dependence and differential item functioning. We used CFA to confirm the derived measurement models and complementarily assessed reliability using Cronbach’s coefficient alpha. Results The validation sample consisted of 798 respondents. All 798 respondents completed Part I, whereas 285 (35.7%)—those with hypertension—completed Part II. A condition-specific questionnaire with high content validity and adequate psychometric properties was developed for people labelled with hypertension. This measure is called ‘Consequences of Labelling Hypertension Questionnaire’ and covers the psychosocial consequences of labelling hypertension in two parts, encompassing a total of 71 items in 15 subscales and 11 single items. Conclusion We developed a tool that can be used in future research involving hypertension, especially in scenarios of screening, prevention, population strategies and in intervention studies. Future use and testing of the questionnaire may still be required.


Sign in / Sign up

Export Citation Format

Share Document