Differentiating Among High-Achieving Learners

2019 ◽  
Author(s):  
Brandon C LeBeau ◽  
Duhita Mahatmya ◽  
Ann Lupkowski-Shoplik ◽  
Susan G Assouline

This study investigated the application of item response theory (IRT) to expand the range of ability estimates for gifted (hereinafter referred to as high-achieving) students’ performance on an above-level test. Using a sample of 4th – 6th grade high-achieving students (n = 1,893), we conducted a study to compare estimates from two measurement theories, classical test theory (CTT) and IRT. CTT and IRT make different assumptions about the analysis that impact the reliability and validity of the scores obtained from the test. IRT can also differentiate students based on the student’s grade or within a grade by using the unique string of correct and incorrect answers the student makes while taking the test. This differentiation may have implications for identifying or classifying students who are ready for advanced coursework. An exploration of the differentiation for math, reading, and science tests and the impact the different measurement frameworks can have on classification of students are explored. Implications for academic talent identification with the Talent Search Model and development of academic talent are discussed.

2020 ◽  
Vol 64 (3) ◽  
pp. 219-237
Author(s):  
Brandon LeBeau ◽  
Susan G. Assouline ◽  
Duhita Mahatmya ◽  
Ann Lupkowski-Shoplik

This study investigated the application of item response theory (IRT) to expand the range of ability estimates for gifted (hereinafter referred to as high-achieving) students’ performance on an above-level test. Using a sample of fourth- to sixth-grade high-achieving students ( N = 1,893), we conducted a study to compare estimates from two measurement theories, classical test theory (CTT) and IRT. CTT and IRT make different assumptions about the analysis that impact the reliability and validity of the scores obtained from the test. IRT can also differentiate students based on the student’s grade or within a grade by using the unique string of correct and incorrect answers the student makes while taking the test. This differentiation may have implications for identifying or classifying students who are ready for advanced coursework. An exploration of the differentiation for Math, Reading, and Science tests and the impact the different measurement frameworks can have on classification of students are explored. Implications for academic talent identification with the talent search model and development of academic talent are discussed.


2013 ◽  
Vol 10 (01) ◽  
pp. 11-17 ◽  
Author(s):  
J. Zielasek ◽  
H.-R. Cleveland ◽  
W. Gaebel

SummaryWithin the efforts to revise ICD-10, the World Health Organization (WHO) has appointed a disorder-specific Working Group on the Classification of Psychotic Disorders (WGPD). The WGPD has proposed several changes to the classification criteria of schizophrenia and other primary psychotic disorders in order to increase the clinical utility, reliability and validity of the diagnostic classification. The main proposals include changes to the chapter title, the replacement of existing schizophrenia subtypes with symptom specifiers, stricter diagnostic criteria for schizoaffective disorder, a reorganization of the delusional disorders and the acute and transient psychotic disorders, as well as the revision of course specifiers. These proposed revisions are subject to field trials with the aim of studying whether they will lead to an improvement of the classification system in comparison to its previous version. The proposals are compared with revisions of the according DSM-5 chapter. The impact of novel results from neuroscience and genetics on the current proposals is discussed, also with respect to future classification strategies such as the Research Domain Criteria (RDoC) project.


2011 ◽  
Vol 42 (1) ◽  
pp. 61-71 ◽  
Author(s):  
K. Klapheck ◽  
S. Nordmeyer ◽  
H. Cronjäger ◽  
D. Naber ◽  
T. Bock

BackgroundClinical research on subjective determinants of recovery and health has increased, but no instrument has been developed to assess the subjective experience and meaning of psychoses. We have therefore constructed and validated the Subjective Sense in Psychosis Questionnaire (SUSE) to measure sense making in psychotic disorders.MethodSUSE was based on an item pool generated by professionals and patients. For pre-testing, 90 psychosis patients completed the instrument. Psychometric properties were assessed using methods of classical test theory. In the main study, SUSE was administered to a representative sample of 400 patients. Factor structure, reliability and validity were assessed and confirmatory factor analyses (CFAs) were used for testing subscale coherence and adequacy of the hypothesized factor structure. Response effects due to clinical settings were tested using multilevel analyses.ResultsThe final version of SUSE comprises 34 items measuring distinct aspects of the experience and meaning of psychoses in a consistent overall model with six coherent subscales representing positive and negative meanings throughout the course of psychotic disorders. Multilevel analyses indicate independence from clinical context effects. Patients relating psychotic experiences to life events assessed their symptoms and prospects more positively. 76% of patients assumed a relationship between their biography and the emergence of psychosis, 42% reported positive experience of symptoms and 74% ascribed positive consequences to their psychosis.ConclusionsSUSE features good psychometric qualities and offers an empirical acquisition to subjective assessment of psychosis. The results highlight the significance of subjective meaning making in psychoses and support a more biographical and in-depth psychological orientation for treatment.


2018 ◽  
pp. 61-67

Experiencia pedagógica en la implementación de la clase invertida en el proceso de formación académica Zeidy Sandra López Collazo, Andrés Rodríguez Jiménez, Yosdey Dávila Valdés Universidad de Artemisa, Código Postal: 33700, Cuba Resumen El presente artículo revela la experiencia pedagógica en la implementación de la metodología de Flipped Classroom o clase invertida en la formación académica de la segunda edición del programa de la Maestría en Didáctica que se desarrolla en la Universidad de Artemisa, Cuba. Todo ello sustentado en la aplicación de métodos del nivel teórico que permitieron sistematizar los referentes teórico-metodológicos acerca de la Flipped Classroom. Esta implementación se desarrolló en el curso de Metodología de la Investigación Educativa, particularmente en el tema correspondiente a La tesis como un tipo de documento científico, Para ello se dispuso un material audiovisual que los aspirantes debían visualizar independientemente, con la ayuda de una guía de observación que se les facilitó. La valoración del impacto sobre el proceso de enseñanza-aprendizaje se realizó mediante una entrevista grupal en la que todos los aspirantes pudieron expresar abiertamente, ante el colectivo de aspirantes y profesores, sus opiniones y criterios en relación con la metodología empleada. También se aplicó una encuesta para que cada estudiante evaluara sus niveles de satisfacción en este sentido. A partir de las respuestas a dicha encuesta se determinaron las medianas de los diferentes indicadores explorados mediante la estadística inferencial y el empleo del Coeficiente de Correlación Multidimensional rpj, como procedimiento lógico aceptado por la Teoría Clásica de los Test para determinar el grado de objetividad de los criterios emitidos. Los resultados obtenidos evidencian una tendencia a elevados niveles de satisfacción en los diferentes aspectos explorados. Descriptores: Aprendizaje inverso, clase invertida, integración, aprendizaje audiovisual Abstract This article reveals the pedagogical experience in the implementation of the Flipped Classroom methodology or inverted class in the academic formation of the second edition of the Master's program in Didactics that takes place at the University of Artemisa, Cuba. All this is based on the application of theoretical level methods that allowed systematizing the theoretical-methodological references about the Flipped Classroom. This implementation was developed in the course of Educational Research Methodology, particularly in the topic corresponding to the thesis as a type of scientific document, for which an audiovisual material was available that the candidates had to visualize independently, with the help of a guide of observation that was provided. The assessment of the impact on the teaching-learning process was carried out through a group interview in which all the applicants were able to openly express, before the group of aspirants and professors, their opinions and criteria in relation to the methodology used. A survey was also applied so that each student could evaluate their levels of satisfaction in this regard. Based on the responses to this survey, the medians of the different indicators explored through inferential statistics and the use of the Multidimensional Correlation Coefficient rpj were determined, as a logical procedure accepted by the Classical Test Theory to determine the degree of objectivity of the criteria issued. The results obtained show a tendency to high levels of satisfaction in the different aspects explored. Keywords: Flip teaching, Flipped Classroom, integration, audiovisual learning


Author(s):  
Stephanie J. Slater

<p>The Test Of Astronomy STandards (TOAST) is a comprehensive assessment instrument designed to measure students general astronomy content knowledge. Built upon the research embedded within a generation of astronomy assessments designed to measure single concepts, the TOAST is appropriate to measure across an entire astronomy course. The TOASTs scientific content represents a consensus of expert opinion about what students should know from three different groups: the American Association for the Advancement of Science, the National Research Council, and the American Astronomical Society. The TOASTs reliability and validity are established by results from Cronbach alpha and classical test theory analyses, a review for construct validity, testing for sensitivity to instruction, and numerous rounds of expert review. As such the TOAST can be considered a valuable tool for classroom instructors and discipline based education researchers in astronomy across a variety of learning environments.</p>


Methodology ◽  
2011 ◽  
Vol 7 (3) ◽  
pp. 103-110 ◽  
Author(s):  
José Muñiz ◽  
Fernando Menéndez

Current availability of computers has led to the use of a new series of response formats that are an alternative to the classical dichotomic format, and to the recovery of other formats, like the case of the answer-until-correct (AUC) format, whose efficient administration requires this kind of technology. The goal of the present study is to determine whether the use of the AUC format improves test reliability and validity in comparison to the classical dichotomic format. Three samples of 174, 431, and 1,446 Spanish students from secondary education, professional training, and high school, ages between 13 and 20 years, were used. A 100-item test and a 25-item test that assessed knowledge of Universal History were used, both tests administered by Internet with the AUC format. There were 56 experimental conditions, resulting from the manipulation of eight scoring models and seven test lengths. The data were analyzed from the perspective of the Classical Test Theory and also with Item Response Theory (IRT) models. Reliability and construct validity, analyzed from the classic perspective, did not seem to improve significantly when using the AUC format; however, when assessing reliability with the Information Function obtained by means of IRT models, the advantages of the AUC format versus the dichotomic format become clear. For low levels of the trait assessed, scores obtained with the AUC format provide more information than scores obtained with the dichotomic format. Lastly, these results are commented on, and the possibilities and limits of the AUC format in highly computerized psychological and educational contexts are analyzed.


Author(s):  
David L. Streiner

This chapter discusses the two major theories underlying scale development: classical test theory, which has dominated the field for the past century, and item response theory, which is more recent. It begins by summarizing the history of measurement, first of physical and physiological parameters and later of intelligence. This is followed by the steps involved in developing a scale: creating the items, determining if they fully span the construct of interest while at the same time not including irrelevant content, and assessing the usability of the items (whether they are understood correctly, whether they are free of jargon, if they avoid negatively worded phrases, etc.). The chapter then describes how to establish the reliability and validity of the scale—what are called the psychometric properties of the scale. It concludes by discussing some of the shortcomings with classical test theory, how item response theory attempts to address them, and the degree to which it has been successful in this regard. This chapter should be useful for those who need to evaluate existing scales as well as for those wanting to develop new scales.


PLoS ONE ◽  
2021 ◽  
Vol 16 (7) ◽  
pp. e0254984
Author(s):  
Mayank Jayaram ◽  
Chang Wang ◽  
Lu Wang ◽  
Kevin C. Chung

Introduction The Michigan Hand Outcomes Questionnaire (MHQ) is a patient-reported outcome measure previously validated in patients with rheumatoid arthritis (RA) using classical test theory. Rasch analysis is a more rigorous method of questionnaire validation that has not been used to test the psychometric properties of the MHQ in patients with RA. The objective of this study is to evaluate the validity and reliability of the MHQ for measuring outcomes in patients with RA with metacarpophalangeal joint deformities. Methods We performed a Rasch analysis using baseline data from the Silicone Arthroplasty in Rheumatoid Arthritis (SARA) prospective cohort study. All domains were tested for threshold ordering, item fit, targeting, differential-item functioning, unidimensionality, and internal consistency. Results The Function and Work domains showed excellent fit to the Rasch model. After making adjustments, the Pain, Activities of Daily Living (ADL) and Satisfaction domains also fulfilled all Rasch model criteria. The Aesthetics domain met the majority of Rasch criteria, but could not be tested for unidimensionality. Conclusions After collapsing disordered thresholds and removing misfitting items, the MHQ demonstrated reliability and validity for assessing outcomes in patients with RA with metacarpophalangeal joint deformities. These results suggest that interpreting individual domain scores may provide more insight into a patient’s condition rather than analyzing an overall MHQ summary score. However, more Rasch analyses are needed in other RA populations before making adjustments to the MHQ.


Sign in / Sign up

Export Citation Format

Share Document