scholarly journals A Systematic Review of Cognitive Diagnostic Assessment and Modeling through Concept Mapping

2021 ◽  
Vol 2 (1) ◽  
pp. p41
Author(s):  
Jingshun Zhang ◽  
Eunice Jang ◽  
Saad Chahine

Traditional assessments are typically constructed on logical taxonomies and content specifications but lack explicit cognitive models of the processes and problem-solving strategies that underlie student performance. Cognitive Diagnostic Assessment (CDA) fills this gap by combining cognitive science and psychometrics. CDA is in its infancy, but over 1,000 relevant studies have been conducted in this area during the last 20 years. Facing these complicated studies, many beginners struggle to understand the whole picture of CDA. This paper systematically reviews the literature on CDA and relevant cognitive diagnosis models (CDMs) with the application of a concept mapping technology. Concept mapping is graphical representation of concepts and their relationships. Its use in this study allows researchers and students to gain in-depth knowledge about CDA and CDM and identify areas of future research.

2021 ◽  
Vol 11 (1) ◽  
Author(s):  
Yeon-Sook Yi

AbstractIn cognitive diagnostic modeling research, one area that has not had enough research interests is remedial learning or instruction based on the information provided by cognitive diagnostic assessment (CDA). The present study tries to address this research gap by looking into the usefulness of the fine-grained score reports based on CDA in two different ways, i.e., a post-test and a survey inquiring about the perceived effectiveness of the score report that provided the skill profile of individual students. Another significance of the current research is that it attempted to introduce cognitive diagnostic assessment into a regular school exam unlike most previous studies that retrofitted to the existing tests. College students in Korea participated in the study, who were encouraged to do self-regulated learning utilizing the detailed information in the CDA-based score report. The results of the post-test and the survey were positive overall, supporting the utility of CDA-generated performance reports. The article ends with some suggestions for future research based on the limitations of the study.


2021 ◽  
Vol 25 (1) ◽  
pp. 37-53
Author(s):  
Brooke Borgognoni ◽  
Jan LeBlanc Wicks

This survey of faculty advisers examined major variables and findings of past research on student-run agencies using organizational theory. Larger agencies appeared to offer training in more formalized business procedures among a more diverse client base, found in previous research to be helpful to student-run agency graduates now on the job. Hopefully, results will help future researchers identify which factors may best facilitate specific student performance outcomes at agencies of all types and sizes.


2021 ◽  
pp. 026553222199547
Author(s):  
Shangchao Min ◽  
Lianzhen He

In this study, we present the development of individualized feedback for a large-scale listening assessment by combining standard setting and cognitive diagnostic assessment (CDA) approaches. We used the performance data from 3358 students’ item-level responses to a field test of a national EFL test primarily intended for tertiary-level EFL learners. The results showed that proficiency classifications and subskill mastery classifications were generally of acceptable reliability, and the two kinds of classifications were in alignment with each other at individual and group levels. The outcome of the study is a set of descriptors that describe each test taker’s ability to understand certain level of oral texts and his or her cognitive performance. The current study, by illustrating the feasibility of combining standard setting and CDA approaches to produce individualized feedback, contributes to the enhancement of score reporting and addresses the long-standing criticism that large-scale language assessments fail to provide individualized feedback to link assessment with instruction.


This article addresses the 3-dimensional mixed intuitionistic fuzzy assignment problems (3D-MIFAPs). In this article, firstly, the author formulates an assignment problem (AP) and assumes the parameters are in uncertainty with hesitation. Secondly, based on the nature of the parameter the author defines various types of solid assignment problem (SAP) in uncertain environment. Thirdly, to solve 3D-MIFAP the PSK method for finding an optimal solution of fully intuitionistic fuzzy assignment problem (FIFAP) is extended by the author. Fourthly, the author presents the proofs of the proposed theorems and corollary. Fifthly, the proposed approach is illustrated with three numerical examples and the optimal objective value of 3D-MIFAP is obtained in the form of intuitionistic fuzzy number and the solution is checked with MATLAB and their coding are also given by the author. Sixthly, the author presents the comparison results and their graphical representation, merits and demerits of the proposed and existing methods and finally the author presents conclusion and future research directions.


2021 ◽  
Vol 8 ◽  
Author(s):  
M. Katie Sheats ◽  
Megan J. Burke ◽  
James B. Robertson ◽  
Katherine E. Fiebrandt ◽  
Callie A. Fogle

Entrustable Professional Activities (EPAs) are units of activity that early-stage professionals perform in the workplace that necessitate simultaneous integration of multiple competencies. EPA #6 requires students to perform a common surgical procedure on a stable patient, including pre-operative and post-operative management. Castration is one of the most common surgeries performed by equine primary care practitioners and is considered an “entry-level competency” for veterinary graduates entering equine private practice, however, to our knowledge there are no equine castration models available for veterinary student education. Therefore, we developed an inexpensive, low-fidelity model of equine field castration and evaluated it using a mixed-methods approach. Two different groups of students, with or without model experience, completed surveys before and after live horse castration. Students who used the model also completed model specific surveys. Videos of the students completing the model were evaluated by at least two different equine veterinary faculty using a 15-point rubric, and inter-rater reliability of the rubric was determined. After completing the model, students reflected on strengths and weaknesses of their performance. From our student survey results, we determined that student attitudes toward the model were mostly positive. Interestingly, there were several student attitudes toward the model that became significantly more favorable after live horse castration. Prior to live horse castration, there was no significant difference in confidence in model vs. no-model groups. Following live horse castration, students who used the model had higher confidence in procedure preparation and hand-ties than students who did not use the model, but they had lower scores for confidence during patient recovery. When reflecting on model castration, students most commonly cited preparation and surgical description as strengths, and ligature placement and hand-ties as weaknesses. Experts provided several suggestions to improve the model, including incorporation of emasculators and the need for better model stabilization. Our findings suggest that both students and veterinary educators feel that this low-fidelity model has educational value. Rubric performance metrics were favorable, but additional steps are needed to improve grading consistency among educators. Future research will determine whether student performance on the model is predictive of competence score during live-horse castration.


2020 ◽  
Author(s):  
LaTasha R Holden ◽  
Michelle LaMar ◽  
Malcolm Bauer

The goal of the present work is to build a foundation for understanding cognition and decision-making processes in innovative assessment contexts. Specifically, we will assess students’ Cross-Cultural Competence (3C: see Thomas et al., 2008) through a social simulation game. The present work will use Mindset (i.e., individuals beliefs about whether ability is fixed or changeable, see Dweck, 2006) to ground the project in theory because it has been shown to be a powerful motivator for decision-making and behavior in learning and achievement (Dweck & Leggett; 1988; Dweck, 1999), and in cross-cultural contexts (Dweck, 2012). The novel contribution of this paper is to apply Mindset theory to social situations requiring 3C, thus proposing the notion of cultural mindsets—defined here as the set of beliefs including affect, cognition, and behavior people bring to cross-cultural contexts. In cultural mindset, affect and cognition govern the ease with which people adapt, learn, and update cultural information. Additionally, we argue that cultural mindsets are important mechanisms involved in navigating cross-cultural situations effectively and should be considered more in future research. In order to understand how cultural mindset affects student performance, we will apply a computational cognitive modeling approach using Markov decision process (MDP) models. The MDP approach is appropriate for sequential decision-making in non-deterministic environments—as actions are chosen as part of a plan to achieve goals with the knowledge that some action effects will be probabilistic.


2021 ◽  
Vol 50 (1) ◽  
Author(s):  
Scott Roy Douglas ◽  
Michael Landry

Because of the large number of post-secondary English for academic purposes (EAP) programs and the varying ways they are structured, it can be difficult to identify how a particular program fits within the overall landscape of university education.  To identify general trends across Canada, the webpages for 74 EAP programs at 50 public English-medium universities were examined for key information related to each program.  Data analysis included descriptive statistics as well as graphical representation.  The results pointed to typical EAP programs that are independent units that offer non-credit courses with some credit options, have international tuition fees around $9,000 per semester, provide approximately 22 hours of instruction per week, and generally require IELTS scores over 5.0 or TOEFL iBT scores over 59 for entry.  These results provide an avenue of comparison and indicate the need for future research to better understand how EAP programming is conceptualized in the Canadian context.


Sign in / Sign up

Export Citation Format

Share Document