scholarly journals ContExtended Questions (CEQ) to Teach and Assess Clinical Reasoning: A New Variant of F-Type Testlets

2021 ◽  
Vol 2 (1) ◽  
pp. 48-56
Author(s):  
Yavuz Selim Kıyak ◽  
Işıl İrem Budakoğlu ◽  
Serdar Kula ◽  
Özlem Coşkun

This study introduces ContExtended Questions (CEQ), which is a tool both to teach and assess clinical reasoning particularly in the preclinical years, and the web-based program to implement. CEQ consists of text-based case-based multiple-choice questions that provide patient data in a fixed and predetermined sequence. It enables the examinees to develop and reshape their illness scripts by using feedback after every question. Feedback operates to transform the examinee’s failure into a “productive failure”. The preliminary results of the randomized controlled experiment of teaching clinical reasoning to preclinical students through CEQ is quite satisfactory. In the medical education literature, this would be the first time that students, who have no or very limited clinical experience, developed their illness scripts just by taking formative multiple-choice tests. The approach would be named “test-only learning”. The complete results of the experiment and then more experiments in other contexts and domains are necessary to establish a more powerful assessment tool and software. Furthermore, by changing the content of the questions, it is possible to use CEQ in every period of medical education and health professions education.

2021 ◽  
Vol 99 ◽  
pp. 01032
Author(s):  
Svetlana Vlazneva ◽  
Olga Androsova

The article is devoted to assessment tools in teaching economics. The authors distinguish and define four levels of understanding economics: elementary, intermediate, systemic and creative. They describe multiple choice questions and essay questions as two possible assessment tools in teaching economics. Multiple-choice questions are represented as the most popular testing format. The advantages of multiple-choice questions include low grading costs, perceived objectivity and availability of comparative analysis. The authors have developed multiple-choice tests, which measure students’ knowledge at three first levels of understanding economics. They enable instructors to see where exactly the students’ understanding has stopped and provide guidance. The authors conclude that multiple-choice questions can be used to measure the basic levels of students’ understanding economics. In measuring higher levels the essay as an assessment tool has a great potential. The authors highlight the advantages and pitfalls of essay testing in economics.


Author(s):  
Le Thai Hung ◽  
Nguyen Thi Quynh Giang ◽  
Tang Thi Thuy ◽  
Tran Lan Anh ◽  
Nguyen Tien Dung ◽  
...  

Computerized Adaptive Testing - CAT is a form of assessment test which requires fewer test questions to arrive at precise measurements of examinees' ability. One of the core technical components in building a CAT is mathematical algorithms which estimate examinee's ability and select the most appropriate test questions for those estimates. Those mathematical algorithms serve as a locomotive in operating the system of adaptive multiple-choice questions on computers.  Our research aims to develop essential mathematical algorithms to a computerised system of adaptive multiple-choice tests. We also build a question bank of 500 multiple-choice questions standardised by IRT theory with the difficulty level follows the normal distribution satisfying Kolmogorov-Smirnov test, to measure the mathematical ability of students in grade 10. The initial outcome of our experiment of the question bank shows: the question bank satisfies the requirements from a psychometric model and the constructed mathematical algorithms meets the criteria to apply in computerised adaptive testing.


1979 ◽  
Vol 1 (2) ◽  
pp. 24-33 ◽  
Author(s):  
James R. McMillan

Most educators agree that classroom evaluation practices need improvement. One way to improve testing is to use high-quality objective multiple-choice exams. Almost any understanding or ability which can be tested by another test form can also be tested by means of multiple-choice items. Based on a survey of 173 respondents, it appears that marketing teachers are disenchanted with multiple-choice questions and use them sparingly. Further, their limited use is largely in the introductory marketing course even though there are emerging pressures for universities to take a closer look at the quality of classroom evaluation at all levels.


2019 ◽  
Vol 5 (1) ◽  
pp. e000495
Author(s):  
Danielle L Cummings ◽  
Matthew Smith ◽  
Brian Merrigan ◽  
Jeffrey Leggit

BackgroundMusculoskeletal (MSK) complaints comprise a large proportion of outpatient visits. However, multiple studies show that medical school curriculum often fails to adequately prepare graduates to diagnose and manage common MSK problems. Current standardised exams inadequately assess trainees’ MSK knowledge and other MSK-specific exams such as Freedman and Bernstein’s (1998) exam have limitations in implementation. We propose a new 30-question multiple choice exam for graduating medical students and primary care residents. Results highlight individual deficiencies and identify areas for curriculum improvement.Methods/ResultsWe developed a bank of multiple choice questions based on 10 critical topics in MSK medicine. The questions were validated with subject-matter experts (SMEs) using a modified Delphi method to obtain consensus on the importance of each question. Based on the SME input, we compiled 30 questions in the assessment. Results of the large-scale pilot test (167 post-clerkship medical students) were an average score of 74 % (range 53% – 90 %, SD 7.8%). In addition, the tool contains detailed explanations and references were created for each question to allow an individual or group to review and enhance learning.SummaryThe proposed MSK30 exam evaluates clinically important topics and offers an assessment tool for clinical MSK knowledge of medical students and residents. It fills a gap in current curriculum and improves on previous MSK-specific assessments through better clinical relevance and consistent grading. Educators can use the results of the exam to guide curriculum development and individual education.


2012 ◽  
Vol 11 (1) ◽  
pp. 47-57 ◽  
Author(s):  
Joyce M. Parker ◽  
Charles W. Anderson ◽  
Merle Heidemann ◽  
John Merrill ◽  
Brett Merritt ◽  
...  

We present a diagnostic question cluster (DQC) that assesses undergraduates' thinking about photosynthesis. This assessment tool is not designed to identify individual misconceptions. Rather, it is focused on students' abilities to apply basic concepts about photosynthesis by reasoning with a coordinated set of practices based on a few scientific principles: conservation of matter, conservation of energy, and the hierarchical nature of biological systems. Data on students' responses to the cluster items and uses of some of the questions in multiple-choice, multiple-true/false, and essay formats are compared. A cross-over study indicates that the multiple-true/false format shows promise as a machine-gradable format that identifies students who have a mixture of accurate and inaccurate ideas. In addition, interviews with students about their choices on three multiple-choice questions reveal the fragility of students' understanding. Collectively, the data show that many undergraduates lack both a basic understanding of the role of photosynthesis in plant metabolism and the ability to reason with scientific principles when learning new content. Implications for instruction are discussed.


Sign in / Sign up

Export Citation Format

Share Document