scholarly journals Do Item Writing Best Practices Improve Multiple Choice Questions for University Students?

2018 ◽  
Author(s):  
Fabio Bertoni ◽  
Lee A. Smales ◽  
Bill Trent ◽  
Gerhard Van de Venter
Keyword(s):  
Best Practices ◽  
University Students ◽  
Multiple Choice ◽  
Multiple Choice Questions ◽  
Item Writing

scholarly journals The frequency of item writing flaws in multiple-choice questions used in high stakes nursing assessments

2006 ◽  
Vol 26 (8) ◽  
pp. 662-671 ◽  
Author(s):  
Marie Tarrant ◽  
Aimee Knierim ◽  
Sasha K. Hayes ◽  
James Ware
Keyword(s):  
Multiple Choice ◽  
Multiple Choice Questions ◽  
High Stakes ◽  
Item Writing

Assessment of Item-Writing Flaws in Multiple-Choice Questions

2013 ◽  
Vol 29 (2) ◽  
pp. 52-57 ◽  
Author(s):  
Rosemarie Nedeau-Cayo ◽  
Deborah Laughlin ◽  
Linda Rus ◽  
John Hall
Keyword(s):  
Multiple Choice ◽  
Multiple Choice Questions ◽  
Item Writing

scholarly journals Assessment of Global Health Education: The Role of Multiple-Choice Questions

2021 ◽  
Vol 9 ◽  
Author(s):  
Nathan T. Douthit ◽  
John Norcini ◽  
Keren Mazuz ◽  
Michael Alkan ◽  
Marie-Therese Feuerstein ◽  
...  
Keyword(s):  
Health Education ◽  
Global Health ◽  
Multiple Choice ◽  
International Health ◽  
Biomedical Science ◽  
Multiple Choice Questions ◽  
Global Health Education ◽  
Item Writing ◽  
Difficulty Index

Introduction: The standardization of global health education and assessment remains a significant issue among global health educators. This paper explores the role of multiple choice questions (MCQs) in global health education: whether MCQs are appropriate in written assessment of what may be perceived to be a broad curriculum packed with fewer facts than biomedical science curricula; what form the MCQs might take; what we want to test; how to select the most appropriate question format; the challenge of quality item-writing; and, which aspects of the curriculum MCQs may be used to assess.Materials and Methods: The Medical School for International Health (MSIH) global health curriculum was blue-printed by content experts and course teachers. A 30-question, 1-h examination was produced after exhaustive item writing and revision by teachers of the course. Reliability, difficulty index and discrimination were calculated and examination results were analyzed using SPSS software.Results: Twenty-nine students sat the 1-h examination. All students passed (scores above 67% - in accordance with University criteria). Twenty-three (77%) questions were found to be easy, 4 (14%) of moderate difficulty, and 3 (9%) difficult (using examinations department difficulty index calculations). Eight questions (27%) were considered discriminatory and 20 (67%) were non-discriminatory according to examinations department calculations and criteria. The reliability score was 0.27.Discussion: Our experience shows that there may be a role for single-best-option (SBO) MCQ assessment in global health education. MCQs may be written that cover the majority of the curriculum. Aspects of the curriculum may be better addressed by non-SBO format MCQs. MCQ assessment might usefully complement other forms of assessment that assess skills, attitude and behavior. Preparation of effective MCQs is an exhaustive process, but high quality MCQs in global health may serve as an important driver of learning.

scholarly journals Perceived impact of extra-curricular activities on foreign language learning in Canadian and Russian university contexts

2017 ◽  
Vol 11 (1) ◽  
pp. 43-65 ◽  
Author(s):  
Veronika Makarova ◽  
Anna Reva
Keyword(s):  
Foreign Language ◽  
University Students ◽  
Language Learning ◽  
Multiple Choice ◽  
Foreign Language Learning ◽  
Multiple Choice Questions ◽  
Chi Square ◽  
Extra Curricular Activities ◽  
Key Word ◽  
Perceived Impact

This paper surveys language-related extra-curricular activities (ECA) attended by university students in Canada and Russia. Very little information is available about ECA in both countries. The study aimed to gather data about extra-curricular activities in Canada and Russia and to investigate the perceived effect of participation in extra-curricular activities on language learning by university students in these countries. The study employed a questionnaire-based survey as a major research method. The questionnaire constructed by the authors included ‘yes/no’, multiple choice and open-ended questions. The total of 119 university students from both countries participated in the study. The participants’ responses to yes/no and multiple choice questions were entered on SPSS charts for descriptive statistics and an analysis across the groups (chi-square tests). The responses to open-ended questions were analyzed using key-word method. The results indicate that only about 1/3 of university students in both countries had some experience with ECAs. Russian students were more aware of the range of ECAs available through their universities. The array of language-related ECAs was different across the countries: Canadian students mostly attended ECAs that were offered through their universities, and Russian students – outside their universities. There was an agreement between the respondents from both countries that trips abroad were the most efficient form of ECAs. The evaluation of some other specific forms of ECAs showed significant differences across the two participant groups. The majority of respondents from both countries placed a high value on ECAs and thought that ECAs were beneficial for their language skills development.

scholarly journals Item Analysis of Multiple Choice Questions in Pharmacology

2020 ◽  
Vol 10 (2) ◽  
Author(s):  
Imtiaz Uddin ◽  
Iftikhar Uddin ◽  
Izaz Ur Rehman ◽  
Muhammad Siyar ◽  
Usman Mehboob
Keyword(s):  
Medical Education ◽  
Item Analysis ◽  
Multiple Choice ◽  
Multiple Choice Questions ◽  
Cross Sectional ◽  
Teaching Programme ◽  
Medical College ◽  
Item Writing ◽  
Difficulty Index

Background: MCQs type assessment in medical education is replacing old theory style. There are concerns regarding the quality of the Multiple Choice Questions.Objectives: To determine the quality of Multiple Choice Questions by item analysis. Material and Methods: Study was a cross sectional descriptive .Fifty Multiple Choice Questions in the final internal evaluation exams in 2015 of Pharmacology at Bacha khan Medical College were analyzed. The quality of each Multiple Choice Questions item was assessed by the Difficulty index (Dif.I), Discriminative Index (D.I) and Distracter Efficiency (D.E).Results: Multiple Choice Questions that were of moderate difficulty were 66%. Easy were 4% and high difficulty were 30%.Reasons for high difficult Multiple Choice Questions were analyzed as Item Writing Flaws 41%, Irreverent Difficulty 36% and C2 level 23%. Discrimination Index shows that majority of MCQs were of Excellent Level (DI greater than 0.25) i.e 52 , Good 32% . (DI=2.15-0.25), Poor 16%. MCQs Distracter Effectiveness (DE)= 4, 3,2,1 were 52%, 34%, 14%, and 0% respectively. Conclusion: Item analysis gives us different parameters with reasons to recheck MCQ pool and teaching programme. High proportions of difficult and sizable amount of poor discriminative indices MCQs were the finding in this study and need to be resolved

scholarly journals MULTIPLE CHOICE QUESTIONS;

2017 ◽  
Vol 24 (09) ◽  
pp. 1409-1414
Author(s):  
Muhammad Zafar Iqbal ◽  
Shumaila Irum ◽  
Muhammad Sohaib Yousaf
Keyword(s):  
Problem Solving ◽  
Descriptive Analysis ◽  
Multiple Choice ◽  
Development Program ◽  
Faculty Members ◽  
Multiple Choice Questions ◽  
Cross Sectional ◽  
Medical College ◽  
Item Writing

Objectives: The main objective of this study was to judge the quality of MCQs interms of their cognition level and item writing flaws, developed by the faculty of a public sectormedical college. Setting: This study was conducted in Sheikh Zayed Medical College, RahimYar Khan. Duration with Dates: Data was collected between June 2014 to March 2015 andthis study was completed in July 2016. Sample Size: A sample of 500 MCQs collected from25 faculty members were included in the study. Study Design: Quantitative method. StudyType: Cross sectional descriptive analysis. Material and Methods: This quantitative study wasconducted in Sheikh Zayed Medical College Rahim Yar Khan over six months period after theapproval of the study proposal. Every faculty member is supposed to write 25 MCQs in order tobecome supervisor. I collected 500 multiple choice questions from 25 faculty members readyfor submission to CPSP. The quality of all MCQs was checked in terms of item writing flawsand cognition level by panel of experts. Results: Absolute terms were observed in 10(2%),vague terms in 15(3%), implausible distracters in 75(15%), extra detail in correct option 15(3%),unfocused stem 63(12.6%), grammatical clues 39(7.8%), logical clues 18(3.6%), word repeats19(3.8%), >then one correct answer 21(4.2%), unnecessary information in stem 37(7.4%),lost sequence in data 15(3%), all of above16(3.2%), none of above 12(2.4%) and negativestem 23(4.6%). Cognition level l (recall) was observed in 363(72.6%), level ll (interpretation) in115(23%) and level lll (problem solving) in 22(4.4%) items. Total 378(75.6%) flaws were identifiedand four commonest flaws were implausible distracter 75(15%), unfocused stem 63(12.6%),grammatical clues 39(7.8%) and unnecessary information in stem 37(7.4%). Conclusion: It isconcluded that assessment of medical students is very demanding and need of the time. A wellconstructed,peer-reviewed single best type MCQ is best one to complete this task becauseof cost effectiveness, better reliability and computerized marking. It is very important to startfaculty development program in order to decrease the number of item writing flaws and improvecognition level towards problem solving and application of knowledge.

scholarly journals EMPOWERING UNIVERSITY STUDENTS THROUGH ONLINE MULTIPLE CHOICE QUESTIONS

2016 ◽  
Author(s):  
David Biggins ◽  
Elvira Bolat ◽  
Emma Crowley ◽  
Huseyin Dogan ◽  
Mihai Dupac
Keyword(s):  
University Students ◽  
Multiple Choice ◽  
Multiple Choice Questions

scholarly journals The frequency of item writing flaws in multiple-choice questions used in high stakes nursing assessments

2006 ◽  
Vol 6 (6) ◽  
pp. 354-363 ◽  
Author(s):  
Marie Tarrant ◽  
Aimee Knierim ◽  
Sasha K. Hayes ◽  
James Ware
Keyword(s):  
Multiple Choice ◽  
Multiple Choice Questions ◽  
High Stakes ◽  
Item Writing
Sign in / Sign up

Export Citation Format

Share Document