scholarly journals EVALUATING THE USE OF MCQ AS AN ASSESSMENT METHOD IN A MEDICAL SCHOOL FOR ASSESSING MEDICAL STUDENTS IN THE COMPETENCE-BASED CURRICULUM

Author(s):  
Mitayani Purwoko ◽  
Trisnawati Mundijo

Background: Student’s cognitive ability could be assessed using MCQ. The aim of this study was to evaluate the quality of MCQ as an assessment method in Medical Faculty of Muhammadiyah University Palembang. Method: This study was designed as a cross sectional descriptive observational study. Sample was MCQ assessment in Genetics and Molecular Biology Module for academic year 2013/2014 until 2015/2016 for total 299 questions. Item analysis was done manually.Results: The item analysis showed that 61.2% questions were recall-type question. This situation showed that the construction of the question was not good and only testing the lower cognitive area. There was 45.2% ideal question with 30-70% difficulty index and 23.1% questions whom distractor efficiency was 100%. Half of the questions (56.2%) should  be revised. This revision-needed questions distributed equally into easy, ideal, and hard level of difficulty. Revision-needed questions had lower distractor efficiency mean compared to good questions. Conclusion: MCQ as an assessment method do not reach maximum target yet because there were many questions that should be revised. Faculty should enhance the development of the lecturer in writing the good MCQs. 

2017 ◽  
Vol 7 (1) ◽  
pp. 2-7
Author(s):  
Md Ahsan Habib ◽  
Humayun Kabir Talukder ◽  
Md Mahbubur Rahman ◽  
Shahnila Ferdousi

Multiple choice questions (MCQs) have considerable role in the preclinical medical assessment, both formative as well as summative. This cross sectional descriptive study was conducted to observe the quality of MC items (completion type) of anatomy, biochemistry and physiology used in preclinical undergraduate medical examinations of 2012 and 2013 of a public university of Bangladesh. Each MC item had a stem and 5 options, and 1200 options were analyzed for difficulty and discrimination indices. Total 556 options were false statements (distracters) and were analyzed to observe their effectiveness as distracter. The study revealed that 18.67% of options were with appropriate difficulty (0.660.80). Highest frequency (43.5%) of difficulty indices was in easy class interval (0.911). Over all frequencies of items of three subjects in the ascending order were difficult, appropriate, marginal and easy as per their difficulty indices. Satisfactory or better discrimination indices (=0.20) were observed in 29.33% options. The mean difficulty and discrimination indices observed were respectively 0.82±0.18 (95% confidence interval [CI] 0.81 to 0.83) and 0.13±0.14 (95% CI 0.122 to 0.138). Out of the options, 6.75% had negative discrimination indices. Items with difficulty index around 0.60 had maximum discriminatory power (up to 0.68) and more difficult as well as easy items had less discriminatory ability. Out of the distracters 83.45% were observed effective and the mean effectiveness was 22.3±18.7% (95% CI 20.75% to 23.85%). The study recommended using the method and findings to improve the quality of the items leading to development of a standard Question Bank.Bangladesh Journal of Medical Education Vol.7(1) 2016: 2-7


2019 ◽  
Vol 09 (03) ◽  
pp. 210-213
Author(s):  
Sadia Suboohi ◽  
Saba Pario ◽  
Ghazala Nasim ◽  
Sughra Abbasi ◽  
Shahanaz Hassan Siddiqui

Objectives: The objective was to determine the frequency of Premenstrual Syndrome and its association with progression of academic years among the medical students. Study Design and Setting: A cross sectional study was conducted at United Medical and Dental College Karachi from January to June 2018 among 150 female medical students. Methodology: A structured questionnaire was designed to assess the demographic characteristics and symptoms of PMS if any experienced by the participants included in the study. The severity symptoms of PMS were marked by the participants on the behalf of their impact on their routine activity & performance, ranking from mild, moderate to severe. Data was analyzed using SPSS version 20. Results: The frequency of PMS was reported as 39% in the study participants among them 79.31% showed mild form, 17.24% showed moderate and 3.44% were diagnosed with severe PMS. Increased frequency of PMS in female medical students was observed to be associated with progression of their academic years, with final year students having highest percentage. Academic year of MBBS, type of accommodation, and occupation of mother, menstrual cycle regularity and history of PMS in family were found to be statistically significant risk factors associated with PMS. Conclusion: Premenstrual syndrome is a prevalent health issue in medical students, increasing year to year during their studies, which may unfavorably have affects on their quality of life and overall performance.


2020 ◽  
Vol 10 (2) ◽  
Author(s):  
Imtiaz Uddin ◽  
Iftikhar Uddin ◽  
Izaz Ur Rehman ◽  
Muhammad Siyar ◽  
Usman Mehboob

Background: MCQs type assessment in medical education is replacing old theory style. There are concerns regarding the quality of the Multiple Choice Questions.Objectives: To determine the quality of Multiple Choice Questions by item analysis. Material and Methods: Study was a cross sectional descriptive .Fifty Multiple Choice Questions in the final internal evaluation exams in 2015 of Pharmacology at Bacha khan Medical College were analyzed. The quality of each Multiple Choice Questions item was assessed by the Difficulty index (Dif.I), Discriminative Index (D.I) and Distracter Efficiency (D.E).Results: Multiple Choice Questions that were of moderate difficulty were 66%. Easy were 4% and high difficulty were 30%.Reasons for high difficult Multiple Choice Questions were analyzed as Item Writing Flaws 41%, Irreverent Difficulty 36% and C2 level 23%. Discrimination Index shows that majority of MCQs were of Excellent Level (DI greater than 0.25) i.e 52 , Good 32% . (DI=2.15-0.25), Poor 16%. MCQs Distracter Effectiveness (DE)= 4, 3,2,1 were 52%, 34%, 14%, and 0% respectively. Conclusion: Item analysis gives us different parameters with reasons to recheck MCQ pool and teaching programme. High proportions of difficult and sizable amount of poor discriminative indices MCQs were the finding in this study and need to be resolved


2017 ◽  
Author(s):  
Abdulaziz Alamri ◽  
Omer Abdelgadir Elfaki ◽  
Karimeldin A Salih ◽  
Suliman Al Humayed ◽  
Fatmah Mohammed Ahmad Althebat ◽  
...  

BACKGROUND Multiple choice questions represent one of the commonest methods of assessment in medical education. They believed to be reliable and efficient. Their quality depends on good item construction. Item analysis is used to assess their quality by computing difficulty index, discrimination index, distractor efficiency and test reliability. OBJECTIVE The aim of this study was to evaluate the quality of MCQs used in the college of medicine, King Khalid University, Saudi Arabia. METHODS Design: Cross sectional Study design Setting, Materials and methods Item analysis data of 21 MCQs exams were collected. Values for difficulty index, discrimination index, distractor efficiency and reliability coefficient were entered in MS excel 2010. Descriptive statistic parameters were computed. RESULTS Twenty one tests were analyzed. Overall, 7% of the items among all the tests were difficult, 35% were easy and 58% were acceptable. The mean difficulty of all the tests was in the acceptable range of 0.3-0.85. Items with acceptable discrimination index among all tests were 39%-98%. Negatively discriminating items were identified in all tests except one. All distractors were functioning in 5%-48%. The mean functioning distractors ranged from 0.77 to 2.25. The KR-20 scores lie between 0.47 and 0.97 CONCLUSIONS Overall, the quality of the items and tests was found to be acceptable. Some items were identified to be problematic and need to be revised. The quality of few tests of specific courses was questionable. These tests need to be revised and steps taken to improve this situation.


2021 ◽  
pp. 9-10
Author(s):  
Bhoomika R. Chauhan ◽  
Jayesh Vaza ◽  
Girish R. Chauhan ◽  
Pradip R. Chauhan

Multiple choice questions are nowadays used in competitive examination and formative assessment to assess the student's eligibility and certification.Item analysis is the process of collecting,summarizing and using information from students' responses to assess the quality of test items.Goal of the study was to identify the relationship between the item difficulty index and item discriminating index in medical student's assessment. 400 final year medical students from various medical colleges responded 200 items constructed for the study.The responses were assessed and analysed for item difficulty index and item discriminating power. Item difficulty index an item discriminating power were analysed by statical methods to identify correlation.The discriminating power of the items with difficulty index in 40%-50% was the highest. Summary and Conclusion:Items with good difficulty index in range of 30%-70% are good discriminator.


Hypertension ◽  
2017 ◽  
Vol 70 (suppl_1) ◽  
Author(s):  
Lilian S Costa ◽  
Marina C Marins ◽  
Jocasta C Ansel ◽  
Carolina P Tavares ◽  
Fernanda T Queiroz ◽  
...  

Introduction: Medical students, susceptible to sleep disorders, have irregular sleep-awake cycle, with repercussions on the quality of life and reduced academic performance, often with greater incidence of psychiatric disorders, estimated at 15% to 25% during your academic training. Objective: To evaluate the sleep habits in students of medical school in a private college of Rio de Janeiro, Brazil. Method: This subset study is a part of an observational study with cross-sectional delineation, with data collected through the application of an anonymous questionnaire, where they were asked about the number (and modification) of hours they sleep daily, in addition to reports of “stress and anxiety”. These data collected formed the basis of an instrument for assessing the quality of life on the medical students of this College. Results: We analyzed data from 481 students: 82 (17%) at the first year, 118 (24.5%) at the second year, 99 (20.6%) at the third, 64 (13.3%) and 118 (24.5%) within the fifth and sixth years. The average age was 21.7 years (16-42) and 306 (63.6%) of female gender. As for the hours of sleep, 445 students (92.5%) report 5 to 8 hours of sleep, and 216 (44.9%) a minimum of 6 hours. In the sleep of the weekends, 394 (81.9%) reported change in the number of hours and, 313 (65.1%) referred to a reduction after the entrance into college. It was reported "some level of stress and anxiety,“ not related to the least number of hours sleepping (0.07). Comparing the data obtained among the 199 students of the first and second years (62.8% female-group A) to 117 at fifth and sixth years (70.9% female-group B), we observed similarity in relation to (1) number of 5 to 8 hours sleepping (A 92.9% x 90.5% B), (2) change the hours of sleepping on the weekends (A 81.9% x 79.5% B), and (3) reduction of sleepping hours after the entrance into College (A 81.9% x 78.6% B). With regard to the report of "stress and anxiety”, we observed statistically significant difference between the groups (A 100% x 88% B, p < 0.03). Conclusion: The change in lifestyle imposed on joining a new school learning model, generates anxiety and loss of sleep hours among students. The development of resilience and adaptation to change, both individual and institutional, may have been responsible to varying degrees of stress.


2021 ◽  
Vol 15 (8) ◽  
pp. 2235-2239
Author(s):  
Farrukh Sarfraz ◽  
Fahad Sarfraz ◽  
Imran Jawad ◽  
Mohammad Zia-Ul-Miraj ◽  
Rizwan Zafar Ahmad ◽  
...  

Background: To assess the competency of a student different tools are used. Since its introduction in 1975 by Dr. Harden and his team, OSCE has gained tremendous strides to assess the clinical competencies. Since 1975 onward OSCE has been very successfully used to assess the clinical competencies of medical student globally. OSCE is an assessment tool in which student is observed for performance of different tasks at specified stations. In the current study perception of medical students about OSCE examination was done which shall give room for positive criticism and further improvement of the system where ever required. Objective: To expedite view of final year MBBS students of Azra Naheed College about OSCE Material and Method Study design: Quantitative, cross sectional study. Settings: Azra Naheed College, Lahore. Duration: Six months i.e. 1st July2020 to 31st December 2020 Data Collection procedure: After an informed consent and appropriate briefing, the questionnaire was distributed among the final year medical students of Azra Naheed Medical College. Questionnaire developed by Russell et al was used. Results: Out of 148 students who participated in the study, 66(45%) students were females and 82(55%) were male. Majority of the students were satisfied with the quality of the exam. Consensus about the quality of exam was that, 29.7% were aware about the nature of the exam, 52.7% were satisfied that the syllabus taught was asked in the exam, 58.1% were satisfied about the time allocation for each station. Majority i.e. 60% considered OSCE an exam of practical nature which is not biased by gender or ethnicity. More than 50% of the students were satisfied with the standard of the exam. At the same time more than 50% students considered essay exam the easiest format of assessment. However, OSCE was considered to be fairest form of assessment 73%. 68.9% perceived that learning is enhanced by MCQs rather than other formats of assessment. Conclusion: To conclude this study, it is very much clear that the perception of students about OSCE as an assessment tool was very encouraging, as it not only provided them the opportunity to highlight their weaknesses but also helped them to perform well in the exam, manage time during exam and to overcome them stress which influenced their results. Key words: OSCE, Objective, Examinations, Clinical skills, qualitative analysis


Author(s):  
Muhammad Shahid Iqbal ◽  
Salah-Ud-Din Khan ◽  
Eldowaik Mohamed Salah Saad ◽  
Muhammad Zahid Iqbal

Objective: The objective of the study was to evaluate the knowledge of ALS among students in a university in Malaysia. Methods: A cross-sectional and observational study was performed among the students of three different healthcare provider faculties (Medical, Pharmacy and Dental) in a university with the help of pre-validated research questionnaire. The Statistical Package for Social Science (SPSS) Version 24.0 was used to analyze and present the data. Results: A total of 268 university students from three faculties participated in the current study. The medical faculty students and final year students had more appropriate knowledge towards the ALS. Conclusion: Overall appropriate knowledge was observed among the studied faculty students. The present study concluded that medical students had adequate knowledge of ALS than the other two faculty students.


2019 ◽  
Vol 4 (1) ◽  
pp. 200
Author(s):  
Nadya Khairiyah Syafti ◽  
Rahmawati Darussyamsu ◽  
Ganda Hijrah Selaras ◽  
Syamsurizal Syamsurizal

Researcher conducted a study with the aim to determine the quality of items in terms of analysis: 1) reliability, 2) the validity of the content and empirical, 3) distinguishing features, 4) level of difficulty, and 5) the function of detractors. This research is a descriptive study. Based on the results of data analysis, the result for the review of aspects: 1)reliability packet A and B, belong to the category high,2)the validity of the content packet A & B, not fulfilling all criteriaand then validity empirically package A, 57.5% are invalid matter and packet B,65% are invalid matte, 3) the level of difficulty package A, 27 questions (67,5%) good category and 13 questions (32,5%) not good category while package B, 27 questions (67,5%) good category and 13 questions (32,5%) not good category. 4) different power packet A, obtained with different power values, namely 35 questions (87,5%) including good categories and 5 questions (12,5) which do not belong to the good category while package B, 29 questions (72,5%) is included in category and 11 questions (27,5%) which do not belong to category, 5) function options packet A, for options that are not qualified is 37% and the quality is 63% and packet B,for options that are not qualified is 31% and the quality is 69%. It can be concluded that the end of the semester exam subjects biology grade XI of the school year 2017/2018 in the se-kecamatan IV Jurai not meet both criteria.


Sign in / Sign up

Export Citation Format

Share Document