scholarly journals Reliability analysis of the objective structured clinical examination using generalizability theory

2016 ◽  
Vol 21 (1) ◽  
pp. 31650 ◽  
Author(s):  
Juan Andrés Trejo-Mejía ◽  
Melchor Sánchez-Mendiola ◽  
Ignacio Méndez-Ramírez ◽  
Adrián Martínez-González
Keyword(s):  
Reliability Analysis ◽  
Clinical Examination ◽  
Generalizability Theory ◽  
Objective Structured Clinical Examination

scholarly journals Neurology objective structured clinical examination reliability using generalizability theory

Neurology ◽  
2015 ◽  
Vol 85 (18) ◽  
pp. 1623-1629 ◽  
Author(s):  
Angela D. Blood ◽  
Yoon Soo Park ◽  
Rimas V. Lukas ◽  
James R. Brorson
Keyword(s):  
Clinical Examination ◽  
Generalizability Theory ◽  
Objective Structured Clinical Examination

scholarly journals Reliability of a viva assessment of clinical reasoning in an Australian pre-professional osteopathy program assessed using generalizability theory

2017 ◽  
Vol 14 ◽  
pp. 1 ◽  
Author(s):  
Brett Vaughan ◽  
Paul Orrock ◽  
Sandra Grace
Keyword(s):  
Student Teaching ◽  
Clinical Examination ◽  
Clinical Reasoning ◽  
Generalizability Theory ◽  
Faculty Members ◽  
Objective Structured Clinical Examination ◽  
Generalizability Coefficient ◽  
Teaching Clinic ◽  
Generalizability Analysis ◽  
Case Based

Clinical reasoning is situation-dependent and case-specific; therefore, assessments incorporating different patient presentations are warranted. The present study aimed to determine the reliability of a multi-station case-based viva assessment of clinical reasoning in an Australian pre-registration osteopathy program using generalizability theory. Students (from years 4 and 5) and examiners were recruited from the osteopathy program at Southern Cross University, Lismore, Australia. The study took place on a single day in the student teaching clinic. Examiners were trained before the examination. Students were allocated to 1 of 3 rounds consisting of 5 10-minute stations in an objective structured clinical examination-style. Generalizability analysis was used to explore the reliability of the examination. Fifteen students and 5 faculty members participated in the study. The examination produced a generalizability coefficient of 0.53, with 18 stations required to achieve a generalizability coefficient of 0.80. The reliability estimations were acceptable and the psychometric findings related to the marking rubric and overall scores were acceptable; however, further work is required in examiner training and ensuring consistent case difficulty to improve the reliability of the examination.

Objective Structured Clinical Examination (OSCE) als kompetenz­orientiertes Prüfungsinstrument in der pflegerischen Erstausbildung

Pflege ◽  
2016 ◽  
Vol 29 (4) ◽  
pp. 193-203 ◽  
Author(s):  
Angelika Beyer ◽  
Adina Dreier ◽  
Stefanie Kirschner ◽  
Wolfgang Hoffmann
Keyword(s):  
Clinical Examination ◽  
Objective Structured Clinical Examination

Zusammenfassung. Hintergrund: Aufgrund der demografischen und epidemiologischen Entwicklung wird die Vermittlung adäquater pflegerischer Kompetenzen in der pflegerischen Ausbildung zunehmend diskutiert. Kompetenzen sind in den Examina angemessen zu überprüfen. Hierfür haben sich international OSCEs bewährt. Ziel: Ziel der vorliegenden Analyse war die Ermittlung von Kompetenzen, die in pflegerischen Erstausbildungen mit OSCEs überprüft werden. Methodik: In internationalen Datenbanken wurden einschlägige Publikationen recherchiert. Analyse-Einschlusskriterium war die Nennung mindestens einer überprüften Kompetenz. Die Kompetenzen wurden – in Anlehnung an den «Fachqualifikationsrahmen Pflege für die hochschulische Bildung» – nach Wissen, Fertigkeiten und Haltung kategorisiert. Ergebnisse: 36 Artikel erfüllten das Einschlusskriterium. Relevante Studien stammen mehrheitlich aus Großbritannien (UK), Kanada und Australien. Es wurden insgesamt n = 166 Kompetenzen in allen Kategorien identifiziert, die anhand verschiedener Methoden gemessen wurden. Am häufigsten wurden Fertigkeiten überprüft. Dabei wurde der sichere Umgang mit Medikamenten am häufigsten thematisiert. Weitere wichtige Themen waren die Kommunikationskompetenz in Bezug auf PatientInnen und die Fähigkeit zur Selbsteinschätzung. Diskussion: Es werden sehr unterschiedliche Kompetenzen mit differenten Formaten per OSCE gemessen. OSCE ermöglichen eine Überprüfung sowohl auf individueller als auch institutioneller Ebene, also sowohl für die Lehre als auch das Gelernte. Weiterer Forschungsbedarf wird festgestellt.

Kesiapan Dosen Dalam Pelaksanaan Uji Objective Structured Clinical Examination (Osce) Program Studi D3 Keperawatan

2018 ◽  
Vol 16 (1) ◽  
pp. 53
Author(s):  
Bejo Danang Saputra
Keyword(s):  
Focus Group ◽  
Focus Group Discussion ◽  
Clinical Examination ◽  
Comparative Method ◽  
Group Discussion ◽  
Objective Structured Clinical Examination ◽  
Constant Comparative Method ◽  
Constant Comparative

Perencanaan pengembangan uji kompetensi perawat Indonesia akan dikembangkan  dengan metode OSCE.. Pelaksanaan uji OSCE membutuhkan persiapan yang matang, terutama kesiapan sumber daya manusia (SDM) dalam hal ini adalah dosen untuk melaksanakan uji OSCE. Mengetahui kesiapan SDM dalam pengembangan uji OSCE di Prodi D3 Keperawatan Sekolah Tinggi Ilmu Kesehatan (STIKES) Al-Irsyad Al-Islamiyyah Cilacap. Desain penelitian yang digunakan adalah kualitatif dengan rancangan studi kasus. Informan penelitian adalah 6 orang dosen dan Kepala Program Studi D3 keperawatan. Data diperoleh melalui, focus group discussion, wawancara mendalam dan studi dokumentasi. Data kemudian dianalisis dengan menggunakan constant comparative method. Penelitian menunjukan bahwa pengetahuan dosen tentang OSCE dan kompetensi berdasarkan pendidikan memenuhi persyaratan untuk pengembangan uji OSCE, namun masih membutuhkan pelatihan mengenai OSCE. Uji OSCE dapat diselenggarakan dengan melibatkan dosen dari prodi lain karena jumlah dosen di Prodi D3 Keperawatan  STIKES Al-Irsyad Al-Islamiyyah Cilacap belum memenuhi kebutuhan pelaksanaan uji OSCE. Hambatan penyelenggaraan OSCE adalah SDM belum terkoordinasi, belum terlatih dan keterbatasan sarana pendukun. Pengetahuan dan kompetensi dosen berdasarkan tingkat pendidikan memenuhi syarat dalam pengembangan OSCE dan OSCE dapat diselenggarakan dengan melibatkan dosen prodi lain.

The use of the objective structured clinical examination (OSCE) in a practice-based health discipline: Academic and student experience in paramedicine

2020 ◽  
Vol 3 (2) ◽  
Author(s):  
Andy Bell ◽  
Jennifer Kelly ◽  
Peter Lewis
Keyword(s):  
Clinical Examination ◽  
Best Practice ◽  
Assessment Tool ◽  
Clinical Performance ◽  
Reliability And Validity ◽  
Specific Area ◽  
Training Model ◽  
Objective Structured Clinical Examination ◽  
Evidence Based ◽  
Effective Measure

Abstract:Purpose:Over the past two decades, the discipline of Paramedicine has seen expediential growth as it moved from a work-based training model to that of an autonomous profession grounded in academia.  With limited evidence-based literature examining assessment in paramedicine, this paper aims to describe student and academic views on the preference for OSCE as an assessment modality, the sufficiency of pre-OSCE instruction, and whether or not OSCE performance is a perceived indicator of clinical performance.Design/Methods:A voluntary, anonymous survey was conducted to examine the perception of the reliability and validity of the Objective Structured Clinical Examination (OSCE) as an assessment tool by students sitting the examination and the academics that facilitate the assessment. Findings:The results of this study revealed that the more confident the students are in the reliability and validity of the assessment, the more likely they are to perceive the assessment as an effective measure of their clinical performance.  The perception of reliability and validity differs when acted upon by additional variables, with the level of anxiety associated with the assessment and the adequacy of feedback of performance cited as major influencers. Research Implications:The findings from this study indicate the need for further paramedicine discipline specific research into assessment methodologies to determine best practice models for high quality assessment.Practical Implications:The development of evidence based best practice guidelines for the assessment of student paramedics should be of the upmost importance to a young, developing profession such as paramedicine.Originality/Value: There is very little research in the discipline specific area of assessment for paramedicine and discipline specific education research is essential for professional growth.Limitations:The principal researcher was a faculty member of one of the institutions surveyed.  However, all data was non identifiable at time of data collection.  Key WordsParamedic; paramedicine; objective structured clinical examinations; OSCE; education; assessment.

Sign in / Sign up

Export Citation Format

Share Document