The competency-based medical education evolution of Canadian emergency medicine specialist training

CJEM ◽  
2019 ◽  
Vol 22 (1) ◽  
pp. 95-102 ◽  
Author(s):  
Jonathan Sherbino ◽  
Glen Bandiera ◽  
Ken Doyle ◽  
Jason R. Frank ◽  
Brian R. Holroyd ◽  
...  
Keyword(s):  
Emergency Medicine ◽  
Medical Education ◽  
Residency Education ◽  
Multiple Sources ◽  
High Stakes ◽  
Competency Based Medical Education ◽  
Professional Activities ◽  
Local Resources ◽  
Education Design ◽  
Competency Based

ABSTRACTCanadian specialist emergency medicine (EM) residency training is undergoing the most significant transformation in its history. This article describes the rationale, process, and redesign of EM competency-based medical education. The rationale for this evolution in residency education includes 1) improved public trust by increasing transparency of the quality and rigour of residency education, 2) improved fiscal accountability to government and institutions regarding specialist EM training, 3) improved assessment systems to replace poor functioning end-of-rotation assessment reports and overemphasis on high-stakes, end-of-training examinations, and 4) and tailored learning for residents to address individualized needs. A working group with geographic and stakeholder representation convened over a 2-year period. A consensus process for decision-making was used. Four key design features of the new residency education design include 1) specialty EM-specific outcomes to be achieved in residency; 2) designation of four progressive stages of training, linked to required learning experiences and entrustable professional activities to be achieved at each stage; 3) tailored learning that provides residency programs and learner flexibility to adapt to local resources and learner needs; and 4) programmatic assessment that emphasizes systematic, longitudinal assessments from multiple sources, and sampling sentinel abilities. Required future study includes a program evaluation of this complex education intervention to ensure that intended outcomes are achieved and unintended outcomes are identified.

scholarly journals Delivering on the promise of competency based medical education – an institutional approach

2019 ◽  
Vol 10 (1) ◽  
pp. e28-38 ◽  
Author(s):  
Damon Dagnone ◽  
Denise Stockley ◽  
Leslie Flynn ◽  
Rylan Egan ◽  
Richard Van Wylick ◽  
...  
Keyword(s):  
Medical Education ◽  
Diffusion Of Innovation ◽  
Training Model ◽  
Residency Education ◽  
Transformative Change ◽  
Competency Based Medical Education ◽  
Professional Activities ◽  
Competency Based ◽  
Institutional Vision ◽  
Proactive Measures

The Royal College of Physicians and Surgeons of Canada (RCPSC) adopted a plan to transform, over a seven-year horizon (2014-2021), residency education across all specialties to competency-based medical education (CBME) curriculum models. The RCPSC plan recommended implementing a more responsive and accountable training model with four discrete stages of training, explicit, specialty specific entrustable professional activities, with associated milestones, and a programmatic approach to assessment across residency education. Embracing this vision, the leadership at Queen’s University (in Kingston, Ontario, Canada) applied for and was granted special permission by the RCPSC to embark on an accelerated institutional path. Over a three-year period, Queen’s took CBME from concept to reality through the development and implementation of acomprehensive strategic plan. This perspective paper describes Queen’s University’s approach of creating a shared institutional vision, outlines the process of developing a centralized CBME executive team and twenty-nine CBME program teams, and summarizes proactive measures to ensure program readiness for launch. In so doing, Queen’s created a community of support and CBME expertise that reinforces shared values including fostering co-production, cultivating responsive leadership, emphasizing diffusion of innovation, and adopting a systems-based approach to transformative change. 

Faculty development in the age of competency-based medical education: A needs assessment of Canadian emergency medicine faculty and senior trainees

CJEM ◽  
2019 ◽  
Vol 21 (4) ◽  
pp. 527-534 ◽  
Author(s):  
Alexandra Stefan ◽  
Justin N. Hall ◽  
Jonathan Sherbino ◽  
Teresa M. Chan
Keyword(s):  
Emergency Medicine ◽  
Medical Education ◽  
Faculty Development ◽  
Patient Care ◽  
Needs Assessment ◽  
Direct Observation ◽  
Senior Resident ◽  
Cross Sectional ◽  
Competency Based Medical Education ◽  
Competency Based

ABSTRACTObjectivesThe Royal College of Physicians and Surgeons of Canada (RCPSC) emergency medicine (EM) programs transitioned to the Competence by Design training framework in July 2018. Prior to this transition, a nation-wide survey was conducted to gain a better understanding of EM faculty and senior resident attitudes towards the implementation of this new program of assessment.MethodsA multi-site, cross-sectional needs assessment survey was conducted. We aimed to document perceptions about competency-based medical education, attitudes towards implementation, perceived/prompted/unperceived faculty development needs. EM faculty and senior residents were nominated by program directors across RCPSC EM programs. Simple descriptive statistics were used to analyse the data.ResultsBetween February and April 2018, 47 participants completed the survey (58.8% response rate). Most respondents (89.4%) thought learners should receive feedback during every shift; 55.3% felt that they provided adequate feedback. Many respondents (78.7%) felt that the ED would allow for direct observation, and most (91.5%) participants were confident that they could incorporate workplace-based assessments (WBAs). Although a fair number of respondents (44.7%) felt that Competence by Design would not impact patient care, some (17.0%) were worried that it may negatively impact it. Perceived faculty development priorities included feedback delivery, completing WBAs, and resident promotion decisions.ConclusionsRCPSC EM faculty have positive attitudes towards competency-based medical education-relevant concepts such as feedback and opportunities for direct observation via WBAs. Perceived threats to Competence by Design implementation included concerns that patient care and trainee education might be negatively impacted. Faculty development should concentrate on further developing supervisors’ teaching skills, focusing on feedback using WBAs.

scholarly journals Analyzing the Administrative Burden of Competency Based Medical Education

2021 ◽  
pp. 084653712110389
Author(s):  
Kevin Cheung ◽  
Christina Rogoza ◽  
Andrew D. Chung ◽  
Benjamin Yin Ming Kwan
Keyword(s):  
Medical Education ◽  
Postgraduate Medical Education ◽  
Assessment Process ◽  
Full Time ◽  
Equal Distribution ◽  
Competency Based Medical Education ◽  
Quantitative Evidence ◽  
Administrative Burden ◽  
Professional Activities ◽  
Competency Based

Purpose: Postgraduate residency programs in Canada are transitioning to a competency-based medical education (CBME) system. Within this system, resident performance is documented through frequent assessments that provide continual feedback and guidance for resident progression. An area of concern is the perception by faculty of added administrative burden imposed by the frequent evaluations. This study investigated the time spent in the documentation and submission of required assessment forms through analysis of quantitative data from the Queen’s University Diagnostic Radiology program. Methods and Materials: Data regarding time taken to complete Entrustable Professional Activities (EPA) assessments was collected from 24 full-time and part-time radiologists over a period of 18 months. This data was analyzed using SPSS to determine mean time of completion by individuals, departments, and by experience with the assessment process. Results: The average time taken to complete an EPA assessment form was 3 minutes and 6 seconds. Assuming 3 completed EPA assessment forms per week for each resident (n = 12) and equal distribution among all staff, this averaged out to an additional 18 minutes of administrative burden per staff member over a 4 week block. Conclusions: This study investigated the perception by faculty of additional administrative burden for assessment in the CBME framework. The data provided quantitative evidence of administrative burden for the documentation and submission of assessments. The data indicated that the added administrative burden may be reasonable given mandate for CBME implementation and the advantages of adoption for postgraduate medical education.

scholarly journals An Entrustable Professional Activity Addressing Racism and Pediatric Health Inequities

PEDIATRICS ◽  
2022 ◽  
Author(s):  
Ndidi I. Unaka ◽  
Ariel Winn ◽  
Adiaha Spinks-Franklin ◽  
Patricia Poitevien ◽  
Franklin Trimm ◽  
...  
Keyword(s):  
Medical Education ◽  
Health Care Systems ◽  
Health Inequities ◽  
Professional Activity ◽  
Competency Based Medical Education ◽  
Pediatric Health ◽  
Professional Activities ◽  
Care Systems ◽  
Competency Based ◽  
Pediatric Populations

Racism and discrimination are the root of many pediatric health inequities and are well described in the literature. Despite the pervasiveness of pediatric health inequities, we have failed to adequately educate and prepare general pediatricians and pediatric subspecialists to address them. Deficiencies within education across the entire continuum and in our health care systems as a whole contribute to health inequities in unacceptable ways. To address these deficiencies, the field of pediatrics, along with other specialties, has been on a journey toward a more competency-based approach to education and assessment, and the framework created for the future is built on entrustable professional activities (EPAs). Competency-based medical education is one approach to addressing the deficiencies within graduate medical education and across the continuum by allowing educators to focus on the desired equitable patient outcomes and then develop an approach to teaching and assessing the tasks, knowledge, skills, and attitudes needed to achieve the goal of optimal, equitable patient care. To that end, we describe the development and content of a revised EPA entitled: Use of Population Health Strategies and Quality Improvement Methods to Promote Health and Address Racism, Discrimination, and Other Contributors to Inequities Among Pediatric Populations. We also highlight the ways in which this EPA can be used to inform curricula, assessments, professional development, organizational systems, and culture change.

scholarly journals Examining Academic Leader’s work in implementing Competency-based Medical Education using Organizational Learning Theory

2018 ◽  
Author(s):  
Nicolas Fernandez ◽  
Nicole Leduc ◽  
Nathalie Caire Fon ◽  
Louis-Georges Ste-Marie ◽  
Dat Nguyen-Dinh ◽  
...  
Keyword(s):  
Medical Education ◽  
Organizational Learning ◽  
Learning Theory ◽  
Structured Interviews ◽  
Academic Leaders ◽  
Competency Based Medical Education ◽  
Organizational Learning Theory ◽  
Professional Activities ◽  
Competency Based ◽  
Implementation Progress

ContextCompetency-based medical education (CBME) implementation is being carried out in many medical schools worldwide. Academic Leadership is a strategy where selected Faculty act to influence peers to adopt change. The Université de Montréal medical school, has adopted this strategy to implement CBME.PurposeThis paper aims to describe the work of Academic Leaders in the process of CBME implementation and to explore relevance of the Nonaka and Toyama organizational learning theory to map implementation progress.MethodBecause knowledge creation model focuses on the relationships between leaders and social structures, embedded case study was selected. Diverse sampling method was used to select three departments: internal medicine, surgery and psychiatry, based on the number of CBME training activities. Data collection was at two intervals, two years apart. Semi-structured interviews (individual and group) were conducted with Department Heads and Academic Leaders. Thematic analysis was conducted on the 15 interview transcriptions.ResultsAs implementation begins, Leaders critically revisit accepted teaching routines and develop a common conception of CBME. This enables leaders to communicate with a wider audience and work within existing committees and working groups where they “break down” CBME into practical concepts. This practical understanding, disseminated through Entrustable Professional Activities, enables observable change.ConclusionLeaders’ roles evolved from an “expert” that disseminates knowledge about CBME through lectures, to a responsive and pragmatic supporting role by developing and writing practical tools in collaboration with peers and program directors.

scholarly journals Assessment of emergency medicine residents: a systematic review

2017 ◽  
Vol 8 (1) ◽  
pp. e106-122 ◽  
Author(s):  
Isabelle N Colmers-Gray ◽  
Kieran Walsh ◽  
Teresa M Chan
Keyword(s):  
Emergency Medicine ◽  
Medical Education ◽  
Direct Observation ◽  
Full Text ◽  
Assessment Tools ◽  
Competency Based Medical Education ◽  
Mesh Terms ◽  
Competency Based ◽  
Resident Assessment ◽  
Assessment Frequency

Background: Competency-based medical education is becoming the new standard for residency programs, including Emergency Medicine (EM). To inform programmatic restructuring, guide resources and identify gaps in publication, we reviewed the published literature on types and frequency of resident assessment.Methods: We searched MEDLINE, EMBASE, PsycInfo and ERIC from Jan 2005 - June 2014. MeSH terms included “assessment,” “residency,” and “emergency medicine.” We included studies on EM residents reporting either of two primary outcomes: 1) assessment type and 2) assessment frequency per resident. Two reviewers screened abstracts, reviewed full text studies, and abstracted data. Reporting of assessment-related costs was a secondary outcome.Results: The search returned 879 articles; 137 articles were full-text reviewed; 73 met inclusion criteria. Half of the studies (54.8%) were pilot projects and one-quarter (26.0%) described fully implemented assessment tools/programs. Assessment tools (n=111) comprised 12 categories, most commonly: simulation-based assessments (28.8%), written exams (28.8%), and direct observation (26.0%). Median assessment frequency (n=39 studies) was twice per month/rotation (range: daily to once in residency). No studies thoroughly reported costs.Conclusion: EM resident assessment commonly uses simulation or direct observation, done once-per-rotation. Implemented assessment systems and assessment-associated costs are poorly reported. Moving forward, routine publication will facilitate transitioning to competency-based medical education.

Creating a Competency-Based Medical Education Curriculum for Canadian Diagnostic Radiology Residency (Queen’s Fundamental Innovations in Residency Education)—Part 1: Transition to Discipline and Foundation of Discipline Stages

2020 ◽  
pp. 084653711989472 ◽  
Author(s):  
Benjamin Yin Ming Kwan ◽  
Achire Mbanwi ◽  
Nicholas Cofie ◽  
Christina Rogoza ◽  
Omar Islam ◽  
...  
Keyword(s):  
Medical Education ◽  
Medical Training ◽  
Residency Education ◽  
Diagnostic Radiology ◽  
Radiology Department ◽  
Competency Based Medical Education ◽  
Postgraduate Medical Training ◽  
Radiology Residency ◽  
Competency Based ◽  
Queen's University

Purpose: The Royal College of Physicians and Surgeons of Canada (RCPSC) has mandated the transition of postgraduate medical training in Canada to a competency-based medical education (CBME) model divided into 4 stages of training. As part of the Queen’s University Fundamental Innovations in Residency Education proposal, Queen’s University in Canada is the first institution to transition all of its residency programs simultaneously to this model, including Diagnostic Radiology. The objective of this report is to describe the Queen’s Diagnostic Radiology Residency Program’s implementation of a CBME curriculum. Methods: At Queen’s University, the novel curriculum was developed using the RCPSC’s competency continuum and the CanMEDS framework to create radiology-specific entrustable professional activities (EPAs) and milestones. In addition, new committees and assessment strategies were established. As of July 2015, 3 cohorts of residents (n = 9) have been enrolled in this new curriculum. Results: EPAs, milestones, and methods of evaluation for the Transition to Discipline and Foundations of Discipline stages, as well as the opportunities and challenges associated with the implementation of a competency-based curriculum in a Diagnostic Radiology Residency Program, are described. Challenges include the increased frequency of resident assessments, establishing stage-specific learner expectations, and the creation of volumetric guidelines for case reporting and procedures. Conclusions: Development of a novel CBME curriculum requires significant resources and dedicated administrative time within an academic Radiology department. This article highlights challenges and provides guidance for this process.

scholarly journals LO72: Spotting potential opportunities for teachable moments

CJEM ◽  
2020 ◽  
Vol 22 (S1) ◽  
pp. S33-S34
Author(s):  
H. Alrimawi ◽  
MB BCh ◽  
S. Sample ◽  
T. Chan
Keyword(s):  
Emergency Medicine ◽  
Post Intervention ◽  
Historical Cohort ◽  
Competency Based Medical Education ◽  
Professional Activities ◽  
Significant Difference ◽  
Local Program ◽  
Competency Based ◽  
Student’S T ◽  
Case Based

Introduction: With the transition of Emergency Medicine into competency based medical education (CBME), entrustable professional activities (EPAs) are used to evaluate residents on performed clinical duties. This study aimed to determine if implementing a case-based orientation, designed to increase recognition of available EPAs, into CBME orientation would help residents increase the number of EPAs completed. Methods: We designed an intervention consisting of clinical cases that were reviewed by national EPA experts who identified which EPAs could be assessed from each case. A case-based session was incorporated into the 2019 CBME orientation for The McMaster Emergency Medicine Program. Postgraduate Year (PGY)1 residents read the cases and discussed which EPAs could be obtained with PGY2/faculty facilitators. The number of EPAs completed in the first two blocks of PGY1 was determined from local program data and Student's t-test was used to compare averages between cohorts. Results: We analyzed data from 22 trainees (7 in 2017, 8 in 2018, and 7 in 2019). In the first two blocks of PGY1, the intervention cohort (2019) had a significantly higher average number of EPAs completed per trainee (47.4 [SD 11.8]) than the historical cohort (25.3 [SD 6.7]) (p < 0.001) (Cohen's d = 2.3). No significant difference existed in the number EPAs obtained between the 2017/2018 cohorts, with averages of 24.3 [SD 6.8] and 26.1 [SD 7.0] per trainee respectively (p = 0.6). Conclusion: Implementation of a case-based orientation led by CBME-experienced facilitators nearly doubled the EPA acquisition rate of our PGY1s. The consistent EPA acquisition by the 2017/2018 cohorts suggest that the post-intervention increase was not solely due to developed familiarity with the CBME curriculum.

scholarly journals Outcomes in the age of competency-based medical education: Recommendations for emergency medicine training in Canada from the 2019 symposium of academic emergency physicians

CJEM ◽  
2020 ◽  
Vol 22 (2) ◽  
pp. 204-214 ◽  
Author(s):  
Teresa M. Chan ◽  
Quinten S. Paterson ◽  
Andrew K. Hall ◽  
Fareen Zaver ◽  
Robert A. Woods ◽  
...  
Keyword(s):  
Emergency Medicine ◽  
Medical Education ◽  
Clinical Outcomes ◽  
Online Survey ◽  
Emergency Physicians ◽  
Competency Based Medical Education ◽  
Canadian Association ◽  
National Implementation ◽  
Competency Based ◽  
The Impact

ABSTRACTObjectivesThe national implementation of competency-based medical education (CBME) has prompted an increased interest in identifying and tracking clinical and educational outcomes for emergency medicine training programs. For the 2019 Canadian Association of Emergency Physicians (CAEP) Academic Symposium, we developed recommendations for measuring outcomes in emergency medicine training in the context of CBME to assist educational leaders and systems designers in program evaluation.MethodsWe conducted a three-phase study to generate educational and clinical outcomes for emergency medicine (EM) education in Canada. First, we elicited expert and community perspectives on the best educational and clinical outcomes through a structured consultation process using a targeted online survey. We then qualitatively analyzed these responses to generate a list of suggested outcomes. Last, we presented these outcomes to a diverse assembly of educators, trainees, and clinicians at the CAEP Academic Symposium for feedback and endorsement through a voting process.ConclusionAcademic Symposium attendees endorsed the measurement and linkage of CBME educational and clinical outcomes. Twenty-five outcomes (15 educational, 10 clinical) were derived from the qualitative analysis of the survey results and the most important short- and long-term outcomes (both educational and clinical) were identified. These outcomes can be used to help measure the impact of CBME on the practice of Emergency Medicine in Canada to ensure that it meets both trainee and patient needs.

Sign in / Sign up

Export Citation Format

Share Document