scholarly journals Developing a dashboard to meet Competence Committee needs: a design-based research project

2020 ◽  
Author(s):  
Brent Thoma ◽  
Venkat Bandi ◽  
Robert Carey ◽  
Debajyoti Mondal ◽  
Robert Woods ◽  
...  
Keyword(s):  
Decision Making ◽  
Research Process ◽  
Assessment Data ◽  
Design Based Research ◽  
Educational Environments ◽  
Integral Role ◽  
Learner Assessment ◽  
Workplace Based Assessment ◽  
Competency Based ◽  
The University

Background: Competency-based programs are being adopted in medical education around the world. Competence Committees must visualize learner assessment data effectively to support their decision-making. Dashboards play an integral role in decision support systems in other fields. Design-based research allows the simultaneous development and study of educational environments. Methods: We utilized a design-based research process within the emergency medicine residency program at the University of Saskatchewan to identify the data, analytics, and visualizations needed by its Competence Committee, and developed a dashboard incorporating these elements. Narrative data were collected from two focus groups, five interviews, and the observation of two Competence Committee meetings. Data were qualitatively analyzed to develop a thematic framework outlining the needs of the Competence Committee and to inform the development of the dashboard. Results: The qualitative analysis identified four Competence Committee needs (Explore Workplace-Based Assessment Data, Explore Other Assessment Data, Understand the Data in Context, and Ensure the Security of the Data). These needs were described with narratives and represented through visualizations of the dashboard elements. Conclusions: This work addresses the practical challenges of supporting data-driven decision making by Competence Committees and will inform the development of dashboards for programs, institutions, and learner management systems.

scholarly journals Developing a dashboard to meet the needs of residents in a competency-based training program: A design-based research project

2020 ◽  
Author(s):  
Robert Carey ◽  
Grayson Wilson ◽  
Venkat Bandi ◽  
Debajyoti Mondal ◽  
Lynsey Martin ◽  
...  
Keyword(s):  
Emergency Medicine ◽  
Focus Groups ◽  
Residency Program ◽  
Research Process ◽  
Theory Approach ◽  
Assessment Data ◽  
Design Based Research ◽  
Professional Activities ◽  
Competency Based ◽  
The University

Background: Canadian specialty programs are implementing Competence By Design, a competency-based medical education (CBME) program which requires frequent assessments of entrustable professional activities. To be used for learning, the large amount of assessment data needs to be interpreted by residents, but little work has been done to determine how visualizing and interacting with this data can be supported. Within the University of Saskatchewan emergency medicine residency program, we sought to determine how our residents’ CBME assessment data should be presented to support their learning and to develop a dashboard that meets our residents’ needs. Methods: We utilized a design-based research process to identify and address resident needs surrounding the presentation of their assessment data. Data was collected within the emergency medicine residency program at the University of Saskatchewan via four resident focus groups held over 10 months. Focus group discussions were analyzed using a grounded theory approach to identify resident needs. This guided the development of a dashboard which contained elements (data, analytics, and visualizations) that support their interpretation of the data. The identified needs are described using quotes from the focus groups as well as visualizations of the dashboard elements. Results: Resident needs were classified under three themes: (1) Provide guidance through the assessment program, (2) Present workplace-based assessment data, and (3) Present other assessment data. Seventeen dashboard elements were designed to address these needs. Conclusions: Our design-based research process identified resident needs and developed dashboard elements to meet them. This work will inform the creation and evolution of CBME assessment dashboards designed to support resident learning.

scholarly journals Developing a dashboard for faculty development in competency-based training programs: a design-based research project

2021 ◽  
Author(s):  
Yusuf Yilmaz ◽  
Robert Carey ◽  
Teresa Chan ◽  
Venkat Bandi ◽  
Shisong Wang ◽  
...  
Keyword(s):  
Faculty Development ◽  
Training Programs ◽  
Research Process ◽  
Assessment Data ◽  
Design Based Research ◽  
Program Leaders ◽  
Professional Activities ◽  
Narrative Assessment ◽  
Competency Based ◽  
The University

Background: Canadian specialist residency training programs are implementing a form of competency-based medical education (CBME) that requires frequent assessments of entrustable professional activities (EPAs). Faculty struggle to provide helpful feedback and assign appropriate entrustment scores. CBME faculty development initiatives rarely incorporate teaching metrics. Dashboards could be used to visualize faculty assessment data to support faculty development. Methods: Using a design-based research process, we identified faculty development needs related to CBME assessments and designed a dashboard containing elements (data, analytics, and visualizations) meeting these needs. Data was collected within the emergency medicine residency program at the University of Saskatchewan through interviews with program leaders, faculty development experts, and faculty participating in development sessions. Two investigators thematically analyzed interview transcripts to identify faculty needs that were audited by a third investigator. The needs were described using representative quotes and the dashboard elements designed to address them. Results: Between July 1, 2019 and December 11, 2020 we conducted 15 interviews with nine participants (two program leaders, three faculty development experts, and four faculty members). Three needs emerged as themes from the analysis: analysis of assessments, contextualization of assessments, and accessible reporting. We addressed these needs by designing an accessible dashboard to present contextualized quantitative and narrative assessment data for each faculty member. Conclusions: We identified faculty development needs related to EPA assessments and designed dashboard elements to meet them. The resulting dashboard was used for faculty development sessions. This work will inform the development of CBME assessment dashboards for faculty.

scholarly journals Nuance and Noise: Lessons Learned From Longitudinal Aggregated Assessment Data

2017 ◽  
Vol 9 (6) ◽  
pp. 724-729 ◽  
Author(s):  
Teresa M. Chan ◽  
Jonathan Sherbino ◽  
Mathew Mercuri
Keyword(s):  
Tertiary Care ◽  
Lessons Learned ◽  
Teaching Hospitals ◽  
Average Score ◽  
Global Rating ◽  
Multilevel Regression ◽  
Assessment Data ◽  
Workplace Based Assessment ◽  
Competency Based ◽  
The Relationship

ABSTRACT Background  Competency-based medical education requires frequent assessment to tailor learning experiences to the needs of trainees. In 2012, we implemented the McMaster Modular Assessment Program, which captures shift-based assessments of resident global performance. Objective  We described patterns (ie, trends and sources of variance) in aggregated workplace-based assessment data. Methods  Emergency medicine residents and faculty members from 3 Canadian university-affiliated, urban, tertiary care teaching hospitals participated in this study. During each shift, supervising physicians rated residents' performance using a behaviorally anchored scale that hinged on endorsements for progression. We used a multilevel regression model to examine the relationship between global rating scores and time, adjusting for data clustering by resident and rater. Results  We analyzed data from 23 second-year residents between July 2012 and June 2015, which yielded 1498 unique ratings (65 ± 18.5 per resident) from 82 raters. The model estimated an average score of 5.7 ± 0.6 at baseline, with an increase of 0.005 ± 0.01 for each additional assessment. There was significant variation among residents' starting score (y-intercept) and trajectory (slope). Conclusions  Our model suggests that residents begin at different points and progress at different rates. Meta-raters such as program directors and Clinical Competency Committee members should bear in mind that progression may take time and learning trajectories will be nuanced. Individuals involved in ratings should be aware of sources of noise in the system, including the raters themselves.

Evaluation of the Academic Setting in Spain 1This study was financed by the University of Oviedo.

1995 ◽  
Vol 11 (2) ◽  
pp. 133-137 ◽  
Author(s):  
Juan Fernández ◽  
Miguel A. Mateo ◽  
José Muñiz
Keyword(s):  
Higher Education ◽  
Decision Making ◽  
Social Climate ◽  
Three Dimensions ◽  
Academic Setting ◽  
Teaching And Research ◽  
Evaluation Questionnaire ◽  
University Teachers ◽  
The University

The conditions are investigated in which Spanish university teachers carry out their teaching and research functions. 655 teachers from the University of Oviedo took part in this study by completing the Academic Setting Evaluation Questionnaire (ASEQ). Of the three dimensions assessed in the ASEQ, Satisfaction received the lowest ratings, Social Climate was rated higher, and Relations with students was rated the highest. These results are similar to those found in two studies carried out in the academic years 1986/87 and 1989/90. Their relevance for higher education is twofold because these data can be used as a complement of those obtained by means of students' opinions, and the crossing of both types of data can facilitate decision making in order to improve the quality of the work (teaching and research) of the university institutions.

Methodology of ECG Interpretation in the Padova Program

1990 ◽  
Vol 29 (04) ◽  
pp. 386-392 ◽  
Author(s):  
R. Degani ◽  
G. Bortolan
Keyword(s):  
Decision Making ◽  
Medical School ◽  
Fuzzy Set ◽  
Medical Knowledge ◽  
Main Aspect ◽  
Measurement Evaluation ◽  
Possibility Distributions ◽  
Linguistic Decision Making ◽  
The University ◽  
Ecg Interpretation

AbstractThe main lines ofthe program designed for the interpretation of ECGs, developed in Padova by LADSEB-CNR with the cooperation of the Medical School of the University of Padova are described. In particular, the strategies used for (i) morphology recognition, (ii) measurement evaluation, and (iii) linguistic decision making are illustrated. The main aspect which discerns this program in comparison with other approaches to computerized electrocardiography is its ability of managing the imprecision in both the measurements and the medical knowledge through the use of fuzzy-set methodologies. So-called possibility distributions are used to represent ill-defined parameters as well as threshold limits for diagnostic criteria. In this way, smooth conclusions are derived when the evidence does not support a crisp decision. The influence of the CSE project on the evolution of the Padova program is illustrated.

UPAYA MENINGKATKAN AKTIVITAS DAN HASIL BELAJAR MAHASISWA MELALUI PENERAPAN MODEL PEMBELAJARAN INKUIRI PADA MATA KULIAH KONSEP DASAR IPA 2 DI PROGRAM STUDI PENDIDIKAN GURU SEKOLAH DASAR TAHUN AKADEMIK 2013/2014

2014 ◽  
Vol 3 (1) ◽  
pp. 23
Author(s):  
Mahmud Alpusari
Keyword(s):  
Initial Data ◽  
Learning Outcomes ◽  
Inquiry Learning ◽  
Learning Activities ◽  
Simple Experiment ◽  
Competency Based ◽  
Basic Concepts ◽  
Using Data ◽  
The University ◽  
Daily Test

In line with the competency-based curriculum at the University of Riau, the effort to improvelearning basic concepts of science 2 courses puts emphasis on understanding the concept ofmatter, which is based on students' learning activities through scientific inquiry.Implementation of action research consists of two cycles in PGSD JIP University of Riau onthe odd semester of 2013/2014 with 55 third semester students. Based on the research results,lecturing process by applying the model of inquiry learning, students’ activity increased inwhich in the first cycle all activities are good category except activity I and II are faircategory. Meanwhile students’ activity in first and fourth in cycle II is good category, andvery good category in second, third, fifth, and sixth activity. Temporarily student’s learningoutcomes increased from pre-tests with an average65.45 into 77,0 in daily test I and 77.45onthe daily test II. Improvement from initial data to the first cycle was 11.55, while the datafrom the beginning to the second cycle increased 12 points. In general the improvement ofstudents’learning is possible because the learning model used is inquiry learning so thatlearning becomes active which centered into students by presenting a problem, then studentsare asked to carry out a simple experiment using equipment and tools, using data, arrangingreports, communicating the results of observations based on concepts and learned principles.Keywords: Inquiry, students’ activity, learning outcomes.

DATABASE DESIGN FOR E-GOVERNANCE APPLICATION: A FRAMEWORK FOR THE MANAGEMENT INFORMATION SYSTEMS OF THE VIETNAM COMMITTEE FOR ETHNIC MINORITY AFFAIRS

2017 ◽  
Author(s):  
Nguyen Viet Hung ◽  
Phan Van Hung ◽  
Be Trung Anh
Keyword(s):  
Decision Making ◽  
Information System ◽  
Ethnic Minority ◽  
Ethnic Minorities ◽  
Good Governance ◽  
Local Governance ◽  
Geographical Information ◽  
Base System ◽  
Challenges And Opportunities ◽  
Competency Based

Data mode “good governance” developed in the last century for process of sustainable base system, providing basic information and on-line services, supports the development, challenges and opportunities in the context of globalization and integration. In this paper I discuss a framework for the design of e-Local Governance (eLG) that integrates Information System (IS), Geographical Information System (GIS) and Atlas with focus on ethnic minorities in Vietnam. The design framework is based on various classifications such categories as sex, age, ethnic group, education background and income. The database system is built to enhance the Committee for Ethnic Minority Affairs (CEMA) capabilities in the planning and decision making process by providing the authorities with data, internet GIS, internet communication and some ecological economic models to disseminate results to the ethnic minorities. The unique feature of the CEMADATA using GIS is that it helps users not only to improve the public services and to provide information and encourage ethnic minorities to participate in decision making processes, but also to support the competency-based training for IT staff

Case Study: The Southern Oral History Program

2012 ◽  
Author(s):  
Jacquelyn Dowd Hall ◽  
Kathryn Nasstrom
Keyword(s):  
Oral History ◽  
American South ◽  
New Era ◽  
Chapel Hill ◽  
Integral Role ◽  
The American South ◽  
And Gender ◽  
History Department ◽  
The University

A case study of the southern oral history program is the essence of this chapter. From its start in 1973 until 1999, the Southern Oral History Program (SOHP) was housed by the history department at the University of North Carolina at Chapel Hill (UNC), rather than in the library or archives, where so many other oral history programs emerged. The SOHP is now part of UNC's Center for the Study of the American South, but it continues to play an integral role in the department of history. Concentrating on U.S. southern racial, labor, and gender issues, the program offers oral history courses and uses interviews to produce works of scholarship, such as the prize-winning book Like a Family: The Making of a Southern Cotton Mill World. The folks at the Institute for Southern Studies tried to combine activism with analysis, trying to figure out how to take the spirit of the movement into a new era.

Evaluation of the educational catchment area and decision-making support at the University of Szeged, Hungary

2014 ◽  
Vol 20 (2) ◽  
pp. 106-120
Author(s):  
Ferenc Kovács ◽  
Gábor Mezősi ◽  
György Sipos ◽  
László Mucsi
Keyword(s):  
Decision Making ◽  
Catchment Area ◽  
The University ◽  
Decision Making Support
Sign in / Sign up

Export Citation Format

Share Document