scholarly journals The Power of an Iterative Approach to Clinical Competence Assessment

Author(s):  
Kimberly Gifford ◽  
Jalen Benson ◽  
Julie Kim

Many residency programs struggle with effective and efficient methods for their program to synthesize and analyze data to create robust milestones-based assessment of residents.  Residents and faculty in the Pediatric Residency at Dartmouth-Hitchcock Medical Center collaborated to design an innovative iterative process for resident assessment using rotation-based Milestones reports, faculty sub-committees, and discussion with the resident. Time spent and frequency of Milestones determinations made at each phase of assessment process were tabulated and feedback summarized from faculty, residents, and administrators.  Our new process integrated milestones determinations into our existing committee review structure without any additional time added to the process. Faculty perceived that the system was efficient and provided more insight about each resident.  The program director used the sub-committee summaries for semi-annual reviews and letters of reference. Residents appreciated the fairness of all residents being reviewed by the same faculty. Milestones determinations were made by: evaluations alone (69%), CCC sub-committee (18%), full CCC (7%), and additional data or PD decision (6%).   The full CCC was needed more frequently for professionalism and systems-based practice Milestones determinations.  Iterative assessment systems have the potential to save valuable faculty time without compromising the quality of assessments.  

2015 ◽  
Vol 41 (1) ◽  
Author(s):  
Liviana Da Dalt ◽  
Pasquale Anselmi ◽  
Sara Furlan ◽  
Silvia Carraro ◽  
Eugenio Baraldi ◽  
...  

2019 ◽  
Vol 12 (3) ◽  
pp. 62-64
Author(s):  
Deborah Alliston ◽  
Matthew J. Kelt ◽  
Grace Nehme ◽  
Robert Wittler

Introduction Faculty evaluations are important tools for improving faculty-to-resident instruction, but residents in our pediatric and internal medicine/pediatric residency programs would seldom evaluate individual pediatric faculty hospitalists. Our objectives were to: (1) increase the percentage of completed evaluations of individual pediatric hospitalists to greater than 85%, (2) improve the quality of pediatric hospitalist feedback as measured by resident and faculty satisfaction surveys, and (3) to reduce the resident concern of lack of anonymity of evaluations. Methods Members of the resident inpatient team (pediatric and internal medicine/pediatric residents) completed group-based evaluations of individual pediatric hospitalists. A survey to evaluate this change in process was distributed to the pediatric hospitalists (n = 6) and another survey was distributed to residents, both based on a 5-point Likert-type scale. Surveys were completed before and four months after implementation of the changes. Pre- and post-survey data of resident and hospitalist responses were compared using the Mann-Whitney test and probability proportion test. Results The percent of completed evaluations increased from 0% to 86% in one month and to 100% in two months. Thereafter, the percent of completed evaluations remained at 100% through the end of the data collection period at seven months. Hospitalists reported (n = 6, 100% participation) their satisfaction regarding the feedback they received from residents significantly increased for all survey questions. Resident satisfaction (n = 24, 89% participation in postintervention surveys) increased significantly with regards to the evaluation process. Conclusions For hospitalists, group-based resident evaluations of individual hospitalists led to an increased percentage of completed evaluations, improved the quality and quantity of feedback to hospitalists, and increased satisfaction with evaluations. For residents, these changes led to increased satisfaction with the evaluation process.


Sensors ◽  
2021 ◽  
Vol 21 (9) ◽  
pp. 3279
Author(s):  
Maria Habib ◽  
Mohammad Faris ◽  
Raneem Qaddoura ◽  
Manal Alomari ◽  
Alaa Alomari ◽  
...  

Maintaining a high quality of conversation between doctors and patients is essential in telehealth services, where efficient and competent communication is important to promote patient health. Assessing the quality of medical conversations is often handled based on a human auditory-perceptual evaluation. Typically, trained experts are needed for such tasks, as they follow systematic evaluation criteria. However, the daily rapid increase of consultations makes the evaluation process inefficient and impractical. This paper investigates the automation of the quality assessment process of patient–doctor voice-based conversations in a telehealth service using a deep-learning-based classification model. For this, the data consist of audio recordings obtained from Altibbi. Altibbi is a digital health platform that provides telemedicine and telehealth services in the Middle East and North Africa (MENA). The objective is to assist Altibbi’s operations team in the evaluation of the provided consultations in an automated manner. The proposed model is developed using three sets of features: features extracted from the signal level, the transcript level, and the signal and transcript levels. At the signal level, various statistical and spectral information is calculated to characterize the spectral envelope of the speech recordings. At the transcript level, a pre-trained embedding model is utilized to encompass the semantic and contextual features of the textual information. Additionally, the hybrid of the signal and transcript levels is explored and analyzed. The designed classification model relies on stacked layers of deep neural networks and convolutional neural networks. Evaluation results show that the model achieved a higher level of precision when compared with the manual evaluation approach followed by Altibbi’s operations team.


2021 ◽  
Vol 11 (2) ◽  
pp. 213
Author(s):  
Dulce Romero-Ayuso ◽  
Cristian Cuerda ◽  
Carmen Morales ◽  
Ricardo Tesoriero ◽  
José Matías Triviño-Juárez ◽  
...  

Cognitive dysfunction affects the performance of Activities of Daily Living (ADL) and the quality of life of people with these deficits and their caregivers. To the knowledge of the authors, to date, there are few studies that focus on knowing the relationship between personal autonomy and deductive reasoning and/or categorization skills, which are necessary for the performance of the ADL. The aim of this study was to explore the relationships between ADL and categorization skills in older people. The study included 51 participants: 31 patients with cognitive impairment and 20 without cognitive impairment. Two tests were administered to assess cognitive functions: (1) the Montreal Cognitive Assessment (MoCA); and (2) the digital version of Riska Object Classification test (ROC-d). In addition, the Routine Tasks Inventory-2 (RTI-2) was applied to determine the level of independence in activities of daily living. People with cognitive impairment performed poorly in categorization tasks with unstructured information (p = 0.006). Also, the results found a high correlation between cognitive functioning and the performance of ADLs (Physical ADL: r = 0.798; p < 0.001; Instrumental ADL: r = 0.740; p < 0.001), a moderate correlation between Physical ADLs and categorization skills (unstructured ROC-d: r = 0.547; p < 0.001; structured ROC-d: r = 0.586; p < 0.001) and Instrumental ADLs and categorization skills in older people (unstructured ROC-d: r = 0.510; p < 0.001; structured ROC-d: r = 0.463; p < 0.001). The ROC-d allows the assessment of categorization skills to be quick and easy, facilitating the assessment process by OT, as well as the accuracy of the data obtained.


2020 ◽  
Vol 41 (Supplement_2) ◽  
Author(s):  
S Barco ◽  
L Valerio ◽  
M Jankowski ◽  
M.M Hoeper ◽  
F.A Klok ◽  
...  

Abstract Background It is unclear to which extent persistence of symptoms and/or residual haemodynamic impairment clinical course of pulmonary embolism are associated with worse quality of life (QoL). Aims To study the correlation between symptoms and haemodynamic impairment with QoL during the first year after acute pulmonary embolism (PE). Methods The Follow-Up after acute pulmonary embolism (FOCUS) study prospectively enrolled and followed consecutive adult patients diagnosed with acute symptomatic objectively diagnosed PE. In the present analysis, we considered patients who completed the Pulmonary Embolism QoL (PEmb-QoL) Questionnaire at predefined visits 3 and 12 months after acute PE. The PEmb-QoL score ranges from 0% (best QoL) to 100% (worst QoL). We evaluated at these two time points the correlation between persisting symptoms (group: symptoms), elevation of natriuretic peptides or residual right ventricular dysfunction (group: RVD), or their combination (group: symptoms + RVD) and QoL. Results A total of 617 patients were included; their median age was 62 years, 44% were women; 8% had active cancer, and 21% previous venous thromboembolism. At 3 months, patients with neither symptoms nor RVD (n=302) had the highest quality of life (median score 18%, 25th–75th percentile: 8%–34%), followed by those without symptoms but with RVD (n=255; median score 19%, 25th–75th percentile: 7%–34%), and by those with symptoms only (n=131; median PEmb-QoL 31%, 25th–75th percentile: 18%–49%). Patients with both symptoms and RVD (n=170) had the worst quality of life (median score 38%, 25th–75th percentile: 19%–53%); Figure 1A. At 12 months, we found an overall improvement of PEmb-QoL score. The degree of this QoL improvement varied across groups, being largest for patients who recovered from having symptoms + RVD at 3 months to normalization of at least one at 12 months. The change in QoL from 3 to 12 months was smaller both in patients who had neither symptoms nor RVD and in patients who had no recovery in either symptoms or RVD; Figure 1B. Conclusions Persistent symptoms after PE, especially in patients with elevated biomarkers or residual echocardiographic dysfunction, were the main drivers of QoL at 3 months as well as of the course of QoL over time. Figure 1 Funding Acknowledgement Type of funding source: Public grant(s) – National budget only. Main funding source(s): University Medical Center of the Johannes Gutenberg University, Mainz, Germany; German Federal Ministry of Education and Research


2021 ◽  
Vol 21 (1) ◽  
Author(s):  
Tilahun Fufa Debela ◽  
Zerihun Asefa Hordofa ◽  
Aster Berhe Aregawi ◽  
Demisew Amenu Sori

Abstract Background The consequences of obstetric fistula on affected women are more than the medical condition. It has extensive physical, psychological, social, and economic consequences on them. Obstetric fistula affects the entire health and entire life of women. Women suffering from obstetric fistula are often abandoned by her partner, relatives, and the community. This study aimed to determine the quality of life of obstetrics fistula patients before and after surgical repair. Methods Institutional-based prospective, before and after study design was conducted in the Jimma University Medical Center from November 1, 2019–October 30, 2020. A face-to-face interview was conducted with fistula patients who visited Jimma University Medical center, fistula clinic during the study period. All fistula patients were included in the study. Accordingly, 78 women who underwent surgical repair were interviewed. The means and the standard deviation were computed using conventional statistics formulas. The unpaired t-test was used to compare two independent means, and one-way analysis of variance (ANOVA) was used to compare the quality of life before repair and after a successful repair. Linear regression analysis was done for identifying determinants of quality of life. A P value of 0.05 will be considered statistical significance. Result The overall quality of life of women was 58.17 ± 7.2 before the surgical repair and 71.20 ± 10.79 after surgical repair. The result indicates there is a significant difference in the mean value of pre and post-operative (P < 0.001). The overall satisfaction of women with their health status before the surgical repair was 22.5 ± 1.30and it has increased to 53.0 ± .90after surgical repair. The physical health dimension score was 16.51 ± 5.27 before the surgical repair while it has increased to 21.77 ± 5.38 after the surgical repair. The score of the social domain before the surgical repair was 5.19 ± 1.34 and it has increased to 7.13 ± 3.67 after the surgical repair. The score of the environmental health domain was 17.41 ± 2.89 before the surgery while it also increased to 21.65 ± 4.04 after the surgical repair. The results have shown there was a significant difference in the mean values of pre and post-operatives in both social and environmental scores (P < 0.001). The score of the psychological health domain before the surgery was 19.06 ± 1.46 and it was increased to 19.84 ± 3.21 after the surgical repair. The result showed there is a significant difference in mean value pre and post-operative (P = 0.048), though it is a slight improvement compared to other domains. Conclusion The overall quality of life of the patient with fistula was improved after successful surgical repair. Although all domains of quality of life had shown significant improvement after successful surgical repair, the psychological domain showed slight improvement.


2021 ◽  
Author(s):  
majdi abu sneineh ◽  
malek abu sneineh ◽  
Monther Abu Sneineh ◽  
mustafa abu sneineh ◽  
muneer abu snineh ◽  
...  

Abstract Introduction GERD is one of the complications of bariatric operations that might affect the quality of life. We aim to perform a retrospective cohort study to determine the incidence of symptomatic GERD following different types of bariatric surgery and which operations are considered a contraindication of GERD. Besides, we are attempting to identify the risk factors of GERD after bariatric surgery. Methods Medical records of 729 patients undergone bariatric operations between January 2010 and June 2019 at Shamir (Assaf Harofeh) Medical Center were reviewed. Results There was a significant difference between the type of bariatric procedure and the incidence of GERD symptoms after the operation. The incidence of symptomatic GERD in patients who underwent SG was 39.9% (p =0.0131). This was significantly higher compared to 16.4% following roux en y gastric bypass, 23.4% following LAGB, and 11% following OAGB. 113 patients out of 718 had a positive swallow test and of these patient 71 developed GERD symptoms post-operatively without correlation to the degree of reflux at the swallow test but with statistically significant correlation to the type of operation especially for SG (P-value <0.001) and to our knowledge this was never reported in the literature. Conclusion SG is a good bariatric procedure option but should be contraindicated in asymptomatic reflux contrast swallow study and symptomatic GERD patients preoperatively because of high levels of symptomatic GERD post-operatively. Asymptomatic reflux at contrast swallow study pre-operatively should be considered a risk factor for GERD after the operation.


2012 ◽  
Vol 2012 ◽  
pp. 1-10 ◽  
Author(s):  
Qurban A. Memon ◽  
Adnan Harb ◽  
Shakeel Khoja

The program assessment process combines assessments from individual courses to generate final program assessment to match accreditation benchmarks. In developing countries, industrial environment is not diversified to allow graduating engineers to seek jobs in all disciplines or specializations of an engineering program. Hence, it seems necessary to seek evolution of an engineering program assessment for specialized requirements of the industry. This paper describes how specialization-specific courses’ assessments are grouped per requirements and then integrated towards overall program assessment. A software program application is developed to automate this development to reduce assessment work and show equivalently as integration of specialization-specific assessments per outcome per term. The implementation also shows how outcomes are integrated per specialization-specific courses in order to judge the implementation of the program assessment. This effort is expected to help stake holders of the program to judge evolution and quality of specialization tracks vis-à-vis expectations of the local industry.


Sign in / Sign up

Export Citation Format

Share Document