Development and pilot testing of an operative competency assessment tool for pediatric direct laryngoscopy and rigid bronchoscopy

2010 ◽  
Vol 120 (11) ◽  
pp. 2294-2300 ◽  
Author(s):  
Stacey L. Ishman ◽  
David J. Brown ◽  
Emily F. Boss ◽  
Margaret L. Skinner ◽  
David E. Tunkel ◽  
...  
Keyword(s):  
Direct Laryngoscopy ◽  
Assessment Tool ◽  
Rigid Bronchoscopy ◽  
Competency Assessment ◽  
Pilot Testing

scholarly journals Blinded Evaluation of Interrater Reliability of an Operative Competency Assessment Tool for Direct Laryngoscopy and Rigid Bronchoscopy

2012 ◽  
Vol 138 (10) ◽  
pp. 916 ◽  
Author(s):  
Stacey L. Ishman ◽  
James R. Benke ◽  
Kaalan Erik Johnson ◽  
Karen B. Zur ◽  
Ian N. Jacobs ◽  
...  
Keyword(s):  
Direct Laryngoscopy ◽  
Interrater Reliability ◽  
Assessment Tool ◽  
Rigid Bronchoscopy ◽  
Competency Assessment

scholarly journals A Novel Scenario-Based Interview Tool to Evaluate Nontechnical Skills and Competencies in Global Health Delivery

2017 ◽  
Vol 9 (4) ◽  
pp. 467-472 ◽  
Author(s):  
Emily B. Wroe ◽  
Ryan K. McBain ◽  
Annie Michaelis ◽  
Elizabeth L. Dunbar ◽  
Lisa R. Hirschhorn ◽  
...  
Keyword(s):  
Global Health ◽  
Discriminant Validity ◽  
Assessment Tool ◽  
Care Patient ◽  
Ordinal Scale ◽  
Competency Assessment ◽  
Health Practitioner ◽  
Pilot Testing ◽  
Health Delivery ◽  
Potential Applicability

ABSTRACT Background  Despite rapid growth in the number of physicians and academic institutions entering the field of global health, there are few tools that inform global health curricula and assess physician readiness for this field. Objective  To address this gap, we describe the development and pilot testing of a new tool to assess nontechnical competencies and values in global health. Competencies assessed include systems-based practice, interpersonal and cross-cultural communication, professionalism and self-care, patient care, mentoring, teaching, management, and personal motivation and experience. Methods  The Global Health Delivery Competency Assessment Tool presents 15 case vignettes and open-ended questions related to situations a global health practitioner might encounter, and grades the quality of responses on a 6-point ordinal scale. We interviewed 17 of 18 possible global health residents (94%), matched with 17 residents not training in global health, for a total of 34 interviews. A second reviewer independently scored recordings of 13 interviews for reliability. Results  Pilot testing indicated a high degree of discriminant validity, as measured by the instrument's ability to distinguish between residents who were and were not enrolled in a global health program (P < .001). It also demonstrated acceptable consistency, as assessed by interrater reliability (κ = 0.53), with a range of item-level agreement from 84%–96%. Conclusions  The tool has potential applicability to a variety of academic and programmatic activities, including evaluation of candidates for global health positions and evaluating the success of training programs in equipping practitioners for entry into this field.

Uji Validitas Dan Reliabilitas Kuesioner Pengukuran Kompetensi Sistem Informasi Keperawatan: NICAT Dalam Bahasa Indonesia

2019 ◽  
Vol 8 (1) ◽  
pp. 39-43
Author(s):  
Stephanie Dwi Guna ◽  
Yureya Nita
Keyword(s):  
Patient Safety ◽  
Electronic Health Record ◽  
Assessment Tool ◽  
Competency Assessment ◽  
Health Record ◽  
Nursing Informatics ◽  
Cronbach’S Alpha ◽  
Cronbach's Alpha ◽  
Electronic Health ◽  
Bahasa Indonesia

Integrasi Teknologi Informasi (TI) di bidang kesehatan terbukti meningkatkan kualitas pelayanan kesehatan dengan meningkatkan patient safety serta mempercepat waktu layanan. Salah satu inovasi TI di bidang kesehatan yaitu rekam medik elektronik (electronic health record). Rekam medik jenis ini sudah umum digunakan di negara maju namun masih jarang digunakan di negara berkembang termasuk Indonesia. Sebelum pengimplementasian suatu sistem informasi baru di pelayanan kesehatan, perlu dipastikan bahwa user dapat mengoperasikannya dengan baik sehingga hasil dari sistem tersebut optimal. Perawat sebagai tenaga kesehatan dengan jumlah paling banyak di suatu pelayanan kesehatan seperti Rumah Sakit merupakan user terbesar bila rekam medik elektronik ini diterapkan.  Oleh karena itu diperlukan suatu alat untuk mengukur kemampuan atau literasi sistem informasi keperawatan (SIK). Salah satu alat ukur kompetensi SIK yaitu NICAT (Nursing Informatics Competency Assessment Tool) yang memiliki 3 bagian serta 30 item pertanyaan. Penulis melakukan alih bahasa pada kuesioner ini, kemudian melakukan uji validitas dan reliabilitas. Jumlah sampel pada penelitian ini yaitu 233 perawat di salah satu Rumah Sakit Pemerintah di Pekanbaru, Indonesia. Hasil uji validitas pada 30 item dengan r tabel 0.128 menunjukkan r hitung diatas nilai tersebut dengan Cronbach’s Alpha 0,975. Dapat disimpulkan kuesioner pengukuran kemampuan SIK (NICAT versi Bahasa Indonesia) telah valid dan reliabel sehingga dapat digunakan mengukur kemampuan SIK perawat Indonesia.

scholarly journals Validity and reliability of Korean version Competency Assessment Tool-Mental Health

2020 ◽  
Vol 7 (2) ◽  
pp. 143-152
Author(s):  
Hyun Mee Cho ◽  
Jeong Won Han ◽  
Eun Joung Choi ◽  
Hyo Eun Jeong ◽  
Bo Ram Hong ◽  
...  
Keyword(s):  
Mental Health ◽  
Health Care ◽  
Mental Health Care ◽  
Internal Consistency ◽  
Assessment Tool ◽  
Reliability And Validity ◽  
Basic Data ◽  
Measurement Tool ◽  
Competency Assessment ◽  
Validity And Reliability

AbstractObjectiveTo establish basic data for identifying the level of mental health care competency of general nurses through verification of the reliability and validity of Competency Assessment Tool-Mental Health in the development of a measurement tool for mental health care competency in Korea.MethodsThis study was conducted on nurses working at general wards, excluding those working at the Department of Psychiatry, in five hospitals with 200 beds or more located in Korea. Content, construct, concurrent validity, and internal consistency of the measurement were confirmed.ResultsAs a result of the construct validity, the section on importance of skills and knowledge for mental health care had 21 items, whereas the section on benefits of additional education had 22 items. The internal consistency of measurement was confirmed as follows: Cronbach's α = 0.96 for the section on importance and 0.96 for the section on benefits section.ConclusionsThis study verified the high validity and reliability of the tool in assessing the mental health care competency of nurses, and it is believed to be significant as basic data for enhancing such competency.

scholarly journals Ophthalmic simulated surgical competency assessment rubric (Sim-OSSCAR) for trabeculectomy

2019 ◽  
Vol 4 (1) ◽  
pp. e000313 ◽  
Author(s):  
William H Dean ◽  
John Buchan ◽  
Fisseha Admassu ◽  
Min J Kim ◽  
Karl C Golnik ◽  
...  
Keyword(s):  
Content Validity ◽  
Assessment Tool ◽  
Interobserver Reliability ◽  
Glaucoma Surgery ◽  
Face Validity ◽  
Competency Assessment ◽  
Validity And Reliability ◽  
Wilcoxon Rank Sum Test ◽  
Better Than ◽  
Assessment Rubric

Background/aimsTo develop, test and determine whether a surgical-competency assessment tool for simulated glaucoma surgery is valid.MethodsThe trabeculectomy ophthalmic simulated surgical competency assessment rubric (Sim-OSSCAR) was assessed for face and content validity with a large international group of expert eye surgeons. Cohorts of novice and competent surgeons were invited to perform anonymised simulation trabeculectomy surgery, which was marked using the Sim-OSSCAR in a masked fashion by a panel of four expert surgeons. Construct validity was assessed using a Wilcoxon rank-sum test. Krippendorff’s alpha was calculated for interobserver reliability.ResultsFor the Sim-OSSCAR for trabeculectomy, 58 of 67 surgeons (86.6%) either agreed or strongly agreed that the Sim-OSSCAR is an appropriate way to assess trainees’ surgical skill. Face validity was rated as 4.04 (out of 5.00). Fifty-seven of 71 surgeons (80.3%) either agreed or strongly agreed that the Sim-OSSCAR contents represented the surgical technique of surgical trabeculectomy. Content validity was rated as 4.00. Wilcoxon rank-sum test showed that competent surgeons perform better than novices (p=0.02). Interobserver reliability was rated >0.60 (Krippendorff’s alpha) in 19 of 20 steps of the Sim-OSSCAR.ConclusionThe Sim-OSSCAR for trabeculectomy, a newly developed and validated assessment tool for simulation glaucoma surgery, has validity and reliability. It has the potential to play a useful role in ophthalmic surgical education.

scholarly journals A Call for Leadership and Management Competency Development for Directors of Medical Services—Evidence from the Chinese Public Hospital System

2020 ◽  
Vol 17 (18) ◽  
pp. 6913
Author(s):  
Zhanming Liang ◽  
Peter Howard ◽  
Jian Wang ◽  
Min Xu
Keyword(s):  
Assessment Tool ◽  
System Level ◽  
Medical Services ◽  
Competency Assessment ◽  
Competency Development ◽  
Hospital System ◽  
Health Service Provision ◽  
Leadership And Management ◽  
Medical Leadership ◽  
Management Competency

Background: A competent medical leadership and management workforce is key to the effectiveness and efficiency of health service provision and to leading and managing the health system reform agenda in China. However, the traditional recruitment and promotion approach of relying on clinical performance and seniority provides limited incentive for competency development and improvement. Methods: A three-component survey including the use of a validated management competency assessment tool was conducted with Directors of Medical Services (n = 143) and Deputy Directors of Medical Services (n = 152) from three categories of hospital in Jinan, Shandong Province, China. Results: The survey identified the inadequacy of formal and informal management training received by hospital medical leaders before commencing their management positions and confirms that the low self-perceived competency level across two medical management level and three hospitals was beyond acceptable. The study also indicates that the informal and formal education provided to Chinese medical leaders have not been effective in developing the required management competencies. Conclusions: The study suggests two system level approaches (health and higher education systems) and one organization level approach to formulate overall medical leadership and management workforce development strategies to encourages continuous management competency development and self-improvement among clinical leaders in China.

Sign in / Sign up

Export Citation Format

Share Document