scholarly journals Establishing Content Validity of a Student Pharmacist Patient Counseling Competency Assessment in Oncology

Author(s):  
Matthew Newman ◽  
Emily Pherson ◽  
Bradley Burton ◽  
Eric Nemec
2019 ◽  
Vol 4 (1) ◽  
pp. e000313 ◽  
Author(s):  
William H Dean ◽  
John Buchan ◽  
Fisseha Admassu ◽  
Min J Kim ◽  
Karl C Golnik ◽  
...  

Background/aimsTo develop, test and determine whether a surgical-competency assessment tool for simulated glaucoma surgery is valid.MethodsThe trabeculectomy ophthalmic simulated surgical competency assessment rubric (Sim-OSSCAR) was assessed for face and content validity with a large international group of expert eye surgeons. Cohorts of novice and competent surgeons were invited to perform anonymised simulation trabeculectomy surgery, which was marked using the Sim-OSSCAR in a masked fashion by a panel of four expert surgeons. Construct validity was assessed using a Wilcoxon rank-sum test. Krippendorff’s alpha was calculated for interobserver reliability.ResultsFor the Sim-OSSCAR for trabeculectomy, 58 of 67 surgeons (86.6%) either agreed or strongly agreed that the Sim-OSSCAR is an appropriate way to assess trainees’ surgical skill. Face validity was rated as 4.04 (out of 5.00). Fifty-seven of 71 surgeons (80.3%) either agreed or strongly agreed that the Sim-OSSCAR contents represented the surgical technique of surgical trabeculectomy. Content validity was rated as 4.00. Wilcoxon rank-sum test showed that competent surgeons perform better than novices (p=0.02). Interobserver reliability was rated >0.60 (Krippendorff’s alpha) in 19 of 20 steps of the Sim-OSSCAR.ConclusionThe Sim-OSSCAR for trabeculectomy, a newly developed and validated assessment tool for simulation glaucoma surgery, has validity and reliability. It has the potential to play a useful role in ophthalmic surgical education.


2015 ◽  
Vol 34 (6) ◽  
pp. 329-336 ◽  
Author(s):  
Leigh Ann Cates ◽  
Sheryl Bishop ◽  
Debra Armentrout ◽  
Terese Verklan ◽  
Jennifer Arnold ◽  
...  

AbstractPurpose: Determine content validity of global statements and operational definitions and choose scenarios for Competency, Assessment, Technology, Education, and Simulation (C.A.T.E.S.), instrument in development to evaluate multidimensional competency of neonatal nurse practitioners (NNPs).Design: Real-time Delphi (RTD) method to pursue four specific aims (SAs): (1) identify which cognitive, technical, or behavioral dimension of NNP competency accurately reflects each global statement; (2) map the global statements to the National Association of Neonatal Nurse Practitioners (NANNP) core competency domains; (3) define operational definitions for the novice to expert performance subscales; and (4) determine the essential scenarios to assess NNPs.Sample: Twenty-five NNPs and nurses with competency and simulation experienceMain outcome variable: One hundred percent of global statements correct for competency dimension and all but two correct for NANNP domain. One hundred percent novice to expert operational definitions and eight scenarios chosen.Results: Content validity determined for global statements and novice to expert definitions and essential scenarios chosen.


Author(s):  
Fatemeh Mohammadi ◽  
Mahmood Mahmoodi ◽  
Majdabadi Farahani ◽  
Leila Nazarimanesh ◽  
Seyed Jamaleddin

Introduction: The importance of using the competent managers in the healthcare system, shows the need to recognize their competencies and having standards to measure competencies. In this regard, the purpose of this article is to determine the validity and reliability of the competency assessment tool of the American College of Health Care Executives for the managers of healthcare networks in Zanjan province. Methods: This study is a descriptive-analytical study in which data collection was performed using the American College of Health Care Executives Competencies Assessment tool. This tool was provided to 30 healthcare management professors and experts, in Zanjan province. To investigate the validity, internal consistency and repeatability Content Validation methods, Cronbach's Alpha coefficient and Retesting were used respectively. Data were analyzed using Excel 2010 and SPSS 18 software. Results: The results showed that 235 out of 302 questions related to the American College of Health Care Executives Competencies Assessment tool had low content validity and should be rejected. The content validity index of the final questionnaire was calculated to be 0.84, which is acceptable. The results also showed that the final questionnaire was reliable with α=0.98 and repeatable. Conclusion: Utilizing a framework to assess the competencies of healthcare network managers can be of benefit in choosing qualified managers. According to the results of this study, the provided tool shows a desirable reliability and a fairly convenient validity to be used in healthcare networks of Zanjan province.


2020 ◽  
Vol 24 (2) ◽  
Author(s):  
Rusijono Rusijono ◽  
Amat Jaedun ◽  
Badrun Kartowagiran ◽  
Ahman Ahman ◽  
Lukman A. R. Laliyo ◽  
...  

The purpose of the study was to develop instruments for measuring the social competence of teacher candidates in the Industrial Revolution 4.0 era. The instrument was developed by referring to Indonesia Constitution Number 14 of 2005 concerning Teachers and Lecturers, Ministry of National Education (MONE) Regulation Number 16 of 2007, with the strengthened special competence of teacher’ candidates in the I.R. 4.0 era, were the top ten relevant skills. The instrument development was carried out with the following steps: (1) developing instrument constructs, (2) developing instrument blueprint, (3) instrument item writing, (4) instrument review, (5) instrument revision, (6) limited testing of instruments. The limited instrument testing was carried out with as many as 107 test subjects for 6th semester undergraduate education at UNY, consisting of three study programs, namely Mathematics Education, Indonesian Language Education, and English Language Education study programs. Data analysis to determine content validity was carried out based on Aiken's V coefficient, construct validity analysis was carried out with CFA, and reliability estimates were based on the Cronbach Alpha formula. The results of the analysis of the content validity of 30 instruments by seven experts, obtained the Aiken V index between 0.61 - 0.93, with 29 items valid, and one item invalid. The results of construct validity analysis with exploratory factor analysis (EFA) showed 25 valid items and five invalid items, with a KMO value of 0.504, while the significance of the Bartlett's Test was p = 0,000. Meanwhile, confirmatory factor analysis showed a fit model, with Chi-Square value = 290.35; p = 0.18; RMSEA = 0.00; GFI = 0.83; SRMR = 0.083; AGFI = 0.80; CFI = 0.86; RFI = 0.28. The reliability results show that the Cronbach Alpha coefficient is 0.40. This results shows that the social competency assessment instruments for teachers’ candidates in the I.R. 4.0 era have been developed is feasible to use, with some revisions.


2014 ◽  
Vol 35 (4) ◽  
pp. 236-244 ◽  
Author(s):  
Atsushi Oshio ◽  
Shingo Abe ◽  
Pino Cutrone ◽  
Samuel D. Gosling

The Ten Item Personality Inventory (TIPI; Gosling, Rentfrow, & Swann, 2003 ) is a widely used very brief measure of the Big Five personality dimensions. Oshio, Abe, and Cutrone (2012) have developed a Japanese version of the TIPI (TIPI-J), which demonstrated acceptable levels of reliability and validity. Until now, all studies examining the validity of the TIPI-J have been conducted in the Japanese language; this reliance on a single language raises concerns about the instrument’s content validity because the instrument could demonstrate reliability (e.g., retest) and some forms of validity (e.g., convergent) but still not capture the full range of the dimensions as originally conceptualized in English. Therefore, to test the content validity of the Japanese TIPI with respect to the original Big Five formulation, we examine the convergence between scores on the TIPI-J and scores on the English-language Big Five Inventory (i.e., the BFI-E), an instrument specifically designed to optimize Big Five content coverage. Two-hundred and twenty-eight Japanese undergraduate students, who were all learning English, completed the two instruments. The results of correlation analyses and structural equation modeling demonstrate the theorized congruence between the TIPI-J and the BFI-E, supporting the content validity of the TIPI-J.


2009 ◽  
Vol 3 (4, Suppl) ◽  
pp. S27-S45 ◽  
Author(s):  
Nadine J. Kaslow ◽  
Catherine L. Grus ◽  
Linda F. Campbell ◽  
Nadya A. Fouad ◽  
Robert L. Hatcher ◽  
...  

Sign in / Sign up

Export Citation Format

Share Document