scholarly journals How to use adjusted degree of distinguishability and inter-rater reliability simultaneously?

2021 ◽  
Vol 42 (3) ◽  
pp. 743-750
Author(s):  
Ayfer Ezgi YILMAZ
Keyword(s):  
Rater Reliability

Structured Interview for Hoarding Disorder (SIHD)

2019 ◽  
Vol 35 (4) ◽  
pp. 512-520
Author(s):  
Caterina Novara ◽  
Paolo Cavedini ◽  
Stella Dorz ◽  
Susanna Pardini ◽  
Claudio Sica
Keyword(s):  
Convergent Validity ◽  
Structured Interview ◽  
Diagnostic Process ◽  
Schizophrenia Spectrum Disorders ◽  
Clinical Environment ◽  
Obsessive Compulsive ◽  
Rater Reliability ◽  
Hoarding Disorder ◽  
Compulsive Disorder ◽  
Schizophrenia Spectrum

Abstract. The Structured Interview for Hoarding Disorder (SIHD) is a semi-structured interview designed to assist clinicians in diagnosing a hoarding disorder (HD). This study aimed to validate the Italian version of the SIHD. For this purpose, its inter-rater reliability has been analyzed as well as its ability to differentiate HD from other disorders often comorbid. The sample was composed of 74 inpatients who had been diagnosed within their clinical environment: 9 with HD, 11 with obsessive-compulsive disorder (OCD) and HD, 22 with OCD, 19 with major depressive disorder (MDD), and 13 with schizophrenia spectrum disorders (SSD). The results obtained indicated “substantial” or “perfect” inter-rater reliability for all the core HD criteria, HD diagnosis, and specifiers. The SIHD differentiated between subjects suffering from and not suffering from a HD. Finally, the results indicated “good” convergent validity and high scores were shown in terms of both sensitivity and specificity for HD diagnosis. Altogether, the SIHD represents a useful instrument for evaluating the presence of HD and is a helpful tool for the clinician during the diagnostic process.

Youth Risk Assessment: Inter-Rater Reliability of State Corrections Staff

2012 ◽  
Author(s):  
Patrick J. Kennealy ◽  
Isaias Hernandez ◽  
Jennifer Skeem
Keyword(s):  
Risk Assessment ◽  
Rater Reliability

Inter- and Intra- Rater Reliability of Navicular Drop Tests Position

2019 ◽  
Vol 26 (1) ◽  
pp. 9-14
Author(s):  
So-yeon Kim ◽  
Jung-eun Yoo ◽  
Da-hyun Woo ◽  
Bo-young Jung ◽  
Bo-ram Choi
Keyword(s):  
Rater Reliability ◽  
Navicular Drop ◽  
Drop Tests

Inter-rater Reliability of Preceptors on Clinical Pharmacy Competency Evaluation

2020 ◽  
Vol 15 ◽  
Author(s):  
Dixon Thomas ◽  
Sherief Khalifa ◽  
Jayadevan Sreedharan ◽  
Rucha Bond
Keyword(s):  
United Arab Emirates ◽  
Clinical Pharmacy ◽  
Clinical Competence ◽  
Assessment Tool ◽  
Clinical Skills ◽  
Group Discussion ◽  
Pharmacy Students ◽  
Rater Reliability ◽  
Quasi Experimental ◽  
Competency Evaluation

Background:: Clinical competence of pharmacy students is better evaluated at their practice sites. compared to the classroom. A clinical pharmacy competency evaluation rubric like that of the American College of Clinical Pharmacy (ACCP)is an effective assessment tool for clinical skills and can be used to show item reliability. The preceptors should be trained on how to use the rubrics as many inherent factors could influence inter-rater reliability. Objective:: To evaluate inter-rater reliability among preceptors on evaluating clinical competence of pharmacy students, before and after a group discussion intervention. Methods:: In this quasi experimental study in a United Arab Emirates teaching hospital, Seven clinical pharmacy preceptors rated clinical pharmacy competencies of ten recent PharmD graduates referring to their portfolios and preceptorship. Clinical pharmacy competencies were adopted from ACCP and mildly modified to be relevant for the local settings. Results:: Inter-rater reliability (Cronbach's Alpha) among preceptors was reasonable being practitioners at a single site for 2-4 years. At domain level, inter-rater reliability ranged from 0.79 - 0.93 before intervention and 0.94 - 0.99 after intervention. No inter-rater reliability was observed in relation to certain competency elements ranging from 0.31 – 0.61 before intervention, but improved to 0.79 – 0.97 after intervention. Intra-class correlation coefficient improved among all individual preceptors being reliable with each other after group discussion though some had no reliability with each other before group discussion. Conclusion:: Group discussion among preceptors at the training site was found to be effective in improving inter-rater reliability on all elements of the clinical pharmacy competency evaluation. Removing a preceptor from analysis did not affect inter-rater reliability after group discussion.

Sign in / Sign up

Export Citation Format

Share Document