Testing the Reliability and Construct Validity of Short-Term Assessment of Risk and Treatability (START) in Non-Western Forensic Psychiatric Inpatients

The Short-Term Assessment of Risk and Treatability (START) is deemed the most appropriate instrument for assessing violence risks and management because of its balanced approach between dynamic risk and protective factors. Although several facets of reliability and predictive validity of this tool were strong, its inter-rater reliability, construct validity, and implementation in Asian population were under-investigated. The objective of this research was to examine the inter-rater reliability and construct validity of the START: Thai version within forensic psychiatric inpatients. The participants consisted of 118 forensic psychiatric inpatients hospitalized at Galya Rajanagarindra Institute in Thailand. Trained mental health professionals (i.e., psychiatrists, forensic nurses, clinical psychologists, social workers, and occupational therapists) assessed each participant across twenty domains of the Thai START. The inter-rater reliability was examined using the intraclass correlation coefficient and a confirmatory factor analysis for ordinal data was used to test the construct validity of the scale. The main finding showed a good-to-excellent inter-rater reliability and supported two relational constructs (i.e., strength vs vulnerability subscales) of the Thai START. The Thai START is a promising tool for using in Thai forensic psychiatric setting but some items were not significant in contributing to the scale. This study also provides the guideline for implementing the tool in non-Western forensic psychiatric populations.

Reliability of hip joint position sense tests using a clinically applicable measurement tool in elderly participants with unilateral hip osteoarthritis

Hip joint proprioception is vital in maintaining posture and stability in elderly individuals. Examining hip joint position sense (JPS) using reliable tools is important in contemporary clinical practice. The objective of this study is to evaluate the intra-rater and inter-rater reliability of hip JPS tests using a clinically applicable measurement tool in elderly individuals with unilateral hip osteoarthritis (OA). Sixty-two individuals (mean age = 67.5 years) diagnosed with unilateral hip OA participated in this study. The JPS tests were evaluated using a digital inclinometer in hip flexion and abduction directions. The absolute difference between target and reproduced angle (repositioning error) in degrees was taken to measure JPS accuracy. The intraclass correlation coefficient (ICC (2.k), was used to assess the reliability. The Intra rater-reliability for hip JPS tests showed very good agreement in the lying position (hip flexion-ICC = 0.88–0.92; standard error of measurement (SEM) = 0.06–0.07, hip abduction-ICC = 0.89–0.91; SEM = 0.06–0.07) and good agreement in the standing position (hip flexion-ICC = 0.69–0.72; SEM = 0.07, hip abduction-ICC = 0.66–0.69; SEM = 0.06–0.08). Likewise, inter-rater reliability for hip JPS tests demonstrated very good agreement in the lying position (hip flexion-ICC = 0.87–0.89; SEM = 0.06–0.07, hip abduction-ICC = 0.87–0.91; SEM = 0.07) and good agreement in the standing position (hip flexion-ICC = 0.64–0.66; SEM = 0.08, hip abduction-ICC = 0.60–0.72; SEM = 0.06–0.09). The results support the use of hip JPS tests in clinical practice and should be incorporated in assessing and managing elderly participants with hip OA.

Inter-rater reliability of optic nerve sheath diameter measurement using real-time ultrasonography

Objectives Ultrasound measurement of the optic nerve sheath diameter (ONSD) is a rapid, non-invasive means to indirectly assess intracranial pressure. Previous research has demonstrated the ability of emergency physicians to measure ONSD accurately with bedside ultrasound when compared to CT scan or MRI, however the reliability of this measurement between two or more operators has been called into question (Hassen et al. in J Emerg Med 48:450–457, 2015; Shirodkar et al. in Ind J Crit Care Med 19:466–470, 2015). Given the need for accurate and precise measurement to use this as a screening exam, we sought to determine the inter-rater reliability between ONSD measurements obtained in real time by fellowship-trained emergency ultrasound physicians. Methods Three ultrasound fellowship-trained emergency physicians measured bilateral ONSD of 10 healthy volunteers using a high-frequency linear transducer. The physicians were blinded to the other scanners’ measurements, and no instructions were given other than to obtain the ONSD. Each sonographer measured the ONSD in real time and it was recorded by a research coordinator. All measurements were recorded in millimeters. Intraclass correlation coefficients (ICCs) were calculated to estimate the inter-rater reliability. Results A total of 60 measurements of ONSD were obtained. The average measurement was 4.3 mm (3.83–4.77). Very little variation was found between the three physicians, with a calculated ICC of 0.82 (95% confidence interval 0.63–0.92). Conclusions ONSD measurement obtained by ultrasound fellowship-trained emergency medicine physicians is a reliable measurement with a high degree of correlation between scanners.

Is Oral Contrast Beneficial for Visualization of the Appendix in Low-Weight Children?Les produits de contraste par voie orale sont-ils utiles pour visualiser l’appendice chez les enfants de petit poids?

Purpose: It has been shown that oral contrast does not improve the diagnostic accuracy of Computed Tomography (CT) for appendicitis in pediatric patients; however, the cohorts in these studies were not stratified by weight or body mass index. The purpose of this study is to assess the benefit of oral contrast administration for identifying the appendix in younger children in the lower weight quartile. Materials and Methods: This retrospective study comprised 100 patients (2–10 years) in lower weight quartile who had intravenous contrast-enhanced CT of the abdomen and pelvis, 37 of which with oral contrast, and 63 without. A pediatric radiologist and a pediatric radiology fellow independently assessed whether the appendix was visualized or not. In case of discrepancy, an additional pediatric radiologist was the “tie-breaker.” Chi-squared test was used to compare the proportion of visualized appendix between the groups (with and without oral contrast). Inter-rater reliability was determined using Cohen’s Kappa coefficient. Results: There was no significant difference in the visualization of the appendix between the group with oral contrast and without ( P = 1). The Cohen Kappa coefficients were .33 (.05, .62) and .91 (.73, 1.00) for the “no oral” and “oral” groups, respectively, yielding evidence of a difference ( P = .007). Conclusions: There was no significant difference in the visualization of the appendix using CT with or without oral contrast in low-weight pediatric patients. The inter-rater reliability, however, was significantly higher in the group given oral contrast. Additional studies assessing the value of oral contrast for the sole indication of appendicitis may provide clearer results.

Reliability of new radiographic measurement techniques for elbow bony impingement

Background Identifying the location and scale of radiographic changes in elbow bony impingement (EBI) is critical in formulating an appropriate diagnosis and treatment plan for such patients. The purpose of present study was to evaluate the intra-rater and inter-rater reliability of the new radiographic parameters, Anterior Impingement angle (AIa) and Posterior Impingement angle (PIa), for EBI. In addition, to determine if there was a relationship between radiographic parameters and clinical evaluation. Patients and methods Three raters of different levels of training evaluated the radiographs of 60 patients (30 in EBI group and 30 in normal group) twice, at least 2 weeks apart. Intra-rater and inter-rater reliabilities were calculated by Intraclass Correlation Coefficients (ICC) with 95% confidence intervals. Correlation between radiographic parameters and clinical evaluation was calculated by Pearson correlation coefficient. Results In both groups, intra-rater and inter-rater reliabilities were substantial. There were no significant differences in reliability between upper-hand expert surgeons and resident for either measurement. Good correlation was observed between impingement arcs and range of motion values. Conclusions Both AIa and PIa measurements demonstrated substantial intra-rater and inter-rater reliability for normal radiographs and in EBI patients. Good reliability, for either expert surgeons or residents in training, and good correlation between radiographic measurements and manual testing, appoints this method may be easily and reliably used in every day practice.

Validity and Reliability of the Richmond Agitation-Sedation Scale in Pediatric Intensive Care Patients: A Multicenter Study

Background: There is limited data about the psychometric properties of the Richmond Agitation-Sedation Scale (RASS) in children. This study aims to analyze the validity and reliability of the RASS in assessing sedation and agitation in critically ill children.Methods: A multicenter prospective study in children admitted to pediatric intensive care, aged between 1 month and 18 years. Twenty-eight observers from 14 PICUs (pediatric intensive care units) participated. Every observation was assessed by 4 observers: 2 nurses and 2 pediatric intensivists. We analyzed RASS inter-rater reliability, construct validity by comparing RASS to the COMFORT behavior (COMFORT-B) scale and the numeric rating scale (NRS), and by its ability to distinguish between levels of sedation, and responsiveness to changes in sedative dose levels.Results: 139 episodes in 55 patients were analyzed, with a median age 3.6 years (interquartile range 0.7–7.8). Inter-rater reliability was excellent, weighted kappa (κw) 0.946 (95% CI, 0.93–0.96; p < 0.001). RASS correlation with COMFORT-B scale, rho = 0.935 (p < 0.001) and NRS, rho = 0.958 (p < 0.001) was excellent. The RASS scores were significantly different (p < 0.001) for the 3 sedation categories (over-sedation, optimum and under-sedation) of the COMFORT-B scale, with a good agreement between both scales, κw 0.827 (95% CI, 0.789–0.865; p < 0.001), κ 0.762 (95% CI, 0.713–0.811, p < 0.001). A significant change in RASS scores (p < 0.001) was recorded with the variance of sedative doses.Conclusions: The RASS showed good measurement properties in PICU, in terms of inter-rater reliability, construct validity, and responsiveness. These properties, including its ability to categorize the patients into deep sedation, moderate-light sedation, and agitation, makes the RASS a useful instrument for monitoring sedation in PICU.