Sedation levels in dogs: a validation study

10.7287/peerj.preprints.2485v1 ◽

2016 ◽

Author(s):

Marika C Wagner ◽

Kent G Hecker ◽

Daniel Pang

Keyword(s):

Internal Consistency ◽

Validation Study ◽

Prospective Trial ◽

Full Scale ◽

Sedation Scale ◽

Good Reliability ◽

Rater Reliability ◽

Video Recordings ◽

Excellent Internal Consistency ◽

To Receive

The aim of this study was to assess validation evidence for a sedation scale for dogs. We hypothesized that the chosen sedation scale would be unreliable when used by different raters and show poor discrimination between sedation protocols. A sedation scale was used to score 62 dogs scheduled to receive sedation at two veterinary clinics in a prospective trial. Scores recorded by a single observer were used to assess internal consistency and construct validity of the scores. To assess inter-rater reliability, video-recordings of sedation assessment were randomized and blinded for viewing by 5 raters untrained in the scale. Videos were also edited to allow assessment of inter-rater reliability of an abbreviated scale by 5 different raters. Both sedation scales exhibited excellent internal consistency and very good inter-rater reliability (full scale, ICCsingle = 0.95; abbreviated scale, ICCsingle = 0.94). The full scale discriminated between the most common protocols: dexmedetomidine-hydromorphone (11 [1-18], n = 20) and acepromazine-hydromorphone (5 [0-15], n = 36, p = 0.02). The hypothesis was rejected. Full and abbreviated scales showed excellent internal consistency and very good reliability between multiple untrained raters. The full scale differentiated between levels of sedation.

Download Full-text

Development and Validation of an Instrument to Assess Horseback Mobility in Hippotherapy

Perceptual and Motor Skills ◽

10.1177/00315125211036578 ◽

2021 ◽

pp. 003151252110365

Author(s):

Alessandra V. Prieto ◽

Kênnea Martins Almeida Ayupe ◽

Ana C. A. Abreu ◽

Paulo J. B. Gutierres Filho

Keyword(s):

Correlation Coefficient ◽

Factor Structure ◽

Internal Consistency ◽

Rater Reliability ◽

Intra Class Correlation ◽

Exploratory Factor Analyses ◽

Excellent Internal Consistency ◽

Development And Validation ◽

Functional Gain ◽

Intra Class Correlation Coefficient

Improvement in rider mobility represents an important functional gain for people with disabilities undergoing hippotherapy. However, there is no validated measuring instrument to track and document the rider's progress in riding activities. In this study, we aimed to develop and establish validity evidence for an instrument to assess hippotherapy participants’ mobility on horseback. We report on this development through the stages of: (a) content validation, (b) construct validation, (c) inter- and intra-rater reliability and (d) internal consistency analysis. We evaluated its factor structure with exploratory factor analyses, calculated values for inter- and intra-rater reliability using the intra-class correlation coefficient, and calculated its internal consistency using Cronbach's alpha. We followed recommendations by the Guidelines for Reporting Reliability and Agreement Studies. We found good inter-rater reliability (intra-class correlation coefficient – ICC = 0.991–0.999) and good intra-rater reliability (ICC = 0.997–1.0), and there was excellent internal consistency (Cronbach's α = 0.937–0.999). The instrument’s factor structure grouped its three domains into one factor. As this instrument is theoretically consistent and has been found to be appropriate and reliable for its intended use, it is now available for the measurement of horseback mobility among hippotherapy riders.

Download Full-text

Reliability of three linguistically and culturally validated pain assessment tools for sedated ICU patients by ICU nurses in Finland

Scandinavian Journal of Pain ◽

10.1515/sjpain-2017-0139 ◽

2018 ◽

Vol 18 (2) ◽

pp. 165-173 ◽

Cited By ~ 1

Author(s):

Sanna-Mari Pudas-Tähkä ◽

Sanna Salanterä

Keyword(s):

Intensive Care ◽

Internal Consistency ◽

Pain Assessment ◽

Assessment Tools ◽

Endotracheal Suctioning ◽

Icu Patients ◽

Rater Reliability ◽

Intensive Care Patients ◽

Video Recordings ◽

Test Retest Reliability

Abstract Background and aims: Pain assessment in intensive care is challenging, especially when the patients are sedated. Sedated patients who cannot communicate verbally are at risk of suffering from pain that remains unnoticed without careful pain assessment. Some tools have been developed for use with sedated patients. The Behavioral Pain Scale (BPS), the Critical-Care Pain Observation Tool (CPOT) and the Nonverbal Adult Pain Assessment Scale (NVPS) have shown promising psychometric qualities. We translated and culturally adapted these three tools for the Finnish intensive care environment. The objective of this feasibility study was to test the reliability of the three pain assessment tools translated into Finnish for use with sedated intensive care patients. Methods: Six sedated intensive care patients were videorecorded while they underwent two procedures: an endotracheal suctioning was the nociceptive procedure, and the non-nociceptive treatment was creaming of the feet. Eight experts assessed the patients’ pain by observing video recordings. They assessed the pain using four instruments: the BPS, the CPOT and the NVPS, and the Numeric Rating Scale (NRS) served as a control instrument. Each expert assessed the patients’ pain at five measurement points: (1) right before the procedure, (2) during the endotracheal suctioning, (3) during rest (4) during the creaming of the feet, and (5) after 20 min of rest. Internal consistency and inter-rater reliability of the tools were evaluated. After 6 months, the video recordings were evaluated for testing the test-retest reliability. Results: Using the BPS, the CPOT, the NVPS and the NRS, 960 assessments were obtained. Internal consistency with Cronbach’s alpha coefficient varied greatly with all the instruments. The lowest values were seen at those measurement points where the pain scores were 0. The highest scores were achieved after the endotracheal suctioning at rest: for the BPS, the score was 0.86; for the CPOT, 0.96; and for the NVPS, 0.90. The inter-rater reliability using the Shrout-Fleiss intraclass correlation coefficient (ICC) tests showed the best results after the painful procedure and during the creaming. The scores were slightly lower for the BPS compared to the CPOT and the NVPS. The test-retest results using the Bland-Altman plots show that all instruments gave similar results. Conclusions: To our knowledge, this is the first time all three behavioral pain assessment tools have been evaluated in the same study in a language other than English or French. All three tools had good internal consistency, but it was better for the CPOT and the NVPS compared to the BPS. The inter-rater reliability was best for the NVPS. The test-retest reliability was strongest for the CPOT. The three tools proved to be reliable for further testing in clinical use. Implications: There is a need for feasible, valid and reliable pain assessment tools for pain assessment of sedated ICU patients in Finland. This was the first time the psychometric properties of these tools were tested in Finnish use. Based on the results, all three instruments could be tested further in clinical use for sedated ICU patients in Finland.

Download Full-text

Mansoura Fiberoptic Endoscopic Evaluation of Swallowing Residue Rating Scale (MFRRS): An Anatomically Based Tool – A Preliminary Study

Folia Phoniatrica et Logopaedica ◽

10.1159/000512158 ◽

2020 ◽

pp. 1-13

Author(s):

Aliaa Sabry ◽

James L. Coyle ◽

Tamer Abou-Elsaad

Keyword(s):

Internal Consistency ◽

Rating Scale ◽

Pyriform Sinus ◽

Hard Copy ◽

Kappa Statistics ◽

Endoscopic Evaluation ◽

Rater Reliability ◽

Functional Problem ◽

Excellent Internal Consistency ◽

Residue Levels

Objective: The aim of this work was to design an anatomically based scale for judging post-swallow residue in the pharyngeal cavities, for use during the fiberoptic endoscopic evaluation of swallowing (FEES) in patients with dysphagia, and to assess its feasibility. Methods: Two 7-point ordinal scales (one for vallecular residue and one for pyriform sinus residue), were developed using detailed anatomic landmarks to denote residue levels. Hard copy color images of a specified frame, from 210 videos of 30 adult FEES evaluations demonstrating the range of all possible residue patterns, were selected (n = 56 valleculae, 62 pyriform sinuses). Half of these images were used to train 4 raters. The remaining half of the images were randomly ordered and rated by the trained raters. Two weeks later the same images were randomized again, and each rater re-analyzed them. The inter- and intra-rater reliability and criterion validity were determined using the kappa statistics and their standard errors. The internal consistency of the items in MFRRS was examined. Results: MFRRS showed strong inter-rater reliability (valleculae, κ = 0.832 ± 0.038; pyriform sinus, κ = 0.855 ± 0.034), almost perfect intra-rater reliability (valleculae, κ = 0.964 ± 0.018; pyriform sinus, κ = 0.962 ± 0.02), almost perfect concurrent validity (valleculae, κ = 0.968 ± 0.020; pyriform sinus, κ = 0.0971 ± 0.017), and excellent internal consistency (valleculae, Cronbach’s α = 0.990; pyriform sinus, Cronbach’s α = 0.985). Conclusion: MFRRS is a feasible and reliable, anatomically based tool that can provide more accurate pharyngeal residue judgments. The optimized description of residue accumulation patterns can contribute to a better overall description of the functional problem and future description of dysphagia phenotypes.

Download Full-text

The Suicide Risk Assessment and Management Manual (S-RAMM) Validation Study 1

Irish Journal of Psychological Medicine ◽

10.1017/s0790966700000215 ◽

2009 ◽

Vol 26 (2) ◽

pp. 54-58 ◽

Cited By ~ 6

Author(s):

Atif Ijaz ◽

Alexia Papaconstantinou ◽

Helen O'Neill ◽

Harry G Kennedy

Keyword(s):

Risk Assessment ◽

Internal Consistency ◽

Validation Study ◽

Suicide Risk ◽

Suicide Risk Assessment ◽

Rater Reliability ◽

Cronbach's Alpha ◽

Cohen's Kappa ◽

Risk Assessment And Management ◽

Professional Judgement

AbstractObjective:There are validated tools for structured professional judgement of risk of violence, but few for risk of suicide. The Suicide Risk Assessment and Management Manual (S-RAMM) is a new structured professional judgement tool closely modelled on the HCR-20. This is the first validation study for the S-RAMM. We measured inter-rater reliability, internal consistency, concurrent validity with another validated risk instrument (HCR-20) and with a measure of psychopathology (PANSS). We tested whether the tool could distinguish between groups of patients clinically assessed as at varying levels of risk of suicide or self harm.Method:Two researchers jointly interviewed 25 current in-patients for inter-rater reliability (Cohen's kappa) and internal consistency (Cronbach's alpha) and interviewed 81 of 83 current in-patients to assess whether the mean scores for different wards were significantly different (using ANOVA). Two other researchers made independent ratings of the HCR-20 and PANSS.Results:Inter-rater reliability was acceptable for all items (Cohen's kappa >0.5 for all but three items) and all sub-scale and total scores (Spearman correlations all >0.8). Internal consistency was high, (Cronbach's alpha all sub-scales >0.6). Scores stratified significantly with high scores for admission and intensive care units and progressively lower scores in rehabilitation and predischarge units. The HCR-20 historical and S-RAMM background scores did not correlate but the dynamic sub-scales correlated significantly. PANSS scores also correlated significantly with S-RAMM scores.Conclusion:The S-RAMM has better than minimum acceptable characteristics for use as a clinical or research tool. Prospective studies of sensitivity and specificity are now required.

Download Full-text

Validity and reliability of the Indonesian version of the International Index of Erectile Function

Journal of Clinical Urology ◽

10.1177/2051415820927819 ◽

2020 ◽

pp. 205141582092781

Author(s):

Yudhistira Pradnyan Kloping ◽

Farizal Rizky Muharram ◽

Ardhina Mahendrata Reswari

Keyword(s):

Internal Consistency ◽

Erectile Function ◽

Pearson Correlation ◽

Intraclass Correlation ◽

Critical Value ◽

Validity And Reliability ◽

Level Of Evidence ◽

Good Reliability ◽

Male Sexual Dysfunction ◽

Excellent Internal Consistency

Objective: This study aimed to evaluate the validity and reliability of the Indonesian-translated version of the International Index of Erectile Function (IIEF-15). Subjects and methods: A total of 100 male participants were involved in this study. Written consent was given by each participant before filling in the questionnaire. The original main structure and domains were kept in the translated version. Pearson product–moment correlation was used to test the validity of the results. The reliability was determined based on the Cronbach’s alpha internal consistency measurement and intraclass correlation coefficient. Results: The Pearson correlation findings indicate an excellent level of validity compared to the critical value table ( r>0.254, p<0.01). Almost every domain shows excellent internal consistency (α>0.9) and good reliability (0.75<α<0.90) except for sexual desire (α=0.631, r=0.461) and overall satisfaction (α=0.705, r=0.545), which show lower but acceptable consistency as well as moderate reliability, respectively. Overall, the questionnaire exhibits promising consistency (α=0.974) and reliability ( r=0.712). Conclusion: The Indonesian version of the IIEF-15 is valid and reliable to be used as both a clinical diagnostic tool and an instrument for further studies focusing on male sexual dysfunction in Indonesia. Level of evidence: Not applicable

Download Full-text

An Initial Investigation of the Use of Comparative Referents to Assess Social Anxiety

European Journal of Psychological Assessment ◽

10.1027/1015-5759/a000349 ◽

2018 ◽

Vol 34 (6) ◽

pp. 367-375 ◽

Cited By ~ 1

Author(s):

Laura D. Seligman ◽

Erin F. Swedish ◽

Jason P. Rose ◽

Jessica M. Baker

Keyword(s):

Social Anxiety ◽

Discriminant Validity ◽

Self Report ◽

Injunctive Norms ◽

Good Reliability ◽

Convergent And Discriminant Validity ◽

Excellent Internal Consistency ◽

Social Quality Of Life ◽

Comparison Measures

Abstract. The current study examined the validity of two self-report measures of social anxiety constructed using social comparative referent points. It was hypothesized that these comparison measures would be both reliable and valid. Results indicated that two different comparative versions – one invoking injunctive norms and another invoking descriptive norms – showed good reliability, excellent internal consistency, and acceptable convergent and discriminant validity. The comparative measures also predicted positive functioning, some aspects of social quality of life, and social anxiety as measured by an independent self-report. These findings suggest that adding a comparative reference point to instructions on social anxiety measures may aid in the assessment of social anxiety.

Download Full-text

Feasibility of an iPhone-based application for knee joint goniometry during gait in a stroke patient (Preprint)

10.2196/preprints.12472 ◽

2018 ◽

Author(s):

Claudia Nava ◽

Patrizio Sale ◽

Vittorio Leggero ◽

Simona Ferrante ◽

Cira Fundaro' ◽

...

Keyword(s):

Range Of Motion ◽

Stroke Patient ◽

Reference Method ◽

Flexion Angle ◽

Good Reliability ◽

Rater Reliability ◽

Maximum Extension ◽

Angle Measurements ◽

Hemiparetic Gait ◽

Flexion Extension

BACKGROUND In recent years, different smartphone apps have been validated for joint goniometry, but none for goniometric assessment of gait after stroke. OBJECTIVE The aims of our work were to assess:1) to assess intra-rater reliability of an image-based goniometric app – DrGoniometer- in the measurement of the extension, flexion angles and range of motion of the knee during the hemiparetic gait of a stroke patient; (2) its validity comparing to the reference method (electrogoniometer) for flexion-extension excursion measurements; and the intra-rater agreement in the choice of the video frames. METHODS An left-hemiparetic inpatient following haemorrhagic stroke was filmed using the app while walking on a linear path. An electrogoniometer was fixed on the medial face of the affected knee in order to record the dynamic goniometry during gait. Twenty-one raters, blinded to measurements, were recruited to rate knee angle measurements from video acquired with DrGoniometer. Each rater repeated the same procedure twice, the second one at least one day after the first measure. RESULTS Results showed that flexion angle measurements are reliable (ICC95%=0.66, 0.34;0.85; SEM=4°), and adequately precise (CV=14%). Extension angles measurements demonstrated moderate reliability and higher degree of variation (ICC=0.51, 0.09;0.77; SEM 4°; CV=53%). ROM values were: ICC=0.23 (-0.21;0.60); CV=20%. Accuracy of DrGoniometer compared to the electrogoniometer was 7.3±4.7°. The selection of maximum extension frame revealed an accordance of 58% and 72% within a range of ±5 or ±10 frames, respectively; while the best flexion frame reported 86% of agreement for both range of 5 and 10 frames. CONCLUSIONS The results demonstrated moderate to good reliability concerning the maximum extension and flexion angles, while assessing ROM DrGoniometer showed poor intra-rater reliability. Flexion angle measurements seemed to be reliable according to ICC and SEM values and more precise with a limited dispersion of results DrGoniometer revealed a good accuracy in the measurement of range of motion. The agreement of the maximal extension frame was anyway adequate within 5 frames (59%) and noticeably increased within 10 frames (72%). In conclusion, DrGoniometer was found to be a valid and reliable method for assessing knee angles during hemiparetic gait. Further studies are necessary to investigate inter-rater reliability and confirm our results.

Download Full-text

Piloting the Play Cycle Observation Method in ‘real time’: Recording children’s Play Cycles in pre-school provision

Journal of Early Childhood Research ◽

10.1177/1476718x20969851 ◽

2020 ◽

pp. 1476718X2096985

Author(s):

Pete King ◽

LaDonna Atkins ◽

Brandon Burr

Keyword(s):

Pilot Study ◽

Real Time ◽

School Setting ◽

Early Years ◽

Good Reliability ◽

Rater Reliability ◽

Children's Play ◽

Observational Tool ◽

Observation Method ◽

And Training

The Play Cycle Observation Method (PCOM) is an observational tool developed to focus on the process of play and has shown good reliability when watching videos of children playing. This study piloted use of the PCOM in ‘real time’ in a pre-school setting where 3-year-old children play. The results from two independent observers not familiar with the concept of the Play Cycle or the PCOM found good inter-rater reliability using Cohen Kappa (k) when observing play cues to form play cycles, as well as observing play cues within established play cycles. In addition, the recording of the nature of the play cues and play returns, the play frame and how the play cycle finishes (annihilation) were shown to be consistent between the two inter-rater observers. The results of this pilot study indicate the PCOM can be used as an observational tool to record the process of play by both students and practitioners working in a range of contexts including playwork, childcare, early years and statutory education. The PCOM can also be used as a teaching and training aid for trainers and lecturers.

Download Full-text

A New Scale of Readiness for Health Care Students to Encounter Partner Abuse

Journal of Interpersonal Violence ◽

10.1177/0886260520981131 ◽

2020 ◽

pp. 088626052098113

Author(s):

Simon Sawyer ◽

Glenn Melvin ◽

Angela Williams ◽

Brett Williams

Keyword(s):

Health Care ◽

Psychometric Properties ◽

Internal Consistency ◽

Partner Abuse ◽

Content Validation ◽

Post Intervention ◽

Good Reliability ◽

Health Care Students ◽

Australian Health ◽

Health Care Practitioners

Partner abuse (PA) is associated with significant morbidity and mortality worldwide. Health care practitioners regularly encounter patients experiencing PA and require comprehensive education on how to respond. This study describes the creation and validation of a new measure of readiness to encounter patients experiencing PA for health care practitioners and students. Initial item development and content validation were informed by expert feedback. Psychometric properties were assessed using data collected from Australian health care students, using Principal Components Analysis (PCA) and Confirmatory Factor Analysis (CFA). Internal consistency, inter-scale correlations, and test–retest analysis were performed. An initial pool of 67 items was reduced to 48 following content validation by 5 experts as a measure of construct validity. A total of n = 926 responses were collected, which were randomly split into two groups to perform a PCA and CFA. The PCA resulted in a 31-item version, which was further reduced to a 27-item version following the CFA, containing four factors. Internal consistency and test–retest analyses demonstrated good reliability. The produced scale is a 27-item measure of readiness to encounter patients experiencing PA, which has demonstrated good psychometric properties with a sample of Australian health care students. Results indicate that self-efficacy and Emotional-readiness are a large component of readiness. The scale may be used to measure the readiness of a cohort, or as a pre and post-intervention measure, and results may provide insight into the educational needs of a cohort.

Download Full-text