Mansoura Fiberoptic Endoscopic Evaluation of Swallowing Residue Rating Scale (MFRRS): An Anatomically Based Tool – A Preliminary Study

2020 ◽  
pp. 1-13
Author(s):  
Aliaa Sabry ◽  
James L. Coyle ◽  
Tamer Abou-Elsaad
Keyword(s):  
Internal Consistency ◽  
Rating Scale ◽  
Pyriform Sinus ◽  
Hard Copy ◽  
Kappa Statistics ◽  
Endoscopic Evaluation ◽  
Rater Reliability ◽  
Functional Problem ◽  
Excellent Internal Consistency ◽  
Residue Levels

<b><i>Objective:</i></b> The aim of this work was to design an anatomically based scale for judging post-swallow residue in the pharyngeal cavities, for use during the fiberoptic endoscopic evaluation of swallowing (FEES) in patients with dysphagia, and to assess its feasibility. <b><i>Methods:</i></b> Two 7-point ordinal scales (one for vallecular residue and one for pyriform sinus residue), were developed using detailed anatomic landmarks to denote residue levels. Hard copy color images of a specified frame, from 210 videos of 30 adult FEES evaluations demonstrating the range of all possible residue patterns, were selected (<i>n</i> = 56 valleculae, 62 pyriform sinuses). Half of these images were used to train 4 raters. The remaining half of the images were randomly ordered and rated by the trained raters. Two weeks later the same images were randomized again, and each rater re-analyzed them. The inter- and intra-rater reliability and criterion validity were determined using the kappa statistics and their standard errors. The internal consistency of the items in MFRRS was examined. <b><i>Results:</i></b> MFRRS showed strong inter-rater reliability (valleculae, κ = 0.832 ± 0.038; pyriform sinus, κ = 0.855 ± 0.034), almost perfect intra-rater reliability (valleculae, κ = 0.964 ± 0.018; pyriform sinus, κ = 0.962 ± 0.02), almost perfect concurrent validity (valleculae, κ = 0.968 ± 0.020; pyriform sinus, κ = 0.0971 ± 0.017), and excellent internal consistency (valleculae, Cronbach’s α = 0.990; pyriform sinus, Cronbach’s α = 0.985). <b><i>Conclusion:</i></b> MFRRS is a feasible and reliable, anatomically based tool that can provide more accurate pharyngeal residue judgments. The optimized description of residue accumulation patterns can contribute to a better overall description of the functional problem and future description of dysphagia phenotypes.

scholarly journals Mixed Consistencies in Dysphagic Patients: A Myth to Dispel

Dysphagia ◽  
2021 ◽  
Author(s):  
Mozzanica Francesco ◽  
Pizzorni Nicole ◽  
Scarponi Letizia ◽  
Bazzotti Claudia ◽  
Ginocchio Daniela ◽  
...  
Keyword(s):  
Rating Scale ◽  
Pyriform Sinus ◽  
Endoscopic Evaluation ◽  
Pharyngeal Residue ◽  
Food Residue ◽  
Severity Rating ◽  
Vegetable Soup ◽  
Laryngeal Vestibule ◽  
Dysphagic Patients ◽  
Penetration Aspiration Scale

AbstractOnly limited and inconsistent information about the effect of mixed consistencies on swallowing are available. The aim of this study was to evaluate the location of the head of the bolus at the swallow onset, the risk of penetration/aspiration, and the severity of post-swallow pharyngeal residue in patients with dysphagia when consuming mixed consistencies. 20 dysphagic patients underwent a Fiberoptic Endoscopic Evaluation of Swallowing (FEES) testing five different textures: liquid, semisolid, solid, biscuits-with-milk and vegetable-soup. The location of the head of the bolus at the onset of swallowing was rated using a five-points scale ranging from zero (the bolus is behind the tongue) to four (the bolus falls into the laryngeal vestibule), the severity of penetration/aspiration was rated using the Penetration Aspiration Scale (PAS), the amount of pharyngeal residue after the swallow was rated using the Yale Pharyngeal Residue Severity Rating Scale (YPRSRS) in the vallecula and pyriform sinus. When consuming biscuits-with-milk and liquid the swallow onset occurred more often when the boluses were located in the laryngeal vestibule. Penetration was more frequent with biscuits-with-milk, while aspiration was more frequent with Liquid, followed by biscuits-with-milk and vegetable-soup, Semisolid and Solid. In particular, no differences in penetration and aspiration between liquids and biscuits-with-milk were found as well as among vegetable-soup, semisolid and solid. No significant differences in the amount of food residue after swallowing were demonstrated. The risk of penetration-aspiration for biscuits-with-milk and liquid is similar, while the risk of penetration-aspiration is lower for vegetable-soup than for liquid.

Development and Validation of an Instrument to Assess Horseback Mobility in Hippotherapy

2021 ◽  
pp. 003151252110365
Author(s):  
Alessandra V. Prieto ◽  
Kênnea Martins Almeida Ayupe ◽  
Ana C. A. Abreu ◽  
Paulo J. B. Gutierres Filho
Keyword(s):  
Correlation Coefficient ◽  
Factor Structure ◽  
Internal Consistency ◽  
Rater Reliability ◽  
Intra Class Correlation ◽  
Exploratory Factor Analyses ◽  
Excellent Internal Consistency ◽  
Development And Validation ◽  
Functional Gain ◽  
Intra Class Correlation Coefficient

Improvement in rider mobility represents an important functional gain for people with disabilities undergoing hippotherapy. However, there is no validated measuring instrument to track and document the rider's progress in riding activities. In this study, we aimed to develop and establish validity evidence for an instrument to assess hippotherapy participants’ mobility on horseback. We report on this development through the stages of: (a) content validation, (b) construct validation, (c) inter- and intra-rater reliability and (d) internal consistency analysis. We evaluated its factor structure with exploratory factor analyses, calculated values for inter- and intra-rater reliability using the intra-class correlation coefficient, and calculated its internal consistency using Cronbach's alpha. We followed recommendations by the Guidelines for Reporting Reliability and Agreement Studies. We found good inter-rater reliability (intra-class correlation coefficient – ICC = 0.991–0.999) and good intra-rater reliability (ICC = 0.997–1.0), and there was excellent internal consistency (Cronbach's α = 0.937–0.999). The instrument’s factor structure grouped its three domains into one factor. As this instrument is theoretically consistent and has been found to be appropriate and reliable for its intended use, it is now available for the measurement of horseback mobility among hippotherapy riders.

The behavior flexibility rating scale-revised (BFRS-R): Factor analysis, internal consistency, inter-rater and intra-rater reliability, and convergent validity

2008 ◽  
Vol 29 (5) ◽  
pp. 398-407 ◽  
Author(s):  
Nienke Peters-Scheffer ◽  
Robert Didden ◽  
Vanessa A. Green ◽  
Jeff Sigafoos ◽  
Hubert Korzilius ◽  
...  
Keyword(s):  
Factor Analysis ◽  
Internal Consistency ◽  
Convergent Validity ◽  
Rating Scale ◽  
Rater Reliability ◽  
R Factor

scholarly journals The Development and Psychometric Evaluation of the Group Schema Therapy Rating Scale – Revised

2018 ◽  
Vol 46 (5) ◽  
pp. 601-618
Author(s):  
Emily Bastick ◽  
Suili Bot ◽  
Simone J. W. Verhagen ◽  
Gerhard Zarbock ◽  
Joan Farrell ◽  
...  
Keyword(s):  
Internal Consistency ◽  
Discriminant Validity ◽  
Rating Scale ◽  
Psychometric Evaluation ◽  
Schema Therapy ◽  
Group Cohesiveness ◽  
Rater Reliability ◽  
Group Format ◽  
Training And Supervision ◽  
Fidelity Measure

Background: Recent research has supported the efficacy of schema therapy as a treatment for personality disorders. A group format has been developed (group schema therapy; GST), which has been suggested to improve both the clinical and cost-effectiveness of the treatment. Aims: Efficacy studies of GST need to assess treatment fidelity. The aims of the present study were to improve, describe and evaluate a fidelity measure for GST, the Group Schema Therapy Rating Scale – Revised (GSTRS-R). Method: Following a pilot study on an initial version of the scale (GSTRS), items were revised and guidelines were modified in order to improve the reliability of the scale. Students highly experienced with the scale rated recorded GST therapy sessions using the GSTRS-R in addition to a group cohesion measure, the Harvard Community Health Plan Group Cohesiveness Scale – II (GCS-II). The scores were used to assess internal consistency and inter-rater reliability. Discriminant validity was assessed by comparing the scores on the GSTRS-R with the GCS-II. Results: The GSTRS-R displayed substantial internal consistency and inter-rater reliability, and adequate discriminate validity, evidenced by a weak positive correlation with the GCS-II. Conclusions: Overall, the GSTRS-R is a reliable tool that may be useful for evaluating therapist fidelity to GST model, and assisting GST training and supervision. Initial validity was supported by a weak association with GCS-II, indicating that although associated with cohesiveness, the instrument also assesses factors specific to GST. Limitations are discussed.

scholarly journals Sedation levels in dogs: a validation study

2016 ◽  
Author(s):  
Marika C Wagner ◽  
Kent G Hecker ◽  
Daniel Pang
Keyword(s):  
Internal Consistency ◽  
Validation Study ◽  
Prospective Trial ◽  
Full Scale ◽  
Sedation Scale ◽  
Good Reliability ◽  
Rater Reliability ◽  
Video Recordings ◽  
Excellent Internal Consistency ◽  
To Receive

The aim of this study was to assess validation evidence for a sedation scale for dogs. We hypothesized that the chosen sedation scale would be unreliable when used by different raters and show poor discrimination between sedation protocols. A sedation scale was used to score 62 dogs scheduled to receive sedation at two veterinary clinics in a prospective trial. Scores recorded by a single observer were used to assess internal consistency and construct validity of the scores. To assess inter-rater reliability, video-recordings of sedation assessment were randomized and blinded for viewing by 5 raters untrained in the scale. Videos were also edited to allow assessment of inter-rater reliability of an abbreviated scale by 5 different raters. Both sedation scales exhibited excellent internal consistency and very good inter-rater reliability (full scale, ICCsingle = 0.95; abbreviated scale, ICCsingle = 0.94). The full scale discriminated between the most common protocols: dexmedetomidine-hydromorphone (11 [1-18], n = 20) and acepromazine-hydromorphone (5 [0-15], n = 36, p = 0.02). The hypothesis was rejected. Full and abbreviated scales showed excellent internal consistency and very good reliability between multiple untrained raters. The full scale differentiated between levels of sedation.

51. Structured assessment format for evaluating operative reports (SAFE-OR) in general surgery

2007 ◽  
Vol 30 (4) ◽  
pp. 55
Author(s):  
A. Vergis ◽  
L. Gillman ◽  
M. Taylor ◽  
S. Minor ◽  
J. Park
Keyword(s):  
Construct Validity ◽  
Internal Consistency ◽  
General Surgery ◽  
Rating Scale ◽  
Assessment Instrument ◽  
Sigmoid Colectomy ◽  
Rater Reliability ◽  
Global Quality ◽  
Canadian Association ◽  
Assessment Format

This study determined the construct validity, inter-rater reliability and internal consistency of a “Structured Assessment Format for Evaluating Operative Reports” (SAFE-OR) in general surgery. The assessment instrument was developed using consensus criteria set forth by the Canadian Association of General Surgeons. It includes a structured assessment and a global quality rating scale. Residents divided into novice and experienced groups viewed and dictated a video-taped laparoscopic sigmoid colectomy. Transcriptions were then graded by blinded, independent faculty evaluators using SAFE-OR. Twenty-one residents participated in the study. Mean structured assessment scores (out of 44) were significantly lower for novice versus experienced residents (23.3 ± 5.2 vs 34.1 ± 6.0, t=0.001). Mean global quality scores (out of 45) were similarly lower for novice residents (25.6 ± 4.7 vs 35.9 ± 7.6, t=0.006). Inter-class correlation coefficients were 0.98 (95% CI 0.96-0.99) for structured assessment and 0.93 (95% CI 0.83-0.97) for global quality scales. Cronbach’s alpha coefficients for internal consistency were 0.85 for structured assessment and 0.96 for global quality assessment scales. SAFE-OR demonstrates significant construct validity, excellent inter-rater reliability and high internal consistency. This tool will allow educators to objectively evaluate the quality of trainee operative reports and ultimately provide a mechanism for implementing, monitoring, and refining curriculum for operative dictation communication skills. Moore R. The dictated operative note: important but is it being taught? Journal of the American College of Surgeons 2000; 190(5):639-40. Novitsky Y, Sing R, et al. Prospective, blinded evaluation of accuracy of operative reports dictated by surgical residents. The American Surgeon 2005; 71(8):627-31. Wanzel K, Ward R, et al. Teaching the surgical craft: From selection to certification. Current Problems in Surgery 2002; 39(6):573-659.

scholarly journals Development of the Therapist Empathy Scale

2013 ◽  
Vol 42 (3) ◽  
pp. 339-354 ◽  
Author(s):  
Suzanne E. Decker ◽  
Charla Nich ◽  
Kathleen M. Carroll ◽  
Steve Martino
Keyword(s):  
Internal Consistency ◽  
Convergent Validity ◽  
Discriminant Validity ◽  
Rating Scale ◽  
Single Factor ◽  
Client Outcome ◽  
Rater Reliability ◽  
Empathy Scale ◽  
Therapist Empathy ◽  
The Impact

Background: Few measures exist to examine therapist empathy as it occurs in session. Aims: A 9-item observer rating scale, called the Therapist Empathy Scale (TES), was developed based on Watson's (1999) work to assess affective, cognitive, attitudinal, and attunement aspects of therapist empathy. The aim of this study was to evaluate the inter-rater reliability, internal consistency, and construct and criterion validity of the TES. Method: Raters evaluated therapist empathy in 315 client sessions conducted by 91 therapists, using data from a multi-site therapist training trial (Martino et al., 2010) in Motivational Interviewing (MI). Results: Inter-rater reliability (ICC = .87 to .91) and internal consistency (Cronbach's alpha = .94) were high. Confirmatory factor analyses indicated some support for single-factor fit. Convergent validity was supported by correlations between TES scores and MI fundamental adherence (r range .50 to .67) and competence scores (r range .56 to .69). Discriminant validity was indicated by negative or nonsignificant correlations between TES and MI-inconsistent behavior (r range .05 to −.33). Conclusions: The TES demonstrates excellent inter-rater reliability and internal consistency. Results indicate some support for a single-factor solution and convergent and discriminant validity. Future studies should examine the use of the TES to evaluate therapist empathy in different psychotherapy approaches and to determine the impact of therapist empathy on client outcome.

scholarly journals Development and reliability of the AOSpine CROST (Clinician Reported Outcome Spine Trauma): a tool to evaluate and predict outcomes from clinician’s perspective

2020 ◽  
Vol 29 (10) ◽  
pp. 2550-2559
Author(s):  
Said Sadiqi ◽  
Sander P. J. Muijs ◽  
Jeroen J. M. Renkens ◽  
Marcel W. Post ◽  
Lorin M. Benneker ◽  
...  
Keyword(s):  
Internal Consistency ◽  
Developmental Process ◽  
Intraclass Correlation ◽  
Kappa Statistics ◽  
Spine Trauma ◽  
Rater Agreement ◽  
Reliability Study ◽  
Rater Reliability ◽  
Dichotomous Scoring ◽  
Outcome Tool

Abstract Purpose To report on the development of AOSpine CROST (Clinician Reported Outcome Spine Trauma) and results of an initial reliability study. Methods The AOSpine CROST was developed using an iterative approach of multiple cycles of development, review, and revision including an expert clinician panel. Subsequently, a reliability study was performed among an expert panel who were provided with 20 spine trauma cases, administered twice with 4-week interval. The results of the developmental process were analyzed using descriptive statistics, the reliability per parameter using Kappa statistics, inter-rater rater agreement using intraclass correlation coefficient (ICC), and internal consistency using Cronbach’s α. Results The AOSpine CROST was developed and consisted of 10 parameters, 2 of which are only applicable for surgically treated patents (‘Wound healing’ and ‘Implants’). A dichotomous scoring system (‘yes’ or ‘no’ response) was incorporated to express expected problems for the short term and long term. In the reliability study, 16 (84.2%) participated in the first round and 14 (73.7%) in the second. Intra-rater reliability was fair to good for both time points (κ = 0.40–0.80 and κ = 0.31–0.67). Results of inter-rater reliability were lower (κ = 0.18–0.60 and κ = 0.16–0.46). Inter-rater agreement for total scores showed moderate results (ICC = 0.52–0.60), and the internal consistency was acceptable (α = 0.76–0.82). Conclusions The AOSpine CROST, an outcome tool for the surgeons, was developed using an iterative process. An initial reliability analysis showed fair to moderate results and acceptable internal consistency. Further clinical validation studies will be performed to further validate the tool.

Assessing Competence in Collaborative Case Conceptualization: Development and Preliminary Psychometric Properties of the Collaborative Case Conceptualization Rating Scale (CCC-RS)

2015 ◽  
Vol 44 (2) ◽  
pp. 179-192 ◽  
Author(s):  
Willem Kuyken ◽  
Shadi Beshai ◽  
Robert Dudley ◽  
Anna Abel ◽  
Nora Görg ◽  
...  
Keyword(s):  
Psychometric Properties ◽  
Internal Consistency ◽  
Convergent Validity ◽  
Rating Scale ◽  
Correlation Coefficients ◽  
Behavioural Therapy ◽  
Case Conceptualization ◽  
Cognitive Behavioural ◽  
Excellent Internal Consistency ◽  
Resistant Depression

Background: Case conceptualization is assumed to be an important element in cognitive-behavioural therapy (CBT) because it describes and explains clients’ presentations in ways that inform intervention. However, we do not have a good measure of competence in CBT case conceptualization that can be used to guide training and elucidate mechanisms. Aims: The current study addresses this gap by describing the development and preliminary psychometric properties of the Collaborative Case Conceptualization – Rating Scale (CCC-RS; Padesky et al., 2011). The CCC-RS was developed in accordance with the model posited by Kuyken et al. (2009). Method: Data for this study (N = 40) were derived from a larger trial (Wiles et al., 2013) with adults suffering from resistant depression. Internal consistency and inter-rater reliability were calculated. Further, and as a partial test of the scale's validity, Pearson's correlation coefficients were obtained for scores on the CCC-RS and key scales from the Cognitive Therapy Scale – Revised (CTS-R; Blackburn et al., 2001). Results: The CCC-RS showed excellent internal consistency (α = .94), split-half (.82) and inter-rater reliabilities (ICC =.84). Total scores on the CCC-RS were significantly correlated with scores on the CTS-R (r = .54, p < .01). Moreover, the Collaboration subscale of the CCC-RS was significantly correlated (r = .44) with its counterpart of the CTS-R in a theoretically predictable manner. Conclusions: These preliminary results indicate that the CCC-RS is a reliable measure with adequate face, content and convergent validity. Further research is needed to replicate and extend the current findings to other facets of validity.

Sign in / Sign up

Export Citation Format

Share Document