The applicability and the inter-rater reliability of the Comprehensive Psychopathological Rating Scale in an elderly clinical population

2004 ◽  
Vol 20 (1) ◽  
pp. 35-40 ◽  
Author(s):  
Niels Chr. van der Laan ◽  
Aletta Schimmel ◽  
Thea J. Heeren
Keyword(s):  
Rating Scale ◽  
Clinical Population ◽  
Rater Reliability

scholarly journals Cross-cultural adaptation and psychometric properties of the Kessler Distress Scale (K10): an application of the rating scale model

2021 ◽  
Vol 34 (1) ◽  
Author(s):  
Evandro Morais Peixoto ◽  
Daniela Sacramento Zanini ◽  
Josemberg Moura de Andrade
Keyword(s):  
Psychological Distress ◽  
Psychometric Properties ◽  
Rating Scale ◽  
Self Report ◽  
Clinical Population ◽  
Scale Model ◽  
General Factor ◽  
Measurement Models ◽  
Distress Scale ◽  
Rating Scale Model

Abstract Background The Kessler Distress Scale (K10) is a self-report scale for the assessment of non-specific psychological distress in the general and clinical population. Because of its ease of application and good psychometric properties, the K10 has been adapted to several cultures. The present study seeks to adapt the K10 to Brazilian Portuguese and estimate its validity evidence and reliability. Methods A total of 1914 individuals from the general population participated in the study (age = 34.88, SD = 13.61, 77.7% female). The adjustment indices were compared among three different measurement models proposed for the K10 through confirmatory factor analysis (CFA). The items’ properties were analyzed by Andrich’s Rating Scale Model (RSM). Furthermore, evidence based on relations to other variables (depression, stress, anxiety, positive and negative affects, and satisfaction with life) was estimated. Results CFA indicated the adequacy of the bifactor model (CFI= 0.985; TLI= 0.973; SMR= 0.019; RMSEA= 0.050), composed of two specific factors (depression and anxiety) and one general factor (psychological distress), corresponding to the theoretical hypothesis. Additionally, it was observed multiple-group invariance by gender and age range. The RSM provided an understanding of the organization of the continuum represented by the psychological distress construct (items difficulty), which varied from −0.89 to 1.00; good adjustment indexes; infit between 0.67 and 1.32; outfit between 0.68 and 1.34; and desirable reliability, α= 0.87. Lastly, theoretically coherent associations with the external variables were observed. Conclusions It is concluded that the Brazilian version of the K10 is a suitable measure of psychological distress for the Brazilian population.

Inter-rater reliability of the International Cooperative Ataxia Rating Scale (ICARS)

2004 ◽  
Vol 19 (2) ◽  
pp. 190-192 ◽  
Author(s):  
Elsdon Storey ◽  
Kate Tuck ◽  
Robert Hester ◽  
Andrew Hughes ◽  
Andrew Churchyard
Keyword(s):  
Rating Scale ◽  
Rater Reliability

scholarly journals Item Response Theory Analyses of Barkley’s Adult Attention-Deficit/Hyperactivity Disorder Rating Scales

2020 ◽  
Vol 35 (7) ◽  
pp. 1094-1108
Author(s):  
Morgan E Nitta ◽  
Brooke E Magnus ◽  
Paul S Marshall ◽  
James B Hoelzle
Keyword(s):  
Item Response Theory ◽  
Item Response ◽  
Adult Adhd ◽  
Rating Scales ◽  
Rating Scale ◽  
Self Report ◽  
Clinical Population ◽  
Response Theory ◽  
Item Level ◽  
Latent Traits

Abstract There are many challenges associated with assessment and diagnosis of ADHD in adulthood. Utilizing the graded response model (GRM) from item response theory (IRT), a comprehensive item-level analysis of adult ADHD rating scales in a clinical population was conducted with Barkley's Adult ADHD Rating Scale-IV, Self-Report of Current Symptoms (CSS), a self-report diagnostic checklist and a similar self-report measure quantifying retrospective report of childhood symptoms, Barkley's Adult ADHD Rating Scale-IV, Self-Report of Childhood Symptoms (BAARS-C). Differences in item functioning were also considered after identifying and excluding individuals with suspect effort. Items associated with symptoms of inattention (IA) and hyperactivity/impulsivity (H/I) are endorsed differently across the lifespan, and these data suggest that they vary in their relationship to the theoretical constructs of IA and H/I. Screening for sufficient effort did not meaningfully change item level functioning. The application IRT to direct item-to-symptom measures allows for a unique psychometric assessment of how the current DSM-5 symptoms represent latent traits of IA and H/I. Meeting a symptom threshold of five or more symptoms may be misleading. Closer attention given to specific symptoms in the context of the clinical interview and reported difficulties across domains may lead to more informed diagnosis.

Development and assessment of the inter-rater and intra-rater reproducibility of a self-administration version of the ALSFRS-R

2019 ◽  
Vol 91 (1) ◽  
pp. 75-81 ◽  
Author(s):  
Leonhard A Bakker ◽  
Carin D Schröder ◽  
Harold H G Tan ◽  
Simone M A G Vugts ◽  
Ruben P A van Eijk ◽  
...  
Keyword(s):  
Rating Scale ◽  
Clinical Care ◽  
Intraclass Correlation ◽  
Correlation Coefficients ◽  
The Self ◽  
Coefficient Alpha ◽  
Rater Agreement ◽  
Self Administration ◽  
Limits Of Agreement ◽  
Rater Reliability

ObjectiveThe Amyotrophic Lateral Sclerosis Functional Rating Scale-Revised (ALSFRS-R) is widely applied to assess disease severity and progression in patients with motor neuron disease (MND). The objective of the study is to assess the inter-rater and intra-rater reproducibility, i.e., the inter-rater and intra-rater reliability and agreement, of a self-administration version of the ALSFRS-R for use in apps, online platforms, clinical care and trials.MethodsThe self-administration version of the ALSFRS-R was developed based on both patient and expert feedback. To assess the inter-rater reproducibility, 59 patients with MND filled out the ALSFRS-R online and were subsequently assessed on the ALSFRS-R by three raters. To assess the intra-rater reproducibility, patients were invited on two occasions to complete the ALSFRS-R online. Reliability was assessed with intraclass correlation coefficients, agreement was assessed with Bland-Altman plots and paired samples t-tests, and internal consistency was examined with Cronbach’s coefficient alpha.ResultsThe self-administration version of the ALSFRS-R demonstrated excellent inter-rater and intra-rater reliability. The assessment of inter-rater agreement demonstrated small systematic differences between patients and raters and acceptable limits of agreement. The assessment of intra-rater agreement demonstrated no systematic changes between time points; limits of agreement were 4.3 points for the total score and ranged from 1.6 to 2.4 points for the domain scores. Coefficient alpha values were acceptable.DiscussionThe self-administration version of the ALSFRS-R demonstrates high reproducibility and can be used in apps and online portals for both individual comparisons, facilitating the management of clinical care and group comparisons in clinical trials.

scholarly journals Visual assessment of movement quality in the single leg squat test: a review and meta-analysis of inter-rater and intrarater reliability

2019 ◽  
Vol 5 (1) ◽  
pp. e000541 ◽  
Author(s):  
John Ressman ◽  
Wilhelmus Johannes Andreas Grooten ◽  
Eva Rasmussen Barr
Keyword(s):  
Rating Scales ◽  
Rating Scale ◽  
Meta Analysis ◽  
Intraclass Correlation ◽  
Cochrane Library ◽  
Intrarater Reliability ◽  
Rater Reliability ◽  
Movement Quality ◽  
Step Down ◽  
Single Leg Squat

Single leg squat (SLS) is a common tool used in clinical examination to set and evaluate rehabilitation goals, but also to assess lower extremity function in active people.ObjectivesTo conduct a review and meta-analysis on the inter-rater and intrarater reliability of the SLS, including the lateral step-down (LSD) and forward step-down (FSD) tests.DesignReview with meta-analysis.Data sourcesCINAHL, Cochrane Library, Embase, Medline (OVID) and Web of Science was searched up until December 2018.Eligibility criteriaStudies were eligible for inclusion if they were methodological studies which assessed the inter-rater and/or intrarater reliability of the SLS, FSD and LSD through observation of movement quality.ResultsThirty-one studies were included. The reliability varied largely between studies (inter-rater: kappa/intraclass correlation coefficients (ICC) = 0.00–0.95; intrarater: kappa/ICC = 0.13–1.00), but most of the studies reached ‘moderate’ measures of agreement. The pooled results of ICC/kappa showed a ‘moderate’ agreement for inter-rater reliability, 0.58 (95% CI 0.50 to 0.65), and a ‘substantial’ agreement for intrarater reliability, 0.68 (95% CI 0.60 to 0.74). Subgroup analyses showed a higher pooled agreement for inter-rater reliability of ≤3-point rating scales while no difference was found for different numbers of segmental assessments.ConclusionOur findings indicate that the SLS test including the FSD and LSD tests can be suitable for clinical use regardless of number of observed segments and particularly with a ≤3-point rating scale. Since most of the included studies were affected with some form of methodological bias, our findings must be interpreted with caution.PROSPERO registration numberCRD42018077822.

Assessing catatonia using four different instruments: Inter-rater reliability and prevalence in inpatient clinical population

2016 ◽  
Vol 23 ◽  
pp. 27-31 ◽  
Author(s):  
Siddharth Sarkar ◽  
Sreekanth Sakey ◽  
Kaliaperumal Mathan ◽  
Balaji Bharadwaj ◽  
Shivanand Kattimani ◽  
...  
Keyword(s):  
Clinical Population ◽  
Rater Reliability

Another Look at air Traffic Controller Performance Evaluation

1996 ◽  
Vol 40 (12) ◽  
pp. 574-578
Author(s):  
Earl S. Stein ◽  
Randy L. Sollenberger
Keyword(s):  
Rating Scales ◽  
Rating Scale ◽  
Evaluation Criteria ◽  
Air Traffic ◽  
Group Discussions ◽  
Air Traffic Controller ◽  
Rater Reliability ◽  
Controller Performance ◽  
Performance Area ◽  
Mutual Evaluation

This paper describes a study that evaluated the reliability of a recently developed rating form designed to assess air traffic controller performance. Six supervisors from different radar approach control facilities nationwide viewed 20 video tapes of controllers working traffic from a previously recorded simulation study. The observer/raters used a new evaluation form that consisted of 24 different rating scales measuring specific areas of controller performance. An important part of this study was observer training. The training consisted of practice rating sessions followed by group discussions. In discussion, observers established mutual evaluation criteria for each performance area. Inter-rater reliability was assessed using intraclass correlations, and intra-rater reliability was assessed using Pearson product-moment correlations on repeated video tapes. In general, the reliability of the form was quite good, however, a few rating scales were much less reliable than the others. Reasons for the differences in rating scale reliability are discussed.

Distress during airway sampling in children with cystic fibrosis

2018 ◽  
Vol 104 (8) ◽  
pp. 806-808 ◽  
Author(s):  
Jun Ting Chau ◽  
Karen Peebles ◽  
Yvonne Belessis ◽  
Adam Jaffe ◽  
Michael Doumit
Keyword(s):  
Cystic Fibrosis ◽  
Heart Rate ◽  
Diagnostic Accuracy ◽  
Rating Scale ◽  
Parent Rating ◽  
Rater Reliability ◽  
Oropharyngeal Swab

BackgroundOropharyngeal suction and oropharyngeal swab are two methods of obtaining airway samples with similar diagnostic accuracy in children with cystic fibrosis (CF). The primary aim was comparing distress between suctioning and swabbing. A secondary aim was establishing the reliability of the Groningen Distress Rating Scale (GDRS).MethodsRandomised oropharyngeal suction or swab occurred over two visits. Two physiotherapists and the child’s parent rated distress using the GDRS. Heart rate (HR) was also measured.Results24 children with CF, mean age of 3 years, participated. Both physiotherapist and parent rating showed significantly higher distress levels during suction than swab. Inter-rater reliability for the GDRS was very good between physiotherapists, and good between physiotherapist and parents.ConclusionThe study found that oropharyngeal swab is less distressing in obtaining samples than oropharyngeal suction and that the GDRS was reliable and valid.

Sign in / Sign up

Export Citation Format

Share Document