Reliability and Validity of the Face, Legs, Activity, Cry, Consolability Behavioral Tool in Assessing Acute Pain in Critically Ill Patients

2010 ◽  
Vol 19 (1) ◽  
pp. 55-61 ◽  
Author(s):  
Terri Voepel-Lewis ◽  
Jennifer Zanotti ◽  
Jennifer A. Dammeyer ◽  
Sandra Merkel

Background Few investigators have evaluated pain assessment tools in the critical care setting.Objective To evaluate the reliability and validity of the Face, Legs, Activity, Cry, Consolability (FLACC) Behavioral Scale in assessing pain in critically ill adults and children unable to self-report pain.Methods Three nurses simultaneously, but independently, observed and scored pain behaviors twice in 29 critically ill adults and 8 children: before administration of an analgesic or during a painful procedure, and 15 to 30 minutes after the administration or procedure. Two nurses used the FLACC scale, the third used either the Checklist of Nonverbal Pain Indicators (for adults) or the COMFORT scale (for children).Results For 73 observations, FLACC scores correlated highly with the other 2 scores (ρ = 0.963 and 0.849, respectively), supporting criterion validity. Significant decreases in FLACC scores after analgesia (or at rest) supported construct validity of the tool (mean, 5.27; SD, 2.3 vs mean, 0.52; SD, 1.1; P < .001). Exact agreement and κ statistics, as well as intraclass correlation coefficients (0.67–0.95), support excellent interrater reliability of the tool. Internal consistency was excellent; the Cronbach α was 0.882 when all items were included.Conclusions Although similar in content to other behavioral pain scales, the FLACC can be used across populations of patients and settings, and the scores are comparable to those of the commonly used 0-to-10 number rating scale.

2013 ◽  
Vol 33 (3) ◽  
pp. 68-78 ◽  
Author(s):  
Mindy Stites

Pain is a common and distressing symptom in critically ill patients. Uncontrolled pain places patients at risk for numerous adverse psychological and physiological consequences, some of which may be life-threatening. A systematic assessment of pain is difficult in intensive care units because of the high percentage of patients who are noncommunicative and unable to self-report pain. Several tools have been developed to identify objective measures of pain, but the best tool has yet to be identified. A comprehensive search on the reliability and validity of observational pain scales indicated that although the Critical-Care Pain Observation Tool was superior to other tools in reliably detecting pain, pain assessment in individuals incapable of spontaneous neuromuscular movements or in patients with concurrent conditions, such as chronic pain or delirium, remains an enigma.


2018 ◽  
Vol 56 (4) ◽  
pp. 594-601 ◽  
Author(s):  
Cristini Klein ◽  
Wolnei Caumo ◽  
Céline Gélinas ◽  
Valéria Patines ◽  
Tatiana Pilger ◽  
...  

2018 ◽  
Vol 38 (1) ◽  
pp. 38-49 ◽  
Author(s):  
Céline Gélinas ◽  
Mélanie Bérubé ◽  
Annie Chevrier ◽  
Brenda T. Pun ◽  
E. Wesley Ely ◽  
...  

BACKGROUNDDelirium is highly prevalent in critically ill patients. Its detection with valid tools is crucial.OBJECTIVETo analyze the development and psychometric properties of delirium assessment tools for critically ill adults.METHODSDatabases were searched to identify relevant studies. Inclusion criteria were English language, publication before January 2015, 30 or more patients, and patient population of critically ill adults (>18 years old). Search terms were delirium, scales, critically ill patients, adult, validity, and reliability. Thirty-six manuscripts were identified, encompassing 5 delirium assessment tools (Confusion Assessment Method for the Intensive Care Unit (CAM-ICU), Cognitive Test for Delirium, Delirium Detection Score, Intensive Care Delirium Screening Checklist (ICDSC), and Nursing Delirium Screening Scale). Two independent reviewers analyzed the psychometric properties of these tools by using a standardized scoring system (range, 0–20) to assess the tool development process, reliability, validity, feasibility, and implementation of each tool.RESULTSPsychometric properties were very good for the CAM-ICU (19.6) and the ICDSC (19.2), moderate for the Nursing Delirium Screening Scale (13.6), low for the Delirium Detection Score (11.2), and very low for the Cognitive Test for Delirium (8.2).CONCLUSIONSThe results indicate that the CAM-ICU and the ICDSC are the most valid and reliable delirium assessment tools for critically ill adults. Additional studies are needed to further validate these tools in critically ill patients with neurological disorders and those at various levels of sedation or consciousness.


2013 ◽  
Vol 25 (9) ◽  
pp. 1503-1511 ◽  
Author(s):  
Florindo Stella ◽  
Orestes Vicente Forlenza ◽  
Jerson Laks ◽  
Larissa Pires de Andrade ◽  
Michelle A. Ljubetic Avendaño ◽  
...  

ABSTRACTBackground:Patients with dementia may be unable to describe their symptoms, and caregivers frequently suffer emotional burden that can interfere with judgment of the patient's behavior. The Neuropsychiatric Inventory-Clinician rating scale (NPI-C) was therefore developed as a comprehensive and versatile instrument to assess and accurately measure neuropsychiatric symptoms (NPS) in dementia, thereby using information from caregiver and patient interviews, and any other relevant available data. The present study is a follow-up to the original, cross-national NPI-C validation, evaluating the reliability and concurrent validity of the NPI-C in quantifying psychopathological symptoms in dementia in a large Brazilian cohort.Methods:Two blinded raters evaluated 312 participants (156 patient-knowledgeable informant dyads) using the NPI-C for a total of 624 observations in five Brazilian centers. Inter-rater reliability was determined through intraclass correlation coefficients for the NPI-C domains and the traditional NPI. Convergent validity included correlations of specific domains of the NPI-C with the Brief Psychiatric Rating Scale (BPRS), the Cohen-Mansfield Agitation Index (CMAI), the Cornell Scale for Depression in Dementia (CSDD), and the Apathy Inventory (AI).Results:Inter-rater reliability was strong for all NPI-C domains. There were high correlations between NPI-C/delusions and BPRS, NPI-C/apathy-indifference with the AI, NPI-C/depression-dysphoria with the CSDD, NPI-C/agitation with the CMAI, and NPI-C/aggression with the CMAI. There was moderate correlation between the NPI-C/aberrant vocalizations and CMAI and the NPI-C/hallucinations with the BPRS.Conclusion:The NPI-C is a comprehensive tool that provides accurate measurement of NPS in dementia with high concurrent validity and inter-rater reliability in the Brazilian setting. In addition to universal assessment, the NPI-C can be completed by individual domains.


2019 ◽  
Vol 48 (5-6) ◽  
pp. 241-249
Author(s):  
Maria C. Duggan ◽  
Madeline E. Morrell ◽  
Rameela Chandrasekhar ◽  
Annachiara Marra ◽  
Kwame Frimpong ◽  
...  

Background/Aim: The diagnostic accuracy of brief informant screening instruments to detect dementia in critically ill adults is unknown. We sought to determine the diagnostic accuracy of the 2- to 3-min Ascertain Dementia 8 (AD8) completed by surrogates in detecting dementia among critically ill adults suspected of having pre-existing dementia by comparing it to the Clinical Dementia Rating Scale (CDR). Methods: This substudy of BRAIN-ICU included a subgroup of 75 critically ill medical/surgical patients determined to be at medium risk of having pre-existing dementia (Informant Questionnaire on Cognitive Decline in the Elderly [IQCODE] score ≥3.3). We calculated the sensitivity, specificity, positive and negative predictive values (PPV and NPV), and AUC for the standard AD8 cutoff of ≥2 versus the reference standard CDR score of ≥1 for mild dementia. Results: By the CDR, 38 patients had very mild or no dementia and 37 had mild dementia or greater. For diagnosing mild dementia, the AD8 had a sensitivity of 97% (95% CI 86–100), a specificity of 16% (6–31), a PPV of 53% (40–65), an NPV of 86% (42–100), and an AUC of 0.738 (0.626–0.850). Conclusions: Among critically ill patients judged at risk for pre-existing dementia, the 2- to 3-min AD8 is highly sensitive and has a high NPV. These data indicate that the brief tool can serve to rule out dementia in a specific patient population.


Author(s):  
Junta Takahashi ◽  
Hisashi Kawai ◽  
Hiroyuki Suzuki ◽  
Yoshinori Fujiwara ◽  
Yutaka Watanabe ◽  
...  

Recent research has suggested that the breadth and evenness of activity and activity diversity contribute to health outcomes among older adults. However, few established assessment tools for activity diversity have been developed. This study developed an Activity Diversity Questionnaire (ADQ) for older adults through expert consultation and a preliminary survey among 18 community-dwelling older adults. The diversity score was calculated according to Shannon’s entropy. In study 1, the intraclass correlation coefficients (ICC) of the diversity scores were determined for community-dwelling older adults (n = 30). In study 2, concurrent validity was tested with participants receiving comprehensive health checkups at the Itabashi ward in Japan in 2018 (n = 766). The correlation coefficients of the diversity scores were then calculated in reference to the Tokyo Metropolitan Institute of Gerontology Index of Competence and Japan Science and Technology Agency Index of Competence. The final version of the ADQ consisted of 20 total items with excellent test-retest reliability (ICC = 0.84) and moderate correlations with both the Tokyo Metropolitan Institute of Gerontology Index of Competence and Japan Science and Technology Agency Index of Competence (r = 0.48 and 0.60, respectively). The ADQ was developed through scientific procedures and revealed sufficient reliability and validity. As such, it is a scientifically validated tool for assessing activity diversity among older adults.


2018 ◽  
Vol 3 (2) ◽  
Author(s):  
Liam Rooney

<p><span style="text-decoration: underline;"><strong>Background</strong></span></p><p>Dementia is a disease affecting 55,000 Irish people. (1)  It is characterised by progressive cognitive impairment, ranging from mild impairment, which may affect memory, to severe impairment where the ability to communicate may be absent.  These people are at risk of having their pain underassessed and undermanaged. (2)  A survey exploring Irish Paramedics and Advanced Paramedics views on the current pain assessment tools available to them, and whether these tools are suitable for use with dementia patients is proposed.  Existing observational pain assessment tools used with dementia patients are examined and their suitability for pre-hospital use discussed.</p><p><span style="text-decoration: underline;"><strong>Introduction</strong></span></p><p>Adults with cognitive impairments, such as dementia, are at a much higher risk of not receiving adequate analgesia for their pain. (3)  It is estimated between 40% and 80% of dementia patients regularly experience pain. (4)  Current pain assessment tools used pre-hospital in Ireland are: Numerical Rating Scale for patients &gt;8yrs, Wong Baker Scale for pediatric patients and the FLACC Scale for infants.  There is no specific pain assessment tool for use with patients who are not capable of self-reporting their level of pain.</p><p><span style="text-decoration: underline;"><strong>Objective</strong></span></p><p>This research aimed to identify observational pain assessment tools used in this cohort.  The most consistently recommended tools were identified.  The suitability of these tools for use in the pre-hospital setting assessed.</p><p><span style="text-decoration: underline;"><strong>Findings</strong></span></p><p>Literature review identified 29 observational pain assessment tools. There is a lack of literature relating to the pre-hospital setting.  The American Geriatric Society (AGS) identified six pain behaviors in dementia patients, changes in facial expression, activity patterns, interpersonal relationships and mental status, negative vocalisation, change in body language.  These six criteria should be the foundation of any pain assessment tool. (5) The three most consistently recommended tools identified were as follows:</p><p><em>Abbey Pain Scale</em></p><p>6 items assessed, meets AGS criteria, quick and easy to implement, moderate to good reliability and validity (6)</p><p><em>Doloplus 2</em></p><p>15 items assessed, meets 5 of 6 AGS criteria, requires observation over time, prior knowledge of patient required, moderate to good reliability and validity (6)</p><p><em>PAINAD</em></p><p>5 items assessed, meets 3 of 6 AGS criteria, less then 5 minutes to implement, may be influenced by psychological distress, good reliability and validity (6)</p><p> </p><p><span style="text-decoration: underline;"><strong>Conclusion</strong></span></p><p>The ability to self report pain is deemed “gold standard”.  Patients with mild to moderate disease, and indeed, some with severe disease, may retain the ability to self report.  An observational tool is required when dementia has progressed to the point where the patient becomes unable to self report or becomes non-verbal.  It is in these patients where undetected, misinterpreted or inaccurate assessment of pain becomes frequent. (7)  The aim of any tool is to gain a good assessment of pain, however, the pain scale used should be suitable to the clinical setting.  The feasibility of an assessment tool is an important factor along with reliability and validity.  No one assessment tool could be recommended over another.  Abbey and PAINAD have potential for use pre-hospital, however, further research, clinical evaluation and trial in an ambulance service is required.</p>


2018 ◽  
Vol 02 (06) ◽  
pp. E191-E199 ◽  
Author(s):  
Shaw Bronner ◽  
Igor Urbano

AbstractThe Dance Functional Outcome Survey (DFOS) was developed as a self-report questionnaire for healthy and injured ballet and modern dancers, focusing on the low back and lower extremities. Our aim was to determine factor analysis and internal consistency of the 16 items and to investigate test-retest and equivalence reliability and validity of the DFOS compared to three orthopedic outcomes instruments. Data were collected from 80 healthy and injured adult ballet and modern pre-professional and professional dancers. DFOS Likert-type and visual analog scales were completed twice within 4–9 days to study test-retest reliability. The Cincinnati Knee Rating System, Olerud and Molander Foot-Ankle Questionnaire, and Oswestry Disability Index were used to assess concurrent validity using intraclass correlation coefficients in SPSS, p<0.05. To determine instrument dimensions and internal consistency of the items, we conducted exploratory factor analysis and calculated Cronbach’s α in JASP. DFOS demonstrated single factor loading and high Cronbach’s α; high test-retest repeatability and equivalence reliability (r=0.74–0.99) and acceptable criterion validity compared to the orthopedic outcomes instruments (r≥0.67). These results support further study of a revised 14 item Likert-version DFOS for repeatability, validity and responsiveness.


2018 ◽  
Vol 76 (5) ◽  
pp. 316-323 ◽  
Author(s):  
Monia Presotto ◽  
Maira Rozenfeld Olchik ◽  
Johanna G. Kalf ◽  
Carlos R.M. Rieder

ABSTRACT Objective: To translate and linguistically and culturally adapt to Brazilian Portuguese, and verify the reliability and validity of the Radboud Oral Motor Inventory for Parkinson's Disease (ROMP). Methods: The ROMP was translated and retranslated, and the instrument reliability was verified by analyzing the internal consistency and the reproducibility of the intra-examiner retest. The final version was applied to 27 participants with Parkinson's disease. Results: Internal consistency was 0.99 for the total ROMP and 0.96 to 0.99 for the three domains. Intraclass correlation coefficients for reproducibility were 0.99 for the total ROMP and 0.93 to 0.99 for the subscales. The ROMP and its subscales correlated substantially with the Likert-type scale, as well as with the unified Parkinson's disease rating scale II and III items. Conclusion: The linguistic and cultural equivalence of the ROMP in Brazilian Portuguese is now available, with excellent reliability and validity.


Sign in / Sign up

Export Citation Format

Share Document