scholarly journals Health of the Nation Outcome Scales for Infants field trial: concurrent validity

BJPsych Open ◽  
2021 ◽  
Vol 7 (4) ◽  
Author(s):  
Peter Brann ◽  
Gordana Culjak ◽  
Nick Kowalenko ◽  
Rosemary Dickson ◽  
Tim Coombs ◽  
...  
Keyword(s):  
Mental Health ◽  
Internal Consistency ◽  
Concurrent Validity ◽  
Outcome Measure ◽  
Face Validity ◽  
Advisory Panel ◽  
Measurement Instruments ◽  
Health Measurement ◽  
Global Assessment Scale ◽  
Routine Outcome Measure

Background A review of Australian mental health services identified a gap in routine outcome measures addressing social, emotional and behavioural domains for pre-schoolers and infants. A Child and Adolescent Mental Health Information Development Expert Advisory Panel working group developed the Health of the Nation Outcome Scales for Infants (HoNOSI), a clinician-reported routine outcome measure for infants 0–47 months. Prior face validity testing showed that the HoNOSI was considered useful in measuring mental health outcomes. Aims To examine the concurrent validity of the HoNOSI. Method Mental health clinicians providing assessment and treatment to infants in routine clinical practice participated in the study. The mental health status of 108 infants were rated by a minimum of 26 clinicians with the HoNOSI, the Parent-Infant Relationship Global Assessment Scale (PIR-GAS) and measures of symptom severity and distress. Results The HoNOSI was statistically significantly correlated with the PIR–;GAS, rs = −0.73; Clinical Worry, rs = 0.77; and Severity Judgement ratings, rs = 0.85; P < 0.001. A good level of internal consistency was found. Using the COsensus-based Standards for the selection of health Measurement INstruments (COSMIN) criteria for judging instrument acceptability, the HoNOSI meets the standard for both concurrent validity and internal consistency. Conclusions There has been a clear need for a routine outcome measure for use with infants. This study provides positive evidence of aspects of validity. These findings, along with those from the prior face validity study, support a controlled release of the HoNOSI accompanied by further research and development.

scholarly journals The interrater reliability of a routine outcome measure for infants and pre-schoolers aged under 48 months: Health of the Nation Outcome Scales for Infants

BJPsych Open ◽  
2021 ◽  
Vol 7 (3) ◽  
Author(s):  
Peter Brann ◽  
Gordana Culjak ◽  
Nick Kowalenko ◽  
Rosemary Dickson ◽  
Tim Coombs ◽  
...  
Keyword(s):  
Mental Health ◽  
Concurrent Validity ◽  
Interrater Reliability ◽  
Outcome Measure ◽  
Weighted Kappa ◽  
Face Validity ◽  
Advisory Panel ◽  
Measurement Instruments ◽  
Health Measurement ◽  
Routine Outcome Measure

Background A review of Australian mental health services identified a gap in routine outcome measures addressing social, emotional and behavioural domains for pre-schoolers and infants. The Child and Adolescent Mental Health Information Development Expert Advisory Panel Working Group developed the Health of the Nation Outcome Scales for Infants (HoNOSI), a clinician-reported routine outcome measure for use with those aged under 4 years. Prior psychometric testing showed that the HoNOSI was considered to show face validity, and that it met the standards for concurrent validity and internal consistency. Aims We aimed to investigate the interrater reliability of the HoNOSI. Method Forty-five infant mental health clinicians completed HoNOSI ratings on a set of five case vignettes. Results Quadratic weighted kappa interrater reliability estimates showed the HoNOSI to have Almost Perfect interrater reliability for the HoNOSI total score. Of the 15 scales, one had Moderate, seven had Substantial and seven had Almost Perfect interrater reliability. Ten of the fifteen scales and the total score exceeded the COnsensus-based Standards for the Selection of Health Measurement INstruments criteria for interrater reliability (κw ≥ 0.7). Conclusions There has been a clear need for a routine outcome measure for use with infants and pre-schoolers. This study provides evidence of interrater reliability. The current findings, combined with the face and concurrent validity studies, support further examination of HoNOSI in real-world settings.

scholarly journals The Session Wants and Need Outcome Measure: The Development of a Brief Outcome Measure for Single-Sessions of Web-Based Support

2021 ◽  
Vol 12 ◽  
Author(s):  
Santiago de Ossorno Garcia ◽  
Louisa Salhi ◽  
Aaron Sefi ◽  
Terry Hanley
Keyword(s):  
Mental Health ◽  
Young People ◽  
Design Process ◽  
Outcome Measure ◽  
Brief Interventions ◽  
Face Validity ◽  
Single Session ◽  
Framework Analysis ◽  
Web Based ◽  
Mental Health Settings

Single-session, brief interventions in therapy for young people make up a large proportion of service provision, including in digital mental health settings. Current nomothetic mental health measures are not specifically designed to capture the benefit or ‘change’ directly related to these brief interventions. As a consequence, we set out to design an outcome measure to concretely demonstrate the value of single-session interventions. The Session Wants and Needs Outcome Measure (SWAN-OM) aims to capture in-session goals and focuses on being user-centric, elements critical to the success of single-session and brief interventions which typically are asset-based and solution-focused. We describe the 4-stage process that was followed to develop this measure: (I) classical item generation and development, (II) content and (III) face validity pilot testing, and (IV) a user-experience approach with young people using framework analysis. This final stage was critical to ensure the integration of this outcome tool into a web-based digital therapy setting, a context which adds another layer of design complexity to item and measure development. This iterative methodology was used to overcome the challenges encountered and to place the needs of the young people and service practitioners at the centre of the design process, thus ensuring measure usability. To end, we highlight the main lessons learnt from engaging in this design process. Specifically, the needs of a measure for single-session interventions are considered, before outlining the learning associated with integrating the measure into a digital mental health platform. Both of these areas are emerging fields and, as such, this study contributes to our understanding of how an idiographic patient outcome theory driven measure can be created for use in a web-based digital mental health therapy service.

The Health of the Nation Outcome Scales for Child & Adolescent Mental Health (HoNOSCA)

2000 ◽  
Vol 5 (2) ◽  
pp. 50-56 ◽  
Author(s):  
Simon Gowers ◽  
Sarah J. Bailey-Rogers ◽  
Alison Shore ◽  
Warren Levine
Keyword(s):  
Mental Health ◽  
Mental Health Services ◽  
Health Services ◽  
Outcome Measure ◽  
Adolescent Mental Health ◽  
Child And Adolescent ◽  
Field Trials ◽  
Extensive Field ◽  
Routine Outcome Measure

The child and adolescent version of the Health of the Nation Outcome Scales (HoNOSCA) represents the first attempt at a routine outcome measure for Child and Adolescent Mental Health Services in the U.K. Extensive field trials suggested that the scales were both acceptable to clinicians from the various disciplines working in this area and also valid and reliable. A growing number of services are now using the scales in audit and research, supported by the national HoNOSCA base that provides training and co-ordinates further developments.

scholarly journals The Mental Health Recovery Star: great for care planning but not as a routine outcome measure

2012 ◽  
Vol 36 (5) ◽  
pp. 194-194 ◽  
Author(s):  
Helen T. Killaspy ◽  
Jed Boardman ◽  
Michael King ◽  
Tatiana Taylor ◽  
Geoff Shepherd ◽  
...  
Keyword(s):  
Mental Health ◽  
Outcome Measure ◽  
Mental Health Recovery ◽  
Care Planning ◽  
Routine Outcome Measure

scholarly journals Assessing risk of self-harm in acute paediatric settings: a multicentre exploratory evaluation of the CYP-MH SAPhE instrument

BMJ Open ◽  
2021 ◽  
Vol 11 (5) ◽  
pp. e043762
Author(s):  
Joseph C Manning ◽  
Tim Carter ◽  
Gemma Walker ◽  
Jane Coad ◽  
Aimee Aubeeluck
Keyword(s):  
Mental Health ◽  
Psychometric Properties ◽  
Internal Consistency ◽  
Rating Scale ◽  
Assessment Instrument ◽  
Face Validity ◽  
Secondary Outcome ◽  
Delphi Consensus ◽  
Healthcare Environments ◽  
Self Harm

ObjectiveTo psychometrically assess the Children and Young People-Mental Health Self-harm Assessment in Paediatric healthcare Environments (CYP-MH SAPhE) instrument for the identification of immediate risk of self-harm in CYP, aged 10–19 years, in acute paediatric wards or emergency departments.DesignThe CYP-MH SAPhE Instrument was developed through a robust scoping review and Delphi consensus with 30 clinicians/topic experts. To evaluate the psychometric properties, a multicentre exploratory study was conducted.SettingThree acute hospitals in the UK.Participants163 CYP presenting at acute hospital settings with primary mental health (cases) or physical health (non-cases) conditions.Primary and secondary outcome measuresPsychometric properties of the CYP-MH SAPhE instrument were evaluated through Principle Axis Factoring (PAF) with Oblimin (Kaiser normalisation) alongside measures of internal consistency (Cronbach’s α), convergent, discriminant and face validity.ResultsPAF of the dichotomous items (n=9) loaded onto three factors (1) behaviours and intentions; (2) suicidality and (3) self-harm. Factors 1 (Cronbach’s α=0.960) and 3 (Cronbach’s α=1) had high internal consistency. There was: good level of agreement between raters (kappa=0.65); a moderately positive correlation between the CYP-MH SAPhE instrument and the Columbia-Suicide Severity Rating Scale; and discrimination between cases and non-cases across the three factors (factor 1: m=88 vs 70; factor 2: m=102 vs 70; factor 3: m=104 vs 68). Assessment of face validity resulted in six items being removed, culminating in an eight question, rapid assessment instrument.ConclusionsThe results support the CYP-MH SAPhE Tool as a potentially reliable and valid instrument to identify immediate risk of self-harm in CYP presenting to acute paediatric healthcare environments, which is a burgeoning and significant global health issue.

scholarly journals An Internet Resource for Self-Assessment of Mental Health and Health Behavior: Development and Implementation of the Self-Assessment Kiosk

2018 ◽  
Vol 5 (2) ◽  
pp. e39 ◽  
Author(s):  
Robert G Maunder ◽  
Jonathan J Hunter
Keyword(s):  
Mental Health ◽  
Health Behavior ◽  
The Self ◽  
Internet Survey ◽  
Internet Resource ◽  
Measurement Instruments ◽  
Health Measurement ◽  
Self Assessment ◽  
Wide Range ◽  
Over Time

Background Standardized measurement of physical and mental health is useful for identification of health problems. Personalized feedback of the results can influence health behavior, and treatment outcomes can be improved by monitoring feedback over time. However, few resources are available that are free for users, provide feedback from validated measurement instruments, and measure a wide range of health domains. Objective This study aimed to develop an internet self-assessment resource that fills the identified gap and collects data to generate and test hypotheses about health, to test its feasibility, and to describe the characteristics of its users. Methods The Self-Assessment Kiosk was built using validated health measurement instruments and implemented on a commercial internet survey platform. Data regarding usage and the characteristics of users were collected over 54 weeks. The rate of accrual of new users, popularity of measurement domains, frequency with which multiple domains were selected for measurement, and characteristics of users who chose particular questionnaires were assessed. Results Of the 1435 visits, 441 (30.73%) were visiting for the first time, completed at least 1 measure, indicated that their responses were truthful, and consented to research. Growth in the number of users over time was approximately linear. Users were skewed toward old age and higher income and education. Most (53.9%, 234/434) reported at least 1 medical condition. The median number of questionnaires completed was 5. Internal reliability of most measures was good (Cronbach alpha>.70), with lower reliability for some subscales of coping (self-distraction alpha=.35, venting alpha=.50, acceptance alpha=.51) and personality (agreeableness alpha=.46, openness alpha=.45). The popular questionnaires measured depression (61.0%, 269/441), anxiety (60.5%, 267/441), attachment insecurity (54.2%, 239/441), and coping (46.0%, 203/441). Demographic characteristics somewhat influenced choice of instruments, accounting for <9% of the variance in this choice. Mean depression and anxiety scores were intermediate between previously studied populations with and without mental illness. Modeling to estimate the sample size required to study relationships between variables suggested that the accrual of users required to study the relationship between 3 variables was 2 to 3 times greater than that required to study a single variable. Conclusions The value of the Self-Assessment Kiosk to users and the feasibility of providing this resource are supported by the steady accumulation of new users over time. The Self-Assessment Kiosk database can be interrogated to understand the relationships between health variables. Users who select particular instruments tend to have scores that are higher than those found in the general population, indicating that instruments are more likely to be selected when they are salient. Self-selection bias limits generalizability and needs to be taken into account when using the Self-Assessment Kiosk database for research. Ethical issues that were considered in developing and implementing the Self-Assessment Kiosk are discussed.

scholarly journals P564 Validation of the IBD-Disk instrument in a Portuguese cohort

2021 ◽  
Vol 15 (Supplement_1) ◽  
pp. S526-S526
Author(s):  
S Silva Mendes ◽  
P Ferreira ◽  
P Antunes ◽  
M Gonçalves ◽  
T Leal ◽  
...  
Keyword(s):  
Construct Validity ◽  
Internal Consistency ◽  
Intraclass Correlation ◽  
Female Gender ◽  
Measurement Instruments ◽  
Health Measurement ◽  
Related Quality ◽  
Health Related ◽  
Inflammatory Bowel

Abstract Background Inflammatory bowel disease (IBD) affects several dimensions of health-related quality of life. The IBD-Disk scale was designed to provide immediate illustration of disability reported by patients with IBD, previously validated in two cohort studies. The aim of this study is to validate the IBD-Disk in a Portuguese cohort in a clinical setting according to the COnsensus-based Standards for the selection of the health Measurement INstruments (COSMIN) recommendations. Methods After translation to Portuguese, a group of IBD patients was invited to fill-in the IBD-Disk at baseline (T0), after 2 weeks (T1), and after 3 months (T2), from July 2020 to February 2021. At T0 and T2 the patients also completed the IBD-Disability Index. We evaluated reliability (internal consistency, test-retest, and inter-rater reliability and measurement error), construct validity, responsiveness, and interpretability. Results At baseline, 154 patients (107 - Crohn′s disease; 46 - ulcerative colitis) completed the IBD-Disk. After 2 weeks and 3 months, 64 and 114 patients repeated the questionnaire, respectively. Factor analysis confirmed the unidimensionality of the scale and reduced the final version to 10 items. Internal consistency was excellent with a Cronbach’s α of 0.916. The intraclass correlation coefficient was 0.95 for test-retest (baseline and 2 weeks). To evaluate construct validity, the IBD-Disk was compared with the IBD-Disability Index with a significative positive correlation (r=0.850; p&lt;0.001). IBD-Disk scores ranged from 0 to 93 with a mean of 38.18±25.39. Female gender (β =0,3; p&lt;0,001) and professional inactivity (β=0.28, p=0.014) were associated with higher IBD-Disk scores. Neither floor nor ceiling effects were observed. Conclusion The Portuguese version of IBD-Disk is a reliable, valid, and responsive tool to assess disability in Portuguese IBD patients. This study confirms the utility of this instrument in the evaluation of IBD patients in diverse populations.

A Validation and Replication Study of the Patient-Generated Measure PSYCHLOPS on an Icelandic Clinical Population

2013 ◽  
Vol 29 (2) ◽  
pp. 89-95 ◽  
Author(s):  
Helgi Héðinsson ◽  
Hafrún Kristjánsdóttir ◽  
Daníel Þór Ólason ◽  
Jón Friðrik Sigurðsson
Keyword(s):  
Mental Health ◽  
Psychometric Properties ◽  
Concurrent Validity ◽  
Outcome Measure ◽  
Clinical Population ◽  
Cognitive Behavior ◽  
Mental Health Setting ◽  
Psychological Outcome ◽  
Valuable Complement ◽  
High Completion Rate

PSYCHLOPS (Psychological Outcome Profiles; Ashworth et al., 2004 ) is a patient-generated outcome measure developed to be a sensitive indicator of change after therapy. It requires the patient to choose which symptoms or problems are most important to measure over the course of therapy. The present study replicates previous findings for the original version and validates the Icelandic version. The psychometric properties of PSYCHLOPS were investigated by comparing it to an established nomothetic outcome measure, CORE-OM. Icelandic versions of both questionnaires were administered to patients attending cognitive behavior group therapy in a mental-health setting in Iceland. PSYCHLOPS was found to be considerably more sensitive to change over therapy than CORE-OM; convergent and concurrent validity was supported, and internal reliabilities were satisfactory. The acceptability of the instrument was demonstrated by the high completion rate. Overall, these findings suggest that the Icelandic version of PSYCHLOPS has good psychometric properties, and the findings compared very favorably to previous findings. It is concluded that PSYCHLOPS should be considered a desirable instrument for evaluating mental-health outcome and a valuable complement to conventional nomothetic outcome measures.

Sign in / Sign up

Export Citation Format

Share Document