scholarly journals The interrater reliability of a routine outcome measure for infants and pre-schoolers aged under 48 months: Health of the Nation Outcome Scales for Infants

BJPsych Open ◽  
2021 ◽  
Vol 7 (3) ◽  
Author(s):  
Peter Brann ◽  
Gordana Culjak ◽  
Nick Kowalenko ◽  
Rosemary Dickson ◽  
Tim Coombs ◽  
...  
Keyword(s):  
Mental Health ◽  
Concurrent Validity ◽  
Interrater Reliability ◽  
Outcome Measure ◽  
Weighted Kappa ◽  
Face Validity ◽  
Advisory Panel ◽  
Measurement Instruments ◽  
Health Measurement ◽  
Routine Outcome Measure

Background A review of Australian mental health services identified a gap in routine outcome measures addressing social, emotional and behavioural domains for pre-schoolers and infants. The Child and Adolescent Mental Health Information Development Expert Advisory Panel Working Group developed the Health of the Nation Outcome Scales for Infants (HoNOSI), a clinician-reported routine outcome measure for use with those aged under 4 years. Prior psychometric testing showed that the HoNOSI was considered to show face validity, and that it met the standards for concurrent validity and internal consistency. Aims We aimed to investigate the interrater reliability of the HoNOSI. Method Forty-five infant mental health clinicians completed HoNOSI ratings on a set of five case vignettes. Results Quadratic weighted kappa interrater reliability estimates showed the HoNOSI to have Almost Perfect interrater reliability for the HoNOSI total score. Of the 15 scales, one had Moderate, seven had Substantial and seven had Almost Perfect interrater reliability. Ten of the fifteen scales and the total score exceeded the COnsensus-based Standards for the Selection of Health Measurement INstruments criteria for interrater reliability (κw ≥ 0.7). Conclusions There has been a clear need for a routine outcome measure for use with infants and pre-schoolers. This study provides evidence of interrater reliability. The current findings, combined with the face and concurrent validity studies, support further examination of HoNOSI in real-world settings.

scholarly journals Health of the Nation Outcome Scales for Infants field trial: concurrent validity

BJPsych Open ◽  
2021 ◽  
Vol 7 (4) ◽  
Author(s):  
Peter Brann ◽  
Gordana Culjak ◽  
Nick Kowalenko ◽  
Rosemary Dickson ◽  
Tim Coombs ◽  
...  
Keyword(s):  
Mental Health ◽  
Internal Consistency ◽  
Concurrent Validity ◽  
Outcome Measure ◽  
Face Validity ◽  
Advisory Panel ◽  
Measurement Instruments ◽  
Health Measurement ◽  
Global Assessment Scale ◽  
Routine Outcome Measure

Background A review of Australian mental health services identified a gap in routine outcome measures addressing social, emotional and behavioural domains for pre-schoolers and infants. A Child and Adolescent Mental Health Information Development Expert Advisory Panel working group developed the Health of the Nation Outcome Scales for Infants (HoNOSI), a clinician-reported routine outcome measure for infants 0–47 months. Prior face validity testing showed that the HoNOSI was considered useful in measuring mental health outcomes. Aims To examine the concurrent validity of the HoNOSI. Method Mental health clinicians providing assessment and treatment to infants in routine clinical practice participated in the study. The mental health status of 108 infants were rated by a minimum of 26 clinicians with the HoNOSI, the Parent-Infant Relationship Global Assessment Scale (PIR-GAS) and measures of symptom severity and distress. Results The HoNOSI was statistically significantly correlated with the PIR–;GAS, rs = −0.73; Clinical Worry, rs = 0.77; and Severity Judgement ratings, rs = 0.85; P < 0.001. A good level of internal consistency was found. Using the COsensus-based Standards for the selection of health Measurement INstruments (COSMIN) criteria for judging instrument acceptability, the HoNOSI meets the standard for both concurrent validity and internal consistency. Conclusions There has been a clear need for a routine outcome measure for use with infants. This study provides positive evidence of aspects of validity. These findings, along with those from the prior face validity study, support a controlled release of the HoNOSI accompanied by further research and development.

scholarly journals The Session Wants and Need Outcome Measure: The Development of a Brief Outcome Measure for Single-Sessions of Web-Based Support

2021 ◽  
Vol 12 ◽  
Author(s):  
Santiago de Ossorno Garcia ◽  
Louisa Salhi ◽  
Aaron Sefi ◽  
Terry Hanley
Keyword(s):  
Mental Health ◽  
Young People ◽  
Design Process ◽  
Outcome Measure ◽  
Brief Interventions ◽  
Face Validity ◽  
Single Session ◽  
Framework Analysis ◽  
Web Based ◽  
Mental Health Settings

Single-session, brief interventions in therapy for young people make up a large proportion of service provision, including in digital mental health settings. Current nomothetic mental health measures are not specifically designed to capture the benefit or ‘change’ directly related to these brief interventions. As a consequence, we set out to design an outcome measure to concretely demonstrate the value of single-session interventions. The Session Wants and Needs Outcome Measure (SWAN-OM) aims to capture in-session goals and focuses on being user-centric, elements critical to the success of single-session and brief interventions which typically are asset-based and solution-focused. We describe the 4-stage process that was followed to develop this measure: (I) classical item generation and development, (II) content and (III) face validity pilot testing, and (IV) a user-experience approach with young people using framework analysis. This final stage was critical to ensure the integration of this outcome tool into a web-based digital therapy setting, a context which adds another layer of design complexity to item and measure development. This iterative methodology was used to overcome the challenges encountered and to place the needs of the young people and service practitioners at the centre of the design process, thus ensuring measure usability. To end, we highlight the main lessons learnt from engaging in this design process. Specifically, the needs of a measure for single-session interventions are considered, before outlining the learning associated with integrating the measure into a digital mental health platform. Both of these areas are emerging fields and, as such, this study contributes to our understanding of how an idiographic patient outcome theory driven measure can be created for use in a web-based digital mental health therapy service.

The Health of the Nation Outcome Scales for Child & Adolescent Mental Health (HoNOSCA)

2000 ◽  
Vol 5 (2) ◽  
pp. 50-56 ◽  
Author(s):  
Simon Gowers ◽  
Sarah J. Bailey-Rogers ◽  
Alison Shore ◽  
Warren Levine
Keyword(s):  
Mental Health ◽  
Mental Health Services ◽  
Health Services ◽  
Outcome Measure ◽  
Adolescent Mental Health ◽  
Child And Adolescent ◽  
Field Trials ◽  
Extensive Field ◽  
Routine Outcome Measure

The child and adolescent version of the Health of the Nation Outcome Scales (HoNOSCA) represents the first attempt at a routine outcome measure for Child and Adolescent Mental Health Services in the U.K. Extensive field trials suggested that the scales were both acceptable to clinicians from the various disciplines working in this area and also valid and reliable. A growing number of services are now using the scales in audit and research, supported by the national HoNOSCA base that provides training and co-ordinates further developments.

scholarly journals The Mental Health Recovery Star: great for care planning but not as a routine outcome measure

2012 ◽  
Vol 36 (5) ◽  
pp. 194-194 ◽  
Author(s):  
Helen T. Killaspy ◽  
Jed Boardman ◽  
Michael King ◽  
Tatiana Taylor ◽  
Geoff Shepherd ◽  
...  
Keyword(s):  
Mental Health ◽  
Outcome Measure ◽  
Mental Health Recovery ◽  
Care Planning ◽  
Routine Outcome Measure

HoNOS-Rome: an expanded, customized, and longitudinally oriented version of the HoNOS

2003 ◽  
Vol 12 (1) ◽  
pp. 53-62 ◽  
Author(s):  
Pierluigi Morosini ◽  
Antonella Gigantesco ◽  
Angelica Mazzarda ◽  
Loredana Gibaldi
Keyword(s):  
Mental Health ◽  
Factor Analysis ◽  
Mental Health Services ◽  
Health Services ◽  
Construct Validity ◽  
Weighted Kappa ◽  
Outcome Evaluation ◽  
Face Validity ◽  
Validity And Reliability ◽  
National Mental Health

SUMMARYAims– To clarify the acceptability, reliability and factorial validity of a new Italian version of the HoNOS called HoNOS-Rome. Its main innovations are both in design and in contents.Methods– Face validity was assessed by surveying 3 focus groups. Reliability was assessed in 8 different pairs of raters on a sample of 24 patients; construct validity was analysed by factor analysis using a sample of 187 patients at 6 day centres. Acceptability was investigated by means an anonymous questionnaire filled by professionals that were using the instrument.Results– Time of completion was low (range 4–12 minutes), the tool proved very acceptable and the reliability was good (weighted kappa ≥ 0.71 for all items). Factor analysis was consistent with the division of HoNOS–Rome into four sensible factors accounting for 52% of the total variance.Conclusions– The findings indicate that HoNOS–Rome has a satisfactory degree of acceptability, construct validity and reliability, and may promote the routine evaluation of outcomes in mental health services.Declaration of Interest: the authors declare that the study was supported by grant no. 96/Q/T41 of the Italian National Mental Health Project – Istituto Superiore di Sanità – Sub-project: Development and validation of tools for outcome evaluation of mental health services, Italy (Professor P. Morosini).

scholarly journals The development of an outcome measure for liaison mental health services

2018 ◽  
Vol 42 (3) ◽  
pp. 109-114
Author(s):  
Else Guthrie ◽  
Mathew Harrison ◽  
Richard Brown ◽  
Rajdeep Sandhu ◽  
Peter Trigwell ◽  
...  
Keyword(s):  
Mental Health ◽  
Interrater Reliability ◽  
Substance Misuse ◽  
Outcome Measure ◽  
Sensitivity To Change ◽  
Mental Health Setting ◽  
Point Scale ◽  
Behavioural Disturbance ◽  
Liaison Psychiatry ◽  
The Mind

Aims and methodTo develop and pilot a clinician-rated outcome scale to evaluate symptomatic outcomes in liaison psychiatry services. Three hundred and sixty patient contacts with 207 separate individuals were rated using six subscales (mood, psychosis, cognition, substance misuse, mind–body problems and behavioural disturbance) plus two additional items (side-effects of medication and capacity to consent for medical treatment). Each item was rated on a five-point scale from 0 to 5 (nil, mild, moderate, severe and very severe).ResultsThe liaison outcome measure was acceptable and easy to use. All subscales showed acceptable interrater reliability, with the exception of the mind–body subscale. Overall, the measure appears to show stability and sensitivity to change.Clinical implicationsThe measure provides a useful and robust way to determine symptomatic change in a liaison mental health setting, although the mind–body subscale requires modification.Declaration of interestNone.

scholarly journals An Internet Resource for Self-Assessment of Mental Health and Health Behavior: Development and Implementation of the Self-Assessment Kiosk

2018 ◽  
Vol 5 (2) ◽  
pp. e39 ◽  
Author(s):  
Robert G Maunder ◽  
Jonathan J Hunter
Keyword(s):  
Mental Health ◽  
Health Behavior ◽  
The Self ◽  
Internet Survey ◽  
Internet Resource ◽  
Measurement Instruments ◽  
Health Measurement ◽  
Self Assessment ◽  
Wide Range ◽  
Over Time

Background Standardized measurement of physical and mental health is useful for identification of health problems. Personalized feedback of the results can influence health behavior, and treatment outcomes can be improved by monitoring feedback over time. However, few resources are available that are free for users, provide feedback from validated measurement instruments, and measure a wide range of health domains. Objective This study aimed to develop an internet self-assessment resource that fills the identified gap and collects data to generate and test hypotheses about health, to test its feasibility, and to describe the characteristics of its users. Methods The Self-Assessment Kiosk was built using validated health measurement instruments and implemented on a commercial internet survey platform. Data regarding usage and the characteristics of users were collected over 54 weeks. The rate of accrual of new users, popularity of measurement domains, frequency with which multiple domains were selected for measurement, and characteristics of users who chose particular questionnaires were assessed. Results Of the 1435 visits, 441 (30.73%) were visiting for the first time, completed at least 1 measure, indicated that their responses were truthful, and consented to research. Growth in the number of users over time was approximately linear. Users were skewed toward old age and higher income and education. Most (53.9%, 234/434) reported at least 1 medical condition. The median number of questionnaires completed was 5. Internal reliability of most measures was good (Cronbach alpha>.70), with lower reliability for some subscales of coping (self-distraction alpha=.35, venting alpha=.50, acceptance alpha=.51) and personality (agreeableness alpha=.46, openness alpha=.45). The popular questionnaires measured depression (61.0%, 269/441), anxiety (60.5%, 267/441), attachment insecurity (54.2%, 239/441), and coping (46.0%, 203/441). Demographic characteristics somewhat influenced choice of instruments, accounting for <9% of the variance in this choice. Mean depression and anxiety scores were intermediate between previously studied populations with and without mental illness. Modeling to estimate the sample size required to study relationships between variables suggested that the accrual of users required to study the relationship between 3 variables was 2 to 3 times greater than that required to study a single variable. Conclusions The value of the Self-Assessment Kiosk to users and the feasibility of providing this resource are supported by the steady accumulation of new users over time. The Self-Assessment Kiosk database can be interrogated to understand the relationships between health variables. Users who select particular instruments tend to have scores that are higher than those found in the general population, indicating that instruments are more likely to be selected when they are salient. Self-selection bias limits generalizability and needs to be taken into account when using the Self-Assessment Kiosk database for research. Ethical issues that were considered in developing and implementing the Self-Assessment Kiosk are discussed.

A Validation and Replication Study of the Patient-Generated Measure PSYCHLOPS on an Icelandic Clinical Population

2013 ◽  
Vol 29 (2) ◽  
pp. 89-95 ◽  
Author(s):  
Helgi Héðinsson ◽  
Hafrún Kristjánsdóttir ◽  
Daníel Þór Ólason ◽  
Jón Friðrik Sigurðsson
Keyword(s):  
Mental Health ◽  
Psychometric Properties ◽  
Concurrent Validity ◽  
Outcome Measure ◽  
Clinical Population ◽  
Cognitive Behavior ◽  
Mental Health Setting ◽  
Psychological Outcome ◽  
Valuable Complement ◽  
High Completion Rate

PSYCHLOPS (Psychological Outcome Profiles; Ashworth et al., 2004 ) is a patient-generated outcome measure developed to be a sensitive indicator of change after therapy. It requires the patient to choose which symptoms or problems are most important to measure over the course of therapy. The present study replicates previous findings for the original version and validates the Icelandic version. The psychometric properties of PSYCHLOPS were investigated by comparing it to an established nomothetic outcome measure, CORE-OM. Icelandic versions of both questionnaires were administered to patients attending cognitive behavior group therapy in a mental-health setting in Iceland. PSYCHLOPS was found to be considerably more sensitive to change over therapy than CORE-OM; convergent and concurrent validity was supported, and internal reliabilities were satisfactory. The acceptability of the instrument was demonstrated by the high completion rate. Overall, these findings suggest that the Icelandic version of PSYCHLOPS has good psychometric properties, and the findings compared very favorably to previous findings. It is concluded that PSYCHLOPS should be considered a desirable instrument for evaluating mental-health outcome and a valuable complement to conventional nomothetic outcome measures.

Evaluating the Health of the Nation Outcome Scales

1999 ◽  
Vol 174 (5) ◽  
pp. 399-403 ◽  
Author(s):  
S. Amin ◽  
S. P. Singh ◽  
T. Croudace ◽  
P. Jones ◽  
I. Medley ◽  
...  
Keyword(s):  
Mental Health ◽  
Concurrent Validity ◽  
Interrater Reliability ◽  
Further Training ◽  
Follow Up Study ◽  
Social Subscale ◽  
First Onset ◽  
Routine Measure

BackgroundThe HoNOS has been developed as a routine measure of outcomes in mental health.AimsTo explore the validity and interrater reliability of HoNOS in a first-onset psychosis follow-up study.MethodBetween 1992 and 1994 we ascertained a cohort of all persons with first-onset psychosis. We re-assessed these people at 3 years (n=166) with several outcome scales, including HoNOS. Patients' keyworkers also completed the HoNOS. We estimated concurrent validity by calculating correlations between HoNOS and other scales, and interrater reliability.ResultsResearcher HoNOS correlated highly with other scales (0.46 < p < 0.86; P < 0.001). Keyworker HoNOS correlations were lower (0.41 < p < 0.51; P < 0.05), but still significant for all scores except the HoNOS-social subscale (0.12 < p < 0.28). Agreements between researcher and keyworker HoNOS were modest (0.47 < ICC < 0.85).ConclusionsIn this research cohort HoNOS correlates well with established outcome scales. Keyworker ratings show similar, but weaker, relationships; its use in routine settings may require further training for calibration of severity.

Sign in / Sign up

Export Citation Format

Share Document