Measurement properties of the Health of the Nation Outcome Scales (HoNOS) family of measures: protocol for a systematic review

An investigation into the factor structure of the Health of the Nation Outcome Scales for People with Learning Disabilities

BACKGROUND

The Health of the Nation Outcome Scales for People with Learning Disabilities (HoNOS-LD) is one of the most used outcome measures in learning disability services in the United Kingdom. There is relatively little known of the psychometric properties of the scales.

METHOD

A data set of HoNOS-LD scales from 571 people with learning disabilities was randomly split into two halves. Exploratory Mokken analysis was applied to the first dataset, and confirmatory scale factor analysis was applied to the second dataset to test the fit of scale structures.

RESULTS

Two-factor and three-factor solutions were explored in the Mokken analysis, with the three-factor option having somewhat better characteristics. One-factor, three-factor and seven-factor solutions were explored using confirmatory factor analysis; a three-factor solution with items 8, 16, 17 and 18 used separately offers the best characteristics.

CONCLUSIONS

The HoNOS-LD is best conceptualised as consisting of three scales, accounting for 14 items that can be labelled as 'Cognitive and Physical Functioning', 'Behaviour and Mood Disturbances' and 'Functional Difficulties'.

Effect of managed transition on mental health outcomes for young people at the child-adult mental health service boundary: a randomised clinical trial

BACKGROUND

Poor transition planning contributes to discontinuity of care at the child-adult mental health service boundary (SB), adversely affecting mental health outcomes in young people (YP). The aim of the study was to determine whether managed transition (MT) improves mental health outcomes of YP reaching the child/adolescent mental health service (CAMHS) boundary compared with usual care (UC).

METHODS

A two-arm cluster-randomised trial (ISRCTN83240263 and NCT03013595) with clusters allocated 1:2 between MT and UC. Recruitment took place in 40 CAMHS (eight European countries) between October 2015 and December 2016. Eligible participants were CAMHS service users who were receiving treatment or had a diagnosed mental disorder, had an IQ ⩾ 70 and were within 1 year of reaching the SB. MT was a multi-component intervention that included CAMHS training, systematic identification of YP approaching SB, a structured assessment (Transition Readiness and Appropriateness Measure) and sharing of information between CAMHS and adult mental health services. The primary outcome was HoNOSCA (Health of the Nation Outcome Scale for Children and Adolescents) score 15-months post-entry to the trial.

RESULTS

The mean difference in HoNOSCA scores between the MT and UC arms at 15 months was -1.11 points (95% confidence interval -2.07 to -0.14, p = 0.03). The cost of delivering the intervention was relatively modest (€17-€65 per service user).

CONCLUSIONS

MT led to improved mental health of YP after the SB but the magnitude of the effect was small. The intervention can be implemented at low cost and form part of planned and purposeful transitional care.

Frailty and Treatment-Resistant Schizophrenia: A Retrospective Cohort Study

Frailty, a state of reduced physiological reserve, has not been studied in consumers with treatment-resistant schizophrenia, despite known elevated rates of comorbidity and psychosocial impairment. This study applies a frailty index to the electronic medical records of 78 adults with treatment-resistant schizophrenia, aged 18-64 years, to determine the prevalence and characteristics of frailty (defined as a frailty index score > 0.21). The mean frailty index score was 0.24 (SD = 0.091, range = 0.061-0.54), with 52.6% of the population categorised as frail (40.0% in those aged 18-39 years). Frailty was positively correlated with age and psychiatric illness severity. This study provides novel evidence that individuals with treatment-resistant schizophrenia have a high rate of frailty and become frail at a younger age. Routine frailty assessments could be used to trigger the delivery of appropriate interventions, which have the potential to improve life expectancy and quality of life.

Análisis psicométrico con el modelo de Rasch de la escala Health of the Nation Outcome Scales (HoNOS) en población uruguaya

El objetivo principal del trabajo fue analizar las propiedades psicométricas de The Health of the Nation Outcome Scale (HoNOS)  utilizando la Teoría Clásica de los Tests y el Modelo de las Escalas de Calificación, un modelo tipo Rasch para ítems politómicos. La HoNOS es una de las escalas más utilizadas para evaluar resultados de forma rutinaria en los servicios de salud mental. La versión original para adultos ha sido traducida al castellano (Uriarte et al., 1999) pero hasta el momento no se han realizado estudios empíricos sobre las propiedades psicométricas de esta versión. Participaron  del estudio 402 usuarios de  cuatro servicios de salud mental ambulatorios y del hospital psiquiátrico de Uruguay. Se analizó el sistema de categorías de respuesta, el ajuste de las personas e ítems al modelo de Rasch, la fiabilidad, validez discriminante y la sensibilidad al cambio.  Los resultados indicaron que el sistema original de cinco categorías de la HoNOS no funcionó correctamente de acuerdo con las recomendaciones de Linacre (2002). Se buscó una solución mediante la agregación de categorías adyacentes reduciendo las categorías iniciales a cuatro que mostró un mejor funcionamiento. Se observó un aceptable ajuste del instrumento a los requisitos del modelo. La escala mostró adecuada validez para discriminar a los pacientes con diferentes niveles de severidad y sensibilidad al cambio. Se concluye que la HoNOS cumple con algunas características deseables como medida de evaluación de resultados de los servicios de salud mental. Presenta algunos problemas métricos que pueden verse mejorados reduciendo a cuatro las categorías de respuesta.

Non-pharmacological interventions to reduce restrictive practices in adult mental health inpatient settings: the COMPARE systematic mapping review

Objectives

The study aimed to provide a mapping review of non-pharmacological interventions to reduce restrictive practices in adult mental health inpatient settings; classify intervention components using the behaviour change technique taxonomy; explore evidence of behaviour change techniques and interventions; and identify the behaviour change techniques that show most effectiveness and those that require further testing.

Background

Incidents involving violence and aggression occur frequently in adult mental health inpatient settings. They often result in restrictive practices such as restraint and seclusion. These practices carry significant risks, including physical and psychological harm to service users and staff, and costs to the NHS. A number of interventions aim to reduce the use of restrictive practices by using behaviour change techniques to modify practice. Some interventions have been evaluated, but effectiveness research is hampered by limited attention to the specific components. The behaviour change technique taxonomy provides a common language with which to specify intervention content.

Design

Systematic mapping study and analysis.

Data sources

English-language health and social care research databases, and grey literature, including social media. The databases searched included British Nursing Index (BNI), Cumulative Index to Nursing and Allied Health Literature (CINAHL), Cochrane Central Register of Controlled Trials (CCRCT), Cochrane Database of Systematic Reviews (CDSR), Database of Abstracts of Reviews of Effects (DARE), EMBASE, Health Technology Assessment (HTA) Database, HTA Canadian and International, Ovid MEDLINE®, NHS Economic Evaluation Database (NHS EED), PsycInfo®and PubMed. Databases were searched from 1999 to 2019.

Review methods

Broad literature search; identification, description and classification of interventions using the behaviour change technique taxonomy; and quality appraisal of reports. Records of interventions to reduce any form of restrictive practice used with adults in mental health services were retrieved and subject to scrutiny of content, to identify interventions; quality appraisal, using the Mixed Methods Appraisal Tool; and data extraction, regarding whether participants were staff or service users, number of participants, study setting, intervention type, procedures and fidelity. The resulting data set for extraction was guided by the Workgroup for Intervention Development and Evaluation Research, Cochrane and theory coding scheme recommendations. The behaviour change technique taxonomy was applied systematically to each identified intervention. Intervention data were examined for overarching patterns, range and frequency. Overall percentages of behaviour change techniques by behaviour change technique cluster were reported. Procedures used within interventions, for example staff training, were described using the behaviour change technique taxonomy.

Results

The final data set comprised 221 records reporting 150 interventions, 109 of which had been evaluated. The most common evaluation approach was a non-randomised design. There were six randomised controlled trials. Behaviour change techniques from 14 out of a possible 16 clusters were detected. Behaviour change techniques found in the interventions were most likely to be those that demonstrated statistically significant effects. The most common intervention target was seclusion and restraint reduction. The most common strategy was staff training. Over two-thirds of the behaviour change techniques mapped onto four clusters, that is ‘goals and planning’, ‘antecedents’, ‘shaping knowledge’ and ‘feedback and monitoring’. The number of behaviour change techniques identified per intervention ranged from 1 to 33 (mean 8 techniques).

Limitations

Many interventions were poorly described and might have contained additional behaviour change techniques that were not detected. The finding that the evidence was weak restricted the study’s scope for examining behaviour change technique effectiveness. The literature search was restricted to English-language records.

Conclusions

Studies on interventions to reduce restrictive practices appear to be diverse and poor. Interventions tend to contain multiple procedures delivered in multiple ways.

Future work

Prior to future commissioning decisions, further research to enhance the evidence base could help address the urgent need for effective strategies. Testing individual procedures, for example, audit and feedback, could ascertain which are the most effective intervention components. Separate testing of individual components could improve understanding of content and delivery.

Study registration

The study is registered as PROSPERO CRD42018086985.

Funding

This project was funded by the National Institute for Health Research (NIHR) Health Services and Delivery Research programme and will be published in full inHealth Services and Delivery Research; Vol. 9, No. 5. See the NIHR Journals Library website for further project information.

Assessing the severity of psychiatric disorders using the Health of the Nation Outcome Scales: An equipercentile linking analysis

OBJECTIVE

The Health of the Nation Outcome Scales was developed as an overall measure of mental health, applicable to the complete range of psychiatric disorders. Meanwhile, it is a benchmark tool for service providers and is also used for the allocation of costs and funding. The ability of the Health of the Nation Outcome Scales to assess and differentiate the severity of psychiatric disorders is largely unknown, as it is the interpretation of a change in score. We aim to establish Health of the Nation Outcome Scales cut-off and benchmark values for severity and improvement - respectively change, using equipercentile linking to the Clinical Global Impression scales.

METHODS

In a clinical sample of 30,616 individuals with a psychiatric disorder, we used a multivariate regression analysis to determine the correlation between the scales and possible confounders. We used an equipercentile linking analysis of the Clinical Global Impressions severity scale with the Health of the Nation Outcome Scales sum score to establish cut-off values for severity. The linking of the Health of the Nation Outcome Scales sum score difference and the percentage of change to the Clinical Global Impression improvement scale determined benchmark values for change (i.e. improvement or deterioration).

RESULTS

The Health of the Nation Outcome Scales and Clinical Global Impression scales showed a Spearman correlation of 0.38 (p < 0.000). Clinical Global Impression-Severity: 'borderline-ill' corresponded to Health of the Nation Outcome Scales score 3-5; 'mildly ill' to 6-10; 'moderately ill' to 11-16; 'markedly ill' to 17-25; 'severely ill' to 26-35; and 'extremely ill' to a score ⩾36. The Spearman correlation between the percentage change of the Health of the Nation Outcome Scales was 0.39 (p > 0.000); Clinical Global Impression-Improvement: 'minimally improved' corresponded to Health of the Nation Outcome Scales reduction of 4 points or 9%; 'much-improved' to 12 points or 48%; 'very-much-improved' to ⩾20 points or ⩾90%. Clinical Global Impression-Improvement: 'minimally worse' corresponded to an increase of 6 points or 25%; 'much-worse' to 12 points or 54%; and finally, 'very-much-worse' to >18 points or ⩾82%.

CONCLUSION

Our results allow for the comparison of severity and response to treatment of patients with a psychiatric disorder, independent of diagnosis.

Clinimetric approach to rating scales for the assessment of apathy in Parkinson's disease: A systematic review

A number of rating scales for the assessment of apathy in Parkinson's disease (PD) were developed. Unfortunately, previous studies focused mainly on psychometric criteria rather than on clinimetric principles to develop these assessment instruments. In the clinimetric approach, the clinical validity of a rating scale, rather than its statistical significance, has the priority. The aim of the present systematic review was to capture the clinimetric properties of these rating scales and to identify the measures, which display clinical validity for the assessment of apathy in PD. The systematic search was conducted on Scopus, PsycINFO, PubMed, Web of Science, ScienceDirect, and Medline following the PRISMA guidelines. A total of 44 studies were included and analyzed in this systematic review. The apathy rating scales, which were found to be psychometrically robust and reliable, were actually clinically questionable. The apathy measures, which displayed clinimetric properties, were the Starkstein Apathy Scale (SAS), the 5-item version of the World Health Organization Well-Being Index (WHO-5), the Neurasthenia Scale and the Lille Apathy Rating Scale (LARS). The SAS was found to be clinically valid at a macro-analytic level, particularly when used either to exclude the presence of symptoms of apathy or to evaluate the side effects of medications. The WHO-5 and the Neurasthenia Scale were found to be clinically valid only at a micro-analytic level and can be used as screening measures for the assessment of the severity of symptoms of apathy. The LARS was a clinically valid instrument to be used for the diagnosis of apathy.