Developing a tool for collecting and costing activity data on psychiatric inpatient wards

A cluster randomised controlled trial of a ward-based intervention to improve access to psychologically-informed care and psychological therapy for mental health in-patients

BACKGROUND

There is good evidence that psychological interventions improve patient well-being and independent living, but patients on acute mental health wards often do not have access to evidence-based psychological therapies which are strongly advised by NICE guidance for severe mental health problems. The overall aim of this programme of work is to increase patient access to psychological therapies on acute mental health inpatient wards. Stage one of the programme (which is complete) aimed to identify barriers and facilitators to delivering therapy in these settings through a large qualitative study. The key output of stage one was an intervention protocol that is designed to be delivered on acute wards to increase patient access to psychologically-informed care and therapy. Stage two of the programme aims to test the effects of the intervention on patient wellbeing and serious incidents on the ward (primary outcomes), patient social functioning and symptoms, staff burnout, ward atmosphere from staff and patient perspectives and cost effectiveness of the intervention (secondary outcomes).

METHODS

The study is a single blind, pragmatic, cluster randomised controlled trial and will recruit thirty-four wards across England that will be randomised to receive the new intervention plus treatment as usual, or treatment as usual only. Primary and secondary outcomes will be assessed at baseline and 6-month and 9-month follow-ups, with serious incidents on the ward collected at an additional 3-month follow-up.

DISCUSSION

The key output will be a potentially effective and cost-effective ward-based psychological intervention that increases patient access to psychological therapy in inpatient settings, is feasible to deliver in inpatient settings and is acceptable to patients.

TRIAL REGISTRATION NUMBER

ClinicalTrials.gov Identifier: NCT03950388. Registered 15th May 2019. https://clinicaltrials.gov/ct2/show/NCT03950388.

Patient involvement in improving the evidence base on mental health inpatient care: the PERCEIVE programme

Background

Despite the movement towards care in the community, 40% of the NHS budget on mental health care is still attributed to inpatient services. However, long before the Francis Report highlighted grave shortcomings in inpatient care, there were reports by service user groups on the poor quality of these services in mental health. The programme provides a particular focus on the inclusion of the patient’s perspective in the development and evaluation of evidence.

Objectives

To understand how changes to inpatient care affect the perceptions of the ward by service users and staff by using stakeholder participatory methods.

Design

The programme consisted of four work packages (WPs). (1) Lasting Improvements for Acute Inpatient SEttings (LIAISE): using participatory methods we developed two new scales [Views On Therapeutic Environment (VOTE) for staff and Views On Inpatient CarE (VOICE) for service users]. (2) Client Services Receipt Inventory – Inpatient (CITRINE): working with nurses and service users we developed a health economic measure of the amount of contact service users have with staff. The self-report measure records interactions with staff as well as the number of therapeutic activities attended. (3) Delivering Opportunities for Recovery (DOORWAYS): a stepped-wedge randomised controlled trial to test if training ward nurses to deliver therapeutic group activities would improve the perception of the ward by service users and staff. A total of 16 wards were progressively randomised and we compared the VOICE, VOTE and CITRINE measures before and after the intervention. A total of 1108 service users and 539 staff participated in this trial. (4) Bringing Emergency TreatmenT to Early Resolution (BETTER PATHWAYS) was an observational study comparing two service systems. The first was a ‘triage’ system in which service users were admitted to the triage ward and then either transferred to their locality wards or discharged back into the community within 7 days. The second system was routine care. We collected data from 454 service users and 284 nurses on their perceptions of the wards.

Main outcome measures

The main outcomes for the DOORWAYS and BETTER project were service user and staff perceptions of the ward (VOICE and VOTE, respectively) and the health economic measure was CITRINE. All were developed in WPs 1 and 2.

Results

We developed reliable and valid measures of (1) the perceptions of inpatient care from the perspectives of service users and nurses (VOICE and VOTE) and (2) costs of interactions that were valued by service users (CITRINE). In the DOORWAYS project, after adjusting for legal status, we found weak evidence for benefit (standardised effect of –0.18, 95% CI 0.38 improvement to 0.01 deterioration;p = 0.062). There was only a significant benefit for involuntary patients following the staff training (N582, standardised effect of –0.35, 95% CI –0.57 to –0.12;p = 0.002; interactionp-value 0.006). VOTE scores did not change over time (standardised effect size of 0.04, 95% CI –0.09 to 0.18;p = 0.54). We found no evidence of an improvement in cost-effectiveness (estimated effect of £33, 95% CI –£91 to £146;p = 0.602), but resource allocation did change towards patient-perceived meaningful contacts by an average of £12 (95% CI –£76 to £98;p = 0·774). There were no significant differences between the triage and routine models of admission in terms of better perceptions by service users (estimated effect 0.77-point improvement in VOICE score on the triage ward;p = 0.68) or nurses (estimated effect of 1.68-point deterioration in VOTE on the triage ward;p = 0.38) or in terms of the cost of the length of care provided (£391 higher on triage;p = 0.77).

Strengths and limitations

We have developed measures using methods involving both service users and staff from mental health services. The measures were developed specifically for acute inpatient services and, therefore, cannot be assumed to be useful for other services. For instance, extensions of the measures are under construction for use in mother and baby units. The strength of the BETTER PATHWAYS and DOORWAYS projects is the large-scale data collection. However, we were testing specific services based in inner city areas and stretching to inner urban areas. It may be that different effects would be found in more rural communities or in different types of inpatient care.

Future work

Our database will be used to develop an understanding of the mediating and moderating factors for improving care quality.

Trial registration

Current Controlled Trials ISRCTN06545047.

Funding

This project was funded by the NIHR Programme Grants for Applied Research programme and will be published in full inProgramme Grants for Applied Research; Vol. 6, No. 7. See the NIHR Journals Library website for further project information.

Improving patient experiences of mental health inpatient care: a randomised controlled trial

BACKGROUND

Poorer patient views of mental health inpatient treatment predict both further admissions and, for those admitted involuntarily, longer admissions. As advocated in the UK Francis report, we investigated the hypothesis that improving staff training improves patients' views of ward care.

METHOD

Cluster randomised trial with stepped wedge design in 16 acute mental health wards randomised (using the ralloc procedure in Stata) by an independent statistician in three waves to staff training. A psychologist trained ward staff on evidence-based group interventions and then supported their introduction to each ward. The main outcome was blind self-report of perceptions of care (VOICE) before or up to 2 years after staff training between November 2008 and January 2013.

RESULTS

In total, 1108 inpatients took part (616 admitted involuntarily under the English Mental Health Act). On average 51.6 staff training sessions were provided per ward. Involuntary patient's perceptions of, and satisfaction with, mental health wards improved after staff training (N582, standardised effect -0·35, 95% CI -0·57 to -0·12, p = 0·002; interaction p value 0·006) but no benefit to those admitted voluntarily (N469, -0.01, 95% CI -0.23 to 0.22, p = 0.955) and no strong evidence of an overall effect (N1058, standardised effect -0.18 s.d., 95% CI -0.38 to 0.01, p = 0.062). The training costs around £10 per patient per week. Resource allocation changed towards patient perceived meaningful contacts by an average of £12 (95% CI -£76 to £98, p = 0.774).

CONCLUSION

Staff training improved the perceptions of the therapeutic environment in those least likely to want an inpatient admission, those formally detained. This change might enhance future engagement with all mental health services and prevent the more costly admissions.

The Rehabilitation Effectiveness for Activities for Life (REAL) study: a national programme of research into NHS inpatient mental health rehabilitation services across England

Background

The REAL (Rehabilitation Effectiveness for Activities for Life) research programme, funded by the National Institute for Heath Research (NIHR) from 2009 to 2015, investigated NHS mental health rehabiliation services across England. The users of these services are people with longer-term, complex mental health problems, such as schizophrenia, who have additional problems that complicate recovery. Although only around 10% of people with severe mental illness require inpatient rehabilitation, because of the severity and complexity of their problems they cost 25–50% of the total mental health budget. Despite this, there has been little research to help clinicians and commissioners to plan and deliver effective treatments and services. This research aimed to address this gap.

Methods

The programme had four phases. (1) A national survey, using quantitative and qualitative methods, was used to provide a detailed understanding of the scope and quality of NHS mental health rehabilitation services in England and the characteristics of those who use them. (2) We developed a training intervention for staff of NHS inpatient mental health rehabilitation units to facilitate service users’ activities. (3) The clinical effectiveness and cost-effectiveness of the staff training programme was evaluated through a cluster randomised controlled trial involving 40 units that scored below average on our quality assessment tool in the national survey. A qualitative process evaluation and a realistic evaluation were carried out to inform our findings further. (4) A naturalistic cohort study was carried out involving 349 service users of 50 units that scored above average on our quality assessment tool in the national survey, who were followed up over 12 months. Factors associated with better clinical outcomes were investigated through exploratory analyses.

Results

Most NHS trusts provided inpatient mental health rehabilitation services. The quality of care provided was higher than that in similar facilities across Europe and was positively associated with service users’ autonomy. Our cluster trial did not find our staff training intervention to be clinically effective [coefficient 1.44, 95% confidence interval (CI) –1.35 to 4.24]; staff appeared to revert to previous practices once the training team left the unit. Our realistic review suggested that greater supervision and senior staff support could help to address this. Over half of the service users in our cohort study were successfully discharged from hospital over 12 months. Factors associated with this were service users’ activity levels [odds ratio (OR) 1.03, 95% CI 1.01 to 1.05] and social skills (OR 1.13, 95% CI 1.04 to 1.24), and the ‘recovery’ orientation of the unit (OR 1.04, 95% CI 1.00 to 1.08), which includes collaborative care planning with service users and holding hope for their progress. Quality of care was not associated with costs of care. A relatively small investment (£67 per service user per month) was required to achieve the improvement in everyday functioning that we found in our cohort study.

Conclusions

People who require inpatient mental health rehabilitation are a ‘low-volume, high-needs’ group. Despite this, these services are able to successfully discharge most to the community within 18 months. Our results suggest that this may be facilitated by recovery-orientated practice that promotes service users’ activities and social skills. Further research is needed to identify effective interventions that enhance such practice to deliver these outcomes. Our research provides evidence that NHS inpatient mental health rehabilitation services deliver high-quality care that successfully supports service users with complex needs in their recovery.

Main limitation

Our programme included only NHS, non-secure, inpatient mental health rehabilitation services.

Trial registration

Current Controlled Trials ISRCTN25898179.

Funding

The NIHR Programme Grants for Applied Research programme.

Following the Francis report: investigating patient experience of mental health in-patient care

BACKGROUND

The Francis report highlights perceptions of care that are affected by different factors including ward structures.

AIMS

To assess patient and staff perceptions of psychiatric in-patient wards over time.

METHOD

Patient and staff perceptions of in-patient psychiatric wards were assessed over 18 months. We also investigated whether the type of ward or service structure affected these perceptions. We included triage and routine care. The goal was to include at least 50% of eligible patients and staff.

RESULTS

The most dramatic change was a significant deterioration in all experiences over the courseof the study. Systems of care or specific wards did not affect patient experience but staff were more dissatisfied in the triage system.

CONCLUSIONS

This is the first report of deterioration in perceptions of the therapeutic in-patient environment that has been captured in a rigorous way. It may reflect contemporaneous experiences across the National Health Service of budget reductions and increased throughput. The ward systems we investigated did not improve patient experience and triage may have been detrimental to staff.

Clinical outcomes and costs for people with complex psychosis; a naturalistic prospective cohort study of mental health rehabilitation service users in England

BACKGROUND

Mental health rehabilitation services in England focus on people with complex psychosis. This group tend to have lengthy hospital admissions due to the severity of their problems and, despite representing only 10-20 % of all those with psychosis, they absorb 25-50 % of the total mental health budget. Few studies have investigated the effectiveness of these services and there is little evidence available to guide clinicians working in this area. As part of a programme of research into inpatient mental health rehabilitation services, we carried out a prospective study to investigate longitudinal outcomes and costs for patients of these services and the predictors of better outcome.

METHOD

Inpatient mental health rehabilitation services across England that scored above average (median) on a standardised quality assessment tool used in a previous national survey were eligible for the study. Unit quality was reassessed and costs of care and patient characteristics rated using standardised tools at recruitment. Multivariable regression modelling was used to investigate the relationship between service quality, patient characteristics and the following clinical outcomes at 12 month follow-up: social function; length of admission in the rehabiliation unit; successful community discharge (without readmission or community placement breakdown) and costs of care.

RESULTS

Across England, 50 units participated and 329 patients were followed over 12 months (94 % of those recruited). Service quality was not associated with patients' social function or length of admission (median 16 months) at 12 months but most patients were successfully discharged (56 %) or ready for discharge (14 %), with associated reductions in the costs of care. Factors associated with successful discharge were the recovery orientation of the service (OR 1.04, 95 % CI 1.00-1.08), and patients' activity (OR 1.03, 95 % CI 1.01-1.05) and social skills (OR 1.13, 95 % CI 1.04-1.24) at recruitment.

CONCLUSION

Inpatient mental health rehabilitation services in England are able to successfully discharge over half their patients within 18 months, reducing the costs of care for this complex group. Provision of recovery orientated practice that promotes patients' social skills and activities may further enhance the effectiveness of these services.

Predicting psychiatric inpatient costs

PURPOSE

A large proportion of mental health costs is inpatient care but little is known about their variation between patients. The aim of this study was to measure and identify the predictors of costs of staff contacts and activities on inpatient wards.

METHOD

Inpatients from psychiatric hospital wards in south London were interviewed in 2008 and 2009 and staff contacts and use of activities recorded over a week and costs calculated. Regression analyses identified predictors.

RESULTS

Of 334 participants, 78% used activities and 90% had staff contacts. However, 41% reported no nurse contact. Mean staff contact and activity costs were £197 and £30 per week, respectively. Staff contact costs were inversely related to age, and activity costs were higher for patients with higher levels of education. Patient satisfaction was positively associated with both costs.

CONCLUSIONS

The costs of self-reported staff contacts and use of activities account for a small amount of total inpatient costs. Patients with higher costs appeared to have higher levels of satisfaction.

Clinical effectiveness of a staff training intervention in mental health inpatient rehabilitation units designed to increase patients' engagement in activities (the Rehabilitation Effectiveness for Activities for Life [REAL] study): single-blind, cluster-randomised controlled trial

BACKGROUND

Mental health inpatient rehabilitation services focus on people with complex psychosis who have, for example, treatment-refractory symptoms, cognitive impairment, and severe negative symptoms, which impair functioning and require lengthy admission. Engagement in activities could lead to improvement in negative symptoms and function, but few trials have been done. We aimed to investigate the effectiveness of a staff training intervention to increase patients' engagement in activities.

METHODS

We did a single-blind, two-arm, cluster-randomised controlled trial in 40 mental health inpatient rehabilitation units across England. Units were randomly allocated to either a manual-based staff training programme delivered by a small intervention team (intervention group, n=20) or standard care (control group, n=20). The primary outcome was patients' engagement in activities 12 months after randomisation, measured with the time use diary. With this measure, both the degree of engagement in an activity and its complexity are recorded four times a day for a week, rated on a scale of 0-4 for every period (maximum score of 112). Analysis was by intention-to-treat. Random-effects models were used to compare outcomes between study groups. Cost-effectiveness was assessed by combining service costs with the primary outcome. This study is registered with Current Controlled Trials (ISRCTN25898179).

FINDINGS

Patients' engagement in activities did not differ between study groups (coefficient 1·44, 95% CI -1·35 to 4·24). An extra £101 was needed to achieve a 1% increase in patients' engagement in activities with the study intervention.

INTERPRETATION

Our training intervention did not increase patients' engagement in activities after 12 months of follow-up. This failure could be attributable to inadequate implementation of the intervention, a high turnover of patients in the intervention units, competing priorities on staff time, high levels of patients' morbidity, and ceiling effects because of the high quality of standard care delivered. Further studies are needed to identify interventions that can improve outcomes for people with severe and complex psychosis.

FUNDING

National Institute for Health Research.

Inpatient care 50 years after the process of deinstitutionalisation

PURPOSE

Throughout the past 50 years mental health services have aimed to provide and improve high quality inpatient care. It is not clear whether there has been improvement as service users and nursing staff have both expressed frustration at the lack of therapeutic activities. In particular, it may be that the changing levels of symptoms over the past 50 years may affect engagement with ward activities.

METHODS

Eight wards in a health care trust in London serving an inner city and urban populations participated. Data were collected on participation in activities and 116 service users' perceptions of acute care as well as clinical factors.

RESULTS

Less time was spent participating in activities today than 50 years ago, while one quarter of service users reported taking part in no activities at all. Uptake of activities was related to more positive service user perceptions of the wards. Symptom severity did not impact the frequency of participation in activities, although those who took part in no activities at all had higher negative symptoms scores.

CONCLUSIONS

Service users' uptake of activities was not related to the severity of their illness. This belies the belief that the acutely ill cannot take part in meaningful activities. This study supports the view that more therapeutic activities could be taken up by the acutely ill and are in fact appreciated.