Methodological challenges in evaluating the effectiveness of women's crisis houses compared with psychiatric wards: findings from a pilot patient preference RCT

Recruitment to a trial of antipsychotic reduction: impact of an acceptability study

OBJECTIVES

Pre-trial acceptability studies may boost recruitment, especially in trials comparing distinctly different interventions. We evaluated the impact of an acceptability study on recruitment to a randomised trial of antipsychotic reduction versus maintenance treatment and explored demographic and clinical predictors of subsequent enrolment.

METHODS

Participants with a diagnosis of a schizophrenia spectrum disorder who were taking antipsychotic medication were interviewed about their views of taking part in a future trial.

RESULTS

In a sample of 210 participants, 151 (71.9%) expressed an interest in taking part in the future trial, 16 (7.6%) said they might be interested, and 43 (20.5%) said they were not. Altruistic reasons were most commonly given for wanting to take part, and concern about randomisation for not wanting to. Ultimately 57 people enrolled in the trial (27.1% of the original sample). Eighty-five people who initially expressed an interest did not enrol due to declining or not being eligible (for clinical reasons). Women and people from a white ethnic background were more likely to enrol in the trial, but no illness or treatment-related characteristics were associated with enrolment.

CONCLUSION

An acceptability study can be a useful tool for recruitment to challenging trials, but it may over-estimate recruitment.

Shared decision-making interventions for people with mental health conditions

BACKGROUND

One person in every four will suffer from a diagnosable mental health condition during their life. Such conditions can have a devastating impact on the lives of the individual and their family, as well as society.  International healthcare policy makers have increasingly advocated and enshrined partnership models of mental health care. Shared decision-making (SDM) is one such partnership approach. Shared decision-making is a form of service user-provider communication where both parties are acknowledged to bring expertise to the process and work in partnership to make a decision.  This review assesses whether SDM interventions improve a range of outcomes. This is the first update of this Cochrane Review, first published in 2010.

OBJECTIVES

To assess the effects of SDM interventions for people of all ages with mental health conditions, directed at people with mental health conditions, carers, or healthcare professionals, on a range of outcomes including: clinical outcomes, participation/involvement in decision-making process (observations on the process of SDM; user-reported, SDM-specific outcomes of encounters), recovery, satisfaction, knowledge, treatment/medication continuation, health service outcomes, and adverse outcomes.

SEARCH METHODS

We ran searches in January 2020 in CENTRAL, MEDLINE, Embase, and PsycINFO (2009 to January 2020). We also searched trial registers and the bibliographies of relevant papers, and contacted authors of included studies.  We updated the searches in February 2022. When we identified studies as potentially relevant, we labelled these as studies awaiting classification.

SELECTION CRITERIA

Randomised controlled trials (RCTs), including cluster-randomised controlled trials, of SDM interventions in people with mental health conditions (by Diagnostic and Statistical Manual of Mental Disorders (DSM) or International Classification of Diseases (ICD) criteria).

DATA COLLECTION AND ANALYSIS

We used standard methodological procedures expected by Cochrane. Two review authors independently screened citations for inclusion, extracted data, and assessed risk of bias. We used GRADE to assess the certainty of the evidence.

MAIN RESULTS

This updated review included 13 new studies, for a total of 15 RCTs. Most participants were adults with severe mental illnesses such as schizophrenia, depression, and bipolar disorder, in higher-income countries. None of the studies included children or adolescents.  Primary outcomes We are uncertain whether SDM interventions improve clinical outcomes, such as psychiatric symptoms, depression, anxiety, and readmission, compared with control due to very low-certainty evidence. For readmission, we conducted subgroup analysis between studies that used usual care and those that used cognitive training in the control group. There were no subgroup differences. Regarding participation (by the person with the mental health condition) or level of involvement in the decision-making process, we are uncertain if SDM interventions improve observations on the process of SDM compared with no intervention due to very low-certainty evidence. On the other hand, SDM interventions may improve SDM-specific user-reported outcomes from encounters immediately after intervention compared with no intervention (standardised mean difference (SMD) 0.63, 95% confidence interval (CI) 0.26 to 1.01; 3 studies, 534 participants; low-certainty evidence). However, there was insufficient evidence for sustained participation or involvement in the decision-making processes. Secondary outcomes We are uncertain whether SDM interventions improve recovery compared with no intervention due to very low-certainty evidence. We are uncertain if SDM interventions improve users' overall satisfaction. However, one study (241 participants) showed that SDM interventions probably improve some aspects of users' satisfaction with received information compared with no intervention: information given was rated as helpful (risk ratio (RR) 1.33, 95% CI 1.08 to 1.65); participants expressed a strong desire to receive information this way for other treatment decisions (RR 1.35, 95% CI 1.08 to 1.68); and strongly recommended the information be shared with others in this way (RR 1.32, 95% CI 1.11 to 1.58). The evidence was of moderate certainty for these outcomes. However, this same study reported there may be little or no effect on amount or clarity of information, while another small study reported there may be little or no change in carer satisfaction with the SDM intervention. The effects of healthcare professional satisfaction were mixed: SDM interventions may have little or no effect on healthcare professional satisfaction when measured continuously, but probably improve healthcare professional satisfaction when assessed categorically. We are uncertain whether SDM interventions improve knowledge, treatment continuation assessed through clinic visits, medication continuation, carer participation, and the relationship between users and healthcare professionals because of very low-certainty evidence. Regarding length of consultation, SDM interventions probably have little or no effect compared with no intervention (SDM 0.09, 95% CI -0.24 to 0.41; 2 studies, 282 participants; moderate-certainty evidence). On the other hand, we are uncertain whether SDM interventions improve length of hospital stay due to very low-certainty evidence. There were no adverse effects on health outcomes and no other adverse events reported.

AUTHORS' CONCLUSIONS

This review update suggests that people exposed to SDM interventions may perceive greater levels of involvement immediately after an encounter compared with those in control groups. Moreover, SDM interventions probably have little or no effect on the length of consultations.  Overall we found that most evidence was of low or very low certainty, meaning there is a generally low level of certainty about the effects of SDM interventions based on the studies assembled thus far. There is a need for further research in this area.

Acute psychiatric care: approaches to increasing the range of services and improving access and quality of care

Acute services for mental health crises are very important to service users and their supporters, and consume a substantial share of mental health resources in many countries. However, acute care is often unpopular and sometimes coercive, and the evidence on which models are best for patient experience and outcomes remains surprisingly limited, in part reflecting challenges in conducting studies with people in crisis. Evidence on best ap-proaches to initial assessment and immediate management is particularly lacking, but some innovative models involving extended assessment, brief interventions, and diversifying settings and strategies for providing support are potentially helpful. Acute wards continue to be central in the intensive treatment phase following a crisis, but new approaches need to be developed, evaluated and implemented to reducing coercion, addressing trauma, diversifying treatments and the inpatient workforce, and making decision-making and care collaborative. Intensive home treatment services, acute day units, and community crisis services have supporting evidence in diverting some service users from hospital admission: a greater understanding of how best to implement them in a wide range of contexts and what works best for which service users would be valuable. Approaches to crisis management in the voluntary sector are more flexible and informal: such services have potential to complement and provide valuable learning for statutory sector services, especially for groups who tend to be underserved or disengaged. Such approaches often involve staff with personal experience of mental health crises, who have important potential roles in improving quality of acute care across sectors. Large gaps exist in many low- and middle-income countries, fuelled by poor access to quality mental health care. Responses need to build on a foundation of existing community responses and contextually relevant evidence. The necessity of moving outside formal systems in low-resource settings may lead to wider learning from locally embedded strategies.

How do participants in clinical trials compare with other patients with schizophrenia?

We aimed to explore the clinical relevance of a multicentre, pragmatic randomised trial of antipsychotic reduction in people diagnosed with schizophrenia or psychosis The sample recruited for the antipsychotic reduction study (n = 69 people) was compared with the population of patients with an eligible diagnosis undergoing treatment in the same service (n = 3067 people), using routinely-collected, anonymised data. The trial sample was found to resemble the wider population in terms of the number of past admissions, the likelihood of having been subject to legal detention and the level of risk the patient was perceived to pose to themselves or others. There was a lower proportion of people from minority ethnic backgrounds in the trial sample. The results provide some reassurance that trial recruits were similar to the wider population in terms of the severity of their condition and did not comprise a highly select sample of people with milder problems. The different ethnic composition of the research sample is consistent with other research.

Emotional crisis in a naturalistic context: characterizing outpatient profiles and treatment effectiveness

BACKGROUND

Crisis happens daily yet its understanding is often limited, even in the field of psychiatry. Indeed, a challenge is to assess the potential for change of patients so as to offer appropriate therapeutic interventions and enhance treatment program efficacy. This naturalistic study aimed to identify the socio-demographical characteristics and clinical profiles at admission of patients referred to a specialized Crisis Intervention Center (CIC) and to examine the effectiveness of the intervention.

METHOD

The sample was composed of 352 adult outpatients recruited among the referrals to the CIC. Assessment completed at admission and at discharge examined psychiatric symptoms, defense mechanisms, recovery styles and global functioning. The crisis intervention consisted in a psychodynamically oriented multimodal approach associated with medication.

RESULTS

Regarding the clinical profiles at intake, patients were middle-aged (M = 38.56, SD = 10.91), with a higher proportion of women (62.22%). They were addressed to the CIC because they had attempted to commit suicide or had suicidal ideation or presented depressed mood related to interpersonal difficulties. No statistical differences were found between patients dropping out (n = 215) and those attending the crisis intervention (n = 137). Crisis intervention demonstrated a beneficial effect (p < 0.01) on almost all variables, with Effect Sizes (ES) ranging from small to large (0.12 < ES < 0.75; median = 0.49). However, the Reliable Change Index indicated that most of the issues fall into the undetermined category (range 41.46 to 96.35%; median = 66.20%).

CONCLUSIONS

This study establishes the profile of patients referred to the CIC and shows that more than half of the patients dropped out from the crisis intervention before completion. Our findings suggest that people presenting an emotional crisis benefit from crisis intervention. However, given methodological constraints, these results need to be considered with caution. Moreover, the clinical significance of the improvements is not confirmed. Thus, the effectiveness of crisis intervention in naturalistic context is not fully determined and should be more rigorously studied in future research.

Crisis intervention for people with severe mental illnesses

BACKGROUND

A particularly difficult challenge for community treatment of people with serious mental illnesses is the delivery of an acceptable level of care during the acute phases of severe mental illness. Crisis-intervention models of care were developed as a possible solution.

OBJECTIVES

To review the effects of crisis-intervention models for anyone with serious mental illness experiencing an acute episode compared to the standard care they would normally receive. If possible, to compare the effects of mobile crisis teams visiting patients' homes with crisis units based in home-like residential houses.

SEARCH METHODS

We searched the Cochrane Schizophrenia Group's Study-Based Register of Trials. There is no language, time, document type, or publication status limitations for inclusion of records in the register. This search was undertaken in 1998 and then updated 2003, 2006, 2010 and September 29, 2014.

SELECTION CRITERIA

We included all randomised controlled trials of crisis-intervention models versus standard care for people with severe mental illnesses that met our inclusion criteria.

DATA COLLECTION AND ANALYSIS

We independently extracted data from these trials and we estimated risk ratios (RR) or mean differences (MD), with 95% confidence intervals (CI). We assessed risk of bias for included studies and used GRADE to create a 'Summary of findings' table.

MAIN RESULTS

The update search September 2014 found no further new studies for inclusion, the number of studies included in this review remains eight with a total of 1144 participants. Our main outcomes of interest are hospital use, global state, mental state, quality of life, participant satisfaction and family burden. With the exception of mental state, it was not possible to pool data for these outcomes.Crisis intervention may reduce repeat admissions to hospital (excluding index admissions) at six months (1 RCT, n = 369, RR 0.75 CI 0.50 to 1.13, high quality evidence), but does appear to reduce family burden (at six months: 1 RCT, n = 120, RR 0.34 CI 0.20 to 0.59, low quality evidence), improve mental state (Brief Psychiatric Rating Scale (BPRS) three months: 2 RCTs, n = 248, MD -4.03 CI -8.18 to 0.12, low quality evidence), and improve global state (Global Assessment Scale (GAS) 20 months; 1 RCT, n = 142, MD 5.70, -0.26 to 11.66, moderate quality evidence). Participants in the crisis-intervention group were more satisfied with their care 20 months after crisis (Client Satisfaction Questionnaire (CSQ-8): 1 RCT, n = 137, MD 5.40 CI 3.91 to 6.89, moderate quality evidence). However, quality of life scores at six months were similar between treatment groups (Manchester Short Assessment of quality of life (MANSA); 1 RCT, n = 226, MD -1.50 CI -5.15 to 2.15, low quality evidence). Favourable results for crisis intervention were also found for leaving the study early and family satisfaction. No differences in death rates were found. Some studies suggested crisis intervention to be more cost-effective than hospital care but all numerical data were either skewed or unusable. We identified no data on staff satisfaction, carer input, complications with medication or number of relapses.

AUTHORS' CONCLUSIONS

Care based on crisis-intervention principles, with or without an ongoing homecare package, appears to be a viable and acceptable way of treating people with serious mental illnesses. However only eight small studies with unclear blinding, reporting and attrition bias could be included and evidence for the main outcomes of interest is low to moderate quality. If this approach is to be widely implemented it would seem that more evaluative studies are still needed.

The relationship between therapeutic alliance and service user satisfaction in mental health inpatient wards and crisis house alternatives: a cross-sectional study

Background

Poor service user experiences are often reported on mental health inpatient wards. Crisis houses are an alternative, but evidence is limited. This paper investigates therapeutic alliances in acute wards and crisis houses, exploring how far stronger therapeutic alliance may underlie greater client satisfaction in crisis houses.

Methods and Findings

Mixed methods were used. In the quantitative component, 108 crisis house and 247 acute ward service users responded to measures of satisfaction, therapeutic relationships, informal peer support, recovery and negative events experienced during the admission. Linear regressions were conducted to estimate the association between service setting and measures, and to model the factors associated with satisfaction. Qualitative interviews exploring therapeutic alliances were conducted with service users and staff in each setting and analysed thematically.

Results

We found that therapeutic alliances, service user satisfaction and informal peer support were greater in crisis houses than on acute wards, whilst self-rated recovery and numbers of negative events were lower. Adjusted multivariable analyses suggest that therapeutic relationships, informal peer support and negative experiences related to staff may be important factors in accounting for greater satisfaction in crisis houses. Qualitative results suggest factors that influence therapeutic alliances include service user perceptions of basic human qualities such as kindness and empathy in staff and, at service level, the extent of loss of liberty and autonomy.

Conclusions and Implications

We found that service users experience better therapeutic relationships and higher satisfaction in crisis houses compared to acute wards, although we cannot exclude the possibility that differences in service user characteristics contribute to this. This finding provides some support for the expansion of crisis house provision. Further research is needed to investigate why acute ward service users experience a lack of compassion and humanity from ward staff and how this could be changed.

Alternatives to standard acute in-patient care in England: short-term clinical outcomes and cost-effectiveness

BACKGROUND

Outcomes following admission to residential alternatives to standard in-patient mental health services are underresearched.

AIMS

To explore short-term outcomes and costs of admission to alternative and standard services.

METHOD

Health of the Nation Outcome Scales (HoNOS), Threshold Assessment Grid (TAG), Global Assessment of Functioning (GAF) and admission cost data were collected for six alternative services and six standard services.

RESULTS

All outcomes improved during admission for both types of service (n = 433). Adjusted improvement was greater for standard services in scores on HoNOS (difference 1.99, 95% CI 1.12-2.86), TAG (difference 1.40, 95% CI 0.39-2.51) and GAF functioning (difference 4.15, 95% CI 1.08-7.22) but not GAF symptoms. Admissions to alternatives were 20.6 days shorter, and hence cheaper (UK pound3832 v. pound9850). Standard services cost an additional pound2939 per unit HoNOS improvement.

CONCLUSIONS

The absence of clear-cut advantage for either type of service highlights the importance of the subjective experience and longer-term costs.

Effectiveness and cost-effectiveness of admissions to women's crisis houses compared with traditional psychiatric wards: pilot patient-preference randomised controlled trial

BACKGROUND

Women's crisis houses have been developed in the UK as a less stigmatising and less institutional alternative to traditional psychiatric wards.

AIMS

To examine the effectiveness and cost-effectiveness of women's crisis houses by first examining the feasibility of a pilot patient-preference randomised controlled trial (PP-RCT) design (ISRCTN20804014).

METHOD

We used a PP-RCT study design to investigate women presenting in crisis needing informal admission. The four study arms were the patient preference arms of women's crisis house or hospital admission, and randomised arms of women's crisis house or hospital admission.

RESULTS

Forty-one women entered the randomised arms of the trial (crisis house n = 19, wards n = 22) and 61 entered the patient-preference arms (crisis house n = 37, ward n = 24). There was no significant difference in outcomes (symptoms, functioning, perceived coercion, stigma, unmet needs or quality of life) or costs for any of the groups (randomised or preference arms), but women who obtained their preferred intervention were more satisfied with treatment.

CONCLUSIONS

Although the sample sizes were too small to allow definite conclusions, the results suggest that when services are able to provide interventions preferred by patients, those patients are more likely to be satisfied with treatment. This pilot study provides some evidence that women's crisis houses are as effective as traditional psychiatric wards, and may be more cost-effective.

The balanced care model for global mental health

BACKGROUND

For too long there have been heated debates between those who believe that mental health care should be largely or solely provided from hospitals and those who adhere to the view that community care should fully replace hospitals. The aim of this study was to propose a conceptual model relevant for mental health service development in low-, medium- and high-resource settings worldwide. Method We conducted a review of the relevant peer-reviewed evidence and a series of surveys including more than 170 individual experts with direct experience of mental health system change worldwide. We integrated data from these multiple sources to develop the balanced care model (BCM), framed in three sequential steps relevant to different resource settings.

RESULTS

Low-resource settings need to focus on improving the recognition and treatment of people with mental illnesses in primary care. Medium-resource settings in addition can develop 'general adult mental health services', namely (i) out-patient clinics, (ii) community mental health teams (CMHTs), (iii) acute in-patient services, (iv) community residential care and (v) work/occupation. High-resource settings, in addition to primary care and general adult mental health services, can also provide specialized services in these same five categories.

CONCLUSIONS

The BCM refers both to a balance between hospital and community care and to a balance between all of the service components (e.g. clinical teams) that are present in any system, whether this is in low-, medium- or high-resource settings. The BCM therefore indicates that a comprehensive mental health system includes both community- and hospital-based components of care.

Crisis intervention for people with severe mental illnesses

BACKGROUND

A particularly difficult challenge for community treatment of people with serious mental illnesses is the delivery of an acceptable level of care during the acute phases of severe mental illness. Crisis intervention models of care were developed as a possible solution.

OBJECTIVES

To review the effects of crisis intervention models for anyone with serious mental illness experiencing an acute episode, compared with 'standard care'.

SEARCH METHODS

We updated the 1998, 2003 and 2006 searches with a search of the Cochrane Schizophrenia Group's Register of trials (2010) which is based on regular searches of CINAHL, EMBASE, MEDLINE, and PsycINFO.

SELECTION CRITERIA

We included all randomised controlled trials of crisis intervention models versus standard care for people with severe mental illnesses.

DATA COLLECTION AND ANALYSIS

We independently extracted data from these trials and we estimated risk ratios (RR) or mean differences (MD), with 95% confidence intervals (CI). We assumed that people who left early from a trial had no improvement.

MAIN RESULTS

Three new studies have been found since the last review in 2006 to add to the five studies already included in this review. None of the previously included studies investigated crisis intervention alone; all used a form of home care for acutely ill people, which included elements of crisis intervention. However, one of the new studies focuses purely on crisis intervention as provided by Crisis Resolution Home Teams within the UK; the two other new studies investigated crisis houses i.e. residential alternatives to hospitalisation providing home-like environments.Crisis intervention appears to reduce repeat admissions to hospital after the initial 'index' crises investigated in the included studies, this was particularly so for mobile crisis teams supporting patients in their own homes.Crisis intervention reduces the number of people leaving the study early, reduces family burden, is a more satisfactory form of care for both patients and families and at three months after crisis, mental state is superior to standard care. We found no differences in death outcomes. Some studies found crisis interventions to be more cost effective than hospital care but all numerical data were either skewed or unusable. No data on staff satisfaction, carer input, complications with medication or number of relapses were available.

AUTHORS' CONCLUSIONS

Care based on crisis intervention principles, with or without an ongoing home care package, appears to be a viable and acceptable way of treating people with serious mental illnesses. If this approach is to be widely implemented it would seem that more evaluative studies are still needed.

Barriers to participation in mental health research: findings from the Genetics and Psychosis (GAP) Study

The aim of this study was to investigate why people with a first episode of psychosis choose or decline to participate in mental health research, using a qualitative study design. Participants were recruited via referrals from the Genetics and Psychosis (GAP) study. A total of 26 individuals with a first-episode of psychosis (nine of whom declined participation in the GAP study and 17 who participated) were individually interviewed and asked about their attitudes towards mental health research participation. Thematic analysis of interview transcripts was used to determine dominant themes and sub-themes on what constituted barriers and facilitators to participation. Reasons for research participation identified included a desire to help others, curiosity, and positive experiences with clinicians. Decisions to participate or not were also influenced by practical issues, including the timing of the approach, researchers' communication skills and whether individuals had concerns that it may be potentially harmful to their health. Other barriers to participation included patients' conceptualizations of mental health problems and the influence of other inpatients. Information on barriers and facilitators to recruitment in mental health research could inform recruitment strategies, thereby maximizing recruitment rates and minimizing the risk of selection biases.

Barriers to participation in mental health research: are there specific gender, ethnicity and age related barriers?

BACKGROUND

It is well established that the incidence, prevalence and presentation of mental disorders differ by gender, ethnicity and age, and there is evidence that there is also differential representation in mental health research by these characteristics. The aim of this paper is to a) review the current literature on the nature of barriers to participation in mental health research, with particular reference to gender, age and ethnicity; b) review the evidence on the effectiveness of strategies used to overcome these barriers.

METHOD

Studies published up to December 2008 were identified using MEDLINE, PsycINFO and EMBASE using relevant mesh headings and keywords.

RESULTS

Forty-nine papers were identified. There was evidence of a wide range of barriers including transportation difficulties, distrust and suspicion of researchers, and the stigma attached to mental illness. Strategies to overcome these barriers included the use of bilingual staff, assistance with travel, avoiding the use of stigmatising language in marketing material and a focus on education about the disorder under investigation. There were very few evaluations of such strategies, but there was evidence that ethnically matching recruiters to potential participants did not improve recruitment rates. Educational strategies were helpful and increased recruitment.

CONCLUSION

Mental health researchers should consider including caregivers in recruitment procedures where possible, provide clear descriptions of study aims and describe the representativeness of their sample when reporting study results. Studies that systematically investigate strategies to overcome barriers to recruitment are needed.

Where next with residential alternatives to admission?

The quest for alternatives to traditional psychiatric wards has a long history but methodological difficulties have limited research into their benefits. Two UK studies suggest that community-based residential alternatives are valued by service users and may be cost-effective. Establishing and/or maintaining such services, where they function as an integrated component of local acute care pathways, is a justifiable decision. However, our findings do not provide compelling evidence that they should be seen as essential in every catchment area. Quality of therapeutic relationships appears central to service user experiences, and future research should explore how this may be improved in both hospital and community settings.