The evolving randomised controlled trial in mental health: studying complexity and treatment process

A Meta-Research of Randomized Controlled Trials in the Field of Mental Health: Comparing Pharmacological to Non-Pharmacological Interventions from 1955 to 2020

OBJECTIVE

This study aimed to provide a general overview of mental health randomized controlled trials (RCTs) and summarize the temporal trends in terms of the number of studies, median sample sizes, and median effect sizes using data collected from the Cochrane Database of Systematic Reviews (CDSR).

METHODS

Using data collected from the CDSR, the temporal trends are compared in terms of the number of studies, median sample sizes, and median effect sizes between two broad categories of interventions: pharmacological RCT (ph-RCT) and non-pharmacological RCT (nph-RCT), and in conjunction with major mental disorder categories.

RESULTS

Chronologically, the number of mental health RCTs reported in publications has increased exponentially from 1955 to 2020. While ph-RCT comprised a majority of mental health RCTs in the earlier years, the proportion of nph-RCTs increased more quickly over time and markedly exceeded ph-RCT after 2010. The median sample size for all 6,652 mental health RCTs was 61, with 61 for ph-RCT and 60 for nph-RCT. Over time, the median fluctuated but an increasing trend was observed over the past 60+ years. The median of the effect size, measured by Pearson's r, for overall RCTs was 0.18, and nph-RCT (0.19) had a larger median effect size compared to ph-RCT (0.16). Over the years, the nph-RCT had a larger median effect size than the ph-RCT. Differences in the median effect sizes among the categories of mental disorders were also noted. Schizophrenia had the most RCTs, with a median Pearson's r value of 0.17. Mood disorder had the second largest number of RCTs and a median Pearson's r value of 0.15. Neurotic/stress-related mental disorder had the third largest number of RCTs with the highest median Pearson's r being 0.23.

CONCLUSIONS

This study provides meaningful information and filled the knowledge gap in mental health RCTs.

Tryptophan modulation in individuals with attention deficit hyperactivity disorder: a systematic review

The serotonergic system is implicated in ADHD, but the impact of serotonin’s precursor molecule, tryptophan, on ADHD symptomology remains unclear. Systematic searches of randomised controlled trials with an experimental tryptophan intervention in children and adults with ADHD identified 14 studies measuring core and related symptoms of the condition. Risk of bias was assessed using the Cochrane Risk of Bias tool. The 14 studies all used acute tryptophan depletion procedures, and most did not investigate core ADHD symptoms (inattention, impulsivity, hyperactivity) as primary outcome measures. Only two studies examined attention and revealed mixed effects of tryptophan. Similar effects were found for impulsivity in a small number of studies. No studies investigated hyperactivity. Most studies focused on reactive aggression, but samples were heterogenous and small, rendering potential meta-analyses inconclusive or misleading. However, the narrative analysis indicates tryptophan interventions may impact reactive aggression. More research is needed on the effect of tryptophan modulation on core ADHD symptoms, especially in adults, using more diverse samples to determine potential as an intervention. From current data, tryptophan modulation appears to alter aggressive behaviour in ADHD; however, the available studies were insufficient for the planned meta-analysis.

Psychological Interventions for Post-traumatic Stress Symptoms in Psychosis: A Systematic Review of Outcomes

Individuals with severe mental health problems, such as psychosis, are consistently shown to have experienced high levels of past traumatic events. They are also at an increased risk of further traumatisation through victimization events such as crime and assault. The experience of psychosis itself and psychiatric hospitalization have also been recognized to be sufficiently traumatic to lead to the development of post-traumatic stress (PTS) symptoms. Rates of post-traumatic stress disorder (PTSD) are elevated in people with psychosis compared to the general population. The current guidance for the treatment of PTSD is informed by an evidence base predominately limited to populations without co-morbid psychiatric disorders. The systematic review therefore sought to present the current available literature on the use of psychological treatments targeting PTS symptoms in a population with a primary diagnosis of a psychotic disorder. The review aimed to investigate the effect of these interventions on PTS symptoms and also the effect on secondary domains such as psychotic symptoms, affect and functioning. Fifteen studies were identified reporting on cognitive behavior therapy, prolonged exposure, eye movement desensitisation and reprocessing and written emotional disclosure. The review provides preliminary support for the safe use of trauma-focused psychological interventions in groups of people with severe mental health problems. Overall, the interventions were found to be effective in reducing PTS symptoms. Results were mixed with regard to secondary effects on additional domains. Further research including studies employing sufficiently powered methodologically rigorous designs is indicated.

The experience of adolescent inpatient care and the anticipated transition to the community: Young people's perspectives

This study explored adolescents' perspectives of inpatient mental health care, focussing on aspects of the inpatient environment they anticipated would help or hinder their transition back home. Semi-structured interviews were conducted with 12 adolescent inpatients; transcripts were analysed thematically. Participants experienced inpatient treatment as offering a mix of benefits (e.g., supportive relationships) and drawbacks (e.g., living in a "fake world"). They anticipated the transition home as providing opportunities for personal growth and consolidation of new coping skills, but also posing challenges concerning re-entering the "real world" after the experience of being "wrapped in cotton wool". Self-determination theory and attachment theory offer two potential frameworks for understanding these opportunities and challenges. Inpatient care has the potential to foster key mechanisms for adaptive development, creating a platform for developing positive future behaviours. Community teams should work closely with inpatient units to support the generalisation of the young person's newly acquired coping skills.

The challenges of conducting a nurse-led intervention in a randomized controlled trial with vulnerable participants

This paper discusses the challenges encountered by researchers while conducting a randomized controlled trial (RCT) testing the efficacy of a healthy lifestyle educational and exercise intervention for people with serious mental illness. RCTs, even though considered the “gold standard” of research designs, are still prone to risks of potential bias and threats to their validity. Based on researcher reflexivity, the combination of reflection and action, during the conduct of the study, this paper outlines a number of challenges faced by the researchers. These included managing the need of participants to tell their story and be heard, reluctance of participants to remain in allocated groups, participant literacy, dual role of the nurse nurse-researcher, and reporting the benefits of nonstatistical results of a quantitative research project. Recommendations for conducting future behaviour intervention studies of this type include the incorporation of a reflexive component for the nurse nurse-researcher, highlighting the importance of taking a reflexive stance in both qualitative and quantitative research designs.

Multidimensional Treatment Foster Care for Adolescents in English care: randomised trial and observational cohort evaluation

BACKGROUND

Children in care often have poor outcomes. There is a lack of evaluative research into intervention options.

AIMS

To examine the efficacy of Multidimensional Treatment Foster Care for Adolescents (MTFC-A) compared with usual care for young people at risk in foster care in England.

METHOD

A two-arm single (assessor) blinded randomised controlled trial (RCT) embedded within an observational quasi-experimental case-control study involving 219 young people aged 11-16 years (trial registration: ISRCTN 68038570). The primary outcome was the Child Global Assessment Scale (CGAS). Secondary outcomes were ratings of educational attendance, achievement and rate of offending.

RESULTS

The MTFC-A group showed a non-significant improvement in CGAS outcome in both the randomised cohort (n = 34, adjusted mean difference 1.3, 95% CI -7.1 to 9.7, P = 0.75) and in the trimmed observational cohort (n = 185, adjusted mean difference 0.95, 95% CI -2.38 to 4.29, P = 0.57). No significant effects were seen in secondary outcomes. There was a possible differential effect of the intervention according to antisocial behaviour.

CONCLUSIONS

There was no evidence that the use of MTFC-A resulted in better outcomes than usual care. The intervention may be more beneficial for young people with antisocial behaviour but less beneficial than usual treatment for those without.

Thinking without knowing--child psychoanalytic psychotherapy in the UK and evidence-based practice

BACKGROUND

Child psychoanalytic psychotherapy has been criticized for its reluctance to embrace evidence-based practice. This study aims to explore the historical narrative of a sample of child psychoanalytic psychotherapists about progress in developing the evidence base.

METHODS

Fourteen psychotherapists were interviewed and the transcripts analysed for common themes about evidence-based practice.

RESULTS

Child psychoanalytic psychotherapists were generally positive about developing evidence-based practice but had reservations about the narrowness of hierarchies used by commissioners to assess evidence.

CONCLUSION

The child psychoanalytical psychotherapists interviewed for this study recognized the need to promote evidence-based practice, in particular, to inform commissioners of Child Mental Health Services.

A new generation of pragmatic trials of psychosocial interventions is needed

This Editorial addresses the crucial issue of which research methodology is most suited for capturing the complexity of psychosocial interventions conducted in 'real world' mental health settings. It first examines conventional randomized controlled trial (RCT) methodology and critically appraises its strengths and weaknesses. It then considers the specificity of mental health care treatments and defines the term 'complex' intervention and its implications for RCT design. The salient features of pragmatic RCTs aimed at generating evidence of psychosocial intervention effectiveness are then described. Subsequently, the conceptualization of pragmatic RCTs, and of their further developments - which we propose to call 'new generation' pragmatic trials - in the broader routine mental health service context, is explored. Helpful tools for planning pragmatic RCTs, such as the CONSORT extension for pragmatic trials, and the PRECIS tool are also examined. We then discuss some practical challenges that are involved in the design and implementation of pragmatic trials based on our own experience in conducting the GET UP PIANO Trial. Lastly, we speculate on the ways in which current ideas on the purpose, scope and ethics of mental health care research may determine further challenges for clinical research and evidence-based practice.

A brief cognitive-behavioural social skills training for stabilised outpatients with schizophrenia: a preliminary study

Achieving social functioning and achieving social competence are two main objectives of psychosocial interventions for people suffering from schizophrenia. The present preliminary study presents a novel approach of social skills training (SST) based on the proposals of Kopelowicz et al. (Kopelowicz, A., Liberman, R. P., and Zarate, R., 2006. Schizophr. Bull. 32 (1): S12-23) that link the treatment to seven specific target behaviours: social perception, social information processing, responding and sending skills, affiliative skills, interactional skills, and behaviour governed by social norms. Thirty-one stabilised outpatients were randomly assigned to one of two groups, SST (n=13) or treatment-as-usual (n=18) (TAU; case management, medication adherence, psychotherapy, leisure engagement, and family support) and were assessed at baseline in cognitive performance, clinical symptomatology, social cognition, and psychosocial functioning. These outcomes were evaluated across post-treatment and at the 6-month follow-up appointment. SST subjects showed improvements in psychopathology, social discomfort, social cognition (self-regulation statements during interactions), social withdrawal, interpersonal communication, and quality of life compared with the TAU group. At the 6-month follow-up, results were maintained for negative symptoms, social discomfort, and some functioning outcomes. Neuropsychological variables were also examined, as mediators of benefit from skills training. Results support the efficacy of the brief SST for outpatients with schizophrenia and show the need to implement empirically supported interventions in mental health services to enhance patients' social functioning and quality of life.

Brief interventions are effective in reducing alcohol consumption in opiate-dependent methadone-maintained patients: results from an implementation study

INTRODUCTION AND AIMS

An implementation study to test the feasibility and effectiveness of brief interventions (BIs) to reduce hazardous and harmful alcohol consumption in opiate-dependent methadone-maintained patients.

DESIGN AND METHODS

Before and after intervention comparison of Alcohol Use Disorders Identification Test (AUDIT-C) scores from baseline to 3month follow up. Seven hundred and ten (82%) of the 863 eligible methadone-maintained patients within three urban addiction treatment clinics were screened. A World Health Organization protocol for a clinician-delivered single BI to reduce alcohol consumption was delivered. The full AUDIT questionnaire was used at baseline (T1) to measure alcohol consumption and related harms; and in part as a screening tool to exclude those who may be alcohol-dependent. AUDIT-C was used at 3month follow up (T2) to assess any changes in alcohol consumption. RESULTS. One hundred and sixty (23% of overall sample screened) 'AUDIT-positive' cases were identified at baseline screening with a mean total full AUDIT score of 13.5 (SD 6.7). There was a statistically significant reduction in AUDIT-C scores from T1 ( , SD=2.35) to T2 (, SD=2.66) for the BI group (z=-3.98, P<0.01). There was a statistically significant decrease in the proportion of men who were AUDIT-positive from T1 to T2 (χ(2) =8.25, P<0.003).

DISCUSSION AND CONCLUSIONS

It is feasible for a range of clinicians to screen for problem alcohol use and deliver BI within community methadone clinics. Opiate-dependent patients significantly reduced their alcohol consumption as a result of receiving a BI.

Culturally relevant family-based treatment for adolescent delinquency and substance abuse: understanding within-session processes

Identifying psychotherapy processes that likely contribute to client outcome with ethnic minorities is a vital practice and research need, particularly within family-focused, evidence-based treatments (EBT) for youth with externalizing problems. Identifying process variables within a cross-cultural context may improve the efficacy of EBTs by informing psychotherapists how to modify their behavior when working with ethnically diverse clients. The authors described one approach to the development of culturally competent psychotherapy, using an observational coding system comprising Afrocentric codes to investigate culturally relevant therapist behaviors. Qualitative examples illustrated the quantitative findings relating to therapist in-session behavior that promote client engagement and positive responding during a midtreatment session of multisystemic therapy.

Guided self-help supported by paraprofessional mental health workers: an uncontrolled before--after cohort study

There has been considerable development of guided self-help clinics within primary care. This uncontrolled before-after cohort study examines efficiency and effectiveness of these clinics when supported by paraprofessional mental health workers having little mental health training and experience. Data were collected by seven Graduate Mental Health Workers (GMHW) located in South-west England. Alongside an analysis of clinic attendance and dropout, efficiency was measured with respect to the number and length of sessions to support patients with the effectiveness of the interventions examined with respect to problem severity. Over a 15-month period, 1162 patients were referred to the GMHW clinics with 658 adopting guided self-help. Patients using guided self-help received an average input per patient, excluding assessment, of four sessions of 40 minutes. Dropout rate was comparable to other primary-care-based mental health clinics supported by experienced mental health professionals with 458 patients completing all support sessions. However, only 233 patients went on to attend the 3 months of follow-up session. Effectiveness of guided self-help clinics supported by paraprofessional mental health workers was comparable to that supported by an experienced mental health nurse. Improvements in problem severity were statistically significant, with 55% and 58% (final support session) and 63% and 62% (3 months of follow-up) of patients experiencing clinically significant and reliable change for anxiety and depression, respectively. However, concerns exist over the efficiency of the GMHW clinic especially with respect to the use of longer support sessions and high dropout rate at the 3 months of follow-up session. The paper concludes by highlighting the effectiveness of guided self-help when supported by paraprofessional mental health workers, but questions the utility of the two-plus-one model of service delivery proposing a collaborative care approach as an alternative.

Using intervention trials in developmental psychiatry to illuminate basic science

We discuss the nature of intervention in developmental psychiatry and the implication of this for clinical trials. New ideas in the design of randomised trials for complex interventions, along with recent statistical advances in causal analysis, give such trials additional potential as a means by which to study the basic science of complex developmental disorders. The challenge for designers of trials is to model designs effectively to make best use of these new opportunities. We give examples of how this might be done and discuss implications for future trials designs in the area.

Inpatient treatment in child and adolescent psychiatry--a prospective study of health gain and costs

BACKGROUND

Inpatient treatment is a complex intervention for the most serious mental health disorders in child and adolescent psychiatry. This is the first large-scale study into its effectiveness and costs. Previous studies have been criticised for methodological weaknesses.

METHODS

A prospective cohort study, including economic evaluation, conducted in 8 UK units (total n = 150) with one year follow-up after discharge. Patients acted as their own controls. Outcome measurement was the clinician-rated Childhood Global Assessment Scale (CGAS); researcher-rated health needs assessment; parent- and teacher-rated symptomatology.

RESULTS

We found a significant (p < .001) and clinically meaningful 12-point improvement in CGAS following mean 16.6 week admission (effect size .92); this improvement was sustained at 1 year follow-up. Comparatively, during the mean 16.4 week pre-admission period there was a 3.7-point improvement (effect size .27). Health needs assessment showed similar gain (p < .001, effect size 1.25), as did teacher- and parent-rated symptoms. Improvement was found across all diagnoses. Longer stays, positive therapeutic alliance and better premorbid family functioning independently predicted better outcome. Mean cost of admission was pound 24,100; pre-admission and post-discharge support costs were similar.

CONCLUSIONS

Inpatient treatment is associated with substantive sustained health gain across a range of diagnoses. Lack of intensive outpatient-treatment alternatives limits any unqualified inference about causal effects, but the rigour of measurement here gives the strongest indication to date of the positive impact of admission for complex mental health problems in young people.

Enhancing the validity and utility of randomized clinical trials in addictions treatment research: II. Participant samples and assessment

PURPOSE

This paper is the second in a series that describes strategies for optimizing the validity and utility of randomized clinical trials (RCTs) in addictions treatment research. Whereas the first paper focused on treatment implementation and research design, here we address issues pertaining to participant samples and assessment methods.

SCOPE

With respect to participant samples, sections focus on the definition of study populations; informed consent; sample size and statistical power; recruitment and enrollment; sample retention; and participant tracking systems. Assessment topics include eligibility screening and baseline assessment; treatment-related variables; outcome measures; the frequency of follow-up evaluation; and assessment process. A final section highlights the importance of pilot testing.

CONCLUSIONS

Sample recruitment and retention strategies are needed that safeguard both internal and external validity. Daily estimation assessment procedures are recommended because of their versatility for creating a range of outcome measures. Assessment batteries should include measures that permit the investigation of treatment processes and mechanisms of action.

Enhancing the validity and utility of randomized clinical trials in addictions treatment research: I. Treatment implementation and research design

PURPOSE

This paper is the first in a series that examines methods for improving the validity and utility of randomized clinical trials (RCTs) in addictions treatment research. The specific foci of this article are treatment implementation and research design.

SCOPE

We begin by considering the conditions under which the RCT provides an appropriate design choice. Sections that follow discuss methodological issues with respect to RCT structure and collaborative arrangements; treatment specification, delivery and cost; experimental design; and randomization/blinding procedures. We emphasize the importance of advance planning; treatment integrity and discriminability; treatment standardization; staff training and supervision; client compliance; maintenance of between-group equivalence across study conditions; and inclusion of appropriate comparison groups in study designs.

CONCLUSIONS

Investigators are encouraged to maximize the internal validity of RCTs, but also to consider methods for enhancing external validity. The utility of addictions RCTs for advancing theory and improving clinical practice can be enhanced by investigating underlying mechanisms of action.