Comparing short-term risk of repeat self-harm after psychosocial assessment of patients who self-harm by psychiatrists or psychiatric nurses in a general hospital: Cohort study

BACKGROUND

There is mixed evidence for whether psychosocial assessment following hospital presentation for self-harm reduces self-harm repetition. A possible reason is the differences in professional background of assessors (primarily psychiatrists and psychiatric nurses) due to variability in training and therapist style.

METHODS

Using data from the Oxford Monitoring System for Self-harm, we analysed data on patients making their first emergency department (ED) presentation for self-harm between 2000 and 2014, followed-up until 2015. Using logistic regression, we estimated the probability of repeat self-harm within 12 months, comparing: (i) patients receiving psychosocial assessment versus none, adjusting for age, gender, self-harm method, past self-harm presentation, and general hospital admission; and (ii) patients assessed by a psychiatric nurse versus those assessed by a psychiatrist, adjusting for age, self-harm method, time and year of presentation.

RESULTS

The 12,652 patients who had an index ED presentation for self-harm during the study period accounted for 24,450 presentations, in 17,303 (71%) of which a psychosocial assessment was conducted; in 9318 (54%) by a psychiatric nurse and in 7692 (45%) by a psychiatrist. We found a reduced probability of repeat self-harm presentation among patients receiving psychosocial assessment versus none (adjusted odds ratio [AOR] = 0.70; 95% CI = 0.65-0.75; p < 0.001), but no differences between patients assessed by a psychiatric nurse or a psychiatrist (AOR = 1.05; 95% CI = 0.98-1.13; p = 0.129).

LIMITATIONS

Findings from a single hospital may not be generalizable to other settings.

CONCLUSIONS

Short-term risk of repeat self-harm after psychosocial assessment for self-harm may not differ by the assessor's professional background.

The efficacy of problem solving therapy to reduce post stroke emotional distress in younger (18-65) stroke survivors

PURPOSE

To investigate the efficacy of problem solving therapy for reducing the emotional distress experienced by younger stroke survivors.

METHOD

A non-randomized waitlist controlled design was used to compare outcome measures for the treatment group and a waitlist control group at baseline and post-waitlist/post-therapy. After the waitlist group received problem solving therapy an analysis was completed on the pooled outcome measures at baseline, post-treatment, and three-month follow-up.

RESULTS

Changes on outcome measures between baseline and post-treatment (n = 13) were not significantly different between the two groups, treatment (n = 13), and the waitlist control group (n = 16) (between-subject design). The pooled data (n = 28) indicated that receiving problem solving therapy significantly reduced participants levels of depression and anxiety and increased quality of life levels from baseline to follow up (within-subject design), however, methodological limitations, such as the lack of a control group reduce the validity of this finding.

CONCLUSION

The between-subject results suggest that there was no significant difference between those that received problem solving therapy and a waitlist control group between baseline and post-waitlist/post-therapy. The within-subject design suggests that problem solving therapy may be beneficial for younger stroke survivors when they are given some time to learn and implement the skills into their day to day life. However, additional research with a control group is required to investigate this further. This study provides limited evidence for the provision of support groups for younger stroke survivors post stroke, however, it remains unclear about what type of support this should be. Implications for Rehabilitation Problem solving therapy is no more effective for reducing post stroke distress than a wait-list control group. Problem solving therapy may be perceived as helpful and enjoyable by younger stroke survivors. Younger stroke survivors may use the skills learnt from problem solving therapy to solve problems in their day to day lives. Younger stroke survivors may benefit from age appropriate psychological support; however, future research is needed to determine what type of support this should be.

The Depression Conundrum and the Advantages of Uncertainty

According to the WHO (2012), the prevalence of unipolar depressive disorders is rising, even in those places where mental health treatments are widely available. The WHO predicts that these disorders will be the leading contributor to the global burden of disease by 2030. This sobering projection fits poorly with how psychological treatments for depression are presented in the mainstream scientific literature: as highly effective therapies, based upon a sound understanding of the causes of distress. There is a clear discrepancy between the rising prevalence figures on the one hand, and the confident claims of this effectiveness research on the other. This discrepancy prompts a set of complex interlinked questions, which we have called 'The Depression Conundrum.' In search of a partial answer, the aim of our study was to critically analyze five meta-analytic studies investigating the effectiveness of psychological EBTs for depression, all of which had been published in high impact factor journals. Our examination established a number of methodological and statistical shortcomings in every study. Furthermore, we argue that the meta-analytic technique is founded upon problematic assumptions. The implications of our analysis are clear: decades of quantitative research might not allow us to conclude that psychological EBTs for depression are effective. The uncertainty and questions raised by our findings might act as a catalyst to broaden the way in which depression and associated therapies are researched. In addition, it might contribute toward a more vigorous and interdisciplinary debate about how to tackle this soon-to-be global public health priority number one.

The Role of the Therapist in Therapeutic Change: How Knowledge From Mental Health Can Inform Pediatric Rehabilitation

The therapist is a neglected and poorly understood variable in pediatric rehabilitation. Much more attention has been paid to the role of intervention on client change than the role of therapist-related variables. This article synthesizes what is known in the adult and child mental health literature about the role of the therapist, and integrates this with work in pediatric rehabilitation. The article reviews the mental health literature on the therapist as a random variable associated with client outcomes (role of the therapist alone) and the role of three other therapist-related constructs: the therapist-client relationship (therapist and client), treatment implementation (therapist and intervention), and therapy process (therapist, client, and intervention considered holistically). Implications for clinical practice in pediatric rehabilitation include recognition of change as a multi-determined phenomenon involving common therapist-related factors, the therapist's role in creating facilitative conditions for change (through supportive relationships, positive expectancies, and mastery and learning experiences), and the importance of training in collaborative partnership skills. A contextual approach to therapeutic change is advocated, in which psychosocial factors and mechanisms are acknowledged, the therapist is seen as crucial, and the intervention process is seen as the context or vehicle through which changes occur.

A Process Evaluation of an Efficacious Family-Based Intervention to Promote Healthy Eating

Entre Familia: Reflejos de Salud was a successful family-based randomized controlled trial designed to improve dietary behaviors and intake among U.S. Latino families, specifically fruit and vegetable intake. The novel intervention design merged a community health worker ( promotora) model with an entertainment-education component. This process evaluation examined intervention implementation and assessed relationships between implementation factors and dietary change. Participants included 180 mothers randomized to an intervention condition. Process evaluation measures were obtained from participant interviews and promotora notes and included fidelity, dose delivered (i.e., minutes of promotora in-person contact with families, number of promotora home visits), and dose received (i.e., participant use of and satisfaction with intervention materials). Outcome variables included changes in vegetable intake and the use of behavioral strategies to increase dietary fiber and decrease dietary fat intake. Participant satisfaction was high, and fidelity was achieved; 87.5% of families received the planned number of promotora home visits. In the multivariable model, satisfaction with intervention materials predicted more frequent use of strategies to increase dietary fiber ( p ≤ .01). Trends suggested that keeping families in the prescribed intervention timeline and obtaining support from other social network members through sharing of program materials may improve changes. Study findings elucidate the relationship between specific intervention processes and dietary changes.

A randomised trial of adaptive pacing therapy, cognitive behaviour therapy, graded exercise, and specialist medical care for chronic fatigue syndrome (PACE): statistical analysis plan

Background

The publication of protocols by medical journals is increasingly becoming an accepted means for promoting good quality research and maximising transparency. Recently, Finfer and Bellomo have suggested the publication of statistical analysis plans (SAPs).The aim of this paper is to make public and to report in detail the planned analyses that were approved by the Trial Steering Committee in May 2010 for the principal papers of the PACE (Pacing, graded Activity, and Cognitive behaviour therapy: a randomised Evaluation) trial, a treatment trial for chronic fatigue syndrome. It illustrates planned analyses of a complex intervention trial that allows for the impact of clustering by care providers, where multiple care-providers are present for each patient in some but not all arms of the trial.

Results

The trial design, objectives and data collection are reported. Considerations relating to blinding, samples, adherence to the protocol, stratification, centre and other clustering effects, missing data, multiplicity and compliance are described. Descriptive, interim and final analyses of the primary and secondary outcomes are then outlined.

Conclusions

This SAP maximises transparency, providing a record of all planned analyses, and it may be a resource for those who are developing SAPs, acting as an illustrative example for teaching and methodological research. It is not the sum of the statistical analysis sections of the principal papers, being completed well before individual papers were drafted.

Trial registration

ISRCTN54285094 assigned 22 May 2003; First participant was randomised on 18 March 2005.

Implementation issues in an innovative rural substance misuser treatment program

This article is essentially the story of the development, implementation, and testing of a treatment protocol designed specifically for rural individuals who are substance misusers. Although the treatment protocol that emerged from this process seemed to be valuable for clients, the researchers were not able to establish with statistical significance that it was better than conventional treatment. In some ways, this was a failure. This article explores some of the possible reasons why new treatment approaches, tested in real clinical situations, may have difficulty establishing their effectiveness. The factors involved are many and complex.

Therapist Effects on Disparities Experienced by Minorities Receiving Services for Mental Illness

OBJECTIVES: The authors examine if some of the reason clients from racial and ethnic minority groups experience outcome disparities is explained by their therapists. METHOD: Data from 98 clients (19% minority) and 14 therapists at two community mental health agencies where clients from racial and ethnic minority groups were experiencing outcome disparities were analyzed using hierarchical linear modeling with treatment outcomes at Level 1, client factors at Level 2, and therapists at Level 3. RESULTS: There were substantial therapist effects that moderated the relationship between clients' race and treatment outcomes (outcome disparities). Therapists accounted for 28.7% of the variability in outcome disparities. CONCLUSIONS: Therapists are linked to outcome disparities and appear to play a substantial role in why disparities occur.

Client perceptions of effective and ineffective therapeutic alliances during treatment for stuttering

The treatment components that contribute to and account for successful therapeutic outcomes for people who stutter are not well understood and are debated by many. The purpose of this phenomenological study was to describe in detail the underlying factors that contribute to a successful or unsuccessful therapeutic interaction between clients and their clinicians. Twenty-eight participants, 19 men and 9 women, who had received from 6 months to more than 12 years of therapy for stuttering were studied. The participants were asked to consider their experience with one or more speech-language pathologists with whom they had received fluency therapy and to describe the characteristics that made that individual effective or ineffective in promoting successful change in their ability to communicate. Analysis of these data resulted in 15 primary categories. Finally, the essential structure of an effective and ineffective therapeutic interaction was described. Results highlighted the importance for effective therapy of understanding the stuttering experience, forming a positive client-clinician, alliance, and being knowledgeable about stuttering and its treatment.

EDUCATIONAL OBJECTIVES

The reader will be able to: (1) describe, from the perspective of a select group of adults who stutter, the themes associated with an effective therapeutic interaction, (2) describe, from the perspective of a select group of adults who stutter, the themes associated with an ineffective therapeutic interaction, and (3) describe the ways in which an effective or ineffective therapeutic interaction could impact a person who stutters.

Therapist variation within randomised trials of psychotherapy: implications for precision, internal and external validity

Nesting of patients within therapists in psychotherapy trials creates an additional level within the design. The multilevel nature of this design has implications for the precision, internal and external validity of estimates of the treatment effect. Prior to or during a trial, psychotherapies are allocated to therapists and therapists are assigned to patients such that the therapist becomes part of the causal pathway from the intervention to the patient. It is therefore important to consider not only the relationship between interventions and patients but also relationships between interventions and therapists and between therapists and patients. Research designs comparing the effects of therapeutic approaches, therapist characteristics and packages of the two can be unified by viewing therapists as an important source of variability within psychotherapy outcome studies. Methodological considerations arising from therapist variation will be discussed, drawing together and building upon the associated psychotherapy and statistical literatures. Parallels will also be made with related designs and methods of analysis.

The Causal Generalization Paradox: The Case of Treatment Outcome Research

Data from psychological experiments pose a causal generalization paradox. Unless the experimental results have some generality, they contribute little to scientific knowledge. Yet, because most experiments use convenience samples rather than probability-based samples, there is almost never a formal justification, or set of rigorous guidelines, for generalizing the study's findings to other populations. This article discusses the causal generalization paradox in the context of outcome findings from experimental evaluations of psychological treatment programs and services. In grappling with the generalization paradox, researchers often make misleading (or at least oversimplified) assumptions. The article analyzes 10 such assumptions, including the belief that a significant experimental treatment effect is likely to be causally generalizable and the belief that the magnitude of a significant experimental effect provides a sound effect size estimate for causal generalization. The article then outlines 10 constructive strategies for assessing and enhancing causal generality. They include strategies involving the scaling level of outcome measures, variable treatment dosages, effectiveness designs, multiple measures, corroboration from observational designs, and the synthesis of multiple studies. Finally, the article's discussion section reviews the conditions under which causal generalizations are justified.

Assessing fidelity in individual and family therapy for adolescent substance abuse

This study introduces an observational measure of fidelity in evidence-based practices for adolescent substance abuse treatment. The Therapist Behavior Rating Scale-Competence (TBRS-C) measures adherence and competence in individual cognitive-behavioral therapy and multidimensional family therapy for adolescent substance abuse. The TBRS-C assesses fidelity to the core therapeutic goals of each approach and also contains global ratings of therapist competence. Study participants were 136 clinically referred adolescents and their families observed in 437 treatment sessions. The TBRS-C demonstrated strong interrater reliability for goal-specific ratings of treatment adherence, and modest reliability for goal-specific and global ratings of therapist competence, evidence of construct validity, and discriminant validity with an observational measure of therapeutic alliance. The utility of the TBRS-C for evaluating treatment fidelity in field settings is discussed.

The use of random effects models to allow for clustering in individually randomized trials

BACKGROUND

We describe different forms of clustering that may occur in individually randomized trials, where the observed outcomes for different individuals cannot be regarded as independent. We propose random effects models to allow for such clustering, across a range of contexts and trial designs, and investigate their effect on estimation and interpretation of the treatment effect.

METHODS

We apply our proposed models to two individually randomized trials with potential for clustering, a trial of teleconsultation in hospital referral (the main outcome being offer of a further hospital appointment) and a trial of exercise therapy delivered by physiotherapists for low back pain (the outcome being a back pain score). Extensions to the methods include the possibility of explaining heterogeneity between clusters using cluster level characteristics and the potential dilution of cluster effects due to noncompliance.

RESULTS

In the teleconsultation trial, the odds ratio was significant (1.52, 95% CI 1.27 to 1.82) when clustering was ignored, but smaller and nonsignificant (1.36, 95% CI 0.85 to 2.13) when clustering by hospital consultant was taken into account. The 95% range of estimated treatment effects across consultants was from 0.21 to 8.76. This variability was only partially explained by the specialty of the consultant. In the back pain trial, although there was an overall benefit of exercise (change of - 0.51 points on the back pain score) and little evidence of clustering, the estimated treatment effects for different physiotherapists ranged from -1.26 to +0.26 points.

CONCLUSIONS

Clustering is an important issue in many individually randomized trials. Ignoring it can lead to underestimates of the uncertainty and too extreme P-values. Even when there is little apparent heterogeneity across clusters, it can still have a large impact on the estimation and interpretation of the treatment effect.

Psychiatrist effects in the psychopharmacological treatment of depression

BACKGROUND

The National Institutes of Mental Health's (NIMH) 1985 Treatment of Depression Collaborative Research Program (TDCRP) reported that imipramine hydrochloride with clinical management (IMI-CM) was significantly more beneficial than placebo with clinical management (PLA-CM) for individuals undergoing treatment for depression. Unfortunately, in analyzing the NIMH TDCRP data, researchers ignored the potential effect that psychiatrists have on patient outcomes, thereby assuming that psychiatrists are equally effective. However, this assumption has yet to be supported empirically. Therefore, the purpose of the current study is to examine psychiatrist effects in the NIMH TDCRP study and to compare the variation among psychiatrists to the variation between treatments.

METHOD

Data from 112 patients [IMI-CM (n = 57, 9 psychiatrists); PLA-CM (n = 55, 9 psychiatrists)] from the NIMH TDCRP study were reanalyzed using a multi-level model.

RESULTS

The proportion of variance in the BDI scores due to medication was 3.4% (p < .05), while the proportion of variance in BDI scores due to psychiatrists was 9.1% (p < .05). The proportion of variance in the HAM-D scores due to medication was 5.9% (p < .05), while the proportion of variance in HAM-D scores due to psychiatrist was 6.7% (p = .053). Therefore, the psychiatrist effects were greater than the treatment effects.

CONCLUSIONS

In this study, both psychiatrists and treatments contributed to outcomes in the treatment of depression. However, given that psychiatrists were responsible for more of the variance in outcomes it can be concluded that effective treatment psychiatrists can, in fact, augment the effects of the active ingredients of anti-depressant medication as well as placebo.

Counselor confounds in evaluations of vocational rehabilitation methods in substance dependency treatment

Evaluation research on vocational counseling in substance dependency treatment should distinguish between the effects of counselors and counseling methods on clients' employment outcomes. Three experimental designs permit investigation of possible confounds between these types of effects: (a) nested designs (each counselor delivers one counseling method so counselors are nested under methods), (b) crossed designs (each counselor delivers all counseling methods so counselors are crossed with methods), and (c) no-treatment control group designs (experimental group's counselors all deliver the same method). Each design is optimal for one stage of evaluation research. No-treatment control group designs are best for exploratory evaluations of new types of vocational counseling. Nested designs are best for outcome evaluations of different types of interventions. Crossed designs are best for (causal) process evaluations of counseling methods of demonstrated efficacy. Despite the importance of methodological issues and problems, vocational rehabilitation in substance dependency treatment has a greater need for stronger interventions than better evaluation designs.