Pushing the quality envelope: a new outcomes management system

Psychological predictors of benzodiazepine discontinuation among older adults: Results from the PASSE 60

BACKGROUND

Long-term benzodiazepine (BZD) use among seniors is mostly inappropriate and associated with adverse health outcomes. To prevent these consequences, withdrawal is crucial, yet knowledge is limited about what predicts BZD discontinuation. Until now, most studies have focused on sociodemographic and BZD intake factors as predictors while neglecting psychological factors. This research addresses this issue by studying how the intensity of depressive symptoms, social support satisfaction, self-perceived competence in the ability to withdraw, and overall quality of sleep predict discontinuation in long-term older consumers.

METHOD

Seventy-three participants aged 60 years and older were enrolled in this study. There were four time measures: before discontinuation (T1), after (T2), 3 months after (T3), and 12 months after (T4). Data were collected in the "Programme d'Aide du Succès au SEvrage" (PASSE-60+) study.

RESULTS

Social support satisfaction predicted discontinuation at T2 and T4. Self-perceived competence in the ability to withdraw and depressive symptoms predicted discontinuation at T4. This later prediction was counterintuitive; higher depressive symptoms at T1 were linked with higher discontinuation success. BZD intake factors (length of use and dose) were good predictors for short term discontinuation. Psychological factors were moderate predictors for short term and good predictors for long term discontinuation.

CONCLUSION

Psychological factors are good predictors of discontinuation and are better predictors than BZD intake factors of long-term discontinuation. Discontinuation programs should focus on social support and self-perceived competence to improve their efficacy. Further studies are needed to acquire a more complete picture of the psychological predictors of discontinuation success. ClinicalTrials.gov Identifier: NCT02281175.

Patient-reported outcome measurements (PROMs) and provider assessment in mental health: a systematic review of the context of implementation

Purpose

To review and integrate the vast amount of literature yielded by recent growing interest in patient-reported outcome measurement and routine outcome measures (PROMs/ROMs), in order to suggest options and improvements for implementation. PROMs are the systematic assessment of service users’ health using standardized self-report measures. Specifically, for ROMs, it includes routine provider or caretaker assessment measures. Both are administered to ascertain routinely, the impact of treatment in mental health settings and to improve care. A review is needed because of the large differences in setting, conceptualization, practice and implementation. Here, we examine the different major projects worldwide.

Data sources

Psych INFO and PubMed including Medline, Biomed Central, EMBASE Psychiatry and Elsevier Science’s Direct.

Study selection

We conducted a systematized review of the literature published from 2000 to 2018 on the implementation and sustainability of PROMs and ROMs in mental health services for adults.

Data extraction, synthesis and Results

We described and characterized the programs in different countries worldwide. We identified 103 articles that met the inclusion criteria, representing over 80 PROMs/ROMs initiatives in 15 countries. National policy and structure of mental health services were found to be major factors in implementation. We discuss the great variability in PROMs/ROMs models in different countries, making suggestions for their streamlining and improvement.

Conclusion

We extracted valuable information on the different characteristics of the numerous PROMs/ROMs initiatives worldwide. However, in the absence of a strong nationwide policy effort and support, implementation seems scattered and irregular. Thus, development of the implementation of PROMs/ROMs is left to groups of enthusiastic clinicians and researchers, making sustainability problematic.

The effectiveness, acceptability and cost-effectiveness of psychosocial interventions for maltreated children and adolescents: an evidence synthesis

BACKGROUND

Child maltreatment is a substantial social problem that affects large numbers of children and young people in the UK, resulting in a range of significant short- and long-term psychosocial problems.

OBJECTIVES

To synthesise evidence of the effectiveness, cost-effectiveness and acceptability of interventions addressing the adverse consequences of child maltreatment.

STUDY DESIGN

For effectiveness, we included any controlled study. Other study designs were considered for economic decision modelling. For acceptability, we included any study that asked participants for their views.

PARTICIPANTS

Children and young people up to 24 years 11 months, who had experienced maltreatment before the age of 17 years 11 months.

INTERVENTIONS

Any psychosocial intervention provided in any setting aiming to address the consequences of maltreatment.

MAIN OUTCOME MEASURES

Psychological distress [particularly post-traumatic stress disorder (PTSD), depression and anxiety, and self-harm], behaviour, social functioning, quality of life and acceptability.

METHODS

Young Persons and Professional Advisory Groups guided the project, which was conducted in accordance with Cochrane Collaboration and NHS Centre for Reviews and Dissemination guidance. Departures from the published protocol were recorded and explained. Meta-analyses and cost-effectiveness analyses of available data were undertaken where possible.

RESULTS

We identified 198 effectiveness studies (including 62 randomised trials); six economic evaluations (five using trial data and one decision-analytic model); and 73 studies investigating treatment acceptability. Pooled data on cognitive-behavioural therapy (CBT) for sexual abuse suggested post-treatment reductions in PTSD [standardised mean difference (SMD) -0.44 (95% CI -4.43 to -1.53)], depression [mean difference -2.83 (95% CI -4.53 to -1.13)] and anxiety [SMD -0.23 (95% CI -0.03 to -0.42)]. No differences were observed for post-treatment sexualised behaviour, externalising behaviour, behaviour management skills of parents, or parental support to the child. Findings from attachment-focused interventions suggested improvements in secure attachment [odds ratio 0.14 (95% CI 0.03 to 0.70)] and reductions in disorganised behaviour [SMD 0.23 (95% CI 0.13 to 0.42)], but no differences in avoidant attachment or externalising behaviour. Few studies addressed the role of caregivers, or the impact of the therapist-child relationship. Economic evaluations suffered methodological limitations and provided conflicting results. As a result, decision-analytic modelling was not possible, but cost-effectiveness analysis using effectiveness data from meta-analyses was undertaken for the most promising intervention: CBT for sexual abuse. Analyses of the cost-effectiveness of CBT were limited by the lack of cost data beyond the cost of CBT itself.

CONCLUSIONS

It is not possible to draw firm conclusions about which interventions are effective for children with different maltreatment profiles, which are of no benefit or are harmful, and which factors encourage people to seek therapy, accept the offer of therapy and actively engage with therapy. Little is known about the cost-effectiveness of alternative interventions.

LIMITATIONS

Studies were largely conducted outside the UK. The heterogeneity of outcomes and measures seriously impacted on the ability to conduct meta-analyses.

FUTURE WORK

Studies are needed that assess the effectiveness of interventions within a UK context, which address the wider effects of maltreatment, as well as specific clinical outcomes.

STUDY REGISTRATION

This study is registered as PROSPERO CRD42013003889.

FUNDING

The National Institute for Health Research Health Technology Assessment programme.

Daily affect dynamics predict early response in CBT: Feasibility and predictive validity of EMA for outpatient psychotherapy

BACKGROUND

Previous studies have shown that individual differences in affect dynamics during depressed patients' everyday lives allow the prediction of treatment outcome and of symptom reoccurrence in remitted patients. In this study, we analyze whether understanding patients' affective states and their fluctuation patterns helps predict early treatment response (until session 5).

METHODS

Ecological Momentary Assessment (EMA) strategies allow in-depth analyses of real-time affective states and of their dynamics. Repeated assessments were made four times a day during a two-week period to capture real-life affective states (positive affect, PA and negative affect, NA) and dynamics (fluctuations in NA and PA) before the start of outpatient treatment of 39 patients. Due to the nested structure of the data, hierarchical linear models were conducted.

RESULTS

PA/NA ratios, as well as fluctuations in NA predicted early treatment response, even when adjusting for initial impairment. In contrast, mean levels of NA or PA, as well as fluctuations in PA did not predict treatment response.

LIMITATIONS

The time between the EMA assessment and treatment onset varied between patients. However, this variation was not associated with early change.

CONCLUSIONS

The results suggest that pre-treatment affect dynamics could provide valuable information for predicting treatment response independent of initial impairment levels. Better predictions of early treatment response help to improve treatment choices early in the treatment progress.

Group Interventions for Patients with Cancer and HIV Disease: Part III. Moderating Variables and Mechanisms of Action

Growing evidence supports the value of group interventions for individuals who are at risk for or have developed cancer or HIV disease. However, information is more limited concerning how these services can be delivered in an optimal manner, and what processes contribute to their benefits. Parts I and II of this review examined the efficacy of different interventions for individuals at different phases of illness, ranging from primary prevention to late-stage disease, in both psychosocial and biological domains. The current paper examines some of the factors other than phase of illness that might influence group treatment effects (e.g., intervention parameters, participant characteristics), and explores mechanisms of action.

Evidence-based psychosocial treatment in the community: considerations for dissemination and implementation

BACKGROUND

In psycho-oncology care, steps toward dissemination and implementation of evidence-based treatments (EBTs) have not been made. For this to change, factors associated with real-world dissemination and implementation must be identified. In the community, providers, their organizations, and patients are key stakeholders.

METHOD

A focused review of literatures in continuing education, dissemination, and implementation of mental health services is provided.

RESULTS

Early-career providers are most ready to implement as they have greater openness and more positive attitudes toward EBTs. Current continuing education practices to teach EBTs have limited effectiveness. Instruction using interactive strategies tailored to therapists' clinical needs and the provision of post-education consultation is needed. There is tension between EBT delivery with fidelity and the necessity for adaptation. EBT service provision is the key outcome of implementation, and documenting such is important to patients, providers, and organizations.

CONCLUSION

A multilevel conceptual framework, Setting, Therapist, Education, imPlementation, and Sustainability, is offered and provides directions for dissemination and sustainable implementation. Guidelines from the Commission on Cancer of the American College of Surgeons and the American Society of Clinical Oncology underscore the timeliness of the proposed framework to move EBTs from the research settings where they were developed to the practice settings where they are needed.

Pretreatment and process predictors of nonresponse at different stages of inpatient psychotherapy

OBJECTIVE

Up to 50% of psychotherapeutic treatments end without significant improvements. While there is first evidence about predictors of nonresponse in outpatient psychotherapy, there are currently no studies investigating predictors of nonresponse in inpatient settings. Based upon a previous systematic literature review, we analyzed the predictive value of initial patient characteristics on nonresponse in symptom distress.

METHODS

Treatment episodes from 546 patients, treated for at least 4 weeks, were assessed under naturalistic conditions. Nonresponse status (i.e., lack of a reliable improvement in symptom distress) was investigated at four different time points: at week 4, at discharge, and at a two follow-ups (3 and 12 months after discharge). Hierarchical binary logistic regression models were used to predict nonresponse. Sociodemographic data, clinical variables, and the previous response status were entered subsequently in the model.

RESULTS

A moderate or functional level of initial symptom distress, a comorbid personality disorder, and previous nonresponse were the most consistent predictors of nonresponse.

CONCLUSIONS

The results point to the importance of early outcome assessment and suggest the implementation of more symptom-specific treatments.

Measuring outcomes in outpatient child psychiatry: reliable improvement, deterioration, and clinically significant improvement

Given the increasing interest in demonstrating effectiveness in psychiatric treatment, the current paper seeks to advance outcome measurement in child psychiatry by demonstrating how more informative analytic strategies can be used to evaluate treatment in a real world setting using a brief, standardized parent-report measure. Questionnaires were obtained at intake for 1294 patients. Of these, 695 patients entered treatment and 531 (74%) had complete forms at intake and follow-up. Using this sample, we analyzed the data to determine effect sizes, rates of reliable improvement and deterioration, and rates of clinically significant improvement. Findings highlighted the utility of these approaches for evaluating treatment outcomes. Further suggestions for improving outcome measurement and evaluation are provided.

Treatment outcomes of a combined cognitive behavior therapy and pharmacotherapy for a sample of women with and without substance abuse histories on an acute psychiatric unit: do therapeutic alliance and motivation matter?

BACKGROUND AND OBJECTIVES

Women with comorbid psychiatric and substance abuse problems (PwSA) experience more consequences from their use and typically have the poorest prognosis and outcome, compared to those with psychiatric problems but without substance abuse problems (PwoSA). The present study examined outcomes of a combined intensive inpatient cognitive behavior therapy (CBT) and pharmacotherapy program for women with PwSA and PwoSA.

METHODS

Sample consisted of 117 women on a women-only acute inpatient unit (PwSA = 50, PwoSA = 67).

RESULTS

Women in both groups made significant improvements in psychological functioning. High motivation at admission and therapeutic alliance at discharge were associated with improved psychological functioning at discharge for both groups.

SCIENTIFIC SIGNIFICANCE

Findings provide preliminary support for the efficacy of a combined CBT and pharmacotherapy program for women with psychiatric diagnoses on a women-only acute inpatient unit, and for pre-treatment motivation and therapeutic alliance as important correlates of better treatment outcomes.

Furthering the reliable and valid measurement of mental health screening, diagnoses, treatment and outcomes through health information technology

INTRODUCTION

Measurement of mental health is challenging; however, many solutions may be found through the use of health information technology.

METHOD

This article reviews current approaches to measuring mental health, focusing on screening, diagnosis, treatment, and outcomes. It then identifies several key areas in which health information technology may advance the field and provide reliable and valid measurements that are readily available to and manageable for providers, as well as acceptable, feasible, and sustainable for selected populations.

RESULT AND CONCLUSIONS

Although new technologies must overcome many challenges, including privacy, efficiency, cost, and scalability, it is an exciting and fast-growing field with many potential applications and clinical benefit.

Replicating and extending the good-enough level model of change: considering session frequency

The good-enough level (GEL) model posits that the rate of change in psychotherapy is related to the total dose of therapy. The psychotherapy dose-response literature has typically measured dose as number of sessions attended without considering the number of days or weeks it takes to complete the sessions (session frequency). The current study sought to replicate the GEL model and explore if session frequency moderates the influence that the number of sessions has on the rate of change in psychotherapy. An archived naturalistic data set with a US university counseling center sample (n=1,207), with treatment progress measured using the Outcome Questionnaire-45 (Lambert et al., 1996), was used. Our results are consistent with the GEL model (i.e., clients who attended fewer sessions evidenced faster rates of change), but extended it by showing that the rate of change was also influenced by session frequency (i.e., clients who attended more sessions on average per week demonstrated more rapid improvement). Evidence suggests that clinicians and researchers should give consideration to session frequency, both in their work with clients and how "dose" is operationalized in psychotherapy research.

Suicide-related discussions with depressed primary care patients in the USA: gender and quality gaps. A mixed methods analysis

Objective To characterise suicide-risk discussions in depressed primary-care patients. Design Secondary analysis of recordings and self reports by physicians and patients. Descriptive statistics of depression and suicide-related discussion, with qualitative extraction of disclosure, enquiry and physician response. Setting 12 primary-care clinics between July 2003 and March 2005. Participants 48 primary-care physicians and 1776 adult patients. Measures Presence of depression or suicide-related discussions during the encounter; patient and physician demographics; depression symptom severity and suicide ideation as measured by the Patient Health Questionnaire (PHQ9); physician's decision-making style as measured by the Medical Outcomes Study Participatory Decision-Making Scale; support for autonomy as measured by the Health Care Climate Questionnaire; trust in their physician as measured by the Primary Care Assessment Survey; physician response to suicide-related enquiry or disclosure. Results Of the 1776 encounters, 128 involved patients scoring >14 on the PHQ9. These patients were seen by 43 of the 48 physicians. Suicide ideation was endorsed by 59% (n=75). Depression was discussed in 52% of the encounters (n=66). Suicide-related discussion occurred in only 11% (n=13) of encounters. 92% (n=12) of the suicide discussions occurred with patients scoring <2 on PHQ9 item 9. Suicide was discussed in only one encounter with a male. Variation in elicitation and response styles demonstrated preferred and discouraged interviewing strategies. Conclusions Suicide ideation is present in a significant proportion of depressed primary care patients but rarely discussed. Men, who carry the highest risk for suicide, are unlikely to disclose their ideation or be asked about it. Patient-centred communication and positive healthcare climate do not appear to increase the likelihood of suicide related discussion. Physicians should be encouraged to ask about suicide ideation in their depressed patients and, when disclosure occurs, facilitate discussion and develop targeted treatment plans.

Reliability and validity of the BASIS-24 Mental Health Survey for Whites, African-Americans, and Latinos

Increasing racial and ethnic diversity calls for mental health assessment instruments that are appropriate, reliable, and valid for the wide range of cultures that comprise the current US population. However, most assessment instruments have not been tested on diverse samples. This study assessed psychometric properties and sensitivity to change of the revised Behavior and Symptom Identification Scale (BASIS-24) among the three largest race/ethnicity groups in the USA: Whites, African-Americans, and Latinos. BASIS-24 assessments were obtained for 2436 inpatients and 2975 outpatients treated at one of 27 mental health and/or substance abuse programs. Confirmatory factor analysis and several psychometric tests supported the factor structure, reliability, concurrent validity, and sensitivity of the instrument within each race/ethnicity group, although discriminant validity may be weaker for African-Americans and Latinos than for Whites. Further research is needed to test and validate assessment instruments with other race/ethnicity groups.

A practical system for monitoring the outcomes of substance use disorder patients

Outcomes monitoring and management are receiving mounting attention because of increased emphasis on health care accountability and cost containment. Efficient, practical outcomes monitoring systems (OMSs) are crucial if health care system performance is to be determined and effective/cost-effective treatments are to be identified, but such practical monitoring systems generally are lacking. This article describes the features of such a system for monitoring the care received by, and the substance use and psychosocial outcomes of, patients treated for substance use disorders (SUDs) in the Department of Veterans Affairs (VA). In contrast to a 15-21% follow-up rate achieved by VA SUD program staff under a previously mandated system-wide monitoring system, the monitoring system used in this project achieved a 67% follow-up rate without paying patients for their participation. We provide data on patient characteristics and treatment outcomes, estimate the cost of implementing this type of monitoring system on a broad scale, and provide recommendations for OMSs in other large health care organizations.

Estimating variability in outcomes attributable to therapists: a naturalistic study of outcomes in managed care

To estimate the variability in outcomes attributable to therapists in clinical practice, the authors analyzed the outcomes of 6,146 patients seen by approximately 581 therapists in the context of managed care. For this analysis, the authors used multilevel statistical procedures, in which therapists were treated as a random factor. When the initial level of severity was taken into account, about 5% of the variation in outcomes was due to therapists. Patient age, gender, and diagnosis as well as therapist age, gender, experience, and professional degree accounted for little of the variability in outcomes among therapists. Whether or not patients were receiving psychotropic medication concurrently with psychotherapy did affect therapist variability. However, the patients of the more effective therapists received more benefit from medication than did the patients of less effective therapists.

Implementation of a feedback system in a managed care environment: What are patients teaching us?

Lessons about patient treatment response from a large-scale outcomes management project are summarized. More than 7,000 clinicians contributed outcome data. Overall, the data demonstrated that patients who have clinical levels of psychological distress and impairment showed a relatively rapid response to treatment. Furthermore, although it appears that the duration and intensity of treatment vary widely from case to case, clinicians and patients make sound judgments as to how much and what kind of treatment is appropriate. Results supported the conclusion that the most effective method to manage costs is to ensure that each patient receive effective care. There are large and stable differences in the effectiveness of clinicians, and outcomes can be improved by referring patients to effective clinicians. The data also suggested that patients who had a poor initial response to treatment eventually had positive outcomes, provided that they remained engaged in treatment. This finding suggests that outcomes can be improved by identifying at-risk patients and proactively keeping them engaged in treatment.

Using Self-Report to Improve Substance Abuse Risk Assessment in Behavioral Health Care

BACKGROUND

Primary care and behavioral health clinicians frequently fail to detect substance-related problems among their patients, thereby leading to increased morbidity and mortality and health care costs. A managed behavioral health care organization(MBHO) conducted a quality improvement initiative in which clients seeking outpatient psychotherapy were screened by self-report for substance-related problems, and clinicians were provided with feedback in cases of discrepant findings.

METHOD

Client self-report questionnaires, which included items inquiring regarding problems related to substance abuse, were administered at multiple points during treatment episodes. Clinicians were also asked to complete assessments, including indicating the presence of a substance abuse problem.

RESULTS

Clinicians failed to identify substance abuse problems in > 80% of the cases where the patient endorsed items clearly related to substance abuse on the outcome questionnaire. In the quality improvement intervention, the MBHO sent letters alerting clinicians to the clients' self-reported substance abuse problems. The concordance between clinician assessment and client self-reported problems then increased significantly.

DISCUSSION

Results of the study argue for the utility of using client self-report measures as part of a comprehensive effort to measure and improve the effectiveness of behavioral health care treatment services.

Computer-supported monitoring of patient treatment response

The use of information technology (IT) for the purpose of improving psychotherapy outcomes in the context of routine clinical practice is described. IT efforts from two research programs, one in Germany and the other in the United States, are based on evidence that not all patients who enter treatment have a positive outcome and that continuous monitoring of patient treatment response with immediate feedback to therapists can be used to increase the likelihood of success for the poorly responding client. Such monitoring and feedback can best be accomplished by IT methodologies. Suitable IT systems are described, and their strengths and limitations are highlighted. Evidence is presented that supports the positive value of such efforts for improving patient treatment response.

Improving Suicide Risk Assessment in a Managed-Care Environment

Summary: This article describes the quality improvement intervention of a managed behavioral healthcare company to improve the quality of suicide risk assessments by its panel of providers. At-risk cases are identified by the patient's self-reported high frequency of suicidal ideation on a standardized outcome measure. Clinicians also assess severity of suicidal ideation based on clinical interviews. The clinician's assessment is identified as probably erroneous if the patient report indicates a high frequency of suicidal ideation and the clinicians assessment of suicidal ideation is none. The article describes the methods used to encourage clinicians to utilize information from the patient self-report measure as part of the clinical assessment. Probable suicidal ideation assessment errors were subsequently reduced by 29% over a 1-year period of administration.

Rationales, obstacles and strategies for local outcome monitoring systems in substance abuse treatment settings

The need for outcome monitoring systems (OMS) in substance abuse treatment is now such a pervasive position that it has achieved 'motherhood' stature. Yet, for a variety of reasons, implementation of systematic, ongoing monitoring continues to lag in most settings. The position taken in this article is that a local approach to monitoring is a viable alternative to large scale monitoring programs when such programs are unavailable. Moreover, local OMS can supplement these more generic programs by providing data that are more in tune with the orientation and program development of a specific setting. This article argues that local OMS can be developed with a reorganization of customary documentation procedures, a modest investment of personnel and specialized technical resources, a shorter-term view to outcome, and a commitment to evidence-based treatment.

Computers in psychiatry: a review of past programs and an analysis of historical trends

In a variety of clinical settings, computers are playing an increasing role in managing or retrieving clinical information. A recent survey of physician computer use suggests that psychiatrists, in comparison to other types of medical specialists, may be using computers less in routine care. In this paper, we present a literature review of 57 articles on computer programs in psychiatry that were published since 1966 in five major peer-reviewed journals. We divide the types of programs that have been developed into four categories: (1) diagnostic and decision support, (2) patient screening and therapy, (3) data collection and management, and (4) data modeling. Among the first three categories, we found trends in publications during the past three decades of research. We provide a discussion of representative computer programs. Our analysis of past programs reveals a number of design problems that may be a barrier to the more widespread use of computers in psychiatry.