Mental Health QUERI Initiative: expert ratings of criteria to assess performance for major depressive disorder and schizophrenia

Development of indicators for a nationwide cross-sectoral quality assurance procedure for mental health care of patients with schizophrenia, schizotypal and delusional disorders in Germany

PURPOSE

This paper describes the development of quality indicators for an external statutory and cross-sectoral quality assurance (QA) procedure in the context of the German health care system for adult patients suffering from schizophrenia, schizotypal and delusional disorders (F20-F29).

METHODS

Indicators were developed by a modified RAND/UCLA Appropriateness Method with 1) the compilation of an indicator register based on a systematic literature search and analyses of health care claims data, 2) the selection of indicators by an expert panel that rated them for relevance and for feasibility regarding implementation. Indicators rated positive for both relevance and feasibility formed the final indicator set.

RESULTS

847 indicators were identified by different searches. Out of these, 56 were selected for the indicator register. During the formal consensus process the expert panel recommended another 45 indicators so that a total of 101 indicators needed to be considered by the panel. Of these, 27 indicators rated both relevant and feasible were included in the final set of indicators: this set included 4 indicators addressing structures, 19 indicators addressing processes and 4 indicators addressing outcomes. 17 indicators of the set will be reported by hospitals and 8 by psychiatric outpatient facilities. Two indicators considered to be cross-sectoral will be reported by both sectors.

DISCUSSION

F20-F29 and its treatment show some specific features which so far have not been addressed by any procedure within the statutory QA program of the German health care system. These features include: Schizophrenia and related disorders a) are potentially chronic conditions, b) are mainly treated in outpatient settings, c) require a multi-professional treatment approach and d) are treated regionally in catchment areas. These specific features in combination with the peculiarities of some legal, political and organizational characteristics of the German health care system and its statutory QA program have strongly influenced the development of indicators. The result was a seemingly "imbalanced" set of indicators with a greater number of indicators for inpatient than for outpatient care despite the fact that clinical reality is otherwise.

CONCLUSIONS

The circumstances of the German health care system that restricted the development of this cross-sectoral QA procedure addressing care for F20-F29 are also most likely to emerge with the development of cross-sectoral QA procedures for other (potentially) chronic conditions that are mainly treated in the outpatient setting by multi-professional teams or by networks of different providers. In order to be able to develop a QA procedure that mirrors the reality of service provision for (potentially) chronic diseases such as F20-F29 we need to explore further current and new data sources, diminish sectoral borders, and implement health care responsibility on the level of catchment areas.

Improving quality of depression care using organized systems of care: a review of the literature

OBJECTIVE

To establish the need for a chronic disease management strategy for major depressive disorder (MDD), discuss the challenges involved in implementing guideline-level treatment for MDD, and provide examples of successful implementation of collaborative care programs.

DATA SOURCES

A systematic literature search of MEDLINE and the US National Library of Medicine was performed.

STUDY SELECTION

We reviewed clinical studies evaluating the effectiveness of collaborative care interventions for the treatment of depression in the primary care setting using the keywords collaborative care, depression, and MDD. This review includes 45 articles relevant to MDD and collaborative care published through May 2010 and excludes all non-English-language articles.

RESULTS

Collaborative care interventions include a greater role for nonmedical specialists and a supervising psychiatrist with the major goal of improving quality of depression care in primary care systems. Collaborative care programs restructure clinical practice to include a patient care strategy with specific goals and an implementation plan, support for self-management training, sustained patient follow-up, and decision support for medication changes. Key components associated with the most effective collaborative care programs were improvement in antidepressant adherence, use of depression case managers, and regular case load supervision by a psychiatrist. Across studies, primary care patients randomized to collaborative care interventions experienced enhanced treatment outcomes compared with those randomized to usual care, with overall outcome differences approaching 30%.

CONCLUSIONS

Collaborative care interventions may help to achieve successful, guideline-level treatment outcomes for primary care patients with MDD. Potential benefits of collaborative care strategies include reduced financial burden of illness, increased treatment adherence, and long-term improvement in depression symptoms and functional outcomes.

Performance indicators for public mental healthcare: a systematic international inventory

Background

The development and use of performance indicators (PI) in the field of public mental health care (PMHC) has increased rapidly in the last decade. To gain insight in the current state of PI for PMHC in nations and regions around the world, we conducted a structured review of publications in scientific peer-reviewed journals supplemented by a systematic inventory of PI published in policy documents by (non-) governmental organizations.

Methods

Publications on PI for PMHC were identified through database- and internet searches. Final selection was based on review of the full content of the publications. Publications were ordered by nation or region and chronologically. Individual PI were classified by development method, assessment level, care domain, performance dimension, diagnostic focus, and data source. Finally, the evidence on feasibility, data reliability, and content-, criterion-, and construct validity of the PI was evaluated.

Results

A total of 106 publications were included in the sample. The majority of the publications (n = 65) were peer-reviewed journal articles and 66 publications specifically dealt with performance of PMHC in the United States. The objectives of performance measurement vary widely from internal quality improvement to increasing transparency and accountability. The characteristics of 1480 unique PI were assessed. The majority of PI is based on stakeholder opinion, assesses care processes, is not specific to any diagnostic group, and utilizes administrative data sources. The targeted quality dimensions varied widely across and within nations depending on local professional or political definitions and interests. For all PI some evidence for the content validity and feasibility has been established. Data reliability, criterion- and construct validity have rarely been assessed. Only 18 publications on criterion validity were included. These show significant associations in the expected direction on the majority of PI, but mixed results on a noteworthy number of others.

Conclusions

PI have been developed for a broad range of care levels, domains, and quality dimensions of PMHC. To ensure their usefulness for the measurement of PMHC performance and advancement of transparency, accountability and quality improvement in PMHC, future research should focus on assessment of the psychometric properties of PI.

Adherence to practice guidelines, clinical outcomes, and costs among Medicaid enrollees with severe mental illnesses

The treatment of Medicaid enrollees diagnosed with depression or schizophrenia was examined to determine whether adherence to treatment guideline was associated with health care financing strategy, clinical outcomes, and cost-effectiveness. Individuals in a fee-for-service condition were significantly more likely to receive treatment consistent with guidelines than those in managed care. Mental health costs were higher for individuals diagnosed with schizophrenia, individuals in an acute phase of illness at intake into the study, and those receiving treatment consistent with practice guidelines. Being in an acute phase of illness and having treatment that comported with recommended practice guidelines were associated with higher total social costs. Policy implications of the findings and recommendations for future research are discussed.

The effectiveness of guideline implementation strategies on improving antipsychotic medication management for schizophrenia

OBJECTIVES

To compare the effectiveness of a conceptually-based, multicomponent "enhanced" strategy with a "basic" strategy for implementing antipsychotic management recommendations of VA schizophrenia guidelines.

METHODS

Two VA medical centers in each of 3 Veterans Integrated Service Networks were randomized to either a basic educational implementation strategy or the enhanced strategy, in which a trained nurse promoted provider guideline adherence and patient compliance. Patients with acute exacerbation of schizophrenia were enrolled and assessed at baseline and 6 months and their medical records were abstracted; 291 participants were included in analyses. Logistic regression models were developed for rates of: (1) switching patients from first-generation antipsychotics (FGA) to second-generation antipsychotics (SGA), and (2) guideline-concordant antipsychotic dose.

RESULTS

Of participants prescribed FGAs at baseline, those at enhanced sites were significantly more likely than participants at basic sites to have an SGA added to the FGA during the study (29% vs. 8%; adjusted OR = 7.7; 95% CI: 2.0-30.1), but were not significantly more likely to be switched to monotherapy with an SGA (29% vs. 23%). Guideline-concordant antipsychotic dosing was not significantly affected by the intervention.

CONCLUSIONS

The enhanced guideline implementation strategy increased addition of SGAs to FGA therapy, but did not significantly increase guideline-recommended switching from FGA to SGA monotherapy. Antipsychotic dosing was not significantly altered. The study illustrates the challenges of changing clinical behavior. Strategies to improve medication management for schizophrenia are needed, and must incorporate recommendations likely to emerge from recent research suggesting comparable effectiveness of SGAs and FGAs.

Use of electronic medical record data for quality improvement in schizophrenia treatment

An understanding of the strengths and limitations of automated data is valuable when using administrative or clinical databases to monitor and improve the quality of health care. This study discusses the feasibility and validity of using data electronically extracted from the Veterans Health Administration (VHA) computer database (VistA) to monitor guideline performance for inpatient and outpatient treatment of schizophrenia. The authors also discuss preliminary results and their experience in applying these methods to monitor antipsychotic prescribing using the South Central VA Healthcare Network (SCVAHCN) Data Warehouse as a tool for quality improvement.

The Institute of Medicine "Chasm" report: implications for depression collaborative care models

The Institute of Medicine report "Crossing the Quality Chasm: A New Health Care System for the 21st Century" describes the barriers in the American health care system to improving quality of care and outcomes of chronic illness. This article describes how depression collaborative care models as well as newer research aimed at organizational and economic issues have addressed these barriers in order to improve outcomes for patients with depression in primary care systems.

Clinical practice variations in prescribing antipsychotics for patients with schizophrenia

Few studies have examined the variations among individual physicians in prescribing antipsychotics for schizophrenia. This study examined clinical practice variations in the route and dosage of antipsychotic medication prescribed for inpatients with schizophrenia by 11 different psychiatrists. The sample consisted of 130 patients with a DSM-III-R diagnosis of schizophrenia who had received inpatient care at a state hospital or Veterans Affairs medical center in the southeastern United States in 1992-1993. Mixed-effects regression models were developed to explore the influence of individual physicians and hospitals on route of antipsychotic administration (oral or depot) and daily antipsychotic dose, controlling for patient case-mix variables (age, race, sex, duration of illness, symptom severity, and substance-abuse diagnosis). The average daily antipsychotic dose was 1092 +/- 892 chlorpromazine mg equivalents. Almost half of the patients (48%) were prescribed doses above or below the range recommended by current practice guidelines. The proportion of patients prescribed depot antipsychotics was significantly different at the 2 hospitals, as was the antipsychotic dose prescribed at discharge. Individual physicians and patient characteristics were not significantly associated with prescribing practices. These data, which were obtained before clinical practice guidelines were widely disseminated, provide a benchmark against which to examine more current practice variations in antipsychotic prescribing. The results raise several questions about deviations from practice guidelines in the pharmacological treatment of schizophrenia. To adequately assess quality and inform and possibly further develop clinical practice guideline recommendations for schizophrenia, well-designed research studies conducted in routine clinical settings are needed.