The case for practical clinical trials in psychiatry

How to assess the clinical impact of treatments on patients, rather than the statistical impact of treatments on measures

While randomized clinical trials (RCTs) should provide the basis for evidence-based medicine, as currently designed and analyzed, they often mislead clinical decision-making. Comparative effectiveness evaluation of two treatments [Treatment 1 (T1) versus Treatment 2 (T2)] should not be determined by the statistical effect of treatments on individual measures of outcome (benefits and/or harms), but rather on the clinical effects of treatments on individual patients who can experience both benefits and harms. Such strategies for evaluation require both methods for statistical assessment of the rates of co-occurrence of such benefits and harms, and clinical assessment of their combined clinical impact on patients. The strategies discussed here are possible solutions to this dilemma. It is crucial to develop successful strategies to assess the effects of treatments on individual patients.

Effectiveness of haloperidol, risperidone and olanzapine in the treatment of first-episode non-affective psychosis: results of a randomized, flexible-dose, open-label 1-year follow-up comparison

The aim of this study was to investigate the long-term effectiveness and efficacy of haloperidol, risperidone and olanzapine in first-episode schizophrenia-spectrum disorders. This was a prospective, randomized, open-label study. Data for the present investigation were obtained from a large epidemiological and 3-year longitudinal intervention programme of first-episode psychosis conducted at the University Hospital Marques de Valdecilla, Santander, Spain. One hundred and seventy-four patients were randomly assigned to haloperidol (N = 56), olanzapine (N = 55), or risperidone (N = 63) and followed up for 1 year. The primary effectiveness measure was all causes of treatment discontinuation. Effectiveness analyses were based on intend-to-treat populations. In addition, an analysis based on per protocol populations was conducted in the analysis for clinical efficacy. The treatment discontinuation rate for any cause was higher with haloperidol than with risperidone and olanzapine (χ(2) = 8.517; p = 0.014). The difference in discontinuation rate between risperidone and olanzapine was not significant (χ(2) = 0.063; p = 0.802). There were no significant advantages of any of the three treatments in reducing the severity of psychopathology. Risperidone and olanzapine demonstrated higher effectiveness relative to haloperidol, but the three antipsychotics were equally effective in reducing the severity of psychopathology. Specific clinical programmes and the use of second-generation antipsychotics may enhance the effectiveness of antipsychotic treatments.

Cardiovascular risk in patients admitted for psychosis compared with findings from a population-based study

BACKGROUND

Schizophrenia and related psychoses are associated with excess morbidity and mortality from cardiovascular disease (CVD). Single-site studies on CVD-related risk factors in representative samples of acutely admitted inpatients are scarce.

AIMS

To assess the levels of risk factors related to CVD in patients acutely admitted to hospital for symptoms of psychosis.

METHODS

Eligible patients aged 18-65 years were included consecutively in the Bergen Psychosis Project (BPP). CVD-related risk factors were recorded at admittance and at discharge or after 6 weeks at the latest. The recordings of 218 patients with psychosis (BPP) were compared with the findings of 50,219 subjects from the population-based Nord-Trøndelag Health Study 1995-97 (HUNT2) survey.

RESULTS

Diastolic blood pressures were higher for BPP women and men, whereas body mass indexes (BMIs) and total cholesterol levels were higher in HUNT2 women and men. On categorical measures, smoking was more prevalent in the patients compared with the HUNT2 subjects. Metabolic syndrome was present in 11.8% and 21.9% of BPP women and men, respectively. At discharge or 6 weeks from admission, 3.2% and 18.6% of BPP women and men, respectively, had metabolic syndrome. BMIs and total cholesterol levels had worsened during the inpatient treatment period. Only one patient had a diagnosis corresponding to the CVD risk found, and only four patients received antidiabetics, antihypertensives or lipid-lowering drugs.

CONCLUSIONS

Some CVD-related risk factors were high in the patients at admission, some worsened and CVD risk factors seem to be suboptimally addressed, which should warrant increased awareness on the topic in clinical practice.

Bridging the gap between basic science and clinical practice: a role for community clinicians

BACKGROUND

Translating the extraordinary scientific and technological advances occurring in medical research laboratories into care for patients in communities throughout the country has been a major challenge. One contributing factor has been the relative absence of community practitioners from the US biomedical research enterprise. Identifying and addressing the barriers that prevent their participation in research should help bridge the gap between basic research and practice to improve quality of care for all Americans.

METHODS

We interviewed over 200 clinicians and other healthcare stakeholders from 2004 through 2005 to develop a conceptual framework and set of strategies for engaging a stable cadre of community clinicians in a clinical research program.

RESULTS

Lack of engagement of community practitioners, lack of necessary infrastructure, and the current misalignment of financial incentives and research participation emerged as the three primary barriers to community clinician research participation. Although every effort was made to learn key motivators for engagement in clinical research from interviewees, we did not observe their behavior and self-report by clinicians does not always track with their behavior.

CONCLUSIONS

A paradigm shift involving acknowledgement of the value of clinicians in the context of community research, establishment of a stable infrastructure to support a cohort of clinicians across time and research studies, and realignment of incentives to encourage participation in clinical research is required.

International Study to Predict Optimized Treatment for Depression (iSPOT-D), a randomized clinical trial: rationale and protocol

Background

Clinically useful treatment moderators of Major Depressive Disorder (MDD) have not yet been identified, though some baseline predictors of treatment outcome have been proposed. The aim of iSPOT-D is to identify pretreatment measures that predict or moderate MDD treatment response or remission to escitalopram, sertraline or venlafaxine; and develop a model that incorporates multiple predictors and moderators.

Methods/Design

The International Study to Predict Optimized Treatment - in Depression (iSPOT-D) is a multi-centre, international, randomized, prospective, open-label trial. It is enrolling 2016 MDD outpatients (ages 18-65) from primary or specialty care practices (672 per treatment arm; 672 age-, sex- and education-matched healthy controls). Study-eligible patients are antidepressant medication (ADM) naïve or willing to undergo a one-week wash-out of any non-protocol ADM, and cannot have had an inadequate response to protocol ADM. Baseline assessments include symptoms; distress; daily function; cognitive performance; electroencephalogram and event-related potentials; heart rate and genetic measures. A subset of these baseline assessments are repeated after eight weeks of treatment. Outcomes include the 17-item Hamilton Rating Scale for Depression (primary) and self-reported depressive symptoms, social functioning, quality of life, emotional regulation, and side-effect burden (secondary). Participants may then enter a naturalistic telephone follow-up at weeks 12, 16, 24 and 52. The first half of the sample will be used to identify potential predictors and moderators, and the second half to replicate and confirm.

Discussion

First enrolment was in December 2008, and is ongoing. iSPOT-D evaluates clinical and biological predictors of treatment response in the largest known sample of MDD collected worldwide.

Trial registration

International Study to Predict Optimised Treatment - in Depression (iSPOT-D) ClinicalTrials.gov Identifier: NCT00693849

URL: http://clinicaltrials.gov/ct2/show/NCT00693849?term=International+Study+to+Predict+Optimized+Treatment+for+Depression&rank=1

Developing partnerships in mental health to bridge the research-practitioner gap

PURPOSE

An overview of approaches used in contemporary mental health research to consider when coordinating research agendas is presented. Connections between the research-practice gap and evidence-based practice are explored. Collaboration, as a key concept and practice, is investigated particularly in relation to community and consumer participation in mental health research.

CONCLUSIONS

Non-commensurate belief systems, inadequate infrastructure, and institutional tendencies maintain the status quo and constitute significant impediments to widespread planned and integrated research programs.

PRACTICE IMPLICATIONS

Communication and trust building between researchers and practitioners is central to developing effective collaborations that can deliver more effective health care.

Looking to the future of research in pediatric anxiety disorders

OBJECTIVE

The rapid emergence of translational developmental neuroscience as the key driver in understanding the onset of mental illness, the restructuring of academic health science centers on the NIH Roadmap, and dramatic shifts in drug, biological, device, and psychosocial intervention development all have important consequences for pediatric anxiety disorders as a field.

METHOD

This article, which tracks the final presentation at a day-long symposium on pediatric anxiety disorders at the 2010 annual meeting of the Anxiety Disorders Association of America (ADAA), will try to outline where the field will head over the next decade as these forces combine to shape research and practice.

RESULTS

After 20 years of large comparative treatment trials that have defined the place of current generation treatments, the field is shifting toward interventions that will emerge from the revolution in translational developmental neuroscience and that herald the dawn of stratified and ultimately personalized medicine. With a much more efficient discovery to translational continuum, intervention development and dissemination will benefit from the concurrent transformation of the clinical and clinical research enterprise.

CONCLUSION

Dramatic advances in science and changes in the structure of medicine will condition the future of clinical research across every therapeutic area in medicine. For the field of pediatric anxiety disorders to thrive it will be important to embrace and actively participate in this revolution so that anxious youth are viewed as a key target population and, consequently, preemptive, preventive, and curative interventions will be developed for children by first intent.

Scientific and organizational collaboration in comparative effectiveness research: the VA cooperative studies program model

Comparative effectiveness research (CER) has the ability to improve health and inform patients, clinicians, and decision makers. However, calls for more devoted efforts with regard to CER have been countered by methodological, resource, and translational challenges related to conducting these studies. The Department of Veterans Affairs (VA) Cooperative Studies Program (CSP) is a clinical research infrastructure that has contributed much evidence to support clinical practice for several decades. Although the CSP does not exclusively focus on CER, it employs strategies that lend themselves toward the planning and execution of studies that seek to compare interventions and/or strategies for treating disease. Consequently, the CSP provides a model for addressing important scientific, structural, and operational factors for clinical research, including large, national and multinational comparative effectiveness studies. Exploration of the difficulties the CSP has encountered can help to elucidate barriers that face CER. This article discusses factors and approaches for collaboratively developing and conducting definitive studies that produce outcomes aimed at influencing clinical practice, lessons that have resulted from such efforts, and ongoing challenges. Future program directions are also presented to highlight areas of emphasis and implications for CER within the VA and nationally.

What have we learned about trial design from NIMH-funded pragmatic trials?

At the 2008 annual meeting of the American College of Neuropsychopharmacology (ACNP), a symposium was devoted to the following question: 'what have we learned about the design of pragmatic clinical trials (PCTs) from the recent costly long-term, large-scale trials of psychiatric treatments?' in order to inform the design of future trials. In all, 10 recommendations were generated placing emphasis on (1) appropriate conduct of pragmatic trials; (2) clinical, rather than, merely statistical significance; (3) sampling from the population clinicians are called upon to treat; (4) clinical outcomes of patients, rather than, on outcome measures; (5) use of stratification, controlling, or adjusting when necessary and not otherwise; (6) appropriate consideration of site differences in multisite studies; (7) encouragement of 'post hoc' exploration to generate (not test) hypotheses; (8) precise articulation of the treatment strategy to be tested and use of the corresponding appropriate design; (9) expanded opportunity for training of researchers and reviewers in RCT principles; and (10) greater emphasis on data sharing.

Design, recruitment and start up of a primary care weight loss trial targeting African American and Hispanic adults

Primary care offices are critical access points for obesity treatment, but evidence for approaches that can be implemented within these settings is limited. The Think Health! (¡Vive Saludable!) Study was designed to assess the feasibility and effectiveness of a behavioral weight loss program, adapted from the Diabetes Prevention Program, for implementation in routine primary care. Recruitment of clinical sites targeted primary care practices serving African American and Hispanic adults. The randomized design compares (a) a moderate-intensity treatment consisting of primary care provider counseling plus additional counseling by an auxiliary staff member (i.e., lifestyle coach), with (b) a low-intensity, control treatment involving primary care provider counseling only. Treatment and follow up duration are 1 to 2 years. The primary outcome is weight change from baseline at 1 and 2 years post-randomization. Between November 2006 and January 2008, 14 primary care providers (13 physicians; 1 physician assistant) were recruited at five clinical sites. Patients were recruited between October 2007 and November 2008. A total of 412 patients were pre-screened, of whom 284 (68.9%) had baseline assessments and 261 were randomized, with the following characteristics: 65% African American; 16% Hispanic American; 84% female; mean (SD) age of 47.2 (11.7) years; mean (SD) BMI of 37.2(6.4) kg/m(2); 43.7% with high blood pressure; and 18.4% with diabetes. This study will provide insights into the potential utility of moderate-intensity lifestyle counseling delivered by motivated primary care clinicians and their staff. The study will have particular relevance to African Americans and women.

Long-term effectiveness of quetiapine in bipolar disorder in a clinical setting

OBJECTIVE

To assess quetiapine effectiveness in bipolar disorder (BD) patients in a clinical setting.

METHODS

We naturalistically administered open quetiapine to outpatients assessed with the Systematic Treatment Enhancement Program for BD (STEP-BD) Affective Disorders Evaluation, and monitored longitudinally with the STEP-BD Clinical Monitoring Form.

RESULTS

96 patients (36 BD I, 50 BD II, 9 BD NOS, 1 Schizoaffective Bipolar Type, mean ± SD age 42.3 ± 13.8 years, 66.7% female) received quetiapine, combined with an average of 2.5 (in 66.7% of patients at least 2) other psychotropic medications and 0.9 non-psychotropic medications, started most often during depressive symptoms (53.1%) or euthymia (37.5%). Mean quetiapine duration and final dose were 385 days and 196 mg/day (50.0% of patients took ≤75 mg/day). Quetiapine was discontinued in 38.5% of trials, after on average 307 days, most often (in 19.8%) due to CNS adverse effects (primarily sedation). In 38.5% of trials quetiapine was continued on average 328 days with no subsequent psychotropic added. In 22.9% quetiapine was continued on average 613 days, but had subsequent psychotropic added after on average 113 days, most often for depressive symptoms. In 67 trials started at Stanford, quetiapine tended to primarily maintain euthymia and relieve depressive symptoms. In 29 trials started prior to Stanford, continuing quetiapine tended to primarily maintain euthymia and relieve mood elevation symptoms. Aside from sedation, quetiapine was generally well tolerated.

CONCLUSIONS

In bipolar disorder outpatients quetiapine had a moderate (38.5%, with 385-day mean duration) discontinuation rate, and commonly did not require subsequent additional pharmacotherapy, suggesting effectiveness in a clinical setting.

Men in methadone maintenance versus psychosocial outpatient treatment: differences in sexual risk behaviors and intervention effectiveness from a multisite HIV prevention intervention trial

The effectiveness of the Real Men Are Safe (REMAS) HIV prevention intervention was examined as a function of treatment program modality. REMAS was associated with significantly larger decreases in unprotected sexual occasions than an HIV education control condition in both treatment modalities. REMAS had superior effectiveness for reducing unprotected sexual occasions in the psychosocial outpatient compared to methadone. At the 6-month follow-up, the adjusted mean change for REMAS completers in psychosocial outpatient (M=6.4, d=0.38) was greater than for REMAS completers in methadone programs (M=2.3, d=0.25). Reasons for why REMAS appears to be especially effective in psychosocial outpatient programs are explored.

Cost-effectiveness analysis of an occupational therapy-led lifestyle approach and routine general practitioner's care for panic disorder

OBJECTIVE

To assess the cost-effectiveness of an occupational therapy-led lifestyle approach to treating panic disorder in primary care compared with routine general practitioner's (GP) care. The burden of mental health disorders is considerable. Cost-effective interventions are necessary to alleviate some of these burdens. Habitual lifestyle behaviours influence mood, although to date mainly single lifestyle factor trials have been conducted to examine the effects on anxiety.

METHODS

An economic evaluation was conducted alongside an unblinded pragmatic randomised controlled trial with assessment at 5 and 10 months. Costs and consequences, as measured by the Beck anxiety inventory (BAI) and quality adjusted life years (QALYs), were compared using incremental cost-effectiveness ratios (ICERs).

RESULTS

The occupational therapy-led lifestyle intervention was more costly than routine GP care at both 5 and 10 months. Significant outcome improvements were evident at 5 months when using the BAI, although these were not maintained at 10 months. Small differences in mean QALYs were found. The estimated ICER was 36 pounds per BAI improvement for 5 months and 39 pounds for 10 months, and 18,905 pounds per QALY gained for 5 months and 8,283 pounds for 10 months.

CONCLUSIONS

If the maximum willingness to pay per additional QALY is 30,000 pounds, then there is an 86% chance that a lifestyle intervention may be considered to be value-for-money over 10 months.

Randomized effectiveness trial of an Internet, pure self-help, cognitive behavioral intervention for depressive symptoms in young adults

This study evaluated an Internet-delivered, cognitive behavioral skills training program versus a treatment-as-usual (TAU) control condition targeting depression symptoms in young adults aged 18 to 24 years. Potential participants were mailed a recruitment brochure; if interested, they accessed the study website to complete an online consent and baseline assessment. Intervention participants could access the website at their own pace and at any time. Reminder postcards were mailed periodically to encourage return use of the intervention. The pure self-help intervention was delivered without contact with a live therapist. The primary depression outcome measure was the Patient Health Questionnaire, administered at 0, 5, 10, 16, and 32 weeks after enrollment. A small but significant between-group effect was found from Week 0 to Week 32 for the entire sample (N = 160, d = .20, 95% confidence interval [CI] 0.00-0.50), with a moderate effect among women (n = 128, d .42, 95%C1 = 0.09-0.77). Greater depression reduction was associated with two measures of lower website usage, total minutes, and total number of page hits. Although intervention effects were modest, they were observed against a background of substantial TAU depression pharmacotherapy and psychosocial services. Highly disseminable, low-cost, and self-help interventions such as this have the potential to deliver a significant public health benefit.

Effectiveness of second-generation antipsychotics: a naturalistic, randomized comparison of olanzapine, quetiapine, risperidone, and ziprasidone

BACKGROUND

No clear recommendations exist regarding which antipsychotic drug should be prescribed first for a patient suffering from psychosis. The primary aims of this naturalistic study were to assess the head-to-head effectiveness of first-line second-generation antipsychotics with regards to time until drug discontinuation, duration of index admission, time until readmission, change of psychopathology scores and tolerability outcomes.

METHODS

Patients >or= 18 years of age admitted to the emergency ward for symptoms of psychosis were consecutively randomized to risperidone (n = 53), olanzapine (n = 52), quetiapine (n = 50), or ziprasidone (n = 58), and followed for up to 2 years.

RESULTS

A total of 213 patients were included, of which 68% were males. The sample represented a diverse population suffering from psychosis. At admittance the mean Positive and Negative Syndrome Scale (PANSS) total score was 74 points and 44% were antipsychotic drug naïve. The primary intention-to-treat analyses revealed no substantial differences between the drugs regarding the times until discontinuation of initial drug, until discharge from index admission, or until readmission. Quetiapine was superior to risperidone and olanzapine in reducing the PANSS total score and the positive subscore. Quetiapine was superior to the other drugs in decreasing the PANSS general psychopathology subscore; in decreasing the Clinical Global Impression - Severity of Illness scale score (CGI-S); and in increasing the Global Assessment of Functioning - Split version, Functions scale score (GAF-F). Ziprasidone was superior to risperidone in decreasing the PANSS positive symptoms subscore and the CGI-S score, and in increasing the GAF-F score. The drugs performed equally with regards to most tolerability outcomes except a higher increase of hip-circumference per day for olanzapine compared to risperidone, and more galactorrhoea for risperidone compared to the other groups.

CONCLUSIONS

Quetiapine appears to be a good starting drug candidate in this sample of patients admitted to hospital for symptoms of psychosis.

TRIAL REGISTRATION

ClinicalTrials.gov ID; URL: http://www.clinicaltrials.gov/: NCT00932529.

Changes in clinical trials methodology over time: a systematic review of six decades of research in psychopharmacology

Background

There have been many changes in clinical trials methodology since the introduction of lithium and the beginning of the modern era of psychopharmacology in 1949. The nature and importance of these changes have not been fully addressed to date. As methodological flaws in trials can lead to false-negative or false-positive results, the objective of our study was to evaluate the impact of methodological changes in psychopharmacology clinical research over the past 60 years.

Methodology/Principal Findings

We performed a systematic review from 1949 to 2009 on MEDLINE and Web of Science electronic databases, and a hand search of high impact journals on studies of seven major drugs (chlorpromazine, clozapine, risperidone, lithium, fluoxetine and lamotrigine). All controlled studies published 100 months after the first trial were included. Ninety-one studies met our inclusion criteria. We analyzed the major changes in abstract reporting, study design, participants' assessment and enrollment, methodology and statistical analysis. Our results showed that the methodology of psychiatric clinical trials changed substantially, with quality gains in abstract reporting, results reporting, and statistical methodology. Recent trials use more informed consent, periods of washout, intention-to-treat approach and parametric tests. Placebo use remains high and unchanged over time.

Conclusions/Significance

Clinical trial quality of psychopharmacological studies has changed significantly in most of the aspects we analyzed. There was significant improvement in quality reporting and internal validity. These changes have increased study efficiency; however, there is room for improvement in some aspects such as rating scales, diagnostic criteria and better trial reporting. Therefore, despite the advancements observed, there are still several areas that can be improved in psychopharmacology clinical trials.

Appraising evidence for intervention effectiveness in early psychosis: conceptual framework and review of evaluation approaches

The literature that is relevant to evaluation of treatment effectiveness is large, scattered and difficult to assemble for appraisal. This scoping review first develops a conceptual framework to help organize the field, and second, uses the framework to appraise early psychosis intervention (EPI) studies. Literature searches were used to identify representative study designs, which were then sorted according to evaluation approach. The groupings provided a conceptual framework upon which a map of the field could be drawn. Key words were cross-checked against definitions in dictionaries of scientific terms and the National Library of Medicine Medical Subject Headings (MeSH) browser. Using the final list of key words as search terms, the EPI evaluation literature was appraised. Experimental studies could be grouped into two classes: efficacy and effectiveness randomized controlled trials. Non-experimental studies could be subgrouped into at least four overlapping categories: clinical epidemiological; health service evaluations; quality assurance studies; and, quasi-experimental assessments of treatment effects. Applying this framework to appraise EPI studies indicated promising evidence for the effectiveness of EPI irrespective of study design type, and a clearer picture of where future evaluation efforts should be focused. Reliance on clinical trials alone will restrict the type of information that can inform clinical practice. There is convergent evidence for the benefits of specialized EPI service functions across a range of study designs. Greater investment in health services research and quality assurance approaches in evaluating EPI effectiveness should be made, which will involve scaling up of study sizes and development of an EPI programme fidelity rating template. The degree of complexity of the evaluation field suggests that greater focus on research methodology in the training of Australasian psychiatrists is urgently needed.

Reducing sex under the influence of drugs or alcohol for patients in substance abuse treatment

AIMS

In a previous report, the effectiveness of the Real Men Are Safe (REMAS) intervention in reducing the number of unprotected sexual occasions among male drug abuse treatment patients was demonstrated. A secondary aim of REMAS was to reduce the frequency with which men engage in sex under the influence (SUI) of drugs or alcohol.

DESIGN

Men in methadone maintenance (n = 173) or out-patient psychosocial treatment (n = 104) completed assessments at baseline, 3 and 6 months post-intervention.

PARTICIPANTS

The participants were assigned randomly to attend either REMAS (five sessions containing information, motivational exercises and skills training, including one session specifically targeting reducing SUI) or human immunodeficiency virus (HIV) education (HIV-Ed; one session containing HIV prevention information). SUI during the most recent sexual event served as the primary outcome in a repeated measures logistic regression model.

FINDINGS

Men assigned to the REMAS condition reporting SUI at the most recent sexual event decreased from 36.8% at baseline to 25.7% at 3 months compared to a increase from 36.9% to 38.3% in the HIV-Ed condition (t(intervention) = -2.16, P = 0.032). No difference between the treatment groups was evident at 6-month follow-up. At each assessment time-point, sex with a casual partner versus a regular partner, and being in methadone maintenance versus psychosocial out-patient treatment, were associated with engaging in SUI.

CONCLUSIONS

Overall, a motivational and skills training HIV prevention intervention designed for men was associated with greater reduction in SUI than standard HIV education at the 3-month follow-up.

Motivational and skills training HIV/sexually transmitted infection sexual risk reduction groups for men

The effectiveness of a motivational and skills training HIV/AIDS group intervention designed for men in substance abuse treatment was evaluated. Men in methadone maintenance (n = 288) or outpatient psychosocial treatment (n = 302) completed assessments at baseline, 2 weeks, 3 months, and 6 months postintervention. Participants were randomly assigned to attend either Real Men Are Safe (REMAS; five sessions containing information, motivational exercises, and skills training) or HIV education (HIV-Ed; one session containing HIV prevention information). REMAS participants engaged in significantly fewer unprotected vaginal and anal sexual intercourse occasions (USO) during the 90 days prior to the 3- and 6-month follow-ups than HIV-Ed participants. Completing REMAS resulted in an even stronger effect: Completers reduced their number of USO by 21% from baseline to 6-month follow-up. In contrast, HIV-Ed completers increased the number of USO by 2%. A motivational and skills training HIV prevention intervention designed for men was associated with greater sexual risk reduction over standard HIV-Ed. Substance abuse treatment programs can therefore help reduce sexual risk among their clientele by providing a more intensive intervention than what is traditionally provided.

A practical clinical trial of coordinated care management to treat substance use disorders among public assistance beneficiaries

This study tested whether coordinated care management (CCM), a continuity of care intervention for substance use disorders (SUD), improved rates of abstinence when compared with usual welfare management for substance-using single adults and adults with dependent children applying for public assistance. The study was designed as a practical clinical trial and was implemented in partnership with a large city welfare agency. Participants were 421 welfare applicants identified via SUD screening and assigned via an unbiased computerized allocation program to a site that provided either CCM (n = 232) or usual care (UC; n = 189). Outcomes were assessed for 1 year postbaseline with self-reports and biological measures of substance use. As hypothesized, for participants not enrolled in methadone maintenance programs (n = 313), CCM clients received significantly more services than did UC clients. Nonmethadone CCM also showed significantly higher abstinence rates (odds ratio = 1.75; 95% confidence interval = 1.12, 2.76; d = 0.31) that emerged early in treatment and were sustained throughout follow-up. In contrast, no treatment services or outcome effects were found for methadone maintenance clients (n = 108). Findings suggest that CCM is promising as a wraparound to SUD treatment for welfare recipients.

Rationale and design of an independent randomised controlled trial evaluating the effectiveness of aripiprazole or haloperidol in combination with clozapine for treatment-resistant schizophrenia

BACKGROUND

One third to two thirds of people with schizophrenia have persistent psychotic symptoms despite clozapine treatment. Under real-world circumstances, the need to provide effective therapeutic interventions to patients who do not have an optimal response to clozapine has been cited as the most common reason for simultaneously prescribing a second antipsychotic drug in combination treatment strategies. In a clinical area where the pressing need of providing therapeutic answers has progressively increased the occurrence of antipsychotic polypharmacy, despite the lack of robust evidence of its efficacy, we sought to implement a pre-planned protocol where two alternative therapeutic answers are systematically provided and evaluated within the context of a pragmatic, multicentre, independent randomised study.

METHODS/DESIGN

The principal clinical question to be answered by the present project is the relative efficacy and tolerability of combination treatment with clozapine plus aripiprazole compared with combination treatment with clozapine plus haloperidol in patients with an incomplete response to treatment with clozapine over an appropriate period of time. This project is a prospective, multicentre, randomized, parallel-group, superiority trial that follow patients over a period of 12 months. Withdrawal from allocated treatment within 3 months is the primary outcome.

DISCUSSION

The implementation of the protocol presented here shows that it is possible to create a network of community psychiatric services that accept the idea of using their everyday clinical practice to produce randomised knowledge. The employed pragmatic attitude allowed to randomly allocate more than 100 individuals, which means that this study is the largest antipsychotic combination trial conducted so far in Western countries. We expect that the current project, by generating evidence on whether it is clinically useful to combine clozapine with aripiprazole rather than with haloperidol, provides physicians with a solid evidence base to be directly applied in the routine care of patients with schizophrenia.

Family-based treatment for adolescent substance abuse: controlled trials and new horizons in services research

This article provides an overview of controlled trials research on treatment processes and outcomes in family-based approaches for adolescent substance abuse. Outcome research on engagement and retention in therapy, clinical impacts in multiple domains of adolescent and family functioning, and durability and moderators of treatment effects is reviewed. Treatment process research on therapeutic alliance, treatment fidelity and core family therapy techniques, and change in family processes is described. Several important research issues are presented for the next generation of family-based treatment studies focusing on delivery of evidence-based treatments in routine practice settings.

The child and adolescent psychiatry trials network (CAPTN): infrastructure development and lessons learned

BACKGROUND

In 2003, the National Institute of Mental Health funded the Child and Adolescent Psychiatry Trials Network (CAPTN) under the Advanced Center for Services and Intervention Research (ACSIR) mechanism. At the time, CAPTN was believed to be both a highly innovative undertaking and a highly speculative one. One reviewer even suggested that CAPTN was "unlikely to succeed, but would be a valuable learning experience for the field."

OBJECTIVE

To describe valuable lessons learned in building a clinical research network in pediatric psychiatry, including innovations intended to decrease barriers to research participation.

METHODS

The CAPTN Team has completed construction of the CAPTN network infrastructure, conducted a large, multi-center psychometric study of a novel adverse event reporting tool, and initiated a large antidepressant safety registry and linked pharmacogenomic study focused on severe adverse events. Specific challenges overcome included establishing structures for network organization and governance; recruiting over 150 active CAPTN participants and 15 child psychiatry training programs; developing and implementing procedures for site contracts, regulatory compliance, indemnification and malpractice coverage, human subjects protection training and IRB approval; and constructing an innovative electronic casa report form (eCRF) running on a web-based electronic data capture system; and, finally, establishing procedures for audit trail oversight requirements put forward by, among others, the Food and Drug Administration (FDA).

CONCLUSION

Given stable funding for network construction and maintenance, our experience demonstrates that judicious use of web-based technologies for profiling investigators, investigator training, and capturing clinical trials data, when coupled to innovative approaches to network governance, data management and site management, can reduce the costs and burden and improve the feasibility of incorporating clinical research into routine clinical practice. Having successfully achieved its initial aim of constructing a network infrastructure, CAPTN is now a capable platform for large safety registries, pharmacogenetic studies, and randomized practical clinical trials in pediatric psychiatry.

Escitalopram in the treatment of major depressive disorder in primary-care settings: an open-label trial

BACKGROUND

The present trial was designed to assess the efficacy and safety of escitalopram prescribed to patients seeking treatment of major depressive disorder (MDD) in a Canadian primary-care setting.

METHODS

Investigators (mainly primary-care physicians) enrolled patients with MDD from their daily practice. Patients were treated with escitalopram (flexible dose 10-20 mg/day) for up to 24 weeks. Efficacy assessments included the Montgomery-Asberg Depression Rating Scale (MADRS), the Clinical Global Impression-Improvement and -Severity scales (CGI-I, CGI-S), the Patient Global Evaluation (PGE), and the Medical Outcome Study 36-item Short Form (SF-36).

RESULTS

Out of the 647 patients enrolled, 461 (71%) completed 24 weeks of treatment. The most common reason for discontinuation was adverse events (10%). The mean MADRS score decreased from 30.7 at baseline to 10.9 at the end of 24 weeks (last observation carried forward, LOCF). Remission (MADRS<or=12) was achieved by 65.5% of patients (LOCF). Symptom improvements were confirmed by global ratings of improvement made by physicians (CGI-I) as well as patients PGE. There was improvement on all dimensions of the SF-36, suggesting an overall improvement in quality of life.

CONCLUSIONS

Escitalopram was well tolerated, safe, and efficacious. Escitalopram can be used with confidence to treat patients with MDD in Canadian primary-care settings.

Differential efficacy of escitalopram and nortriptyline on dimensional measures of depression

BACKGROUND

Tricyclic antidepressants and serotonin reuptake inhibitors are considered to be equally effective, but differences may have been obscured by internally inconsistent measurement scales and inefficient statistical analyses.

AIMS

To test the hypothesis that escitalopram and nortriptyline differ in their effects on observed mood, cognitive and neurovegetative symptoms of depression.

METHOD

In a multicentre part-randomised open-label design (the Genome Based Therapeutic Drugs for Depression (GENDEP) study) 811 adults with moderate to severe unipolar depression were allocated to flexible dosage escitalopram or nortriptyline for 12 weeks. The weekly Montgomery-Asberg Depression Rating Scale, Hamilton Rating Scale for Depression, and Beck Depression Inventory were scored both conventionally and in a more novel way according to dimensions of observed mood, cognitive symptoms and neurovegetative symptoms.

RESULTS

Mixed-effect linear regression showed no difference between escitalopram and nortriptyline on the three original scales, but symptom dimensions revealed drug-specific advantages. Observed mood and cognitive symptoms improved more with escitalopram than with nortriptyline. Neurovegetative symptoms improved more with nortriptyline than with escitalopram.

CONCLUSIONS

The three symptom dimensions provided sensitive descriptors of differential antidepressant response and enabled identification of drug-specific effects.

The future of psychotherapy for mentally ill children and adolescents

OBJECTIVE

Given striking advances in translational developmental neuroscience and its convergence with developmental psychopathology and developmental epidemiology, it is now clear that mental illnesses are best thought of as neurodevelopmental disorders. This simple fact has enormous implications for the nature and organization of psychotherapy for mentally ill children, adolescents and adults.

METHOD

This article reviews the 'trajectory' of psychosocial interventions in pediatric psychiatry, and makes some general predictions about where this field is heading over the next several decades.

RESULTS

Driven largely by scientific advances in molecular, cellular and systems neuroscience, psychotherapy in the future will focus less on personal narratives and more on the developing brain. In place of disorders as intervention targets, modularized psychosocial treatment components derived from current cognitive-behavior therapies will target corresponding central nervous system (CNS) information processes and their functional behavioral consequences. Either preventive or rehabilitative, the goal of psychotherapy will be to promote development along typical developmental trajectories. In place of guilds, psychotherapy will be organized professionally much as physical therapy is organized today. As with other forms of increasingly personalized health care, internet-based delivery of psychotherapy will become commonplace.

CONCLUSION

Informed by the new field of translational developmental neuroscience, psychotherapy in the future will take aim at the developing brain in a service delivery model that closely resembles the place and role of psychosocial interventions in the rest of medicine. Getting there will be, as they say, interesting.

Methodological Innovation to Increase the Utility and Efficiency of Psychotherapy Research for Patients with Co-occurring Mental Health and Substance Use Disorders

Psychotherapy research with chronic and difficult-to-treat populations such as those with co-occurring mental health and addictive disorders can employ flexible research designs, which allow for a systematic, yet non-linear relationship between efficacy and effectiveness designs. Outcomes research can bypass the efficacy-effectiveness dichotomy through use of a hybrid model (Carroll & Rounsaville, 2003) conducted in the context of community treatment settings in collaboration with community providers. We present the case for using this methodological approach as a means of advancing psychotherapy research and practice, while translating and disseminating empirically supported treatments with more efficiency. A hybrid model study conducted within the National Institute on Drug Abuse's Clinical Trials Network illustrates the application. These findings inform new directions for future research.

Bridging bench and practice: translational research for schizophrenia and other psychotic disorders

Translational research is urgently needed to turn basic scientific discoveries into widespread health gains and nowhere are these needs greater than in conditions such as schizophrenia and other psychotic disorders. In this article, we discuss one type of translational research--called T1--which is needed to take advantage of developments in the basic neurosciences and translate them into more efficacious diagnostic, preventive, and therapeutic interventions. However, ensuring that interventions from T1 research actually benefit patients will require a second form of translational research--called T2--to turn innovations into everyday clinical practice and health decision-making. Recent examples of T1 and T2 research in schizophrenia and other psychotic disorders as well as strategies for better linking T1 and T2 research agendas are covered.

Recent developments and strategies in pediatric pharmacology research in the USA

Research in pediatric pharmacology has undergone major changes in the last ten years, with an expansion in both publicly and privately funded activities. A number of pharmacokinetics studies and multi-site controlled efficacy trials have been conducted, so that treatment of children and adolescents can now be better informed and evidence-based. Regulatory financial incentives to industry in return for studies on drugs still covered by patent exclusivity have resulted in a substantial increase in pediatric research funded by pharmaceutical companies. In parallel, public funding has supported research on off-patent medications and other clinical important aspects of treatment, such as comparisons between active treatments, including non-pharmacological interventions. With greater interest by industry in pediatric research, the role of government funding agencies has been redefined to avoid duplication and ensure better integration of efforts and utilization of resources. The present review discusses some of the recent developments in pediatric pharmacology with focus on psychiatric medications.

Understanding antipsychotic non-classical prescriptions: a quantitative and qualitative approach

AIMS

To date only a few studies investigated the clinical reasons supporting and explaining non-classical antipsychotic prescriptions. The present study was carried out to develop concepts which help understand this phenomenon in a natural setting, giving emphasis to views of clinicians according to quali - quantitative research methodologies.

SUBJECTS

From the South-Verona Psychiatric Case Register all antipsychotic prescriptions issued during 2005 were extracted. Concurrent prescribing of two or more antipsychotics, prescribing antipsychotic drugs outside the licensed indications, and outside the licensed ranges of doses reported in the Italian National Formulary, were considered non-classical prescriptions. Reasons for non-classical prescriptions were collected by means of brainstorming sessions with clinicians. Non-classical prescriptions and the corresponding reasons were grouped according to whether they were "clinically sound" or "clinically not sound".

RESULTS

During 2005 a total of 259 patients received 376 non-classical prescriptions. The most frequently reported reasons for non-classical prescribing were that prescriptions were inherited from another clinician with or without benefit, and that prescriptions were motivated by the need of reducing psychotic symptoms. More than 60% of these non-classical prescriptions were categorised as "clinically sound". Clinically not sound prescriptions were related with negative clinicians' views and opinions about the patient/clinician relationship.

CONCLUSION

Clinically not sound prescriptions appeared just a reflection of a problematic doctor/patient relationship, where no individual treatment plan existed and psychiatric visits had the only goal of monitoring ongoing prescriptions.

Effectiveness of lamotrigine in bipolar disorder in a clinical setting

OBJECTIVE

To assess lamotrigine effectiveness in bipolar disorder (BD) patients in a clinical setting.

METHOD

Open lamotrigine was naturalistically administered to outpatients at the Stanford University BD Clinic assessed with the Systematic Treatment Enhancement Program for BD (STEP-BD) Affective Disorders Evaluation, and monitored longitudinally with the STEP-BD Clinical Monitoring Form.

RESULTS

One hundred and ninety-seven patients (64 BD I, 110 BD II, 21 BD NOS, 2 Schizoaffective Bipolar Type, mean+/-SD age 42.2+/-14.4 years, 62% female) had 200 trials of lamotrigine. Lamotrigine was combined with a mean of 2.1+/-1.5 other psychotropic medications, most often during euthymia or depressive symptoms. Mean lamotrigine duration was 434+/-444 days, and mean final dose was 236+/-132mg/day without valproate, and 169+/-137mg/day with valproate. Lamotrigine was discontinued in only 26.5% of trials at 255+/-242 days, most often due to inefficacy, and seldom due to adverse effects. In 31.5% of trials lamotrigine was continued 264+/-375 days with no subsequent psychotropic added. In 42.0% of trials lamotrigine was continued 674+/-479 days, but had subsequent psychotropic added at 146+/-150 days, most often for anxiety/insomnia and depressive symptoms. In 145 trials started at Stanford, lamotrigine primarily yielded relief of depressive symptoms or maintained euthymia. In 55 trials in which lamotrigine was started prior to Stanford, lamotrigine primarily maintained euthymia. Lamotrigine was generally well tolerated, with no serious rash, and only 3.5% discontinuing due to benign rash.

CONCLUSION

In a cohort of bipolar disorder outpatients commonly with comorbid conditions, and most often receiving complex combination therapy, lamotrigine had a low (26.5%, with an overall mean duration of treatment of 434 days) discontinuation rate, suggesting effectiveness in BD in a clinical setting.

Adverse events in children and adolescents treated with antipsychotic medications

OBJECTIVE

To report the odds of developing adverse events associated with antipsychotic treatment among children and adolescents.

METHOD

A retrospective cohort design evaluating medical and pharmacy claims from one state Medicaid program was used to compare incidence rates for six categories of adverse events of antipsychotic use in 4140 children and adolescents newly prescribed one of six atypical or two conventional antipsychotic medications, January, 1998 to December, 2005 with prevalence rates of these conditions in a random sample of 4500 children not treated with psychotropic medications.

RESULTS

The odds of developing obesity/excessive weight gain, Type II diabetes and dyslipidemia, digestive/urogenital problems, and neurological/sensory symptoms were higher for females and those prescribed multiple antipsychotic medications. The odds of developing cardiovascular conditions were higher for those prescribed multiple antipsychotic medications and haloperidol. The odds of developing somatic conditions were higher for females, children 12 and under, and those prescribed multiple antipsychotics. Those with lengthy exposure to antipsychotics were at higher risk of developing incident neurological/sensory symptoms. Those treated with concomitant antipsychotic agents were at higher risk of developing somatic problems, and digestive/urogenital conditions.

CONCLUSION

Pediatric exposure to antipsychotic polypharmacotherapy confers a higher risk of developing adverse events than monotherapy, especially for females.

Evidence-based practice in psychiatric care: defining levels of evidence

Identification and application of the current research evidence to a clinical problem is a goal reflected in professional codes and institutional mission statements. The use of expert opinions and traditions is no longer clinically or legally defensible in an era of using emerging evidence. Application of current research evidence is the emerging standard of care for all health care personnel, including psychiatric mental health care. The emergence of evidence-based practice as the new standard of care obliges all health care providers to use the latest research evidence. The need to make an intervention based on the highest level of evidence mandates that clinicians understand levels of research evidence and how the different classification systems of evidence compare. In this article, the levels of research evidence are reviewed to provide a framework for determining the best evidence to use as a basis for clinical interventions. J Am Psychiatr Nurses Assoc, 2008; 14(3), 181-187. DOI: 10.1177/1078390308321220.

[Therapeutic alliance, a stake in schizophrenia]

INTRODUCTION

Adherence to (or compliance with) a medication is one of the foremost issues in the assumption of patients with psychiatric illness and, in particular, in schizophrenia. Adherence to medication is generally defined as the extent to which patients take medications as prescribed by their health care providers. There is no consensus to define an acceptable compliance.

LITERATURE FINDINGS

The methods available for measuring adherence can be broken down into direct and indirect methods of measurement, each one having advantages and disadvantages. Clinical summations of studies were realized, the problem of poor adherence to medication concerned 25% of patients with schizophrenia and 74% of the 1493 schizophrenia patients recruited for the Catie study discontinued their assigned study medication before 18 months, a rate that was considered to be very high in a study in which the primary outcome measure was discontinuation of the study drug for any cause and approximately 30% stopped the treatment of their own motivation. In two thirds of cases, rehospitalisation is the result of complete or partial non-compliance. One year after first hospitalsation, 40% of relapse results from non-adherence to medication.

DISCUSSION

Medication adherence problems increase hospitalisation, morbidity and mortality. Social consequences, professional and family problems linked to hospitalisations lead to low quality of life for patients and high cost for society. Indicators of poor adherence to a medication regimen are a useful resource for physicians to help identify patients who are most in need of interventions to improve adherence. It is usual to identify quatre categories of factors causing disparity: 1: factors due to psychiatric disorders; 2: factors due to medication; 3: factors linked to patients; 4: factors depending on the therapeutic relationship with the clinician. Patients with psychiatric illness typically have great difficulty following a medication regimen, but they also have the greatest potential for benefiting from adherence. Some effective actions to improve compliance are described in reply to the factors influencing the adherence. The communication attitude of the clinician, therapeutic relationship and prescription use are main points of alliance. Information and communication with the patient, simplification of the therapeutic plan, consultation planning and account of side effect are simple and effective actions. Social support is very important for improvement of therapeutic alliance. Poor therapeutic alliance is common, contributing to substantial worsening of disease and more research on compliance and therapeutic alliance evaluation is needed. Information and tools must be proposed to practitioners.

Challenges in the design and conduct of a randomized study of two interventions for liquid aspiration

BACKGROUND

Liquid aspiration during swallowing has been linked to pneumonia, the most common cause of infectious death in the elderly. This paper examines the key issues in the design and implementation of the first multisite, randomized behavioral trial in dysphagia in an aging population. The study evaluated two commonly used treatments with respect to short-term and long-term management of liquid aspiration and subsequent pneumonia in dysphagic geriatric participants with dementia and/or Parkinson's disease.

METHODS

Discussed are lessons learned during the conduct of this trial and include (1) ethical and methodological design issues, (2) pragmatic implementation of procedures and forms, (3) importance of multiple communication and monitoring strategies, (4) response to funding issues, and (5) changes in staff and facilities.

RESULTS

In order to complete this trial the researchers were required to provide more support than anticipated in tasks such as completion of regulatory requirements by sites, supplementing site staff to identify potential study participants using a 'circuit rider' approach, continued recruitment of new sites and staff throughout the course of the trial, adapting forms and procedures and managing within economic constraints in a changing trial environment.

LIMITATIONS

Many of the challenges faced by the researchers were not anticipated when the study began. Successful strategies are described for these unanticipated difficulties, based on retrospective evaluation.

CONCLUSIONS

Successful conduct of clinical trials in long-term care environments that are heavily impacted by changes extraneous to the trial design and with staff typically new to clinical trials is possible but success depends on logistical flexibility.

Effectiveness of paroxetine in the treatment of acute major depression in adults: a systematic re-examination of published and unpublished data from randomized trials

BACKGROUND

Concern has been raised about the efficacy of antidepressant therapy for major depression in adults. We undertook a systematic review of published and unpublished clinical trial data to determine the effectiveness and acceptability of paroxetine.

METHODS

We searched the Cochrane Collaboration Depression, Anxiety and Neurosis Controlled Trials Register, the Cochrane Central Register of Controlled Trials, the GlaxoSmithKline Clinical Trial Register, MEDLINE and EMBASE up to December 2006. Published and unpublished randomized trials comparing paroxetine with placebo in adults with major depression were eligible for inclusion. We selected the proportion of patients who left a study early for any reason as the primary outcome measure because it represents a hard measure of treatment effectiveness and acceptability.

RESULTS

We included in our review 29 published and 11 unpublished clinical trials, with a total of 3704 patients who received paroxetine and 2687 who received with placebo. There was no difference between paroxetine and placebo in terms of the proportion of patients who left the study early for any reason (random effect relative risk [RR] 0.99, 99% confidence interval [CI] 0.88-1.11). Paroxetine was more effective than placebo, with fewer patients who did not experience improvement in symptoms of at least 50% (random effect RR 0.83, 99% CI 0.77-0.90). Significantly more patients in the paroxetine group than in the placebo group left their respective studies because of side effects (random effect RR 1.77, 95% CI 1.44-2.18) or experienced suicidal tendencies (odds ratio 2.55, 95% CI 1.17-5.54).

INTERPRETATION

Among adults with moderate to severe major depression in the clinical trials we reviewed, paroxetine was not superior to placebo in terms of overall treatment effectiveness and acceptability. These results were not biased by selective inclusion of published studies.

Randomized controlled trials for schizophrenia: study designs targeted to distinct goals

Randomized controlled trials for antipsychotic drugs have a variety of design features suited to diverse purposes. Efficacy (or explanatory) trials seek to establish if a drug can reduce psychotic symptoms under ideal circumstances. To isolate drug effects, researchers enroll carefully selected patients. Specialized research personnel use rating scales of symptoms that are sensitive to drug effects as the study primary outcomes. Large simple trials (LSTs) are conducted at typical treatment settings with usual clinical personnel and enroll large numbers of participants so small but clinically important differences between treatment options can be detected. LSTs focus narrowly on clearly defined, patient-oriented outcomes. To some extent, practical trials can be conceptualized as hybrids of efficacy and large simple trials. Practical trials provide independent evidence to inform decision makers about the everyday effectiveness of clinically relevant alternative interventions. Practical trial researchers include a heterogeneous population of patients and collect data on a broad range of meaningful health outcomes at many types of practice settings intended to represent usual treatment. The designers of practical trials make trade-offs between internal validity, external validity, the breadth of issues addressed, and the ability to detect small differences. The different objectives of trials should be considered in the interpretation of the complete body of randomized evidence on antipsychotic drugs.

Is NICE infallible? A qualitative study of its assessment of treatments for attention-deficit/hyperactivity disorder (ADHD)

BACKGROUND

Conclusions of the recent NICE technology appraisal of treatments for attention-deficit/hyperactivity disorder (ADHD) differ from recommendations by other Health Technology Assessment (HTA) agencies, such as the Scottish Medicines Consortium (CMS) and the Australian Pharmaceutical Benefits Advisory Committee (PBAC). NICE did not identify differences on grounds of clinical effectiveness between treatment options studied and issued technology guidance based on clinical profiles of compounds and on drug acquisition costs. The aim of the present study was to explore the robustness of NICE assessment methods when addressing a complex clinical problem such as the evaluation of ADHD treatment strategies. This robustness will be of interest to international policy-makers, given the widespread perception of NICE as a role model for the implementation of HTAs including economic evaluation.

METHODS

A qualitative case study was performed to critically appraise the technology assessment report (AR) underlying NICE conclusions, including a systematic search for and analysis of relevant literature.

RESULTS

The AR produced on behalf of NICE was found to exhibit a range of anomalies. Search criteria were not applied consistently, and the available clinical evidence was not used optimally; selection of clinical endpoints and clinical trials for analysis were idiosyncratic. The primary cost-effectiveness model relied on six short-term studies only, and secondary extensions combined heterogeneous study designs and different clinical endpoints. Neither the distinction between efficacy and effectiveness nor the role of treatment compliance in ADHD was addressed adequately. Long-term extensions of the model were impaired by use of inappropriate discount rates and absence of consideration of long-term sequelae associated with ADHD.

CONCLUSION

A review of the literature strongly suggests that the NICE assessment of ADHD treatment strategies was incomplete and likely prone to bias. It is concluded that NICE did not adequately accommodate a complex clinical decision problem. Although the present qualitative case study of one assessment cannot, and was not designed to, invalidate the NICE approach to economic evaluation of healthcare programs, this observation may have potentially far-reaching implications for the generalizability of NICE-like approaches.

The NICE ADHD health technology assessment: a review and critique

BACKGROUND

Health technology assessments (HTAs) by the National Institute for Health and Clinical Excellence (NICE) enjoy high levels of international attention. The present analysis addresses NICE's appraisal of methylphenidate, atomoxetine and dexamphetamine for attention-deficit/hyperactivity disorder (ADHD) in children and adolescents, published in March 2006.

METHODS

A qualitative study of NICE Technology Appraisal No. 98 was done focusing on the >600-page technology assessment report, which aimed at evaluating ADHD treatment strategies by a clinical effectiveness review and an economic analysis using meta-analytical techniques and a cost-effectiveness model.

RESULTS

The technology assessment was unable to differentiate between the various drugs in terms of efficacy, and its economic model was ultimately driven by cost differences. While the assessment concluded that the economic model "clearly identified an optimal treatment strategy" with first-line dexamphetamine, the NICE appraisal committee subsequently found it impossible to distinguish between the different strategies on grounds of cost-effectiveness. Analyzing the assessment reveals gaps and inconsistencies concerning data selection (ultimately relying on a small number of short-term studies only), data synthesis (pooling of heterogeneous study designs and clinical endpoints), and economic model structure (identifying double-counting of nonresponders as a likely source of bias, alongside further methodological anomalies).

CONCLUSION

Many conclusions of the NICE technology assessment rest on shaky grounds. There remains a need for a new, state-of-the-art systematic review of ADHD treatment strategies including economic evaluation, which ideally should address outcomes beyond children's health-related quality of life, such as long-term sequelae of the disorder and caregiver burden.