1
|
Narayan AJ, Hayley AC, Rose S, Di Natale L, Downey LA. The effect of nightly use of 150 mg cannabidiol on daytime neurocognitive performance in primary insomnia: a randomized controlled pilot trial. Psychopharmacology (Berl) 2024:10.1007/s00213-024-06674-x. [PMID: 39153080 DOI: 10.1007/s00213-024-06674-x] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 03/14/2024] [Accepted: 08/09/2024] [Indexed: 08/19/2024]
Abstract
RATIONALE Cannabidiol (CBD) is increasingly used as a sleep aid for insomnia; yet neurocognitive and subjective state effects following daily therapeutic use are unclear. OBJECTIVES To measure the effect of daily CBD use on neurocognitive performance and daily subjective mood in a population with primary insomnia. METHODS This study used a randomized, placebo-controlled, parallel design incorporating a single-blind placebo run-in week followed by a two-week double-blind dosing period, during which participants consumed 150 mg CBD (N = 15) or placebo (N = 15) sublingually 60-minutes daily before bed. Attention, executive function, reasoning, information processing, working and episodic memory were assessed using the CogPro system at the beginning of the placebo run-in, after 1-week and 2-weeks of dosing. Subjective states using visual analogue scales and side effects were recorded daily. RESULTS Cognitive performance was unaffected by nightly CBD supplementation (all p > 0.05). From baseline to trial conclusion, those receiving CBD reported greater experience of calmness, clear-headedness, coordination and were more likely to report side-effects of dry mouth relative to placebo (all p < 0.05). CONCLUSIONS Relative to placebo, daytime cognitive functioning following nightly supplementation as a therapeutic aid for primary insomnia was preserved under trial conditions. Results suggested an overall favourable safety profile, with larger controlled trials and thorough analyses of varying insomnia phenotypes necessary to corroborate these findings.
Collapse
Affiliation(s)
- Andrea J Narayan
- Centre for Mental Health & Brain Sciences, Swinburne University of Technology, Hawthorn, 3122, Australia
| | - Amie C Hayley
- Centre for Mental Health & Brain Sciences, Swinburne University of Technology, Hawthorn, 3122, Australia.
- Institute for Breathing and Sleep, Austin Hospital, Melbourne, Australia.
| | - Sarah Rose
- Centre for Mental Health & Brain Sciences, Swinburne University of Technology, Hawthorn, 3122, Australia
| | - Lauren Di Natale
- Centre for Mental Health & Brain Sciences, Swinburne University of Technology, Hawthorn, 3122, Australia
| | - Luke A Downey
- Centre for Mental Health & Brain Sciences, Swinburne University of Technology, Hawthorn, 3122, Australia
- Institute for Breathing and Sleep, Austin Hospital, Melbourne, Australia
| |
Collapse
|
2
|
Fava M. How should we design future mechanistic and/or efficacy clinical trials? Neuropsychopharmacology 2024; 49:197-204. [PMID: 37237086 PMCID: PMC10700333 DOI: 10.1038/s41386-023-01600-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 02/28/2023] [Revised: 04/10/2023] [Accepted: 04/24/2023] [Indexed: 05/28/2023]
Abstract
The emergence of new molecular targets, together with the development of new approaches to neuropsychiatric diseases, involving psychedelics as well as gene and cell therapies, are creating the need to improve the efficiency of mechanistic and/or efficacy clinical trials. This review article will discuss a number of issues that have hampered our ability to detect therapeutic signals, from excessive placebo/sham response rates to the imprecision of diagnostic and outcome assessments. In addition to reviewing the limitations of current efficacy and mechanistic neuropsychiatric clinical trials, this review presents some of the methodological approaches that may improve the overall performance of our neuropsychiatric trials, including the adoption of novel study designs such as the sequential parallel comparison design and independent confirmation of the appropriateness of subjects' enrollment. In addition, this review will discuss several designs that make mechanistic clinical trials more precise.
Collapse
Affiliation(s)
- Maurizio Fava
- Department of Psychiatry, Massachusetts General Hospital, Boston, MA, USA.
| |
Collapse
|
3
|
Homma G, Daimon T. Usefulness of the placebo lead-in design for clinical trials with binary outcomes. Clin Trials 2023; 20:145-152. [PMID: 36627841 DOI: 10.1177/17407745221140048] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/12/2023]
Abstract
BACKGROUND In placebo-controlled clinical trials to develop new drugs for the treatment of psychiatric or neurological disorders, a high and sometimes greater-than-expected placebo response makes it difficult to show the superiority of an investigational drug over a corresponding placebo. To avoid such difficulty, a placebo lead-in design has been presented, but its usefulness has been open to discussion. Although the statistical properties of the placebo lead-in design are investigated in the context of continuous outcomes, whether these properties can be generalized for binary or ordinal cases remains unclear. METHODS We investigate whether the placebo lead-in design is useful in clinical trials with binary outcomes through mathematical formulae and a numerical investigation. Specifically, we compare the proportion of placebo responders, the drug-placebo difference, and the effect size between two populations: one enriched for placebo nonresponders and the other comprising the all-comers. RESULTS Under positive correlation of the data between the lead-in stage and the randomized stage for both treatment groups, we mathematically show that the proportion of responders in the population enriched for placebo nonresponders is less than that in the all-comers population, and whether the placebo lead-in design increases the drug-placebo difference depends on the variances of outcomes in both treatment groups as well as the correlations of the outcomes between two stages. Further, through a numerical investigation, we show that whether the placebo lead-in design increases the effect size strongly depends on the magnitude of the correlations and their difference. CONCLUSION If the correlation of the placebo-placebo group is much higher than that of the placebo-drug group, the placebo lead-in design is advantageous in most cases but has an impact on an estimand in placebo nonresponders. Therefore, we do not recommend using the placebo lead-in design for clinical trials with binary outcomes.
Collapse
Affiliation(s)
- Gosuke Homma
- Biostatistics & Data Science, Boehringer-Ingelheim Co., Ltd, Tokyo, Japan
| | - Takashi Daimon
- Department of Biostatistics, Hyogo Medical University, Nishinomiya, Japan
| |
Collapse
|
4
|
Correll CU, Solmi M, Cortese S, Fava M, Højlund M, Kraemer HC, McIntyre RS, Pine DS, Schneider LS, Kane JM. The future of psychopharmacology: a critical appraisal of ongoing phase 2/3 trials, and of some current trends aiming to de-risk trial programmes of novel agents. World Psychiatry 2023; 22:48-74. [PMID: 36640403 PMCID: PMC9840514 DOI: 10.1002/wps.21056] [Citation(s) in RCA: 38] [Impact Index Per Article: 38.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Accepted: 10/14/2022] [Indexed: 01/15/2023] Open
Abstract
Despite considerable progress in pharmacotherapy over the past seven decades, many mental disorders remain insufficiently treated. This situation is in part due to the limited knowledge of the pathophysiology of these disorders and the lack of biological markers to stratify and individualize patient selection, but also to a still restricted number of mechanisms of action being targeted in monotherapy or combination/augmentation treatment, as well as to a variety of challenges threatening the successful development and testing of new drugs. In this paper, we first provide an overview of the most promising drugs with innovative mechanisms of action that are undergoing phase 2 or 3 testing for schizophrenia, bipolar disorder, major depressive disorder, anxiety and trauma-related disorders, substance use disorders, and dementia. Promising repurposing of established medications for new psychiatric indications, as well as variations in the modulation of dopamine, noradrenaline and serotonin receptor functioning, are also considered. We then critically discuss the clinical trial parameters that need to be considered in depth when developing and testing new pharmacological agents for the treatment of mental disorders. Hurdles and perils threatening success of new drug development and testing include inadequacy and imprecision of inclusion/exclusion criteria and ratings, sub-optimally suited clinical trial participants, multiple factors contributing to a large/increasing placebo effect, and problems with statistical analyses. This information should be considered in order to de-risk trial programmes of novel agents or known agents for novel psychiatric indications, increasing their chances of success.
Collapse
Affiliation(s)
- Christoph U Correll
- Department of Child and Adolescent Psychiatry, Charité Universitätsmedizin Berlin, Berlin, Germany
- Department of Psychiatry, Zucker Hillside Hospital, Northwell Health, Glen Oaks, NY, USA
- Department of Psychiatry and Molecular Medicine, Zucker School of Medicine at Hofstra/Northwell, Hempstead, NY, USA
- Center for Psychiatric Neuroscience, Feinstein Institute for Medical Research, Manhasset, NY, USA
| | - Marco Solmi
- Department of Child and Adolescent Psychiatry, Charité Universitätsmedizin Berlin, Berlin, Germany
- Department of Psychiatry, University of Ottawa, Ottawa, ON, Canada
- Department of Mental Health, Ottawa Hospital, Ottawa, ON, Canada
- Ottawa Hospital Research Institute (OHRI) Clinical Epidemiology Program, University of Ottawa, Ottawa, ON, Canada
- School of Epidemiology and Public Health, Faculty of Medicine, University of Ottawa, Ottawa, ON, Canada
- Centre for Innovation in Mental Health, School of Psychology, Faculty of Environmental and Life Sciences, University of Southampton, Southampton, UK
| | - Samuele Cortese
- Centre for Innovation in Mental Health, School of Psychology, Faculty of Environmental and Life Sciences, University of Southampton, Southampton, UK
- Clinical and Experimental Sciences (CNS and Psychiatry), Faculty of Medicine, University of Southampton, Southampton, UK
- Solent NHS Trust, Southampton, UK
- Division of Psychiatry and Applied Psychology, School of Medicine, University of Nottingham, Nottingham, UK
- Hassenfeld Children's Hospital at NYU Langone, New York University Child Study Center, New York, NY, USA
| | - Maurizio Fava
- Depression Clinical and Research Program, Massachusetts General Hospital, Harvard Medical School, Boston, MA, USA
| | - Mikkel Højlund
- Department of Public Health, Clinical Pharmacology, Pharmacy and Environmental Medicine, University of Southern Denmark, Odense, Denmark
- Mental Health Services in the Region of Southern Denmark, Department of Psychiatry Aabenraa, Aabenraa, Denmark
| | - Helena C Kraemer
- Department of Psychiatry and Behavioral Sciences, Stanford University, Cupertino, CA, USA
| | - Roger S McIntyre
- Mood Disorders Psychopharmacology Unit, University Health Network, Toronto, ON, Canada
- Institute of Medical Science, University of Toronto, Toronto, ON, Canada
- Canadian Rapid Treatment Center of Excellence, Mississauga, ON, Canada
- Department of Psychiatry, University of Toronto, Toronto, ON, Canada
- Department of Pharmacology, University of Toronto, Toronto, ON, Canada
- Brain and Cognition Discovery Foundation, Toronto, ON, Canada
| | - Daniel S Pine
- Section on Developmental Affective Neuroscience, National Institute of Mental Health, Bethesda, MD, USA
| | - Lon S Schneider
- Department of Psychiatry and Behavioral Sciences, and Department of Neurology, Keck School of Medicine, and L. Davis School of Gerontology, University of Southern California, Los Angeles, CA, USA
| | - John M Kane
- Department of Psychiatry, Zucker Hillside Hospital, Northwell Health, Glen Oaks, NY, USA
- Department of Psychiatry and Molecular Medicine, Zucker School of Medicine at Hofstra/Northwell, Hempstead, NY, USA
- Center for Psychiatric Neuroscience, Feinstein Institute for Medical Research, Manhasset, NY, USA
| |
Collapse
|
5
|
Goyal RK, Kalaria SN, McElroy SL, Gopalakrishnan M. An exploratory machine learning approach to identify placebo responders in pharmacological binge eating disorder trials. Clin Transl Sci 2022; 15:2878-2887. [PMID: 36126231 PMCID: PMC9747128 DOI: 10.1111/cts.13406] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/05/2022] [Revised: 08/23/2022] [Accepted: 08/30/2022] [Indexed: 01/26/2023] Open
Abstract
Randomized, placebo-controlled trials for binge eating disorder (BED) have revealed highly variable, and often marked, rates of short-term placebo response. Several quantitative based analyses in patients with BED have inconsistently demonstrated which patient factors attribute to an increase in placebo response. The objective of this study is to utilize machine learning (ML) algorithms to identify moderators of placebo response in patients with BED. Data were pooled from 12 randomized placebo-controlled trials evaluating different treatment options for BED. The final dataset consisted of 189 adults receiving placebo with complete information of baseline variables. Placebo responders were defined as patients experiencing ≥75% reduction in binge eating frequency (BEF) at study end point. Nine patient prerandomization variables were included as predictors. Patients were divided into training and testing subsets according to an 75%:25% distribution while preserving the proportion of placebo responders. All analysis was performed in the software Pumas 2.0. Gaussian Naïve Bayes algorithm showed the best cross-validation accuracy (~64%) and was chosen as the final algorithm. Shapley analysis suggested that patients with low baseline BEF and anxiety status were strong moderators of placebo response. Upon applying the final algorithm on the test dataset, the resulting sensitivity was 88% and prediction accuracy was 72%. This is the first application of ML to identify moderators of placebo response in BED. The results of this analysis confirm previous findings of lesser baseline disease severity and adds that patients with no anxiety are more susceptible to placebo response.
Collapse
Affiliation(s)
- Rahul K. Goyal
- Center for Translational MedicineSchool of Pharmacy, University of MarylandBaltimoreMarylandUSA
| | - Shamir N. Kalaria
- Center for Translational MedicineSchool of Pharmacy, University of MarylandBaltimoreMarylandUSA
| | - Susan L. McElroy
- Department of Psychiatry and Behavioral NeuroscienceUniversity of Cincinnati, College of MedicineMasonOhioUSA
| | - Mathangi Gopalakrishnan
- Center for Translational MedicineSchool of Pharmacy, University of MarylandBaltimoreMarylandUSA
| |
Collapse
|
6
|
Murphy RP, O'Donnell MJ, Nolan A, McGrath E, O'Conghaile A, Ferguson J, Alvarez-Iglesias A, Costello M, Loughlin E, Reddin C, Ruttledge S, Gorey S, Hughes D, Smyth A, Canavan M, Judge C. Effect of a Run-In Period on Estimated Treatment Effects in Cardiovascular Randomized Clinical Trials: A Meta-Analytic Review. J Am Heart Assoc 2022; 11:e023061. [PMID: 36250666 DOI: 10.1161/jaha.121.023061] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
Abstract
Background A run-in period may increase adherence to intervention and reduce loss to follow-up. Whether use of a run-in period affects the magnitude of treatment effects is unknown. Methods and Results We conducted a meta-analysis comparing treatment effects from 11 systematic reviews of cardiovascular prevention trials using a run-in period with matched trials not using a run-in period. We matched run-in with non-run-in trials by population, intervention, control, and outcome. We calculated a ratio of relative risks (RRRs) using a random-effects meta-analysis. Our primary outcome was a composite of cardiovascular events, and the primary analysis was a matched comparison of clinical trials using a run-in period versus without a run-in period. We identified 66 run-in trials and 111 non-run-in trials (n=668 901). On meta-analysis there was no statistically significant difference in the magnitude of treatment effect between run-in trials (relative risk [RR], 0.83 [95% CI, 0.80-0.87]) compared with non-run-in trials (RR, 0.88 [95% CI, 0.84-0.91]; RRR, 0.95 [95% CI, 0.90-1.01]). There was no significant difference in the RRR for secondary outcomes of all-cause mortality (RRR, 0.97 [95% CI, 0.91-1.03]) or medication discontinuation because of adverse events (RRR, 1.05 [95% CI, 0.85-1.21]). Post hoc exploratory univariate meta-regression showed that on average a run-in period is associated with a statistically significant difference in treatment effect (RRR, 0.94 [95% CI, 0.90-0.99]) for cardiovascular composite outcome, but this was not statistically significant on multivariable meta-regression analysis (RRR, 0.95 [95% CI, 0.90-1.0]). Conclusions The use of a run-in period was not associated with a difference in the magnitude of treatment effect among cardiovascular prevention trials.
Collapse
Affiliation(s)
- Robert P Murphy
- Health Research Board Clinical Research Facility-Galway National University of Ireland Galway Galway Ireland
| | - Martin J O'Donnell
- Health Research Board Clinical Research Facility-Galway National University of Ireland Galway Galway Ireland
| | - Aoife Nolan
- Health Research Board Clinical Research Facility-Galway National University of Ireland Galway Galway Ireland
| | - Emer McGrath
- Health Research Board Clinical Research Facility-Galway National University of Ireland Galway Galway Ireland.,Department of Neurology Harvard Medical School Boston MA
| | - Aengus O'Conghaile
- Department of Psychiatry National University of Ireland Galway Galway Ireland
| | - John Ferguson
- Health Research Board Clinical Research Facility-Galway National University of Ireland Galway Galway Ireland
| | - Alberto Alvarez-Iglesias
- Health Research Board Clinical Research Facility-Galway National University of Ireland Galway Galway Ireland
| | - Maria Costello
- Health Research Board Clinical Research Facility-Galway National University of Ireland Galway Galway Ireland
| | - Elaine Loughlin
- Health Research Board Clinical Research Facility-Galway National University of Ireland Galway Galway Ireland
| | - Catriona Reddin
- Health Research Board Clinical Research Facility-Galway National University of Ireland Galway Galway Ireland
| | - Sarah Ruttledge
- Health Research Board Clinical Research Facility-Galway National University of Ireland Galway Galway Ireland
| | - Sarah Gorey
- Health Research Board Clinical Research Facility-Galway National University of Ireland Galway Galway Ireland
| | - Diarmaid Hughes
- Health Research Board Clinical Research Facility-Galway National University of Ireland Galway Galway Ireland
| | - Andrew Smyth
- Health Research Board Clinical Research Facility-Galway National University of Ireland Galway Galway Ireland
| | - Michelle Canavan
- Health Research Board Clinical Research Facility-Galway National University of Ireland Galway Galway Ireland
| | - Conor Judge
- Health Research Board Clinical Research Facility-Galway National University of Ireland Galway Galway Ireland.,Translational Medical Device Lab National University of Ireland Galway Galway Ireland.,Wellcome Trust - Health Research Board Irish Clinical Academic Training Galway Ireland
| |
Collapse
|
7
|
Lui KJ. Notes on power comparison between the sequential parallel comparison and other commonly-used designs. COMMUN STAT-SIMUL C 2022. [DOI: 10.1080/03610918.2019.1682160] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/25/2022]
Affiliation(s)
- Kung-Jong Lui
- Department of Mathematics and Statistics, College of Sciences, San Diego State University, San Diego, California, USA
| |
Collapse
|
8
|
Scott AJ, Sharpe L, Quinn V, Colagiuri B. Association of Single-blind Placebo Run-in Periods With the Placebo Response in Randomized Clinical Trials of Antidepressants: A Systematic Review and Meta-analysis. JAMA Psychiatry 2022; 79:42-49. [PMID: 34757405 PMCID: PMC8581773 DOI: 10.1001/jamapsychiatry.2021.3204] [Citation(s) in RCA: 15] [Impact Index Per Article: 7.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 06/09/2021] [Accepted: 09/13/2021] [Indexed: 12/13/2022]
Abstract
Importance Single-blind placebo run-in (PRI) periods are common in randomized clinical trials (RCTs) of treatment for depression. They aim to increase sensitivity to detect drug effects; however, the association of PRI periods with study outcomes remains unclear. This is concerning given the costs of PRI periods to patients and investigators. Objective To examine the association of the use of PRI periods with the placebo response, drug response, and drug-placebo difference among RCTs of antidepressants. Data Sources MEDLINE, Embase, the Cochrane Central Register of Controlled Trials, and PsycINFO, as well as repositories of unpublished studies, were systematically searched up to July 2021. Study Selection Included studies were double-blind, placebo-controlled RCTs of antidepressant medication among adults with depressive disorders. Data Extraction and Synthesis Data were extracted into a coding sheet, including the characteristics of studies, the characteristics of PRI periods, and the outcomes of studies. Main Outcomes and Measures Study outcomes were the primary depression symptom measure reported by the RCT. These outcomes were used to calculate effect sizes (Hedges g) of the within-group drug response and placebo response as well as the drug-placebo difference. Random-effects meta-analysis was used to calculate effect sizes, and subgroup analyses were used to compare outcomes depending on use of PRI periods. Results A total of 347 trials (representing 89 183 participants) were included; 174 studies (50%) reported using a single-blind PRI period. Response outcome data were available for 189 studies. Studies using PRI periods reported a smaller placebo response (g = 1.05 [95% CI, 0.98-1.11]; I2 = 82%) than studies that did not use a PRI period (g = 1.15 [95% CI, 1.09-1.21]; I2 = 81%; P = .02). Subgroup analysis showed a larger drug response size among studies that did not use a PRI period (g = 1.55 [95% CI, 1.49-1.61]; I2 = 85%) than those that did use a PRI period (g = 1.42 [95% CI, 1.36-1.48]; I2 = 81%; P = .001). The drug-placebo difference did not differ by use of PRI periods (g = 0.33 [95% CI, 0.29-0.38]; I2 = 47% for use of a PRI period vs g = 0.34 [95% CI, 0.30-0.38]; I2 = 54% for no use of PRI periods; P = .92). The likelihood of response to drug vs placebo also did not differ between studies that used a PRI period (odds ratio, 1.89 [95% CI, 1.76-2.03]) and those that did not use a PRI period (odds ratio, 1.77 [95% CI, 1.65-1.89]; P = .18). Conclusions and Relevance This study suggests that RCTs using PRI periods yield smaller within-group changes across both placebo and drug groups compared with RCTs without PRI periods. The reduction in effect size across groups was equivalent in magnitude. Consequently, PRI studies do not observe larger drug-placebo differences, suggesting that they do not increase trial sensitivity. As such, given the resources and probable deception required and risk to external validity, the practice of using PRI periods in RCTs of antidepressants should be ended.
Collapse
Affiliation(s)
- Amelia J. Scott
- School of Psychology, University of Sydney, Sydney, New South Wales, Australia
- Department of Psychology, eCentreClinic, Macquarie University, Sydney, New South Wales, Australia
| | - Louise Sharpe
- School of Psychology, University of Sydney, Sydney, New South Wales, Australia
| | - Veronica Quinn
- Department of Psychology, eCentreClinic, Macquarie University, Sydney, New South Wales, Australia
| | - Ben Colagiuri
- School of Psychology, University of Sydney, Sydney, New South Wales, Australia
| |
Collapse
|
9
|
Hume M, Abraham M. Practical Research Ethics in Psychiatric Clinical Trials: A Guide for Investigators. Psychiatr Clin North Am 2021; 44:549-561. [PMID: 34763788 DOI: 10.1016/j.psc.2021.08.005] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 10/19/2022]
Abstract
The conduct of clinical psychiatric research is critical to advance the science and efficacy of treatment while also safeguarding the interests of participants. This article emerges from the authors' experience, providing practical guidance to colleagues seeking input on how to design and implement clinical research protocols in accordance with key ethical considerations. Thus, the intent of this article is to provide (1) an overview of common ethical considerations when conducting psychiatric clinical research along with (2) practical advice for preparing Institutional Review Board applications and associated materials in the ethical conduct of psychiatric clinical research.
Collapse
Affiliation(s)
- Michelle Hume
- Mendota Mental Health Institute, 301 Troy Dr, Madison, WI 53704, USA.
| | - Melissa Abraham
- Research Ethics Consultation Unit, Division of Clinical Research, Massachusetts General Hospital; Department of Psychiatry, Massachusetts General Hospital, Harvard Medical School; Center for Bioethics, Harvard Medical School; Ariadne Labs
| |
Collapse
|
10
|
Nasir M, Li F, Courley S, Olten B, Bloch MH. Meta-Analysis: Pediatric Placebo Response in Depression Trials Does Not Replicate in Anxiety and Obsessive-Compulsive Disorder Trials. J Child Adolesc Psychopharmacol 2021; 31:670-684. [PMID: 34558984 DOI: 10.1089/cap.2021.0030] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 11/12/2022]
Abstract
Background: Placebo response has been identified as an important factor influencing the success of adult antidepressant trials, yet little research of placebo response has been conducted in pediatric populations. Understanding disorder-specific and transdiagnostic predictors of pediatric placebo response is important in designing successful child psychopharmacological trials. Methods: A PubMed search was conducted for all pediatric antidepressant randomized controlled trials treating depression, anxiety, or obsessive-compulsive disorder (OCD). A random-effects model was utilized to examine the magnitude of placebo symptom improvement using standardized mean difference (SMD) and placebo response rates. Stratified subgroup analysis was performed by diagnostic indication. Meta-regression was utilized to search possible correlates of placebo symptom improvement and placebo response rate. Results: Thirty antidepressant trials involving 2911 participants receiving placebo were included in this meta-analysis. Magnitude of placebo improvement and placebo response rates varied significantly across disorders; being greater in depression (SMD = 1.44, 95% confidence interval [CI]: 1.18 to 1.71) than anxiety disorders (SMD = 1.09, 95% CI: 0.77 to 1.41) and the lowest in OCD (SMD = 0.71, 95% CI: 0.32 to 1.12). Different predictors were associated with placebo response in different indications. Conclusions: Both the magnitude and predictors of placebo response in pediatric depression trials do not replicate across anxiety and OCD. Based on our results, across disorders, minimizing the number of sites might significantly reduce placebo improvement. In addition to these, we could potentially decrease the placebo response in depression trials by increasing the number of subjects enrolled per study site, minimizing the number of study visits and conducting the studies in the United States. Further research is needed into the predictors of placebo response in pediatric anxiety and OCD.
Collapse
Affiliation(s)
- Madeeha Nasir
- Yale Child Study Center, Yale University School of Medicine, New Haven, Connecticut, USA
| | - Fenghua Li
- Yale Child Study Center, Yale University School of Medicine, New Haven, Connecticut, USA
| | - Samantha Courley
- Yale Child Study Center, Yale University School of Medicine, New Haven, Connecticut, USA
| | - Baris Olten
- Yale Child Study Center, Yale University School of Medicine, New Haven, Connecticut, USA
| | - Michael H Bloch
- Yale Child Study Center, Yale University School of Medicine, New Haven, Connecticut, USA.,Yale Department of Psychiatry, Yale University School of Medicine, New Haven, Connecticut, USA
| |
Collapse
|
11
|
Cheung CP, Thiyagarajah MT, Abraha HY, Liu CS, Lanctôt KL, Kiss AJ, Saleem M, Juda A, Levitt AJ, Schaffer A, Cheung AH, Sinyor M. The association between placebo arm inclusion and adverse event rates in antidepressant randomized controlled trials: An examination of the Nocebo Effect. J Affect Disord 2021; 280:140-147. [PMID: 33212405 DOI: 10.1016/j.jad.2020.11.004] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 08/02/2019] [Revised: 07/27/2020] [Accepted: 11/01/2020] [Indexed: 12/29/2022]
Abstract
BACKGROUND Antidepressant efficacy is influenced by patient expectations and, in randomized controlled trials (RCTs), the probability of receiving a placebo. It is unclear whether tolerability demonstrates a similar pattern. This study aimed to determine whether study design influences adverse event (AE) rates in antidepressant trials for subjects receiving active treatment or placebo. METHODS RCTs comparing one antidepressant to another antidepressant, placebo, or both in major depressive disorder (MDD) (1996-2018) were retrieved from Medline and PsycINFO. Clinicaltrials.gov was searched for unpublished trials. Of 1,997 studies screened, 77 trials were included. Studies were classified as drug-drug, drug-drug-placebo, or drug-placebo based on design and overall number of subjects experiencing any AE was recorded. Subgroup meta-analysis of proportions and meta-regression techniques were used to compare AE rates across study designs in patients receiving active antidepressant treatment and placebo. RESULTS Among the actively treated, AE rates were lower in drug-drug trials (58.5%) compared to drug-drug-placebo (75.7%) and drug-placebo (76.4%) (the model reported coefficients for percent differences between AE rates of different study designs were B=17.0, p<0.001 and B=17.8, p<0.001, respectively). AE rates in patients receiving placebo were not different between study designs. LIMITATIONS The present study is limited by the diverse range of study populations, variability in reporting of AEs, and specific antidepressants employed in the included trials. CONCLUSIONS The inclusion of a placebo arm in the study design was unexpectedly associated with higher rates of AEs among patients receiving active medication in antidepressant trials. This observation has important implications for interpretation of trial tolerability findings.
Collapse
Affiliation(s)
- Christian P Cheung
- Department of Psychiatry, Sunnybrook Health Sciences Centre, Toronto, Canada
| | - Mathura T Thiyagarajah
- Neuropsychopharmacology Research Program, Department of Psychiatry, Sunnybrook Health Sciences Centre; Hurvitz Brain Sciences Program, Sunnybrook Research Institute, Toronto, Canada
| | - Haben Y Abraha
- Neuropsychopharmacology Research Program, Department of Psychiatry, Sunnybrook Health Sciences Centre; Hurvitz Brain Sciences Program, Sunnybrook Research Institute, Toronto, Canada
| | - Celina S Liu
- Neuropsychopharmacology Research Program, Department of Psychiatry, Sunnybrook Health Sciences Centre; Hurvitz Brain Sciences Program, Sunnybrook Research Institute, Toronto, Canada
| | - Krista L Lanctôt
- Neuropsychopharmacology Research Program, Department of Psychiatry, Sunnybrook Health Sciences Centre; Hurvitz Brain Sciences Program, Sunnybrook Research Institute, Toronto, Canada
| | - Alex J Kiss
- Department of Research Design and Biostatistics, Sunnybrook Research Institute, Toronto, Canada
| | - Mahwesh Saleem
- Neuropsychopharmacology Research Program, Department of Psychiatry, Sunnybrook Health Sciences Centre; Hurvitz Brain Sciences Program, Sunnybrook Research Institute, Toronto, Canada
| | - Ari Juda
- Department of Psychiatry, Sunnybrook Health Sciences Centre, Toronto, Canada
| | - Anthony J Levitt
- Department of Psychiatry, Sunnybrook Health Sciences Centre, Toronto, Canada
| | - Ayal Schaffer
- Department of Psychiatry, Sunnybrook Health Sciences Centre, Toronto, Canada
| | - Amy H Cheung
- Department of Psychiatry, Sunnybrook Health Sciences Centre, Toronto, Canada
| | - Mark Sinyor
- Department of Psychiatry, Sunnybrook Health Sciences Centre, Toronto, Canada.
| |
Collapse
|
12
|
Collister D, Rodrigues JC, Mbuagbaw L, Devereaux PJ, Guyatt G, Herrington W, Walsh M. Prerandomization run-in periods in randomized controlled trials of chronic diseases: a methodological study. J Clin Epidemiol 2020; 128:148-156. [PMID: 33002638 DOI: 10.1016/j.jclinepi.2020.09.035] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/24/2020] [Revised: 09/09/2020] [Accepted: 09/22/2020] [Indexed: 01/12/2023]
Abstract
OBJECTIVE To systematically review the epidemiology of prerandomized run-in periods in randomized controlled trials (RCTs) of chronic diseases. STUDY DESIGN AND SETTING Meta-epidemiologic study of all RCTs from the four highest impact medical journals from 2011 to 2016. Eligible trials included parallel RCTs that evaluated pharmacologic therapies in adults with chronic diseases with a minimum follow-up of 24 weeks. RESULTS Of 262 eligible manuscripts, 48 (18.3%), representing 42 unique RCTs, included run-in periods. Run-in periods were most common in cardiovascular disease and diabetes trials. Of the 42 RCTs, in 22 patients received the experimental therapy, 15 placebo, 4 both (either sequentially or in combination), and one did not report the run-in period drug. The median run-in period duration was 28 days (Q1: Q3 14: 66 days). Reasons for including a run-in period included ensuring eligibility criteria were met (18, 42.9%), excluding participants with nonadherence (18, 42.9%) and intolerances to therapy (15, 35.7%), and to standardize therapy prior to randomization (8, 19.0%). The median run-in completion rate was 77.4% (Q1: Q3 62.2:87.8%). CONCLUSIONS Run-in periods are uncommon in RCTs of chronic drug treatments and when used, their reporting is heterogeneous. Further research to improve the design, use, and reporting of run-in periods is necessary.
Collapse
Affiliation(s)
- David Collister
- Department of Health Research Methods, Evidence and Impact, McMaster University, 1280 Main Street West, Hamilton, Ontario, Canada; Population Health Research Institute, 237 Barton Street East, Hamilton, Ontario, Canada.
| | - Jennifer C Rodrigues
- Department of Health Research Methods, Evidence and Impact, McMaster University, 1280 Main Street West, Hamilton, Ontario, Canada
| | - Lawrence Mbuagbaw
- Department of Health Research Methods, Evidence and Impact, McMaster University, 1280 Main Street West, Hamilton, Ontario, Canada
| | - P J Devereaux
- Department of Health Research Methods, Evidence and Impact, McMaster University, 1280 Main Street West, Hamilton, Ontario, Canada; Population Health Research Institute, 237 Barton Street East, Hamilton, Ontario, Canada
| | - Gordon Guyatt
- Department of Health Research Methods, Evidence and Impact, McMaster University, 1280 Main Street West, Hamilton, Ontario, Canada
| | - William Herrington
- Medical Research Council Population Health Research Unit at the University of Oxford, Clinical Trial Service Unit and Epidemiological Studies Unit, Richard Doll Building, Old Road Campus, Oxford OX3 7LF, UK
| | - Michael Walsh
- Department of Health Research Methods, Evidence and Impact, McMaster University, 1280 Main Street West, Hamilton, Ontario, Canada; Population Health Research Institute, 237 Barton Street East, Hamilton, Ontario, Canada
| |
Collapse
|
13
|
Karahalios A, Herbison GP, McKenzie JE. Placebo run-in periods in anticholinergic trials are not associated with treatment effect size or risk of attrition: an empirical evaluation. J Clin Epidemiol 2020; 125:120-129. [PMID: 32531264 DOI: 10.1016/j.jclinepi.2020.05.032] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/07/2020] [Revised: 05/11/2020] [Accepted: 05/27/2020] [Indexed: 10/24/2022]
Abstract
OBJECTIVES We aimed to explore the impact of run-in periods on the magnitude of treatment effect and the risk of attrition in a sample of randomized trials. STUDY DESIGN AND SETTING We identified randomized trials from a published systematic review examining the effects of anticholinergics for the treatment of overactive bladders. We fitted meta-analytic mixed-effects models to assess whether the type of run-in (placebo run-in vs. no run-in) was associated with the magnitude of the effect estimates for the following outcomes: the number of voids per day, number of leakages per day, presence of dry mouth, cure/improvement, patient withdrawal from the trial, compliance with the trial protocol, and/or adherence to study drug. We adjusted for potential confounders. RESULTS A total of 96 trials met the eligibility criteria; 59 trials had no run-in (which included those with a screening or withdrawal period), 37 trials had a placebo run-in, and no trials had a drug run-in. The magnitude of the effect estimates for all outcomes did not importantly differ between trials with a placebo run-in and trials with no run-in. Adjustment for the confounding variables did not materially change the estimates. CONCLUSION The hypothesized benefits of placebo run-in periods were not observed in our sample of anticholinergic randomized trials for the treatment of overactive bladders. Designing future trials of anticholinergics with more pragmatic intentions is likely to result in evidence that more directly informs clinical decision-making.
Collapse
Affiliation(s)
- Amalia Karahalios
- School of Public Health and Preventive Medicine, Monash University, Level 4, 553 St Kilda Road, Melbourne, Victoria, Australia.
| | | | - Joanne E McKenzie
- School of Public Health and Preventive Medicine, Monash University, Level 4, 553 St Kilda Road, Melbourne, Victoria, Australia
| |
Collapse
|
14
|
Lindheimer JB, Szabo A, Raglin JS, Beedie C. Advancing the understanding of placebo effects in psychological outcomes of exercise: Lessons learned and future directions. Eur J Sport Sci 2020; 20:326-337. [PMID: 31215360 PMCID: PMC6949426 DOI: 10.1080/17461391.2019.1632937] [Citation(s) in RCA: 27] [Impact Index Per Article: 6.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/30/2023]
Abstract
Despite the apparent strength of scientific evidence suggesting that psychological benefits result from both acute and chronic exercise, concerns remain regarding the extent to which these benefits are explained by placebo effects. Addressing these concerns is methodologically and at times conceptually challenging. However, developments in the conceptualisation and study of placebo effects from the fields of psychology, neuroscience, pharmacology, and human performance offer guidance for advancing the understanding of placebo effects in psychological responses to exercise. In clinical trials, expectations can be measured and experimentally manipulated to better understand the influence of placebo effects on treatment responses. Further, compelling evidence has shown that the contribution of placebo effects and their underlying neurobiological mechanisms to treatment effects can be measured without administering a traditional placebo (e.g. inert substance) by leveraging psychological factors such as expectations and conditioning. Hence, the purpose of this focused review is to integrate lessons such as these with the current body of literature on placebo effects in psychological responses to exercise and provide recommendations for future research directions.
Collapse
Affiliation(s)
- Jacob B Lindheimer
- Department of Veterans Affairs, William S. Middleton Veterans Memorial Hospital, Madison, WI, USA
- Department of Kinesiology, University of Wisconsin-Madison, Madison, WI, USA
| | - Attila Szabo
- Institute of Health Promotion and Sport Sciences, ELTE Eötvös Loránd University, Budapest Hungary
| | - John S Raglin
- Department of Kinesiology, Indiana University, Bloomington, IN, USA
| | - Chris Beedie
- School of Psychology, University of Kent, Canterbury, UK
| |
Collapse
|
15
|
Early score fluctuation and placebo response in a study of major depressive disorder. J Psychiatr Res 2020; 121:118-125. [PMID: 31812110 DOI: 10.1016/j.jpsychires.2019.11.014] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 09/25/2019] [Revised: 10/28/2019] [Accepted: 11/21/2019] [Indexed: 12/27/2022]
Abstract
Early score fluctuation in double-blind, placebo-controlled studies may affect the reliability of the baseline measurement and adversely affect the eventual study outcome. We examined the effect of early score fluctuation during a 2-week double-blind placebo lead-in period in a phase II, double-blind, placebo-controlled trial of adjunctive s-adenosyl methionine (MSI-195) in MDD subjects who had had an inadequate response to ongoing antidepressant treatment. The overall study failed to meet its specified endpoints. We examined the score trajectories of all placebo-assigned subjects during the double-blind placebo lead-in period and subsequent 6-week treatment period. Placebo-assigned subjects with ≥20% HamD17 or MADRS score fluctuations (improvement or worsening) during the double-blind placebo lead-in period (prior to randomization) had significantly higher rates of placebo response and remission at week 8 compared to subjects with <20% response. A post-hoc analysis of evaluable subjects taken from the ITT population that excluded subjects with ≥20% early score response yielded higher effect sizes for both the HamD17 and MADRS sub-groups and statistical significance for MSI-195 over placebo in the MADRS sub-group (p = 0.012) with an effect size of 0.404. A reliable baseline measure is an asset for signal detection. These post-hoc findings suggest that study designs that anticipate and attempt to manage early response prior to randomization may yield more meaningful outcome data for trials of MDD and possibly other disorders as well.
Collapse
|
16
|
Benda N, Haenisch B. Enrichment designs using placebo nonresponders. Pharm Stat 2020; 19:303-314. [PMID: 31899854 DOI: 10.1002/pst.1992] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/22/2018] [Revised: 10/29/2019] [Accepted: 11/04/2019] [Indexed: 11/06/2022]
Abstract
Enrichment designs that select placebo nonresponders have gained much attention during the last years in areas with high placebo response rates, eg, in depression. Proposals were made that re-randomize patients who did not respond to placebo during a first study phase as the sequential parallel design (SPD). This design uses in a second phase an enriched patient population where the treatment effect is expected to be more pronounced. This may be problematic if an effect in the overall population is claimed. Proposals were made to combine the treatment effects in the overall population from study phase 1 and the enriched population from study phase 2, alleviating but not solving the issue of a potential selection bias. This paper shows how this bias corresponding to the effect difference between the overall population and the enriched population depends on the variability of a potential subject-by-treatment interaction. Sample sizes are given, which lead to a significant result in the combining test with a given probability if actually the average effect in the overall population is zero. If, on the other hand, no subject-by-treatment interaction is given, the enrichment is shown to be inefficient. We conclude that enrichment designs using placebo nonresponders are not able to claim a positive average effect in the overall population if a subject-by-treatment interaction cannot be excluded. It cannot be used to demonstrate positive efficacy in the overall population in a pivotal phase III trial but may be used in early phases to demonstrate varying treatment effects between patients.
Collapse
Affiliation(s)
- Norbert Benda
- Research Department, Federal Institute for Drugs and Medical Devices (BfArM), Bonn, Germany.,Department of Medical Statistics, University Medical Center Göttingen, Göttingen, Germany
| | - Britta Haenisch
- Research Department, Federal Institute for Drugs and Medical Devices (BfArM), Bonn, Germany.,Population Health Sciences, German Center for Neurodegenerative Diseases (DZNE), Bonn, Germany.,Center for Translational Medicine, University of Bonn, Bonn, Germany
| |
Collapse
|
17
|
Hulshof TA, Zuidema SU, Gispen-de Wied CC, Luijendijk HJ. Run-in periods and clinical outcomes of antipsychotics in dementia: A meta-epidemiological study of placebo-controlled trials. Pharmacoepidemiol Drug Saf 2019; 29:125-133. [PMID: 31730266 PMCID: PMC7027584 DOI: 10.1002/pds.4903] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/20/2018] [Revised: 09/06/2019] [Accepted: 09/09/2019] [Indexed: 01/03/2023]
Abstract
Purpose Run‐in periods are used to identify placebo‐responders and washout. Our aim was to assess the association of run‐in periods with clinical outcomes of antipsychotics in dementia. Methods We searched randomized placebo‐controlled trials of conventional and atypical antipsychotics for neuropsychiatric symptoms (NPS) in dementia in electronic sources and references of selected articles. We extracted (a) the presence of a run‐in period, use of placebo/investigated drug during run‐in (versus washout only), and run‐in duration (1 week or more) and (b) the reduction in NPS, number of participants with somnolence, extrapyramidal symptoms (EPS), and deaths per treatment group. We pooled clinical outcomes comparing antipsychotic and placebo groups in trials with and without run‐in. Results We identified 35 trials. Twenty‐nine trials used run‐in. The pooled standardized mean difference in the reduction of NPS was −0.170 (95% CI, −0.227 to −0.112) in trials with run‐in and −0.142 (95% CI, −0.331 to 0.047) in trials without run‐in. The pooled odds ratio for somnolence was 2.8 (95% CI, 2.3‐3.5) in trials with run‐in and 3.5 (95% CI, 1.2‐10.7) in trials without run‐in; for EPS, these ORs were 1.8 (95% CI, 1.4‐2.2) and 2.0 (95% CI, 1.3‐3.1) respectively, and for mortality 1.4 (95% CI, 1.0‐2.0) and 1.6 (95% CI, 0.7‐3.4). The use of placebo/investigated drug during run‐in and run‐in duration did not affect the estimates in a consistent way. Conclusions The use of run‐in in trials might have led to overestimated efficacy and especially underestimated risks of side effects of antipsychotics compared with placebo for NPS in dementia.
Collapse
Affiliation(s)
- Tessa A Hulshof
- Department of General Practice and Elderly Care Medicine, University Medical Center Groningen, Groningen, The Netherlands
| | - Sytse U Zuidema
- Department of General Practice and Elderly Care Medicine, University Medical Center Groningen, Groningen, The Netherlands
| | | | - Hendrika J Luijendijk
- Department of General Practice and Elderly Care Medicine, University Medical Center Groningen, Groningen, The Netherlands
| |
Collapse
|
18
|
Brown V, Peciña M. Neuroimaging Studies of Antidepressant Placebo Effects: Challenges and Opportunities. Front Psychiatry 2019; 10:669. [PMID: 31616327 PMCID: PMC6768950 DOI: 10.3389/fpsyt.2019.00669] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.6] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 02/11/2019] [Accepted: 08/19/2019] [Indexed: 12/31/2022] Open
Abstract
Over the last two decades, neuroscientists have used antidepressant placebo probes to examine the biological mechanisms implicated in expectancies of mood improvement.However, findings from these studies have yet to elucidate a model-based theory that would explain the mechanisms through which antidepressant expectancies evolve to induce persistent mood changes. Compared to other fields, the development of experimental models of antidepressant placebo effects faces significant challenges, such as the delayed mechanism of action of conventional antidepressants and the complex internal dynamics of mood. Still, recent neuroimaging studies of antidepressant placebo effects have shown remarkable similarities to those observed in other disciplines (e.g., placebo analgesia), such as placebo-induced increased µ-opioid signaling and blood-oxygen-level dependent (BOLD) responses in areas involved in cognitive control, the representation of expected values and reward and emotional processing. This review will summarize these findings and the challenges and opportunities that arise from applying methodologies used in the field of placebo analgesia into the field of antidepressant placebo effects.
Collapse
Affiliation(s)
| | - Marta Peciña
- Department of Psychiatry, University of Pittsburgh, Pittsburgh, PA, United States
| |
Collapse
|
19
|
Liu Y, Rybin D, Heeren TC, Doros G. Comparison of novel methods in two-way enriched clinical trial design. Stat Med 2019; 38:4112-4130. [PMID: 31256435 DOI: 10.1002/sim.8288] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/14/2018] [Revised: 05/23/2019] [Accepted: 05/31/2019] [Indexed: 11/08/2022]
Abstract
Two-way enriched design (TED) is a novel approach addressing placebo response in clinical trials. It is a two-stage, randomized, placebo-controlled trial design with enrichment in placebo non-responders and treatment responders at the second stage. All data from the first stage and data from placebo non-responders and treatment responders in the second stage are used for the final analysis of the treatment effect. The existing methods for the analysis of TED data include score tests with one, two, and three degrees of freedom. All these methods are only applicable to binary outcomes. However, there is an interest in continuous outcomes in clinical trials in psychiatry. In this manuscript, we apply some novel methods, including a repeated measures model, a weighted repeated measures model with weights from propensity score, and weights from K-means clustering, to analyze TED data for both binary outcomes and continuous outcomes. The simulation study indicates that the repeated measures model performs consistently well in preserving the type I error and achieving the minimum mean standard error as well as a higher power. The performance of the weighted repeated measures model with weights from K-means clustering improves with increasing sample size. Investigators can choose from these analytic approaches under different scenarios.
Collapse
Affiliation(s)
- Yuyin Liu
- Department of Biostatistics, Boston University, Boston, Massachusetts.,Baim Institute for Clinical Research, Boston, Massachusetts
| | | | - Timothy C Heeren
- Department of Biostatistics, Boston University, Boston, Massachusetts
| | - Gheorghe Doros
- Department of Biostatistics, Boston University, Boston, Massachusetts.,Baim Institute for Clinical Research, Boston, Massachusetts
| |
Collapse
|
20
|
Gomeni R, Rabinowitz J, Goyal N, Bressolle-Gomeni FMM, Fava M. Model-Informed Approach to Assess the Treatment Effect Conditional to the Level of Placebo Response. Clin Pharmacol Ther 2019; 106:1253-1260. [PMID: 31397904 DOI: 10.1002/cpt.1584] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/16/2019] [Accepted: 06/22/2019] [Indexed: 11/07/2022]
Abstract
One of the most important reasons for failure of placebo-controlled randomized controlled clinical trials (RCTs) is the lack of appropriate methodologies for detecting treatment effect (TE; difference between placebo and active treatment response) in the presence of excessively low/high levels of placebo response. Although, the higher the level of placebo response in a trial, the lower the apparent detectable TE. TE is usually estimated in a conventional analysis of an RCT as an "apparent" TE value conditional to the level of placebo response in that RCT. A model-informed methodology is proposed to establish a relationship between level of placebo response and TE. This relationship is used to estimate the "typical" TE associated with a "typical" level of placebo response, irrespective of the level of placebo response observed. The approach can be valuable for providing a reliable estimate of TE, for conducting risk/benefit analysis, and for determining dosage recommendations.
Collapse
Affiliation(s)
| | | | - Navin Goyal
- GlaxoSmithKline Research and Development, Collegeville, Pennsylvania, USA
| | | | - Maurizio Fava
- Massachusetts General Hospital, Boston, Massachusetts, USA
| |
Collapse
|
21
|
Silverman R, Fine J, Zink RC, Ivanova A. Permutation and Bootstrap Testing for the Sequential Parallel Comparison Design. Stat Biopharm Res 2019. [DOI: 10.1080/19466315.2018.1549095] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/27/2022]
Affiliation(s)
- Rachel Silverman
- Department of Biostatistics, The University of North Carolina, Chapel Hill, NC
| | - Jason Fine
- Department of Biostatistics, The University of North Carolina, Chapel Hill, NC
| | | | - Anastasia Ivanova
- Department of Biostatistics, The University of North Carolina, Chapel Hill, NC
| |
Collapse
|
22
|
Laursen DRT, Paludan-Müller AS, Hróbjartsson A. Randomized clinical trials with run-in periods: frequency, characteristics and reporting. Clin Epidemiol 2019; 11:169-184. [PMID: 30809104 PMCID: PMC6377048 DOI: 10.2147/clep.s188752] [Citation(s) in RCA: 35] [Impact Index Per Article: 7.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/23/2022] Open
Abstract
Background Run-in periods are occasionally used in randomized clinical trials to exclude patients after inclusion, but before randomization. In theory, run-in periods increase the probability of detecting a potential treatment effect, at the cost of possibly affecting external and internal validity. Adequate reporting of exclusions during the run-in period is a prerequisite for judging the risk of compromised validity. Our study aims were to assess the proportion of randomized clinical trials with run-in periods, to characterize such trials and the types of run-in periods and to assess their reporting. Materials and methods This was an observational study of 470 PubMed-indexed randomized controlled trial publications from 2014. We compared trials with and without run-in periods, described the types of run-in periods and evaluated the completeness of their reporting by noting whether publications stated the number of excluded patients, reasons for exclusion and baseline characteristics of the excluded patients. Results Twenty-five trials reported a run-in period (5%). These were larger than other trials (median number of randomized patients 217 vs 90, P=0.01) and more commonly industry trials (11% vs 3%, P<0.01). The run-in procedures varied in design and purpose. In 23 out of 25 trials (88%), the run-in period was incompletely reported, mostly due to missing baseline characteristics. Conclusion Approximately 1 in 20 trials used run-in periods, though much more frequently in industry trials. Reporting of the run-in period was often incomplete, precluding a meaningful assessment of the impact of the run-in period on the validity of trial results. We suggest that current trials with run-in periods are interpreted with caution and that updates of reporting guidelines for randomized trials address the issue.
Collapse
Affiliation(s)
- David Ruben Teindl Laursen
- Centre for Evidence-Based Medicine Odense (CEBMO), Odense University Hospital, Odense, Denmark, .,Nordic Cochrane Centre, Rigshospitalet, Copenhagen, Denmark, .,Department of Clinical Research, University of Southern Denmark, Odense, Denmark, .,Odense Patient data Explorative Network (OPEN), Odense University Hospital, Odense, Denmark,
| | | | - Asbjørn Hróbjartsson
- Centre for Evidence-Based Medicine Odense (CEBMO), Odense University Hospital, Odense, Denmark, .,Department of Clinical Research, University of Southern Denmark, Odense, Denmark, .,Odense Patient data Explorative Network (OPEN), Odense University Hospital, Odense, Denmark,
| |
Collapse
|
23
|
Zajecka JM, Stanford AD, Memisoglu A, Martin WF, Pathak S. Buprenorphine/samidorphan combination for the adjunctive treatment of major depressive disorder: results of a phase III clinical trial (FORWARD-3). Neuropsychiatr Dis Treat 2019; 15:795-808. [PMID: 31040679 PMCID: PMC6459143 DOI: 10.2147/ndt.s199245] [Citation(s) in RCA: 13] [Impact Index Per Article: 2.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 12/26/2022] Open
Abstract
BACKGROUND The endogenous opioid system is a fundamental regulator of mood in humans. Previously reported clinical trials have demonstrated the efficacy of the investigational agent buprenorphine/samidorphan (BUP/SAM) combination, an opioid-system modulator, for the adjunctive treatment of major depressive disorder. We present here a third phase III study of different design. METHODS Adult patients with major depressive disorder and inadequate response to antidepressant therapy were enrolled in this double-blind, placebo-controlled, placebo run-in study to evaluate the efficacy, safety, and tolerability of adjunctive BUP/SAM 2 mg/2 mg. Patients with baseline Hamilton Depression Rating Scale score $20 received double-blind placebo in addition to background antidepressant therapy for 4 weeks. Nonresponders were randomized to receive adjunctive BUP/SAM 2 mg/2 mg or placebo for 6 weeks. The primary end point was change in Montgomery-Åsberg Depression Rating Scale (MADRS)-10 total score from randomization at baseline to the end of the 6-week treatment period. RESULTS Least-squares mean change in MADRS-10 score at end of treatment was -4.8 (SE 0.67) in the BUP/SAM 2 mg/2 mg group and -4.6 (SE 0.66) in the placebo group (mean difference -0.3 [SE 0.95], P=0.782). There were no differences in MADRS-based response or remission rates. Overall, 42.9% of the BUP/SAM 2 mg/2 mg group and 34.5% of the placebo group experienced at least one treatment-emergent adverse event during the 6-week treatment period, most of which were mild or moderate in severity. There were no clinically important changes in laboratory parameters, weight, or vital signs and no evidence of abuse potential during treatment or opiate-withdrawal symptoms post treatment. CONCLUSION Efficacy results in FORWARD-3 measured by change in MADRS-10 score did not meet the primary end point, but postbaseline improvement in MADRS-10 in the BUP/SAM 2 mg/2 mg group was consistent with that seen in previously reported trials. BUP/SAM 2 mg/2 mg was well tolerated.
Collapse
Affiliation(s)
- John M Zajecka
- Department of Psychiatry, Rush University Medical Center, Chicago, IL, USA, .,Psychiatric Medicine Associates, LLC, Skokie, IL, USA,
| | | | - Asli Memisoglu
- Department of Biostatistics, Alkermes, Inc., Waltham, MA, USA
| | | | - Sanjeev Pathak
- Department of Clinical Research, Alkermes, Inc., Waltham, MA, USA
| |
Collapse
|
24
|
Targum SD, Cameron BR, Ferreira L, MacDonald ID. An augmentation study of MSI-195 (S-adenosylmethionine) in Major Depressive Disorder. J Psychiatr Res 2018; 107:86-96. [PMID: 30368163 DOI: 10.1016/j.jpsychires.2018.10.010] [Citation(s) in RCA: 9] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 06/29/2018] [Revised: 10/13/2018] [Accepted: 10/16/2018] [Indexed: 12/28/2022]
Abstract
We conducted a 6-week double-blind, placebo-controlled, augmentation study comparing the efficacy and safety of MSI-195 800 mg (a proprietary formulation of S-adenosylmethionine) or placebo added to ongoing antidepressant medication (ADT) in acutely depressed subjects with Major Depressive Disorder (MDD) who had experienced an inadequate response to their ongoing ADT (The Horizon Study, ClinicalTrials.gov NCT01912196). There were 234 eligible subjects randomized to either MSI-195 (n = 118) or placebo (n = 116). There were no overall statistically significant differences found between MSI-195 added to ongoing ADT compared to placebo on any of 3 depression-rating instruments (HamD17, MADRS, IDS-SR30) in the ITT set. MSI-195 was generally safe and well tolerated with predominantly mild gastrointestinal side effects. Post-hoc analyses examined factors that might have affected study outcome. The ITT set was divided into subjects enrolled during the 1st half (first nine months) and 2nd half of the study. MSI-195 added to ongoing ADT was significantly better than placebo on both the HamD17 and MADRS in the 1st half (p = 0.03 and 0.02 respectively), but not in the 2nd half of the study. Several demographic and clinical characteristics were significantly different between the two study segments including body mass index, pre-randomization symptom severity fluctuation, number of lifetime depressive episodes, and anxious depression sub-type. Thus, the characteristics of the enrolled subjects changed between the 1st and 2nd half of the study. These post-hoc findings highlight the inherent challenges encountered for subject selection in double-blind, placebo controlled trials and compel further investigation of enrollment criteria and moderating factors that affect treatment. The favorable safety profile and clinical benefit observed with MSI-195 in the 1st half of this study warrant further investigation in MDD.
Collapse
Affiliation(s)
- Steven D Targum
- MSI Methylation Sciences Inc, Burnaby, BC, Canada; Bracket Global LLC, Boston, MA, USA.
| | | | | | | |
Collapse
|
25
|
Factors Associated With Response to Placebo in Patients With Irritable Bowel Syndrome and Constipation. Clin Gastroenterol Hepatol 2018; 16:1738-1744.e1. [PMID: 29654913 PMCID: PMC6414074 DOI: 10.1016/j.cgh.2018.04.009] [Citation(s) in RCA: 26] [Impact Index Per Article: 4.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 01/19/2018] [Revised: 03/20/2018] [Accepted: 04/02/2018] [Indexed: 02/07/2023]
Abstract
BACKGROUND & AIMS A high proportion of patients with irritable bowel syndrome (IBS) respond to placebo in clinical trials (estimated at about 40%). We aimed to identify factors that contribute to the high placebo response rate using data from a placebo-controlled trial of patients with IBS. METHODS We performed a retrospective analysis of 599 women with IBS with constipation who were in the placebo group of a 12-week, randomized, double-blind, phase 3 trial of the experimental medication renzapride. Primary analyses evaluated frequency of abdominal pain in patients who received placebo, defined as ≥30% pain improvement from baseline for ≥6 of the 12 study weeks. We performed backward elimination regression with bootstrapping to identify factors associated with response to placebo. RESULTS In the placebo group, 29.0% of the patients had an abdominal pain response. Factors associated with a response to placebo were baseline variation in abdominal pain (odds ratio [OR], 1.71), maximum baseline pain severity (OR, 1.34), and placebo response in study week 2 (OR, 2.23) or week 3 (OR, 3.69). Factors associated with lack of response to placebo were number of baseline complete spontaneous bowel movements (OR, 0.73; P = .019) and final baseline pain ratings (OR, 0.73; P < .001). CONCLUSIONS We identified factors associated with a response in abdominal pain to placebo using original data from an IBS clinical trial. Baseline factors associated with the placebo response in women with IBS and constipation included variation in baseline pain symptoms, severity of baseline symptoms, and early improvement of abdominal pain. These findings have significant implications for clinical trial design.
Collapse
|
26
|
Placebo Effects Across Self-Report, Clinician Rating, and Objective Performance Tasks Among Women With Post-Traumatic Stress Disorder: Investigation of Placebo Response in a Pharmacological Treatment Study of Post-Traumatic Stress Disorder. J Clin Psychopharmacol 2018; 38:200-206. [PMID: 29505471 PMCID: PMC5903933 DOI: 10.1097/jcp.0000000000000858] [Citation(s) in RCA: 15] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 01/26/2023]
Abstract
PURPOSE/BACKGROUND For a drug to acquire Food and Drug Administration approval, it must significantly outperform placebo treatment. In recent years, the placebo effect seems to be increasing in neuropsychiatric conditions. Here, we examine placebo effects across self-reported, clinically rated, and performance-based data from a trial using a corticotropin-releasing hormone receptor type 1 (CRHR1) antagonist for treatment of post-traumatic stress disorder (PTSD). METHODS/PROCEDURES Women with chronic PTSD were randomized to treatment with either GSK561679, a CRHR1 antagonist, or placebo. Before randomization, participants completed self-report scales, clinician-rated measures of PTSD and depression symptoms, and objective tests of cognition and functioning. Differences in change scores on measures were compared between GSK561679 and placebo-treated participants. FINDINGS/RESULTS GSK561679 failed to produce any significant improvement in the participants. A substantial placebo effect was observed in both self-report and clinical rating scales, with effect sizes up to 1.5 SD. No single variable predicted placebo-related changes. Notably, there was an improvement on objective performance measures of cognition that exceeded previous standards for practice effects. IMPLICATIONS/CONCLUSIONS Participants in this trial manifested retest effects on performance-based measures of cognition. Notably, they had minimal prior experience with performance-based assessments. Experiencing the structure and support of a clinical trial may have contributed to significant reductions in subject-reported and clinician-rated PTSD symptom levels. The improvement seen across all assessment domains was consistent with that seen in previous studies where the active treatments separated from placebo. Investigators conducting clinical trials treating PTSD patients should expect placebo effects and design studies accordingly.
Collapse
|
27
|
Breilmann J, Furukawa TA, Becker T, Koesters M. Differences in the placebo response in duloxetine and venlafaxine trials. Acta Psychiatr Scand 2018; 137:472-480. [PMID: 29603140 DOI: 10.1111/acps.12881] [Citation(s) in RCA: 10] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Accepted: 03/06/2018] [Indexed: 01/23/2023]
Abstract
OBJECTIVE Our analysis aimed at comparing the placebo effect sizes from randomized controlled trials (RCTs) of two widely prescribed antidepressants, namely duloxetine and venlafaxine, and at analysing a potential influence of the investigated drugs on the placebo response. METHOD We conducted a comprehensive systematic review and meta-analysis of placebo-controlled, double-blind RCTs, which examined the efficacy of duloxetine and venlafaxine in the acute treatment of major depressive disorder. RESULTS We included 71 studies (29 duloxetine trials and 43 venlafaxine trials; one study provided data for the duloxetine and the venlafaxine data set). The placebo effect sizes, defined as pre-postscore change divided by baseline standard deviation, differed significantly between venlafaxine and duloxetine studies (-2.51 vs. -2.09; test for subgroup differences P = 0.028; high heterogeneity). The analysis of effect modifiers and the metaregression analyses confirmed the drug, next to baseline depression severity and publication status, as the most influential independent predictor. CONCLUSION Our analyses show a significant difference in the placebo response between venlafaxine and duloxetine trials and suggest that the investigated drug has an influence on the placebo response that is not related to baseline severity, changes over the years or other variables we included.
Collapse
Affiliation(s)
- J Breilmann
- Department of Psychiatry and Psychotherapy II, Ulm University, Bezirkskrankenhaus, Guenzburg, Germany
| | - T A Furukawa
- Department of Health Promotion and Human Behaviour, Kyoto University Graduate School of Medicine/School of Public Health, Kyoto, Japan
| | - T Becker
- Department of Psychiatry and Psychotherapy II, Ulm University, Bezirkskrankenhaus, Guenzburg, Germany
| | - M Koesters
- Department of Psychiatry and Psychotherapy II, Ulm University, Bezirkskrankenhaus, Guenzburg, Germany
| |
Collapse
|
28
|
Carlino E, Vase L. Can knowledge of Placebo and Nocebo Mechanisms Help Improve Randomized Clinical Trials? INTERNATIONAL REVIEW OF NEUROBIOLOGY 2018; 138:329-357. [PMID: 29681333 DOI: 10.1016/bs.irn.2018.01.012] [Citation(s) in RCA: 17] [Impact Index Per Article: 2.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/17/2022]
Abstract
Over the last decade, there has been a substantial increase in negative results from randomized controlled trials (RCTs), which may be due to an increasing placebo response among other factors. Currently, identification and exclusion of placebo responders from trials are attempted to overcome this problem, but so far the success of these approaches has been limited. At the same time, the placebo-mechanism literature has highlighted how contextual factors, such as patients' expectations, interfere with the effect of drug administration, leading to a certain degree of uncertainty in RCTs. In this chapter, we review the current challenges of RCTs including the uncertainties of the active arm, the placebo arm, the additivity assumption, and the double-blind procedure. We use the placebo-mechanism literature to debate the strengths and weaknesses of attempts to identify and exclude placebo responders from trials. Finally, we illustrate how insights from the placebo-mechanism literature may point to new ways of improving RCTs.
Collapse
Affiliation(s)
| | - Lene Vase
- School of Business and Social Sciences, Aarhus University, Aarhus, Denmark.
| |
Collapse
|
29
|
Nakabayashi T, Hara A, Minami H. Impact of demographic factors on the antidepressant effect: A patient-level data analysis from depression trials submitted to the Pharmaceuticals and Medical Devices Agency in Japan. J Psychiatr Res 2018; 98:116-123. [PMID: 29334636 DOI: 10.1016/j.jpsychires.2017.12.019] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 09/01/2017] [Revised: 12/18/2017] [Accepted: 12/31/2017] [Indexed: 12/28/2022]
Abstract
A substantial and variable placebo response can cause unreliable findings in clinical trials designed to demonstrate the efficacy of antidepressants, and the high rate of failed trials represents a major obstacle in the development of new drugs for major depressive disorder (MDD). However, the influence of demographic and symptom factors on the antidepressant effect remains to be established. The purpose of this study was to estimate the magnitude of this influence. A patient-level meta-analysis of data from double-blind, randomized, placebo-controlled trials involving the use of antidepressants for adults with MDD was performed. Data from five confirmatory trials evaluating the efficacy of four antidepressants that were submitted to the Pharmaceuticals and Medical Devices Agency (PMDA) to support new drug applications were pooled (n = 1898). The change in the total score of 17-item Hamilton Depression Rating Scale (HDRS17) was the primary outcome of interest in our analysis. The changes in the total HDRS17 score in both the antidepressant medication group (ADM) and the placebo group (PBO) increased in relation to baseline symptom severity. Among older patients and those with a history of prior treatment with antidepressants, the changes in the total HDRS17 score decreased in ADM and remained static in PBO. There were no notable clinical symptoms that influenced the change in the total HDRS17 score. Baseline symptom severity, participant age and a history of previous treatment with antidepressants were suggested as moderators of the antidepressant effect. The drug-placebo difference in the estimated changes as a function of baseline symptom severity varied depending on the regression models used, and further studies are required to investigate appropriate models.
Collapse
Affiliation(s)
| | - Ayako Hara
- Biostatistics Group, Center for Product Evaluation, Pharmaceuticals and Medical Devices Agency, Japan
| | - Hirofumi Minami
- Office of New Drug IV, Pharmaceuticals and Medical Devices Agency, Japan
| |
Collapse
|
30
|
Silverman RK, Ivanova A, Fine J. Sequential parallel comparison design with binary and time-to-event outcomes. Stat Med 2018; 37:1454-1466. [DOI: 10.1002/sim.7635] [Citation(s) in RCA: 11] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/22/2017] [Revised: 01/19/2018] [Accepted: 01/26/2018] [Indexed: 11/09/2022]
Affiliation(s)
- Rachel Kloss Silverman
- Department of Biostatistics; The University of North Carolina at Chapel Hill; Chapel Hill North Carolina 27599-7420 USA
| | - Anastasia Ivanova
- Department of Biostatistics; The University of North Carolina at Chapel Hill; Chapel Hill North Carolina 27599-7420 USA
| | - Jason Fine
- Department of Biostatistics; The University of North Carolina at Chapel Hill; Chapel Hill North Carolina 27599-7420 USA
| |
Collapse
|
31
|
Targum SD. Early symptomatic improvement affects treatment outcome in a study of major depressive disorder. J Psychiatr Res 2017; 95:276-281. [PMID: 28926793 DOI: 10.1016/j.jpsychires.2017.09.009] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 05/31/2017] [Revised: 07/21/2017] [Accepted: 09/07/2017] [Indexed: 10/18/2022]
Abstract
Early symptomatic improvement immediately following randomization can affect signal detection in clinical trials. The impact of early improvement of the Montgomery-Asberg depression rating scale (MADRS) on eventual treatment outcome was examined in a 6-week, double-blind, placebo-controlled trial of a putative antidepressant (CX157) versus placebo in depressed subjects with major depressive disorder (MDD) who had had an inadequate response to ongoing antidepressant treatment (NCT00739908). MADRS score changes within one week after randomization directly affected treatment outcome at the study endpoint (week 6). The response and remission rates at week 6 increased significantly as the percent of MADRS score improvement increased between baseline and week 1 regardless of treatment assignment. Less MADRS improvement or actual worsening within the first week after randomization was associated with minimal overall MADRS score changes by week 6 in either treatment assignment. Alternatively, CX157 assigned subjects who had ≥30% improvement by week 1 achieved a significantly greater treatment response rate than the matched placebo group at the study endpoint (p = 0.025) that converted the lack of signal detection in the mITT population. This post-hoc analysis highlights the potent effect that early symptomatic improvement immediately following randomization can have on treatment outcome, and is particularly relevant for antidepressant drugs with rapid onset of action. The findings compel further exploration of possible moderating and mediating factors, including the experimental condition itself that can influence early response, and the need to identify "bio-types" within the population of MDD subjects.
Collapse
Affiliation(s)
- Steven D Targum
- Bracket Global LLC, 2 Oliver Street, Suite 1003, Boston, MA 02109, USA.
| |
Collapse
|
32
|
Zhang P, Carroll K, Hobart M, Augustine C, Koch G. A case study in identifying targeted patients population in major depressive disorder by enhanced enrichment design. Pharm Stat 2017; 17:144-154. [PMID: 29152847 DOI: 10.1002/pst.1839] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/27/2017] [Revised: 08/21/2017] [Accepted: 10/02/2017] [Indexed: 11/10/2022]
Abstract
Despite advances in clinical trial design, failure rates near 80% in phase 2 and 50% in phase 3 have recently been reported. The challenges to successful drug development are particularly acute in central nervous system trials such as for pain, schizophrenia, mania, and depression because high-placebo response rates lessen assay sensitivity, diminish estimated treatment effect sizes, and thereby decrease statistical power. This paper addresses the importance of rigorous patient selection in major depressive disorder trials through an enhanced enrichment paradigm. This approach led to a redefinition of an ongoing, blinded phase 3 trial algorithm for patient inclusion (1) to eliminate further randomization of transient placebo responders and (2) to exclude previously randomized transient responders from the primary analysis of the double blind phase of the trial. It is illustrated for a case study for the comparison between brexpiprazole + antidepressant therapy and placebo + antidepressant therapy. Analysis of the primary endpoint showed that efficacy of brexpiprazole versus placebo could not be established statistically if the original algorithm for identification of placebo responders was used, but the enhanced enrichment approach did statistically demonstrate efficacy. Additionally, the enhanced enrichment approach identified a target population with a clinically meaningful treatment effect. Through its successful identification of a target population, the innovative enhanced enrichment approach enabled the demonstration of a positive treatment effect in a very challenging area of depression research.
Collapse
Affiliation(s)
- Peter Zhang
- Otsuka Pharmaceutical Development & Commercialization, Inc., Princeton, NJ, USA
| | | | - Mary Hobart
- Otsuka Pharmaceutical Development & Commercialization, Inc., Princeton, NJ, USA
| | - Carole Augustine
- Otsuka Pharmaceutical Development & Commercialization, Inc., Princeton, NJ, USA
| | - Gary Koch
- University of North Carolina, Chapel Hill, NC, USA
| |
Collapse
|
33
|
Zhang X, Chen YF, Tamura R. The plan of enrichment designs for dealing with high placebo response. Pharm Stat 2017; 17:25-37. [PMID: 29094519 DOI: 10.1002/pst.1833] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/24/2015] [Revised: 08/23/2017] [Accepted: 09/05/2017] [Indexed: 12/17/2022]
Abstract
To deal with high placebo response in clinical trials for psychiatric and other diseases, different enrichment designs, such as the sequential parallel design, two-way enriched design, and sequential enriched design, have been proposed and implemented recently. Depending on the historical trial information and the trial sponsors' resources, detailed design elements are needed for determining which design to adopt. To assist in making more suitable decisions, we perform evaluations for selecting required design elements in terms of power optimization and sample size planning. We also discuss the implementation of the interim analysis related to its applicability.
Collapse
Affiliation(s)
| | - Yeh-Fong Chen
- Division of Biometric III, Office of Biostatistics, Office of Translational Sciences, Center of Drug Evaluation and Research (CDER), US Food and Drug Administration, Silver Spring, MD, USA
| | - Roy Tamura
- Health Informatics Institute, University of South Florida, Tampa, FL, USA
| |
Collapse
|
34
|
Silverman RK, Ivanova A. Sample size re-estimation and other midcourse adjustments with sequential parallel comparison design. J Biopharm Stat 2017; 27:416-425. [PMID: 28166457 DOI: 10.1080/10543406.2017.1289951] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/20/2022]
Abstract
Sequential parallel comparison design (SPCD) was proposed to reduce placebo response in a randomized trial with placebo comparator. Subjects are randomized between placebo and drug in stage 1 of the trial, and then, placebo non-responders are re-randomized in stage 2. Efficacy analysis includes all data from stage 1 and all placebo non-responding subjects from stage 2. This article investigates the possibility to re-estimate the sample size and adjust the design parameters, allocation proportion to placebo in stage 1 of SPCD, and weight of stage 1 data in the overall efficacy test statistic during an interim analysis.
Collapse
Affiliation(s)
- Rachel K Silverman
- a Department of Biostatistics , The University of North Carolina at Chapel Hill , Chapel Hill , North Carolina , USA
| | - Anastasia Ivanova
- a Department of Biostatistics , The University of North Carolina at Chapel Hill , Chapel Hill , North Carolina , USA
| |
Collapse
|
35
|
Using Placebo Response to Pain as a Predictor of Placebo Response in Mood Disorders. Curr Behav Neurosci Rep 2016. [DOI: 10.1007/s40473-016-0092-3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 10/20/2022]
|
36
|
Greenberg RP, Fisher S, Riter JA. Placebo Washout is not a Meaningful Part of Antidepressant Drug Trials. Percept Mot Skills 2016; 81:688-90. [PMID: 8570378 DOI: 10.1177/003151259508100264] [Citation(s) in RCA: 11] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
Abstract
Most trials testing the effectiveness of psychotropic drugs begin with a placebo washout phase. Hypothetically this technique rids studies of placebo re-spenders before randomization of subjects to drug and placebo groups. In theory, this lowers the level of response to placebo in the study and magnifies the superiority of the response to medication. An analysis of 10 years of research literature demonstrates that the washout technique does not do what it was designed to do in antidepressant studies. Within placebo or drug groups neither measures of depression nor dropouts were affected by including a preliminary washout in the design. The findings are consistent with the two other studies that have addressed this issue.
Collapse
Affiliation(s)
- R P Greenberg
- Department of Psychiatry and Behavioral Sciences, State University of New York Health Science Center, Syracuse 13210, USA
| | | | | |
Collapse
|
37
|
Wilsey B, Deutsch R, Marcotte TD. Maintenance of Blinding in Clinical Trials and the Implications for Studying Analgesia Using Cannabinoids. Cannabis Cannabinoid Res 2016; 1:139-148. [PMID: 28861490 PMCID: PMC5549444 DOI: 10.1089/can.2016.0016] [Citation(s) in RCA: 13] [Impact Index Per Article: 1.6] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/15/2022] Open
Abstract
The design of analgesic clinical trials invariably involves a comparison between placebo and active study medication. An assumption is made that treatment effects can be approximated by subtracting the response to placebo from that attained with the use of active study medication. However, the psychoactivity of cannabinoids may unmask their presence and lead to an expectation and/or conditioning of pain relief. For example, study participants biased toward the belief that cannabis is beneficial for their condition might be more inclined to report positive effects if they were to accurately identify the active treatment because of its psychoactivity. This may lead to incorrect assumptions regarding the efficacy of a cannabinoid. Methodologies designed to counteract unmasking need to be implemented in the design phase of a study. During the clinical trial, it is also important to query participants as to which treatment they believe they have received. Blinding can be considered to be preserved when the accuracy of treatment guesses is not considerably different than random guessing, which is estimated to be correct 50% of the time. After a study has been completed, the use of statistical methodologies such as regression and mediation analysis are worthy of consideration to see whether psychoactive effects biased the results.
Collapse
Affiliation(s)
- Barth Wilsey
- Department of Psychiatry, Center for Medicinal Cannabis Research, University of California, San Diego, San Diego, California
| | - Reena Deutsch
- Department of Psychiatry, Center for Medicinal Cannabis Research, University of California, San Diego, San Diego, California
| | - Thomas D. Marcotte
- Department of Psychiatry, Center for Medicinal Cannabis Research, University of California, San Diego, San Diego, California
| |
Collapse
|
38
|
Young AS, Meers MR, Vesco AT, Seidenfeld AM, Arnold LE, Fristad MA. Predicting Therapeutic Effects of Psychodiagnostic Assessment Among Children and Adolescents Participating in Randomized Controlled Trials. JOURNAL OF CLINICAL CHILD AND ADOLESCENT PSYCHOLOGY 2016; 48:S1-S12. [PMID: 27105332 DOI: 10.1080/15374416.2016.1146992] [Citation(s) in RCA: 7] [Impact Index Per Article: 0.9] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 10/21/2022]
Abstract
This study explored predictors of improvement after completing a psychodiagnostic screening assessment but before randomization among youth who participated in two pilot randomized controlled trials of omega-3 supplementation and Individual-Family Psychoeducational Psychotherapy (PEP). Ninety-five youth (56.8% male, 61.1% White) ages 7-14 with mood disorders completed screening and baseline assessments (including Clinical Global Impressions-Improvement [CGI-I], Children's Depression Rating Scale-Revised, Young Mania Rating Scale), then were randomized into a 12-week trial of omega-3, PEP, their combination, or placebo. Between screening and randomization, 35.8% minimally improved (CGI-I = 3), 12.6% much improved (CGI-I < 3), totaling 48.4% improved. Caregiver postsecondary education (p = .018), absence of attention-deficit/hyperactivity disorder (p = .027), and lower screen depression severity (p = .034) were associated with CGI-I. Caregiver postsecondary education (p = .020) and absence of a disruptive behavior diagnosis (p = .038) were associated with depression severity improvement. Prerandomization improvement moderated treatment outcomes: Among youth who improved prerandomization, those who received PEP (alone or with omega-3) had more favorable placebo-controlled depression trajectories due to a lack of placebo response. This open-label trial of psychodiagnostic assessment provides suggestive evidence that psychodiagnostic assessment is beneficial, especially for those with depression and without externalizing disorders. Prerandomization improvement is associated with better placebo-controlled treatment response. Future research should test alternative hypotheses for change and determine if less intensive (shorter and/or automated) assessments would provide comparable results.
Collapse
Affiliation(s)
- Andrea S Young
- a Department of Psychiatry and Behavioral Health , The Ohio State University
| | - Molly R Meers
- a Department of Psychiatry and Behavioral Health , The Ohio State University
| | - Anthony T Vesco
- a Department of Psychiatry and Behavioral Health , The Ohio State University
| | - Adina M Seidenfeld
- a Department of Psychiatry and Behavioral Health , The Ohio State University
| | - L Eugene Arnold
- a Department of Psychiatry and Behavioral Health , The Ohio State University
| | - Mary A Fristad
- a Department of Psychiatry and Behavioral Health , The Ohio State University
| |
Collapse
|
39
|
Holmes RD, Tiwari AK, Kennedy JL. Mechanisms of the placebo effect in pain and psychiatric disorders. THE PHARMACOGENOMICS JOURNAL 2016; 16:491-500. [PMID: 27001122 DOI: 10.1038/tpj.2016.15] [Citation(s) in RCA: 27] [Impact Index Per Article: 3.4] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/30/2014] [Revised: 11/17/2015] [Accepted: 01/20/2016] [Indexed: 02/07/2023]
Abstract
Placebo effect research over the past 15 years has improved our understanding of how placebo treatments reduce patient symptoms. The expectation of symptom improvement is the primary factor underlying the placebo effect. Such expectations are shaped by past experiences, contextual cues and biological traits, which ultimately modulate one's degree of response to a placebo. The body of evidence that describes the physiology of the placebo effect has been derived from mechanistic studies primarily restricted to the setting of pain. Imaging findings support the role of endogenous opioid and dopaminergic networks in placebo analgesia in both healthy patients as well as patients with painful medical conditions. In patients with psychiatric illnesses such as anxiety disorders or depression, a vast overlap in neurological changes is observed in drug responders and placebo responders supporting the role of serotonergic networks in placebo response. Molecular techniques have been relatively underutilized in understanding the placebo effect until recently. We present an overview of the placebo responder phenotypes and genetic markers that have been associated with the placebo effect in pain, schizophrenia, anxiety disorders and depression.
Collapse
Affiliation(s)
- R D Holmes
- Neurogenetics Section, Neuroscience Department, Centre for Addiction and Mental Health, Toronto, Ontario, Canada
| | - A K Tiwari
- Neurogenetics Section, Neuroscience Department, Centre for Addiction and Mental Health, Toronto, Ontario, Canada
| | - J L Kennedy
- Neurogenetics Section, Neuroscience Department, Centre for Addiction and Mental Health, Toronto, Ontario, Canada
| |
Collapse
|
40
|
Shiovitz TM, Bain EE, McCann DJ, Skolnick P, Laughren T, Hanina A, Burch D. Mitigating the Effects of Nonadherence in Clinical Trials. J Clin Pharmacol 2016; 56:1151-64. [PMID: 26634893 PMCID: PMC5066799 DOI: 10.1002/jcph.689] [Citation(s) in RCA: 64] [Impact Index Per Article: 8.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/02/2015] [Accepted: 11/27/2015] [Indexed: 11/26/2022]
Abstract
Accounting for subject nonadherence and eliminating inappropriate subjects in clinical trials are critical elements of a successful study. Nonadherence can increase variance, lower study power, and reduce the magnitude of treatment effects. Inappropriate subjects (including those who do not have the illness under study, fail to report exclusionary conditions, falsely report medication adherence, or participate in concurrent trials) confound safety and efficacy signals. This paper, a product of the International Society for CNS Clinical Trial Methodology (ISCTM) Working Group on Nonadherence in Clinical Trials, explores and models nonadherence in clinical trials and puts forth specific recommendations to identify and mitigate its negative effects. These include statistical analyses of nonadherence data, novel protocol design, and the use of biomarkers, subject registries, and/or medication adherence technologies.
Collapse
Affiliation(s)
- Thomas M Shiovitz
- California Neuroscience Research Medical Group, Sherman Oaks, CA, USA.,CTSdatabase, LLC, Beverly Hills, CA, USA
| | - Earle E Bain
- Global Pharmaceutical Research and Development, AbbVie, Inc, North Chicago, IL, USA
| | - David J McCann
- Division of Therapeutics and Medical Consequences, NIDA, NIH, Bethesda, MD, USA
| | - Phil Skolnick
- Division of Therapeutics and Medical Consequences, NIDA, NIH, Bethesda, MD, USA
| | - Thomas Laughren
- Director of Regulatory Affairs, Massachusetts General Hospital Clinical Trial Network and Institute, Boston, MA, USA
| | | | - Daniel Burch
- Pharmaceutical Product Development, LLC, Wilmington, NC, USA
| |
Collapse
|
41
|
Abstract
BACKGROUND High response under placebo constitutes a concern in clinical studies, particularly in psychiatry. Discontinuation of placebo responders identified during a placebo run-in is often recommended to avoid failures of clinical trials in the presence of high placebo effects. Evidence for the benefit of this approach is ambiguous. PURPOSE We investigate under which conditions a placebo lead-in can be beneficial in the context of continuous data, assuming that the data in the placebo run-in and the treatment stage follow a bivariate normal distribution. Placebo responders are defined as patients with an effect during placebo lead-in which is larger than a pre-defined threshold on the absolute value or the absolute or relative change from baseline or a combination thereof. RESULTS Data are less variable under either placebo or test treatment after placebo responders have been removed. Whether the effect of test over placebo increases or decreases after enrichment for placebo non-responders depends on the parameters of the distribution, in particular the covariance structure, and the threshold in the definition of placebo responders. LIMITATIONS The results apply in the continuous case, and the binary or ordinary case is not studied. The findings explain to some extent the ambiguity in the assessments of the usefulness of placebo lead-in periods in clinical trials; however, besides the clear statement on variability reduction, it is not straightforward to judge upfront whether placebo lead-in is useful. Concerns relating to the conduct and interpretation of results of such trials are mentioned.
Collapse
|
42
|
Brown MA, Bishnoi RJ, Dholakia S, Velligan DI. Methodological issues associated with preclinical drug development and increased placebo effects in schizophrenia clinical trials. Expert Rev Clin Pharmacol 2015; 9:591-604. [PMID: 26696325 DOI: 10.1586/17512433.2016.1135734] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
Abstract
Recent failures to detect efficacy in clinical trials investigating pharmacological treatments for schizophrenia raise concerns regarding the potential contribution of methodological shortcomings to this research. This review provides an examination of two key methodological issues currently suspected of playing a role in hampering schizophrenia drug development; 1) limitations on the translational utility of preclinical development models, and 2) methodological challenges posed by increased placebo effects. Recommendations for strategies to address these methodological issues are addressed.
Collapse
Affiliation(s)
- Matt A Brown
- a Department of Psychiatry , University of Texas Health Science Center at San Antonio , San Antonio , TX , USA
| | - Ram J Bishnoi
- a Department of Psychiatry , University of Texas Health Science Center at San Antonio , San Antonio , TX , USA
| | - Sara Dholakia
- a Department of Psychiatry , University of Texas Health Science Center at San Antonio , San Antonio , TX , USA
| | - Dawn I Velligan
- a Department of Psychiatry , University of Texas Health Science Center at San Antonio , San Antonio , TX , USA
| |
Collapse
|
43
|
Rutherford BR, Bailey VS, Schneier FR, Pott E, Brown PJ, Roose SP. INFLUENCE OF STUDY DESIGN ON TREATMENT RESPONSE IN ANXIETY DISORDER CLINICAL TRIALS. Depress Anxiety 2015; 32:944-57. [PMID: 26437267 PMCID: PMC4922308 DOI: 10.1002/da.22433] [Citation(s) in RCA: 14] [Impact Index Per Article: 1.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 05/26/2015] [Revised: 08/05/2015] [Accepted: 09/12/2015] [Indexed: 12/18/2022] Open
Abstract
OBJECTIVE The influence of study design variables and publication year on response to medication and placebo was investigated in clinical trials for social anxiety disorder (SAD), generalized anxiety disorder (GAD), and panic disorder (PD). METHOD Hierarchical linear modeling determined whether publication year, treatment assignment (medication vs. placebo), study type (placebo-controlled or active comparator), study duration, and the number of study visits affected the mean change associated with medication and placebo. RESULTS In the 66 trials examined, the change associated with both medication and placebo increased over time (t = 4.23, df = 39, P < .001), but average drug-placebo differences decreased over time (t = -2.04, df = 46, P = .047). More severe baseline illness was associated with greater drug-placebo differences for serotonin norepinephrine reuptake inhibitors (SNRIs, t = 3.46, df = 106, P = .001) and selective serotonin reuptake inhibitors (SSRI, t = 10.37, df = 106, P < .001). Improvement with medication was significantly greater in active-comparator studies compared to placebo-controlled trials (t = 3.41, df = 39, P = .002). A greater number of study visits was associated with greater symptom improvement in PD trials relative to SAD (t = 2.83, df = 39, P = .008) and GAD (t = 2.16, df = 39, P = .037). CONCLUSIONS Placebo response is substantial in SAD, GAD, and PD trials, and its rise over time has been associated with diminished drug-placebo differences. Study design features that influence treatment response in anxiety disorder trials include patient expectancy, frequency of follow-up visits, and baseline illness severity.
Collapse
Affiliation(s)
- Bret R Rutherford
- Columbia University College of Physicians and Surgeons, New York State Psychiatric Institute, New York, New York,Correspondence to: Bret R. Rutherford, Columbia University College of Physicians and Surgeons, New York State Psychiatric Institute, 1051 Riverside Drive, Box 98, New York, NY 10032.
| | | | - Franklin R. Schneier
- Columbia University College of Physicians and Surgeons, New York State Psychiatric Institute, New York, New York
| | - Emily Pott
- New York State Psychiatric Institute, New York, New York
| | - Patrick J. Brown
- Columbia University College of Physicians and Surgeons, New York State Psychiatric Institute, New York, New York
| | - Steven P. Roose
- Columbia University College of Physicians and Surgeons, New York State Psychiatric Institute, New York, New York
| |
Collapse
|
44
|
The VA augmentation and switching treatments for improving depression outcomes (VAST-D) study: Rationale and design considerations. Psychiatry Res 2015; 229:760-70. [PMID: 26279130 DOI: 10.1016/j.psychres.2015.08.005] [Citation(s) in RCA: 17] [Impact Index Per Article: 1.9] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 04/10/2015] [Revised: 07/22/2015] [Accepted: 08/04/2015] [Indexed: 11/22/2022]
Abstract
Because two-thirds of patients with Major Depressive Disorder do not achieve remission with their first antidepressant, we designed a trial of three "next-step" strategies: switching to another antidepressant (bupropion-SR) or augmenting the current antidepressant with either another antidepressant (bupropion-SR) or with an atypical antipsychotic (aripiprazole). The study will compare 12-week remission rates and, among those who have at least a partial response, relapse rates for up to 6 months of additional treatment. We review seven key efficacy/effectiveness design decisions in this mixed "efficacy-effectiveness" trial.
Collapse
|
45
|
Gomeni R, Goyal N, Bressolle F, Fava M. A Novel Methodology to Estimate the Treatment Effect in Presence of Highly Variable Placebo Response. Neuropsychopharmacology 2015; 40:2588-95. [PMID: 25895454 PMCID: PMC4569948 DOI: 10.1038/npp.2015.105] [Citation(s) in RCA: 6] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 01/07/2015] [Revised: 03/17/2015] [Accepted: 04/08/2015] [Indexed: 11/09/2022]
Abstract
One of the main reasons for the inefficiency of multicenter randomized clinical trials (RCTs) in depression is the excessively high level of placebo response. The aim of this work was to propose a novel methodology to analyze RCTs based on the assumption that centers with high placebo response are less informative than the other centers for estimating the 'true' treatment effect (TE). A linear mixed-effect modeling approach for repeated measures (MMRM) was used as a reference approach. The new method for estimating TE was based on a nonlinear longitudinal modeling of clinical scores (NLMMRM). NLMMRM estimates TE by associating a weighting factor to the data collected in each center. The weight was defined by the posterior probability of detecting a clinically relevant difference between active treatment and placebo at that center. Data from five RCTs in depression were used to compare the performance of MMRM with NLMMRM. The results of the analyses showed an average improvement of ~15% in the TE estimated with NLMMRM when the center effect was included in the analyses. Opposite results were observed with MMRM: TE estimate was reduced by ~4% when the center effect was considered as covariate in the analysis. The novel NLMMRM approach provides a tool for controlling the confounding effect of high placebo response, to increase signal detection and to provide a more reliable estimate of the 'true' TE by controlling false negative results associated with excessively high placebo response.
Collapse
Affiliation(s)
- Roberto Gomeni
- R&D Department, Pharmacometrica, Longcol, La Fouillade, France,R&D, Pharmacometrica, Lieu-dit Longcol, La Fouillade, 12270, France, Tel: +33 760451976, Fax: +33 983233188, E-mail:
| | - Navin Goyal
- Clinical Pharmacology Modeling and Simulation Department, GlaxoSmithKline, King of Prussia, PA, USA
| | | | - Maurizio Fava
- Psychiatry Department, Massachusetts General Hospital, Boston, MA, USA
| |
Collapse
|
46
|
Nakonezny PA, Mayes TL, Byerly MJ, Emslie GJ. Predicting placebo response in adolescents with major depressive disorder: The Adolescent Placebo Impact Composite Score (APICS). J Psychiatr Res 2015; 68:346-53. [PMID: 26028546 DOI: 10.1016/j.jpsychires.2015.05.003] [Citation(s) in RCA: 10] [Impact Index Per Article: 1.1] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 01/27/2015] [Revised: 04/17/2015] [Accepted: 05/07/2015] [Indexed: 11/25/2022]
Abstract
OBJECTIVE The aim of this study was to construct a composite scoring system to predict the probability of placebo response in adolescents with Major Depressive Disorder (MDD). METHOD Participants of the current study were 151 adolescents (aged 12-17 years) who were randomized to the placebo arm (placebo transdermal patches) of a randomized controlled trial (RCT) comparing the selegiline transdermal patch with placebo (DelBello et al., 2014). The primary outcome of response was defined as a CGI-I score of 1 or 2 (very much or much improved) at week 12 (study-end) or exit. As a first step, a multiple logistic mixed model was used to estimate the odds of placebo response from each predictor in the model, including age, CDRS-R total at baseline (depressive symptom severity), history of recurrent depression (yes vs. no), sex (female vs. male), and race (non-Caucasian vs. Caucasian). On the basis of the initial logistic mixed model analysis, we then constructed an Adolescent Placebo Impact Composite Score (APICS) that became the sole predictor in a re-specified Bayesian logistic regression model to estimate the probability of placebo response. Finally, the AUC for the APICS was tested against a nominal area of 0.50 to evaluate how well the APICS discriminated placebo response status. RESULTS Among the 151 adolescents, with a mean age of 14.6 years (SD = 1.6) and a mean baseline CDRS-R total of 60.6 (SD = 12.1), 68.2% were females, 50.3% was Caucasian, and 39.7% had a history of recurrent depression. Placebo response rate was 58.3%. Based on the logistic mixed model, the re-specified equation with the highest discriminatory ability to estimate the probability of placebo response was APICS = age + (0.32 × CDRS-R Total at baseline) + (-2.85 × if female) + (-5.50 × if history of recurrent depression) + (-5.85 × if non-Caucasian). The AUC for this model was 0.59 (p = .049). Within a Bayesian decision-theoretic framework, in 95.5% of the time, the 10,000 posterior Monte Carlo samples suggested that as APICS decreased the probability of placebo response increased. The observed APICS and related probability of responding to placebo in this adolescent sample ranged from 14.1 = 74.1% (in placebo responders) to 39.1 = 41.8% (in placebo non-responders). CONCLUSION The APICS model estimates the probability of placebo response in adolescents with MDD with a modest degree of accuracy (AUC = 0.59) and with a reasonable degree of positive predictive value (74.5%), and is based on five previously identified patient characteristics of placebo response from prior meta-analytic studies (Bridge et al., 2009; Cohen et al., 2010) of randomized placebo-controlled trials of antidepressants in youth with MDD. Calculation of the APICS should be restricted to the range of the adolescent ages (12-17 years) and CDRS-R total scores (17-113); thus, the APICS can assume possible calculated values and related probability of responding to placebo ranging from about 3 (84%) to 53 (25%). The APICS Bayesian logistic model, based on a given aggregate patient profile, has a range of predicted probabilities of placebo response that is fairly wide, albeit truncated, but potentially meaningful for predicting the probability of placebo response among adolescent youth with MDD. The ability of the APICS to objectify the probability of placebo response in adolescents with MDD could be accounted for in the clinical research design of the trial itself and perhaps aid clinicians in treatment strategy for youth who are more likely to experience placebo response.
Collapse
Affiliation(s)
- Paul A Nakonezny
- Department of Psychiatry, University of Texas Southwestern Medical Center, USA; Department of Clinical Sciences, Division of Biostatistics, University of Texas Southwestern Medical Center, USA.
| | - Taryn L Mayes
- Department of Psychiatry, University of Texas Southwestern Medical Center, USA; Children's Medical Center of Dallas, USA
| | - Matthew J Byerly
- Department of Psychiatry, University of Texas Southwestern Medical Center, USA
| | - Graham J Emslie
- Department of Psychiatry, University of Texas Southwestern Medical Center, USA; Children's Medical Center of Dallas, USA
| |
Collapse
|
47
|
Chen YF, Zhang X, Tamura RN, Chen CM. A sequential enriched design for target patient population in psychiatric clinical trials. Stat Med 2015; 33:2953-67. [PMID: 25927082 DOI: 10.1002/sim.6116] [Citation(s) in RCA: 11] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/09/2022]
Abstract
High placebo response is widely believed to be one major reason why many psychiatric clinical trials fail to demonstrate drug efficacy. In order to alleviate this problem, research has developed several enrichment designs, including the parallel design with a placebo lead-in phase, the sequential parallel design, and a recently proposed two-way enriched design. While these designs have been evaluated and discussed individually, their effectiveness against each other has not been rigorously compared. The current study examines the various enrichment designs simultaneously. Building on their strengths, we introduce a new improved design named' sequential enriched design' (SED) aimed at removing not only patients with high placebo response but also patients who do not respond to any treatment from the study. The SED begins with a double-blind placebo lead-in phase followed by a traditional parallel design in the first stage. Only patients who respond to the drug in the first stage are re-randomized to the drug or placebo at the second stage. We simulate data for a mixed population composed of four subgroups of patients who are predetermined as to whether they respond to drug or not as well as to placebo or not. By focusing on the target patients whose responses reflect the drug's efficacy,we evaluate the bias, mean squared error, and power for different designs. We demonstrate that the SED produces a less biased estimate for the target treatment effect and yields reasonably high power in general compared with the other designs.
Collapse
Affiliation(s)
- Yeh-Fong Chen
- Division of Biometrics I, Office of Biostatistics, Office of Translational Sciences, Center of Drug Evaluation and Research (CDER), US Food and Drug Administration, Silver Spring, MD, U.S.A
| | | | | | | |
Collapse
|
48
|
Vase L, Amanzio M, Price DD. Nocebo vs. placebo: the challenges of trial design in analgesia research. Clin Pharmacol Ther 2015; 97:143-50. [PMID: 25670519 DOI: 10.1002/cpt.31] [Citation(s) in RCA: 39] [Impact Index Per Article: 4.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/19/2014] [Revised: 10/28/2014] [Accepted: 11/04/2014] [Indexed: 02/06/2023]
Abstract
The placebo effect in randomized clinical trials appears to have increased thereby contributing to problems of demonstrating statistically reliable effects of treatments that directly target biological mechanisms. The shortcomings of randomized clinical trials are currently discussed along with potential improvements of trial designs. In this review we explain how utilizing knowledge from the placebo and nocebo mechanisms literature could improve the information that can be obtained from randomized clinical trials. We present three major challenges in randomized clinical trials: (i) increasing placebo effects, (ii) variability of the placebo effect, and (iii) risk of un-blinding. We then explain how recent placebo and nocebo studies of effects of verbal suggestion, expectancy, and emotions may improve understanding and discussion of increasing placebo effects, account/control for large parts of the variability of placebo effects, and suggest ways to improve blinding in future trials.
Collapse
Affiliation(s)
- L Vase
- Department of Psychology and Behavioural Sciences, School of Business and Social Sciences, Aarhus University, Aarhus, Denmark
| | | | | |
Collapse
|
49
|
Fountoulakis KN, McIntyre RS, Carvalho AF. From Randomized Controlled Trials of Antidepressant Drugs to the Meta-Analytic Synthesis of Evidence: Methodological Aspects Lead to Discrepant Findings. Curr Neuropharmacol 2015; 13:605-15. [PMID: 26467410 PMCID: PMC4761632 DOI: 10.2174/1570159x13666150630174343] [Citation(s) in RCA: 9] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/01/2014] [Revised: 01/20/2015] [Accepted: 01/20/2015] [Indexed: 01/20/2023] Open
Abstract
During the last decade, several meta-analytic studies employing different methodological approaches have had inconsistent conclusions regarding antidepressant efficacy. Herein, we aim to comment on methodological aspects that may have contributed to disparate findings. We initially discuss methodological inconsistencies and limitations related to the conduct of individual antidepressant randomized controlled trials (RCTs), including differences in allocated samples, limitations of psychometric scales, possible explanations for the heightened placebo response rates in antidepressant RCTs across the past two decades as well as the reporting of conflicts of interest. In the second part of this article, we briefly describe the various meta-analyses techniques (e.g., simple random effects meta-analysis and network meta-analysis) and the application of these methods to synthesize evidence related to antidepressant efficacy. Recently published antidepressant metaanalyses often provide discrepant results and similar results often lead to different interpretations. Finally, we propose strategies to improve methodology considering real-world clinical scenarios.
Collapse
Affiliation(s)
| | | | - André F Carvalho
- 6, Odysseos str (1st Parodos Ampelonon str.), 55535 Pylaia Thessaloniki, Greece.
| |
Collapse
|
50
|
Rutherford BR, Wall MM, Glass A, Stewart JW. The role of patient expectancy in placebo and nocebo effects in antidepressant trials. J Clin Psychiatry 2014; 75:1040-6. [PMID: 25006812 PMCID: PMC4221413 DOI: 10.4088/jcp.13m08797] [Citation(s) in RCA: 35] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 09/16/2013] [Accepted: 12/31/2013] [Indexed: 10/25/2022]
Abstract
OBJECTIVE To determine whether patient expectancy plays a role in observed placebo and nocebo effects in 2 clinical trials. METHOD Data were reanalyzed from 2 fluoxetine-discontinuation studies conducted from March 1990 to September 1992 and from May 1997 to December 2002. The 673 outpatients included were aged 18-65 years with DSM-III-R major depressive disorder (MDD), responded to 12-week duration open treatment, and were randomized to continued fluoxetine or placebo for an additional year. Participants in 1 of the included studies received a fixed dose of fluoxetine 20 mg daily, while the second study utilized flexible fluoxetine doses up to 60 mg daily. Mixed effects longitudinal models determined whether the possible randomization to placebo at 12 weeks resulted in significant depressive symptom worsening across treatments. Correlations were computed between early symptom change (weeks 1-3 of open treatment) and postrandomization symptom change (weeks 13-16 following randomization). RESULTS Participants continuing to receive fluoxetine and those switched to placebo had significantly higher mean Hamilton Depression Rating Scale (HDRS) scores immediately postrandomization compared to the final weeks of open treatment (P < .001 for both fluoxetine- and placebo-treated patients). In both studies, early HDRS change was significantly correlated with postrandomization HDRS change for patients receiving fluoxetine (r = -0.46, P < .001) as well as placebo (r = -0.48, P < .001). CONCLUSIONS The possibility of receiving placebo following 12 weeks of open fluoxetine was associated with significant symptom worsening in 2 large fluoxetine discontinuation studies. Worsening depression scores following randomization were significantly associated with the degree of improvement participants experienced during weeks 1-3 of open treatment. These results suggest that treatment changes influence patients' expectations of improvement, which, in turn, affect their depressive symptoms.
Collapse
Affiliation(s)
- Bret R Rutherford
- Columbia University College of Physicians and Surgeons, Department of Psychiatry, New York State Psychiatric Institute, 1051 Riverside Drive, Box 98, New York, NY 10032
| | - Melanie M. Wall
- Columbia University College of Physicians and Surgeons, New York State Psychiatric Institute
| | - Andrew Glass
- Columbia University College of Physicians and Surgeons, New York State Psychiatric Institute
| | - Jonathan W. Stewart
- Columbia University College of Physicians and Surgeons, New York State Psychiatric Institute
| |
Collapse
|