1
|
Thai M, Nair AU, Klimes-Dougan B, Albott CS, Silamongkol T, Corkrum M, Hill D, Roemer JW, Lewis CP, Croarkin PE, Lim KO, Widge AS, Nahas Z, Eberly LE, Cullen KR. Deep transcranial magnetic stimulation for adolescents with treatment-resistant depression: A preliminary dose-finding study exploring safety and clinical effectiveness. J Affect Disord 2024; 354:589-600. [PMID: 38484878 PMCID: PMC11163675 DOI: 10.1016/j.jad.2024.03.061] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 04/18/2023] [Revised: 02/20/2024] [Accepted: 03/09/2024] [Indexed: 03/26/2024]
Abstract
BACKGROUND Transcranial magnetic stimulation (TMS) is an intervention for treatment-resistant depression (TRD) that modulates neural activity. Deep TMS (dTMS) can target not only cortical but also deeper limbic structures implicated in depression. Although TMS has demonstrated safety in adolescents, dTMS has yet to be applied to adolescent TRD. OBJECTIVE/HYPOTHESIS This pilot study evaluated the safety, tolerability, and clinical effects of dTMS in adolescents with TRD. We hypothesized dTMS would be safe, tolerable, and efficacious for adolescent TRD. METHODS 15 adolescents with TRD (Age, years: M = 16.4, SD = 1.42) completed a six-week daily dTMS protocol targeting the left dorsolateral prefrontal cortex (BrainsWay H1 coil, 30 sessions, 10 Hz, 3.6 s train duration, 20s inter-train interval, 55 trains; 1980 total pulses per session, 80 % to 120 % of motor threshold). Participants completed clinical, safety, and neurocognitive assessments before and after treatment. The primary outcome was depression symptom severity measured by the Children's Depression Rating Scale-Revised (CDRS-R). RESULTS 14 out of 15 participants completed the dTMS treatments. One participant experienced a convulsive syncope; the other participants only experienced mild side effects (e.g., headaches). There were no serious adverse events and minimal to no change in cognitive performance. Depression symptom severity significantly improved pre- to post-treatment and decreased to a clinically significant degree after 10 treatment sessions. Six participants met criteria for treatment response. LIMITATIONS Main limitations include a small sample size and open-label design. CONCLUSIONS These findings provide preliminary evidence that dTMS may be tolerable and associated with clinical improvement in adolescent TRD.
Collapse
Affiliation(s)
- Michelle Thai
- Department of Psychology, University of Minnesota, Twin Cities, MN, United States of America; Center for Depression, Anxiety, and Stress Research, McLean Hospital, Belmont, MA, United States of America; Department of Psychiatry, Harvard Medical School, United States of America.
| | - Aparna U Nair
- Department of Psychiatry & Behavioral Sciences, University of Minnesota Medical School, Minneapolis, MN, United States of America
| | - Bonnie Klimes-Dougan
- Department of Psychology, University of Minnesota, Twin Cities, MN, United States of America
| | - C Sophia Albott
- Department of Psychiatry & Behavioral Sciences, University of Minnesota Medical School, Minneapolis, MN, United States of America
| | - Thanharat Silamongkol
- Graduate School of Applied and Professional Psychology, Rutgers, The State University of New Jersey, New Brunswick, NJ, United States of America
| | - Michelle Corkrum
- Columbia University Medical Center, New York, NY, United States of America
| | - Dawson Hill
- University of Michigan Medical School, Ann Arbor, MI, United States of America
| | - Justin W Roemer
- Department of Psychiatry & Behavioral Sciences, University of Minnesota Medical School, Minneapolis, MN, United States of America
| | - Charles P Lewis
- Department of Psychiatry & Behavioral Sciences, University of Minnesota Medical School, Minneapolis, MN, United States of America
| | - Paul E Croarkin
- Department of Psychiatry and Psychology, Mayo Clinic, Rochester, MN, United States of America
| | - Kelvin O Lim
- Department of Psychiatry & Behavioral Sciences, University of Minnesota Medical School, Minneapolis, MN, United States of America
| | - Alik S Widge
- Department of Psychiatry & Behavioral Sciences, University of Minnesota Medical School, Minneapolis, MN, United States of America
| | - Ziad Nahas
- Department of Psychiatry & Behavioral Sciences, University of Minnesota Medical School, Minneapolis, MN, United States of America
| | - Lynn E Eberly
- Division of Biostatistics, School of Public Health, University of Minnesota, United States of America
| | - Kathryn R Cullen
- Department of Psychiatry & Behavioral Sciences, University of Minnesota Medical School, Minneapolis, MN, United States of America
| |
Collapse
|
2
|
Bjornstad G, Sonthalia S, Rouse B, Freeman L, Hessami N, Dunne JH, Axford N. A comparison of the effectiveness of cognitive behavioural interventions based on delivery features for elevated symptoms of depression in adolescents: A systematic review. CAMPBELL SYSTEMATIC REVIEWS 2024; 20:e1376. [PMID: 38188230 PMCID: PMC10771715 DOI: 10.1002/cl2.1376] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 09/19/2023] [Accepted: 11/03/2023] [Indexed: 01/09/2024]
Abstract
Background Depression is a public health problem and common amongst adolescents. Cognitive behavioural therapy (CBT) is widely used to treat adolescent depression but existing research does not provide clear conclusions regarding the relative effectiveness of different delivery modalities. Objectives The primary aim is to estimate the relative efficacy of different modes of CBT delivery compared with each other and control conditions for reducing depressive symptoms in adolescents. The secondary aim is to compare the different modes of delivery with regard to intervention completion/attrition (a proxy for intervention acceptability). Search Methods The Cochrane Depression, Anxiety and Neurosis Clinical Trials Register was searched in April 2020. MEDLINE, PsycInfo, EMBASE, four other electronic databases, the CENTRAL trial registry, Google Scholar and Google were searched in November 2020, together with reference checking, citation searching and hand-searching of two databases. Selection Criteria Randomised controlled trials (RCTs) of CBT interventions (irrespective of delivery mode) to reduce symptoms of depression in young people aged 10-19 years with clinically relevant symptoms or diagnosis of depression were included. Data Collection and Analysis Screening and data extraction were completed by two authors independently, with discrepancies addressed by a third author. CBT interventions were categorised as follows: group CBT, individual CBT, remote CBT, guided self-help, and unguided self-help. Effect on depressive symptom score was estimated across validated self-report measures using Hedges' g standardised mean difference. Acceptability was estimated based on loss to follow-up as an odds ratio. Treatment rankings were developed using the surface under the cumulative ranking curve (SUCRA). Pairwise meta-analyses were conducted using random effects models where there were two or more head-to-head trials. Network analyses were conducted using random effects models. Main Results Sixty-eight studies were included in the review. The mean age of participants ranged from 10 to 19.5 years, and on average 60% of participants were female. The majority of studies were conducted in schools (28) or universities (6); other settings included primary care, clinical settings and the home. The number of CBT sessions ranged from 1 to 16, the frequency of delivery from once every 2 weeks to twice a week and the duration of each session from 20 min to 2 h. The risk of bias was low across all domains for 23 studies, 24 studies had some concerns and the remaining 21 were assessed to be at high risk of bias. Sixty-two RCTs (representing 6435 participants) were included in the pairwise and network meta-analyses for post-intervention depressive symptom score at post-intervention. All pre-specified treatment and control categories were represented by at least one RCT. Although most CBT approaches, except remote CBT, demonstrated superiority over no intervention, no approaches performed clearly better than or equivalent to another. The highest and lowest ranking interventions were guided self-help (SUCRA 83%) and unguided self-help (SUCRA 51%), respectively (very low certainty in treatment ranking). Nineteen RCTs (3260 participants) were included in the pairwise and network meta-analyses for 6 to 12 month follow-up depressive symptom score. Neither guided self-help nor remote CBT were evaluated in the RCTs for this time point. Effects were generally attenuated for 6- to 12-month outcomes compared to posttest. No interventions demonstrated superiority to no intervention, although unguided self-help and group CBT both demonstrated superiority compared to TAU. No CBT approach demonstrated clear superiority over another. The highest and lowest ranking approaches were unguided self-help and individual CBT, respectively. Sixty-two RCTs (7347 participants) were included in the pairwise and network meta-analyses for intervention acceptability. All pre-specified treatment and control categories were represented by at least one RCT. Although point estimates tended to favour no intervention, no active treatments were clearly inferior. No CBT approach demonstrated clear superiority over another. The highest and lowest ranking active interventions were individual CBT and group CBT respectively. Pairwise meta-analytic findings were similar to those of the network meta-analysis for all analyses. There may be age-based subgroup effects on post-intervention depressive symptoms. Using the no intervention control group as the reference, the magnitudes of effects appear to be larger for the oldest age categories compared to the other subgroups for each given comparison. However, they were generally less precise and formal testing only indicated a significant difference for group CBT. Findings were robust to pre-specified sensitivity analyses separating out the type of placebo and excluding cluster-RCTs, as well as an additional analysis excluding studies where we had imputed standard deviations. Authors' Conclusions At posttreatment, all active treatments (group CBT, individual CBT, guided self-help, and unguided self-help) except for remote CBT were more effective than no treatment. Guided self-help was the most highly ranked intervention but only evaluated in trials with the oldest adolescents (16-19 years). Moreover, the studies of guided self-help vary in the type and amount of therapist support provided and longer-term results are needed to determine whether effects persist. The magnitude of effects was generally attenuated for 6- to 12-month outcomes. Although unguided self-help was the lowest-ranked active intervention at post-intervention, it was the highest ranked at follow-up. This suggests the need for further research into whether interventions with self-directed elements enable young people to maintain effects by continuing or revisiting the intervention independently, and whether therapist support would improve long-term outcomes. There was no clear evidence that any active treatments were more acceptable to participants than any others. The relative effectiveness of intervention delivery modes must be taken into account in the context of the needs and preferences of individual young people, particularly as the differences between effect sizes were relatively small. Further research into the type and amount of therapist support that is most acceptable to young people and most cost-effective would be particularly useful.
Collapse
Affiliation(s)
- Gretchen Bjornstad
- NIHR Applied Research Collaboration South West Peninsula (PenARC)University of Exeter Medical SchoolExeterUK
- Dartington Service Design LabBuckfastleighUK
| | - Shreya Sonthalia
- Dartington Service Design LabBuckfastleighUK
- MRC/CSO Social and Public Health Sciences UnitUniversity of GlasgowGlasgowUK
| | - Benjamin Rouse
- Center for Clinical Evidence and Guidelines, ECRI InstitutePlymouth MeetingPennsylvaniaUSA
| | | | | | - Jo Hickman Dunne
- The Centre for Youth ImpactLondonUK
- University of ManchesterManchesterUK
| | - Nick Axford
- NIHR Applied Research Collaboration South West Peninsula (PenARC)University of PlymouthPlymouthUK
| |
Collapse
|
3
|
Yuruk D, Ozger C, Garzon JF, Leffler JM, Shekunov J, Vande Voort JL, Zaccariello MJ, Nakonezny PA, Croarkin PE. Sequential bilateral accelerated theta burst stimulation in adolescents with suicidal ideation associated with major depressive disorder: Protocol for a randomized controlled trial. PLoS One 2023; 18:e0280010. [PMID: 37053246 PMCID: PMC10101506 DOI: 10.1371/journal.pone.0280010] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/01/2023] [Accepted: 01/26/2023] [Indexed: 04/14/2023] Open
Abstract
BACKGROUND Suicide is a leading cause of death in adolescents worldwide. Previous research findings suggest that suicidal adolescents with depression have pathophysiological dorsolateral prefrontal cortex (DLPFC) deficits in γ-aminobutyric acid neurotransmission. Interventions with transcranial magnetic stimulation (TMS) directly address these underlying pathophysiological deficits in the prefrontal cortex. Theta burst stimulation (TBS) is newer dosing approach for TMS. Accelerated TBS (aTBS) involves administering multiple sessions of TMS daily as this dosing may be more efficient, tolerable, and rapid acting than standard TMS. MATERIALS AND METHODS This is a randomized, double-blind, sham-controlled trial of sequential bilateral aTBS in adolescents with major depressive disorder (MDD) and suicidal ideation. Three sessions are administered daily for 10 days. During each session, continuous TBS is administered first to the right DPFC, in which 1,800 pulses are delivered continuously over 120 seconds. Then intermittent TBS is applied to the left DPFC, in which 1,800 pulses are delivered in 2-second bursts and repeated every 10 seconds for 570 seconds. The TBS parameters were adopted from prior research, with 3-pulse, 50-Hz bursts given every 200 ms (at 5 Hz) with an intensity of 80% active motor threshold. The comparison group will receive 3 daily sessions of bilateral sham TBS treatment for 10 days. All participants will receive the standard of care for patients with depression and suicidal ideation including daily psychotherapeutic skill sessions. Long-interval intracortical inhibition (LICI) biomarkers will be measured before and after treatment. Exploratory measures will be collected with TMS and electroencephalography for biomarker development. DISCUSSION This is the first known randomized controlled trial to examine the efficacy of sequential bilateral aTBS for treating suicidal ideation in adolescents with MDD. Results from this study will also provide opportunities to further understand the neurophysiological and molecular mechanisms of suicidal ideation in adolescents. TRIAL REGISTRATION Investigational device exemption (IDE) Number: G200220, ClinicalTrials.gov (ID: NCT04701840). Registered August 6, 2020. https://clinicaltrials.gov/ct2/show/NCT04502758?term=NCT04701840&draw=2&rank=1.
Collapse
Affiliation(s)
- Deniz Yuruk
- Department of Psychiatry and Psychology, Mayo Clinic, Rochester, Minnesota, United States of America
| | - Can Ozger
- Department of Psychiatry and Psychology, Mayo Clinic, Rochester, Minnesota, United States of America
| | - Juan F. Garzon
- Department of Psychiatry and Psychology, Mayo Clinic, Rochester, Minnesota, United States of America
| | - Jarrod M. Leffler
- Virginia Treatment Center for Children, Virginia Commonwealth University, Richmond, Virginia, United States of America
| | - Julia Shekunov
- Department of Psychiatry and Psychology, Mayo Clinic, Rochester, Minnesota, United States of America
- Mayo Clinic Depression Center, Mayo Clinic, Rochester, Minnesota, United States of America
| | - Jennifer L. Vande Voort
- Department of Psychiatry and Psychology, Mayo Clinic, Rochester, Minnesota, United States of America
- Mayo Clinic Depression Center, Mayo Clinic, Rochester, Minnesota, United States of America
- Mayo Clinic Children’s Research Center, Mayo Clinic, Rochester, Minnesota, United States of America
| | - Michael J. Zaccariello
- Department of Psychiatry and Psychology, Mayo Clinic, Rochester, Minnesota, United States of America
- Mayo Clinic Children’s Research Center, Mayo Clinic, Rochester, Minnesota, United States of America
| | - Paul A. Nakonezny
- Department of Population and Data Sciences, UT Southwestern Medical Center, Dallas, Texas, United States of America
| | - Paul E. Croarkin
- Department of Psychiatry and Psychology, Mayo Clinic, Rochester, Minnesota, United States of America
- Mayo Clinic Depression Center, Mayo Clinic, Rochester, Minnesota, United States of America
- Mayo Clinic Children’s Research Center, Mayo Clinic, Rochester, Minnesota, United States of America
| |
Collapse
|
4
|
Croarkin PE, Elmaadawi AZ, Aaronson ST, Schrodt GR, Holbert RC, Verdoliva S, Heart KL, Demitrack MA, Strawn JR. Left prefrontal transcranial magnetic stimulation for treatment-resistant depression in adolescents: a double-blind, randomized, sham-controlled trial. Neuropsychopharmacology 2021; 46:462-469. [PMID: 32919400 PMCID: PMC7852515 DOI: 10.1038/s41386-020-00829-y] [Citation(s) in RCA: 38] [Impact Index Per Article: 12.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 07/01/2020] [Revised: 08/08/2020] [Accepted: 08/17/2020] [Indexed: 02/06/2023]
Abstract
Treatment-resistant depression (TRD) is prevalent and associated with a substantial psychosocial burden and mortality. There are few prior studies of interventions for TRD in adolescents. This was the largest study to date examining the feasibility, safety, and efficacy of 10-Hz transcranial magnetic stimulation (TMS) for adolescents with TRD. Adolescents with TRD (aged 12-21 years) were enrolled in a randomized, sham-controlled trial of TMS across 13 sites. Treatment resistance was defined as an antidepressant treatment record level of 1 to 4 in a current episode of depression. Intention-to-treat patients (n = 103) included those randomly assigned to active NeuroStar TMS monotherapy (n = 48) or sham TMS (n = 55) for 30 daily treatments over 6 weeks. The primary outcome measure was change in the Hamilton Depression Rating Scale (HAM-D-24) score. After 6 weeks of blinded treatment, improvement in the least-squares mean (SE) HAM-D-24 scores were similar between the active (-11.1 [2.03]) and sham groups (-10.6 [2.00]; P = 0.8; difference [95% CI], - 0.5 [-4.2 to 3.3]). Response rates were 41.7% in the active group and 36.4% in the sham group (P = 0.6). Remission rates were 29.2% in the active group and 29.0% in the sham group (P = 0.95). There were no new tolerability or safety signals in adolescents. Although TMS treatment produced a clinically meaningful change in depressive symptom severity, this did not differ from sham treatment. Future studies should focus on strategies to reduce the placebo response and examine the optimal dosing of TMS for adolescents with TRD.
Collapse
Affiliation(s)
- Paul E. Croarkin
- grid.66875.3a0000 0004 0459 167XDivision of Child and Adolescent Psychiatry and Psychology, Mayo Clinic Depression Center, Mayo Clinic, Rochester, Minnesota USA
| | - Ahmed Z. Elmaadawi
- grid.429317.a0000 0004 4659 5310Beacon Health System, South Bend, Indiana USA, Indiana University School of Medicine, South Bend, USA
| | - Scott T. Aaronson
- grid.415693.c0000 0004 0373 4931Sheppard Pratt Health System, Baltimore, Maryland USA
| | | | | | - Sarah Verdoliva
- North American Science Associates, Inc. (NAMSA) Minneapolis, Minnesota, USA
| | | | | | - Jeffrey R. Strawn
- grid.24827.3b0000 0001 2179 9593Department of Psychiatry & Behavioral Neuroscience, University of Cincinnati, Cincinnati, Ohio USA
| |
Collapse
|
5
|
Westergren T, Narum S, Klemp M. Critical appraisal of adverse effects reporting in the 'Treatment for Adolescents With Depression Study (TADS)'. BMJ Open 2019; 9:e026089. [PMID: 30878988 PMCID: PMC6429903 DOI: 10.1136/bmjopen-2018-026089] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 01/04/2023] Open
Abstract
OBJECTIVE To identify all publications from the 'Treatment for Adolescents With Depression Study (TADS)' and assess the findings regarding occurrence of any adverse effects in the treatment groups both for the short-term and long-term study stages. DESIGN Descriptive analysis of TADS publications with any information on adverse effects. RESULTS We identified 48 publications describing various aspects of the TADS, in which 439 adolescent patients received treatment with fluoxetine, cognitive-behavioural therapy, cognitive-behavioural therapy plus fluoxetine or placebo. Eight publications were assessed as providing some data on adverse effects. Risk of suicidal behaviour was the only adverse effect that was addressed in all publications. Several psychiatric and physical adverse effects were reported during the first 12 weeks, but not mentioned in reports from later study stages. Common adverse effects of fluoxetine, such as weight changes or sexual problems, were not identified or mentioned in the publications. CONCLUSIONS The TADS publications do not present a comprehensive assessment of treatment risk with fluoxetine in adolescents, especially for more than 12 weeks of treatment. Risk of suicidality was the only adverse effect that was reported over time. Reporting of adverse effects was incomplete with regard to the long-term safety profile of fluoxetine.
Collapse
Affiliation(s)
- Tone Westergren
- Regional Medicines Information and Pharmacovigilance Centre (RELIS Sør-Øst), Department of Pharmacology, Oslo University Hospital, Oslo, Norway
| | - Sigrid Narum
- Center for Psychopharmacology, Diakonhjemmet Hospital, Oslo, Norway
| | - Marianne Klemp
- Department of Pharmacology, University of Oslo, Oslo, Norway
| |
Collapse
|
6
|
Dobson ET, Strawn JR. Placebo Response in Pediatric Anxiety Disorders: Implications for Clinical Trial Design and Interpretation. J Child Adolesc Psychopharmacol 2016; 26:686-693. [PMID: 27027330 PMCID: PMC5069715 DOI: 10.1089/cap.2015.0192] [Citation(s) in RCA: 18] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 12/22/2022]
Abstract
OBJECTIVES The characterization and prediction of placebo response in clinical trials of youth with anxiety disorders have received little attention, despite the critical effects of placebo response rate on the success or failure of clinical trials. With this in mind, we sought to examine the factors that predict or influence placebo response in randomized controlled trials of youth with anxiety disorders. METHODS Prospective, randomized, parallel-group controlled trials of psychopharmacologic interventions in pediatric patients with anxiety disorders were identified using a search of PubMed/Medline (1966-2015). Weighted least squares regression models and z-tests were utilized to examine the impact of continuous and categorical variables, respectively, on placebo response. These variables included demographic (e.g., age, percent white, percent female), clinical (e.g., baseline symptom severity), and trial characteristics (sample size, duration, funding). Finally, the relationship between the class of comparator medication and placebo response rate was examined using a multiple comparison for proportions test. RESULTS The analyses of data from 14 trials involving 2230 patients and 9 medications reveal that higher placebo response rates were associated with a greater number of study sites (p = 0.013) and fewer patients per site (p < 0.008), while placebo dropout rates increased with more recent publication (p = 0.01) and were positively associated with the number of study visits (p < 0.02). Lower placebo response rates were associated with federally funded studies (z = -4.61, p < 0.001), studies conducted in the United States (z = 1.81, p < 0.035), and with an increased likelihood of detecting a significant effect on the primary outcome (z = 4.58, p < 0.0001). Additionally, studies, in which the majority of patients (>60%) had a diagnosis of social anxiety disorder, exhibited lower placebo response rates (p < 0.001). Finally, for trials, effect size has decreased over time (p = 0.004). CONCLUSIONS Important trial-specific factors affect placebo response and placebo dropout in youth with anxiety disorders and have pragmatic implications for the conduct and design of clinical trials and raise the possibility that limiting the number of sites while maximizing the number of patients per site could enhance the ability to detect medication-placebo differences.
Collapse
Affiliation(s)
- Eric T. Dobson
- Department of Psychiatry and Behavioral Neuroscience, University of Cincinnati, College of Medicine, Cincinnati, Ohio
| | - Jeffrey R. Strawn
- Department of Psychiatry and Behavioral Neuroscience, University of Cincinnati, College of Medicine, Cincinnati, Ohio.,Division of Child and Adolescent Psychiatry, Department of Pediatrics, Cincinnati Children's Hospital Medical Center, Cincinnati, Ohio
| |
Collapse
|
7
|
Peters AT, Jacobs RH, Feldhaus C, Henry DB, Albano AM, Langenecker SA, Reinecke MA, Silva SG, Curry JF. Trajectories of Functioning Into Emerging Adulthood Following Treatment for Adolescent Depression. J Adolesc Health 2016; 58:253-9. [PMID: 26576820 PMCID: PMC4836911 DOI: 10.1016/j.jadohealth.2015.09.022] [Citation(s) in RCA: 19] [Impact Index Per Article: 2.4] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 07/29/2015] [Revised: 09/18/2015] [Accepted: 09/18/2015] [Indexed: 11/18/2022]
Abstract
PURPOSE It is well established that empirically supported treatments reduce depressive symptoms for most adolescents; however, it is not yet known whether these interventions lead to sustained improvements in global functioning. The goal of this study is to assess the clinical characteristics and trajectories of long-term psychosocial functioning among emerging adults who have experienced adolescent-onset major depressive disorder. METHODS Global functioning was assessed using the Clinical Global Assessment Scale for children (participants ≤18 years), the Global Assessment of Functioning (participants ≥ 19 years) and the Health of the Nation Outcome Scales for Adolescents among 196 adolescents who elected to complete 3.5 years of naturalistic follow-up subsequent to their participation in the Treatment for Adolescents with Depression Study. The Treatment for Adolescents with Depression Study examined the efficacy of cognitive behavior therapy, fluoxetine, and the combination of cognitive behavior therapy and fluoxetine (combination treatment) over the course of 36 weeks. Mixed-effects regression models were used to identify trajectories and clinical predictors of functioning over the naturalistic follow-up. RESULTS Global functioning and achievement of developmental milestones (college, employment) improved over the course of follow-up for most adolescents. Depressive relapse, initial randomization to the placebo group, and the presence of multiple psychiatric comorbidities conferred risk for relatively poorer functioning. CONCLUSIONS Functioning generally improves among most adolescents who have received empirically supported treatments. However, the presence of recurrent major depressive disorder and multiple psychiatric comorbidities is associated with poorer functioning trajectories, offering targets for maintenance treatment or secondary prevention.
Collapse
Affiliation(s)
- Amy T Peters
- Department of Psychiatry, University of Illinois at Chicago, Chicago, Illinois
| | - Rachel H Jacobs
- Department of Psychiatry, University of Illinois at Chicago, Chicago, Illinois
| | - Claudia Feldhaus
- Department of Psychiatry, University of Illinois at Chicago, Chicago, Illinois
| | - David B Henry
- Department of Psychiatry, University of Illinois at Chicago, Chicago, Illinois
| | - Anne Marie Albano
- Department of Psychiatry, New York State Psychiatric Institute, New York, New York
| | - Scott A Langenecker
- Department of Psychiatry, University of Illinois at Chicago, Chicago, Illinois
| | - Mark A Reinecke
- Department of Psychiatry and Behavioral Sciences, Northwestern University Feinberg School of Medicine, Chicago, Illinois
| | - Susan G Silva
- Department of Psychiatry and Behavioral Sciences, Duke University, Durham, North Carolina
| | - John F Curry
- Department of Psychiatry and Behavioral Sciences, Duke University, Durham, North Carolina.
| |
Collapse
|
8
|
Högberg G, Antonuccio DO, Healy D. Suicidal risk from TADS study was higher than it first appeared. INTERNATIONAL JOURNAL OF RISK & SAFETY IN MEDICINE 2015; 27:85-91. [DOI: 10.3233/jrs-150645] [Citation(s) in RCA: 18] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/21/2022]
Affiliation(s)
- Göran Högberg
- Department of Women’s and Children’s Health, Child and Adolescent Psychiatric Unit, Karolinska Institutet, Astrid Lindgren Children’s Hospital, Stockholm, Sweden
- Stockholm Child and Adolescent Psychiatry, BUP Huddinge, Stockholm, Sweden
| | - David O. Antonuccio
- Department of Psychiatry and Behavioral Sciences, University of Nevada School of Medicine, Reno, NV, USA
| | | |
Collapse
|
9
|
Brenner SL, Burns BJ, Curry JF, Silva SG, Kratochvil CJ, Domino ME. Mental health service use among adolescents following participation in a randomized clinical trial for depression. JOURNAL OF CLINICAL CHILD AND ADOLESCENT PSYCHOLOGY 2014; 44:551-8. [PMID: 24661263 DOI: 10.1080/15374416.2014.881291] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 10/25/2022]
Abstract
Major depressive disorder (MDD) is a common disorder among adolescents. The Treatment for Adolescents with Depression Study (TADS) was a randomized controlled trial to examine the efficacy of fluoxetine and cognitive-behavioral therapy (CBT), separately and together, compared with placebo, in adolescents 12 to 17 years of age. The Survey of Outcomes Following Treatment for Adolescent Depression (SOFTAD) was designed as a naturalistic follow-up of participants in TADS. The aims of the current analyses are to describe mental health service use during the SOFTAD period. There were 196 adolescents recruited from 12 TADS sites. The Schedule for Affective Disorders and Schizophrenia for School-Age-Children-Present and Lifetime Version was used for clinical diagnoses. Participants completed a psychiatric treatment log and the Child and Adolescent Services Assessment to assess service use. 58% received psychotherapy or nonstimulant psychotropic medication during SOFTAD. Youth with recurrent MDD had higher rates of treatment compared to youth without recurrent MDD (71% vs. 45%). However, nearly one third of the adolescents in the study did not receive treatment for a recurrent episode of depression. Service use differed by gender for those with recurrent MDD, with female participants (79%) receiving treatment at higher rates than male participants (55%), although there was no significant difference in depression severity between genders. Younger participants with recurrent MDD had higher odds of receiving psychotherapy. Use of psychotherapy and psychotropics following recurrence of depression appears to be influenced by age and gender. Even when youth respond well to treatment, a sizeable percentage are likely to experience a subsequent episode that may go untreated.
Collapse
Affiliation(s)
- Sharon L Brenner
- a Department of Psychiatry and Behavioral Sciences , Duke University School of Medicine
| | | | | | | | | | | |
Collapse
|
10
|
Cox GR, Fisher CA, De Silva S, Phelan M, Akinwale OP, Simmons MB, Hetrick SE. Interventions for preventing relapse and recurrence of a depressive disorder in children and adolescents. Cochrane Database Syst Rev 2012; 11:CD007504. [PMID: 23152246 PMCID: PMC8978530 DOI: 10.1002/14651858.cd007504.pub2] [Citation(s) in RCA: 20] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 11/06/2022]
Abstract
BACKGROUND Depressive disorders often begin during childhood or adolescence. There is a growing body of evidence supporting effective treatments during the acute phase of a depressive disorder. However, little is known about treatments for preventing relapse or recurrence of depression once an individual has achieved remission or recovery from their symptoms. OBJECTIVES To determine the efficacy of early interventions, including psychological and pharmacological interventions, to prevent relapse or recurrence of depressive disorders in children and adolescents. SEARCH METHODS We searched the Cochrane Depression, Anxiety and Neurosis Review Group's Specialised Register (CCDANCTR) (to 1 June 2011). The CCDANCTR contains reports of relevant randomised controlled trials from The Cochrane Library (all years), EMBASE (1974 to date), MEDLINE (1950 to date) and PsycINFO (1967 to date). In addition we handsearched the references of all included studies and review articles. SELECTION CRITERIA Randomised controlled trials using a psychological or pharmacological intervention, with the aim of preventing relapse or recurrence from an episode of major depressive disorder (MDD) or dysthymic disorder (DD) in children and adolescents were included. Participants were required to have been diagnosed with MDD or DD according to DSM or ICD criteria, using a standardised and validated assessment tool. DATA COLLECTION AND ANALYSIS Two review authors independently assessed all trials for inclusion in the review, extracted trial and outcome data, and assessed trial quality. Results for dichotomous outcomes are expressed as odds ratio and continuous measures as mean difference or standardised mean difference. We combined results using random-effects meta-analyses, with 95% confidence intervals. We contacted lead authors of included trials and requested additional data where possible. MAIN RESULTS Nine trials with 882 participants were included in the review. In five trials the outcome assessors were blind to the participants' intervention condition and in the remainder of trials it was unclear. In the majority of trials, participants were either not blind to their intervention condition, or it was unclear whether they were or not. Allocation concealment was also unclear in the majority of trials. Although all trials treated participants in an outpatient setting, the designs implemented in trials was diverse, which limits the generalisability of the results. Three trials indicated participants treated with antidepressant medication had lower relapse-recurrence rates (40.9%) compared to those treated with placebo (66.6%) during a relapse prevention phase (odds ratio (OR) 0.34; 95% confidence interval (CI) 0.18 to 0.64, P = 0.02). One trial that compared a combination of psychological therapy and medication to medication alone favoured a combination approach over medication alone, however this result did not reach statistical significance (OR 0.26; 95% CI 0.06 to 1.15). The majority of trials that involved antidepressant medication reported adverse events including suicide-related behaviours. However, there were not enough data to show which treatment approach results in the most favourable adverse event profile. AUTHORS' CONCLUSIONS Currently, there is little evidence to conclude which type of treatment approach is most effective in preventing relapse or recurrence of depressive episodes in children and adolescents. Limited trials found that antidepressant medication reduces the chance of relapse-recurrence in the future, however, there is considerable diversity in the design of trials, making it difficult to compare outcomes across studies. Some of the research involving psychological therapies is encouraging, however at present more trials with larger sample sizes need to be conducted in order to explore this treatment approach further.
Collapse
Affiliation(s)
- Georgina R Cox
- Orygen YouthHealth ResearchCentre,Centre for YouthMentalHealth,University ofMelbourne,Melbourne, Australia.
| | | | | | | | | | | | | |
Collapse
|
11
|
Antonuccio D, Healy D. Relabeling the medications we call antidepressants. SCIENTIFICA 2012; 2012:965908. [PMID: 24278764 PMCID: PMC3820604 DOI: 10.6064/2012/965908] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/18/2012] [Accepted: 05/28/2012] [Indexed: 06/02/2023]
Abstract
This paper raises the question about whether the data on the medications we call antidepressants justify the label of antidepressant. The authors argue that a true antidepressant should be clearly superior to placebo, should offer a risk/benefit balance that exceeds that of alternative treatments, should not increase suicidality, should not increase anxiety and agitation, should not interfere with sexual functioning, and should not increase depression chronicity. Unfortunately, these medications appear to fall short on all of these dimensions. Many of the "side effects" of these medications have larger effect sizes than the antidepressant effect size. To call these medications antidepressants may make sense from a marketing standpoint but may be misleading from a scientific perspective. Consumers deserve a label that more accurately reflects the data on the largest effects and helps them understand the range of effects from these medications. In other words, it may make just as much sense to call these medications antiaphrodisiacs as antidepressants because the negative effects on libido and sexual functioning are so common. It can be argued that a misleading label may interfere with our commitment to informed consent. Therefore, it may be time to stop calling these medications antidepressants.
Collapse
Affiliation(s)
- David Antonuccio
- Department of Psychiatry and Behavioral Sciences, University of Nevada School of Medicine, Reno, NV 89503, USA
- Department of Psychology, Fielding Graduate University, Santa Barbara, CA 93105-3538, USA
| | | |
Collapse
|
12
|
Curry J, Silva S, Rohde P, Ginsburg G, Kennard B, Kratochvil C, Simons A, Kirchner J, May D, Mayes T, Feeny N, Albano AM, Lavanier S, Reinecke M, Jacobs R, Becker-Weidman E, Weller E, Emslie G, Walkup J, Kastelic E, Burns B, Wells K, March J. Onset of alcohol or substance use disorders following treatment for adolescent depression. J Consult Clin Psychol 2012; 80:299-312. [PMID: 22250853 DOI: 10.1037/a0026929] [Citation(s) in RCA: 36] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
Abstract
OBJECTIVE This study tested whether positive response to short-term treatment for adolescent major depressive disorder (MDD) would have the secondary benefit of preventing subsequent alcohol use disorders (AUD) or substance use disorders (SUD). METHOD For 5 years, we followed 192 adolescents (56.2% female; 20.8% minority) who had participated in the Treatment for Adolescents with Depression Study (TADS; TADS Team, 2004) and who had no prior diagnoses of AUD or SUD. TADS initial treatments were cognitive behavior therapy (CBT), fluoxetine alone (FLX), the combination of CBT and FLX (COMB), or clinical management with pill placebo (PBO). We used both the original TADS treatment response rating and a more restrictive symptom count rating. During follow-up, diagnostic interviews were completed at 6- or 12-month intervals to assess onset of AUD or SUD as well as MDD recovery and recurrence. RESULTS Achieving a positive response to MDD treatment was unrelated to subsequent AUD but predicted a lower rate of subsequent SUD, regardless of the measure of positive response (11.65% vs. 24.72%, or 10.0% vs. 24.5%, respectively). Type of initial MDD treatment was not related to either outcome. Prior to depression treatment, greater involvement with alcohol or drugs predicted later AUD or SUD, as did older age (for AUD) and more comorbid disorders (for SUD). Among those with recurrent MDD and AUD, AUD preceded MDD recurrence in 24 of 25 cases. CONCLUSION Effective short-term adolescent depression treatment significantly reduces the rate of subsequent SUD but not AUD. Alcohol or drug use should be assessed prior to adolescent MDD treatment and monitored even after MDD recovery.
Collapse
Affiliation(s)
- John Curry
- Department of Psychiatry and Behavioral Sciences, Duke University Medical Center, and Duke Clinical Research Institute, Durham, North Carolina 27705, USA.
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | |
Collapse
|
13
|
Oestergaard S, Møldrup C. Optimal duration of combined psychotherapy and pharmacotherapy for patients with moderate and severe depression: a meta-analysis. J Affect Disord 2011; 131:24-36. [PMID: 20950863 DOI: 10.1016/j.jad.2010.08.014] [Citation(s) in RCA: 24] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 05/25/2010] [Revised: 08/17/2010] [Accepted: 08/17/2010] [Indexed: 11/19/2022]
Abstract
BACKGROUND To investigate the most effective duration of combined psychotherapy and pharmacotherapy for achieving remission and preventing relapse in depressive patients as compared to pharmacotherapy alone. METHODS A systematic review of English articles using PubMed, EMBASE, Web of Science, the Cochrane Library, and PsychINFO was performed in September 2009. Clinical studies comparing pharmacotherapy alone with pharmacotherapy in combination with a psychological intervention for depression treatment that reported response, remission or relapse as outcomes were included in the analysis. For each of the studies, clinical binary outcomes such as response, remission or relapse were extracted. RESULTS All pooled analyses were based on random-effects models. Twenty-one article describing the influence of additional psychotherapy on remission and 15 articles reporting the influence on relapse in depression were included in the analysis. Patients receiving combined treatment experienced remission more often than those receiving pharmacotherapy alone, with the highest odds ratio OR, 2.36; 95% CI, 1.58-3.55 observed at 4months after commencing the treatment. Patients receiving pharmacotherapy alone also demonstrated a higher risk for relapse compared to those receiving combined treatment. LIMITATIONS We restricted our search to only English language publications. Studies investigating relapse or recurrence rates are often of small size. CONCLUSION Pharmacotherapy enhanced with psychotherapy is associated with a higher probability of remission and a lower risk of relapse, as compared to antidepressants alone for depression treatment. Receiving psychotherapy in both the acute and continuation phases is the most effective option. Further research is needed to investigate the influence of additional psychotherapy on different patients.
Collapse
Affiliation(s)
- Svetlana Oestergaard
- Department of Pharmacology and Pharmacotherapy, Section for Social Pharmacy, University of Copenhagen, Faculty of Pharmaceutical Sciences, Denmark.
| | | |
Collapse
|
14
|
Dubicka B, Elvins R, Roberts C, Chick G, Wilkinson P, Goodyer IM. Combined treatment with cognitive-behavioural therapy in adolescent depression: meta-analysis. Br J Psychiatry 2010; 197:433-40. [PMID: 21119148 DOI: 10.1192/bjp.bp.109.075853] [Citation(s) in RCA: 50] [Impact Index Per Article: 3.6] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 11/23/2022]
Abstract
BACKGROUND The treatment of adolescent depression is controversial and studies of combined treatment (antidepressants and cognitive-behavioural therapy, CBT) have produced conflicting findings. AIMS To address the question of whether CBT confers additional benefit to antidepressant treatment in adolescents with unipolar depression for depressive symptoms, suicidality, impairment and global improvement. METHOD Meta-analysis of randomised controlled trials (RCTs) of newer-generation antidepressants and CBT in adolescent depression. RESULTS There was no evidence of a statistically significant benefit of combined treatment over antidepressants for depressive symptoms, suicidality and global improvement after acute treatment or at follow-up. There was a statistically significant advantage of combined treatment for impairment in the short-term (at 12 weeks) only. There was some evidence of heterogeneity between studies. CONCLUSIONS Adding CBT to antidepressants confers limited advantage for the treatment of an episode of depression in adolescents. The variation in sampling and methodology between studies, as well as the small number of trials, limits the generalisability of the findings and any conclusions that can be drawn. Future studies should examine predictors of response to treatment as well as clinical components that may affect outcome.
Collapse
Affiliation(s)
- Bernadka Dubicka
- Lancashire Care Foundation Trust and Psychiatry Research Group, School of Community Based Medicine, University of Manchester, UK.
| | | | | | | | | | | |
Collapse
|
15
|
|
16
|
Curry J, Silva S, Rohde P, Ginsburg G, Kratochvil C, Simons A, Kirchner J, May D, Kennard B, Mayes T, Feeny N, Albano AM, Lavanier S, Reinecke M, Jacobs R, Becker-Weidman E, Weller E, Emslie G, Walkup J, Kastelic E, Burns B, Wells K, March J. Recovery and recurrence following treatment for adolescent major depression. ACTA ACUST UNITED AC 2010; 68:263-9. [PMID: 21041606 DOI: 10.1001/archgenpsychiatry.2010.150] [Citation(s) in RCA: 147] [Impact Index Per Article: 10.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/14/2022]
Abstract
CONTEXT Major depressive disorder in adolescents is common and impairing. Efficacious treatments have been developed, but little is known about longer-term outcomes, including recurrence. OBJECTIVES To determine whether adolescents who responded to short-term treatments or who received the most efficacious short-term treatment would have lower recurrence rates, and to identify predictors of recovery and recurrence. DESIGN Naturalistic follow-up study. SETTING Twelve academic sites in the United States. PARTICIPANTS One hundred ninety-six adolescents (86 males and 110 females) randomized to 1 of 4 short-term interventions (fluoxetine hydrochloride treatment, cognitive behavioral therapy, their combination, or placebo) in the Treatment for Adolescents With Depression Study were followed up for 5 years after study entry (44.6% of the original Treatment for Adolescents With Depression Study sample). MAIN OUTCOME MEASURES Recovery was defined as absence of clinically significant major depressive disorder symptoms on the Schedule for Affective Disorders and Schizophrenia for School-Age Children-Present and Lifetime Version interview for at least 8 weeks, and recurrence was defined as a new episode of major depressive disorder following recovery. RESULTS Almost all participants (96.4%) recovered from their index episode of major depressive disorder during the follow-up period. Recovery by 2 years was significantly more likely for short-term treatment responders (96.2%) than for partial responders or nonresponders (79.1%) (P < .001) but was not associated with having received the most efficacious short-term treatment (the combination of fluoxetine and cognitive behavioral therapy). Of the 189 participants who recovered, 88 (46.6%) had a recurrence. Recurrence was not predicted by full short-term treatment response or by original treatment. However, full or partial responders were less likely to have a recurrence (42.9%) than were nonresponders (67.6%) (P = .03). Sex predicted recurrence (57.0% among females vs 32.9% among males; P = .02). CONCLUSIONS Almost all depressed adolescents recovered. However, recurrence occurs in almost half of recovered adolescents, with higher probability in females in this age range. Further research should identify and address the vulnerabilities to recurrence that are more common among young women.
Collapse
Affiliation(s)
- John Curry
- Department of Psychiatry and Behavioral Sciences, Duke University Medical Center, Durham, NC 27705, USA.
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | |
Collapse
|
17
|
Abstract
Major depressive disorder (MDD) is one of the most prevalent psychiatric disorders affecting children and adolescents. The significant psychiatric, social, and functional impairments associated with this disorder coupled with the high incidence of relapse indicate a need for continued efforts to enhance treatment. Current empirically supported treatments for childhood and adolescent MDD include psychotropic medications, psychotherapy, and a combination of both treatments, with selection of the most appropriate strategy depending on symptom severity. One strategy to enhance treatment outcome is the use of measurement-based care. This article provides a systematic review of measurement-based care in the treatment of childhood and adolescent MDD. It also presents a comprehensive analysis of widely used depression rating scales and discusses their utility in clinical practice. This review found evidence supporting the utility and benefit of depression rating scales to document depression severity in children and adolescents. We also found evidence suggesting that many of these scales are time efficient, and that both clinician-rated and self-rated scales provide accurate assessment of depressive symptomatology. Future research is warranted to examine the utility of measurement-based care in clinical practice with child and adolescent populations.
Collapse
|
18
|
Cohen D, Consoli A, Bodeau N, Purper-Ouakil D, Deniau E, Guile JM, Donnelly C. Predictors of placebo response in randomized controlled trials of psychotropic drugs for children and adolescents with internalizing disorders. J Child Adolesc Psychopharmacol 2010; 20:39-47. [PMID: 20166795 DOI: 10.1089/cap.2009.0047] [Citation(s) in RCA: 41] [Impact Index Per Article: 2.9] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 12/19/2022]
Abstract
OBJECTIVE The aim of this study was to assess predictors of placebo response in all available short-term, placebo-controlled trials of psychotropic drugs for children and adolescents with internalizing disorders, major depressive disorder (MDD), obsessive compulsive disorder (OCD,) and anxiety disorders (ANX) exclusive of OCD and posttraumatic stress disorder (PTSD). METHOD We reviewed the literature relevant to the use of psychotropic medication in children and adolescents with internalizing disorders, restricting our review to double-blind studies including a placebo arm. Placebo response, defined according to each trial's primary response outcome variable and Clinical Global Impressions-Improvement, when available, and potential predictive variables were extracted from 40 studies. RESULTS From 1972 to 2007, we found 23 trials that evaluated the efficacy of psychotropic medication involving youth with MDD, 7 pertaining to youths with OCD, and 10 pertaining to youths with ANX (N = 2,533 patients in placebo arms). For all internalizing disorders combined, predictors of nonresponse to placebo were the percentage of Caucasian patients included in the study and the duration of the disorder: Both variables were negatively correlated with the percent of placebo responders. The type of disorder was found to predict the robustness of placebo response: (OCD < ANX < MDD). For a subset of MDD studies, we found that baseline illness severity tended to be negatively correlated with placebo response. Finally, trial "success" was significantly associated with lower placebo response rate. CONCLUSION Predictors of placebo response in internalizing disorders of youths parallel those in adult studies, with the exception of race. These predictors should be considered when designing placebo-controlled trials in youths to enhance findings of true drug-placebo differences.
Collapse
Affiliation(s)
- David Cohen
- Department of Child and Adolescent Psychiatry, Université Pierre et Marie Curie, GH Pitié-Salpétrière, AP-HP, Paris, France
| | | | | | | | | | | | | |
Collapse
|
19
|
Affiliation(s)
- Johannes Hebebrand
- Department of Child and Adolescent Psychiatry and Psychotherapy, University of Duisburg-Essen, Germany
| |
Collapse
|
20
|
|