1
|
Wenger F, Allenhof C, Schreynemackers S, Hegerl U, Reich H. Use of Random Forest to Predict Adherence in an Online Intervention for Depression Using Baseline and Early Usage Data: Model Development and Validation on Retrospective Routine Care Log Data. JMIR Form Res 2024; 8:e53768. [PMID: 39546342 PMCID: PMC11607565 DOI: 10.2196/53768] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/18/2023] [Revised: 08/30/2024] [Accepted: 10/05/2024] [Indexed: 11/17/2024] Open
Abstract
BACKGROUND Online interventions, such as the iFightDepression (iFD) tool, are increasingly recognized as effective alternatives to traditional face-to-face psychotherapy or pharmacotherapy for treating depression. However, particularly when used outside of study settings, low adherence rates and the resulting diminished benefits of the intervention can limit their effectiveness. Understanding the factors that predict adherence would allow for early, tailored interventions for individuals at risk of nonadherence, thereby enhancing user engagement and optimizing therapeutic outcomes. OBJECTIVE This study aims to develop and evaluate a random forest model that predicts adherence to the iFD tool to identify users at risk of noncompletion. The model was based on characteristics collected during baseline and the first week of the intervention in patients with depression. METHODS Log data from 4187 adult patients who registered for the iFD tool between October 1, 2016, and May 5, 2022, and provided informed consent were statistically analyzed. The resulting data set was divided into training (2932/4187, 70%) and test (1255/4187, 30%) sets using a randomly stratified split. The training data set was utilized to train a random forest model aimed at predicting each user's adherence at baseline, based on the hypothesized predictors: age, self-reported gender, expectations of the intervention, current or previous depression treatments, confirmed diagnosis of depression, baseline 9-item Patient Health Questionnaire (PHQ-9) score, accompanying guide profession, and usage behavior within the first week. After training, the random forest model was evaluated on the test data set to assess its predictive performance. The importance of each variable in predicting adherence was analyzed using mean decrease accuracy, mean decrease Gini, and Shapley Additive Explanations values. RESULTS Of the 4187 patients evaluated, 1019 (24.34%) were classified as adherent based on our predefined definition. An initial random forest model that relied solely on sociodemographic and clinical predictors collected at baseline did not yield a statistically significant adherence prediction. However, after incorporating each patient's usage behavior during the first week, we achieved a significant prediction of adherence (P<.001). Within this prediction, the model achieved an accuracy of 0.82 (95% CI 0.79-0.84), an F1-score of 0.53, an area under the curve of 0.83, and a specificity of 0.94 for predicting nonadherent users. The key predictors of adherence included logs, word count on the first workshop's worksheet, and time spent on the tool, all measured during the first week. CONCLUSIONS Our results highlight that early engagement, particularly usage behavior during the first week of the online intervention, is a far greater predictor of adherence than any sociodemographic or clinical factors. Therefore, analyzing usage behavior within the first week and identifying nonadherers through the algorithm could be beneficial for tailoring interventions aimed at improving user adherence. This could include follow-up calls or face-to-face discussions, optimizing resource utilization in the process.
Collapse
Affiliation(s)
- Franziska Wenger
- Clinic for Psychiatry, Psychosomatics and Psychotherapy, University Hospital, Goethe University Frankfurt, Frankfurt am Main, Germany
| | - Caroline Allenhof
- Depression Research Centre, German Depression Foundation, Leipzig, Germany
| | | | - Ulrich Hegerl
- Clinic for Psychiatry, Psychosomatics and Psychotherapy, University Hospital, Goethe University Frankfurt, Frankfurt am Main, Germany
- Depression Research Centre, German Depression Foundation, Frankfurt, Germany
| | - Hanna Reich
- Clinic for Psychiatry, Psychosomatics and Psychotherapy, University Hospital, Goethe University Frankfurt, Frankfurt am Main, Germany
- Depression Research Centre, German Depression Foundation, Frankfurt, Germany
| |
Collapse
|
2
|
Reich H, Hegerl U, Rosenthal A, Allenhof C. Arabic-language digital interventions for depression in German routine health care are acceptable, but intervention adoption remains a challenge. Sci Rep 2024; 14:12097. [PMID: 38866810 PMCID: PMC11169486 DOI: 10.1038/s41598-024-62196-8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/30/2023] [Accepted: 05/14/2024] [Indexed: 06/14/2024] Open
Abstract
Migrants face many barriers to mental health care, such as different cultural concepts of distress, unfamiliar pathways to care, and language. Digital mental health interventions are effective and scalable in multi-language versions. However, their implementation into routine care is in its infancy. Here, we report on the Arabic- and German-language implementation of two digital interventions in Germany: The iFightDepression® website, providing information about depression to the public, and the iFightDepression® tool, offering guided self-management for depression. Our main goal is to gain empirical knowledge about the success of their implementation and provide evidence-based recommendations for improvement. Data for the current analyses stem from convenience samples, utilizing anonymized user logs of the iFightDepression® website and 15.307 user accounts in the iFightDepression® tool. We found that the acceptability (time on page, usage behavior) of both digital interventions was comparable between the two user groups. The website pervasiveness of the target populations was nine times lower among Arab migrants in Germany than Germans (89 vs. 834 unique page views/ 100,000 inhabitants), but the increase in views was superior and sustained over three years. The adoption of the tool was lower among Arabic than German users (conversion rate from invitation to completed registration: 30.8% vs. 59.0%, p < 0.001) and appropriateness was challenged as Arabic users reported higher depression severities upon first registration (p = 0.027). Our results show that the uptake of digital interventions for migrants requires facilitation and further tailoring to the needs of the target group.
Collapse
Affiliation(s)
- Hanna Reich
- Department of Psychiatry, Psychosomatic Medicine, and Psychotherapy, Depression Research Centre of the German Depression Foundation, University Hospital, Goethe University, Heinrich-Hoffmann-Str. 10, 60528, Frankfurt am Main, Germany.
- German Depression Foundation, Leipzig, Germany.
| | - Ulrich Hegerl
- German Depression Foundation, Leipzig, Germany
- Johann Christian Senckenberg Distinguished Professorship, Department for Psychiatry, Psychosomatic Medicine, and Psychotherapy, University Hospital, Goethe University, Frankfurt am Main, Germany
- European Alliance Against Depression e.V., Leipzig, Germany
| | | | | |
Collapse
|
3
|
Varga A, Czeglédi E, Tóth MD, Purebl G. Effectiveness of iFightDepression ® online guided self-help tool in depression: A pilot study. J Telemed Telecare 2024; 30:696-705. [PMID: 35300546 DOI: 10.1177/1357633x221084584] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/15/2022]
Abstract
BACKGROUND Depression is one of the leading causes of human misery and disability worldwide. For those fortunate enough to have access to the rapidly expanding World Wide Web, online self-help tools can guide those suffering from depression, with or without professional intervention, to better manage their symptoms and maintain some measure of self-actualization. This study assesses the efficacy of the widely used, online self-help tool, iFightDepression®. METHODS A six-week, observational study was conducted with 143 participants (29.4% men, mean age: 37.8; standard deviation [SD] = 12.05, range = 18-70, years) in three intervention groups, as follows: 1) Treatment As Usual (TAU), 2) TAU combined with access to the iFightDepression® tool (TAU + iFD®), 3) TAU combined with iFightDepression® and weekly phone support (TAU + iFD® + phone). Depression symptoms were measured pre- and post- by Patient Health Questionnaire-9. RESULTS There was a significantly greater decrease of depressive symptoms in both iFD® groups compared to the TAU group (time × group interaction: F(2) = 34.657, p < 0.001, partial η2 = 0.331). The reliable change index calculation identified one participant (0.7%) as having experienced a statistically reliable deterioration in depression. A total of 102 participants (71.3%) showed no reliable change, while 40 participants (28.0%) showed a statistically reliable improvement. Multiple binary logistic regression analysis found odds of reliable improvement to be significantly higher in both iFD® groups compared to the TAU group (TAU + iFD®: OR = 18.52, p = 0.015, TAU + iFD® + Phone: OR = 126.72, p < 0.001). Participants living in Budapest were found to have significantly higher odds for a reliable improvement compared to those living in the countryside (odds ratio [OR] = 4.04, p = 0.023). Finally, higher levels of depressive symptoms at baseline (pretest) were also associated with increased odds for post-intervention improvement (OR = 1.58, p < 0.001). The variance explained by the model is 62.0%. With regards to the iFD® self-help program, the mean of completed modules was 4.8 (SD = 1.73, range = 1-6). Participants in the group supported by weekly phone calls completed significantly more modules (n = 50, M = 5.7, SD = 0.76) than participants without weekly telephone support (n = 52, M = 3.9, SD = 1.94, Z = 5.253, p < 0.001). However, there was no significant difference in the number of completed modules between respondents with a reliable improvement in depression (n = 39, M = 4.9, SD = 1.57) and those without a reliable change (n = 63, M = 4.7, SD = 1.83, Z = 0.343, p = 0.731). CONCLUSION Our results confirm previous findings regarding the efficacy of web-based interventions with the low-intensity guidance of mental health professional. Findings suggest that a relatively short additional weekly call may result in a significant decrease in depressive symptoms and higher number of completed iFD® modules. The study confirms that the IFD® tool, both alone and with additional phone support, is a possible and effective way to help patients with mild to moderate and, in some cases, even severe depression. Providing mental and primary health care systems with the availability of online self-help tools may contribute to the efficacious treatment of depression and prevention of the increase in depressive symptoms.
Collapse
Affiliation(s)
- Anna Varga
- Semmelweis University, Budapest, Hungary
| | | | | | | |
Collapse
|
4
|
Freund J, Piotrowski A, Bührmann L, Oehler C, Titzler I, Netter AL, Potthoff S, Ebert DD, Finch T, Köberlein-Neu J, Etzelmüller A. Validation of the German Normalisation Process Theory Measure G-NoMAD: translation, adaptation, and pilot testing. Implement Sci Commun 2023; 4:126. [PMID: 37845776 PMCID: PMC10578017 DOI: 10.1186/s43058-023-00505-4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/30/2023] [Accepted: 09/23/2023] [Indexed: 10/18/2023] Open
Abstract
BACKGROUND Implementing evidence-based healthcare practices (EBPs) is a complex endeavour and often lags behind research-informed decision processes. Understanding and systematically improving implementation using implementation theory can help bridge the gap between research findings and practice. This study aims to translate, pilot, and validate a German version of the English NoMAD questionnaire (G-NoMAD), an instrument derived from the Normalisation Process Theory, to explore the implementation of EBPs. METHODS Survey data has been collected in four German research projects and subsequently combined into a validation data set. Two versions of the G-NoMAD existed, independently translated from the original English version by two research groups. A measurement invariance analysis was conducted, comparing latent scale structures between groups of respondents to both versions. After determining the baseline model, the questionnaire was tested for different degrees of invariance (configural, metric, scalar, and uniqueness) across samples. A confirmatory factor analysis for three models (a four-factor, a unidimensional, and a hierarchical model) was used to examine the theoretical structure of the G-NoMAD. Finally, psychometric results were discussed in a consensus meeting, and the final instructions, items, and scale format were consented to. RESULTS A total of 539 health care professionals completed the questionnaire. The results of the measurement invariance analysis showed configural, partial metric, and partial scalar invariance indicating that the questionnaire versions are comparable. Internal consistency ranged from acceptable to good (0.79 ≤ α ≤ 0.85) per subscale. Both the four factor and the hierarchical model achieved a better fit than the unidimensional model, with indices from acceptable (SRMR = 0.08) to good (CFI = 0.97; TLI = 0.96). However, the RMSEA values were only close to acceptable (four-factor model: χ2164 = 1029.84, RMSEA = 0.10; hierarchical model: χ2166 = 1073.43, RMSEA = 0.10). CONCLUSIONS The G-NoMAD provides a reliable and promising tool to measure the degree of normalisation among individuals involved in implementation activities. Since the fit was similar in the four-factor and the hierarchical model, priority should be given to the practical relevance of the hierarchical model, including a total score and four subscale scores. The findings of this study support the further usage of the G-NoMAD in German implementation settings. TRIAL REGISTRATION Both the AdAM project (No. NCT03430336, 06/02/2018) and the EU-project ImpleMentAll (No. NCT03652883, 29/08/2018) were registered on ClinicalTrials.gov. The ImplementIT study was registered at the German Clinical Trial Registration (No. DRKS00017078, 18/04/2019). The G-NoMAD validation study was registered at the Open Science Framework (No7u9ab, 17/04/2023).
Collapse
Affiliation(s)
- Johanna Freund
- Professorship Psychology & Digital Mental Health Care, Department of Sport and Health Sciences, Technical University of Munich, Georg-Brauchle-Ring 60/62, Munich, 80992, Germany.
- Department of Clinical Psychology and Psychotherapy, Institute of Psychology, Friedrich-Alexander-Universität Erlangen-Nürnberg, Erlangen, Germany.
| | - Alexandra Piotrowski
- Center for Health Economics and Health Services Research, Schumpeter School of Business and Economics, University of Wuppertal, Wuppertal, Germany
- Chair of General Practice II and Patient Centredness in Primary Care, Institute of General Practice and Primary Care (IAMAG), Faculty of Health, Witten/Herdecke University, Witten, Germany
| | - Leah Bührmann
- Department of Social Work, Education and Community Wellbeing, Northumbria University, Newcastle Upon Tyne, UK
| | - Caroline Oehler
- German Depression Foundation, Leipzig, Germany
- Department of Psychiatry and Psychotherapy, University of Leipzig Medical Center, Leipzig, Germany
| | - Ingrid Titzler
- Department of Clinical Psychology and Psychotherapy, Institute of Psychology, Friedrich-Alexander-Universität Erlangen-Nürnberg, Erlangen, Germany
| | - Anna-Lena Netter
- Department of Clinical Psychology and Psychotherapy, Institute of Psychology, Philipps University of Marburg, Marburg, Germany
| | - Sebastian Potthoff
- Department of Social Work, Education and Community Wellbeing, Northumbria University, Newcastle Upon Tyne, UK
| | - David Daniel Ebert
- Professorship Psychology & Digital Mental Health Care, Department of Sport and Health Sciences, Technical University of Munich, Georg-Brauchle-Ring 60/62, Munich, 80992, Germany
| | - Tracy Finch
- Department of Nursing, Midwifery and Health, Northumbria University, Newcastle Upon Tyne, UK
| | - Juliane Köberlein-Neu
- Center for Health Economics and Health Services Research, Schumpeter School of Business and Economics, University of Wuppertal, Wuppertal, Germany
| | - Anne Etzelmüller
- Professorship Psychology & Digital Mental Health Care, Department of Sport and Health Sciences, Technical University of Munich, Georg-Brauchle-Ring 60/62, Munich, 80992, Germany
- HelloBetter, GET.ON Institut für Online Gesundheitstrainings GmbH, Berlin, Germany
| |
Collapse
|
5
|
Le Jeannic A, Turmaine K, Gandré C, Vinet MA, Michel M, Chevreul K. Defining the Characteristics of an e-Health Tool for Suicide Primary Prevention in the General Population: The StopBlues Case in France. INTERNATIONAL JOURNAL OF ENVIRONMENTAL RESEARCH AND PUBLIC HEALTH 2023; 20:6096. [PMID: 37372683 DOI: 10.3390/ijerph20126096] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/23/2023] [Revised: 05/26/2023] [Accepted: 05/29/2023] [Indexed: 06/29/2023]
Abstract
With over one million deaths per year in the world, suicide is a major public health problem that could be significantly reduced by effective prevention programs. E-health tools are of particular interest for primary prevention as they can address a broad population including people unaware of their own risk and provide information and help without the fear of stigma. Our main objective was to define the overall characteristics of an e-health tool for suicide primary prevention in the French general population by defining the characteristics of the IT features; the content of the information delivered; the best way to structure it; and how it should be relayed and by whom. The research was carried out through a literature review and a co-construction phase with stakeholders. Four types of strategies may guide the construction of e-health tools for suicide primary prevention: education and awareness, (self-)screening, accessing support, and mental health coping. They should be accessible on different devices to reach the most users, and language and content should be adapted to the target population and to the issue being addressed. Finally, the tool should be consistent with ethical and quality best practices. The e-health tool StopBlues was developed following those recommendations.
Collapse
Affiliation(s)
- Anaïs Le Jeannic
- ECEVE, UMR 1123, Université Paris Cité, Inserm, 75010 Paris, France
- Unité de Recherche Clinique en Économie de la Santé (URC Eco), Assistance Publique-Hôpitaux de Paris, 1 Place du Parvis Notre-Dame, 75004 Paris, France
| | | | - Coralie Gandré
- ECEVE, UMR 1123, Université Paris Cité, Inserm, 75010 Paris, France
| | - Marie-Amélie Vinet
- ECEVE, UMR 1123, Université Paris Cité, Inserm, 75010 Paris, France
- Unité de Recherche Clinique en Économie de la Santé (URC Eco), Assistance Publique-Hôpitaux de Paris, 1 Place du Parvis Notre-Dame, 75004 Paris, France
| | - Morgane Michel
- ECEVE, UMR 1123, Université Paris Cité, Inserm, 75010 Paris, France
- Unité D'épidémiologie Clinique, Assistance Publique-Hôpitaux de Paris, Hôpital Robert Debré, 75019 Paris, France
| | - Karine Chevreul
- ECEVE, UMR 1123, Université Paris Cité, Inserm, 75010 Paris, France
- Unité de Recherche Clinique en Économie de la Santé (URC Eco), Assistance Publique-Hôpitaux de Paris, 1 Place du Parvis Notre-Dame, 75004 Paris, France
- Unité D'épidémiologie Clinique, Assistance Publique-Hôpitaux de Paris, Hôpital Robert Debré, 75019 Paris, France
| |
Collapse
|
6
|
Orsolini L, Pompili S, Salvi V, Volpe U. A Systematic Review on TeleMental Health in Youth Mental Health: Focus on Anxiety, Depression and Obsessive-Compulsive Disorder. MEDICINA (KAUNAS, LITHUANIA) 2021; 57:793. [PMID: 34440999 PMCID: PMC8398756 DOI: 10.3390/medicina57080793] [Citation(s) in RCA: 29] [Impact Index Per Article: 7.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 07/04/2021] [Revised: 07/26/2021] [Accepted: 07/28/2021] [Indexed: 01/17/2023]
Abstract
Background and Objectives: The Internet is widely used and disseminated amongst youngsters and many web-based applications may serve to improve mental health care access, particularly in remote and distant sites or in settings where there is a shortage of mental health practitioners. However, in recent years, specific digital psychiatry interventions have been developed and implemented for special populations such as children and adolescents. Materials and Methods: Hereby, we describe the current state-of-the-art in the field of TMH application for young mental health, focusing on recent studies concerning anxiety, obsessive-compulsive disorder and affective disorders. Results: After screening and selection process, a total of 56 studies focusing on TMH applied to youth depression (n = 29), to only youth anxiety (n = 12) or mixed youth anxiety/depression (n = 7) and youth OCD (n = 8) were selected and retrieved. Conclusions: Telemental Health (TMH; i.e., the use of telecommunications and information technology to provide access to mental health assessment, diagnosis, intervention, consultation, supervision across distance) may offer an effective and efficacious tool to overcome many of the barriers encountering in the delivery of young mental health care.
Collapse
Affiliation(s)
- Laura Orsolini
- Unit of Clinical Psychiatry, Department of Clinical Neurosciences/DIMSC, School of Medicine, Polytechnic University of Marche, Via Tronto 10/A, 60126 Ancona, Italy; (S.P.); (V.S.); (U.V.)
| | | | | | | |
Collapse
|
7
|
Oehler C, Görges F, Rogalla M, Rummel-Kluge C, Hegerl U. Efficacy of a Guided Web-Based Self-Management Intervention for Depression or Dysthymia: Randomized Controlled Trial With a 12-Month Follow-Up Using an Active Control Condition. J Med Internet Res 2020; 22:e15361. [PMID: 32673233 PMCID: PMC7388040 DOI: 10.2196/15361] [Citation(s) in RCA: 28] [Impact Index Per Article: 5.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/04/2019] [Revised: 04/01/2020] [Accepted: 04/26/2020] [Indexed: 02/01/2023] Open
Abstract
BACKGROUND An increasing number of studies suggest that web-based interventions for patients with depression can reduce their symptoms and are expected to fill currently existing treatment gaps. However, evidence for their efficacy has mainly been derived from comparisons with wait-list or treatment as usual controls. In particular, designs using wait-list controls are unlikely to induce hope and may even have nocebo effects, making it difficult to draw conclusions about the intervention's efficacy. Studies using active controls are rare and have not yielded conclusive results. OBJECTIVE The main objective of this study is to assess the acute and long-term antidepressant efficacy of a 6-week, guided, web-based self-management intervention building on the principles of cognitive behavioral therapy (iFightDepression tool) for patients with depression compared with web-based progressive muscle relaxation as an active control condition. METHODS A total of 348 patients with mild-to-moderate depressive symptoms or dysthymia (according to the Mini International Neuropsychiatric Interview) were recruited online and randomly assigned to 1 of the 2 intervention arms. Acute antidepressant effects after 6 weeks and long-term effects at 3-, 6-, and 12-month follow-up were studied using the Inventory of Depressive Symptomatology-self-rating as a primary outcome parameter and change in quality of life (Short Form 12) and user satisfaction (client satisfaction questionnaire) as secondary outcome parameters. Treatment effects were assessed using mixed model analyses. RESULTS Over the entire observation period, a greater reduction in symptoms of depression (P=.01) and a greater improvement of life quality (P<.001) was found in the intervention group compared with the active control group. Separate tests for each time point revealed significant effects on depressive symptoms at the 3-month follow-up (d=0.281; 95% CI 0.069 to 0.493), but not after 6 weeks (main outcome:d=0.192; 95% CI -0.020 to 0.404) and 6 and 12 months. The intervention was significantly superior to the control condition with respect to user satisfaction (25.31 vs 21.97; t259=5.804; P<.01). CONCLUSIONS The fact that antidepressant effects have been found for a guided self-management tool in comparison with an active control strengthens the evidence base for the efficacy of web-based interventions. The antidepressant effect became most prominent at the 3-month follow-up. After 6 weeks of intervention, significant positive effects were observed on life quality but not on depressive symptoms. Although the effect size of such web-based interventions on symptoms of depression might be smaller than that suggested by earlier studies using wait-list control conditions, they can be a cost-effective addition to antidepressants and face-to-face psychotherapy. TRIAL REGISTRATION International Clinical Trials Registry Platform ICTRP080-15-09032015; https://apps.who.int/trialsearch/Trial2.aspx?TrialID=DRKS00009323.
Collapse
Affiliation(s)
| | - Frauke Görges
- Department of Psychiatry and Psychotherapy, University Leipzig, Leipzig, Germany
| | - Mandy Rogalla
- Department of Psychiatry and Psychotherapy, University Leipzig, Leipzig, Germany
| | | | - Ulrich Hegerl
- Department of Psychiatry, Psychosomatics and Psychotherapy, Goethe-Universität Frankfurt, Frankfurt, Germany
| |
Collapse
|
8
|
Oehler C, Görges F, Böttger D, Hug J, Koburger N, Kohls E, Rummel-Kluge C. Efficacy of an internet-based self-management intervention for depression or dysthymia - a study protocol of an RCT using an active control condition. BMC Psychiatry 2019; 19:90. [PMID: 30871544 PMCID: PMC6419490 DOI: 10.1186/s12888-019-2063-1] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 05/15/2018] [Accepted: 02/20/2019] [Indexed: 12/22/2022] Open
Abstract
BACKGROUND The treatment of major depressive disorder, a highly prevalent disorder associated with pronounced burden, is a large challenge to healthcare systems worldwide. Internet based self-management interventions seem to be a cost effective way to complement the treatment of depressed patients, but the accumulating evidence is mainly based on the comparison to waitlist controls and treatment as usual, which might lead to an overestimation of effects. Furthermore, studies assessing long-term effects and possible negative outcomes are still rare. METHODS/DESIGN The proposed study evaluates the efficacy of the German version of the iFightDepression® tool in comparison to an active control condition. A total of 360 patients with mild to moderate depressive symptoms are included into a two-armed randomized controlled trial. They receive one of two six week interventions; either the iFightDepression® tool or progressive muscle relaxation serving as the control condition. Both intervention groups receive information material, weekly tasks via the internet and regular phone calls as part of the intervention. The primary outcome is change in depressive symptoms after the intervention period, as measured with the Inventory of Depressive Symptomatology. Satisfaction with the program, usability, changes in perceived quality of life, and possible negative effects are assessed as secondary outcomes. DISCUSSION This study represents the first randomized controlled trial on the iFightDepression® self-management tool in its German version, aiming at efficacy, but also at providing new insights into so far understudied aspects of E-mental health programs, namely the specificity of the treatment effect compared to an active control condition, it's continuity over a time course of 12 months, and possible negative effects of these internet based interventions. TRIAL REGISTRATION International trial-registration took place through the "international clinical trials registry platform" (WHO) with the secondary ID 080-15-09032015. German Clinical Trial Registration: DRKS00009323 (DRKS.de, registered on 25 February 2016).
Collapse
Affiliation(s)
- Caroline Oehler
- German Depression Foundation, Semmelweisstr. 10, 04103 Leipzig, Germany
| | - Frauke Görges
- German Depression Foundation, Semmelweisstr. 10, 04103 Leipzig, Germany
| | - Daniel Böttger
- German Depression Foundation, Semmelweisstr. 10, 04103 Leipzig, Germany
| | - Juliane Hug
- grid.493241.9European Alliance Against Depression, Semmelweisstr. 10, 04103 Leipzig, Germany
| | - Nicole Koburger
- Research Academy Leipzig, Wächterstraße 30, 04107 Leipzig, Germany
| | - Elisabeth Kohls
- 0000 0001 2230 9752grid.9647.cDepartment of Psychiatry and Psychotherapy, Medical Faculty, University Leipzig, Semmelweisstr. 10, 04103 Leipzig, Germany
| | - Christine Rummel-Kluge
- Department of Psychiatry and Psychotherapy, Medical Faculty, University Leipzig, Semmelweisstr. 10, 04103, Leipzig, Germany.
| |
Collapse
|
9
|
Baldofski S, Kohls E, Bauer S, Becker K, Bilic S, Eschenbeck H, Kaess M, Moessner M, Salize HJ, Diestelkamp S, Voß E, Rummel-Kluge C. Efficacy and cost-effectiveness of two online interventions for children and adolescents at risk for depression (E.motion trial): study protocol for a randomized controlled trial within the ProHEAD consortium. Trials 2019; 20:53. [PMID: 30646944 PMCID: PMC6334409 DOI: 10.1186/s13063-018-3156-8] [Citation(s) in RCA: 14] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/02/2018] [Accepted: 12/22/2018] [Indexed: 11/10/2022] Open
Abstract
BACKGROUND Depression is a serious mental health problem and is common in children and adolescents. Online interventions are promising in overcoming the widespread undertreatment of depression and in improving the help-seeking behavior in children and adolescents. METHODS The multicentre, randomized controlled E.motion trial is part of the German ProHEAD consortium (Promoting Help-seeking using E-technology for ADolescents). The objective of the trial is to investigate the efficacy and cost-effectiveness of two online interventions to reduce depressive symptomatology in high-risk children and adolescents with subsyndromal symptoms of depression in comparison to an active control group. Participants will be randomized to one of three conditions: (1) Intervention 1, a clinician-guided self-management program (iFightDepression®); (2) Intervention 2, a clinician-guided group chat intervention; and (3) Control intervention, a psycho-educational website on depressive symptoms. Interventions last six weeks. In total, N = 363 children and adolescents aged ≥ 12 years with Patient Health Questionnaire-9 modified for Adolescents (PHQ-A) scores in the range of 5-9 will be recruited at five study sites across Germany. Online questionnaires will be administered before onset of the intervention, at the end of the intervention, and at the six-month follow-up. Further, children and adolescents will participate in the baseline screening and the one- and two-year school-based follow-up assessments integrated in the ProHEAD consortium. The primary endpoint is depression symptomatology at the end of intervention as measured by the PHQ-A score. Secondary outcomes include depression symptomatology at all follow-ups, help-seeking attitudes, and actual face-to-face help-seeking, adherence to and satisfaction with the interventions, depression stigma, and utilization and cost of interventions. DISCUSSION This study represents the first randomized controlled trial (RCT) investigating efficacy and cost-effectiveness of two online interventions in children and adolescents aged ≥ 12 years at risk for depression. It aims to provide a better understanding of the help-seeking behavior of children and adolescents, potential benefits of E-mental health interventions for this age group, and new insights into so far understudied aspects of E-mental health programs, such as potential negative effects of online interventions. This knowledge will be used to tailor and improve future help offers and programs for children and adolescents and ways of treatment allocation. TRIAL REGISTRATION German Register for Clinical Trials (DRKS), DRKS00014668 . Registered on 4 May 2018. International trial registration took place through the "international clinical trials registry platform" with the secondary ID S-086/2018.
Collapse
Affiliation(s)
- Sabrina Baldofski
- Department of Psychiatry and Psychotherapy, Medical Faculty, University Leipzig, Semmelweisstraße 10, 04103 Leipzig, Germany
| | - Elisabeth Kohls
- Department of Psychiatry and Psychotherapy, Medical Faculty, University Leipzig, Semmelweisstraße 10, 04103 Leipzig, Germany
| | - Stephanie Bauer
- Center for Psychotherapy Research, University Hospital Heidelberg, Heidelberg, Germany
| | - Katja Becker
- Department of Child and Adolescent Psychiatry, Psychosomatics and Psychotherapy, University Hospital of Marburg and Philipps-University Marburg, Marburg, Germany
- Marburg Center for Mind, Brain and Behavior (MCMBB), Philipps-University Marburg, Marburg, Germany
| | - Sally Bilic
- Center for Psychotherapy Research, University Hospital Heidelberg, Heidelberg, Germany
| | - Heike Eschenbeck
- Department of Psychology, University of Education Schwäbisch Gmünd, Schwäbisch Gmünd, Germany
| | - Michael Kaess
- Department of Child and Adolescent Psychiatry, Centre for Psychosocial Medicine, University Hospital Heidelberg, Heidelberg, Germany
- University Hospital of Child and Adolescent Psychiatry and Psychotherapy, University of Bern, Bern, Switzerland
| | - Markus Moessner
- Center for Psychotherapy Research, University Hospital Heidelberg, Heidelberg, Germany
| | - Hans Joachim Salize
- Mental Health Services Research Group, Central Institute of Mental Health, Medical Faculty Mannheim/Heidelberg University, Mannheim, Germany
| | - Silke Diestelkamp
- German Center for Addiction Research in Childhood and Adolescence (DZSKJ), University Medical Center Hamburg-Eppendorf, Hamburg, Germany
| | - Elke Voß
- Mental Health Services Research Group, Central Institute of Mental Health, Medical Faculty Mannheim/Heidelberg University, Mannheim, Germany
| | - Christine Rummel-Kluge
- Department of Psychiatry and Psychotherapy, Medical Faculty, University Leipzig, Semmelweisstraße 10, 04103 Leipzig, Germany
| |
Collapse
|
10
|
Wilson M, Finlay M, Orr M, Barbosa-Leiker C, Sherazi N, Roberts MLA, Layton M, Roll JM. Engagement in online pain self-management improves pain in adults on medication-assisted behavioral treatment for opioid use disorders. Addict Behav 2018; 86:130-137. [PMID: 29731244 DOI: 10.1016/j.addbeh.2018.04.019] [Citation(s) in RCA: 27] [Impact Index Per Article: 3.9] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/27/2017] [Revised: 04/03/2018] [Accepted: 04/25/2018] [Indexed: 01/14/2023]
Abstract
INTRODUCTION Persistent pain has been recognized as an important motivator that can lead individuals to misuse opioids. New approaches are needed to test pain treatments that can improve outcomes for people with persistent pain in medication-assisted behavioral treatment for opioid use disorder. This study piloted an online pain self-management program to explore acceptability and treatment effects. METHODS A sample of 60 adults diagnosed with chronic non-cancer pain and receiving medication-assisted behavioral treatment at one of two clinics were randomized into either treatment group with access to an online pain management program or waitlist attention control. Participants received online surveys via email at baseline and post-treatment at week 8. RESULTS The majority of participants (n = 44; 73%) reported that their first use of opioids was in response to a painful event. Those who engaged in the online program had significantly lower pain interference, pain severity, opioid misuse measures, and depressive symptoms after eight weeks while pain self-efficacy was increased. CONCLUSION Our results suggest the online pain self-management program content may be helpful for managing physical and emotional symptoms experienced by individuals with co-occurring pain and opioid use disorders. To improve online engagement, more support is necessary to assist with technology access and completion of online activities.
Collapse
|
11
|
Choubisa R, Singh K. Development and validation of a web-delivered positive psychological intervention in an Indian Milieu: Lessons from a limited pilot randomized controlled trial. COGENT PSYCHOLOGY 2018. [DOI: 10.1080/23311908.2018.1488512] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/28/2022] Open
Affiliation(s)
- Rajneesh Choubisa
- Department of Humanities and Social Sciences, Birla Institute of Technology & Science (BITS), Pilani, Pilani 333031, Rajasthan, India
| | - Kamlesh Singh
- Department of Humanities & Social Sciences, Indian Institute of Technology (IIT)-Delhi, Hauz Khas, New Delhi 110016, India
| |
Collapse
|
12
|
Ziedonis D, Larkin C, Appasani R. Dignity in mental health practice & research: Time to unite on innovation, outreach & education. Indian J Med Res 2018; 144:491-495. [PMID: 28256454 PMCID: PMC5345292 DOI: 10.4103/0971-5916.200885] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/29/2022] Open
Affiliation(s)
- Douglas Ziedonis
- Department of Psychiatry, University of Massachusetts Medical School, Worcester, MA, USA
| | - Celine Larkin
- Department of Psychiatry, University of Massachusetts Medical School, Worcester, MA, USA
| | - Raghu Appasani
- Department of Psychiatry, University of Massachusetts Medical School, Worcester, MA, USA
| |
Collapse
|
13
|
Abstract
More than 800 000 people die every year from suicide, and about 20 times more attempt suicide. In most countries, suicide risk is highest in older males, and risk of attempted suicide is highest in younger females. The higher lethal level of suicidal acts in males is explained by the preference for more lethal methods, as well as other factors. In the vast majority of cases, suicidal behavior occurs in the context of psychiatric disorders, depression being the most important one. Improving the treatment of depression, restricting access to lethal means, and avoiding the Werther effect (imitation suicide) are central aspects of suicide prevention programs. In several European regions, the four-level intervention concept of the European Alliance Against Depression (www.EAAD.net), simultaneously targeting depression and suicidal behavior, has been found to have preventive effects on suicidal behavior. It has already been implemented in more than 100 regions in Europe.
Collapse
Affiliation(s)
- Ulrich Hegerl
- Department of Psychiatry and Psychotherapy, University Hospital of Leipzig, Leipzig, Germany
| |
Collapse
|
14
|
Dogan E, Sander C, Wagner X, Hegerl U, Kohls E. Smartphone-Based Monitoring of Objective and Subjective Data in Affective Disorders: Where Are We and Where Are We Going? Systematic Review. J Med Internet Res 2017; 19:e262. [PMID: 28739561 PMCID: PMC5547249 DOI: 10.2196/jmir.7006] [Citation(s) in RCA: 99] [Impact Index Per Article: 12.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/15/2016] [Revised: 03/31/2017] [Accepted: 05/15/2017] [Indexed: 02/06/2023] Open
Abstract
Background Electronic mental health interventions for mood disorders have increased rapidly over the past decade, most recently in the form of various systems and apps that are delivered via smartphones. Objective We aim to provide an overview of studies on smartphone-based systems that combine subjective ratings with objectively measured data for longitudinal monitoring of patients with affective disorders. Specifically, we aim to examine current knowledge on: (1) the feasibility of, and adherence to, such systems; (2) the association of monitored data with mood status; and (3) the effects of monitoring on clinical outcomes. Methods We systematically searched PubMed, Web of Science, PsycINFO, and the Cochrane Central Register of Controlled Trials for relevant articles published in the last ten years (2007-2017) by applying Boolean search operators with an iterative combination of search terms, which was conducted in February 2017. Additional articles were identified via pearling, author correspondence, selected reference lists, and trial protocols. Results A total of 3463 unique records were identified. Twenty-nine studies met the inclusion criteria and were included in the review. The majority of articles represented feasibility studies (n=27); two articles reported results from one randomized controlled trial (RCT). In total, six different self-monitoring systems for affective disorders that used subjective mood ratings and objective measurements were included. These objective parameters included physiological data (heart rate variability), behavioral data (phone usage, physical activity, voice features), and context/environmental information (light exposure and location). The included articles contained results regarding feasibility of such systems in affective disorders, showed reasonable accuracy in predicting mood status and mood fluctuations based on the objectively monitored data, and reported observations about the impact of monitoring on clinical state and adherence of patients to the system usage. Conclusions The included observational studies and RCT substantiate the value of smartphone-based approaches for gathering long-term objective data (aside from self-ratings to monitor clinical symptoms) to predict changes in clinical states, and to investigate causal inferences about state changes in patients with affective disorders. Although promising, a much larger evidence-base is necessary to fully assess the potential and the risks of these approaches. Methodological limitations of the available studies (eg, small sample sizes, variations in the number of observations or monitoring duration, lack of RCT, and heterogeneity of methods) restrict the interpretability of the results. However, a number of study protocols stated ambitions to expand and intensify research in this emerging and promising field.
Collapse
Affiliation(s)
- Ezgi Dogan
- Medical Faculty, Department of Psychiatry and Psychotherapy, University Leipzig, Leipzig, Germany
| | - Christian Sander
- Medical Faculty, Department of Psychiatry and Psychotherapy, University Leipzig, Leipzig, Germany.,Depression Research Centre, German Depression Foundation, Leipzig, Germany
| | - Xenija Wagner
- Medical Faculty, Department of Psychiatry and Psychotherapy, University Leipzig, Leipzig, Germany
| | - Ulrich Hegerl
- Medical Faculty, Department of Psychiatry and Psychotherapy, University Leipzig, Leipzig, Germany.,Depression Research Centre, German Depression Foundation, Leipzig, Germany
| | - Elisabeth Kohls
- Medical Faculty, Department of Psychiatry and Psychotherapy, University Leipzig, Leipzig, Germany
| |
Collapse
|
15
|
Justicia A, Elices M, Cebria AI, Palao DJ, Gorosabel J, Puigdemont D, de Diego-Adeliño J, Gabilondo A, Iruin A, Hegerl U, Pérez V. Rationale and methods of the iFightDepression study: A double-blind, randomized controlled trial evaluating the efficacy of an internet-based self-management tool for moderate to mild depression. BMC Psychiatry 2017; 17:143. [PMID: 28420367 PMCID: PMC5395842 DOI: 10.1186/s12888-017-1306-2] [Citation(s) in RCA: 6] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 03/10/2017] [Accepted: 04/10/2017] [Indexed: 11/15/2022] Open
Abstract
BACKGROUND During the last decade online interventions have emerged as a promising approach for patients with mild/moderate depressive symptoms, reaching at large populations and representing cost-effective alternatives. The main objective of this double-blind, randomized controlled trial is to examine the efficacy of an internet-based self-management tool (iFightDepression) for mild to moderate depression as an add-on to treatment as usual (TAU) versus internet-based psychoeducation plus TAU. METHODS A total of 310 participants with major depression disorder (MDD) will be recruited at four different mental-health facilities in Spain. Participants will be randomly allocated to one of two study arms: iFightDepression (iFD) tool + TAU vs. internet-based psychoeducation + TAU. Both interventions last for 8 weeks and there is a 12 weeks follow up. The primary outcome measure is changes in depressive symptoms assessed with the Hamilton Depression Rating Scale. Additionally, pre-post interventions assessments will include socio-demographic data, a brief medical and clinical history and self-reported measures of depressive symptoms, quality of life, functional impairments and satisfaction with the iFD tool. DISCUSSION iFightDepression is an easy-prescribed tool that could increase the efficacy of conventional treatment and potentially reach untreated patients, shortening waiting lists to receive psychological treatment. Confirming the efficacy of the iFD internet-based self-management tool as an add-on treatment for individuals with mild to moderate depression will be clinically-relevant. TRIAL REGISTRATION Registration number NCT02312583 . Clinicaltrials.gov . December 4, 2014.
Collapse
Affiliation(s)
- Azucena Justicia
- Centro de Investigación Biomédica en Red de Salud Mental (CIBERSAM), Madrid, Spain. .,Departament de Psiquiatria i Medicina Legal, Universitat Autònoma de Barcelona, Barcelona, Cerdanyola del Vallès, Spain. .,Institut de Neuropsiquiatria i Addiccions (INAD), PSMar, Barcelona, Spain. .,Institut Hospital del Mar d'Investigacions Mèdiques (IMIM), Barcelona, Spain.
| | - Matilde Elices
- grid.469673.9Centro de Investigación Biomédica en Red de Salud Mental (CIBERSAM), Madrid, Spain ,0000 0004 1767 9005grid.20522.37Institut Hospital del Mar d’Investigacions Mèdiques (IMIM), Barcelona, Spain
| | - Ana Isabel Cebria
- grid.469673.9Centro de Investigación Biomédica en Red de Salud Mental (CIBERSAM), Madrid, Spain ,grid.7080.fDepartament de Psiquiatria i Medicina Legal, Universitat Autònoma de Barcelona, Barcelona, Cerdanyola del Vallès Spain ,0000 0000 9238 6887grid.428313.fParc Taulí Hospital Universitari, Sabadell, Spain
| | - Diego J. Palao
- grid.469673.9Centro de Investigación Biomédica en Red de Salud Mental (CIBERSAM), Madrid, Spain ,grid.7080.fDepartament de Psiquiatria i Medicina Legal, Universitat Autònoma de Barcelona, Barcelona, Cerdanyola del Vallès Spain ,0000 0000 9238 6887grid.428313.fParc Taulí Hospital Universitari, Sabadell, Spain
| | | | - Dolors Puigdemont
- grid.469673.9Centro de Investigación Biomédica en Red de Salud Mental (CIBERSAM), Madrid, Spain ,Departament de Psiquiatria, Hospital de la Santa Creu i Sant Pau, Institut d’Investigació Biomèdica Sant Pau, Barcelona, Spain
| | - Javier de Diego-Adeliño
- grid.469673.9Centro de Investigación Biomédica en Red de Salud Mental (CIBERSAM), Madrid, Spain ,grid.7080.fDepartament de Psiquiatria i Medicina Legal, Universitat Autònoma de Barcelona, Barcelona, Cerdanyola del Vallès Spain ,Departament de Psiquiatria, Hospital de la Santa Creu i Sant Pau, Institut d’Investigació Biomèdica Sant Pau, Barcelona, Spain
| | - Andrea Gabilondo
- Outpatient Mental Health Care Network, Osakidetza- Basque Health System, Biodonosti Health Research Institute, San Sebastian, Spain
| | - Alvaro Iruin
- Outpatient Mental Health Care Network, Osakidetza- Basque Health System, Biodonosti Health Research Institute, San Sebastian, Spain
| | - Ulrich Hegerl
- 0000 0001 2230 9752grid.9647.cUniversity Hospital, Department of Psychiatry and Psychotherapy, University of Leipzig, Leipzig, Germany ,German Depression Foundation, Depression Research Centre, Leipzig, Germany
| | - Víctor Pérez
- grid.469673.9Centro de Investigación Biomédica en Red de Salud Mental (CIBERSAM), Madrid, Spain ,grid.7080.fDepartament de Psiquiatria i Medicina Legal, Universitat Autònoma de Barcelona, Barcelona, Cerdanyola del Vallès Spain ,Institut de Neuropsiquiatria i Addiccions (INAD), PSMar, Barcelona, Spain ,0000 0004 1767 9005grid.20522.37Institut Hospital del Mar d’Investigacions Mèdiques (IMIM), Barcelona, Spain
| |
Collapse
|
16
|
Wilson M, Hewes C, Barbosa-Leiker C, Mason A, Wuestney KA, Shuen JA, Wilson MP. Engaging Adults With Chronic Disease in Online Depressive Symptom Self-Management. West J Nurs Res 2017; 40:834-853. [PMID: 28322662 DOI: 10.1177/0193945916689068] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/15/2022]
Abstract
The main purpose of this study was to evaluate participant engagement and effects of an Internet-based, self-directed program for depressive symptoms piloted among adults with a chronic disease. Eligible participants ( N = 47) were randomly assigned to either the "Think Clearly About Depression" online depression self-management program or the control group. The Patient Health Questionnaire-8 and Chronic Disease Self-Efficacy Scales were administered at baseline and at Weeks 4 and 8 after initiating the intervention. Number Needed to Treat analysis indicated that one in every three treatment group participants found clinically significant reductions in depressive symptoms by Week 8. Paired-sample t tests showed that depressive symptoms and self-efficacy in management of depressive symptoms improved over time for those in the treatment group and not for those in the control group. Participants' engagement and satisfaction with the online program were favorable.
Collapse
Affiliation(s)
- Marian Wilson
- 1 Washington State University College of Nursing, Spokane, WA, USA
| | - Casey Hewes
- 2 Texas Health Resources, Arlington, TX, USA
| | | | - Anne Mason
- 1 Washington State University College of Nursing, Spokane, WA, USA
| | | | | | | |
Collapse
|
17
|
Kutcher S, Wei Y, Costa S, Gusmão R, Skokauskas N, Sourander A. Enhancing mental health literacy in young people. Eur Child Adolesc Psychiatry 2016; 25:567-9. [PMID: 27236662 DOI: 10.1007/s00787-016-0867-9] [Citation(s) in RCA: 67] [Impact Index Per Article: 7.4] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 11/27/2022]
Affiliation(s)
- Stan Kutcher
- WHO Collaborating Center, Dalhousie University, Halifax, Canada
- Sun Life Financial Chair in Adolescent Mental Health Team, IWK Health Centre, 5980 University Avenue, P.O Box 9700, Halifax, B3K 6R8, Canada
| | - Yifeng Wei
- Sun Life Financial Chair in Adolescent Mental Health Team, IWK Health Centre, 5980 University Avenue, P.O Box 9700, Halifax, B3K 6R8, Canada
| | - Susana Costa
- EAAD, European Alliance Against Depression, Semmelweisstraße 10, Haus 13, 04103, Leipzig, Germany
- EUTIMIA, Aliança Europeia Contra a Depressão em Portugal, Rua Duque de Palmela 2, 3º Esqº, 1250-098, Lisbon, Portugal
| | - Ricardo Gusmão
- EUTIMIA, Aliança Europeia Contra a Depressão em Portugal, Rua Duque de Palmela 2, 3º Esqº, 1250-098, Lisbon, Portugal
- Instituto de Saúde Pública da Universidade do Porto (ISPUP), Rua das Taipas nº135, 4050-600, Porto, Portugal
| | - Norbert Skokauskas
- Centre for Child and Youth Mental Health, NTNU, Pb 8905, MTFS, 7491, Trondheim, Norway
| | - Andre Sourander
- University of Turku and Turku University Hospital, 20520, Turku, Finland.
| |
Collapse
|