3
|
Lee YY, Le LKD, Stockings EA, Hay P, Whiteford HA, Barendregt JJ, Mihalopoulos C. Estimation of a Relative Risk Effect Size when Using Continuous Outcomes Data: An Application of Methods in the Prevention of Major Depression and Eating Disorders. Med Decis Making 2018; 38:866-880. [PMID: 30156470 DOI: 10.1177/0272989x18793394] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/05/2023]
Abstract
INTRODUCTION The raw mean difference (RMD) and standardized mean difference (SMD) are continuous effect size measures that are not readily usable in decision-analytic models of health care interventions. This study compared the predictive performance of 3 methods by which continuous outcomes data collected using psychiatric rating scales can be used to calculate a relative risk (RR) effect size. METHODS Three methods to calculate RR effect sizes from continuous outcomes data are described: the RMD, SMD, and Cochrane conversion methods. Each conversion method was validated using data from randomized controlled trials (RCTs) examining the efficacy of interventions for the prevention of depression in youth (aged ≤17 years) and adults (aged ≥18 years) and the prevention of eating disorders in young women (aged ≤21 years). Validation analyses compared predicted RR effect sizes to actual RR effect sizes using scatterplots, correlation coefficients ( r), and simple linear regression. An applied analysis was also conducted to examine the impact of using each conversion method in a cost-effectiveness model. RESULTS The predictive performances of the RMD and Cochrane conversion methods were strong relative to the SMD conversion method when analyzing RCTs involving depression in adults (RMD: r = 0.89-0.90; Cochrane: r = 0.73; SMD: r = 0.41-0.67) and eating disorders in young women (RMD: r = 0.89; Cochrane: r = 0.96). Moderate predictive performances were observed across the 3 methods when analyzing RCTs involving depression in youth (RMD: r = 0.50; Cochrane: r = 0.47; SMD: r = 0.46-0.46). Negligible differences were observed between the 3 methods when applied to a cost-effectiveness model. CONCLUSION The RMD and Cochrane conversion methods are both valid methods for predicting RR effect sizes from continuous outcomes data. However, further validation and refinement are required before being applied more broadly.
Collapse
Affiliation(s)
- Yong Yi Lee
- School of Public Health, University of Queensland, Herston, Queensland, Australia (YYL, HAW, JJB).,Queensland Centre for Mental Health Research (QCMHR), The Park Centre for Mental Health, Wacol, Queensland, Australia (YYL, HAW).,Geelong, Deakin Health Economics, School of Health and Social Development, Deakin University, Melbourne, Victoria, Australia (LK-DL, CM).,National Drug and Alcohol Research Centre (NDARC), University of New South Wales, Randwick, New South Wales, Australia (EAS).,School of Medicine and Translational Health Research Institute, Western Sydney University, NSW, Australia (PH).,Institute for Health Metrics and Evaluation (IHME), University of Washington, Seattle, WA (HAW).,Epigear International Pty Ltd, Sunrise Beach, Queensland Australia (JJB)
| | - Long Khanh-Dao Le
- School of Public Health, University of Queensland, Herston, Queensland, Australia (YYL, HAW, JJB).,Queensland Centre for Mental Health Research (QCMHR), The Park Centre for Mental Health, Wacol, Queensland, Australia (YYL, HAW).,Geelong, Deakin Health Economics, School of Health and Social Development, Deakin University, Melbourne, Victoria, Australia (LK-DL, CM).,National Drug and Alcohol Research Centre (NDARC), University of New South Wales, Randwick, New South Wales, Australia (EAS).,School of Medicine and Translational Health Research Institute, Western Sydney University, NSW, Australia (PH).,Institute for Health Metrics and Evaluation (IHME), University of Washington, Seattle, WA (HAW).,Epigear International Pty Ltd, Sunrise Beach, Queensland Australia (JJB)
| | - Emily A Stockings
- School of Public Health, University of Queensland, Herston, Queensland, Australia (YYL, HAW, JJB).,Queensland Centre for Mental Health Research (QCMHR), The Park Centre for Mental Health, Wacol, Queensland, Australia (YYL, HAW).,Geelong, Deakin Health Economics, School of Health and Social Development, Deakin University, Melbourne, Victoria, Australia (LK-DL, CM).,National Drug and Alcohol Research Centre (NDARC), University of New South Wales, Randwick, New South Wales, Australia (EAS).,School of Medicine and Translational Health Research Institute, Western Sydney University, NSW, Australia (PH).,Institute for Health Metrics and Evaluation (IHME), University of Washington, Seattle, WA (HAW).,Epigear International Pty Ltd, Sunrise Beach, Queensland Australia (JJB)
| | - Phillipa Hay
- School of Public Health, University of Queensland, Herston, Queensland, Australia (YYL, HAW, JJB).,Queensland Centre for Mental Health Research (QCMHR), The Park Centre for Mental Health, Wacol, Queensland, Australia (YYL, HAW).,Geelong, Deakin Health Economics, School of Health and Social Development, Deakin University, Melbourne, Victoria, Australia (LK-DL, CM).,National Drug and Alcohol Research Centre (NDARC), University of New South Wales, Randwick, New South Wales, Australia (EAS).,School of Medicine and Translational Health Research Institute, Western Sydney University, NSW, Australia (PH).,Institute for Health Metrics and Evaluation (IHME), University of Washington, Seattle, WA (HAW).,Epigear International Pty Ltd, Sunrise Beach, Queensland Australia (JJB)
| | - Harvey A Whiteford
- School of Public Health, University of Queensland, Herston, Queensland, Australia (YYL, HAW, JJB).,Queensland Centre for Mental Health Research (QCMHR), The Park Centre for Mental Health, Wacol, Queensland, Australia (YYL, HAW).,Geelong, Deakin Health Economics, School of Health and Social Development, Deakin University, Melbourne, Victoria, Australia (LK-DL, CM).,National Drug and Alcohol Research Centre (NDARC), University of New South Wales, Randwick, New South Wales, Australia (EAS).,School of Medicine and Translational Health Research Institute, Western Sydney University, NSW, Australia (PH).,Institute for Health Metrics and Evaluation (IHME), University of Washington, Seattle, WA (HAW).,Epigear International Pty Ltd, Sunrise Beach, Queensland Australia (JJB)
| | - Jan J Barendregt
- School of Public Health, University of Queensland, Herston, Queensland, Australia (YYL, HAW, JJB).,Queensland Centre for Mental Health Research (QCMHR), The Park Centre for Mental Health, Wacol, Queensland, Australia (YYL, HAW).,Geelong, Deakin Health Economics, School of Health and Social Development, Deakin University, Melbourne, Victoria, Australia (LK-DL, CM).,National Drug and Alcohol Research Centre (NDARC), University of New South Wales, Randwick, New South Wales, Australia (EAS).,School of Medicine and Translational Health Research Institute, Western Sydney University, NSW, Australia (PH).,Institute for Health Metrics and Evaluation (IHME), University of Washington, Seattle, WA (HAW).,Epigear International Pty Ltd, Sunrise Beach, Queensland Australia (JJB)
| | - Cathrine Mihalopoulos
- School of Public Health, University of Queensland, Herston, Queensland, Australia (YYL, HAW, JJB).,Queensland Centre for Mental Health Research (QCMHR), The Park Centre for Mental Health, Wacol, Queensland, Australia (YYL, HAW).,Geelong, Deakin Health Economics, School of Health and Social Development, Deakin University, Melbourne, Victoria, Australia (LK-DL, CM).,National Drug and Alcohol Research Centre (NDARC), University of New South Wales, Randwick, New South Wales, Australia (EAS).,School of Medicine and Translational Health Research Institute, Western Sydney University, NSW, Australia (PH).,Institute for Health Metrics and Evaluation (IHME), University of Washington, Seattle, WA (HAW).,Epigear International Pty Ltd, Sunrise Beach, Queensland Australia (JJB)
| |
Collapse
|
4
|
Roseman M, Kloda LA, Saadat N, Riehm KE, Ickowicz A, Baltzer F, Katz LY, Patten SB, Rousseau C, Thombs BD. Accuracy of Depression Screening Tools to Detect Major Depression in Children and Adolescents: A Systematic Review. CANADIAN JOURNAL OF PSYCHIATRY. REVUE CANADIENNE DE PSYCHIATRIE 2016; 61:746-757. [PMID: 27310247 PMCID: PMC5564894 DOI: 10.1177/0706743716651833] [Citation(s) in RCA: 25] [Impact Index Per Article: 3.1] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 01/01/2023]
Abstract
OBJECTIVE Depression screening among children and adolescents is controversial, and no clinical trials have evaluated benefits and harms of screening programs. A requirement for effective screening is a screening tool with demonstrated high accuracy. The objective of this systematic review was to evaluate the accuracy of depression screening instruments to detect major depressive disorder (MDD) in children and adolescents. METHOD Data sources included the MEDLINE, MEDLINE In-Process, EMBASE, PsycINFO, HaPI, and LILACS databases from 2006 to September 30, 2015. Eligible studies compared a depression screening tool to a validated diagnostic interview for MDD and reported accuracy data for children and adolescents aged 6 to 18 years. Risk of bias was assessed with QUADAS-2. RESULTS We identified 17 studies with data on 20 depression screening tools. Few studies examined the accuracy of the same screening tools. Cut-off scores identified as optimal were inconsistent across studies. Width of 95% confidence intervals (CIs) for sensitivity ranged from 9% to 55% (median 32%), and only 1 study had a lower bound 95% CI ≥80%. For specificity, 95% CI width ranged from 2% to 27% (median 9%), and 3 studies had a lower bound ≥90%. Methodological limitations included small sample sizes, exploratory data analyses to identify optimal cut-offs, and the failure to exclude children and adolescents already diagnosed or treated for depression. CONCLUSIONS There is insufficient evidence that any depression screening tool and cut-off accurately screens for MDD in children and adolescents. Screening could lead to overdiagnosis and the consumption of scarce health care resources.
Collapse
Affiliation(s)
- Michelle Roseman
- Lady Davis Institute for Medical Research, Jewish General Hospital, Montreal, Quebec
| | | | - Nazanin Saadat
- Lady Davis Institute for Medical Research, Jewish General Hospital, Montreal, Quebec
| | - Kira E. Riehm
- Lady Davis Institute for Medical Research, Jewish General Hospital, Montreal, Quebec
| | - Abel Ickowicz
- Department of Psychiatry, Hospital for Sick Children, University of Toronto, Toronto, Ontario
| | - Franziska Baltzer
- Montreal Children’s Hospital, Montreal, Quebec
- McGill University, Montreal, Quebec
| | | | | | | | - Brett D. Thombs
- Lady Davis Institute for Medical Research, Jewish General Hospital, Montreal, Quebec
- McGill University, Montreal, Quebec
| |
Collapse
|