1
|
Tomko RL, Wolf BJ, McClure EA, Carpenter MJ, Magruder KM, Squeglia LM, Gray KM. Who responds to a multi-component treatment for cannabis use disorder? Using multivariable and machine learning models to classify treatment responders and non-responders. Addiction 2023; 118:1965-1974. [PMID: 37132085 PMCID: PMC10524796 DOI: 10.1111/add.16226] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 10/28/2022] [Accepted: 04/13/2023] [Indexed: 05/04/2023]
Abstract
BACKGROUND AND AIMS Treatments for cannabis use disorder (CUD) have limited efficacy and little is known about who responds to existing treatments. Accurately predicting who will respond to treatment can improve clinical decision-making by allowing clinicians to offer the most appropriate level and type of care. This study aimed to determine whether multivariable/machine learning models can be used to classify CUD treatment responders versus non-responders. METHODS This secondary analysis used data from a National Drug Abuse Treatment Clinical Trials Network multi-site outpatient clinical trial in the United States. Adults with CUD (n = 302) received 12 weeks of contingency management, brief cessation counseling and were randomized to receive additionally either (1) N-Acetylcysteine or (2) placebo. Multivariable/machine learning models were used to classify treatment responders (i.e. two consecutive negative urine cannabinoid tests or a 50% reduction in days of use) versus non-responders using baseline demographic, medical, psychiatric and substance use information. RESULTS Prediction performance for various machine learning and regression prediction models yielded area under the curves (AUCs) >0.70 for four models (0.72-0.77), with support vector machine models having the highest overall accuracy (73%; 95% CI = 68-78%) and AUC (0.77; 95% CI = 0.72, 0.83). Fourteen variables were retained in at least three of four top models, including demographic (ethnicity, education), medical (diastolic/systolic blood pressure, overall health, neurological diagnosis), psychiatric (depressive symptoms, generalized anxiety disorder, antisocial personality disorder) and substance use (tobacco smoker, baseline cannabinoid level, amphetamine use, age of experimentation with other substances, cannabis withdrawal intensity) characteristics. CONCLUSIONS Multivariable/machine learning models can improve on chance prediction of treatment response to outpatient cannabis use disorder treatment, although further improvements in prediction performance are likely necessary for decisions about clinical care.
Collapse
Affiliation(s)
- Rachel L. Tomko
- Department of Psychiatry and Behavioral Sciences, Medical University of South Carolina, Charleston, SC, USA
| | - Bethany J. Wolf
- Department of Public Health Sciences, Medical University of South Carolina, Charleston, SC, USA
| | - Erin A. McClure
- Department of Psychiatry and Behavioral Sciences, Medical University of South Carolina, Charleston, SC, USA
| | - Matthew J. Carpenter
- Department of Psychiatry and Behavioral Sciences, Medical University of South Carolina, Charleston, SC, USA
- Department of Public Health Sciences, Medical University of South Carolina, Charleston, SC, USA
- Hollings Cancer Center, Medical University of South Carolina, Charleston, SC, USA
| | - Kathryn M. Magruder
- Department of Psychiatry and Behavioral Sciences, Medical University of South Carolina, Charleston, SC, USA
| | - Lindsay M. Squeglia
- Department of Psychiatry and Behavioral Sciences, Medical University of South Carolina, Charleston, SC, USA
| | - Kevin M. Gray
- Department of Psychiatry and Behavioral Sciences, Medical University of South Carolina, Charleston, SC, USA
| |
Collapse
|
2
|
Feng Y, Chen C, Liu S, Dong B, Yu Y, Chen C, Lv X. A novel technology of structural distance feature of Raman spectra and convolutional neural network for alcohol dependence diagnosis. Microchem J 2023. [DOI: 10.1016/j.microc.2023.108485] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/05/2023]
|
3
|
Negriff S, Dilkina B, Matai L, Rice E. Using machine learning to determine the shared and unique risk factors for marijuana use among child-welfare versus community adolescents. PLoS One 2022; 17:e0274998. [PMID: 36129944 PMCID: PMC9491564 DOI: 10.1371/journal.pone.0274998] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/11/2021] [Accepted: 09/08/2022] [Indexed: 11/22/2022] Open
Abstract
OBJECTIVE This study used machine learning (ML) to test an empirically derived set of risk factors for marijuana use. Models were built separately for child welfare (CW) and non-CW adolescents in order to compare the variables selected as important features/risk factors. METHOD Data were from a Time 4 (Mage = 18.22) of longitudinal study of the effects of maltreatment on adolescent development (n = 350; CW = 222; non-CW = 128; 56%male). Marijuana use in the past 12 months (none versus any) was obtained from a single item self-report. Risk factors entered into the model included mental health, parent/family social support, peer risk behavior, self-reported risk behavior, self-esteem, and self-reported adversities (e.g., abuse, neglect, witnessing family violence or community violence). RESULTS The ML approaches indicated 80% accuracy in predicting marijuana use in the CW group and 85% accuracy in the non-CW group. In addition, the top features differed for the CW and non-CW groups with peer marijuana use emerging as the most important risk factor for CW youth, whereas externalizing behavior was the most important for the non-CW group. The most important common risk factor between group was gender, with males having higher risk. CONCLUSIONS This is the first study to examine the shared and unique risk factors for marijuana use for CW and non-CW youth using a machine learning approach. The results support our assertion that there may be similar risk factors for both groups, but there are also risks unique to each population. Therefore, risk factors derived from normative populations may not have the same importance when used for CW youth. These differences should be considered in clinical practice when assessing risk for substance use among adolescents.
Collapse
Affiliation(s)
- Sonya Negriff
- Department of Research and Evaluation, Kaiser Permanente Southern California, Pasadena, California, United States of America
| | - Bistra Dilkina
- Department of Computer Science, University of Southern California, Los Angeles, California, United States of America
| | - Laksh Matai
- Department of Computer Science, University of Southern California, Los Angeles, California, United States of America
| | - Eric Rice
- Suzanne Dworak-Peck School of Social Work, University of Southern California, Los Angeles, California, United States of America
| |
Collapse
|
4
|
Can we predict who will benefit from cognitive-behavioural therapy? A systematic review and meta-analysis of machine learning studies. Clin Psychol Rev 2022; 97:102193. [DOI: 10.1016/j.cpr.2022.102193] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/14/2022] [Revised: 06/29/2022] [Accepted: 08/04/2022] [Indexed: 11/23/2022]
|
5
|
Roberts W, Zhao Y, Verplaetse T, Moore KE, Peltier MR, Burke C, Zakiniaeiz Y, McKee S. Using machine learning to predict heavy drinking during outpatient alcohol treatment. Alcohol Clin Exp Res 2022; 46:657-666. [PMID: 35420710 PMCID: PMC9180421 DOI: 10.1111/acer.14802] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/10/2021] [Revised: 02/15/2022] [Accepted: 02/22/2022] [Indexed: 12/23/2022]
Abstract
BACKGROUND Accurate clinical prediction supports the effective treatment of alcohol use disorder (AUD) and other psychiatric disorders. Traditional statistical techniques have identified patient characteristics associated with treatment outcomes. However, less work has focused on systematically leveraging these associations to create optimal predictive models. The current study demonstrates how machine learning can be used to predict clinical outcomes in people completing outpatient AUD treatment. METHOD We used data from the COMBINE multisite clinical trial (n = 1383) to develop and test predictive models. We identified three priority prediction targets, including (1) heavy drinking during the first month of treatment, (2) heavy drinking during the last month of treatment, and (3) heavy drinking between weekly/bi-weekly sessions. Models were generated using the random forest algorithm. We used "leave sites out" partitioning to externally validate the models in trial sites that were not included in the model training. Stratified model development was used to test for sex differences in the relative importance of predictive features. RESULTS Models predicting heavy alcohol use during the first and last months of treatment showed internal cross-validation area under the curve (AUC) scores ranging from 0.67 to 0.74. AUC was comparable in the external validation using data from held-out sites (AUC range = 0.69 to 0.72). The model predicting between-session heavy drinking showed strong classification accuracy in internal cross-validation (AUC = 0.89) and external test samples (AUC range = 0.80 to 0.87). Stratified analyses showed substantial sex differences in optimal feature sets. CONCLUSION Machine learning techniques can predict alcohol treatment outcomes using routinely collected clinical data. This technique has the potential to greatly improve clinical prediction accuracy without requiring expensive or invasive assessment methods. More research is needed to understand how best to deploy these models.
Collapse
Affiliation(s)
- Walter Roberts
- Department of Psychiatry, Yale University School of Medicine, New Haven, Connecticut, USA.,Department of Psychology, East Tennessee State University, Johnson City, Tennessee, USA
| | - Yize Zhao
- Department of Biostatistics, Yale University School of Public Health, New Haven, Connecticut, USA
| | - Terril Verplaetse
- Department of Psychiatry, Yale University School of Medicine, New Haven, Connecticut, USA
| | - Kelly E Moore
- Department of Psychology, East Tennessee State University, Johnson City, Tennessee, USA
| | - MacKenzie R Peltier
- Department of Psychiatry, Yale University School of Medicine, New Haven, Connecticut, USA.,Veterans Affairs Connecticut Healthcare System, West Haven, Connecticut, USA
| | - Catherine Burke
- Department of Psychiatry, Yale University School of Medicine, New Haven, Connecticut, USA
| | - Yasmin Zakiniaeiz
- Department of Psychiatry, Yale University School of Medicine, New Haven, Connecticut, USA
| | - Sherry McKee
- Department of Psychiatry, Yale University School of Medicine, New Haven, Connecticut, USA
| |
Collapse
|
6
|
Ferrarese A, Sartori G, Orrù G, Frigo AC, Pelizzaro F, Burra P, Senzolo M. Machine learning in liver transplantation: a tool for some unsolved questions? Transpl Int 2021; 34:398-411. [PMID: 33428298 DOI: 10.1111/tri.13818] [Citation(s) in RCA: 17] [Impact Index Per Article: 5.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/07/2020] [Revised: 08/24/2020] [Accepted: 01/08/2021] [Indexed: 12/13/2022]
Abstract
Machine learning has recently been proposed as a useful tool in many fields of Medicine, with the aim of increasing diagnostic and prognostic accuracy. Models based on machine learning have been introduced in the setting of solid organ transplantation too, where prognosis depends on a complex, multidimensional and nonlinear relationship between variables pertaining to the donor, the recipient and the surgical procedure. In the setting of liver transplantation, machine learning models have been developed to predict pretransplant survival in patients with cirrhosis, to assess the best donor-to-recipient match during allocation processes, and to foresee postoperative complications and outcomes. This is a narrative review on the role of machine learning in the field of liver transplantation, highlighting strengths and pitfalls, and future perspectives.
Collapse
Affiliation(s)
- Alberto Ferrarese
- Multivisceral Transplant Unit, Department of Surgery, Oncology and Gastroenterology, Padua University Hospital, Padua, Italy
| | - Giuseppe Sartori
- Forensic Neuropsychology and Forensic Neuroscience, PhD Program in Mind Brain and Computer Science, Department of General Psychology, Padua University, Padua, Italy
| | - Graziella Orrù
- Department of Surgical, Medical, Molecular and Critical Area Pathology, University of Pisa, Pisa, Italy
| | - Anna Chiara Frigo
- Department of Cardiac-Thoracic-Vascular Sciences and Public Health, Biostatistics, Epidemiology and Public Health Unit, University of Padua, Padova, Veneto, Italy
| | - Filippo Pelizzaro
- Multivisceral Transplant Unit, Department of Surgery, Oncology and Gastroenterology, Padua University Hospital, Padua, Italy
| | - Patrizia Burra
- Multivisceral Transplant Unit, Department of Surgery, Oncology and Gastroenterology, Padua University Hospital, Padua, Italy
| | - Marco Senzolo
- Multivisceral Transplant Unit, Department of Surgery, Oncology and Gastroenterology, Padua University Hospital, Padua, Italy
| |
Collapse
|
7
|
Symons M, Feeney GFX, Gallagher MR, Young RM, Connor JP. Predicting alcohol dependence treatment outcomes: a prospective comparative study of clinical psychologists versus 'trained' machine learning models. Addiction 2020; 115:2164-2175. [PMID: 32150316 DOI: 10.1111/add.15038] [Citation(s) in RCA: 11] [Impact Index Per Article: 2.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 07/18/2019] [Revised: 10/13/2019] [Accepted: 03/04/2020] [Indexed: 12/11/2022]
Abstract
BACKGROUND AND AIMS Clinical staff are typically poor at predicting alcohol dependence treatment outcomes. Machine learning (ML) offers the potential to model complex clinical data more effectively. This study tested the predictive accuracy of ML algorithms demonstrated to be effective in predicting alcohol dependence outcomes, compared with clinical judgement and traditional linear regression. DESIGN Prospective study. ML models were trained on 1016 previously treated patients (training-set) who attended a hospital-based alcohol and drug clinic. ML models (n = 27), clinical psychologists (n = 10) and a 'traditional' logistic regression model (n = 1) predicted treatment outcome during the initial treatment session of an alcohol dependence programme. SETTING A 12-week cognitive behavioural therapy (CBT)-based abstinence programme for alcohol dependence in a hospital-based alcohol and drug clinic in Australia. PARTICIPANTS Prospective predictions were made for 220 new patients (test-set; 70.91% male, mean age = 35.78 years, standard deviation = 9.19). Sixty-nine (31.36%) patients successfully completed treatment. MEASUREMENTS Treatment success was the primary outcome variable. The cross-validated training-set accuracy of ML models was used to determine optimal parameters for selecting models for prospective prediction. Accuracy, sensitivity, specificity, area under the receiver operator curve (AUC), Brier score and calibration curves were calculated and compared across predictions. FINDINGS The mean aggregate accuracy of the ML models (63.06%) was higher than the mean accuracy of psychologist predictions (56.36%). The most accurate ML model achieved 70% accuracy, as did logistic regression. Both were more accurate than psychologists (P < 0.05) and had superior calibration. The high specificity for the selected ML (79%) and logistic regression (90%) meant they were significantly (P < 0.001) more effective than psychologists (50%) at correctly identifying patients whose treatment was unsuccessful. For ML and logistic regression, high specificity came at the expense of sensitivity (26 and 31%, respectively), resulting in poor prediction of successful patients. CONCLUSIONS Machine learning models and logistic regression appear to be more accurate than psychologists at predicting treatment outcomes in an abstinence programme for alcohol dependence, but sensitivity is low.
Collapse
Affiliation(s)
- Martyn Symons
- Alcohol and Drug Assessment Unit, Princess Alexandra Hospital, Brisbane, Australia.,Discipline of Psychiatry, The University of Queensland, Brisbane, Australia.,National Health and Medical Research Council FASD Research Australia Centre of Research Excellence, Telethon Kids Institute, The University of Western Australia, Perth, Australia
| | - Gerald F X Feeney
- Alcohol and Drug Assessment Unit, Princess Alexandra Hospital, Brisbane, Australia.,Centre for Youth Substance Abuse Research, The University of Queensland, Brisbane, Australia
| | - Marcus R Gallagher
- School of Information Technology and Electrical Engineering, The University of Queensland, Brisbane, Australia
| | - Ross McD Young
- Alcohol and Drug Assessment Unit, Princess Alexandra Hospital, Brisbane, Australia.,Faculty of Health, Queensland University of Technology, Brisbane, Australia
| | - Jason P Connor
- Alcohol and Drug Assessment Unit, Princess Alexandra Hospital, Brisbane, Australia.,Discipline of Psychiatry, The University of Queensland, Brisbane, Australia.,Centre for Youth Substance Abuse Research, The University of Queensland, Brisbane, Australia
| |
Collapse
|
8
|
Hsu M, Ahern DK, Suzuki J. Digital Phenotyping to Enhance Substance Use Treatment During the COVID-19 Pandemic. JMIR Ment Health 2020; 7:e21814. [PMID: 33031044 PMCID: PMC7592462 DOI: 10.2196/21814] [Citation(s) in RCA: 19] [Impact Index Per Article: 4.8] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 06/28/2020] [Revised: 08/14/2020] [Accepted: 09/25/2020] [Indexed: 01/19/2023] Open
Abstract
Due to the COVID-19 pandemic, many clinical addiction treatment programs have been required to transition to telephonic or virtual visits. Novel solutions are needed to enhance substance use treatment during a time when many patients are disconnected from clinical care and social support. Digital phenotyping, which leverages the unique functionality of smartphone sensors (GPS, social behavior, and typing patterns), can buttress clinical treatment in a remote, scalable fashion. Specifically, digital phenotyping has the potential to improve relapse prediction and intervention, relapse detection, and overdose intervention. Digital phenotyping may enhance relapse prediction through coupling machine learning algorithms with the enormous amount of collected behavioral data. Activity-based analysis in real time can potentially be used to prevent relapse by warning substance users when they approach locational triggers such as bars or liquor stores. Wearable devices detect when a person has relapsed to substances through measuring physiological changes such as electrodermal activity and locomotion. Despite the initial promise of this approach, privacy, security, and barriers to access are important issues to address.
Collapse
Affiliation(s)
- Michael Hsu
- Department of Psychiatry, Brigham and Women's Hospital, Boston, MA, United States
| | - David K Ahern
- Digital Behavioral Health and Informatics Research Program, Brigham and Women's Hospital, Boston, MA, United States
| | - Joji Suzuki
- Division of Addiction Psychiatry, Brigham and Women's Hospital, Boston, MA, United States
| |
Collapse
|
9
|
Jemberie WB, Stewart Williams J, Eriksson M, Grönlund AS, Ng N, Blom Nilsson M, Padyab M, Priest KC, Sandlund M, Snellman F, McCarty D, Lundgren LM. Substance Use Disorders and COVID-19: Multi-Faceted Problems Which Require Multi-Pronged Solutions. Front Psychiatry 2020; 11:714. [PMID: 32848907 PMCID: PMC7396653 DOI: 10.3389/fpsyt.2020.00714] [Citation(s) in RCA: 68] [Impact Index Per Article: 17.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 05/19/2020] [Accepted: 07/07/2020] [Indexed: 12/21/2022] Open
Abstract
COVID-19 shocked health and economic systems leaving millions of people without employment and safety nets. The pandemic disproportionately affects people with substance use disorders (SUDs) due to the collision between SUDs and COVID-19. Comorbidities and risk environments for SUDs are likely risk factors for COVID-19. The pandemic, in turn, diminishes resources that people with SUD need for their recovery and well-being. This article presents an interdisciplinary and international perspective on how COVID-19 and the related systemic shock impact on individuals with SUDs directly and indirectly. We highlight a need to understand SUDs as biopsychosocial disorders and use evidence-based policies to destigmatize SUDs. We recommend a suite of multi-sectorial actions and strategies to strengthen, modernize and complement addiction care systems which will become resilient and responsive to future systemic shocks similar to the COVID-19 pandemic.
Collapse
Affiliation(s)
- Wossenseged Birhane Jemberie
- Department of Social Work, Umeå University, Umeå, Sweden
- Centre for Demography and Ageing Research (CEDAR), Umeå University, Umeå, Sweden
- The Swedish National Graduate School for Competitive Science on Ageing and Health (SWEAH), Department of Health Sciences, Faculty of Medicine, Lund University, Lund, Sweden
| | - Jennifer Stewart Williams
- Department of Epidemiology and Global Health, Faculty of Medicine, Umeå University, Umeå, Sweden
- Research Centre for Generational Health and Ageing, Faculty of Health, University of Newcastle, Callaghan, NSW, Australia
| | - Malin Eriksson
- Department of Social Work, Umeå University, Umeå, Sweden
| | | | - Nawi Ng
- Department of Epidemiology and Global Health, Faculty of Medicine, Umeå University, Umeå, Sweden
- School of Public Health and Community Medicine, Institute of Medicine, Sahlgrenska Academy, University of Gothenburg, Gothenburg, Sweden
| | | | - Mojgan Padyab
- Department of Social Work, Umeå University, Umeå, Sweden
- Centre for Demography and Ageing Research (CEDAR), Umeå University, Umeå, Sweden
| | - Kelsey Caroline Priest
- MD/PhD Program, School of Medicine, Oregon Health & Science University, Portland, OR, United States
| | - Mikael Sandlund
- Psychiatry Unit, Department of Clinical Science, Umeå University, Umeå, Sweden
| | | | - Dennis McCarty
- Oregon Health & Science University- Portland State University, School of Public Health, Portland, OR, United States
| | - Lena M. Lundgren
- Department of Social Work, Umeå University, Umeå, Sweden
- Cross-National Behavioral Health Laboratory, Graduate School of Social Work, University of Denver, Denver, CO, United States
| |
Collapse
|
10
|
Coughlin LN, Tegge AN, Sheffer CE, Bickel WK. A Machine-Learning Approach to Predicting Smoking Cessation Treatment Outcomes. Nicotine Tob Res 2020; 22:415-422. [PMID: 30508122 PMCID: PMC7297111 DOI: 10.1093/ntr/nty259] [Citation(s) in RCA: 43] [Impact Index Per Article: 10.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/18/2018] [Accepted: 11/29/2018] [Indexed: 11/14/2022]
Abstract
AIMS Most cigarette smokers want to quit smoking and more than half make an attempt every year, but less than 10% remain abstinent for at least 6 months. Evidence-based tobacco use treatment improves the likelihood of quitting, but more than two-thirds of individuals relapse when provided even the most robust treatments. Identifying for whom treatment is effective will improve the success of our treatments and perhaps identify strategies for improving current approaches. METHODS Two cohorts (training: N = 90, validation: N = 71) of cigarette smokers enrolled in group cognitive-behavioral therapy (CBT). Generalized estimating equations were used to identify baseline predictors of outcome, as defined by breath carbon monoxide and urine cotinine. Significant measures were entered as candidate variables to predict quit status. The resulting decision trees were used to predict cessation outcomes in a validation cohort. RESULTS In the training cohort, the decision trees significantly improved on chance classification of smoking status following treatment and at 6-month follow-up. The first split of all decision trees, which was delay discounting, significantly improved on chance classification rates in both the training and validation cohort. Delay discounting emerged as the single best predictor of group CBT treatment response with an average baseline discount rate of ln(k) = -7.1, correctly predicting smoking status of 80% of participants at posttreatment and 81% of participants at follow-up. CONCLUSIONS This study provides a first step toward personalized care for smoking cessation though future work is needed to identify individuals that are likely to be successful in treatments beyond group CBT. IMPLICATIONS This study provides a first step toward personalized care for smoking cessation. Using a novel machine-learning approach, baseline measures of clinical and executive functioning are used to predict smoking cessation outcomes following group CBT. A decision point is recommended for the single best predictor of treatment outcomes, delay discounting, to inform future research or clinical practice in an effort to better allocate patients to treatments that are likely to work.
Collapse
Affiliation(s)
- Lara N Coughlin
- Addiction Recovery Research Center, Virginia Tech Carilion Research Institute, Roanoke, VA
- Department of Psychology, Virginia Tech, Blacksburg, VA
| | - Allison N Tegge
- Addiction Recovery Research Center, Virginia Tech Carilion Research Institute, Roanoke, VA
- Department of Statistics, Virginia Tech, Blacksburg, VA
| | - Christine E Sheffer
- Department of Health Behavior, Roswell Park Comprehensive Cancer Center, Buffalo, NY
| | - Warren K Bickel
- Addiction Recovery Research Center, Virginia Tech Carilion Research Institute, Roanoke, VA
- Department of Psychology, Virginia Tech, Blacksburg, VA
| |
Collapse
|
11
|
Personalized prediction of smartphone-based psychotherapeutic micro-intervention success using machine learning. J Affect Disord 2020; 264:430-437. [PMID: 31787419 DOI: 10.1016/j.jad.2019.11.071] [Citation(s) in RCA: 12] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 06/14/2019] [Revised: 09/18/2019] [Accepted: 11/12/2019] [Indexed: 12/29/2022]
Abstract
BACKGROUND Tailoring healthcare to patients' individual needs is a central goal of precision medicine. Combining smartphone-based interventions with machine learning approaches may help attaining this goal. The aim of our study was to explore the predictability of the success of smartphone-based psychotherapeutic micro-interventions in eliciting mood changes using machine learning. METHODS Participants conducted daily smartphone-based psychotherapeutic micro-interventions, guided by short video clips, for 13 consecutive days. Participants chose one of four intervention techniques used in psychotherapeutic approaches. Mood changes were assessed using the Multidimensional Mood State Questionnaire. Micro-intervention success was predicted using random forest (RF) tree-based mixed-effects logistic regression models. Data from 27 participants were used, totaling 324 micro-interventions, randomly split 100 times into training and test samples, using within-subject and between-subject sampling. RESULTS Mood improved from pre- to post-intervention in 137 sessions (initial success-rate: 42.3%). The RF approach resulted in predictions of micro-intervention success significantly better than the initial success-rate within and between subjects (positive predictive value: 0.732 (95%-CI: 0.607; 0.820) and 0.698 (95%-CI: 0.564; 0.805), respectively). Prediction quality was highest using the RF approach within subjects (rand accuracy: 0.75 (95%-CI: 0.641; 0.840), Matthew's correlation coefficient: 0.483 (95%-CI: 0.323; 0.723)). LIMITATIONS The RF approach does not allow firm conclusions about the exact contribution of each factor to the algorithm's predictions. We included a limited number of predictors and did not compare whether predictability differed between psychotherapeutic techniques. CONCLUSIONS Our findings may pave the way for translation and encourage scrutinizing personalized prediction in the psychotherapeutic context to improve treatment efficacy.
Collapse
|
12
|
Lee MR, Sankar V, Hammer A, Kennedy WG, Barb JJ, McQueen PG, Leggio L. Using Machine Learning to Classify Individuals With Alcohol Use Disorder Based on Treatment Seeking Status. EClinicalMedicine 2019; 12:70-78. [PMID: 31388665 PMCID: PMC6677650 DOI: 10.1016/j.eclinm.2019.05.008] [Citation(s) in RCA: 15] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 03/28/2019] [Revised: 05/14/2019] [Accepted: 05/20/2019] [Indexed: 01/01/2023] Open
Abstract
OBJECTIVE The authors used a decision tree classifier to reduce neuropsychological, behavioral and laboratory measures to a subset of measures that best predicted whether an individual with alcohol use disorder (AUD) seeks treatment. METHOD Clinical measures (N = 178) from 778 individuals with AUD were used to construct an alternating decision tree (ADT) with 10 measures that best classified individuals as treatment or not treatment-seeking for AUD. ADT's were validated by two methods: using cross-validation and an independent dataset (N = 236). For comparison, two other machine learning techniques were used as well as two linear models. RESULTS The 10 measures in the ADT classifier were drinking behavior, depression and drinking-related psychological problems, as well as substance dependence. With cross-validation, the ADT classified 86% of individuals correctly. The ADT classified 78% of the independent dataset correctly. Only the simple logistic model was similar in accuracy; however, this model needed more than twice as many measures as ADT to classify at comparable accuracy. INTERPRETATION While there has been emphasis on understanding differences between those with AUD and controls, it is also important to understand, within those with AUD, the features associated with clinically important outcomes. Since the majority of individuals with AUD do not receive treatment, it is important to understand the clinical features associated with treatment utilization; the ADT reported here correctly classified the majority of individuals with AUD with 10 clinically relevant measures, misclassifying < 7% of treatment seekers, while misclassifying 38% of non-treatment seekers. These individual clinically relevant measures can serve, potentially, as separate targets for treatment. FUNDING Funding for this work was provided by the Intramural Research Programs of the National Institute on Alcohol Abuse and Alcoholism (NIAAA), National Institute on Drug Abuse (NIDA) and the Center for Information Technology (CIT). RESEARCH IN CONTEXT Evidence Before This Study: Less than 10% of persons who meet lifetime criteria for Alcohol Use Disorder (AUD) receive treatment. As the etiology of AUD represents a complex interaction between neurobiological, social, environmental and psychological factors, low treatment utilization likely stems from barriers on multiple levels. Given this issue, it is important from both a research and clinical standpoint to determine what characteristics are associated with treatment utilization in addition to merely asking individuals if they wish to enter treatment. At the level of clinical research, if there are phenotypic differences between treatment and nontreatment-seekers that directly influence outcomes of early-phase studies, these phenotypic differences are a potential confound in assessing the utility of an experimental treatment for AUD. At the level of clinical practice, distinguishing between treatment- and nontreatment-seekers may help facilitate a targeted treatment approach. Previous efforts to understand the differences between these populations of individuals with AUD leveraged the multidimensional data collected in clinical research settings for AUD that are not well suited to traditional regression methods.Added Value of This Study: Alternating decision trees are well suited to deep-phenotyping data collected in clinical research settings as this approach handles nonparametric, skewed, and missing data whose relationships are nonlinear. This approach has proved to be superior in some cases to conventional clinical methods to solve diagnostic problems in medicine. We used a decision tree classifier to understand treatment- and non-treatment seeking group differences. The decision tree classifier approach chose a subset of factors arranged in an alternating decision tree that best predicts a given outcome. Assuming that the input measures are clinically relevant, the alternating decision tree that is generated has clinical value. Unlike other machine learning approaches, in addition to its predictive value, the nodes in the tree and their arrangement in a hierarchy have clinical utility. With the "if-then" logic of the tree, the clinician can learn what features become important and which recede in importance as the logic of the tree is followed. The decision tree classifier approach reduced 178 characterization measures (both categorical and continuous) in multiple domains to a decision tree comprised of 10 measures that together best classified subjects by treatment seeking status (yes/no).Implications After All the Available Evidence: We leveraged a large data set comprised of 178 clinical measures and using the decision tree approach, we have reduced these to a subset of 10 measures that accurately classified individuals with alcohol dependence by treatment utilization. From this analysis, drinking behavior variables and depression measures are strong treatment seeking predictors. Having identified a cluster of factors that predicts treatment seeking, we can assess the influence of these factors directly on the clinical study outcome measures themselves. In clinical practice these factors can be separate targets for treatment. In clinical research, the group differences my directly influence research outcomes for treatment of AUD.
Collapse
Affiliation(s)
- Mary R. Lee
- Section on Clinical Psychoneuroendocrinology and Neuropsychopharmacology, National Institute on Alcohol Abuse and Alcoholism, National Institute on Drug Abuse, National Institutes of Health, Bethesda, MD, USA
| | - Vignesh Sankar
- Section on Clinical Psychoneuroendocrinology and Neuropsychopharmacology, National Institute on Alcohol Abuse and Alcoholism, National Institute on Drug Abuse, National Institutes of Health, Bethesda, MD, USA
| | - Aaron Hammer
- Section on Clinical Psychoneuroendocrinology and Neuropsychopharmacology, National Institute on Alcohol Abuse and Alcoholism, National Institute on Drug Abuse, National Institutes of Health, Bethesda, MD, USA
| | - William G. Kennedy
- Krasnow Institute for Advanced Study, George Mason University, Fairfax, VA, USA
| | - Jennifer J. Barb
- Center for Information Technology, National Institutes of Health, Bethesda, MD, USA
| | - Philip G. McQueen
- Center for Information Technology, National Institutes of Health, Bethesda, MD, USA
| | - Lorenzo Leggio
- Section on Clinical Psychoneuroendocrinology and Neuropsychopharmacology, National Institute on Alcohol Abuse and Alcoholism, National Institute on Drug Abuse, National Institutes of Health, Bethesda, MD, USA
- Center for Alcohol and Addiction Studies, Department of Behavioral and Social Sciences, Brown University, Providence, RI, USA
| |
Collapse
|
13
|
Symons M, Feeney GFX, Gallagher MR, Young RM, Connor JP. Machine learning vs addiction therapists: A pilot study predicting alcohol dependence treatment outcome from patient data in behavior therapy with adjunctive medication. J Subst Abuse Treat 2019; 99:156-162. [PMID: 30797388 DOI: 10.1016/j.jsat.2019.01.020] [Citation(s) in RCA: 11] [Impact Index Per Article: 2.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/20/2018] [Revised: 01/17/2019] [Accepted: 01/25/2019] [Indexed: 10/27/2022]
Abstract
BACKGROUND AND OBJECTIVES Clinical staff providing addiction treatment predict patient outcome poorly. Prognoses based on linear statistics are rarely replicated. Addiction is a complex non-linear behavior. Incorporating non-linear models, Machine Learning (ML) has successfully predicted treatment outcome when applied in other areas of medicine. Using identical assessment data across the two groups, this study compares the accuracy of ML models versus clinical staff to predict alcohol dependence treatment outcome in behavior therapy using patient data only. METHODS Machine learning models (n = 28) were constructed ('trained') using demographic and psychometric assessment data from 780 previously treated patients who had undertaken a 12 week, abstinence-based Cognitive Behavioral Therapy program for alcohol dependence. Independent predictions applying assessment data for an additional 50 consecutive patients were obtained from 10 experienced addiction therapists and the 28 trained ML models. The predictive accuracy of the ML models and the addiction therapists was then compared with further investigation of the 10 best models selected by cross-validated accuracy on the training-set. Variables selected as important for prediction by staff and the most accurate ML model were examined. RESULTS The most accurate ML model (Fuzzy Unordered Rule Induction Algorithm, 74%) was significantly more accurate than the four least accurate clinical staff (51%-40%). However, the robustness of this finding may be limited by the moderate area under the receiver operator curve (AUC = 0.49). There was no significant difference in mean aggregate predictive accuracy between 10 clinical staff (56.1%) and the 28 best models (58.57%). Addiction therapists favoured demographic and consumption variables compared with the ML model using more questionnaire subscales. CONCLUSIONS The majority of staff and ML models were not more accurate than suggested by chance. However, the best performing prediction models may provide useful adjunctive information to standard clinically available prognostic data to more effectively target treatment approaches in clinical settings.
Collapse
Affiliation(s)
- Martyn Symons
- Alcohol and Drug Assessment Unit, Princess Alexandra Hospital, Wooloongabba, Brisbane, Queensland 4102, Australia; Discipline of Psychiatry, The University of Queensland, K Floor, Mental Health Centre, Royal Brisbane and Women's Hospital, Herston, Brisbane, Queensland 4029, Australia; Telethon Kids Institute, West Perth, Western Australia 6872, Australia
| | - Gerald F X Feeney
- Alcohol and Drug Assessment Unit, Princess Alexandra Hospital, Wooloongabba, Brisbane, Queensland 4102, Australia; Centre for Youth Substance Abuse Research, The University of Queensland, Upland Road, St Lucia, Brisbane, Queensland 4072, Australia
| | - Marcus R Gallagher
- School of Information Technology and Electrical Engineering, The University of Queensland, Brisbane, Queensland 4072, Australia
| | - Ross McD Young
- Alcohol and Drug Assessment Unit, Princess Alexandra Hospital, Wooloongabba, Brisbane, Queensland 4102, Australia; Faculty of Health, Queensland University of Technology, Kelvin Grove, Brisbane, Queensland 4059, Australia
| | - Jason P Connor
- Alcohol and Drug Assessment Unit, Princess Alexandra Hospital, Wooloongabba, Brisbane, Queensland 4102, Australia; Discipline of Psychiatry, The University of Queensland, K Floor, Mental Health Centre, Royal Brisbane and Women's Hospital, Herston, Brisbane, Queensland 4029, Australia; Centre for Youth Substance Abuse Research, The University of Queensland, Upland Road, St Lucia, Brisbane, Queensland 4072, Australia.
| |
Collapse
|
14
|
Smart Healthcare Systems and Precision Medicine. Front Psychiatry 2019; 1192:263-279. [DOI: 10.1007/978-981-32-9721-0_13] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 10/25/2022] Open
|
15
|
Tian X, Zhang G, Shao Y, Yang Z. Towards enhanced metabolomic data analysis of mass spectrometry image: Multivariate Curve Resolution and Machine Learning. Anal Chim Acta 2018; 1037:211-219. [PMID: 30292295 DOI: 10.1016/j.aca.2018.02.031] [Citation(s) in RCA: 17] [Impact Index Per Article: 2.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/01/2017] [Revised: 02/08/2018] [Accepted: 02/10/2018] [Indexed: 12/12/2022]
Abstract
Large amounts of data are generally produced from mass spectrometry imaging (MSI) experiments in obtaining the molecular and spatial information of biological samples. Traditionally, MS images are constructed using manually selected ions, and it is very challenging to comprehensively analyze MSI results due to their large data sizes and highly complex data structures. To overcome these barriers, it is obligatory to develop advanced data analysis approaches to handle the increasingly large MSI data. In the current study, we focused on the method development of using Multivariate Curve Resolution (MCR) and Machine Learning (ML) approaches. We aimed to effectively extract the essential information present in the large and complex MSI data and enhance the metabolomic data analysis of biological tissues. Multivariate Curve Resolution-Alternating Least Squares (MCR-ALS) algorithm was used to obtain major patterns of spatial distribution and grouped metabolites with the same spatial distribution patterns. In addition, both supervised and unsupervised ML methods were established to analyze the MSI data. In the supervised ML approach, Random Forest method was selected, and the model was trained using the selected datasets based on the distribution pattern obtained from MCR-ALS analyses. In the unsupervised ML approach, both DBSCAN (Density-based Spatial Clustering of Applications with Noise) and CLARA (Clustering Large Applications) were applied to cluster the MSI datasets. It is worth noting that similar patterns of spatial distribution were discovered through MSI data analysis using MCR-ALS, supervised ML, and unsupervised ML. Our protocols of data analysis can be applied to process the data acquired using many other types of MSI techniques, and to extract the overall features present in MSI results that are intractable using traditional data analysis approaches.
Collapse
Affiliation(s)
- Xiang Tian
- Department of Chemistry and Biochemistry, University of Oklahoma, 101 Stephenson Parkway, Norman, OK, 73019, USA
| | - Genwei Zhang
- Department of Chemistry and Biochemistry, University of Oklahoma, 101 Stephenson Parkway, Norman, OK, 73019, USA
| | - Yihan Shao
- Department of Chemistry and Biochemistry, University of Oklahoma, 101 Stephenson Parkway, Norman, OK, 73019, USA.
| | - Zhibo Yang
- Department of Chemistry and Biochemistry, University of Oklahoma, 101 Stephenson Parkway, Norman, OK, 73019, USA.
| |
Collapse
|
16
|
Ferreri F, Bourla A, Mouchabac S, Karila L. e-Addictology: An Overview of New Technologies for Assessing and Intervening in Addictive Behaviors. Front Psychiatry 2018; 9:51. [PMID: 29545756 PMCID: PMC5837980 DOI: 10.3389/fpsyt.2018.00051] [Citation(s) in RCA: 60] [Impact Index Per Article: 10.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 01/08/2018] [Accepted: 02/06/2018] [Indexed: 02/01/2023] Open
Abstract
BACKGROUND New technologies can profoundly change the way we understand psychiatric pathologies and addictive disorders. New concepts are emerging with the development of more accurate means of collecting live data, computerized questionnaires, and the use of passive data. Digital phenotyping, a paradigmatic example, refers to the use of computerized measurement tools to capture the characteristics of different psychiatric disorders. Similarly, machine learning-a form of artificial intelligence-can improve the classification of patients based on patterns that clinicians have not always considered in the past. Remote or automated interventions (web-based or smartphone-based apps), as well as virtual reality and neurofeedback, are already available or under development. OBJECTIVE These recent changes have the potential to disrupt practices, as well as practitioners' beliefs, ethics and representations, and may even call into question their professional culture. However, the impact of new technologies on health professionals' practice in addictive disorder care has yet to be determined. In the present paper, we therefore present an overview of new technology in the field of addiction medicine. METHOD Using the keywords [e-health], [m-health], [computer], [mobile], [smartphone], [wearable], [digital], [machine learning], [ecological momentary assessment], [biofeedback] and [virtual reality], we searched the PubMed database for the most representative articles in the field of assessment and interventions in substance use disorders. RESULTS We screened 595 abstracts and analyzed 92 articles, dividing them into seven categories: e-health program and web-based interventions, machine learning, computerized adaptive testing, wearable devices and digital phenotyping, ecological momentary assessment, biofeedback, and virtual reality. CONCLUSION This overview shows that new technologies can improve assessment and interventions in the field of addictive disorders. The precise role of connected devices, artificial intelligence and remote monitoring remains to be defined. If they are to be used effectively, these tools must be explained and adapted to the different profiles of physicians and patients. The involvement of patients, caregivers and other health professionals is essential to their design and assessment.
Collapse
Affiliation(s)
- Florian Ferreri
- Sorbonne Université, UPMC, Department of Adult Psychiatry and Medical Psychology, APHP, Saint-Antoine Hospital, Paris, France
| | - Alexis Bourla
- Sorbonne Université, UPMC, Department of Adult Psychiatry and Medical Psychology, APHP, Saint-Antoine Hospital, Paris, France
| | - Stephane Mouchabac
- Sorbonne Université, UPMC, Department of Adult Psychiatry and Medical Psychology, APHP, Saint-Antoine Hospital, Paris, France
| | - Laurent Karila
- Université Paris Sud - INSERM U1000, Addiction Research and Treatment Center, APHP, Paul Brousse Hospital, Villejuif, France
| |
Collapse
|
17
|
Yahata N, Kasai K, Kawato M. Computational neuroscience approach to biomarkers and treatments for mental disorders. Psychiatry Clin Neurosci 2017; 71:215-237. [PMID: 28032396 DOI: 10.1111/pcn.12502] [Citation(s) in RCA: 60] [Impact Index Per Article: 8.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 08/31/2016] [Revised: 12/19/2016] [Accepted: 12/25/2016] [Indexed: 01/21/2023]
Abstract
Psychiatry research has long experienced a stagnation stemming from a lack of understanding of the neurobiological underpinnings of phenomenologically defined mental disorders. Recently, the application of computational neuroscience to psychiatry research has shown great promise in establishing a link between phenomenological and pathophysiological aspects of mental disorders, thereby recasting current nosology in more biologically meaningful dimensions. In this review, we highlight recent investigations into computational neuroscience that have undertaken either theory- or data-driven approaches to quantitatively delineate the mechanisms of mental disorders. The theory-driven approach, including reinforcement learning models, plays an integrative role in this process by enabling correspondence between behavior and disorder-specific alterations at multiple levels of brain organization, ranging from molecules to cells to circuits. Previous studies have explicated a plethora of defining symptoms of mental disorders, including anhedonia, inattention, and poor executive function. The data-driven approach, on the other hand, is an emerging field in computational neuroscience seeking to identify disorder-specific features among high-dimensional big data. Remarkably, various machine-learning techniques have been applied to neuroimaging data, and the extracted disorder-specific features have been used for automatic case-control classification. For many disorders, the reported accuracies have reached 90% or more. However, we note that rigorous tests on independent cohorts are critically required to translate this research into clinical applications. Finally, we discuss the utility of the disorder-specific features found by the data-driven approach to psychiatric therapies, including neurofeedback. Such developments will allow simultaneous diagnosis and treatment of mental disorders using neuroimaging, thereby establishing 'theranostics' for the first time in clinical psychiatry.
Collapse
Affiliation(s)
- Noriaki Yahata
- Department of Youth Mental Health, Graduate School of Medicine, The University of Tokyo, Tokyo, Japan.,Department of Molecular Imaging and Theranostics, National Institute of Radiological Sciences, National Institutes for Quantum and Radiological Science and Technology, Chiba, Japan.,ATR Brain Information Communication Research Laboratory Group, Kyoto, Japan
| | - Kiyoto Kasai
- Department of Neuropsychiatry, Graduate School of Medicine, The University of Tokyo, Tokyo, Japan
| | - Mitsuo Kawato
- ATR Brain Information Communication Research Laboratory Group, Kyoto, Japan
| |
Collapse
|
18
|
Baker EJ, Walter NAR, Salo A, Rivas Perea P, Moore S, Gonzales S, Grant KA. Identifying Future Drinkers: Behavioral Analysis of Monkeys Initiating Drinking to Intoxication is Predictive of Future Drinking Classification. Alcohol Clin Exp Res 2017; 41:626-636. [PMID: 28055132 PMCID: PMC5347908 DOI: 10.1111/acer.13327] [Citation(s) in RCA: 29] [Impact Index Per Article: 4.1] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/11/2016] [Accepted: 12/24/2016] [Indexed: 12/25/2022]
Abstract
BACKGROUND The Monkey Alcohol Tissue Research Resource (MATRR) is a repository and analytics platform for detailed data derived from well-documented nonhuman primate (NHP) alcohol self-administration studies. This macaque model has demonstrated categorical drinking norms reflective of human drinking populations, resulting in consumption pattern classifications of very heavy drinking (VHD), heavy drinking (HD), binge drinking (BD), and low drinking (LD) individuals. Here, we expand on previous findings that suggest ethanol drinking patterns during initial drinking to intoxication can reliably predict future drinking category assignment. METHODS The classification strategy uses a machine-learning approach to examine an extensive set of daily drinking attributes during 90 sessions of induction across 7 cohorts of 5 to 8 monkeys for a total of 50 animals. A Random Forest classifier is employed to accurately predict categorical drinking after 12 months of self-administration. RESULTS Predictive outcome accuracy is approximately 78% when classes are aggregated into 2 groups, "LD and BD" and "HD and VHD." A subsequent 2-step classification model distinguishes individual LD and BD categories with 90% accuracy and between HD and VHD categories with 95% accuracy. Average 4-category classification accuracy is 74%, and provides putative distinguishing behavioral characteristics between groupings. CONCLUSIONS We demonstrate that data derived from the induction phase of this ethanol self-administration protocol have significant predictive power for future ethanol consumption patterns. Importantly, numerous predictive factors are longitudinal, measuring the change of drinking patterns through 3 stages of induction. Factors during induction that predict future heavy drinkers include being younger at the time of first intoxication and developing a shorter latency to first ethanol drink. Overall, this analysis identifies predictive characteristics in future very heavy drinkers that optimize intoxication, such as having increasingly fewer bouts with more drinks. This analysis also identifies characteristic avoidance of intoxicating topographies in future low drinkers, such as increasing number of bouts and waiting longer before the first ethanol drink.
Collapse
Affiliation(s)
- Erich J Baker
- Department of Computer Science, Baylor University, Waco, Texas
| | - Nicole A R Walter
- Division of Neuroscience at the Oregon National Primate Research Center, Oregon Health and Science University, Portland, Oregon
| | - Alex Salo
- Department of Computer Science, Baylor University, Waco, Texas
| | - Pablo Rivas Perea
- Department of Computer Science, Marist College, Poughkeepsie, New York
| | - Sharon Moore
- Department of Computer Science, Baylor University, Waco, Texas
| | - Steven Gonzales
- Division of Neuroscience at the Oregon National Primate Research Center, Oregon Health and Science University, Portland, Oregon
| | - Kathleen A Grant
- Division of Neuroscience at the Oregon National Primate Research Center, Oregon Health and Science University, Portland, Oregon
| |
Collapse
|
19
|
Gowin JL, Ball TM, Wittmann M, Tapert SF, Paulus MP. Individualized relapse prediction: Personality measures and striatal and insular activity during reward-processing robustly predict relapse. Drug Alcohol Depend 2015; 152:93-101. [PMID: 25977206 PMCID: PMC4458160 DOI: 10.1016/j.drugalcdep.2015.04.018] [Citation(s) in RCA: 55] [Impact Index Per Article: 6.1] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 11/21/2014] [Revised: 04/17/2015] [Accepted: 04/17/2015] [Indexed: 11/19/2022]
Abstract
BACKGROUND Nearly half of individuals with substance use disorders relapse in the year after treatment. A diagnostic tool to help clinicians make decisions regarding treatment does not exist for psychiatric conditions. Identifying individuals with high risk for relapse to substance use following abstinence has profound clinical consequences. This study aimed to develop neuroimaging as a robust tool to predict relapse. METHODS 68 methamphetamine-dependent adults (15 female) were recruited from 28-day inpatient treatment. During treatment, participants completed a functional MRI scan that examined brain activation during reward processing. Patients were followed 1 year later to assess abstinence. We examined brain activation during reward processing between relapsing and abstaining individuals and employed three random forest prediction models (clinical and personality measures, neuroimaging measures, a combined model) to generate predictions for each participant regarding their relapse likelihood. RESULTS 18 individuals relapsed. There were significant group by reward-size interactions for neural activation in the left insula and right striatum for rewards. Abstaining individuals showed increased activation for large, risky relative to small, safe rewards, whereas relapsing individuals failed to show differential activation between reward types. All three random forest models yielded good test characteristics such that a positive test for relapse yielded a likelihood ratio 2.63, whereas a negative test had a likelihood ratio of 0.48. CONCLUSIONS These findings suggest that neuroimaging can be developed in combination with other measures as an instrument to predict relapse, advancing tools providers can use to make decisions about individualized treatment of substance use disorders.
Collapse
Affiliation(s)
- Joshua L Gowin
- Psychiatry, University of California San Diego, La Jolla, CA, United States; Section on Human Psychopharmacology, Laboratory of Clinical and Translational Studies, National Institute on Alcohol Abuse and Alcoholism, Bethesda, MD, United States.
| | - Tali M Ball
- Psychiatry, University of California San Diego, La Jolla, CA, United States
| | - Marc Wittmann
- Psychiatry, University of California San Diego, La Jolla, CA, United States; Empirical and Analytical Psychophysics, Institute for Frontier Areas of Psychology and Mental Health, Freiburg, Germany
| | - Susan F Tapert
- Psychiatry, University of California San Diego, La Jolla, CA, United States; Psychology Service, VA San Diego Healthcare System, La Jolla, CA, United States
| | - Martin P Paulus
- Psychiatry, University of California San Diego, La Jolla, CA, United States; Psychiatry Service, VA San Diego Healthcare System, La Jolla, CA, United States; Laureate Institute for Brain Research, United States
| |
Collapse
|
20
|
Kessler RC, Rose S, Koenen KC, Karam EG, Stang PE, Stein DJ, Heeringa SG, Hill ED, Liberzon I, McLaughlin KA, McLean SA, Pennell BE, Petukhova M, Rosellini AJ, Ruscio AM, Shahly V, Shalev AY, Silove D, Zaslavsky AM, Angermeyer MC, Bromet EJ, de Almeida JMC, de Girolamo G, de Jonge P, Demyttenaere K, Florescu SE, Gureje O, Haro JM, Hinkov H, Kawakami N, Kovess-Masfety V, Lee S, Medina-Mora ME, Murphy SD, Navarro-Mateu F, Piazza M, Posada-Villa J, Scott K, Torres Y, Carmen Viana M. How well can post-traumatic stress disorder be predicted from pre-trauma risk factors? An exploratory study in the WHO World Mental Health Surveys. World Psychiatry 2014; 13:265-74. [PMID: 25273300 PMCID: PMC4219068 DOI: 10.1002/wps.20150] [Citation(s) in RCA: 141] [Impact Index Per Article: 14.1] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 01/03/2023] Open
Abstract
Post-traumatic stress disorder (PTSD) should be one of the most preventable mental disorders, since many people exposed to traumatic experiences (TEs) could be targeted in first response settings in the immediate aftermath of exposure for preventive intervention. However, these interventions are costly and the proportion of TE-exposed people who develop PTSD is small. To be cost-effective, risk prediction rules are needed to target high-risk people in the immediate aftermath of a TE. Although a number of studies have been carried out to examine prospective predictors of PTSD among people recently exposed to TEs, most were either small or focused on a narrow sample, making it unclear how well PTSD can be predicted in the total population of people exposed to TEs. The current report investigates this issue in a large sample based on the World Health Organization (WHO)'s World Mental Health Surveys. Retrospective reports were obtained on the predictors of PTSD associated with 47,466 TE exposures in representative community surveys carried out in 24 countries. Machine learning methods (random forests, penalized regression, super learner) were used to develop a model predicting PTSD from information about TE type, socio-demographics, and prior histories of cumulative TE exposure and DSM-IV disorders. DSM-IV PTSD prevalence was 4.0% across the 47,466 TE exposures. 95.6% of these PTSD cases were associated with the 10.0% of exposures (i.e., 4,747) classified by machine learning algorithm as having highest predicted PTSD risk. The 47,466 exposures were divided into 20 ventiles (20 groups of equal size) ranked by predicted PTSD risk. PTSD occurred after 56.3% of the TEs in the highest-risk ventile, 20.0% of the TEs in the second highest ventile, and 0.0-1.3% of the TEs in the 18 remaining ventiles. These patterns of differential risk were quite stable across demographic-geographic sub-samples. These results demonstrate that a sensitive risk algorithm can be created using data collected in the immediate aftermath of TE exposure to target people at highest risk of PTSD. However, validation of the algorithm is needed in prospective samples, and additional work is warranted to refine the algorithm both in terms of determining a minimum required predictor set and developing a practical administration and scoring protocol that can be used in routine clinical practice.
Collapse
Affiliation(s)
- Ronald C Kessler
- Department of Health Care Policy, Harvard Medical School180 Longwood Ave., Boston, MA, 02115, USA
| | - Sherri Rose
- Department of Health Care Policy, Harvard Medical School180 Longwood Ave., Boston, MA, 02115, USA
| | - Karestan C Koenen
- Mailman School of Public Health, Columbia UniversityNew York, NY, USA
| | - Elie G Karam
- Balamand University Medical School and Institute for Development, Research, Advocacy and Applied Care (IDRAAC)Beirut, Lebanon
| | - Paul E Stang
- Janssen Research & DevelopmentTitusville, NJ, USA
| | - Dan J Stein
- University of Cape TownCape Town, South Africa
| | - Steven G Heeringa
- Institute for Social Research, University of MichiganAnn Arbor, MI, USA
| | - Eric D Hill
- Department of Health Care Policy, Harvard Medical School180 Longwood Ave., Boston, MA, 02115, USA
| | - Israel Liberzon
- Department of Psychology, University of MichiganAnn Arbor, MI, USA
| | | | - Samuel A McLean
- University of North Carolina at Chapel HillChapel Hill, NC, USA
| | - Beth E Pennell
- Institute for Social Research, University of MichiganAnn Arbor, MI, USA
| | - Maria Petukhova
- Department of Health Care Policy, Harvard Medical School180 Longwood Ave., Boston, MA, 02115, USA
| | - Anthony J Rosellini
- Department of Health Care Policy, Harvard Medical School180 Longwood Ave., Boston, MA, 02115, USA
| | | | - Victoria Shahly
- Department of Health Care Policy, Harvard Medical School180 Longwood Ave., Boston, MA, 02115, USA
| | | | - Derrick Silove
- University of New South Wales and Liverpool HospitalSydney, Australia
| | - Alan M Zaslavsky
- Department of Health Care Policy, Harvard Medical School180 Longwood Ave., Boston, MA, 02115, USA
| | | | - Evelyn J Bromet
- State University of New York at Stony BrookStony Brook, NY, USA
| | | | | | | | | | - Silvia E Florescu
- National School of Public Health Management and Professional DevelopmentBucharest, Romania
| | | | | | - Hristo Hinkov
- National Center for Public Health ProtectionSofia, Bulgaria
| | | | | | - Sing Lee
- Chinese University of Hong Kong, Hong Kong SARChina
| | | | | | - Fernando Navarro-Mateu
- Servicio Murciano de Salud and CIBER de Epidemiologia y Salud Publica (CIBERESP)El Palmar, Spain
| | | | | | | | - Yolanda Torres
- University Center of Excellence on Mental Health ResearchMedellín, Colombia
| | | |
Collapse
|
21
|
Valero S, Daigre C, Rodríguez-Cintas L, Barral C, Gomà-I-Freixanet M, Ferrer M, Casas M, Roncero C. Neuroticism and impulsivity: their hierarchical organization in the personality characterization of drug-dependent patients from a decision tree learning perspective. Compr Psychiatry 2014; 55:1227-33. [PMID: 24799261 DOI: 10.1016/j.comppsych.2014.03.021] [Citation(s) in RCA: 24] [Impact Index Per Article: 2.4] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 07/25/2013] [Revised: 03/26/2014] [Accepted: 03/27/2014] [Indexed: 10/25/2022] Open
Abstract
OBJECTIVE Neuroticism and impulsivity are the personality variables most consistently associated with drug-dependent patients. To date, no data mining procedures have been applied to explore the differential role of personality variables in this population. METHODS The personality profile of 336 drug-dependent patients was compared with that of a sample of community participants in the context of a decision tree learning approach using the Alternative Five Factor Model. The resulting discriminant model was cross-validated. RESULTS Neuroticism and impulsivity were the most relevant variables in the resulting model, but their association appeared to be hierarchically organized. In the personality characterization of these patients, neuroticism became the main discriminant dimension, whereas impulsivity played a differential role, explained by means of an interaction effect. Decision tree learning models appear to be a heuristic theoretical and empirical approximation to the study of relevant variables, such as personality traits, in drug-dependency research.
Collapse
Affiliation(s)
- Sergi Valero
- Department of Psychiatry, Hospital Universitari Vall d'Hebron, CIBERSAM, Universitat Autònoma de Barcelona, Barcelona, Catalonia, Spain.
| | - Constanza Daigre
- Department of Psychiatry, Hospital Universitari Vall d'Hebron, CIBERSAM, Universitat Autònoma de Barcelona, Barcelona, Catalonia, Spain; Outpatient Drug Clinic (CAS) Vall Hebron, Hospital Vall d'Hebron-Agència de Salut Pública de Barcelona, Barcelona, Catalonia, Spain
| | - Laia Rodríguez-Cintas
- Department of Psychiatry, Hospital Universitari Vall d'Hebron, CIBERSAM, Universitat Autònoma de Barcelona, Barcelona, Catalonia, Spain; Outpatient Drug Clinic (CAS) Vall Hebron, Hospital Vall d'Hebron-Agència de Salut Pública de Barcelona, Barcelona, Catalonia, Spain
| | - Carmen Barral
- Department of Psychiatry, Hospital Universitari Vall d'Hebron, CIBERSAM, Universitat Autònoma de Barcelona, Barcelona, Catalonia, Spain; Outpatient Drug Clinic (CAS) Vall Hebron, Hospital Vall d'Hebron-Agència de Salut Pública de Barcelona, Barcelona, Catalonia, Spain
| | - Montserrat Gomà-I-Freixanet
- Department of Clinical and Health Psychology, Universitat Autònoma de Barcelona, Barcelona, Catalonia, Spain
| | - Marc Ferrer
- Department of Psychiatry, Hospital Universitari Vall d'Hebron, CIBERSAM, Universitat Autònoma de Barcelona, Barcelona, Catalonia, Spain; Department of Psychiatry and Legal Medicine, Universitat Autònoma de Barcelona, Barcelona, Catalonia, Spain
| | - Miquel Casas
- Department of Psychiatry, Hospital Universitari Vall d'Hebron, CIBERSAM, Universitat Autònoma de Barcelona, Barcelona, Catalonia, Spain; Department of Psychiatry and Legal Medicine, Universitat Autònoma de Barcelona, Barcelona, Catalonia, Spain
| | - Carlos Roncero
- Department of Psychiatry, Hospital Universitari Vall d'Hebron, CIBERSAM, Universitat Autònoma de Barcelona, Barcelona, Catalonia, Spain; Outpatient Drug Clinic (CAS) Vall Hebron, Hospital Vall d'Hebron-Agència de Salut Pública de Barcelona, Barcelona, Catalonia, Spain; Department of Psychiatry and Legal Medicine, Universitat Autònoma de Barcelona, Barcelona, Catalonia, Spain
| |
Collapse
|
22
|
Chih MY, Patton T, McTavish FM, Isham AJ, Judkins-Fisher CL, Atwood AK, Gustafson DH. Predictive modeling of addiction lapses in a mobile health application. J Subst Abuse Treat 2013; 46:29-35. [PMID: 24035143 DOI: 10.1016/j.jsat.2013.08.004] [Citation(s) in RCA: 58] [Impact Index Per Article: 5.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/09/2013] [Revised: 07/30/2013] [Accepted: 08/02/2013] [Indexed: 11/16/2022]
Abstract
The chronically relapsing nature of alcoholism leads to substantial personal, family, and societal costs. Addiction-comprehensive health enhancement support system (A-CHESS) is a smartphone application that aims to reduce relapse. To offer targeted support to patients who are at risk of lapses within the coming week, a Bayesian network model to predict such events was constructed using responses on 2,934 weekly surveys (called the Weekly Check-in) from 152 alcohol-dependent individuals who recently completed residential treatment. The Weekly Check-in is a self-monitoring service, provided in A-CHESS, to track patients' recovery progress. The model showed good predictability, with the area under receiver operating characteristic curve of 0.829 in the 10-fold cross-validation and 0.912 in the external validation. The sensitivity/specificity table assists the tradeoff decisions necessary to apply the model in practice. This study moves us closer to the goal of providing lapse prediction so that patients might receive more targeted and timely support.
Collapse
Affiliation(s)
- Ming-Yuan Chih
- Center for Health Enhancement Systems Studies, College of Engineering, University of Wisconsin - Madison, 1513 University Ave., Madison, WI 53706, USA.
| | | | | | | | | | | | | |
Collapse
|
23
|
Abstract
Alcohol dependence has been described as a relapsing condition and it has been proposed that alcohol lapses could potentially be explained by dynamic associations between contextual, interpersonal, and intrapersonal risk factors. Yet, few studies have tested the associations between risk factors in the prediction of lapse dynamics. The current study was a secondary analysis of data from the COMBINE study (n = 1,383; COMBINE Study Research Group, 2003). The goal of the current study was to examine static (alcohol dependence severity, treatment history, marital status, psychiatric symptoms) and dynamic (negative affect, craving, stress) predictors of heavy drinking during the course of treatment and up to one year following treatment. Results from dynamic latent difference score models indicated that higher levels of static and dynamic risk and increased dynamic risk over time were significantly associated with greater increases in heavy drinking. Likewise, more frequent heavy drinking and higher static risk predicted higher levels of dynamic risk. In addition, changes in dynamic risk factors significantly mediated the association between changes in heavy drinking and both psychiatric symptoms and treatment history. It is important to note that while the effects of static and dynamic risk factors in the prediction of heavy drinking were statistically significant, the magnitude of the effects were small. The current study provided partial support for a dynamic model of relapse; however future research using intensive longitudinal data collection and more advanced statistical techniques could further elucidate lapse dynamics and potentially improve relapse prevention planning.
Collapse
Affiliation(s)
- Katie Witkiewitz
- Department of Psychology, Washington State University–Vancouver, 14204 NE Salmon Creek Avenue Vancouver, WA 98686, USA.
| |
Collapse
|
24
|
Current world literature. Addictive disorder. Curr Opin Psychiatry 2009; 22:331-6. [PMID: 19365188 DOI: 10.1097/yco.0b013e32832ae253] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 11/25/2022]
|