1
|
Del Mauro L, Vergallito A, Devoto F, Locatelli G, Hassan G, Romero Lauro LJ. Beyond the Surface: Deep TMS Efficacy in Reducing Craving in Addictive Disorders. A Systematic Review and Meta-analysis. BIOLOGICAL PSYCHIATRY. COGNITIVE NEUROSCIENCE AND NEUROIMAGING 2025:S2451-9022(25)00125-9. [PMID: 40204236 DOI: 10.1016/j.bpsc.2025.03.012] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/07/2025] [Revised: 03/21/2025] [Accepted: 03/23/2025] [Indexed: 04/11/2025]
Abstract
BACKGROUND Substance use disorders (SUDs) and Gambling Disorder (GD) are addictive diseases with a chronic course. Due to the limited efficacy of conventional treatments, there is growing interest in alternative approaches targeting the altered neural circuits underlying these disorders. Deep Transcranial Magnetic Stimulation (dTMS) has emerged as a promising neuromodulation technique capable of reaching deep and bilateral brain regions. However, no definite recommendation for its use in addiction treatment exists. This study systematically reviewed and quantitatively analyzed dTMS effects in SUDs and GD. METHODS Following the PRISMA guidelines, we screened four electronic databases up to February 2024 and selected relevant English-written original research articles. Seventeen papers were included in the systematic review. As only a minority of studies employed a sham-controlled design, we ran the meta-analysis on a subset of 12 studies, computing the pre-post real stimulation standardized mean change (SMCC) as the effect size, using self-reported craving scores as the dependent variable. RESULTS The results showed a significant and large effect of real dTMS in reducing craving scores (SMCC = - 1.26, 95% CI [-1.67, - 0.86], p <.001). High heterogeneity across studies was found at both quantitative and qualitative levels. CONCLUSIONS Results provide preliminary evidence supporting the effectiveness of dTMS for SUDs treatment. Current limitations and future directions are critically discussed, highlighting the need for further rigorous research to refine the therapeutic potential and develop consensus-based guidelines for dTMS clinical application.
Collapse
Affiliation(s)
| | | | - Francantonio Devoto
- Department of Psychology & NeuroMi, University of Milano Bicocca, Milan, Italy
| | - Gaia Locatelli
- Department of Psychology & NeuroMi, University of Milano Bicocca, Milan, Italy; Istituto Universitario di Studi Superiori IUSS, Pavia, Italy
| | - Gabriel Hassan
- Department of Biomedical and Clinical Sciences, University of Milan, Milan, Italy
| | - Leonor J Romero Lauro
- Fondazione Eris ETS, Milan, Italy; Department of Psychology & NeuroMi, University of Milano Bicocca, Milan, Italy.
| |
Collapse
|
2
|
Treiber M, Tsapakis EM, Fountoulakis K. Repetitive Transcranial Magnetic Stimulation for Alcohol Craving in Alcohol Use Disorders: A Meta-analysis. J Addict Med 2025; 19:195-201. [PMID: 39665462 DOI: 10.1097/adm.0000000000001416] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/13/2024]
Abstract
AIMS We aimed to evaluate the immediate and up to 3 months' effect of multiple-session repetitive transcranial magnetic stimulation (rTMS) on alcohol craving in AUD. METHODS We performed a systematic review and random effects meta-analysis. We included randomized controlled trials with at least 10 sessions of rTMS and postintervention alcohol craving assessment. We evaluated the immediate and up to 3 months' effects of active rTMS versus sham stimulation. RESULTS Twelve studies met inclusion criteria, including 475 participants across both treatment and control groups. rTMS reduced alcohol craving over sham stimulation immediately post-treatment (SMD = -0.79, 95% CI: -1.53 to -0.04, P = 0.04, I2 = 93%). Concerning a maintenance effect, our meta-analysis revealed a medium effect for active rTMS in reduction of alcohol craving at 3-month follow-up (SMD = -0.44, 95% CI: -0.77 to 0.11, P < 0.01, I2 = 38%). Our subgroup analysis revealed that rTMS targeting the medial prefrontal cortex (SMD = -2.12, 95% CI: -4.34 to 0.09, P = 0.06, I2 = 94%) may be more effective than stimulating the right dorsolateral prefrontal cortex (SMD = -1.04, 95% CI: -2.56 to 0.48, P = 0.18, I2 = 96%) or left dorsolateral prefrontal cortex (SMD = -0.27, 95% CI: -0.60 to 0.05, P = 0.10, I2 = 0%) immediately after treatment. CONCLUSION A minimum of 10 sessions of rTMS reduced alcohol craving immediately after treatment; this effect seems to be sustained over a 3-month period. We provide limited evidence of superiority for rTMS targeting the medial prefrontal cortex.
Collapse
Affiliation(s)
- Michael Treiber
- From the Department of Psychiatry and Psychotherapy, Medical University of Vienna, Austria (MT); Comprehensive Center for Clinical Neurosciences and Mental Health (C3NMH), Medical University of Vienna, Austria (MT); and 3rd Department of Psychiatry, Division of Neurosciences, School of Medicine, Aristotle University of Thessaloniki, Thessaloniki, Greece (MT, E-MT, KF)
| | | | | |
Collapse
|
3
|
Tang VM, Blumberger DM. Transcranial magnetic stimulation for the rehabilitation of patients with addiction: current status and future prospects. Expert Rev Med Devices 2024; 21:943-954. [PMID: 39323104 DOI: 10.1080/17434440.2024.2404962] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/30/2024] [Accepted: 09/12/2024] [Indexed: 09/27/2024]
Abstract
INTRODUCTION Substance use disorders (SUDs) are severe conditions that remain extremely challenging to treat in clinical practice. With high rates of non-response to current treatment options and several SUDs with no approved interventions, novel therapies are needed. Repetitive transcranial magnetic stimulation (rTMS) can non-invasively modulate the neurocircuitry of brain-based disorders, and investigation into its therapeutic potential for SUDs is growing rapidly. AREAS COVERED In this review, we summarize the clinical research to date evaluating its safety and efficacy for various SUDs. We highlight the investigations comparing different stimulation parameters to present our current understanding on optimal stimulation parameters. Additionally, we cover key research avenues in the use of neuroimaging to guide treatment, cue-induction paradigms, and adjunctive or combination treatments that may optimize outcomes. EXPERT OPINION Evidence of rTMS as an effective treatment for certain SUDs has emerged and is preliminary for others. There are a growing number of studies showing benefit and meta-analyses suggesting that rTMS can significantly reduce substance craving and consumption. However, the optimal approach has not been determined, and there is a great deal of heterogeneity in rTMS protocols and mixed outcomes. Further research into strategies for enhancing precision will be crucial in moving the field forward.
Collapse
Affiliation(s)
- Victor M Tang
- Addictions Division, Centre for Addiction and Mental Health, Toronto, ON, Canada
- Department of Psychiatry, Temerty Faculty of Medicine, University of Toronto, Toronto, ON, Canada
- Institute for Mental Health Policy Research, Centre for Addiction and Mental Health, Toronto, ON, Canada
| | - Daniel M Blumberger
- Addictions Division, Centre for Addiction and Mental Health, Toronto, ON, Canada
- Department of Psychiatry, Temerty Faculty of Medicine, University of Toronto, Toronto, ON, Canada
- Temerty Centre for Therapeutic Brain Intervention, Campbell Family Mental Health Research Institute, Centre for Addiction and Mental Health, Toronto, ON, Canada
| |
Collapse
|
4
|
Narasimha VL, Mukherjee D, Arya S, Parmar A. Alcohol use disorder research in India: An update. Indian J Psychiatry 2024; 66:495-515. [PMID: 39100372 PMCID: PMC11293778 DOI: 10.4103/indianjpsychiatry.indianjpsychiatry_758_23] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 09/30/2023] [Revised: 05/10/2024] [Accepted: 05/21/2024] [Indexed: 08/06/2024] Open
Abstract
Background Despite alcohol use being a risk factor for numerous health-related conditions and alcohol use disorder (AUD) recognized as a disease, there was limited research in India until 2010. This narrative review aims to evaluate AUD-related research in India from 2010 to July 2023. Methods A PubMed search used key terms for AUD in India after 2010. Indian and international journals with regional significance that publish alcohol-related research were searched by each author individually. These were then collated, and duplicates were removed. In addition, we also conducted a gray literature search on focused areas related to AUD. Results The alcohol-related research in India after 2010 focused on diverse areas associated with alcohol use. Some areas of research have received more attention than others. Two major epidemiological surveys conducted in the past decade reveal that around 5% have a problematic alcohol use pattern. Factors associated with alcohol use, like genetic, neurobiological, psychological, and sociocultural, were studied. The studies focused on the clinical profile of AUD, including their correlates, such as craving, withdrawal, alcohol-related harm, and comorbid psychiatric and medical illnesses. During this period, minimal research was conducted to understand AUD's laboratory biomarkers, course, and prognosis. While there was a focus on generating evidence for different psychological interventions for alcohol dependence in management-related research, pharmacological studies centered on anticraving agents like baclofen. Research on noninvasive brain stimulation, such as rTMS, has shown preliminary usefulness in treating alcohol dependence. Very little research has been conducted regarding alcohol policy. Conclusion In the past decade, Indian research on alcohol has focused on diverse areas. Epidemiological and psychological management-related research received maximum attention. Considering the magnitude of the alcohol-related burden, it is essential to prioritize research to other less studied areas like pharmacological management of alcohol dependence and alcohol policy.
Collapse
Affiliation(s)
- Venkata Lakshmi Narasimha
- Centre for Addiction Medicine, Department of Psychiatry, National Institute of Mental Health and Neurosciences (NIMHANS), Bengaluru, Karnataka, India
| | | | - Sidharth Arya
- Institute of Mental Health, Pt BDS University of Health Sciences, Rohtak, Haryana, India
| | - Arpit Parmar
- Department of Psychiatry, All India Institute of Medical Sciences (AIIMS), Bhubaneswar, Odisha, India
| |
Collapse
|
5
|
Mehta DD, Praecht A, Ward HB, Sanches M, Sorkhou M, Tang VM, Steele VR, Hanlon CA, George TP. A systematic review and meta-analysis of neuromodulation therapies for substance use disorders. Neuropsychopharmacology 2024; 49:649-680. [PMID: 38086901 PMCID: PMC10876556 DOI: 10.1038/s41386-023-01776-0] [Citation(s) in RCA: 20] [Impact Index Per Article: 20.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 07/20/2023] [Revised: 11/06/2023] [Accepted: 11/20/2023] [Indexed: 02/21/2024]
Abstract
While pharmacological, behavioral and psychosocial treatments are available for substance use disorders (SUDs), they are not always effective or well-tolerated. Neuromodulation (NM) methods, including repetitive transcranial magnetic stimulation (rTMS), transcranial direct current stimulation (tDCS) and deep brain stimulation (DBS) may address SUDs by targeting addiction neurocircuitry. We evaluated the efficacy of NM to improve behavioral outcomes in SUDs. A systematic literature search was performed on MEDLINE, PsychINFO, and PubMed databases and a list of search terms for four key concepts (SUD, rTMS, tDCS, DBS) was applied. Ninety-four studies were identified that examined the effects of rTMS, tDCS, and DBS on substance use outcomes (e.g., craving, consumption, and relapse) amongst individuals with SUDs including alcohol, tobacco, cannabis, stimulants, and opioids. Meta-analyses were performed for alcohol and tobacco studies using rTMS and tDCS. We found that rTMS reduced substance use and craving, as indicated by medium to large effect sizes (Hedge's g > 0.5). Results were most encouraging when multiple stimulation sessions were applied, and the left dorsolateral prefrontal cortex (DLPFC) was targeted. tDCS also produced medium effect sizes for drug use and craving, though they were highly variable and less robust than rTMS; right anodal DLPFC stimulation appeared to be most efficacious. DBS studies were typically small, uncontrolled studies, but showed promise in reducing misuse of multiple substances. NM may be promising for the treatment of SUDs. Future studies should determine underlying neural mechanisms of NM, and further evaluate extended treatment durations, accelerated administration protocols and long-term outcomes with biochemical verification of substance use.
Collapse
Affiliation(s)
- Dhvani D Mehta
- Addictions Division, CAMH, Toronto, ON, Canada.
- Department of Psychiatry, Temerty Faculty of Medicine, University of Toronto, Toronto, ON, Canada.
| | - Angela Praecht
- Addictions Division, CAMH, Toronto, ON, Canada
- Department of Psychiatry, Temerty Faculty of Medicine, University of Toronto, Toronto, ON, Canada
| | - Heather B Ward
- Department of Psychiatry and Behavioral Sciences, Vanderbilt University Medical Center, Nashville, TN, USA
| | | | - Maryam Sorkhou
- Addictions Division, CAMH, Toronto, ON, Canada
- Department of Psychiatry, Temerty Faculty of Medicine, University of Toronto, Toronto, ON, Canada
| | - Victor M Tang
- Addictions Division, CAMH, Toronto, ON, Canada
- Department of Psychiatry, Temerty Faculty of Medicine, University of Toronto, Toronto, ON, Canada
| | - Vaughn R Steele
- Department of Psychiatry, Yale University School of Medicine, New Haven, CT, USA
| | | | - Tony P George
- Addictions Division, CAMH, Toronto, ON, Canada.
- Department of Psychiatry, Temerty Faculty of Medicine, University of Toronto, Toronto, ON, Canada.
| |
Collapse
|
6
|
Tang VM, Ibrahim C, Rodak T, Goud R, Blumberger DM, Voineskos D, Le Foll B. Managing substance use in patients receiving therapeutic repetitive transcranial magnetic stimulation: A scoping review. Neurosci Biobehav Rev 2023; 155:105477. [PMID: 38007879 DOI: 10.1016/j.neubiorev.2023.105477] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/25/2023] [Revised: 11/16/2023] [Accepted: 11/18/2023] [Indexed: 11/28/2023]
Abstract
Repetitive Transcranial Magnetic Stimulation (rTMS) is an invaluable treatment option for neuropsychiatric disorders. Co-occurring recreational and nonmedical substance use can be common in those presenting for rTMS treatment, and it is unknown how it may affect the safety and efficacy of rTMS for the treatment of currently approved neuropsychiatric indications. This scoping review aimed to map the literature on humans receiving rTMS and had a history of any type of substance use. The search identified 274 articles providing information on inclusion/exclusion criteria, withdrawal criteria, safety protocols, type of rTMS and treatment parameters, adverse events and effect on primary outcomes that related to substance use. There are neurophysiological effects of substance use on cortical excitability, although the relevance to clinical rTMS practice is unknown. The current literature supports the safety and feasibility of delivering rTMS to those who have co-occurring neuropsychiatric disorder and substance use. However, specific details on how varying degrees of substance use alters the safety, efficacy, and mechanisms of rTMS remains poorly described.
Collapse
Affiliation(s)
- Victor M Tang
- Addictions Division, Centre for Addiction and Mental Health, Canada; Institute for Medical Science, Temerty Faculty of Medicine, University of Toronto, Canada; Department of Psychiatry, Temerty Faculty of Medicine, University of Toronto, Canada; Campbell Family Mental Health Research Institute, Centre for Addiction and Mental Health, Canada; Institute of Mental Health Policy Research, Centre for Addiction and Mental Health, Canada.
| | - Christine Ibrahim
- Addictions Division, Centre for Addiction and Mental Health, Canada; Institute for Medical Science, Temerty Faculty of Medicine, University of Toronto, Canada
| | - Terri Rodak
- CAMH Mental Health Sciences Library, Department of Education, Centre for Addiction and Mental Health, Canada
| | - Rachel Goud
- Addictions Division, Centre for Addiction and Mental Health, Canada
| | - Daniel M Blumberger
- Institute for Medical Science, Temerty Faculty of Medicine, University of Toronto, Canada; Department of Psychiatry, Temerty Faculty of Medicine, University of Toronto, Canada; Campbell Family Mental Health Research Institute, Centre for Addiction and Mental Health, Canada; Temerty Centre for Therapeutic Brain Intervention, Centre for Addiction and Mental Health, Canada
| | - Daphne Voineskos
- Institute for Medical Science, Temerty Faculty of Medicine, University of Toronto, Canada; Department of Psychiatry, Temerty Faculty of Medicine, University of Toronto, Canada; Campbell Family Mental Health Research Institute, Centre for Addiction and Mental Health, Canada; Temerty Centre for Therapeutic Brain Intervention, Centre for Addiction and Mental Health, Canada; Poul Hansen Family Centre for Depression, Krembil Research Institute, Toronto Western Hospital, University Health Network, Canada
| | - Bernard Le Foll
- Addictions Division, Centre for Addiction and Mental Health, Canada; Institute for Medical Science, Temerty Faculty of Medicine, University of Toronto, Canada; Department of Psychiatry, Temerty Faculty of Medicine, University of Toronto, Canada; Campbell Family Mental Health Research Institute, Centre for Addiction and Mental Health, Canada; Institute of Mental Health Policy Research, Centre for Addiction and Mental Health, Canada; CAMH Mental Health Sciences Library, Department of Education, Centre for Addiction and Mental Health, Canada; Temerty Centre for Therapeutic Brain Intervention, Centre for Addiction and Mental Health, Canada; Poul Hansen Family Centre for Depression, Krembil Research Institute, Toronto Western Hospital, University Health Network, Canada; Department of Pharmacology and Toxicology, Temerty Faculty of Medicine, University of Toronto, Canada; Department of Family and Community Medicine, Temerty Faculty of Medicine, University of Toronto, Canada; Waypoint Research Institute, Waypoint Centre for Mental Health Care, Penetanguishene, Canada
| |
Collapse
|
7
|
Sorkhou M, Stogios N, Sayrafizadeh N, Hahn MK, Agarwal SM, George TP. Non-invasive neuromodulation of dorsolateral prefrontal cortex to reduce craving in alcohol use disorder: A meta-analysis. DRUG AND ALCOHOL DEPENDENCE REPORTS 2022; 4:100076. [PMID: 36846579 PMCID: PMC9948891 DOI: 10.1016/j.dadr.2022.100076] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 02/25/2022] [Revised: 05/16/2022] [Accepted: 06/23/2022] [Indexed: 11/26/2022]
Abstract
Introduction While several pharmacological and behavioral treatments are available for alcohol use disorder (AUD), they may not be effective for all patients. The aim of this systematic review and meta-analysis was to evaluate the efficacy and safety of rTMS and tDCS for craving in AUD. Methods EMBASE, Cochrane Library, PsycINFO, and PubMed databases were searched for original, peer-reviewed research articles in the English language published between January 2000 and January 2022. Randomized controlled trials (RCTs) reporting changes in alcohol craving among patients with AUD were selected. Random-effects meta-analysis was employed to pool data. Results Changes in alcohol craving were extracted from 15 RCTs. Six studies assessed the efficacy of rTMS while nine studies examined tDCS. Results demonstrated that in comparison to sham stimulation, active rTMS to the DLPFC yields small but significant reductions in alcohol craving (standardized mean difference [SMD] = -0.27, p = .03). However, DLPFC stimulation via tDCS was not superior to sham stimulation in producing changes in alcohol craving (SMD = -0.08, p = .59). Conclusions Our meta-analysis suggests that rTMS may be superior to tDCS in reducing alcohol craving in patients with AUD. However, additional research is needed to identify optimal stimulation parameters for both non-invasive neuromodulatory techniques in AUD.
Collapse
Affiliation(s)
- Maryam Sorkhou
- Institute of Medical Sciences (IMS), University of Toronto, Canada,Temerty Faculty of Medicine, University of Toronto, Canada,Centre for Complex Interventions (CCI), Centre for Addiction and Mental Health (CAMH), Canada
| | - Nicolette Stogios
- Institute of Medical Sciences (IMS), University of Toronto, Canada,Schizophrenia Division, Centre for Addiction and Mental Health (CAMH), Canada
| | - Negar Sayrafizadeh
- Institute of Medical Sciences (IMS), University of Toronto, Canada,Temerty Faculty of Medicine, University of Toronto, Canada,Centre for Complex Interventions (CCI), Centre for Addiction and Mental Health (CAMH), Canada
| | - Margaret K. Hahn
- Institute of Medical Sciences (IMS), University of Toronto, Canada,Department of Psychiatry, University of Toronto, Canada,Temerty Faculty of Medicine, University of Toronto, Canada,Schizophrenia Division, Centre for Addiction and Mental Health (CAMH), Canada
| | - Sri Mahavir Agarwal
- Institute of Medical Sciences (IMS), University of Toronto, Canada,Department of Psychiatry, University of Toronto, Canada,Temerty Faculty of Medicine, University of Toronto, Canada,Schizophrenia Division, Centre for Addiction and Mental Health (CAMH), Canada
| | - Tony P. George
- Institute of Medical Sciences (IMS), University of Toronto, Canada,Department of Psychiatry, University of Toronto, Canada,Temerty Faculty of Medicine, University of Toronto, Canada,Centre for Complex Interventions (CCI), Centre for Addiction and Mental Health (CAMH), Canada,Corresponding author at: Addictions Division; Schizophrenia Division, University of Toronto Clinician-Scientist, Centre for Addiction and Mental Health (CAMH), 60 White Squirrel Way, Room 312, Toronto, Ontario M6J 1H4, Canada
| |
Collapse
|
8
|
rTMS Reduces Craving and Alcohol Use in Patients with Alcohol Use Disorder: Results of a Randomized, Sham-Controlled Clinical Trial. J Clin Med 2022; 11:jcm11040951. [PMID: 35207224 PMCID: PMC8878126 DOI: 10.3390/jcm11040951] [Citation(s) in RCA: 7] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/22/2021] [Revised: 01/27/2022] [Accepted: 02/08/2022] [Indexed: 12/18/2022] Open
Abstract
(1) Background: Current evidence-based treatments for alcohol use disorder (AUD) are moderately effective. Studies testing repetitive transcranial magnetic stimulation (rTMS) in AUD commonly apply a limited number of rTMS sessions with different rTMS settings, showing inconsistent effects on craving for alcohol. This study tested the efficacy of a robust rTMS protocol on craving and alcohol use. (2) Methods: In a single-blind randomized controlled trial in recently detoxified patients with AUD, ten days of high-frequency rTMS over the right dorsolateral prefrontal cortex on top of treatment as usual (n = 14) was compared with sham rTMS (n = 16). Outcome measures were alcohol craving and use over a follow-up period of one year. Analysis was performed by means of repeated measures multivariate analysis of variance. (3) Results: The results showed a main group-by-time interaction effect on craving (Wilks’ Λ = 0.348, F (12, 17) = 2.654, p = 0.032) and an effect of group on alcohol use (Wilk’s Λ = 0.44, F (6, 23) = 4.9, p = 0.002), with lower alcohol craving and use in the group with active rTMS compared to the control group. Differences in craving between groups were most prominent three months after treatment. At 12 months follow-up, there was no effect of rTMS on craving or abstinence. (4) Conclusions: This small-scale randomized controlled trial showed the efficacy of high-frequency rTMS over the right dlPFC diminished alcohol craving and use in recently detoxified patients with AUD during the first months after detoxification. These findings suggest that rTMS might be an effective add-on in treating patients with AUD and warrant replication in future large-scale studies.
Collapse
|