1
|
Bauer A, Gregoire A, Tinelli M, Knapp M. Costs and benefits of scaling psychosocial interventions during the perinatal period in England: A simulation modelling study. Int J Nurs Stud 2024; 154:104733. [PMID: 38493516 DOI: 10.1016/j.ijnurstu.2024.104733] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/10/2023] [Revised: 02/21/2024] [Accepted: 02/22/2024] [Indexed: 03/19/2024]
Abstract
BACKGROUND Globally, guidance recommends the integration of mental health into maternal and child healthcare to address common maternal mental health problems during the perinatal period. However, implementing this in the real-world requires substantial resource allocations. OBJECTIVE The aim of this study was to estimate the likely costs and consequences linked to scaling the delivery of treatment (in the form of psychosocial interventions) during the perinatal period. DESIGN Simulation modelling. SETTING(S) England. METHODS Costs and consequences were modelled for three scenarios of assumed provision of services, whereby one referred to the projected provision under current government plans, with no additional scaling up of treatment. The other two scenarios referred to additional scaling of treatment: in one scenario, this referred to the provision of treatment by midwives and health visitors trained in the routine enquiry about mental health and delivery of psychosocial interventions; in the other scenario this referred to an expanded provision by primary mental health services. For each scenario and in yearly intervals (covering a ten-year period, 2015 to 2024), unit cots and outcomes were assigned to the activities women were assumed to receive (routine enquiry, assessment, treatment, care coordination). All costs were in 2020 pounds sterling. Data sources for the modelling included: published findings from randomised controlled trials; national unit cost source; national statistics; and expert consultation. RESULTS If the projected treatment gap was to be addressed, an estimated additional 111,154 (50,031) women would be accessing treatment in 2015 (2024). Estimated total costs (including cost offsets) in the scenario of projected provision under current government plans would be £73.5 million in 2015 and £95.2 million in 2024, whilst quality-adjusted life years gained would be 901 and 928 respectively. Addressing the treatment gap through provision by trained midwives and health visitors could mean additional costs of £7.3 million in 2015 but lower costs of £18.4 million in 2024. The additional quality-adjusted life years gained are estimated at 2096 in 2015 and 1418 in 2024. A scenario in which the treatment gap would be met by primary mental health services was likely to be more costly and delivered less health gains. CONCLUSIONS Findings from this modelling study suggest that scaling the integration of mental health care into routinely delivered care for women during the perinatal period might be economically viable. REGISTRATION N/A. TWEETABLE ABSTRACT Integrating mental health into maternal and child healthcare might generate economic benefits new study by @a_annettemaria and @knappem @CPEC_LSE finds #increasing access to treatment for women with perinatal mental health problems.
Collapse
Affiliation(s)
- Annette Bauer
- Care Policy and Evaluation Centre, Department of Health Policy, London School of Economics and Political Science, United Kingdom.
| | | | - Michela Tinelli
- Care Policy and Evaluation Centre, Department of Health Policy, London School of Economics and Political Science, United Kingdom. https://twitter.com/CPEC_LSE
| | - Martin Knapp
- Care Policy and Evaluation Centre, Department of Health Policy, London School of Economics and Political Science, United Kingdom. https://twitter.com/knappem
| |
Collapse
|
2
|
Singla DR, de Oliveira C, Murphy SM, Patel V, Charlebois J, Davis WN, Dennis CL, Kim JJ, Kurdyak P, Lawson A, Meltzer-Brody S, Mulsant BH, Schoueri-Mychasiw N, Silver RK, Tschritter D, Vigod SN, Byford S. Protocol for an economic evaluation of scalable strategies to improve mental health among perinatal women: non-specialist care delivered via telemedicine vs. specialist care delivered in-person. BMC Psychiatry 2023; 23:817. [PMID: 37940930 PMCID: PMC10634150 DOI: 10.1186/s12888-023-05318-2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 10/23/2023] [Accepted: 10/27/2023] [Indexed: 11/10/2023] Open
Abstract
BACKGROUND Perinatal depression affects an estimated 1 in 5 women in North America during the perinatal period, with annualized lifetime costs estimated at $20.6 billion CAD in Canada and over $45.9 billion USD in the US. Access to psychological treatments remains limited for most perinatal women suffering from depression and anxiety. Some barriers to effective care can be addressed through task-sharing to non-specialist providers and through telemedicine platforms. The cost-effectiveness of these strategies compared to traditional specialist and in-person models remains unknown. This protocol describes an economic evaluation of non-specialist providers and telemedicine, in comparison to specialist providers and in-person sessions within the ongoing Scaling Up Maternal Mental healthcare by Increasing access to Treatment (SUMMIT) trial. METHODS The economic evaluation will be undertaken alongside the SUMMIT trial. SUMMIT is a pragmatic, randomized, non-inferiority trial across five North American study sites (N = 1,226) of the comparable effectiveness of two types of providers (specialist vs. non-specialist) and delivery modes (telemedicine vs. in-person) of a behavioural activation treatment for perinatal depressive and anxiety symptoms. The primary economic evaluation will be a cost-utility analysis. The outcome will be the incremental cost-effectiveness ratio, which will be expressed as the additional cost required to achieve an additional quality-adjusted life-year, as assessed by the EuroQol 5-Dimension 5-Level instrument. A secondary cost-effectiveness analysis will use participants' depressive symptom scores. A micro-costing analysis will be conducted to estimate the resources/costs required to implement and sustain the interventions; healthcare resource utilization will be captured via self-report. Data will be pooled and analysed using uniform price and utility weights to determine cost-utility across all trial sites. Secondary country-specific cost-utility and cost-effectiveness analyses will also be completed. Sensitivity analyses will be conducted, and cost-effectiveness acceptability-curves will be generated, in all instances. DISCUSSION Results of this study are expected to inform key decisions related to dissemination and scale up of evidence-based psychological interventions in Canada, the US, and possibly worldwide. There is potential impact on real-world practice by informing decision makers of the long-term savings to the larger healthcare setting in services to support perinatal women with common mental health conditions.
Collapse
Affiliation(s)
- Daisy R Singla
- Institute for Mental Health Policy Research, Campbell Family Mental Health Research Institute, Centre for Addiction and Mental Health, Toronto, Canada.
- Department of Psychiatry, Temerty Faculty of Medicine, University of Toronto, Toronto, Canada.
- Lunenfeld-Tanenbaum Research Institute, Sinai Health, Toronto, Canada.
| | - Claire de Oliveira
- Institute for Mental Health Policy Research, Campbell Family Mental Health Research Institute, Centre for Addiction and Mental Health, Toronto, Canada
- Institute of Health Policy, Management and Evaluation, Dalla Lana School of Public Health, University of Toronto, Toronto, Canada
- ICES, Toronto, Canada
| | - Sean M Murphy
- Department of Population Health Sciences, Weill Cornell Medical College, New York, NY, USA
| | - Vikram Patel
- Department of Global Health and Social Medicine, Harvard Medical School, Boston, USA
- Department of Global Health and Population, Harvard Chan School of Public Health, Boston, USA
| | | | | | - Cindy-Lee Dennis
- Department of Psychiatry, Temerty Faculty of Medicine, University of Toronto, Toronto, Canada
- Lunenfeld-Tanenbaum Research Institute, Sinai Health, Toronto, Canada
- Lawrence S. Bloomberg Faculty of Nursing, University of Toronto, Toronto, Canada
| | - J Jo Kim
- Department of Obstetrics & Gynecology, NorthShore University HealthSystem, Evanston, USA
| | - Paul Kurdyak
- Institute for Mental Health Policy Research, Campbell Family Mental Health Research Institute, Centre for Addiction and Mental Health, Toronto, Canada
- Department of Psychiatry, Temerty Faculty of Medicine, University of Toronto, Toronto, Canada
- ICES, Toronto, Canada
| | - Andrea Lawson
- Institute for Mental Health Policy Research, Campbell Family Mental Health Research Institute, Centre for Addiction and Mental Health, Toronto, Canada
| | - Samantha Meltzer-Brody
- Department of Psychiatry, School of Medicine, University of North Carolina, Chapel Hill, USA
| | - Benoit H Mulsant
- Institute for Mental Health Policy Research, Campbell Family Mental Health Research Institute, Centre for Addiction and Mental Health, Toronto, Canada
- Department of Psychiatry, Temerty Faculty of Medicine, University of Toronto, Toronto, Canada
| | | | - Richard K Silver
- Department of Obstetrics & Gynecology, NorthShore University HealthSystem, Evanston, USA
- Department of Obstetrics and Gynecology, University of Chicago Pritzker School of Medicine, Chicago, USA
| | - Dana Tschritter
- Lunenfeld-Tanenbaum Research Institute, Sinai Health, Toronto, Canada
| | - Simone N Vigod
- Department of Psychiatry, Temerty Faculty of Medicine, University of Toronto, Toronto, Canada
- Women's College Hospital, Toronto, Canada
| | - Sarah Byford
- King's Health Economics, Institute of Psychiatry, Psychology & Neuroscience, King's College London, London, UK
| |
Collapse
|
3
|
Darcy A, Beaudette A, Chiauzzi E, Daniels J, Goodwin K, Mariano TY, Wicks P, Robinson A. Anatomy of a Woebot® (WB001): agent guided CBT for women with postpartum depression. Expert Rev Med Devices 2023; 20:1035-1049. [PMID: 37938145 DOI: 10.1080/17434440.2023.2280686] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/19/2023] [Accepted: 11/03/2023] [Indexed: 11/09/2023]
Abstract
INTRODUCTION Postpartum depression (PPD) is common, persistent, and stigmatized. There are insufficient trained professionals to deliver appropriate screening, diagnosis, and treatment. AREAS COVERED WB001 is a Software as a Medical Device (SaMD) based Agent-Guided Cognitive-Behavioral Therapy (AGCBT) program for the treatment of PPD, for which Breakthrough Device Designation was recently granted by the US Food and Drug Administration. WB001 combines therapeutic alliance, human-centered design, machine learning techniques, and established principles from CBT and interpersonal therapy (IPT). We introduce AGCBT as a new model of service delivery, whilst describing Woebot, the agent technology that enables guidance through the replication of some elements of human relationships. The profile describes the device's design principles, enabling technology, risk handling, and efficacy data in PPD. EXPERT OPINION WB001 is a dynamic and personalized tool with which patients may establish a therapeutic bond. Woebot is designed to augment (rather than replace) human healthcare providers, unlocking the therapeutic potency associated with guidance, whilst retaining the scalability and agency that characterizes self-help approaches. WB001 has the potential to improve both the quality and the scalability of care through providing support to patients on waiting lists, in between clinical encounters, and enabling automation of measurement-based-care.
Collapse
Affiliation(s)
| | | | | | | | | | - Timothy Y Mariano
- Woebot Health, San Francisco, CA, USA
- RR&D Center for Neurorestoration and Neurotechnology, VA Providence Healthcare System, Providence, RI, USA
- Department of Psychiatry and Human Behavior, Warren Alpert Medical School of Brown University, Providence, RI, USA
| | | | | |
Collapse
|
4
|
Pettman D, O'Mahen H, Blomberg O, Svanberg AS, von Essen L, Woodford J. Effectiveness of cognitive behavioural therapy-based interventions for maternal perinatal depression: a systematic review and meta-analysis. BMC Psychiatry 2023; 23:208. [PMID: 36991389 PMCID: PMC10052839 DOI: 10.1186/s12888-023-04547-9] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 05/15/2022] [Accepted: 01/13/2023] [Indexed: 03/31/2023] Open
Abstract
BACKGROUND Depression during the perinatal period (during pregnancy and the year after childbirth) is common and associated with a range of negative effects for mothers, infants, family members, and wider society. Although existing evidence suggests cognitive behavioral therapy (CBT) based interventions are effective for perinatal depression, less is known about the effect of CBT-based interventions on important secondary outcomes, and a number of potential clinical and methodological moderators have not been examined. METHODS A systematic review and meta-analysis primarily examined the effectiveness of CBT-based interventions for perinatal depression on symptoms of depression. Secondary aims examined the effectiveness of CBT-based interventions for perinatal depression on symptoms of anxiety, stress, parenting, perceived social support, and perceived parental competence; and explored clinical and methodological moderators potentially associated with effectiveness. A systematic search of electronic databases and other sources was performed up to November 2021. We included randomized controlled trials comparing CBT-based interventions for perinatal depression with control conditions allowing for the isolation of the effects of CBT. RESULTS In total, 31 studies (5291 participants) were included in the systematic review and 26 studies (4658 participants) were included in the meta-analysis. The overall effect size was medium (hedges g = - 0.53 [95% CI - 0.65 to - 0.40]); with high heterogeneity. Significant effects were also found for anxiety, individual stress, and perceived social support, however few studies examined secondary outcomes. Subgroup analysis identified type of control, type of CBT, and type of health professional as significant moderators of the main effect (symptoms of depression). Some concerns of risk of bias were present in the majority of studies and one study had a high risk of bias. CONCLUSIONS CBT-based interventions for depression during the perinatal period appear effective, however results should be interpreted with caution given high levels of heterogeneity and low quality of included studies. There is a need to further investigate possibly important clinical moderators of effect, including the type of health professional delivering interventions. Further, results indicate a need to establish a minimum core data set to improve the consistency of secondary outcome collection across trials and to design and conduct trials with longer-term follow-up periods. TRIAL REGISTRATION CRD42020152254 .
Collapse
Affiliation(s)
- Danelle Pettman
- Healthcare Sciences and e-Health, Department of Women's and Children's Health, Uppsala University, Uppsala, Sweden
| | - Heather O'Mahen
- Mood Disorders Centre, Department of Psychology, University of Exeter, Exeter, UK
| | - Oscar Blomberg
- Healthcare Sciences and e-Health, Department of Women's and Children's Health, Uppsala University, Uppsala, Sweden
| | - Agneta Skoog Svanberg
- Reproductive Health, Department of Women's and Children's Health, Uppsala University, Uppsala, Sweden
| | - Louise von Essen
- Healthcare Sciences and e-Health, Department of Women's and Children's Health, Uppsala University, Uppsala, Sweden
| | - Joanne Woodford
- Healthcare Sciences and e-Health, Department of Women's and Children's Health, Uppsala University, Uppsala, Sweden.
| |
Collapse
|
5
|
Van Lieshout RJ, Layton H, Savoy CD, Xie F, Brown JSL, Huh K, Bieling PJ, Streiner DL, Ferro MA, Haber-Evans E. In-person 1-day cognitive behavioral therapy-based workshops for postpartum depression: a randomized controlled trial. Psychol Med 2023; 53:1-11. [PMID: 36878891 PMCID: PMC10600825 DOI: 10.1017/s0033291723000454] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 06/16/2022] [Revised: 01/29/2023] [Accepted: 02/06/2023] [Indexed: 03/08/2023]
Abstract
BACKGROUND Postpartum depression (PPD) affects up to one in five mothers and birthing parents, yet as few as 10% access evidence-based treatment. One-day cognitive behavioral therapy (CBT)-based workshops for PPD have the potential to reach large numbers of sufferers and be integrated into stepped models of care. METHODS This randomized controlled trial of 461 mothers and birthing parents in Ontario, Canada with Edinburgh Postnatal Depression Scale (EPDS) scores ⩾10, age ⩾18 years, and an infant <12 months of age compared the effects of a 1-day CBT-based workshop plus treatment as usual (TAU; i.e. care from any provider(s) they wished) to TAU alone at 12-weeks post-intervention on PPD, anxiety, the mother-infant relationship, offspring behavior, health-related quality of life, and cost-effectiveness. Data were collected via REDCap. RESULTS Workshops led to meaningful reductions in EPDS scores (m = 15.77 to 11.22; b = -4.6, p < 0.01) and were associated with three times higher odds of a clinically significant decrease in PPD [odds ratio (OR) 3.00, 95% confidence interval (CI) 1.93-4.67]. Anxiety also decreased and participants had three times the odds of clinically significant improvement (OR 3.20, 95% CI 2.03-5.04). Participants reported improvements in mother-infant bonding, infant-focused rejection and anger, and effortful control in their toddlers. The workshop plus TAU achieved similar quality-adjusted life-years at lower costs than TAU alone. CONCLUSIONS One-day CBT-based workshops for PPD can lead to improvements in depression, anxiety, and the mother-infant relationship and are cost-saving. This intervention could represent a perinatal-specific option that can treat larger numbers of individuals and be integrated into stepped care approaches at reasonable cost.
Collapse
Affiliation(s)
- Ryan J. Van Lieshout
- Department of Psychiatry and Behavioural Neurosciences, McMaster University, Hamilton, Ontario, Canada
| | - Haley Layton
- Health Research Methodology Graduate Program, McMaster University, Hamilton, Ontario, Canada
| | - Calan D. Savoy
- Department of Psychiatry and Behavioural Neurosciences, McMaster University, Hamilton, Ontario, Canada
| | - Feng Xie
- Department of Health Research Methods, Evidence and Impact, McMaster University, Hamilton, Ontario, Canada
| | - June S. L. Brown
- Department of Psychology, Institute of Psychiatry, Psychology and Neuroscience, King's College London, London, UK
| | - Kathryn Huh
- Faculty of Health Sciences, McMaster University, Hamilton, Ontario, Canada
| | - Peter J. Bieling
- Department of Psychiatry and Behavioural Neurosciences, McMaster University, Hamilton, Ontario, Canada
| | - David L. Streiner
- Department of Psychiatry and Behavioural Neurosciences, McMaster University, Hamilton, Ontario, Canada
| | - Mark A. Ferro
- School of Public Health and Health Systems, University of Waterloo, Waterloo, Ontario, Canada
| | - Erika Haber-Evans
- Department of Psychiatry and Behavioural Neurosciences, McMaster University, Hamilton, Ontario, Canada
| |
Collapse
|
6
|
Smith CG, Jones EJH, Wass SV, Jacobs D, Fitzpatrick C, Charman T. The effect of perinatal interventions on parent anxiety, infant socio‐emotional development and parent‐infant relationship outcomes: A systematic review. JCPP ADVANCES 2022. [DOI: 10.1002/jcv2.12116] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/20/2022] Open
Affiliation(s)
- Celia G. Smith
- Institute of Psychiatry, Psychology & Neuroscience King's College London London UK
| | | | | | | | | | - Tony Charman
- Institute of Psychiatry, Psychology & Neuroscience King's College London London UK
| |
Collapse
|
7
|
Verbeke E, Bogaerts A, Nuyts T, Crombag N, Luyten J. Cost-effectiveness of mental health interventions during and after pregnancy: A systematic review. Birth 2022; 49:364-402. [PMID: 35322898 DOI: 10.1111/birt.12623] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 10/22/2020] [Revised: 03/29/2021] [Accepted: 02/04/2022] [Indexed: 11/30/2022]
Abstract
BACKGROUND Mental health problems during and after pregnancy such as depression, anxiety, post-traumatic stress disorder (PTSD), or addiction are common and can have lifelong implications for both parents and offspring. This review investigates the cost-effectiveness of interventions tackling these problems, assesses the methodological quality of included studies, and indicates suggestions for further research. METHODS Thirteen databases were searched for economic evaluations of interventions related to antenatal, perinatal, and postnatal mental health conditions, published between 2000 and September 2021, in high-income countries. RESULTS Thirty-nine studies met all inclusion criteria. Interventions considered were screening programs, pharmacological treatments, and various forms of psychosocial and psychological support. Six studies reported that the intervention was cost-saving. Eighteen were cost-effective and seven likely to be cost-effective. Only six studies included health outcomes for the child; one study considered paternal health. The time horizon for which costs and consequences were considered was for most evaluations limited to 1 year (n = 18) or 2 years (n = 11) postpartum. CONCLUSIONS Given the importance of the subject, a relatively low number of studies have investigated the cost-effectiveness of interventions tackling mental health problems during and after pregnancy. The scant evidence available suggests good overall value for money. Likely, cost-effectiveness is underestimated as costly long-term consequences on offspring are systematically excluded. No evidence was found for several frequently occurring conditions. Further research is required to obtain reliable, long-term effectiveness data and to address the methodological challenges related to measuring all relevant health outcomes for all parties affected.
Collapse
Affiliation(s)
- Evelyn Verbeke
- Department of Public Health and Primary Care, Leuven Institute for Healthcare Policy, KU Leuven, Leuven, Belgium
| | - Annick Bogaerts
- Department of Development & Regeneration, Women & Child, REALIFE research group, Faculty of Medicine, KU Leuven, Leuven, Belgium.,Faculty of Medicine and Health Sciences, Centre for Research and Innovation in Care (CRIC), University of Antwerp, Antwerp, Belgium.,Faculty of Health, University of Plymouth, Devon PL4 8AA, UK
| | - Tinne Nuyts
- Department of Development & Regeneration, Women & Child, REALIFE research group, Faculty of Medicine, KU Leuven, Leuven, Belgium
| | - Neeltje Crombag
- Department of Development and Regeneration, Urogenital, Abdominal and Plastic Surgery, KU Leuven, Leuven, Belgium
| | - Jeroen Luyten
- Department of Public Health and Primary Care, Leuven Institute for Healthcare Policy, KU Leuven, Leuven, Belgium
| |
Collapse
|
8
|
Allen K, Melendez-Torres GJ, Ford T, Bonell C, Finning K, Fredlund M, Gainsbury A, Berry V. Family focused interventions that address parental domestic violence and abuse, mental ill-health, and substance misuse in combination: A systematic review. PLoS One 2022; 17:e0270894. [PMID: 35905105 PMCID: PMC9337671 DOI: 10.1371/journal.pone.0270894] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/07/2021] [Accepted: 06/18/2022] [Indexed: 11/19/2022] Open
Abstract
Parental domestic violence and abuse (DVA), mental ill-health (MH), and substance misuse (SU) are three public health issues that tend to cluster within families, risking negative impacts for both parents and children. Despite this, service provision for these issues has been historically siloed, increasing the barriers families face to accessing support. Our review aimed to identify family focused interventions that have combined impacts on parental DVA, MH, and/or SU. We searched 10 databases (MEDLINE, PsycINFO, Embase, CINAHL, Education Research Information Centre, Sociological Abstracts, Applied Social Sciences Index & Abstracts, ProQuest Dissertations and Theses Global, Web of Science Core Collection, and Cochrane Central Register of Controlled Trials) from inception to July 2021 for randomised controlled trials examining the effectiveness of family focused, psychosocial, preventive interventions targeting parents/carers at risk of, or experiencing, DVA, MH, and/or SU. Studies were included if they measured impacts on two or more of these issues. The Cochrane Risk of Bias Tool 2 was used to quality appraise studies, which were synthesised narratively, grouped in relation to the combination of DVA, MH, and/or SU outcomes measured. Harvest plots were used to illustrate the findings. Thirty-seven unique studies were identified for inclusion. Of these, none had a combined positive impact on all three outcomes and only one study demonstrated a combined positive impact on two outcomes. We also found studies that had combined adverse, mixed, or singular impacts. Most studies were based in the U.S., targeted mothers, and were rated as 'some concerns' or 'high risk' of bias. The results highlight the distinct lack of evidence for, and no 'best bet', family focused interventions targeting these often-clustered risks. This may, in part, be due to the ways interventions are currently conceptualised or designed to influence the relationships between DVA, MH, and/or SU. Trial registration: PROSPERO registration: CRD42020210350.
Collapse
Affiliation(s)
- Kate Allen
- College of Medicine and Health, University of Exeter, Exeter, United Kingdom
| | | | - Tamsin Ford
- Department of Psychiatry, University of Cambridge, Cambridge, United Kingdom
| | - Chris Bonell
- London School of Hygiene and Tropical Medicine, London, United Kingdom
| | - Katie Finning
- College of Medicine and Health, University of Exeter, Exeter, United Kingdom
| | - Mary Fredlund
- College of Medicine and Health, University of Exeter, Exeter, United Kingdom
| | | | - Vashti Berry
- College of Medicine and Health, University of Exeter, Exeter, United Kingdom
| |
Collapse
|
9
|
Howard LM, Abel KM, Atmore KH, Bick D, Bye A, Byford S, Carson LE, Dolman C, Heslin M, Hunter M, Jennings S, Johnson S, Jones I, Taylor BL, McDonald R, Milgrom J, Morant N, Nath S, Pawlby S, Potts L, Powell C, Rose D, Ryan E, Seneviratne G, Shallcross R, Stanley N, Trevillion K, Wieck A, Pickles A. Perinatal mental health services in pregnancy and the year after birth: the ESMI research programme including RCT. PROGRAMME GRANTS FOR APPLIED RESEARCH 2022. [DOI: 10.3310/ccht9881] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/12/2022]
Abstract
Background
It is unclear how best to identify and treat women with mental disorders in pregnancy and the year after birth (i.e. the perinatal period).
Objectives
(1) To investigate how best to identify depression at antenatal booking [work package (WP) 1]. (2) To estimate the prevalence of mental disorders in early pregnancy (WP1). (3) To develop and examine the efficacy of a guided self-help intervention for mild to moderate antenatal depression delivered by psychological well-being practitioners (WP1). (4) To examine the psychometric properties of the perinatal VOICE (Views On Inpatient CarE) measure of service satisfaction (WP3). (5) To examine the clinical effectiveness and cost-effectiveness of services for women with acute severe postnatal mental disorders (WPs 1–3). (6) To investigate women’s and partners’/significant others’ experiences of different types of care (WP2).
Design
Objectives 1 and 2 – a cross-sectional survey stratified by response to Whooley depression screening questions. Objective 3 – an exploratory randomised controlled trial. Objective 4 – an exploratory factor analysis, including test–retest reliability and validity assessed by association with the Client Satisfaction Questionnaire contemporaneous satisfaction scores. Objective 5 – an observational cohort study using propensity scores for the main analysis and instrumental variable analysis using geographical distance to mother and baby unit. Objective 6 – a qualitative study.
Setting
English maternity services and generic and specialist mental health services for pregnant and postnatal women.
Participants
Staff and users of mental health and maternity services.
Interventions
Guided self-help, mother and baby units and generic care.
Main outcome measures
The following measures were evaluated in WP1(i) – specificity, sensitivity, positive predictive value, likelihood ratio, acceptability and population prevalence estimates. The following measures were evaluated in WP1(ii) – participant recruitment rate, attrition and adverse events. The following measure was evaluated in WP2 – experiences of care. The following measures were evaluated in WP3 – psychometric indices for perinatal VOICE and the proportion of participants readmitted to acute care in the year after discharge.
Results
WP1(i) – the population prevalence estimate was 11% (95% confidence interval 8% to 14%) for depression and 27% (95% confidence interval 22% to 32%) for any mental disorder in early pregnancy. The diagnostic accuracy of two depression screening questions was as follows: a weighted sensitivity of 0.41, a specificity of 0.95, a positive predictive value of 0.45, a negative predictive value of 0.93 and a likelihood ratio (positive) of 8.2. For the Edinburgh Postnatal Depression Scale, the diagnostic accuracy was as follows: a weighted sensitivity of 0.59, a specificity of 0.94, a positive predictive value of 0.52, a negative predictive value of 0.95 and a likelihood ratio (positive) of 9.8. Most women reported that asking about depression at the antenatal booking appointment was acceptable, although this was reported as being less acceptable for women with mental disorders and/or experiences of abuse. Cost-effectiveness analysis suggested that both the Whooley depression screening questions and the Edinburgh Postnatal Depression Scale were more cost-effective than with the Whooley depression screening questions followed by the Edinburgh Postnatal Depression Scale or no-screen option. WP1(ii) – 53 women with depression in pregnancy were randomised. Twenty-six women received modified guided self-help [with 18 (69%) women attending four or more sessions] and 27 women received usual care. Three women were lost to follow-up (follow-up for primary outcome: 92%). At 14 weeks post randomisation, women receiving guided self-help reported fewer depressive symptoms than women receiving usual care (adjusted effect size −0.64, 95% confidence interval −1.30 to 0.06). Costs and quality-adjusted life-years were similar, resulting in a 50% probability of guided self-help being cost-effective compared with usual care at National Institute for Health and Care Excellence cost per quality-adjusted life-year thresholds. The slow recruitment rate means that a future definitive larger trial is not feasible. WP2 – qualitative findings indicate that women valued clinicians with specialist perinatal expertise across all services, but for some women generic services were able to provide better continuity of care. Involvement of family members and care post discharge from acute services were perceived as poor across services, but there was also ambivalence among some women about increasing family involvement because of a complex range of factors. WP3(i) – for the perinatal VOICE, measures from exploratory factor analysis suggested that two factors gave an adequate fit (comparative fit index = 0.97). Items loading on these two dimensions were (1) those concerning aspects of the service relating to the care of the mother and (2) those relating to care of the baby. The factors were positively correlated (0.49; p < 0.0001). Total scores were strongly associated with service (with higher satisfaction for mother and baby units, 2 degrees of freedom; p < 0.0001) and with the ‘gold standard’ Client Service Questionnaire total score (test–retest intraclass correlation coefficient 0.784, 95% confidence interval 0.643 to 0.924; p < 0.0001). WP3(ii) – 263 of 279 women could be included in the primary analysis, which shows that the odds of being readmitted to acute care was 0.95 times higher for women who were admitted to a mother and baby unit than for those not admitted to a mother and baby unit (0.95, 95% confidence interval 0.86 to 1.04; p = 0.29). Sensitivity analysis using an instrumental variable found a markedly more significant effect of admission to mother and baby units (p < 0.001) than the primary analysis. Mother and baby units were not found to be cost-effective at 1 month post discharge because of the costs of care in a mother and baby unit. Cost-effectiveness advantages may exist if the cost of mother and baby units is offset by savings from reduced readmissions in the longer term.
Limitations
Policy and service changes had an impact on recruitment. In observational studies, residual confounding is likely.
Conclusions
Services adapted for the perinatal period are highly valued by women and may be more effective than generic services. Mother and baby units have a low probability of being cost-effective in the short term, although this may vary in the longer term.
Future work
Future work should include examination of how to reduce relapses, including in after-care following discharge, and how better to involve family members.
Trial registration
This trial is registered as ISRCTN83768230 and as study registration UKCRN ID 16403.
Funding
This project was funded by the National Institute for Health and Care Research (NIHR) Programme Grants for Applied Research programme and will be published in full in Programme Grants for Applied Research; Vol. 10, No. 5. See the NIHR Journals Library website for further project information.
Collapse
Affiliation(s)
- Louise M Howard
- Section of Women’s Mental Health, Institute of Psychiatry, Psychology and Neuroscience, King’s College London, London, UK
| | - Kathryn M Abel
- Centre for Women’s Mental Health, The University of Manchester, Manchester, UK
| | - Katie H Atmore
- Section of Women’s Mental Health, Institute of Psychiatry, Psychology and Neuroscience, King’s College London, London, UK
| | - Debra Bick
- Division of Women and Children’s Health, Florence Nightingale Faculty of Nursing, Midwifery and Palliative Care, King’s College London, London, UK
| | - Amanda Bye
- Section of Women’s Mental Health, Institute of Psychiatry, Psychology and Neuroscience, King’s College London, London, UK
| | - Sarah Byford
- King’s Health Economics, Institute of Psychiatry, Psychology and Neuroscience, King’s College London, London, UK
| | - Lauren E Carson
- Section of Women’s Mental Health, Institute of Psychiatry, Psychology and Neuroscience, King’s College London, London, UK
| | - Clare Dolman
- Section of Women’s Mental Health, Institute of Psychiatry, Psychology and Neuroscience, King’s College London, London, UK
| | - Margaret Heslin
- King’s Health Economics, Institute of Psychiatry, Psychology and Neuroscience, King’s College London, London, UK
| | - Myra Hunter
- Department of Psychology, Institute of Psychiatry, Psychology and Neuroscience, King’s College London, London, UK
| | - Stacey Jennings
- Section of Women’s Mental Health, Institute of Psychiatry, Psychology and Neuroscience, King’s College London, London, UK
| | - Sonia Johnson
- Division of Psychiatry, University College London, London, UK
| | - Ian Jones
- Institute of Psychological Medicine and Clinical Neuroscience, Cardiff University, Cardiff, UK
| | | | - Rebecca McDonald
- Section of Women’s Mental Health, Institute of Psychiatry, Psychology and Neuroscience, King’s College London, London, UK
| | - Jeannette Milgrom
- Department of Clinical and Health Psychology, Parent–Infant Research Institute, University of Melbourne, Melbourne, VIC, Australia
| | - Nicola Morant
- Division of Psychiatry, University College London, London, UK
| | - Selina Nath
- Section of Women’s Mental Health, Institute of Psychiatry, Psychology and Neuroscience, King’s College London, London, UK
| | - Susan Pawlby
- Department of Psychological Medicine, Institute of Psychiatry, Psychology and Neuroscience, King’s College London, London, UK
| | - Laura Potts
- Biostatistics and Health Informatics, King’s College London, London, UK
| | - Claire Powell
- Section of Women’s Mental Health, Institute of Psychiatry, Psychology and Neuroscience, King’s College London, London, UK
| | - Diana Rose
- Service User Research Enterprise, Institute of Psychiatry, Psychology and Neuroscience, King’s College London, London, UK
| | - Elizabeth Ryan
- Biostatistics and Health Informatics, King’s College London, London, UK
| | | | - Rebekah Shallcross
- Section of Women’s Mental Health, Institute of Psychiatry, Psychology and Neuroscience, King’s College London, London, UK
| | - Nicky Stanley
- School of Social Work, Care and Community, University of Central Lancashire, Harrington, UK
| | - Kylee Trevillion
- Section of Women’s Mental Health, Institute of Psychiatry, Psychology and Neuroscience, King’s College London, London, UK
| | - Angelika Wieck
- Greater Manchester Mental Health NHS Foundation Trust, Manchester, UK
| | - Andrew Pickles
- Biostatistics and Health Informatics, King’s College London, London, UK
| |
Collapse
|
10
|
Lee-Carbon L, Nath S, Trevillion K, Byford S, Howard LM, Challacombe FL, Heslin M. Mental health service use among pregnant and early postpartum women. Soc Psychiatry Psychiatr Epidemiol 2022; 57:2229-2240. [PMID: 35902425 PMCID: PMC9636080 DOI: 10.1007/s00127-022-02331-w] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 01/12/2022] [Accepted: 06/20/2022] [Indexed: 12/02/2022]
Abstract
PURPOSE To explore the proportion and characteristics of women with a mental disorder who have contact with mental health services during pregnancy and the postnatal period in a maternity service in London. METHODS Data from the WEll-being in pregNancy stuDY (WENDY), a prospective cohort study, were used. Women were recruited at their first appointment for antenatal care and assessed for mental disorders using the Structured Clinical Interview DSM-IV Axis I/II Disorders for Research. Clinical, sociodemographic and psychosocial characteristics were collected. Mental health service use data were collected for the period from study entry to 3 months postpartum. RESULTS Two hundred women met diagnostic criteria for a mental disorder. Fifty-five (34%) of these had at least one contact with mental health services. Moderate depression (OR 7.44, CI 2.03-27.28, p < 0.01), severe depression (OR 10.5, CI 2.68-41.12, p < 0.01), past psychiatric hospital admission (OR 3.76, CI 1.05-13.44, p < 0.05), symptoms of anxiety (OR 3.95, CI 1.86-8.37, p < 0.001) and perceived low levels of social support (OR 0.43, CI 0.18-1.01, p = 0.05) were associated with an increased likelihood of contact with mental health services in univariate analyses. However, only moderate (OR 5.92, CI 1.31-26.78, p = 0.02) and severe depression (OR 6.04, CI 1.08-33.72, p = 0.04) remained significant in the multivariate regressions analyses. CONCLUSION Only a third of women with a diagnosable mental disorder at their first antenatal appointment had any contact with mental health services during pregnancy or up to 3 months postpartum. Further research is warranted to elicit perinatal women's views about the potential barriers to accessing professional mental health care.
Collapse
Affiliation(s)
- Leonie Lee-Carbon
- Section of Women’s Mental Health, Institute of Psychiatry, Psychology & Neuroscience, King’s College London, London, UK
| | - Selina Nath
- Section of Women’s Mental Health, Institute of Psychiatry, Psychology & Neuroscience, King’s College London, London, UK ,Population, Policy and Practice Research & Teaching Department, University College London, London, UK
| | - Kylee Trevillion
- Section of Women’s Mental Health, Institute of Psychiatry, Psychology & Neuroscience, King’s College London, London, UK
| | - Sarah Byford
- King’s Health Economics, Institute of Psychiatry, Psychology & Neuroscience, King’s College London, London, UK
| | - Louise M. Howard
- Section of Women’s Mental Health, Institute of Psychiatry, Psychology & Neuroscience, King’s College London, London, UK
| | - Fiona L. Challacombe
- Section of Women’s Mental Health, Institute of Psychiatry, Psychology & Neuroscience, King’s College London, London, UK
| | - Margaret Heslin
- King's Health Economics, Institute of Psychiatry, Psychology & Neuroscience, King's College London, London, UK.
| |
Collapse
|
11
|
Nath S, Lewis LN, Bick D, Demilew J, Howard LM. Mental health problems and fear of childbirth: A cohort study of women in an inner-city maternity service. Birth 2021; 48:230-241. [PMID: 33733519 DOI: 10.1111/birt.12532] [Citation(s) in RCA: 7] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 07/02/2020] [Revised: 01/17/2021] [Accepted: 01/18/2021] [Indexed: 11/27/2022]
Abstract
OBJECTIVES To estimate the population prevalence of severe fear of childbirth (FOC) during pregnancy and investigate its association with: (a) antenatal common mental disorders (depression and anxiety disorder) and (b) elective cesarean birth. METHODS 545 participants from an inner-city London maternity population were interviewed soon after their first antenatal appointment (mean gestation: 14 weeks). Current mental disorders were assessed using the Structured Clinical Interview DSM-IV. FOC was measured using the Wijma Delivery Expectancy/Experience Questionnaire (WDEQ-A) at approximately 28 weeks gestation (n = 377), with severe FOC defined using a cutoff of WDEQ-A ≥ 85. Birth mode information was collected at 3 months post-delivery using an adapted Adult Service Use Schedule. Linear regressions were used to model associations, adjusting for the effects of covariates (age, parity, relationship status, education, and planned pregnancy). Sampling weights were used to adjust for bias introduced by the stratified sampling. We also accounted for missing data within the analysis. RESULTS The estimated population prevalence of severe FOC was 3% (95% CI: 2%-6%) (n = 377). Depression and anxiety were significantly associated with severe FOC after adjustment for covariates (45% vs 11%; coefficient: 15.75, 95% CI: 8.08-23.42, P < .001). There was a weak association between severe FOC and elective cesarean birth. CONCLUSIONS Severe FOC occurs in around 3% of the population. Depression and anxiety are associated with FOC. Pregnant people with depression and anxiety may be at increased risk of experiencing severe FOC. Attitudes toward childbirth should be assessed as part of routine clinical assessment of pregnant people in contact with mental health services.
Collapse
Affiliation(s)
- Selina Nath
- Health Service and Population Research Department, Section of Women's Mental Health, Institute of Psychiatry, Psychology and Neuroscience, King's College London, London, UK
| | - Lucy N Lewis
- Health Service and Population Research Department, Section of Women's Mental Health, Institute of Psychiatry, Psychology and Neuroscience, King's College London, London, UK
| | - Debra Bick
- Warwick Clinical Trials Unit, Warwick Medical School, University of Warwick, Coventry, UK
| | - Jill Demilew
- Women's Health, King's College Hospital NHS Foundation Trust, London, UK
| | - Louise M Howard
- Health Service and Population Research Department, Section of Women's Mental Health, Institute of Psychiatry, Psychology and Neuroscience, King's College London, London, UK
| |
Collapse
|
12
|
Challacombe FL, Nath S, Trevillion K, Pawlby S, Howard LM. Fear of childbirth during pregnancy: associations with observed mother-infant interactions and perceived bonding. Arch Womens Ment Health 2021; 24:483-492. [PMID: 33336315 PMCID: PMC8116271 DOI: 10.1007/s00737-020-01098-w] [Citation(s) in RCA: 10] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 08/25/2020] [Accepted: 12/02/2020] [Indexed: 01/18/2023]
Abstract
Fear of childbirth (FOC) is a common phenomenon that can impair functioning in pregnancy but potential longer term implications for the mother-infant relationship are little understood. This study was aimed at investigating postpartum implications of FOC on the mother-infant relationship. A UK sample of 341 women in a community setting provided data on anxiety, mood and FOC in mid-pregnancy and subsequently completed self-report measures of postnatal bonding in a longitudinal cohort study. Postnatal observations of mother-infant interactions were collected and rated for a subset of 141 women. FOC was associated with maternal perception of impaired bonding, even after controlling for sociodemographic factors, concurrent depression and the presence of anxiety disorders (Coef = 0.10, 95% CI 0.07-0.14, p < 0.001). Observed mother-infant interactions were not associated with FOC (Coef = -0.01-0.03 CI - 0.02 to 0.02, p = 0.46), weakly with concurrent depression (Coef = - 0.10, CI - 0.19 to 0.00, p = 0.06) and not associated with anxiety disorders. The self-efficacy component of FOC was most strongly associated with lower reported bonding (Coef 0.37, 95% CI 0.25-0.49, p < 0.001) FOC makes a distinct contribution to perceived postpartum bonding difficulties but observed mother-infant interaction quality was not affected. This may be due to low self-efficacy impacting psychological adjustment during pregnancy. Targeted interventions during pregnancy focusing both on treatment of key childbirth fears and bonding could help women adjust earlier.
Collapse
Affiliation(s)
- Fiona L Challacombe
- Section of Women's Mental Health, Health Service and Population Research Department, Institute of Psychiatry, Psychology & Neuroscience, King's College London, De Crespigny Park, SE5 8AF, London, UK.
| | - Selina Nath
- Section of Women's Mental Health, Health Service and Population Research Department, Institute of Psychiatry, Psychology & Neuroscience, King's College London, De Crespigny Park, SE5 8AF, London, UK
| | - Kylee Trevillion
- Section of Women's Mental Health, Health Service and Population Research Department, Institute of Psychiatry, Psychology & Neuroscience, King's College London, De Crespigny Park, SE5 8AF, London, UK
| | - Susan Pawlby
- Division of Psychological Medicine, Institute of Psychiatry, Psychology & Neuroscience, King's College London, London, UK
| | - Louise M Howard
- Section of Women's Mental Health, Health Service and Population Research Department, Institute of Psychiatry, Psychology & Neuroscience, King's College London, De Crespigny Park, SE5 8AF, London, UK
| |
Collapse
|
13
|
Challacombe FL, Potts L, Carter B, Lawrence V, Husbands A, Howard LM. Optimising psychological treatment for Anxiety DisordErs in Pregnancy (ADEPT): study protocol for a feasibility trial of time-intensive CBT versus weekly CBT. Pilot Feasibility Stud 2021; 7:101. [PMID: 33931111 PMCID: PMC8085465 DOI: 10.1186/s40814-021-00838-8] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/07/2020] [Accepted: 04/10/2021] [Indexed: 11/10/2022] Open
Abstract
BACKGROUND Moderate to severe anxiety disorders such as obsessive-compulsive disorder (OCD), post-traumatic stress disorder (PTSD), social phobia and panic disorder are common, and affect approximately 11-16% of women in pregnancy. Psychological treatments for anxiety disorders, primarily cognitive behaviour therapy (CBT), have a substantial evidence base and recently time-intensive versions have been found as effective as weekly treatments. However, this has not been trialled in women who are pregnant, where a shorter intervention may be desirable. METHODS The ADEPT study is a feasibility randomised controlled trial with two parallel intervention groups. Time-intensive one-to-one CBT and standard weekly one-to-one CBT delivered during pregnancy will be compared. Feasibility outcomes including participation and follow-up rates will be assessed, alongside the acceptability of the interventions using qualitative methods. DISCUSSION The study will provide preliminary data to inform the design of a full-scale randomised controlled trial of a time-intensive intervention for anxiety during pregnancy. This will include information on the acceptability of time-intensive interventions for pregnant women with anxiety disorders. TRIAL REGISTRATION https://doi.org/10.1186/ISRCTN81203286 prospectively registered 27/6/2019.
Collapse
Affiliation(s)
- Fiona L Challacombe
- Institute of Psychiatry, Psychology & Neuroscience, King's College London, De Crespigny Park, London, SE5 8AF, UK.
| | - Laura Potts
- Institute of Psychiatry, Psychology & Neuroscience, King's College London, De Crespigny Park, London, SE5 8AF, UK
| | - Ben Carter
- Institute of Psychiatry, Psychology & Neuroscience, King's College London, De Crespigny Park, London, SE5 8AF, UK
| | - Vanessa Lawrence
- Institute of Psychiatry, Psychology & Neuroscience, King's College London, De Crespigny Park, London, SE5 8AF, UK
| | - Alaina Husbands
- Institute of Psychiatry, Psychology & Neuroscience, King's College London, De Crespigny Park, London, SE5 8AF, UK
| | - Louise M Howard
- Institute of Psychiatry, Psychology & Neuroscience, King's College London, De Crespigny Park, London, SE5 8AF, UK
| |
Collapse
|
14
|
Abstract
Perinatal mental health has become a significant focus of interest in recent years, with investment in new specialist mental health services in some high-income countries, and inpatient psychiatric mother and baby units in diverse settings. In this paper, we summarize and critically examine the epidemiology and impact of perinatal mental disorders, including emerging evidence of an increase of their prevalence in young pregnant women. Perinatal mental disorders are among the commonest morbidities of pregnancy, and make an important contribution to maternal mortality, as well as to adverse neonatal, infant and child outcomes. We then review the current evidence base on interventions, including individual level and public health ones, as well as service delivery models. Randomized controlled trials provide evidence on the effectiveness of psychological and psychosocial interventions at the individual level, though it is not yet clear which women with perinatal mental disorders also need additional support for parenting. The evidence base on psychotropic use in pregnancy is almost exclusively observational. There is little research on the full range of perinatal mental disorders, on how to improve access to treatment for women with psychosocial difficulties, and on the effectiveness of different service delivery models. We conclude with research and clinical implications, which, we argue, highlight the need for an extension of generic psychiatric services to include preconception care, and further investment into public health interventions, in addition to perinatal mental health services, potentially for women and men, to reduce maternal and child morbidity and mortality.
Collapse
Affiliation(s)
- Louise M. Howard
- Section of Women's Mental Health, Health Service and Population Research DepartmentInstitute of Psychiatry, Psychology and Neuroscience, King's College LondonLondonUK
| | - Hind Khalifeh
- Section of Women's Mental Health, Health Service and Population Research DepartmentInstitute of Psychiatry, Psychology and Neuroscience, King's College LondonLondonUK
| |
Collapse
|