Exploring the Limits of Artificial Intelligence for Referencing Scientific Articles

OBJECTIVE

 To evaluate the reliability of three artificial intelligence (AI) chatbots (ChatGPT, Google Bard, and Chatsonic) in generating accurate references from existing obstetric literature.

STUDY DESIGN

 Between mid-March and late April 2023, ChatGPT, Google Bard, and Chatsonic were prompted to provide references for specific obstetrical randomized controlled trials (RCTs) published in 2020. RCTs were considered for inclusion if they were mentioned in a previous article that primarily evaluated RCTs published by the top medical and obstetrics and gynecology journals with the highest impact factors in 2020 as well as RCTs published in a new journal focused on publishing obstetric RCTs. The selection of the three AI models was based on their popularity, performance in natural language processing, and public availability. Data collection involved prompting the AI chatbots to provide references according to a standardized protocol. The primary evaluation metric was the accuracy of each AI model in correctly citing references, including authors, publication title, journal name, and digital object identifier (DOI). Statistical analysis was performed using a permutation test to compare the performance of the AI models.

RESULTS

 Among the 44 RCTs analyzed, Google Bard demonstrated the highest accuracy, correctly citing 13.6% of the requested RCTs, whereas ChatGPT and Chatsonic exhibited lower accuracy rates of 2.4 and 0%, respectively. Google Bard often substantially outperformed Chatsonic and ChatGPT in correctly citing the studied reference components. The majority of references from all AI models studied were noted to provide DOIs for unrelated studies or DOIs that do not exist.

CONCLUSION

 To ensure the reliability of scientific information being disseminated, authors must exercise caution when utilizing AI for scientific writing and literature search. However, despite their limitations, collaborative partnerships between AI systems and researchers have the potential to drive synergistic advancements, leading to improved patient care and outcomes.

KEY POINTS

· AI chatbots often cite scientific articles incorrectly.. · AI chatbots can create false references.. · Responsible AI use in research is vital..

Preventing posttraumatic stress disorder following childbirth: a systematic review and meta-analysis

OBJECTIVE

Women can develop posttraumatic stress disorder in response to experienced or perceived traumatic, often medically complicated, childbirth; the prevalence of these events remains high in the United States. Currently, no recommended treatment exists in routine care to prevent or mitigate maternal childbirth-related posttraumatic stress disorder. We conducted a systematic review and meta-analysis of clinical trials that evaluated any therapy to prevent or treat childbirth-related posttraumatic stress disorder.

DATA SOURCES

PsycInfo, PsycArticles, PubMed (MEDLINE), ClinicalTrials.gov, CINAHL, ProQuest, Sociological Abstracts, Google Scholar, Embase, Web of Science, ScienceDirect, Scopus, and the Cochrane Central Register of Controlled Trials were searched for eligible trials published through September 2023.

STUDY ELIGIBILITY CRITERIA

Trials were included if they were interventional, if they evaluated any therapy for childbirth-related posttraumatic stress disorder for the indication of symptoms or before posttraumatic stress disorder onset, and if they were written in English.

METHODS

Independent coders extracted the sample characteristics and intervention information of the eligible studies and evaluated the trials using the Downs and Black's quality checklist and Cochrane's method for risk of bias evaluation.

RESULTS

A total of 41 studies (32 randomized controlled trials, 9 nonrandomized trials) were reviewed. They evaluated brief psychological therapies including debriefing, trauma-focused therapies (including cognitive behavioral therapy and expressive writing), memory consolidation and reconsolidation blockage, mother-infant-focused therapies, and educational interventions. The trials targeted secondary preventions aimed at buffering childbirth-related posttraumatic stress disorder usually after traumatic childbirth (n=24), tertiary preventions among women with probable childbirth-related posttraumatic stress disorder (n=14), and primary prevention during pregnancy (n=3). A meta-analysis of the combined randomized secondary preventions showed moderate effects in reducing childbirth-related posttraumatic stress disorder symptoms when compared with usual treatment (standardized mean difference, -0.67; 95% confidence interval, -0.92 to -0.42). Single-session therapy within 96 hours of birth was helpful (standardized mean difference, -0.55). Brief, structured, trauma-focused therapies and semi-structured, midwife-led, dialogue-based psychological counseling showed the largest effects (standardized mean difference, -0.95 and -0.91, respectively). Other treatment approaches (eg, the Tetris game, mindfulness, mother-infant-focused treatment) warrant more research. Tertiary preventions produced smaller effects than secondary prevention but are potentially clinically meaningful (standardized mean difference, -0.37; -0.60 to -0.14). Antepartum educational approaches may help, but insufficient empirical evidence exists.

CONCLUSION

Brief trauma-focused and non-trauma-focused psychological therapies delivered early in the period following traumatic childbirth offer a critical and feasible opportunity to buffer the symptoms of childbirth-related posttraumatic stress disorder. Future research that integrates diagnostic and biologic measures can inform treatment use and the mechanisms at work.

A scoping review of therapies used to treat psychological trauma post perinatal bereavement

BACKGROUND

Up to 39% of women who experience perinatal bereavement proceed to develop Post-Traumatic-Stress-Disorder (PTSD), with this large proportion meriting treatment. Before setting-up a treatment service for postnatal women who are experiencing psychological trauma, it is important to identify what therapies have been used in-the-past to address this problem.

AIM

To scope for research that has implemented therapies to treat psychological trauma post perinatal bereavement, for potential inclusion in a flexible treatment package.

METHOD

A scoping review mapped coverage, range, and type of research that has reported on prior therapies used to treat psychological trauma post perinatal bereavement.

FINDINGS

Due to the dearth of papers that directly addressed perinatal bereavement, we widened the scope of the review to view what treatments had been used to treat psychological trauma post-childbirth. Out of 23 studies that report on effectiveness of therapies used to treat psychological trauma post-childbirth, only 4-focused upon treating PTSD post perinatal bereavement (3 effective/1 ineffective). Successful treatments were reported by Kersting et al. (2013), who found CBT effective at reducing PTSD symptoms post-miscarriage, termination for medical reasons, and stillbirth (n = 33 & n = 115), and Navidian et al. (2s017)) found that 4-sessions of grief-counselling reduced trauma symptoms post-stillbirth in (n = 50) women. One study by Huberty et al. (2020found on-line yoga to be ineffective at reducing PTSD symptoms post-stillbirth.

CONCLUSIONS

A dearth of research has explored effectiveness of therapies for treating psychological trauma post perinatal bereavement and post-childbirth, with need to develop and test a research informed flexible counselling package.

Effect of psychological interventions on mental health, personal relationships and quality of life of women who have subjectively experienced traumatic childbirth

BACKGROUND

No targeted review has assessed the effect of psychological interventions on the mental health, personal relationships, and the quality of life of women who have subjectively experienced traumatic childbirth.

METHODS

Eight databases were searched from inception to January 2023. Study selection, data extraction, quality appraisal, and data analysis were conducted by two researchers independently.

RESULTS

In total, eight studies were included. The results indicated that psychological interventions could effectively alleviate post-traumatic stress disorder (PTSD) symptoms, depression, and anxiety in women who have subjectively experienced traumatic childbirth. The interventions were more effective in alleviating PTSD symptoms than depression or anxiety. The subgroup analysis results showed that the effect of multiple sessions might be better than that of a single session. There was insufficient evidence supporting the effect of psychological interventions to improve personal relationships and the quality of life.

LIMITATIONS

Study limitations included the small number of studies included for meta-analysis, substantial heterogeneity, and the retrieval of only studies written in English or Chinese.

CONCLUSIONS

Psychological intervention is a promising method for the mental health of women who have subjectively experienced traumatic childbirth, but more studies are needed to confirm the effects. More studies are also required to explore the impact of psychological interventions on personal relationships and the quality of life. Future studies should focus on comparing which specific type of psychological intervention is most effective. Additional investigations should include the potential adverse effects and long-term effects of psychological interventions and details, such as content, process, and timing.

Can psychological interventions prevent or reduce risk for perinatal anxiety disorders? A systematic review and meta-analysis

OBJECTIVE

Little is known about the extent to which interventions can prevent perinatal anxiety disorders. We conducted a systematic review and meta-analysis to examine whether interventions can decrease the onset and symptoms of perinatal anxiety among individuals without an anxiety disorder diagnosis.

METHOD

We conducted a comprehensive literature search across five databases related to key concepts: (1) anxiety disorders/anxiety symptom severity (2) perinatal (3) interventions (4) prevention. We included studies that examined a perinatal population without an anxiety disorder diagnosis, included a comparator group, and assessed perinatal anxiety. We included interventions focused on perinatal anxiety as well as interventions to prevent perinatal depression or influence related outcomes (e.g., physical activity).

RESULTS

Thirty-six studies were included. No study assessing the incidence of perinatal anxiety disorder (n = 4) found a significant effect of an intervention. Among studies assessing anxiety symptom severity and included in the quantitative analysis (n = 30), a meta-analysis suggested a small standardized mean difference of -0.31 (95% CI [-0.46, -0.16], p < .001) for anxiety at post intervention, favoring the intervention group. Both mindfulness (n = 6), and cognitive behavioral therapy approaches (n = 10) were effective.

CONCLUSIONS

Interventions developed for perinatal anxiety were more effective than interventions to prevent perinatal depression. Psychological interventions show promise for reducing perinatal anxiety symptom severity, though interventions specifically targeting anxiety are needed.

A Systematic Review of Interventions for Prevention and Treatment of Post-Traumatic Stress Disorder Following Childbirth

Objective

Postpartum women can develop post-traumatic stress disorder (PTSD) in response to complicated, traumatic childbirth; prevalence of these events remains high in the U.S. Currently, there is no recommended treatment approach in routine peripartum care for preventing maternal childbirth-related PTSD (CB-PTSD) and lessening its severity. Here, we provide a systematic review of available clinical trials testing interventions for the prevention and indication of CB-PTSD.

Data Sources

We conducted a systematic review of PsycInfo, PsycArticles, PubMed (MEDLINE), ClinicalTrials.gov, CINAHL, ProQuest, Sociological Abstracts, Google Scholar, Embase, Web of Science, ScienceDirect, and Scopus through December 2022 to identify clinical trials involving CB-PTSD prevention and treatment.

Study Eligibility Criteria

Trials were included if they were interventional, evaluated CB-PTSD preventive strategies or treatments, and reported outcomes assessing CB-PTSD symptoms. Duplicate studies, case reports, protocols, active clinical trials, and studies of CB-PTSD following stillbirth were excluded.

Study Appraisal and Synthesis Methods

Two independent coders evaluated trials using a modified Downs and Black methodological quality assessment checklist. Sample characteristics and related intervention information were extracted via an Excel-based form.

Results

A total of 33 studies, including 25 randomized controlled trials (RCTs) and 8 non-RCTs, were included. Trial quality ranged from Poor to Excellent. Trials tested psychological therapies most often delivered as secondary prevention against CB-PTSD onset (n=21); some examined primary (n=3) and tertiary (n=9) therapies. Positive treatment effects were found for early interventions employing conventional trauma-focused therapies, psychological counseling, and mother-infant dyadic focused strategies. Therapies' utility to aid women with severe acute traumatic stress symptoms or reduce incidence of CB-PTSD diagnosis is unclear, as is whether they are effective as tertiary intervention. Educational birth plan-focused interventions during pregnancy may improve maternal health outcomes, but studies remain scarce.

Conclusions

An array of early psychological therapies delivered in response to traumatic childbirth, rather than universally, in the first postpartum days and weeks, may potentially buffer CB-PTSD development. Rather than one treatment being suitable for all, effective therapy should consider individual-specific factors. As additional RCTs generate critical information and guide recommendations for first-line preventive treatments for CB-PTSD, the psychiatric consequences associated with traumatic childbirth could be lessened.

Do antenatal preparation and obstetric complications and procedures interact to affect birth experience and postnatal mental health?

BACKGROUND

Antenatal preparation is commonly offered to women in pregnancy in the United Kingdom, but the content is highly variable, with some programmes orientated towards 'normal birth', whilst others may incorporate information about complications and procedures (broader focus). However, the impact of this variability on birth experience has not been explored. We examined the relationship between the content of antenatal preparation received and birth experience, taking into account obstetric complications and procedures. As birth experience can have a profound impact on a mother's postnatal well-being, we also investigated associations with mothers' postnatal mood and anxiety.

METHODS

N = 253 first-time mothers completed a cross-sectional survey measuring demographic and clinical factors, antenatal preparation content (categorised as normality-focused or broader-focused), obstetric complications and procedures experienced, birth experience (measured using three separate indices; the Childbirth Experience Questionnaire, emotional experiences, and presence/absence of birth trauma), postnatal depression and anxiety, and qualitative information on how the COVID-19 pandemic had affected birth experience.

RESULTS

Regarding birth experience, receiving more broader-focused preparation was associated with a more positive birth experience irrespective of complications/procedures experienced, while receiving only normality-focused preparation was beneficial in the context of fewer complications/procedures. Regarding birth trauma, receiving more broader-focused preparation was associated with lower likelihood of reporting birth as traumatic only in the context of more complications/procedures. Degree of normality-focused preparation was unrelated to experience of birth trauma. Lastly, while more complications/procedures were associated with greater anxiety and low mood, only greater normality-focused preparation was linked with better postnatal mental health.

CONCLUSIONS

Antenatal preparation including both normality- and broader-focused information is positively related to women's birth experience. While normality-focused preparation seems most beneficial if fewer complications/procedures are experienced, broader-focused preparation may be most beneficial in the context of a greater number of complications/procedures. As complications/procedures are often unpredictable, offering broader-focused preparation routinely is likely to benefit women's birth experience. This antenatal preparation should be freely available and easily accessible.

Effectiveness of Psychological Interventions to Improve the Mental Well-Being of Parents Who Have Experienced Traumatic Childbirth: A Systematic Review and Meta-Analysis

Considering the adverse impact that traumatic childbirth experiences can have on parental mental well-being, studies that have investigated the potential of providing postnatal psychological support for this group of parents require evaluation. This systematic review aimed to examine the effectiveness of psychological interventions at improving the mental well-being of parents who have experienced traumatic childbirth in terms of anxiety, depression, fear of childbirth, and post-traumatic stress disorder (PTSD) symptoms. Seven electronic databases were searched from their respective inception dates up to January 2021. Only quantitative studies that reported the effects of psychological interventions on anxiety, depression, fear of childbirth, and/or PTSD symptoms in selective (at risk of traumatic childbirth experience) or indicated (self-defined childbirth experience as traumatic for any reason) populations of parents (mothers and/or fathers) were included. Eight studies were included and meta-analyses were conducted using a random-effect model. All studies were conducted on mothers only, and one study had minimal father involvement. Results showed that psychological interventions were more effective in reducing fear of childbirth and improving PTSD symptoms compared to anxiety and depression. Greater improvement in depression was reported at 3-8 weeks' follow-up than at immediate post-intervention. Subgroup analyses showed that technology-based interventions were feasible, and indicated interventions were more effective than selective interventions. Conducting future interventions in more geographical regions, engaging and including fathers more actively, incorporating both personalized professional therapy and informal peer support, striving for flexibility and convenience, as well as addressing topics on self-doubt and coping skills can improve current interventions.

Early psychological interventions for prevention and treatment of post-traumatic stress disorder (PTSD) and post-traumatic stress symptoms in post-partum women: A systematic review and meta-analysis

Background

Pre-term or full-term childbirth can be experienced as physically or psychologically traumatic. Cumulative and trans-generational effects of traumatic stress on both psychological and physical health indicate the ethical requirement to investigate appropriate preventative treatment for stress symptoms in women following a routine traumatic experience such as childbirth.

Objective

The objective of this review was to investigate the effectiveness of early psychological interventions in reducing or preventing post-traumatic stress symptoms and post-traumatic stress disorder in post-partum women within twelve weeks of a traumatic birth.

Methods

Randomised controlled trials and pilot studies of psychological interventions preventing or reducing post-traumatic stress symptoms or PTSD, that included women who had experienced a traumatic birth, were identified in a search of Cochrane Central Register of Randomised Controlled Trials, MEDLINE, Embase, Psychinfo, PILOTS, CINAHL and Proquest Dissertations databases. One author performed database searches, verified results with a subject librarian, extracted study details and data. Five authors appraised extracted data and agreed upon risk of bias. Analysis was completed with Rev Man 5 software and quality of findings were rated according to Grading of Recommendation, Assessment, Development, and Evaluation.

Results

Eleven studies were identified that evaluated the effectiveness of a range of early psychological interventions. There was firm evidence to suggest that midwifery or clinician led early psychological interventions administered within 72 hours following traumatic childbirth are more effective than usual care in reducing traumatic stress symptoms in women at 4–6 weeks. Further studies of high methodological quality that include longer follow up of 6–12 months are required in order to substantiate the evidence of the effectiveness of specific face to face and online early psychological intervention modalities in preventing the effects of stress symptoms and PTSD in women following a traumatic birth before introduction to routine care and practice.

Prospero registration

CRD42020202576, https://www.crd.york.ac.uk/prospero/display_record.php?RecordID=202576

Number and quality of randomized controlled trials in obstetrics published in the top general medical and obstetrics and gynecology journals

BACKGROUND

There has been an increasing number of randomized controlled trials published in obstetrics and maternal-fetal medicine to reduce biases of treatment effect and to provide insights on the cause-effect of the relationship between treatment and outcomes.

OBJECTIVE

This study aimed to identify obstetrical randomized controlled trials published in top weekly general medical journals and monthly obstetrics and gynecology journals, to assess their quality in reporting and identify factors associated with publication in different journals.

STUDY DESIGN

The 4 weekly medical journals with the highest 2019 impact factor (New England Journal of Medicine, The Lancet, The Journal of the American Medical Association, and British Medical Journal), the top 4 monthly obstetrics and gynecology journals with obstetrics-related research (American Journal of Obstetrics & Gynecology, Ultrasound in Obstetrics & Gynecology, Obstetrics & Gynecology, and the British Journal of Obstetrics and Gynaecology), and the American Journal of Obstetrics & Gynecology Maternal-Fetal Medicine were searched for obstetrical randomized controlled trials in the years 2018 to 2020. The primary outcome was the number of obstetrical randomized controlled trials published in the obstetrics and gynecology journals vs the weekly medical journals and the percentage of trials published, overall and per journal. The secondary outcomes included the proportion of positive vs negative trials overall and per journal and the assessment of the study characteristics of published trials, including quality assessment criteria.

RESULTS

Of the 4024 original research articles published in the 9 journals during the 3-year study period, 1221 (30.3%) were randomized controlled trials, with 137 (11.2%) randomized controlled trials being in obstetrics (46 in 2018, 47 in 2019, and 44 studies in 2020). Furthermore, 33 (24.1%) were published in weekly medical journals, and 104 (75.9%) were published in obstetrics and gynecology journals. The percentage of obstetrical randomized controlled trials published ranged from 1.5% to 9.6% per journal. Overall, 34.3% of obstetrical trials were statistically significant or "positive" for the primary outcome. Notably, 24.8% of the trials were retrospectively registered after the enrollment of the first study patient. Trials published in the 4 weekly medical journals enrolled significantly more patients (1801 vs 180; P<.001), received more often funding from the federal government (78.8% vs 35.6%; P<.001), and were more likely to be multicenter (90.9% vs 42.3%; P<.001), non-United States based (69.7% vs 49.0%; P=.03), and double blinded (45.5% vs 18.3%; P=.003) than trials published in the obstetrics and gynecology journals. There was no difference in study type (noninferiority vs superiority) and trial quality characteristics, including pretrial registration, ethics approval statement, informed consent statement, and adherence to the Consolidated Standards of Reporting Trials guidelines statement between studies published in weekly medical journals and studies published in obstetrics and gynecology journals.

CONCLUSION

Approximately 45 trials in obstetrics are being published every year in the highest impact journals, with one-fourth being in the weekly medical journals and the remainder in the obstetrics and gynecology journals. Only about a third of published obstetrical trials are positive. Trials published in weekly medical journals are larger, more likely to be funded by the government, multicenter, international, and double blinded. Quality metrics are similar between weekly medical journals and obstetrics and gynecology journals.

Women's Experiences of the Coping With Birth Trauma:A Psychoeducational Group Support Program

OBJECTIVE

Between 20%-50% of women experience birth as traumatic, with negative impacts for women, infants and families. Currently, there is a lack of evidence into supportive interventions to ameliorate women's adverse responses following a traumatic birth. In North-West UK, a 6-week psychoeducation group support program (Coping with Birth Trauma [CwBT]) was developed and delivered by two trained therapists. The course aimed to facilitate women's understanding of trauma, and to provide coping strategies; additional speakers were also invited to discuss specialist issues. The aim of this evaluation was to explore women's experiences and perceptions of the CwBT, and to identify recommendations for course development.

METHODS

Following university ethics approval, all the women who had attended a CwBT course (n = 3) were invited to take part in a telephone interview. Eight women out of a possible sample of 16 agreed to participate. Thematic analysis was used to analyse the interview data.

RESULTS

Two themes and associated sub-themes describe the social, cognitive and instrumentalcomponents of the CwBT course (“Creating a difference”) and how the course facilitated growth and help-seeking behaviors (“Growth and renewal”). The final theme “complaints and recommendations” details critical reflections and suggestions for course development. Recommendations included speakers from different therapeutic backgrounds and more opportunities for contact with women at different stages of their trauma journey.

CONCLUSIONS

Overall, the course was well received with positive implications for health, wellbeing and family functioning. Further and large-scale studies to assess its effectiveness are needed.

The birth trauma psychological therapy service: An audit of outcomes

OBJECTIVE

To evaluate routinely collected service data from a 'Birth Trauma' psychology clinic integrated into maternity services, in order to review effectiveness for women with symptoms of Post-Traumatic Stress Disorder (PTSD) following childbirth.

BACKGROUND

Prevalence of PTSD after child-birth has been estimated to be around 3% for women meeting full diagnostic criteria and up to 9% for sub-threshold symptoms. This can occur even in response to deliveries considered to be medically straightforward. NICE guidelines (2018) recommend psychological therapy as a first line treatment for symptoms of PTSD.

METHODS

The sample included 114 women referred post-natally for psychological assessment and intervention following a traumatic birth experience. Measures were routinely administered as part of initial assessment (T1) and at completion of intervention (T2). Data from these measures were collated and analyzed using a series of paired sample t tests. Following assessment 101 women were taken on for psychological intervention and of these, 74 completed both T1 and T2 measures.

RESULTS

There were highly significant reductions across all measures of PTSD, anxiety and negative mood symptoms. The treatment effect sizes were very large. Mean total score on a measure of PTSD symptomatology was no longer clinically significant following interventions.

CONCLUSION

This evaluation suggests an integrated Birth Trauma psychology clinic using a small number of contact sessions is a highly efficient and effective model of care for women experiencing symptoms of PTSD following childbirth.