Evaluation of ChatGPT for Pelvic Floor Surgery Counseling

IMPORTANCE

Large language models are artificial intelligence applications that can comprehend and produce human-like text and language. ChatGPT is one such model. Recent advances have increased interest in the utility of large language models in medicine. Urogynecology counseling is complex and time-consuming. Therefore, we evaluated ChatGPT as a potential adjunct for patient counseling.

OBJECTIVE

Our primary objective was to compare the accuracy and completeness of ChatGPT responses to information in standard patient counseling leaflets regarding common urogynecological procedures.

STUDY DESIGN

Seven urogynecologists compared the accuracy and completeness of ChatGPT responses to standard patient leaflets using 5-point Likert scales with a score of 3 being "equally accurate" and "equally complete," and a score of 5 being "much more accurate" and much more complete, respectively. This was repeated 3 months later to evaluate the consistency of ChatGPT. Additional analysis of the understandability and actionability was completed by 2 authors using the Patient Education Materials Assessment Tool. Analysis was primarily descriptive. First and second ChatGPT queries were compared with the Wilcoxon signed rank test.

RESULTS

The median (interquartile range) accuracy was 3 (2-3) and completeness 3 (2-4) for the first ChatGPT query and 3 (3-3) and 4 (3-4), respectively, for the second query. Accuracy and completeness were significantly higher in the second query (P < 0.01). Understandability and actionability of ChatGPT responses were lower than the standard leaflets.

CONCLUSIONS

ChatGPT is similarly accurate and complete when compared with standard patient information leaflets for common urogynecological procedures. Large language models may be a helpful adjunct to direct patient-provider counseling. Further research to determine the efficacy and patient satisfaction of ChatGPT for patient counseling is needed.

Rectovaginal Fistula From Untreated Ulcerative Colitis in Pregnancy: A Case Report and Review of the Literature

Inflammatory bowel disease can have reproductive consequences depending on disease severity at the time of conception and antepartum management. A 37-year-old G1 with ulcerative pancolitis initially did not disclose her medical history to the obstetrics providers. She developed worsening hematochezia and microcytic anemia and declined antepartum treatment of ulcerative colitis. She then developed a rectovaginal fistula, underwent cesarean delivery but declined intraoperative management of the fistula, and started treatment after significant postpartum weight loss. She was ultimately lost to follow-up care. For patients with ulcerative colitis, a multidisciplinary team approach should be utilized to identify barriers to care, prevent disease progression, and optimize pregnancy outcomes. Delivery methods should be individualized to the patient, and further studies are necessary to establish guidelines.