The accessibility, readability, and quality of online resources for gender affirming surgery

Validation of ChatGPT 3.5 as a Tool to Optimize Readability of Patient-facing Craniofacial Education Materials

Background

To address patient health literacy, the American Medical Association recommends that readability of patient education materials should not exceed a sixth grade reading level; the National Institutes of Health recommend no greater than an eigth-grade reading level. However, patient-facing materials in plastic surgery often remain at an above-recommended average reading level. The purpose of this study was to evaluate ChatGPT 3.5 as a tool for optimizing patient-facing craniofacial education materials.

Methods

Eighteen patient-facing craniofacial education materials were evaluated for readability by a traditional calculator and ChatGPT 3.5. The resulting scores were compared. The original excerpts were then inputted to ChatGPT 3.5 and simplified by the artificial intelligence tool. The simplified excerpts were scored by the calculators.

Results

The difference in scores for the original excerpts between the online calculator and ChatGPT 3.5 were not significant (P = 0.441). Additionally, the simplified excerpts' scores were significantly lower than the originals (P < 0.001), and the mean of the simplified excerpts was 7.78, less than the maximum recommended 8.

Conclusions

The use of ChatGPT 3.5 for simplification and readability analysis of patient-facing craniofacial materials is efficient and may help facilitate the conveyance of important health information. ChatGPT 3.5 rendered readability scores comparable to traditional readability calculators, in addition to excerpt-specific feedback. It was also able to simplify materials to the recommended grade levels. With human oversight, we validate this tool for readability analysis and simplification.

A multimetric health literacy analysis of online gender affirmation surgery materials: From facial to genital surgery

BACKGROUND

The transgender patient population is expanding, and gender affirming surgery (GAS) volume is increasing. Accurate, comprehensive, and easily navigable resources on GAS are lacking. We aim to evaluate the readability of online materials for specific gender affirming surgical procedures to identify mechanisms of improving information access for transgender patients.

MATERIALS AND METHODS

"Facial feminization", "facial masculinization", "MTF breast augmentation", "FTM chest masculinization", "MTF vaginoplasty", "metoidioplasty", and "FTM phalloplasty" were searched on Google. Per keyword, the first 75 text-containing results were included. Text was analyzed for reading difficulty using the Flesch-Kincaid Reading-Ease (FKRE) test and grade level using the Flesch-Kincaid Grade Level (FKGL) formula, Gunning Fog Index (GFI), Simple Measure of Gobbledygook (SMOG), and Coleman-Liau Index (CLI). Scores were compared using independent t-and ANOVA tests (α = 0.05).

RESULTS

Mean readability scores (FKRE 37.44) and grade-levels (FKGL 12.87, GFI 15.61, SMOG 11.91, CLI 15.00) correlated with college-level difficulty. Masculinizing surgical materials were more difficult to read than feminizing ones (p ≤ 0.023). Top surgery materials were easier to read than facial and genital surgery materials (p ≤ 0.013). Specifically, chest masculinization resources were more difficult to read than those for breast augmentation (p ≤ 0.006). No differences were found between facial feminization and masculinization surgery resources, nor between resources for different gender affirming genital surgeries.

CONCLUSION

Online GAS materials are written above the recommended 6th grade reading-level, with resources for transgender men being significantly more challenging to understand. Improving readability of online resources can help overcome barriers to care for the transgender patient population.

Quality Assessment of Online Resources for Gender-affirming Surgery

Background

As visibility of the transgender patient population and utilization of online resources increases, it is imperative that web-based gender-affirming surgery (GAS) materials for patients are readable, accessible, and of high quality.

Methods

A search trends analysis was performed to determine frequency of GAS-related searches over time. The top 100 most common results for GAS-related terms were analyzed using six readability formulas. Accessibility of patient-facing GAS sources was determined by categorizing types of search results. Frequency of article types was compared in low- and high-population dense areas. Quality was assigned to GAS web-based sources using the DISCERN score.

Results

Search engine trend data demonstrates increasing occurrence of searches related to GAS. Readability scores of the top 100 online sources for GAS were discovered to exceed recommended levels for patient proficiency. Availability of patient-facing online information related to GAS was found to be 60%, followed by information provided by insurance companies (17%). Differences in availability of online resources in varying dense cities were found to be minimal. The average quality of sources determined by the DISCERN score was found to be 3, indicating "potential important shortcomings."

Conclusions

Despite increasing demand for web-based GAS information, the readability of online resources related to GAS was found to be significantly greater than the grade level of proficiency recommended for patients. A high number of nonpatient-facing search results appear in response to GAS search terms. Quality sources are still difficult for patients to find, as search results have a high incidence of low-quality resources.

Quality and Readability of Accessible Facial Feminization Literature: Where Can We Improve?

BACKGROUND

Facial feminization surgery (FFS) consists of multiple, complex procedures. Well-informed patients have been shown to have better outcomes and expectations. However, there is limited data evaluating FFS patient-oriented material online. This study aims to evaluate the quality and readability of FFS literature online.

METHODS

Facial feminization surgery-related terms were queried in Google with location, cookies, and user account information disabled. Websites were analyzed for readability using Flesch Reading Ease and Flesch-Kincaid Reading Grade Level, suitability using the suitability assessment of materials (SAM), and quality using the DISCERN scale. Unpaired t tests and χ2 tests were used to compare the websites of community-based and academic or public institutions.

RESULTS

One hundred twenty websites met inclusion criteria (71 community-based and 49 academic). The average reading grade level was 11.68 ± 1.71. The average SAM score was 53.11 ± 11.75, denoting adequate readability. Only 16.67% of websites contained visual aids to assist in explaining procedures and benefits. Overall, 68.33% of websites' DISCERN score was rated very poor or poor, whereas only 8.33% were rated as good. The following DISCERN elements had the lowest scores across all graded websites: "clear source and date of information," "details of additional source of support," "refers to areas of uncertainty," and "describes risks of each treatment." Websites published by community-based institutions were significantly better in describing how FFS works and the benefits of each procedure. Academic sites overall were less biased (4.84 vs 4.62, P = 0.03) and provided additional sources of support (2.35 vs 1.32, P = <0.001).

CONCLUSIONS

Online FFS patient resources should be written at a more inclusive reading level and should increase the use of pictorial aids to improve patient comprehension. Facial feminization surgery patient resources were significantly above the recommended sixth grade reading level for health literature. Academic and community-based institutions should include more information about procedural risks and limitations in surgical outcomes to ensure a broader scope of understanding.

Patient education information material assessment criteria: A scoping review

BACKGROUND

Patient education information material (PEIM) is an essential component of patient education programs in increasing patients' ability to cope with their diseases. Therefore, it is essential to consider the criteria that will be used to prepare and evaluate these resources.

OBJECTIVE

This paper aims to identify these criteria and recognize the tools or methods used to evaluate them.

METHODS

National and international databases and indexing banks, including PubMed, Scopus, Web of Science, ProQuest, the Cochrane Library, Magiran, SID and ISC, were searched for this review. Original or review articles, theses, short surveys, and conference papers published between January 1990 and June 2022 were included.

RESULTS

Overall, 4688 documents were retrieved, of which 298 documents met the inclusion criteria. The criteria were grouped into 24 overarching criteria. The most frequently used criteria were readability, quality, suitability, comprehensibility and understandability.

CONCLUSION

This review has provided empirical evidence to identify criteria, tools, techniques or methods for developing or evaluating a PEIM. The authors suggest that developing a comprehensive tool based on these findings is critical for evaluating the overall efficiency of PEIM using effective criteria.

Readability Analysis and Accessibility of Online Materials About Transgender Voice Care

OBJECTIVE

To determine readability, understandability, and actionability of online health information related to transgender voice care.

STUDY DESIGN

Review of online materials.

SETTING

Academic medical center.

METHODS

A Google search of "transgender voice care" was performed with the first 50 websites meeting inclusion criteria included. Readability was assessed using the Flesch Reading Ease Score (FRES), Flesch-Kincaid Grade Level (FKGL), and the Simple Measure of Gobbledygook (SMOG). Understandability and actionability were measured by 2 independent reviewers using the Patient Education Materials Assessment Tool for Printable Materials (PEMAT-P). Unpaired t tests were used to compare clinician- and patient-oriented sites, surgical and nonsurgical sites, and sites that discuss nonbinary indications for voice care. Analysis of variance was used to compare sites that discuss voice feminization, masculinization, both, or neither.

RESULTS

Average scores across the cohort for FRES, FKGL, and SMOG were 43.77 ± 13.52, 12.14 ± 2.66, and 11.30 ± 1.93, respectively, indicating materials were above a 12th-grade reading level. PEMAT-P scores for understandability and actionability were 64.95% ± 15.78% and 40.55% ± 23.86%, respectively. Patient-oriented sites were significantly more understandable and actionable than clinician-oriented sites (P < .02). Websites that discussed only voice feminization were significantly more readable according to objective metrics (FKGL, SMOG) than websites that discussed both feminization and masculinization or those that did not differentiate care types (P < .05).

CONCLUSION

Online information written about transgender voice care is written at a level above what is recommended for patient education materials. Providers may improve accessibility of transgender voice care by enhancing readability of online materials.

Recognizing Racial Disparities in Postoperative Outcomes of Gender Affirming Surgery

Purpose: Given the increasing frequency with which gender affirming surgery (GAS) is performed, understanding risk factors for poor outcomes is imperative. Recent investigations highlight inferior health outcomes experienced by Black transgender and gender expansive (TGE) individuals. Herein, we evaluate the relationship between race and postoperative outcomes in TGE patients undergoing GAS, utilizing the American College of Surgeons National Surgical Quality Improvement Program (ACS NSQIP). Methods: We conducted a retrospective review of ACS NSQIP from 2010 to 2018. Patients with a primary diagnosis of gender dysphoria undergoing GAS were identified and grouped by race. Patient characteristics and 30-day postoperative outcomes were recorded. Univariate analysis was used to compare patient characteristics and postoperative outcomes across groups. Multivariate logistic regression was used to determine independent predictors of complications. Results: We included 2308 patients (1780 White, 419 Black, 109 Asian). Gender, body mass index, smoking status, and type of surgery performed differed significantly between groups (p < 0.001). Univariate analysis revealed significant differences in 30-day readmission and organ space surgical site infection (SSI) across groups (p = 0.03). Multivariate logistic regression, adjusted for confounders, revealed that Black patients had higher odds of reoperation (odds ratio [OR] 1.82, p = 0.047), 30-day readmission (OR 2.46, p = 0.003), and organ space SSI (OR 4.65, p = 0.024) than White patients. Conclusion: We found that race was an independent predictor of important short-term postoperative outcomes in GAS. Inclusive clinical research, effective engagement with the TGE community, and surgery-specific enhanced recovery after surgery protocols may help address disparities, but we must acknowledge race as a social determinant of health.

Health Literacy in Plastic Surgery: A Scoping Review

Health literacy of plastic surgery patients may affect surgical decision-making and perioperative outcomes. In addition to consulting a plastic surgeon, patients often refer to online-based resources to learn about surgical options. The aim of this scoping review was to identify evidence detailing the state of health literacy of plastic surgery patients and available resources to highlight areas of improvement for clinical practice and future research.

Telemedicine for Gender-Affirming Medical and Surgical Care: A Systematic Review and Call-to-Action

Telemedicine has facilitated the delivery of affordable and accessible health care. However, little has been discussed about its use in gender-affirming care (GAC). Telemedicine has the potential to overcome many barriers encountered by transgender individuals such as limited geographic access to care and financial constraints, which have both been exacerbated by the COVID-19 pandemic. Telemedicine may also enhance opportunities for training in gender-affirming surgery. A systematic review of the literature on telehealth and GAC was performed. Identified uses of telehealth included: an electronic teleconsultation service, a virtual peer health consultation service, and an open online course on LGBT+ rights and health care for health care providers and laypeople. As the medical and health care communities adjust to the new reality of health care, efforts should be made to effectively incorporate telemedicine into GAC.

A Multimetric Readability Analysis of Online Patient Educational Materials for Submental Fat Reduction

Background

Patients often utilize the Internet to seek information related to their care. This study assesses the readability of online patient educational materials for submental fat reduction.

Methods

Patient educational materials from the 12 most popular websites related to submental fat reduction were downloaded and assessed for readability grade level using 10 unique scales.

Results

Analysis of the 12 most popular websites (and corresponding 47 articles) revealed that patient educational materials were written, on average, at an 11th grade reading level. The Flesch Reading Ease score was 48.9 (range 39.8–59.2), representing a “difficult” level of reading. Mean readability grade levels (range 9–13th grade for individual websites) were as follows: Coleman-Liau, 11.1; Flesch-Kincaid, 10.8; FORCAST, 10.8; Fry Graph, 10.1; Gunning Fog, 12.7; New Dale-Chall, 10.1; New Fog Count, 11.8; Simple Measure of Gobbledygook, 11.7; Raygor, 6.7. No website was at the 6th grade reading level for patient educational materials recommended by the American Medical Association and National Institutes of Health.

Conclusions

Online patient educational materials for submental fat reduction are written well above the recommended reading level. Recognition of disparities in health literacy is necessary to enable patients to make informed decisions and become active participants in their own care.

Level of Evidence V

This journal requires that authors assign a level of evidence to each article. For a full description of these Evidence-Based Medicine ratings, please refer to the Table of Contents or the online Instructions to Authors  www.springer.com/00266

Readability and Quality Assessment of Online Materials for Syndactyly Release

Syndactyly is one of the most common congenital hand malformations, involving an abnormal fusion of digits and with treatment varying according to its complexity. The internet has become a primary source of information for both families and patients with congenital hand anomalies. The purpose of this study was to evaluate both the readability and quality of available web content for syndactyly, using validated instruments.

A Systematic Review of Health Disparities Research in Plastic Surgery

BACKGROUND

In this systematic review, the authors report on the current state of health disparities research in plastic surgery and consider how equity-oriented interventions are taking shape at the patient, provider, and health care system levels.

METHODS

The authors performed a systematic literature search of the PubMed/MEDLINE and Embase databases using search terms related to the social determinants of both health and plastic surgery. Two independent reviewers screened the article titles and abstracts for relevance and identified the plastic surgery focus and study characteristics of the included literature. The articles were then categorized as detecting, understanding, or reducing health disparities according to a conceptual framework. This review was conducted in line with the Preferred Reporting Items for Systematic Reviews and Meta-Analysis guidelines.

RESULTS

One hundred forty-seven articles published between 1997 and 2019 met the inclusion criteria. Health disparities research in gender-affirming, craniofacial, cosmetic, and hand surgery was lacking relative to breast reconstruction. Racial/ethnic and socioeconomic disparities were reported across subspecialties. Place of residence was also a large determinant of access to care and quality of surgical outcomes. Half of the included studies were in the detecting phase of research. Meanwhile, 40 and 10 percent were in the understanding and reducing phases, respectively.

CONCLUSIONS

Investigators suggested several avenues for reducing health disparities in plastic surgery, yet there is limited evidence on the actual effectiveness of equity-oriented initiatives. More comprehensive research is needed to disentangle the patient, provider, and system-level factors that underlie inequity across subspecialties.

A systematic review of decision aids for gender affirming therapy

BACKGROUND

Transgender and gender diverse (TGD) persons considering gender affirming therapy have to make many complex medical decisions, potentially without understanding the associated harms or benefits of hormonal and surgical interventions. Further, clinicians are often unaware of how best to communicate information to persons seeking gender affirming therapy. Patient decision aids have been developed to provide evidence-based information as a way to help people make decisions in collaboration with their clinicians. It is unclear whether such tools exist for persons seeking gender affirming therapy. The objective of our systematic review is to search for and determine the quality of any existing patient decision aids developed for TGD persons considering gender affirming therapy, and the outcomes associated with their use.

METHODS

We adapted a search strategy for databases using two key concepts "decision support intervention/patient decision aid" and "transgender". We also conducted a brief online search of Google and abstracts from relevant conferences to identify any tools not published in the academic literature. Following study selection and data extraction, we used the International Patient Decision Aid Standards instrument (IPDASi) to assess the quality of patient decision aids, and the Standards for UNiversal reporting of patient Decision Aid Evaluations (SUNDAE) checklist to assess the quality of evaluations.

RESULTS

We identified 762 studies; none were identified from Google or conference content. One tool met our inclusion criteria: an online, pre-encounter patient decision aid for transmasculine genital gender-affirming surgery developed in Amsterdam, translated in English and Dutch. The tool met all the IPDASi qualifying criteria, and scored a 17/28 on the certification criteria, and 57/112 on the quality criteria. The efficacy of the patient decision aid has not been evaluated.

CONCLUSIONS

Despite multiple decisions required for gender affirming therapies, only one patient decision aid has been developed for transmasculine genital reconstruction. Further research is required to develop patient decision aids for the multiple decision points along the gender affirming journey.

A Mixed Methods Study Describing the Quality of Healthcare Received by Transgender and Gender Nonconforming Patients at a Large Integrated Health System

Transgender and gender nonconforming (TGNC) patients have been seeking medical care in higher numbers and have faced unique social, personal, and health issues that affect the quality of care they receive. The purpose of this study was to conduct a mixed-methods study to describe TGNC care at Kaiser Permanente Mid-Atlantic States, a large integrated health system. We used a transgender registry to describe a TGNC patient population and compared healthcare utilization between TGNC patients and non-TGNC patients. Four focus groups were also conducted among 28 patients. Atlas.ti software was used to code and analyze themes for the qualitative analysis. Among the 282 adults TGNC patients, the mean age was 32.6 years. Of the study sample, 59% were White, and 27% were Black. TGNC patients demonstrated an increased use of email/telephone visits and the online patient portal and more cancellations and no-shows compared to non-TGNC controls. Of the 28 TGNC patients who participated in the focus groups, 39% identified as female, 21% as a transman, and 18% as non-binary/genderqueer. Participants were predominantly White (68%), highly educated (74%), and reported use of hormones (89%). Themes that emerged from our qualitative analysis included: limited availability of TGNC information; positive and negative sentiments regarding patient–provider interactions; issues with case management; limited access to care; lack of coordination of care; negative staff experiences. We identified specific areas in a health system to improve the quality of care of TGNC patients, including specific TGNC training for providers and staff, a source of TGNC information/resources, and hiring and training TGNC-specific case managers.

A Single-Center Study Comparison of Two Different Male-to-Female Penile Skin Inversion Vaginoplasty Techniques and Their 3.5-Year Outcomes

BACKGROUND

Vaginoplasty is a crucial part of genital gender-affirming surgery with the number of trans women undergoing this intervention steadily, however, up to date, there is still no standardized vaginoplasty technique.

AIM

This retrospective single-center study compares single-stage vs two-stage penile skin inversion vaginoplasty techniques and their long-term outcomes.

METHODS

Medical records of 63 consecutive patients who underwent single-stage vaginoplasty, as described by Dr Preecha Tiewtranon, and 62 consecutive patients who underwent 2-stage vaginoplasty were reviewed.

RESULTS

The mean postoperative hospital stay was 7 days for patients who underwent single-stage vaginoplasty vs 16 days for patients who underwent 2-stage vaginoplasty. Neovaginal depth proved constant in patients who underwent single-stage vaginoplasty, whereas a loss of more than 30% was observed in patients who underwent 2-stage vaginoplasty during the first postoperative year. Early complications were more common than late-onset complications in both groups. The most common complication in the single-stage group was wound dehiscence (4.8%). There were significantly more complications in 2-stage collective, among which wound dehiscence (33.9%), unsatisfactory cosmetic outcome (25.8%), and urethral stenosis (14.5%) were the most common. In the single-stage cohort, 4 (6.4%) patients needed one revision surgery, whereas 35 (56.5%) patients in the 2-stage cohort necessitated one or more reoperations with up to 10 quaternary revisions. All patients reported to have sensitivity to neoclitoris in the single-stage group, whereas 3 (4.8%) patients in the 2-stage group were deprived of it because of neoclitoral necrosis.

CLINICAL IMPLICATIONS

Optimizing a vaginoplasty surgical technique and its postoperative protocol.

STRENGTHS & LIMITATIONS

The present retrospective study with a mean follow-up of more than 3.5 years offers the first ever comparison of 2 different PSI vaginoplasty surgical techniques performed in the same center.

CONCLUSION

Significantly lower complication and revision rates, shorter recovery time, and superior esthetic and functional outcomes were observed in the single-stage than in the two-stage penile skin inversion vaginoplasty surgical technique. Fakin RM, Giovanoli P. A Single-Center Study Comparison of Two Different Male-to-Female Penile Skin Inversion Vaginoplasty Techniques and Their 3.5-Year Outcomes. J Sex Med 2021;18:391-399.