An evaluation of the readability, quality, and accuracy of online health information regarding the treatment of hypospadias

Association between YouTube® videos and health literacy with postoperative healthcare utilization following pediatric urologic surgery: A randomized trial

INTRODUCTION

Limited caregiver health literacy has been associated with poorer health outcomes in pediatric patients and may limit caregiver understanding of printed education resources. Postoperative healthcare utilization may be related to confusion about instructions or complications.

OBJECTIVE

To correlate caregiver health literacy and educational video intervention with postoperative healthcare utilization following ambulatory pediatric urologic surgery.

STUDY DESIGN

From July through December 2021, a randomized double-blinded trial assessed postoperative healthcare utilization following pediatric urologic surgery. Caregivers were randomized to receive standardized postoperative counseling and printed instructions (control) or access to English-language educational YouTube® videos with standardized postoperative counseling and printed instructions (intervention). Medical record abstraction was completed 30 days following surgery to identify postoperative healthcare utilization with calls, messages, add-on clinic visits, or presentation for urgent or emergent care, and postoperative complications.

RESULTS

Target enrollment was achieved with 400 caregivers with 204 in the intervention and 196 in the control groups. There was a 32.5 % overall rate of postoperative healthcare utilization. Health literacy was inversely associated with total postoperative healthcare utilization (p < 0.001). There was no difference in the incidence of postoperative healthcare utilization between the control and intervention groups (p = 0.623). However, on sub-analysis of caregivers with postoperative healthcare utilization (Summary Figure), there were fewer total occurrences in the intervention group (intervention median 1, IQR 1,2.3; control median 2, IQR 1,3; p < 0.001). For caregivers with limited health literacy, there was a greater associated reduction in median calls from 2 (IQR 0,2) to 0 (IQR 0,0.5) with video intervention (p = 0.016). On multivariate analysis, total postoperative healthcare utilization was significantly associated with limited caregiver health literacy (OR 1.08; p = 0.004), English as preferred language (OR 0.68; p = 0.018), and older patient age (OR 0.95; p = 0.001).

DISCUSSION

Current resources for postoperative education are limited as resources can be written above recommended reading levels and families can have difficulty recalling information discussed during postoperative counseling. Video intervention is an underutilized resource that can provide an additional resource to families with visual and auditory aids and be accessed as needed.

CONCLUSION

Caregiver health literacy was inversely associated with postoperative healthcare utilization. There was no difference in the incidence of postoperative healthcare utilization with video intervention. However, on subgroup analysis, supplemental videos were associated with fewer occurrences of postoperative healthcare utilization, especially in caregivers with limited health literacy. On multivariate regression, health literacy, preferred language, and patient age were significantly associated with total postoperative healthcare utilization.

Application of Artificial Intelligence to Patient-Targeted Health Information on Kidney Stone Disease

OBJECTIVE

The American Medical Association recommends health information to be written at a 6th grade level reading level. Our aim was to determine whether Artificial Intelligence can outperform the existing health information on kidney stone prevention and treatment.

METHODS

The top 50 search results for "Kidney Stone Prevention" and "Kidney Stone Treatment" on Google, Bing, and Yahoo were selected. Duplicate webpages, advertisements, pages intended for health professionals such as science articles, links to videos, paid subscription pages, and links nonrelated to kidney stone prevention and/or treatment were excluded. Included pages were categorized into academic, hospital-affiliated, commercial, nonprofit foundations, and other. Quality and readability of webpages were evaluated using validated tools, and the reading level was descriptively compared with ChatGPT generated health information on kidney stone prevention and treatment.

RESULTS

50 webpages on kidney stone prevention and 49 on stone treatment were included in this study. The reading level was determined to equate to that of a 10th to 12th grade student. Quality was measured as "fair" with no pages scoring "excellent" and only 20% receiving a "good" quality. There was no significant difference between pages from academic, hospital-affiliated, commercial, and nonprofit foundation publications. The text generated by ChatGPT was considerably easier to understand with readability levels measured as low as 5th grade.

CONCLUSIONS

The language used in existing information on kidney stone disease is of subpar quality and too complex to understand. Machine learning tools could aid in generating information that is comprehensible by the public.

A mobile application for postoperative education of caregivers of children with congenital hypospadias: Requirement analysis

Background and Aims

Hypospadias, a congenital anomaly, can have long-term effects on sexual, urinary, and reproductive functions, making proper postoperative care essential for desirable outcomes, which could be facilitated through a mobile application for diseases with long-term complications. The aim of this study was to investigate the data and functional requirements or minimum data set of a postoperative education mobile application for caregivers of children with hypospadias.

Methods

A literature review of papers published until April 2023 using Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) statement was conducted to determine the data and functional requirements of a mobile application that provides postoperative education to caregivers of children with congenital hypospadias. Based on the results, a questionnaire was prepared, and its content validity and reliability were evaluated by CVI and CVR. Additionally, data was examined by 30 residents, specialists, and subspecialists in pediatric surgery using the Delphi approach.

Results

The study identified 28 data elements in three main categories: demographic data, clinical data, and application function. Functional requirements of the mobile application were suggested for use in designing the application. Also, the most critical data elements included the definition of disease, the importance of treatment, surgical preparation, bandage, hygiene, symptoms and infection, bleeding, and emergency condition.

Conclusion

The study will pave the way for developing postoperative educational applications for caregivers of children with congenital hypospadias. M-Health app developers and clinician specialists can utilize these findings to design practical applications that assist caregivers in managing the care of hypospadias patients.

Online Resources for Robin Sequence; an Analysis of Readability

The objective was to evaluate the readability of easily accessible parent-directed information concerning Robin Sequence (RS) online, compared to the American Medical Association (AMA)-recommended sixth grade (age 11-12) readability level.

A Google search of the term "Pierre Robin Sequence information" was performed. The first ten websites were evaluated using six commonly used readability formulas. Sample texts from three websites were 'translated' by the authors, with the aim of achieving a sixth grade readability level.

The following outcomes were used: Automated Readability Index (ARI), Coleman Liau Index (CLI), Gunning Fog Score, Simple Measure of Gobbledygook (SMOG), Flesch Kincaid Grade Level (FKGL), and Flesch Reading Ease (FRE) score.

The mean pooled grade level of the top 10 included websites was 12.1 (age 17-18). The overall FRE Index was 45.8, which is equivalent to a College-grade reading level. The mean grade level by each test used was: Flesch-Kincaid Grade Level 11.6 (age 16-17), Gunning Fog Score 13.3 (age 18+), SMOG 10.0 (age 14-15), Coleman-Liau Index 13.8 (age 18+), and ARI 12.0 (age 17-18). The author-translated resources achieved pooled mean grade levels of 6.3-6.5.

Parent-directed online materials concerning RS have a readability in excess of the AMA-recommended sixth grade reading level. Even though the condition is complex, more readable resources are achievable. Coproduction of parent-directed resources in association with public an patient involvement (PPI) contributors is encouraged.

Clear as Mud: Readability Scores in Cloacal Exstrophy Literature and Its Treatment

Purpose

This study examines the readability of online medical information regarding cloacal exstrophy (CE). We hypothesize that inappropriate levels of comprehension are required in these resources, leading to poor understanding and confusion amongst caregivers.

Methods

The Google and Bing search engines were used to search the terms "cloacal exstrophy" and "cloacal exstrophy treatment". The first 100 results for each were collected. Each webpage was analyzed for readability using four independent validated scoring systems: the Gunning-Fog index (GFI), SMOG grade (Simple Measure of Gobbledygook), Dale-Chall index (DCI), and the Flesch-Kincaid grade (FKG).

Results

Forty-seven unique webpages fit the inclusion criteria. Mean readability scores across all websites were GFI, 14.6; SMOG score, 10.8; DCI, 9.3; and FKG, 11.8, correlating to adjusted grade levels of college sophomore, 11th grade, college, and 11th grade, respectively. There were significant differences across all readability formulas. Non-profit websites were significantly less readable than institutional and commercial webpages (GFI p = 0.012, SMOG p = 0.018, DCI p = 0.021, FKG p = 0.0093).

Conclusion

Caregiver-directed health information regarding CE and its treatment available online is written at the 11th grade reading level or above. Online resources pertaining to CE must be simplified to be effective.

Internet Health Resources on Nocturnal Enuresis: A Readability, Quality, and Accuracy Analysis

INTRODUCTION

 Nocturnal enuresis is a common yet quality-of-life-limiting pediatric condition. There is an increasing trend for parents to obtain information on the disease's nature and treatment options via the internet. However, the quality of health-related information on the internet varies greatly and is largely uncontrolled and unregulated. With this study, a readability, quality, and accuracy evaluation of the health information regarding nocturnal enuresis is carried out.

MATERIALS AND METHODS

 A questionnaire was administered to parents and patients with nocturnal enuresis to determine their use of the internet to research their condition. The most common search terms were determined, and the first 30 websites returned by the most popular search engines were used to assess the quality of information about nocturnal enuresis. Each site was categorized by type and assessed for readability using the Gunning fog score, Simple Measure of Gobbledygook (SMOG) index, and Dale-Chall score; for quality using the DISCERN score; and for accuracy by comparison to the International Children's Continence Society guidelines by three experienced pediatric urologists and nephrologists.

RESULTS

 A total of 30 websites were assessed and classified into five categories: professional (n = 13), nonprofit (n = 8), commercial (n = 4), government (n = 3), and other (n = 2). The information was considered difficult for the public to comprehend, with mean Gunning fog, SMOG index, and Dale-Chall scores of 12.1 ± 4.3, 14.1 ± 4.3, and 8.1 ± 1.3, respectively. The mean summed DISCERN score was 41 ± 11.6 out of 75. Only seven (23%) websites were considered of good quality (DISCERN score > 50). The mean accuracy score of the websites was 3.2 ± 0.6 out of 5. Commercial websites were of the poorest quality and accuracy. Websites generally scored well in providing their aims and identifying treatment benefits and options, while they lacked references and information regarding treatment risks and mechanisms.

CONCLUSION

 Online information about nocturnal enuresis exists for parents; however, most websites are of suboptimal quality, readability, and accuracy. Pediatric surgeons should be aware of parents' health-information-seeking behavior and be proactive in guiding parents to identify high-quality resources.

Assessment of readability and quality of patient education materials specific to nocturnal enuresis

BACKGROUND

Bedwetting, or nocturnal enuresis (NE), is a common childhood disease. Families increasingly turn to free online resources for health education in order to navigate treatment options.

OBJECTIVE

We aim to determine the readability and quality of online health information that families may encounter when searching for information on pediatric NE.

STUDY DESIGN

The search term 'bedwetting' was queried in commonly used search engines. Included articles were further categorized as institutional/reference, commercial, non-profit/charitable, or personal. An online readability platform calculated 3 commonly used readability assessments as well as a consensus score. Quality was assessed by two independent pediatric urologists using a validated DISCERN instrument. Differences in readability were further assessed by article category type.

RESULTS

36 websites were reviewed, 3 did not include treatment options and were not included in quality assessment. 55.6% of the articles were categorized as institutional/reference, 27.8% as non-profit/charitable, 11.1% as personal, and 5.6% as commercial. The average, standard deviation, and range of readability level were as follows: overall consensus score = 9.56 ± 2.09, FK Grade Level Formula score = 9.38 ± 2.17 (range 5.8-14.1), SMOG Index score = 8.89 ± 1.79 (range 6.4-12.9), and the GF Index score = 11.86 ± 2.34 (range 8.4-16.9). The overall consensus score, 9.56, correlates to a 9th-grade reading level. 16 articles were considered to be of 'good' quality, 12 of 'fair' quality, and 5 of 'poor' quality; according to the DISCERN scoring. There was no statistically significant difference in readability scores across website categories. Two articles included the outdated treatment option of intranasal DDAVP.

DISCUSSION

These findings are concordant with the increasing body of literature demonstrating that patient education materials are too difficult to read. Pediatric urologists should be aware of the readability and quality of available online content for common clinical presentations. They can ensure that institutional articles online are useful to patients by participating in the development and design of these materials.

CONCLUSION

We demonstrated that online articles that families encounter via a search engine query for bedwetting are written at a higher level than recommended and the majority are of 'fair' quality. There is much room for improvement for institutions to provide high quality, readable content that supports the needs of families seeking information on NE.

Assessing the readability and quality of online information about benign prostatic hyperplasia

PURPOSE

Benign prostatic hyperplasia (BPH) affects nearly half of men in their fifties. Patients often search the Internet to better understand their diagnosis, but online health information is not well regulated and can be difficult for patients to comprehend. This study aims to evaluate not only readability, but also the quality of online information about BPH, as well as the effect of commercial bias on readability and quality.

METHODS

Three search engines (Google, Bing, and DuckDuckGo) were used with broad search terms including "BPH," "BPH treatment," and "BPH surgery," to mimic a patient diagnosed with BPH seeking further information. 204 total websites were identified, of which 62 were unique websites. Among those unique websites, 23 were advertisements. Three readability formulas (Flesch-Kincaid Grade Level, Flesch-Kincaid Reading Ease, SMOG) were used to generate readability scores. DISCERN standardized questionnaire was used to evaluate website quality.

RESULTS

Average reading level of online information about BPH was significantly higher than the recommended level by the American Medical Association (AMA) and United States Department of Health and Human Services (USDHHS). Advertisements had significantly easier readability than nonadvertisements. Average website quality was "excellent" for nonadvertisements, but only "fair" for advertisements.

CONCLUSION

Although advertisements may hold optimal search result positions and have better readability than nonadvertisements, they have biased and lower quality information. It is important to guide patients to high quality online information of appropriate reading level. Continued efforts should be made to create and share with patients high quality resources with improved readability to facilitate comprehension and minimize misinformation.

Online Health Information for Penile Prosthesis Implants Lacks Quality and Is Unreadable to the Average US Patient

BACKGROUND

Online health information (OHI) has become widely accessible and affects patient decisions regarding their healthcare. The purpose of this study was to assess the readability, quality, and accuracy of information available to patients online about penile prosthesis implants (PPIs).

METHODS

We performed a Google search using the keywords "penile implant" and "penile prosthesis." The first 30 search results for both terms were analyzed, and advertisements, news articles, duplicates, and videos were excluded. Websites were categorized as institutional, commercial, and personal/patient support. Readability of each website was determined using the Flesch-Kincaid grade level (FKGL) readability formula within the readable tool. Quality was measured by Health On the Net (HON) certification status and the DISCERN scoring method. For website accuracy, a score of 1-4 (1=0-25%, 2=25-50%, 3=50-75%, and 4=75-100%) was assigned.

RESULTS

Forty-four websites met the criteria (23 institutional, 12 commercial, and 9 personal/patient support). The mean total FKGL score was 9.55. No statistical difference was detected between mean FKGL for each website category (p=0.69). Only eight websites (18%) scored ≤8th-grade reading level (average US adult level), while 36 (82%) were >8th-grade level. Mean total DISCERN sum score was 39.74/75, with no statistical difference in mean DISCERN score between website types (p=0.08). Over half (55%) of the websites were defined as "very poor" or "poor" quality by DISCERN scoring. Mean total overall quality rating was 2.67/5. HON certification was verified for only nine websites (20%). Twenty-five percent of websites were classified as 0-25% accurate, 23% were 25-50% accurate, 30% were 50-75% accurate, and 23% were 75-100% accurate.

CONCLUSION

Most information on the Internet about PPIs is reasonably accurate; however, the majority of websites are deficient in quality and unreadable to the average patient, irrespective of website type.

Engagement of common pediatric urologic conditions on social media

INTRODUCTION

As social media use continues to increase, parents and caregivers report using social media platforms as a source of health information. However, there are minimal regulations for social media content and health misinformation has been shared for various medical issues and urologic conditions. While internet content related to pediatric urology has been previously described, social media engagement for various pediatric urologic conditions have yet to be described.

OBJECTIVE

To evaluate the evidence supporting articles engaged on social media that are related to common pediatric urologic conditions.

STUDY DESIGN

A social media analysis tool was used to identify articles engaged through Facebook, Reddit, Twitter, and Pinterest between July 2020-2021. The top 5 articles related to toilet training, circumcision, cryptorchidism, testicular torsion, and hypospadias were identified. Article citations were reviewed and classified by Oxford levels of evidence. The content of each article was then reviewed and compared against supporting evidence on an independent literature search. Statistical analysis was completed with descriptive statistics, Mann-Whitney U, Wilcoxon signed rank, and bivariate correlation.

RESULTS

Of the 25 articles reviewed, 8 (32%) were affiliated with medical journals, hospitals, or academic institutions and 17 (68%) were on non-affiliated websites with advertisements. There was greater social media engagement for articles related to toilet training and circumcision than testicular torsion, hypospadias, and cryptorchidism. No articles cited level 1 evidence and 32% of articles cited no evidence. Literature search for article content demonstrated a discrepancy between the level of evidence cited by articles compared to the evidence available in the literature to support article content. There was greater social media engagement for articles with no cited or supporting evidence and those not affiliated with medical journals, hospitals, or academic institutions.

DISCUSSION

The findings in this study are consistent with trends reported for other urologic conditions, including genitourinary malignancy, female pelvic medicine and reconstructive surgery, nephrolithiasis, and sexual function. Parents without a medical background may have difficulty identifying whether articles shared on social media can be a reliable resource for health information. It is important to understand how information related to pediatric urologic conditions is engaged on social media so that misinformation can be addressed in clinical, online, and regulatory settings.

CONCLUSION

There was greater social media engagement for articles with no cited or supporting evidence and those not affiliated with medical journals, hospitals, or academic institutions.

Quantifying the Quality of Web-Based Health Information on Student Health Center Websites Using a Software Tool: Design and Development Study

Background

The internet has become a major source of health information, especially for adolescents and young adults. Unfortunately, inaccurate, incomplete, or outdated health information is widespread on the web. Often adolescents and young adults turn to authoritative websites such as the student health center (SHC) website of the university they attend to obtain reliable health information. Although most on-campus SHC clinics comply with the American College Health Association standards, their websites are not subject to any standards or code of conduct. In the absence of quality standards or guidelines, monitoring and compliance processes do not exist for SHC websites. Thus, there is no oversight of the health information published on SHC websites by any central governing body.

Objective

The aim of this study is to develop, describe, and validate an open-source software that can effectively and efficiently assess the quality of health information on SHC websites in the United States.

Methods

Our cross-functional team designed and developed an open-source software, QMOHI (Quantitative Measures of Online Health Information), that assesses information quality for a specified health topic from all SHC websites belonging to a predetermined list of universities. The tool was designed to compute 8 different quality metrics that quantify various aspects of information quality based on the retrieved text. We conducted and reported results from 3 experiments that assessed the QMOHI tool in terms of its scalability, generalizability in health topics, and robustness to changes in universities’ website structure.

Results

Empirical evaluation has shown the QMOHI tool to be highly scalable and substantially more efficient than manually assessing web-based information quality. The tool’s runtime was dominated by network-related tasks (98%), whereas the metric computations take <2 seconds. QMOHI demonstrated topical versatility, evaluating SHC website information quality for four disparate and broad health topics (COVID, cancer, long-acting reversible contraceptives, and condoms) and two narrowly focused topics (hormonal intrauterine device and copper intrauterine device). The tool exhibited robustness, correctly measuring information quality despite changes in SHC website structure. QMOHI can support longitudinal studies by being robust to such website changes.

Conclusions

QMOHI allows public health researchers and practitioners to conduct large-scale studies of SHC websites that were previously too time- and cost-intensive. The capability to generalize broadly or focus narrowly allows a wide range of applications of QMOHI, allowing researchers to study both mainstream and underexplored health topics. QMOHI’s ability to robustly analyze SHC websites periodically promotes longitudinal investigations and allows QMOHI to be used as a monitoring tool. QMOHI serves as a launching pad for our future work that aims to develop a broadly applicable public health tool for web-based health information studies with potential applications far beyond SHC websites.

The Gap Between Self-Rated Health Information Literacy and Internet Health Information-Seeking Ability for Patients With Chronic Diseases in Rural Communities: Cross-sectional Study

BACKGROUND

The internet has become one of the most important channels for residents to seek health information, particularly in remote rural areas in China.

OBJECTIVE

In this study, we aimed to explore the gap between self-rated health information literacy and internet health information seeking ability for patients with chronic diseases in rural communities and to preliminarily evaluate their barriers when seeking health information via the internet.

METHODS

Residents from rural communities near Bengbu City and with chronic diseases were included in this study. A self-rated questionnaire was used to evaluate their health information literacy, 3 behavioral competency tasks were designed to preliminarily evaluate their ability to seek health information on the internet and semistructured interviews were used to investigate their barriers to obtaining health information via the internet. A small audiorecorder was used to record the interview content, and screen-recording software was used to record the participants' behavior during the web-based operational tasks.

RESULTS

A total of 70 respondents completed the self-rated health information literacy questionnaire and the behavioral competence test, and 56 respondents participated in the semistructured interviews. Self-rated health information literacy (score out of 70: mean 46.21, SD 4.90) of the 70 respondents were moderate. Although 91% (64/70) of the respondents could find health websites, and 93% (65/70) of the respondents could find information on treatment that they thought was the best, 35% (23/65) of respondents did not know how to save the results they had found. The operational tasks indicated that most articles selected by the respondents came from websites with encyclopedic knowledge or answers from people based on their own experiences rather than authoritative health information websites. After combining the results of the semistructured interviews with the DISCERN scale test results, we found that most interviewees had difficulty obtaining high-quality health information via the internet.

CONCLUSIONS

Although the health information literacy level of patients with rural chronic disease was moderate, they lack the ability to access high-quality health information via the internet. The vast majority of respondents recognized the importance of accessing health information but were not very proactive in accessing such information.

Online Information on Painful Sexual Dysfunction in Women: Quality Analysis of Websites in SPANISH about Dyspareunia, Vaginismus and Vulvodynia

The objective of this study was to evaluate the content, quality, and readability of websites containing information on dyspareunia, vaginismus, and vulvodynia in Spanish. Web pages were retrieved entering the terms “dyspareunia”, “vaginismus”, and “vulvodynia” in Google, Yahoo!, and Bing search engines. Two researchers employed the DISCERN and Bermúdez-Tamayo questionnaires to analyze the content and quality of the websites, and the INFLESZ scale to evaluate their readability. IBM SPSS^® version 25 statistical software was employed for data analysis. The internet search yielded 262 websites, 91 of which were included after applying the selection criteria. Websites with information on dyspareunia obtained median scores of 24 (30–21) in the DISCERN, 38 (41.0–35.5) in the Bermúdez-Tamayo, and 55.3 (57.2–50.9) in the INFLESZ tools. The results for websites on vaginismus revealed median scores of 23.5 (30–20) in the DISCERN, 37 (42–35) in the Bermúdez-Tamayo, and 52.9 (55.6–46.4) in the INFLESZ. Finally, the median scores for vulvodynia sites was 25.5 (30–20) in the DISCERN, 38 (43–33.7) in the Bermúdez-Tamayo, and 54.2 (57.3–47.2) in the INFLESZ. These outcomes indicate that the quality of information in these websites is very low, while the overall quality of the web pages is moderate. Sites on vaginismus and vulvodynia were “somewhat difficult” to read, while readability was “normal” for websites on dyspareunia. Healthcare professionals should be aware of the shortcomings of these websites and address them through therapeutic education with resources containing updated, quality information. This raises the need for health professionals to generate these resources themselves or for experts and/or scientific societies in the field to check the quality and timeliness of the contents, regardless of whether or not the websites are endorsed with quality seals.

Social Media and the Transformation of the Physician-Patient Relationship: Viewpoint

As many as 80% of internet users seek health information online. The social determinants of health (SDoH) are intimately related to who has access to the internet and health care as a whole. Those who face more barriers to care are more likely to benefit from accessing health information online, assuming the information they are retrieving is accurate. Virtual communities on social media platforms are beginning to serve as venues for seeking health information online because peers have been shown to influence health behavior more than almost anything else. As a positive mediator of health, social media can be used as a direct or indirect mode of communication between physicians and patients, a venue for health promotion and health information, and a community support network. However, false or misleading content, social contagion, confirmation bias, and security and privacy concerns must be mitigated to realize the full potential of social media as a positive mediator of health. This paper presents the shifting dynamics of how such communities are affecting physician-patient relationships. With the intersections between the SDoH, social media, and health evolving, physicians must take into consideration these factors when establishing their relationships with patients. We argue a paradigm shift in the physician-patient relationship is warranted, one where physicians acknowledge the impacts of the SDoH on information-seeking behavior, recognize the positive and negative roles of social media as a mediator of health through the lens of the SDoH, and use social media to catalyze positive changes in the physician-patient relationship. We discuss how the physician-patient relationship must evolve to accommodate for the ever-increasing role of social media in health and to best use social media as a tool to improve health outcomes. Finally, we present a fluid and multicomponent diagram that we believe will assist in framing future research in this area. We conclude that it is ineffective and even counterproductive for physicians to ignore the relationship between social media, the SDoH and health, their impact on one another, and the effect it has on designing the medical encounter and the delivery of care under the definition of precision medicine.

Assessing the Accuracy, Quality, and Readability of Information Related to the Surgical Management of Benign Prostatic Hyperplasia

Objectives: To assess the accuracy, quality, and readability of online educational health information in English related to the most common benign prostatic hyperplasia (BPH) guideline-approved surgical treatments. Methods: The terms "benign prostatic hyperplasia," "BPH," and all eight guideline-approved treatment modalities studied, were searched to retrieve the first five relevant websites and first two paid advertised websites related to the surgical treatment options for BPH. These modalities included transurethral resection of the prostate (TURP), GreenLight photovaporization, endoscopic enucleation of the prostate, Rezum, Urolift, Aquablation, open simple prostatectomy, and robotic simple prostatectomy (RSP). All relevant websites were assessed for their accuracy, quality, and readability using standardized scoring systems. Results: The mean accuracy score for each of the treatment modalities were all indicative of good accuracy, with 76%-99% of the information presented as being accurate. The median quality score was statistically different across the eight treatment modalities (p = 0.015). The median readability grade level was statistically different across the eight treatment modalities (p = 0.009). Websites that described TURP (median readability grade level, 9.00 [interquartile range (IQR) 8.00-10.80]) were significantly easier to read than those related to RSP (median readability grade level, 14.35 [IQR, 11.08-16.50]) (p = 0.011). No other statistically significant differences were found within the other treatment modality websites. Conclusions: The majority of websites retrieved were found to be of high accuracy, good quality, and poor readability. Additionally, it was found that none of the retrieved websites included descriptions for all the other included treatment modalities. Given these findings, the authors recommend the development of centralized resources with all guideline-approved treatment modalities and accurate, readable, and high-quality information related to the surgical treatment of BPH.

Readability of Patient Educational Materials in Pediatric Orthopaedics

BACKGROUND

Parents are increasingly turning to the internet to seek pediatric health information. Numerous organizations advise that patient educational materials (PEMs) should not surpass the sixth-grade reading level. We aimed to assess the readability of online pediatric orthopaedic PEMs.

METHODS

The readability of 176 articles pertaining to pediatric orthopaedics from the American Academy of Orthopaedic Surgeons (AAOS), Pediatric Orthopaedic Society of North America (POSNA), and American Academy of Pediatrics (AAP) websites was assessed with the use of 8 readability formulae: the Flesch-Kincaid Reading Grade Level, the Flesch Reading Ease Score, the Raygor Estimate, the SMOG, the Coleman-Liau, the Fry, the FORCAST, and the Gunning Fog. The mean reading grade level (RGL) of each article was compared with the sixth and eighth-grade reading levels. The mean RGL of each website's articles also was compared.

RESULTS

The cumulative mean RGL was 10.2 (range, 6.6 to 16.0). No articles (0%) were written at the sixth-grade reading level, and only 7 articles (4.0%) were written at or below the eighth-grade reading level. The mean RGL was significantly higher than the sixth-grade (95% confidence interval [CI] for the difference, 4.0 to 4.4; p < 0.001) and eighth-grade (95% CI, 2.0 to 2.4; p < 0.001) reading levels. The mean RGL of articles on the POSNA website was significantly lower than the mean RGL of the articles on the AAOS (95% CI, -1.8 to -1.0; p < 0.001) and AAP (95% CI, -2.9 to -1.1; p < 0.001) websites.

CONCLUSIONS

Pediatric orthopaedic PEMs that are produced by the AAOS, the POSNA, and the AAP have readability scores that exceed recommendations. Given the increasing preference of parents and adolescents for online health information, the growing body of online PEMs, and the critical role that health literacy plays in patient outcomes, substantial work is required to address the readability of these materials.

Using the Google™ Search Engine for Health Information: Is There a Problem? Case Study: Supplements for Cancer

We assessed the quality of online health and nutrition information using a Google™ search on "supplements for cancer". Search results were scored using the Health Information Quality Index (HIQI), a quality-rating tool consisting of 12 objective criteria related to website domain, lack of commercial aspects, and authoritative nature of the health and nutrition information provided. Possible scores ranged from 0 (lowest) to 12 ("perfect" or highest quality). After eliminating irrelevant results, the remaining 160 search results had median and mean scores of 8. One-quarter of the results were of high quality (score of 10-12). There was no correlation between high-quality scores and early appearance in the sequence of search results, where results are presumably more visible. Also, 496 advertisements, over twice the number of search results, appeared. We conclude that the Google™ search engine may have shortcomings when used to obtain information on dietary supplements and cancer.

Public health education for parents during the outbreak of COVID-19: a rapid review

Background

It is well-known that public health education plays a crucial role in the prevention and control of emerging infectious diseases, but how health providers should advise families and parents to obtain health education information is a challenging question. With coronavirus disease 2019 (COVID-19) spreading around the world, this rapid review aims to answer that question and thus to promote evidence-based decision making in health education policy and practice.

Methods

We systematically searched the literature on health education during COVID-19, severe acute respiratory syndrome (SARS) and middle east respiratory syndrome (MERS) epidemics in Medline (via PubMed), Cochrane Library, EMBASE, Web of Science, China Biology Medicine disc (CBM), China National Knowledge Infrastructure (CNKI), and Wanfang Data from their inception until March 31, 2020. The potential bias of the studies was assessed by Joanna Briggs Institute Prevalence Critical Appraisal Tool.

Results

Of 1,067 papers found, 24 cross-sectional studies with a total of 35,967 participants were included in this review. The general public lacked good knowledge of SARS and MERS at the early stage of epidemics. Some people’s knowledge, attitude and practice (KAP) of COVID-19 had been improved, but the health behaviors of some special groups including children and their parents need to be strengthened. Negative emotions including fear and stigmatization occurred during the outbreaks. Reliable health information was needed to improve public awareness and mental health for infectious diseases. Health information from nonprofit, government and academic websites was more accurate than privately owned commercial websites and media websites.

Conclusions

For educating and cultivating children, parents should obtain information from the official websites of authorities such as the World Health Organization (WHO) and national Centers for Disease Control, or from other sources endorsed by these authorities, rather than from a general search of the internet or social media.

Knowledge gaps and information seeking by parents about hypospadias

INTRODUCTION

Parents making complex decisions about hypospadias surgery may experience anxiety and uncertainty related to multiple sources of information with questionable reliability and limited relevance to their concerns.

OBJECTIVE

The purpose of this study was to identify knowledge gaps, information-seeking behaviors, and informational needs of parents making decisions about hypospadias surgery as an initial step in the development of a hypospadias decision aid.

STUDY DESIGN

We conducted semi-structured interviews with English-speaking parents (≥18 years of age) of children with hypospadias, inquiring about gaps in their knowledge, information-seeking behaviors, and perceived informational needs (Extended Summary Table). We conducted interviews until no new themes were identified, analyzing them iteratively using open, axial, and selective coding. We used grounded theory methods to develop an explanation of the information-seeking process about hypospadias surgery.

RESULTS

Of the 43 eligible parents, 16 mothers and 1 father (39.5%) of 16 patients participated: 7 preoperative and 9 postoperative with distal (8) and proximal (8) meatal locations. Parents were aged 21-43: 15 Caucasians and 2 African-Americans. Educational backgrounds and marital status varied across subjects. We identified five categories of knowledge gaps relating to hypospadias surgery: 1) epidemiology, 2) timing/technique, 3) perioperative experience, 4) long-term cosmetic outcome, and 5) long-term risk of complications. Information-seeking behaviors included searching the internet, discussing hypospadias with the child's pediatrician and/or urologist, and obtaining information from their social network. Most parents sought information online prior to and/or after consultation with the urologist, from parent blogs/forums, medical school/hospital websites, journal articles, and medical databases. Perceived informational needs included clear and reliable information online, images of mild degrees of hypospadias, and images of repaired hypospadias cases. According to the parents, video testimonials from other parents would help them relate to others in their social network and build confidence about the surgical process.

DISCUSSION

The findings of this study contribute to our understanding of parental decision-making about hypospadias surgery by highlighting specific knowledge gaps and informational needs for inclusion in a decision aid. Study limitations include a small sample size that is typical and expected for qualitative research studies and the underrepresentation of fathers, minorities, and same-sex couples.

CONCLUSIONS

The Internet is the primary source of information most parents use to address knowledge gaps about hypospadias. Parents expressed concerns about the reliability and clarity of information and identified informational needs including parent testimonials and a wide variety of hypospadias images for inclusion in a decision aid.

Parenting Science Gang: radical co-creation of research projects led by parents of young children

BACKGROUND

Parents are increasingly searching online for information supported by research but can find it difficult to identify results relevant to their own experiences. More troublingly, a number of studies indicate that parenting information found online often can be misleading or wrong. The goal of the Parenting Science Gang (PSG) project was to use the power of the Internet to help parents ask questions they wanted to have answered by scientific research and to feel confident in assessing research evidence.

METHODS

By using Facebook to recruit groups and facilitate interactions, PSG was able to engage fully the target public of parents of young children in the radical co-production of scientific studies, while not creating an undue burden on time or restricting participants due to disability, financial status or location. By giving parents true partnership and control of creation of projects, PSG ensured that the chosen questions were ones that were of most relevance and interest to them.

RESULTS

This paper presents a summary of eight projects, with three in more detail, designed and implemented by PSG Facebook groups in collaboration with experts. Most projects had health related themes, often prompted by dissatisfaction with treatment of parents by health professionals or by feelings of being marginalised by pregnancy and motherhood, as well as by the lack of evidence for their questions and concerns. The PSG approach meant that these frustrations were channelled into actions. All eight of the PSG groups engaged in meaningful interactions with experts and co-produced studies with the groups defining the questions of interest.

CONCLUSIONS

This radically user-led design meant that the PSG staff and the collaborating experts had to live with a high degree of uncertainty. Nevertheless, PSG achieved its goal of academically productive, truly co-produced projects, but as important were the positive effects it had on many of the participants, both parents and experts. At the point of writing this paper, PSG projects have led to outputs including at least eight papers published, in press or in preparation, seven conference presentations, testimony to the Infant Feeding All-Party Parliamentary Group, and with more to come.

Consulting "Dr. YouTube": an objective evaluation of hypospadias videos on a popular video-sharing website

INTRODUCTION

Parents who make decisions about hypospadias repair for their child may seek information from online platforms such as YouTube.

OBJECTIVE

The purpose of this study is to evaluate the health literacy demand of hypospadias videos on YouTube using the Patient Education Materials Assessment Tool for Audiovisual Materials (PEMAT-A/V).

STUDY DESIGN

We performed a YouTube search using the term "hypospadias," limiting results to the first 100 videos. We excluded videos that were <1 min or >20 min and videos that were not in English or did not include subtitles. Two evaluators independently examined videos and determined PEMAT-A/V scores for understandability and actionability (i.e., ability to identify actions the viewer can take). Videos with scores >70% are understandable or actionable. The inter-rater reliability (kappa) and intraclass correlation coefficient (ICC) of PEMAT scores were calculated. Bivariate and multivariable linear regression models assessed the association of video characteristics with respective scores.

RESULTS

Of the 100 videos that were identified on YouTube, 47 (47%) were excluded leaving 53 for analysis: 14 were >20 min, 14 were <1 min, 9 had no audio or subtitles, 7 were not in English, 1 was a duplicate, 1 was unrelated to hypospadias, and 1 was deleted at the time of data analysis. Three (5.6%) were understandable (mean score 54.5%, standard deviation (SD) 14.9) and eight (15.1%) were actionable (mean score 21.8%, SD 16.6) (Extended Summary Figure). Kappa values ranged from 0.4 to 1. The ICC's were 0.55 and 0.33 for understandability and actionability, respectively. In the bivariate analysis, mean understandability scores were significantly higher for English language videos (p = 0.04), videos with animation (p = 0.002), and those produced by industry (p = 0.02). In the multivariable analysis, mean understandability scores were significantly higher for "expert testimonial" or "other" video types after adjusting for graphics type and overall tone (p = 0.04). Mean understandability scores were also significantly higher for videos with animation after adjusting for video type and overall tone (p = 0.01). Mean actionability scores were significantly higher for videos with a negative tone (p = 0.01).

DISCUSSION

The vast majority of hypospadias-related YouTube content is not appropriate for users with low health literacy although certain types of videos, such those with animation and expert testimonials, scored higher on understandability than other types.

CONCLUSION

Due to the lack of sufficient online informational content regarding hypospadias, we plan to engage parents of sons with hypospadias in the development of high-quality patient educational materials about hypospadias.

The Use of Social Media in Pediatric Urology-Forging New Paths or Crossing Boundaries?

PURPOSE OF REVIEW

There has been a remarkable change in how people connect, access, and share professional and medical information over social media. This perspective article describes opportunities, potential pitfalls, and guidelines for social media use by pediatric urology providers.

RECENT FINDINGS

Pediatric urologists have effectively used social media to connect and share expertise, augment scientific conference participation, promote themselves and their research, disseminate guidelines and best practices, participate in virtual journal clubs, and engage with patients and their families. Information shared over social media is not protected by copyright law, not confidential, not regulated, permanent, and subjected to public domain and scrutiny. Despite these potential pitfalls, social media is a useful tool if best practices are observed and online communication adheres to professional guidelines and organizational policy. Social media use in healthcare is here to stay and pediatric urologists have online visibility whether or not they choose to actively participate. Despite new legal, ethical, and professional considerations that social media introduces, a well-executed social media presence provides pediatric urologists a wealth of new opportunities for networking, research, and disseminating high-quality medical information online.

Disorders of sex development (DSD) web-based information: quality survey of DSD team websites

Objectives

Consumers rely on online health information, particularly for unusual conditions. Disorders of Sex Development (DSD) are complex with some aspects of care controversial. Accurate web-based DSD information is essential for decision-making, but the quality has not been rigorously evaluated. The purpose of the present study was to assess the quality of online health information related to DSD presented by 12 pediatric institutions comprising the NIH-sponsored DSD-Translational Research Network (DSD-TRN).

Methods

DSD-TRN sites identified team webpages, then we identified linked webpages. We also used each institution search engine to search common DSD terms. We assessed webpages using validated tools: the Simple Measure of Gobbledygook (SMOG) determined reading level, the Patient Education Materials Assessment Tool (PEMAT) evaluated content for understandability and actionability, and the DISCERN tool assessed treatment decision-making information (for hormone replacement and surgery). We developed a “Completeness” measure which assessed the presence of information on 25 DSD topics.

Results

The SMOG reading level of webpages was at or above high-school grade level. Mean (SD) PEMAT understandability score for Team Pages and Team Links was 68% (6%); on average these pages met less than 70% of the understandability criteria. Mean (SD) PEMAT actionability score was 23% (20%); few patient actions were identified. The DISCERN tool determined that the quality of information related to hormone treatment and to surgery was poor. Sites’ webpages covered 12–56% of the items on our Completeness measure.

Conclusions

Quality of DSD online content was poor, and would be improved by using a variety of strategies, such as simplifying word choice, using visual aids, highlighting actions patients can take and acknowledging areas of uncertainty. For complex conditions such as DSD, high-quality web-based information is essential to empower patients (and caregiver proxies), particularly when aspects of care are controversial.