Evaluation of internet-based patient education materials from internal medicine subspecialty organizations: will patients understand them?

Patients' perspectives on the quality of online patient education materials: A qualitative study

BACKGROUND

Access to online patient education information can lead to more effective self-care and disease management. However, the large amount of online information provided through unknown or unreliable sources can challenge patients to trust and use this information. This study was designed to examine the opinions of Iranian gastrointestinal patients about the quality of online information used.

MATERIALS AND METHODS

A qualitative study was conducted using thematic analysis. Data were gathered via a semi-structured interview with 29 gastrointestinal patients, and data analysis was performed by qualitative content analysis using open coding with MAXQDA 2018 software.

RESULTS

Based on the study, 22 codes were extracted in nine subcategories named as: "Emphasis on the identity of providers," "Nature of online information," "Distrust on online information," "Poor quality of information," "Giving misinformation," "False impact," "Improve communication," "Positive effect on the patient," "Better Diagnosis."

CONCLUSIONS

In the current situation, Iranian patients are not confident enough about the quality of available online information. They believe that the use of current poor-quality information has negative consequences. However, they tend to use online patient education materials are produced in Persian by reputable scientific authorities. Using online information can increase patients' knowledge and lead to better communication with medical staff and other similar patients. They can use this information for self-care with more confidence, and such an approach can also have significant benefits for the national health system.

Helping Patients Understand Pancreatic Cancer Using Animated Pancreas Patient Education With Visual Formats of Learning

OBJECTIVES

Patient education and resources that address barriers to health literacy to improve understanding in pancreatic cancer are limited. We evaluated the impact and outcomes benefits of Animated Pancreas Patient (APP) cancer educational modules (APP website and YouTube).

METHODS

A retrospective study of APP metrics and utilization data from September 2013 to February 2021 was conducted. We evaluated audience reach and calculated top views by media type (animation/expert video/patient video/slideshow) and top retention videos from the modules.

RESULTS

During the study period, APP had 4,551,079 views worldwide of which 2,757,064 unique visitors or 60% were from the United States. Of these, 54% were patients, 17% were family members or caregivers, 16% were health care providers, and 13% were other. The most popular topic viewed among the animations was "Understanding Clinical Trials" (n = 182,217), and the most common expert video viewed was "What are the different stages of pancreatic cancer?" (n = 15,357).

CONCLUSIONS

Pancreatic cancer patient education using APP's visual formats of learning demonstrated a wide reach and had a significant impact on improved understanding among patients, families, and caregivers. Continued efforts should be made to provide patient resources that address health literacy, better quality of life and improved health outcomes in pancreatic cancer.

Improving patient understanding and outcomes in myelodysplastic syndromes - An animated patient guide to MDS with visual formats of learning

Objectives

Patient education resources that address barriers to health literacy to improve understanding and outcomes in myelodysplastic syndromes (MDS) are limited. The aim of this study was to evaluate the impact and outcomes benefits of An Animated Patient's Guide to Myelodysplastic Syndromes (MDS) cancer educational modules (which includes the ‘You and MDS’ website and YouTube hosted resources) related to MDS education, awareness, understanding and health outcomes.

Methods

This was a retrospective study of learner feedback, metrics, and utilization data from July 2018 to August 2021. We evaluated audience reach (number of visit sessions, unique visitors, page views) and calculated top views by media type (animation, expert video, patient video, and slide show) and top retention videos from the modules. We also assessed the educational impact and utilization through learner feedback surveys.

Results

During the study period, ‘You and MDS’ had 233,743 views worldwide of which 104,214 were unique visitors and 78,161 (or 76% unique visitors) were from the United States. Of these, 61% were patients; 29% family members or caregivers; 5% were healthcare providers and 5% represented other groups. Most popular topics viewed among the animations were “Understanding Myelodysplastic Syndromes (MDS)” (40,219 views), “Managing and Treating MDS” (19,240 views), “Understanding Erythropoiesis” (17,564 views.) The most popular expert videos viewed were “What is iron overload, and how it is treated?” (20,310 views), “How serious a cancer is MDS? What is the prognosis for MDS?” (8,327 views), “What is MDS?” (3,157 views). Of participants who completed the online feedback survey, ≥ 95% reported improved knowledge gains and commitments to change.

Conclusions

MDS patients using ‘You and MDS - An Animated Patient's Guide to MDS’ and its visual formats of learning represented a wide U.S. and global learner audience. This MDS educational resource had a significant impact on improved understanding among patients, families, and caregivers. Continued efforts should be made to provide patient-effective resources that address health literacy, improve patient understanding, and address educational needs that respond to the concerns of patients to achieve better quality of life and improved health outcomes in MDS.

Investigating Medical Student's Preferences for Internet-Based Healthcare Services: A Best-Worst Scaling Survey

Objective: This study aimed to investigate the importance of providing Internet-based healthcare services based on the preference of a sample of medical students in China. Methods: An online best-worst scaling (BWS) survey with Case 1 design was conducted. Balanced independent block design generated 12 choice task profiles for each participant to answer. Descriptive analysis was used to describe the respondents' characteristics; Multinomial and mixed logit regression methods were used to investigate the importance of Internet-based services based on respondents' preferences. Results: A total of 1,296 students completed the online survey and rated "Clinical Service," "Decision Aids," and "Public health" as the three most important services that should be provided through an Internet-based healthcare system. Providing "Medical Education" via the Internet was chosen as the least important service by the respondents. Subgroup analysis indicated that students studying clinical medicine and non-clinical medicine considered providing "Medical Education" and "Public Health," respectively, as more important services than others. Conclusions: This BWS study demonstrated that providing "Clinical Service," "Decision Aids," and "Public Health" through the Internet are the three most important services based on medical students' preferences in China. Further research is needed to investigate how to improve medical students' skills in using internet-based healthcare services in medical education programs.

Educação em saúde e final de vida no hospital

Objetivo: identificar ações de educação em saúde direcionadas às pessoas em final da vida e seus cuidadores, informais e formais, no hospital, além de avaliar o nível de evidência de tais ações. Síntese do conteúdo: o estudo foi realizado entre dezembro de 2019 e janeiro de 2020, nas bases de dados Web of Science, Scopus e MEDLINE. Identificaram-se 6.762 artigos, dos quais 42 integram a análise por serem artigos originais ou de revisão escritos em português, espanhol, inglês ou francês; a amostra dos estudos foi composta por pacientes maiores de 19 anos, com doença avançada e/ou em final de vida ou cuidadores ou profissionais de saúde. Os dados foram agrupados por similaridade do tema das ações, conforme Polit e Beck, e o nível de evidência avaliado segundo Melnyk e Fineout-Overholt. O vídeo foi a ação com maior força de recomendação, seguida por cartilhas. As unidades temáticas foram “Ações para o controle da dor”, “Narrativas sobre o final da vida”, “Planejamento de cuidados”, “Dialogando sobre os cuidados paliativos” e “Comunicação e final de vida”. Conclusões: ações de educação em saúde no final da vida devem considerar as tecnologias da informação e da comunicação, além das condições socioculturais, clínicas e cognitivas dessa etapa do adoecimento.

Readability, understandability, and quality of retinopathy of prematurity information on the web

BACKGROUND

The purpose of this study is to assess the readability, understandability, and quality of information on retinopathy of prematurity presented at websites frequently visited by parents.

METHODS

A total of 220 websites were assessed, which were recruited by searching for "retinopathy of prematurity" at the Google search engine. The readability of each web page was assessed by Flesch Reading Ease Score, Gobbledygook's Gunning Frequency, Flesch Kincaid Grade Level, Coleman Liau score, The Simple Measure of Gobbledygook, Fry Graph Readability Formula, and Automated readability score. The understandability of the web pages included in the study was measured by using the Patient Education Materials Assessment Tool. Quality was evaluated using Health in Net code and JAMA. The ALEXA traffic tool was used to reference the domains' popularity and visibility.

RESULTS

Sixty-four websites were included to the study. The average Flesch Reading Ease Score was 50.1 ± 11.4, Gunning Frequency of Gobbledygook level was 13.4 ± 2.5, The Flesch-Kincaid Grade level was 10.7 ± 2.2, Coleman Liau level was 10.8 ± 1.7, Simple Measure of Gobbledygook level was 10.0 ± 1.9, and Fry Graph Readability Formula 11.9 ± 2.7, Automated readability score 10.4 ± 2.5. The average understandability score for all website-based patient education materials was 76.9 ± 15.2. Total JAMA Benchmark score is 2.27 ± 1.14 (range from 1 to 4). The quality of information at most websites were determined by our chosen assessments to not to be good.

CONCLUSION

Websites addressed to parents for retinopathy of prematurity had found to have high understandability. It was concluded based on this study that readability and quality of presented written materials at online sources need to be improved.

Socio-demographic characteristics affect health information seeking on the Internet in Turkey

OBJECTIVE

The objective of this paper was to determine the effects of certain socio-demographic characteristics of Turkish individuals who seek health information on the Internet.

METHODS

This study was granted permission to use data obtained by the Turkish Statistical Institute (TSI) in 2018 under their Household Information Technology Use (HITU) study. The original sample for this research comprised 19,389 participants.

RESULTS

Age, gender, educational level, place of residence and frequency of Internet use were all found to impact the participants' health information seeking behaviour on the Internet. Health information was sought more frequently by women than men, by younger than older people and by those with higher levels of education. Also, health information searches were conducted more often in developed regions than in less-developed regions. In addition, it was also found that the habit of seeking health information was more common among those who use the Internet more frequently.

CONCLUSION

Several socio-demographic characteristics of individuals affect their health information seeking behaviour on the Internet. All individuals should be granted equivalent access to reliable health information by taking sociodemographic characteristics and discrepancies into consideration.

Evaluating the readability, understandability, and quality of online materials about chest pain in children

An increasing number of individuals use the Internet to obtain health information. However, online health information is unregulated and highly variable. We aimed to assess the readability, understandability, and quality of online information available for "chest pain in children." This analysis was performed in January 2020, by inputting the search term "chest pain in children" into Google. The 180 search results were evaluated/categorized. The readability was assessed using the Flesch reading ease score, the Gunning FOG readability score, the Flesch-Kincaid grade level, the Coleman-Liau score, the Simple Measure of Gobbledygook readability score, the Fry readability score, and the automated readability index (ARI). The quality was assessed through the Journal of the American Medical Association (JAMA) benchmark criteria. The understandability was evaluated by the Patient Education Materials Assessment Tool (PEMAT) for this study. Sixty-five websites were analyzed (academic and hospital websites (n = 30), physicians and health information websites (n = 35)). Among all websites, the average reading grade level was 9.99. There was no statistical difference between the two groups for the average readability level (p: 0.645). The mean PEMAT score for all websites was 65.09%. There was no statistical difference between the two groups for the average PEMAT score (p: 0.945). For both groups, the understandability score was below 70%. The average JAMA benchmark score was 2.43 ± 1.06, with a statistically significant difference between the academic and hospital websites (2.07 ± 0.91) and physician and health information websites (2.74 ± 1.09, p: 0.009).Conclusion: The readability of online materials available for patients regarding "chest pain in children" was significantly higher than the grade 6 recommended by the National Institutes of Health. The current online health information related to pediatric chest pain may be too difficult for the average reader to read. The quality and understandability were not good for both groups. Improving the readability, understandability, and quality of pediatric health-related online materials has the potential to reduce parental anxiety, improve baseline medical knowledge, and even enhance the physician-parent alliance.

Health Literacy Gaps in Online Resources for Cirrhotic Patients

Background

The average readability level in the USA is a sixth grade level and for patients with chronic disease it is lower. Cirrhosis is a prevalent chronic disease that requires complex knowledge and instructions to manage. No research has been done about the understandability of online educational content for cirrhotic patients. Patients can find online materials curated by both general health platforms and high-volume liver transplant centers, and thus these materials were analyzed.

Methods

After determining exclusion criteria, the websites of the top 20 general health platform results and the websites of the top 20 high-volume hepatology centers were analyzed. Readability was assessed using the Patient Education Materials Assessment Tool (Audiovisual Materials) (PEMAT-A/V), Flesch-Kincaid Grade Level tests, word counts, sentence counts, words per sentence, and time for an average sixth grader to read.

Results

The mean grade level readabilities were 12.3 and 11.3 for the general resources and the transplant center resources, respectively. The online resources ranged from 9 to 389 sentences requiring an average of 9.8 min to read. The mean PEMAT-A/V scores were 70.05% for the general resources and 72.45% for the transplant center resources. There was a statistically significant difference in the Flesch-Kincaid grade level, sentence number, words per sentence, word count, and time for an average sixth grader to read the general resources and transplant center resources (P < 0.05).

Conclusions

The online resources both from health platforms and hepatology centers available to patients with cirrhosis are too long and complex and underscore the need for simpler and shorter resources.

The quality, understandability, readability, and popularity of online educational materials for heart murmur

OBJECTIVE

Murmurs are abnormal audible heart sounds produced by turbulent blood flow. Therefore, murmurs in a child may be a source of anxiety for family members. Families often use online materials to explore possible reasons for these murmurs, given the accessibility of information on the Internet. In this study, we evaluated the quality, understandability, readability, and popularity of online materials about heart murmur.

METHODS

An Internet search was performed for "heart murmur" using the Google search engine. The global quality score (on a scale of 1 to 5, corresponding to poor to excellent quality) and Health on the Net code were used to measure the quality of information presented. The understandability of the web pages identified was measured using the Patient Education Materials Assessment Tool (score range from 0 to 100%, scores below 70% reflect poor performance). The readability of each web pages was assessed using four validated indices: the Flesch Reading Ease Score, the Flesch-Kincaid Grade Level, the Gunning Frequency of Gobbledygook, and the Simple Measure of Gobbledygook. The ALEXA traffic tool was used to reference domains' popularity and visibility.

RESULTS

We identified 230 English-language patient educational materials that discussed heart murmur. After exclusion, a total of 86 web pages were evaluated for this study. The average global quality score was 4.34 (SD = 0.71; range from 3 to 5) indicating that the quality of information of most websites was good. Only 14 (16.3%) websites had Health on the Net certification. The mean understandability score for all Internet-based patient educational materials was 74.6% (SD = 12.8%; range from 31.2 to 93.7%). A score suggesting these Internet-based patient educational materials were "easy to understand". The mean readability levels of all patient educational materials were higher than the recommended sixth-grade reading level, according to all indices applied. This means that the level of readability is difficult. The average grade level for all web pages was 10.4 ± 1.65 (range from 7.53 to 14.13). The Flesch-Kincaid Grade level was 10 ± 1.81, the Gunning Frequency of Gobbledygook level was 12.1 ± 1.85, and the Simple Measure of Gobbledygook level was 9.1 ± 1.38. The average Flesch Reading Ease Score was 55 ± 9.1 (range from 32.4 to 72.9).

CONCLUSION

We demonstrated that web pages describing heart murmurs were understandable and high quality. However, the readability level of the websites was above the recommended sixth-grade reading level. Readability of written materials from online sources need to be improved. However, care must be taken to ensure that the information of web pages is of a high quality and understandable.

Assessing the Readability of Online Information About Hip Arthroscopy

PURPOSE

To investigate the current readability of online information pertaining to hip arthroscopy.

METHODS

The terms "hip arthroscopy" and "hip scope" were entered into the advanced search functions of Google, Yahoo!, and Bing on March 25, 2017, and results from the first 3 pages were analyzed. Results were required to be unique, accessible websites with information about hip arthroscopy conveyed primarily via analyzable text. Two reviewers applied inclusion criteria to the initial 97 results, discussing to reach consensus in cases of disagreement. Overall, 60 unique results were reviewed with 48 meeting inclusion criteria. Websites were categorized as physician-sponsored, academic, commercial, governmental and nonprofit organization (NPO), or unspecified. Readability was measured via 6 different indices: the Flesch-Kincaid grade level (FKGL), Flesch Reading Ease (FRE), Gunning Fog Score, SMOG Index, Coleman-Liau Index (CLI), and Automated Readability Index (ARI) along with an average grade level and readability classification score.

RESULTS

Forty-eight unique websites were assessed for readability, with physician-sponsored webpages composing the majority (47.92%) followed by academic sources (35.42%). The webpages' average grade level, incorporating information from all 6 metrics, was 12.79 ± 1.98.

CONCLUSIONS

The current readability of online information pertaining to hip arthroscopy is at an inappropriately high reading level compared with the sixth-grade level recommended by the American Medical Association and National Institutes of Health, thus introducing significant barriers to understanding for many patients. Online materials should be edited to reduce word and sentence length and complexity, use simpler terms, and minimize use of passive voice to facilitate patient knowledge acquisition and understanding of online information about hip arthroscopy.

CLINICAL RELEVANCE

This study shows that the current readability of online information on hip arthroscopy exceeds the suggested sixth-grade reading level. It also emphasizes the need for simplifying written materials and offers specific suggestions on doing so to increase accessibility of information for patients.

Understanding Pancreatic Diseases Using Animated Pancreas Patient: Informing Patients for Better Health Outcomes With Visual Formats of Learning

OBJECTIVES

The aim of this study was to evaluate the impact of Animated Pancreas Patient (APP) educational modules (APP website and YouTube) on pancreas education, awareness, and health outcomes.

METHODS

This was a retrospective study of APP metrics data from September 2013 to October 2017. We evaluated audience reach (number of visit sessions, unique visitors, page views) and calculated top views by media type (animation, expert video, patient video, and slide show) and top retention videos from the modules. We also assessed the educational impact through learner feedback survey.

RESULTS

The APP had 1,475,252 views (547,693 unique visitors, 63.1% in United States) during the study period. Most popular topic viewed among the animations was "Role and Anatomy of the Pancreas" (n = 361,116), and most common expert video viewed was "Chronic Pancreatitis: What Foods and Beverages Should I Avoid?" (n = 31,667). Participants who completed the online feedback survey reported knowledge gains and commitments to change.

CONCLUSIONS

Pancreas education in visual formats of learning provided by APP demonstrated wide reach and has substantial potential to inform and impact behaviors of patients and caregivers. Continued efforts should be made to provide patient resources that address health literacy and patient education and respond to patient needs for better quality of life and improved health outcomes in pancreatic diseases.

Quantitative analysis of the level of readability of online emergency radiology-based patient education resources

PURPOSE

The vast amount of information found on the internet, combined with its accessibility, makes it a widely utilized resource for Americans to find information pertaining to medical information. The field of radiology is no exception. In this paper, we assess the readability level of websites pertaining specifically to emergency radiology.

METHODS

Using Google, 23 terms were searched, and the top 10 results were recorded. Each link was evaluated for its readability level using a set of ten reputable readability scales. The search terms included the following: abdominal ultrasound, abdominal aortic aneurysm, aortic dissection, appendicitis, cord compression, CT abdomen, cholecystitis, CT chest, diverticulitis, ectopic pregnancy, epidural hematoma, dural venous thrombosis, head CT, MRI brain, MR angiography, MRI spine, ovarian torsion, pancreatitis, pelvic ultrasound, pneumoperitoneum, pulmonary embolism, subarachnoid hemorrhage, and subdural hematoma. Any content that was not written for patients was excluded.

RESULTS

The 230 articles that were assessed were written, on average, at a 12.1 grade level. Only 2 of the 230 articles (1%) were written at the third to seventh grade recommended reading level set forth by the National Institutes of Health (NIH) and American Medical Association (AMA). Fifty-two percent of the 230 articles were written so as to require a minimum of a high school education (at least a 12th grade level). Additionally, 17 of the 230 articles (7.3%) were written at a level that exceeded an undergraduate education (at least a 16th grade level).

CONCLUSIONS

The majority of websites with emergency radiology-related patient education materials are not adhering to the NIH and AMA's recommended reading levels, and it is likely that the average reader is not benefiting fully from these information outlets. With the link between health literacy and poor health outcomes, it is important to address the online content in this area of radiology, allowing for patient to more fully benefit from their online searches.