A systematic method for reviewing and analysing health information on consumer-oriented websites

Qualitative content analysis of image interpretation education in UK pre-registration diagnostic radiography programmes

INTRODUCTION

Image interpretation is a required capability for all UK pre-registration programmes in diagnostic radiography to meet the needs of graduate practice. It also provides a potential educational foundation for future advanced clinical practice. The aim of this study was to explore how image interpretation education is designed, delivered, and assessed within contemporary UK pre-registration diagnostic radiography programmes.

METHODS

Qualitative content analysis of open-source image interpretation curriculum data extracted from UK Higher Education Institute (HEI) websites.

RESULTS

Extracted search data was initially coded and three overarching themes emerged, image interpretation education vision, operationalisation, and delivery and assessment.

CONCLUSION

This study identified significant heterogeneity in all aspects of UK pre-registration image interpretation education which may suggest an equal heterogeneity can be expected in the image interpretation knowledge, skill, confidence between newly registered practitioners.

IMPLICATIONS FOR PRACTICE

There may be a need for clearer expectations on HEIs by professional and regulatory bodies to ensure consistency in pre-registration image interpretation education.

Quality Evaluation of Consumer Health Information Websites Found on Google Using DISCERN, CRAAP, and HONcode

Online health misinformation is a growing problem, and health information professionals and consumers would benefit from an evaluation of health websites for reliability and trustworthiness. Terms from the Google COVID-19 Search Trends dataset were searched on Google to determine the most frequently appearing consumer health information websites. The quality of the resulting top five websites was evaluated. The top five websites that appeared most frequently were WebMD, Mayo Clinic, Healthline, MedlinePlus, and Medical News Today, respectively. All websites, except Medline Plus, received HONcode certification. Based on DISCERN and CRAAP scores, MedlinePlus was found to be the most reliable health website.

What's out there for parents? A systematic review of online information about prenatal microarray and exome sequencing

Objective

To identify what online patient information (presented in English) is available to parents about prenatal microarray (CMA) and exome sequencing (ES), and evaluate its content, quality, and readability.

Method

Systematic searches (Google and Bing) were conducted, and websites were categorised according to their purpose. Websites categorised as patient information were included if they were: in English, directed at patients, or were a text, video, or online version of an information leaflet. Author‐developed content checklists, the DISCERN Genetics tool, and readability tests (the Flesch Reading Ease Score, the Gunning Fog Index, and the Simple Measure of Gobbledygook Index) were then used to assess those sources of patient information.

Results

Of the 665 websites screened, 18 met the criteria. A further 8 sources were found through a targeted search of professional organisations, resulting in 26 sources available for further evaluation. In general, this was found to be low in quality, omitted details recommended by national or international guidance, and was written at a level too advanced for average readers.

Conclusion

Improvements should be made to the content, quality, and readability of online information so that it both reinforces and complements the discussions between parents and clinicians about testing options during pregnancy.

What's already known about this topic?

The Internet is an important source of information for parents during pregnancy

Little is known about the availability and standard of online information about newer prenatal genetic tests like chromosomal microarray (CMA) and prenatal exome sequencing (ES)

What does this study add?

Our results revealed limited online information aimed at parents about CMA and ES

The information we did identify was lacking the details recommended by professional guidelines, had low quality scores, and was written at an advanced level

Improvements to online information for parents are needed to support informed decision‐making regarding prenatal genetic tests

Quality of web-based information at the beginning of a global pandemic: a cross-sectional infodemiology study investigating preventive measures and self care methods of the coronavirus disease 2019

Background

reducing the spread and impact epidemics and pandemics requires that members of the general population change their behaviors according to the recommendations, restrictions and laws provided by leading authorities. When a new epidemic or pandemic emerges, people are faced with the challenge of sorting through a great volume of varied information. Therefore, the dissemination of high-quality web-based information is essential during this time period. The overarching aim was to investigate the quality of web-based information about preventive measures and self care methods at the beginning of the COVID-19 pandemic.

Methods

in May 2020, consumer-oriented websites written in Swedish were identified via systematic searches in Google (n = 76). Websites were assessed with inductive content analysis, the JAMA benchmarks, the QUEST tool and the DISCERN instrument.

Results

seven categories and 33 subcategories were identified concerning preventive measures (md = 6.0 subcategories), with few specifying a method for washing hands (n = 4), when to sanitize the hands (n = 4), and a method for sanitizing the hands (n = 1). Eight categories and 30 subcategories were identified concerning self care methods (md = 3.0 subcategories), with few referring to the national number for telephone-based counseling (n = 20) and an online symptom assessment tool (n = 16). Overall, the median total quality scores were low (JAMA = 0/4, QUEST =13/28, DISCERN = 29/80).

Conclusions

at the beginning of the pandemic, substantial quality deficits of websites about COVID-19 may have counteracted the public recommendations for preventive measures. This illustrates a critical need for standardized and systematic routines on how to achieve dissemination of high-quality web-based information when new epidemics and pandemics emerge.

Supplementary Information

The online version contains supplementary material available at 10.1186/s12889-021-11141-9.

Quality and readability of internet information about stuttering

PURPOSE

We examined the quality and readability of English-language Internet information about stuttering and evaluated the results considering recommendations by experts in health literacy.

METHOD

A search of Internet websites containing information about stuttering was conducted. Three key words (i.e., stuttering, stammering, speech disfluency) were entered into five country-specific versions of the most commonly used Internet search engine. A total of 79 websites were assessed. Their origin (commercial, non-profit, government, personal or university), quality [Health On the Net (HON) certification and DISCERN scores], and readability [Flesch Reading Ease (FRE) score, Flesch-Kincaid Grade Level Formula (F-KGL), and Simple Measure of Gobbledygook (SMOG)] were assessed.

RESULTS

Of the 79 websites, 38 % were of commercial, 42 % were of nonprofit organization, 15 % were of government and 5% were of university origins, respectively. Only 13 % had obtained HON certification and the mean DISCERN scores was 3.10 in a 5-point scale. The mean reading grade levels were at 13th and 14th grade and 100 % of the websites exceeded the recommended 5th to 6th reading grade level for health information.

CONCLUSIONS

The quality of Internet-based health information about the treatment of stuttering is generally adequate, but actual usability of the sites examined in this study may be limited due to poor readability levels. This is problematic in persons with poor literacy skills. Since the Internet can be readily accessed as a valuable consumer information resource, speech-language pathologists and other healthcare professionals have an opportunity to direct consumers to websites that provide readable information of good quality.

Self-care promotion of the intact (non-circumcised) patient: A review of available recommendations

PURPOSE

With routine infant circumcision rates declining in the United States, nurses are likely to encounter more intact (non-circumcised) male patients requiring genital hygiene, nursing interventions, and education accessing the health system. To date, a little emphasis has been placed on the care of the intact male patient in the nursing literature, resulting in ambiguity in care recommendations. The vagueness is problematic, as improper intact care, particularly in the pediatric patient, can result in forced retraction injuries, bleeding, scarring, and unnecessary intervention. In addition, with nurses conducting many of the tasks of hygiene and education for self-care, there is potential for impaired patient self-care and harm if nurses are not knowledgeable in intact care. Utilizing Orem's self-care theory as a framework, the aim of this effort is to perform a review of current recommendations on intact care to inform nursing practice with this population. As no evidence was found in the scientific literature, readily available consumer website resources were reviewed.

CONCLUSION

Themes of hygiene and age of retraction emerged. While recommendations for hygiene practices were variable, all review sources (n = 12) were clear in advising against the premature retraction of the intact foreskin and identified this as a route for injury.

PRACTICE IMPLICATIONS

With no current literature available to summarize current nursing clinical or educational practices, dissemination of these recommendations is necessary to prevent patient injury and promote appropriate patient self-care.

Online resources for family caregivers of cognitively competent patients: A review of user-driven reputable health website content on caregiver communication with health professionals

OBJECTIVE

Most patients want their family involved in consultations and decisions, however some family caregivers report feeling overwhelmed and unsure of their role. As caregivers are increasingly looking to medical websites for guidance, this study aimed to review reputable web-resources available to inform family caregivers on how to be involved in medical consultations and decisions.

METHODS

Google searches were performed using lay search strings, to imitate how a cancer caregiver may locate information. Relevant webpages were included if they were directed at caregivers and from a reputable health organisation. Qualitative content analyses were performed on the included webpages.

RESULTS

22 webpages were included and 8 were directed at caregivers of cancer patients. Six key categories of information were identified: preparing for consultations, helping during consultations, advocating for the patient, decision-making, communicating in hospital settings, and communicating with family and friends.

CONCLUSION

A range of online resources were found to guide family caregivers, particularly cancer caregivers, on involvement in consultations. However, few provided information to caregivers on complex situations such as treatment decision-making, advocating for patient's needs, and communicating in a hospital setting.

PRACTICE IMPLICATIONS

Clinicians can actively refer family caregivers to online resources that support caregiver communication in medical settings.

Quality and readability of English-language Internet information for vestibular disorders

BACKGROUND:

The Internet has become a powerful, accessible resource for many patients to use for their own medical management and knowledge. Vestibular disorders are prevalent, especially in the elderly. As the Internet is increasingly a major source of health-related information to the general public, it is often used to search for information regarding dizziness and vertigo. Ensuring that the information is accessible, unbiased, and appropriate can aid informed decision-making.

OBJECTIVE:

To evaluate the quality and readability of English-language Internet information related to vestibular disorders.

METHODS:

A cross-sectional website search using three keywords (nausea, dizziness, and vertigo) in five country-specific versions of the most commonly used Internet search engine was conducted in March 2018. The language was limited to English for all websites. Quality was assessed by presence of Health on the Net (HON) certification and DISCERN scores. Readability was assessed using the Flesch Reading Ease (FRE) score, Flesch-Kincaid Grade Level Formula (F-KGL), and Simple Measure of Gobbledygook (SMOG).

RESULTS:

In total, 112 websites were included and analyzed. The majority were commercial (61%) websites. A total of 42% had obtained HON certification. No association was found between the presence of HON certification and the resource of the website. The DISCERN scores had a mean of 2.52 (SD 1.1). Readability measures indicated that an average of 14–18 years of education was required to read and understand the Internet information provided regarding vestibular disorders.

CONCLUSIONS:

To ensure the accessible to the general population, it is necessary to improve the quality and readability of Internet-based information regarding vestibular disorders.

Quality of consumer-oriented websites containing information about the second trimester ultrasound examination during pregnancy

Background

Providing information about prenatal tests is a clinical challenge and the public frequently accesses the Web to read pregnancy-related information. The overarching aim of this study was to investigate the quality of consumer-oriented websites addressing obstetric ultrasound examination in the second trimester of pregnancy.

Methods

Swedish websites were identified with Google, using 20 search strings and screening 400 hits (n = 71 included websites). Reliability and information about the examination were assessed with the DISCERN instrument, completeness was assessed according to national guidelines, and readability analyzed with the Readability Index. Popularity was determined with the ALEXA tool and search rank was determined according to Google hit lists.

Results

The mean total DISCERN score was 29.7/80 (SD 11.4), with > 50% having low quality for 15 of the 16 questions. The mean completeness score was 6.8/24 (SD 4.5). The Readability Index ranged between 22 and 63, with a mean of 42.7 (SD 6.8), indicating difficult readability. Weak and non-significant correlations were observed between ALEXA/search rank and the investigated quality variables, except for search rank and reliability.

Conclusions

The quality of consumer-oriented websites addressing the second trimester ultrasound examination is low. Health professionals need to discuss this with expectant parents considering undergoing the examination. There is a need for efforts that aim to improve the poor quality of online sources in the field of prenatal examinations.

Quality of websites about long-acting reversible contraception: a descriptive cross-sectional study

Background

Today, there are various short- and long-acting contraceptive alternatives available for those who wish to prevent unintended pregnancy. Long-acting reversible contraception are considered effective methods with a high user satisfaction. High-quality information about contraception is essential in order to empower individuals to reach informed decisions based on sufficient knowledge. Use of the Web for information about contraception is widespread, and there is a risk that those who use it for this purpose could come in contact with sources of low quality.

Objective

The overarching aim was to investigate the quality of websites about long-acting reversible contraception.

Methods

Swedish client-oriented websites were identified through searches in Google (n = 46 included websites). Reliability and information about long-acting reversible contraceptive choices were assessed by two assessors with the DISCERN instrument, transparency was analyzed with the Journal of the American Medical Association benchmarks, completeness was assessed with inductive content analysis and readability was analyzed with Readability Index.

Results

The mean DISCERN was 44.1/80 (SD 7.7) for total score, 19.7/40 (SD 3.7) for reliability, 22.1/35 (SD 4.1) for information about long-acting reversible contraceptive choices, and 2.3/5 (SD 1.1) for overall quality. A majority of the included websites had low quality with regard to what sources were used to compile the information (n = 41/46, 89%), when the information was produced (n = 40/46, 87%), and if it provided additional sources of support and information (n = 30/46, 65%). Less than half of the websites adhered to any of the JAMA benchmarks. We identified 23 categories of comprehensiveness. The most frequent was contraceptive mechanism (n = 39/46, 85%) and the least frequent was when contraception may be initiated following an abortion (n = 3/46, 7%). The mean Readability Index was 42.5 (SD 6.3, Range 29–55) indicating moderate to difficult readability levels, corresponding to a grade level of 9.

Conclusions

The quality of client-oriented websites about long-acting reversible contraception is poor. There is an undeniable need to support and guide laypersons that intend to use web-based sources about contraceptive alternatives, so that they may reach informed decisions based on sufficient knowledge.

Quality of web pages about second-trimester medical abortion: A cross-sectional study of readability, comprehensiveness, and transparency

AIMS

To investigate the readability, comprehensiveness and transparency of web pages about medical abortion in the second trimester of pregnancy.

DESIGN

A cross-sectional descriptive study of Swedish web pages.

METHODS

Six systematic searches were performed in Google during January 2017. The first 10 hits of each search were screened, resulting in 46 included Swedish web pages. The web pages were analyzed with readability index (LIX) to investigate readability, inductive manifest content analysis to investigate comprehensiveness, and Journal of the Medical Association benchmarks to investigate transparency.

RESULTS

Median LIX was 29.0 and the largest proportion had LIX 31-40 (N = 17), indicating moderate readability. Visual components were observed in 13 websites. Content analysis resulted in 12 categories illustrating comprehensiveness, but eight of these were only included in ≤50% web pages. With regard to transparency, 29 (63%) adhered to no benchmark, 15 (33%) adhered to one benchmark, and 2 (4%) adhered to two benchmarks. Most web pages were written or reviewed by laypersons (N = 25) and health professionals (N = 11).

CONCLUSION

The results indicate that web pages about medical abortion have moderate readability, varied comprehensiveness and poor transparency.

IMPACT

Health professionals need to acknowledge the risk of contact with web-based information about poor quality. There is a need for research that aims to increase the chances that patients encounter high-quality web-based information about medical abortion in the second trimester of pregnancy.

Supporting Self-Management in Bipolar Disorder: Mixed-Methods Knowledge Translation Study

BACKGROUND

Self-management is increasingly recognized as an important method through which individuals with bipolar disorder (BD) may cope with symptoms and improve quality of life. Digital health technologies have strong potential as a method to support the application of evidence-informed self-management strategies in BD. Little is known, however, about how to most effectively maximize user engagement with digital platforms.

OBJECTIVE

The aims of this study were (1) to create an innovative Web-based Bipolar Wellness Centre, (2) to conduct a mixed-methods (ie, quantitative and qualitative) evaluation to assess the impact of different sorts of engagement (ie, knowledge translation [KT]), and (3) to support engagement with the self-management information in the Bipolar Wellness Centre.

METHODS

The project was implemented in 2 phases. In phase 1, community-based participatory research and user-centered design methods were used to develop a website (Bipolar Wellness Centre) housing evidence-informed tools and strategies for self-management of BD. In phase 2, a mixed-methods evaluation was conducted to explore the potential impact of 4 KT strategies (Web-based webinars, Web-based videos, Web-based one-to-one Living Library peer support, and in-person workshops). Quantitative assessments occurred at 2 time points-preintervention and 3 weeks postintervention. Purposive sampling was used to recruit a subsample of participants for the qualitative interviews, ensuring each KT modality was represented, and interviews occurred approximately 3 weeks postintervention.

RESULTS

A total of 94 participants were included in the quantitative analysis. Responses to evaluative questions about engagement were broadly positive. When averaged across the 4 KT strategies, significant improvements were observed on the Bipolar Recovery Questionnaire (F_1,77=5.887; P=.02) and Quality of Life in Bipolar Disorder (F_1,77=8.212; P=.005). Nonsignificant improvements in positive affect and negative affect were also observed. The sole difference that emerged between KT strategies related to the Chronic Disease Self-Efficacy measure, which decreased after participation in the webinar and video arms but increased after the Living Library and workshop arms. A subsample of 43 participants was included in the qualitative analyses, with the majority of participants describing positive experiences with the 4 KT strategies; peer contact was emphasized as a benefit across all strategies. Infrequent negative experiences were reported in relation to the webinar and video strategies, and included technical difficulties, the academic tone of webinars, and feeling unable to relate to the actor in the videos.

CONCLUSIONS

This study adds incremental evidence to a growing literature that suggests digital health technologies can provide effective support for self-management for people with BD. The finding that KT strategies could differentially impact chronic disease self-efficacy (hypothesized as being a product of differences in degree of peer contact) warrants further exploration. Implications of the findings for the development of evidence-informed apps for BD are discussed in this paper.