Assessment of content completeness and accuracy of prostate cancer patient education materials

Assessment of online information on robotic cardiac and thoracic surgery

Online health resources are important for patients seeking perioperative information on robotic cardiac and thoracic surgery. The value of the resources depends on their readability, accuracy, content, quality, and suitability for patient use. We systematically assess current online health information on robotic cardiac and thoracic surgery. Systematic online searches were performed to identify websites discussing robotic cardiac and thoracic surgery. For each website, readability was measured by nine standardized tests, and accuracy and content were assessed by an independent panel of two robotic cardiothoracic surgeons. Quality and suitability of websites were evaluated using the DISCERN and Suitability Assessment of Materials tools, respectively. A total of 220 websites (120 cardiac, and 100 thoracic) were evaluated. Both robotic cardiac and thoracic surgery websites were very difficult to read with mean readability scores of 13.8 and 14.0 (p = 0.97), respectively, requiring at least 13 years of education to be comprehended. Both robotic cardiac and thoracic surgery websites had similar accuracy, amount of content, quality, and suitability (p > 0.05). On multivariable regression, academic websites [Exp (B)], 2.25; 95% confidence interval [CI], 1.60-3.16; P < 0.001), and websites with higher amount of content [Exp (B)],1.73; 95% CI, 1.24-2.41; P < 0.001) were associated with higher accuracy. There was no association between readability of websites and accuracy [Exp (B)], 1.04; 95% CI, 0.90-1.21; P = 0.57). Online information on robotic cardiac and thoracic surgery websites overestimate patients' understanding and require at least 13 years of education to be comprehended. As website accuracy is not associated with ease of reading, the readability of online resources can be improved without compromising accuracy.

The Quality of Patient Information Booklets for Cancer Patients-an Evaluation of Free Accessible Material in German Language

According to the information-seeking behaviors of patients, booklets which can be downloaded from the Internet for free are an important source of information notably for patients with cancer. This study investigated whether information booklets for patients with cancer available at German websites are in accordance with the formal and content criteria of evidence-based information. We compared and compiled both content and formal criteria by matching different national and international standards for written patient information using a merged instrument. A catalog with a total of 16 items within 4 categories (quality of the publication, quality of information, quality of information representation, and transparency) was created. Patient information booklets for the most frequent tumor types were collected from the Internet. A total of 52 different patient booklets were downloaded and assessed. Overall, no booklet fulfilled all criteria. The quality of the publications was evaluated with an average value of 1.67 while the quality of the information had a mean value of 1.45, and the quality of information presentation had a similar rating (1.39). The transparency criteria were evaluated as lowest with an average of 1.07. In summary, German booklets for cancer patients have some shortcomings concerning formal and content criteria for evidence-based patient information. The applied requirement catalog is suitable for wide use and may help in quality assurance of health information. It may be used as part of an obligatory external evaluation, which could help improving the quality of health information.

Reading grade level and completeness of freely available materials on thyroid nodules: there is work to be done

BACKGROUND

Patient education is one of the key components required for patients to participate in decision making for their care. Sources of information should be complete and understandable. The objective of this study was to assess the quality and reading grade level of freely available materials pertaining to the evaluation and treatment of thyroid nodules.

METHODS

All available materials were gathered through a comprehensive Internet search or direct contact with each identified organization associated with thyroid care. Materials meeting inclusion criteria were assessed for completeness of content and reading grade level using the SMOG readability formula. Then, the DISCERN instrument was utilized to assess the quality of the five materials which had the best (lowest) and the five materials that had the worst (highest) SMOG reading grade levels.

RESULTS

A total of 63 materials on thyroid nodule evaluation and management were identified. A minority of materials presented readers with a complete picture of the topic, describing both benefits and cautions of thyroid nodule evaluation, benefits and cautions of fine-needle thyroid nodule biopsy, or risks, benefits, and long-term effects of thyroidectomy. The SMOG reading grade level assessment was well above recommended levels. The range was eighth grade to college level; the mean and median reading grade level were 13. Lastly, the DISCERN instrument revealed that most of the materials with both the best and the worst reading grade levels assessed had "extensive or serious shortcomings" that would impede their usefulness as high-quality sources of information regarding management options.

CONCLUSIONS

Existing thyroid nodule evaluation and management materials have serious shortcomings. Future work should focus on the development of patient materials that are both grade level appropriate and meet the DISCERN criteria for topic completeness and accuracy.

Beyond reading level: a systematic review of the suitability of cancer education print and Web-based materials

Consideration of categories related to reading comprehension--beyond reading level--is imperative to reach low literacy populations effectively. "Suitability" has been proposed as a term to encompass six categories of such factors: content, literacy demand graphics, layout/typography, learning stimulation, and cultural appropriateness. Our purpose was to describe instruments used to evaluate categories of suitability in cancer education materials in published reports and their findings. We searched databases and reference lists for evaluations of print and Web-based cancer education materials to identify and describe measures of these categories. Studies had to evaluate reading level and at least one category of suitability. Eleven studies met our criteria. Seven studies reported inter-rater reliability. Cultural appropriateness was most often assessed; four instruments assessed only surface aspects of cultural appropriateness. Only two of seven instruments used, the suitability assessment of materials (SAM) and the comprehensibility assessment of materials (SAM + CAM), were described as having any evidence of validity. Studies using Simplified Measure of Goobledygook (SMOG) and Fry reported higher average reading level scores than those using Flesh-Kincaid. Most materials failed criteria for reading level and cultural appropriateness. We recommend more emphasis on the categories of suitability for those developing cancer education materials and more study of these categories and reliability and validity testing of instruments.