1
|
Sayfi S, Charide R, Elliott SA, Hartling L, Munan M, Stallwood L, Butcher NJ, Richards DP, Mathew JL, Suvada J, Akl EA, Kredo T, Mbuagbaw L, Motilall A, Baba A, Scott SD, Falavigna M, Klugar M, Friessová T, Lotfi T, Stevens A, Offringa M, Schünemann HJ, Pottie K. A multimethods randomized trial found that plain language versions improved adults understanding of health recommendations. J Clin Epidemiol 2024; 165:111219. [PMID: 38008266 DOI: 10.1016/j.jclinepi.2023.11.009] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/10/2023] [Revised: 10/17/2023] [Accepted: 11/17/2023] [Indexed: 11/28/2023]
Abstract
OBJECTIVES To make informed decisions, the general population should have access to accessible and understandable health recommendations. To compare understanding, accessibility, usability, satisfaction, intention to implement, and preference of adults provided with a digital "Plain Language Recommendation" (PLR) format vs. the original "Standard Language Version" (SLV). STUDY DESIGN AND SETTING An allocation-concealed, blinded, controlled superiority trial and a qualitative study to understand participant preferences. An international on-line survey. 488 adults with some English proficiency. 67.8% of participants identified as female, 62.3% were from the Americas, 70.1% identified as white, 32.2% had a bachelor's degree as their highest completed education, and 42% said they were very comfortable reading health information. In collaboration with patient partners, advisors, and the Cochrane Consumer Network, we developed a plain language format of guideline recommendations (PLRs) to compare their effectiveness vs. the original standard language versions (SLVs) as published in the source guideline. We selected two recommendations about COVID-19 vaccine, similar in their content, to compare our versions, one from the World Health Organization (WHO) and one from Centers for Disease Control and Prevention (CDC). The primary outcome was understanding, measured as the proportion of correct responses to seven comprehension questions. Secondary outcomes were accessibility, usability, satisfaction, preference, and intended behavior, measured on a 1-7 scale. RESULTS Participants randomized to the PLR group had a higher proportion of correct responses to the understanding questions for the WHO recommendation (mean difference [MD] of 19.8%, 95% confidence interval [CI] 14.7-24.9%; P < 0.001) but this difference was smaller and not statistically significant for the CDC recommendation (MD of 3.9%, 95% CI -0.7% to 8.3%; P = 0.096). However, regardless of the recommendation, participants found the PLRs more accessible, (MD of 1.2 on the seven-point scale, 95% CI 0.9-1.4%; P < 0.001) and more satisfying (MD of 1.2, 95% CI 0.9-1.4%; P < 0.001). They were also more likely to follow the recommendation if they had not already followed it (MD of 1.2, 95% CI 0.7-1.8%; P < 0.001) and share it with other people they know (MD of 1.9, 95% CI 0.5-1.2%; P < 0.001). There was no significant difference in the preference between the two formats (MD of -0.3, 95% CI -0.5% to 0.03%; P = 0.078). The qualitative interviews supported and contextualized these findings. CONCLUSION Health information provided in a PLR format improved understanding, accessibility, usability, and satisfaction and thereby has the potential to shape public decision-making behavior.
Collapse
Affiliation(s)
- Shahab Sayfi
- Department of Biology, Faculty of Science, University of Ottawa, Ottawa, Ontario K1N 6N5, Canada; Schulich School of Medicine & Dentistry, Western University, London, Ontario N6A 5C1, Canada; Department of Health Research Methods, Evidence and Impact, Michael G. DeGroote Cochrane Canada and GRADE Centres, McMaster University, 1280 Main St. W., Hamilton, Ontario L8S 4K1, Canada
| | - Rana Charide
- Department of Health Research Methods, Evidence and Impact, Michael G. DeGroote Cochrane Canada and GRADE Centres, McMaster University, 1280 Main St. W., Hamilton, Ontario L8S 4K1, Canada
| | - Sarah A Elliott
- Department of Pediatrics, Faculty of Medicine and Dentistry, Alberta Research Center for Health Evidence, University of Alberta, Edmonton, Alberta, Canada; Cochrane Child Health, University of Alberta, Edmonton, Alberta, Canada
| | - Lisa Hartling
- Department of Pediatrics, Faculty of Medicine and Dentistry, Alberta Research Center for Health Evidence, University of Alberta, Edmonton, Alberta, Canada; Cochrane Child Health, University of Alberta, Edmonton, Alberta, Canada
| | - Matthew Munan
- Department of Pediatrics, Faculty of Medicine and Dentistry, Alberta Research Center for Health Evidence, University of Alberta, Edmonton, Alberta, Canada
| | - Lisa Stallwood
- Child Health Evaluative Sciences, The Hospital for Sick Children Research Institute, Toronto, Ontario M5G 0A4, Canada
| | - Nancy J Butcher
- Child Health Evaluative Sciences, The Hospital for Sick Children Research Institute, Toronto, Ontario M5G 0A4, Canada; Department of Psychiatry, University of Toronto, Toronto, Ontario M5T 1R8, Canada
| | | | - Joseph L Mathew
- Postgraduate Institute of Medical Education and Research, Chandigarh, India
| | - Jozef Suvada
- National Evidence and Quality Platform, St. Elizabeth University of Public Health and Social Science, Research Dept., Nam. 1. Maja 1, 81000 Bratislava, Slovak Republic; Experts Consortium for COVID-19, Advisor to Government of Slovak Republic, Bratislava, Slovak Republic; WHO Executive Board, Geneva, Switzerland
| | - Elie A Akl
- Department of Health Research Methods, Evidence and Impact, Michael G. DeGroote Cochrane Canada and GRADE Centres, McMaster University, 1280 Main St. W., Hamilton, Ontario L8S 4K1, Canada; Department of Internal Medicine, American University of Beirut, Beirut, Lebanon
| | - Tamara Kredo
- Cochrane South Africa, South African Medical Research Council, Capetown, South Africa; Division of Epidemiology and Biostatistics, Department of Global Health, Faculty of Medicine and Health Sciences, Stellenbosch University, Stellenbosch, South Africa
| | - Lawrence Mbuagbaw
- Department of Health Research Methods, Evidence and Impact, Michael G. DeGroote Cochrane Canada and GRADE Centres, McMaster University, 1280 Main St. W., Hamilton, Ontario L8S 4K1, Canada; Department of Anesthesia, McMaster University, Hamilton, Ontario, Canada; Department of Pediatrics, McMaster University, Hamilton, Ontario, Canada; Biostatistics Unit, Father Sean O'Sullivan Research Centre, St Joseph's Healthcare, Hamilton, Ontario, Canada; Centre for Development of Best Practices in Health (CDBPH), Yaoundé Central Hospital, Yaoundé, Cameroon; Division of Epidemiology and Biostatistics, Department of Global Health, Stellenbosch University, Cape Town, South Africa
| | - Ashley Motilall
- Department of Health Research Methods, Evidence and Impact, Michael G. DeGroote Cochrane Canada and GRADE Centres, McMaster University, 1280 Main St. W., Hamilton, Ontario L8S 4K1, Canada
| | - Ami Baba
- Child Health Evaluative Sciences, The Hospital for Sick Children Research Institute, Toronto, Ontario M5G 0A4, Canada
| | - Shannon D Scott
- Faculty of Nursing, University of Alberta, Edmonton, Alberta, Canada
| | - Maicon Falavigna
- National Institute for Health Technology Assessment, Federal University of Rio Grande do Sul, Porto Alegre, Brazil
| | - Miloslav Klugar
- Czech National Centre for Evidence-Based Healthcare and Knowledge Translation (Cochrane Czech Republic, Czech EBHC: JBI Centre of Excellence, Masaryk University GRADE Centre), Institute of Biostatistics and Analyses, Faculty of Medicine, Masaryk University, 625 00 Brno, Czech Republic; Institute of Health Information and Statistics of the Czech Republic, Prague, Czech Republic
| | - Tereza Friessová
- Department of Health Sciences, Faculty of Medicine, Masaryk University, Brno, Czech Republic
| | - Tamara Lotfi
- Department of Health Research Methods, Evidence and Impact, Michael G. DeGroote Cochrane Canada and GRADE Centres, McMaster University, 1280 Main St. W., Hamilton, Ontario L8S 4K1, Canada
| | - Adrienne Stevens
- Centre for Immunization Readiness, Public Health Agency of Canada, Ottawa, Ontario K1A 0K9, Canada
| | - Martin Offringa
- Child Health Evaluative Sciences, The Hospital for Sick Children Research Institute, Toronto, Ontario M5G 0A4, Canada; Institute of Health Policy, Management and Evaluation, University of Toronto, Toronto, Ontario M5T 3M6, Canada; Division of Neonatology, The Hospital for Sick Children, University of Toronto, Toronto, Ontario M5G 1X8, Canada
| | - Holger J Schünemann
- Department of Health Research Methods, Evidence and Impact, Michael G. DeGroote Cochrane Canada and GRADE Centres, McMaster University, 1280 Main St. W., Hamilton, Ontario L8S 4K1, Canada; Department of Biomedical Sciences, Humanitas University, Milan, Italy.
| | - Kevin Pottie
- Schulich School of Medicine & Dentistry, Western University, London, Ontario N6A 5C1, Canada; Department of Family Medicine, Western University, London, Ontario, Canada.
| |
Collapse
|
2
|
Charide R, Stallwood L, Munan M, Sayfi S, Hartling L, Butcher NJ, Offringa M, Elliott S, Richards DP, Mathew JL, Akl EA, Kredo T, Mbuagbaw L, Motillal A, Baba A, Prebeg M, Relihan J, Scott SD, Suvada J, Falavigna M, Klugar M, Lotfi T, Stevens A, Pottie K, Schünemann HJ. Knowledge mobilization activities to support decision-making by youth, parents, and adults using a systematic and living map of evidence and recommendations on COVID-19: protocol for three randomized controlled trials and qualitative user-experience studies. Trials 2023; 24:27. [PMID: 36641457 PMCID: PMC9840541 DOI: 10.1186/s13063-023-07067-9] [Citation(s) in RCA: 3] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/08/2022] [Accepted: 01/03/2023] [Indexed: 01/15/2023] Open
Abstract
INTRODUCTION The COVID-19 pandemic underlined that guidelines and recommendations must be made more accessible and more understandable to the general public to improve health outcomes. The objective of this study is to evaluate, quantify, and compare the public's understanding, usability, satisfaction, intention to implement, and preference for different ways of presenting COVID-19 health recommendations derived from the COVID-19 Living Map of Recommendations and Gateway to Contextualization (RecMap). METHODS AND ANALYSIS This is a protocol for a multi-method study. Through an online survey, we will conduct pragmatic allocation-concealed, blinded superiority randomized controlled trials (RCTs) in three populations to test alternative formats of presenting health recommendations: adults, parents, and youth, with at least 240 participants in each population. Prior to initiating the RCT, our interventions will have been refined with relevant stakeholder input. The intervention arm will receive a plain language recommendation (PLR) format while the control arm will receive the corresponding original recommendation format as originally published by the guideline organizations (standard language version). Our primary outcome is understanding, and our secondary outcomes are accessibility and usability, satisfaction, intended behavior, and preference for the recommendation formats. Each population's results will be analyzed separately. However, we are planning a meta-analysis of the results across populations. At the end of each survey, participants will be invited to participate in an optional one-on-one, virtual semi-structured interview to explore their user experience. All interviews will be transcribed and analyzed using the principles of thematic analysis and a hybrid inductive and deductive approach. ETHICS AND DISSEMINATION Through Clinical Trials Ontario, the Hamilton Integrated Research Ethics Board has reviewed and approved this protocol (Project ID: 3856). The University of Alberta has approved the parent portion of the trial (Project ID:00114894). Findings from this study will be disseminated through open-access publications in peer-reviewed journals and using social media. TRIAL REGISTRATION Clinicaltrials.gov NCT05358990 . Registered on May 3, 2022.
Collapse
Affiliation(s)
- Rana Charide
- grid.25073.330000 0004 1936 8227Michael G. DeGroote Cochrane Canada and McMaster GRADE Centres, Department of Health Research Methods, Evidence and Impact, McMaster University, 1280 Main St. W, Hamilton, Ontario L8S 4K1 Canada
| | - Lisa Stallwood
- grid.42327.300000 0004 0473 9646Child Health Evaluative Sciences, The Hospital for Sick Children Research Institute, Toronto, Ontario Canada
| | - Matthew Munan
- grid.17089.370000 0001 2190 316XAlberta Research Centre for Health Evidence, Department of Pediatrics, Faculty of Medicine and Dentistry, University of Alberta, Edmonton, Alberta Canada
| | - Shahab Sayfi
- grid.39381.300000 0004 1936 8884Schulich School of Medicine & Dentistry, Western University, London, Ontario Canada
| | - Lisa Hartling
- grid.17089.370000 0001 2190 316XAlberta Research Centre for Health Evidence, Department of Pediatrics, Faculty of Medicine and Dentistry, University of Alberta, Edmonton, Alberta Canada ,grid.17089.370000 0001 2190 316XCochrane Child Health, Department of Pediatrics, University of Alberta, Edmonton, Alberta Canada
| | - Nancy J. Butcher
- grid.42327.300000 0004 0473 9646Child Health Evaluative Sciences, The Hospital for Sick Children Research Institute, Toronto, Ontario Canada ,grid.17063.330000 0001 2157 2938Department of Psychiatry, University of Toronto, Toronto, Ontario Canada
| | - Martin Offringa
- grid.42327.300000 0004 0473 9646Child Health Evaluative Sciences, The Hospital for Sick Children Research Institute, Toronto, Ontario Canada ,grid.17063.330000 0001 2157 2938Institute of Health Policy, Management and Evaluation, University of Toronto, Toronto, Ontario Canada ,grid.42327.300000 0004 0473 9646Division of Neonatology, The Hospital for Sick Children, Toronto, Ontario Canada
| | - Sarah Elliott
- grid.17089.370000 0001 2190 316XAlberta Research Centre for Health Evidence, Department of Pediatrics, Faculty of Medicine and Dentistry, University of Alberta, Edmonton, Alberta Canada ,grid.17089.370000 0001 2190 316XCochrane Child Health, Department of Pediatrics, University of Alberta, Edmonton, Alberta Canada
| | - Dawn P. Richards
- Five02 Labs Inc, Toronto, Ontario Canada ,grid.498672.6Canadian Arthritis Patient Alliance, Toronto, Ontario Canada
| | - Joseph L. Mathew
- grid.415131.30000 0004 1767 2903Postgraduate Institute of Medical Education and Research, Chandigarh, India
| | - Elie A. Akl
- grid.25073.330000 0004 1936 8227Michael G. DeGroote Cochrane Canada and McMaster GRADE Centres, Department of Health Research Methods, Evidence and Impact, McMaster University, 1280 Main St. W, Hamilton, Ontario L8S 4K1 Canada ,grid.22903.3a0000 0004 1936 9801Department of Internal Medicine, American University of Beirut, Beirut, Lebanon
| | - Tamara Kredo
- grid.415021.30000 0000 9155 0024Cochrane South Africa, South African Medical Research Council, Cape Town, South Africa ,grid.11956.3a0000 0001 2214 904XDivision of Clinical Pharmacology, Department of Medicine and Division of Epidemiology and Biostatistics, Department of Global Health, Faculty of Medicine and Health Sciences, Stellenbosch University, Stellenbosch, South Africa
| | - Lawrence Mbuagbaw
- grid.25073.330000 0004 1936 8227Michael G. DeGroote Cochrane Canada and McMaster GRADE Centres, Department of Health Research Methods, Evidence and Impact, McMaster University, 1280 Main St. W, Hamilton, Ontario L8S 4K1 Canada ,grid.25073.330000 0004 1936 8227Department of Anesthesia, McMaster University, Hamilton, Ontario Canada ,grid.25073.330000 0004 1936 8227Department of Pediatrics, McMaster University, Hamilton, Ontario Canada ,grid.416721.70000 0001 0742 7355Biostatistics Unit, Father Sean O’Sullivan Research Centre, St Joseph’s Healthcare, Hamilton, Ontario Canada ,grid.460723.40000 0004 0647 4688Centre for Development of Best Practices in Health (CDBPH), Yaoundé Central Hospital, Yaoundé, Cameroon ,grid.11956.3a0000 0001 2214 904XDivision of Epidemiology and Biostatistics, Department of Global Health, Stellenbosch University, Cape Town, South Africa
| | - Ashley Motillal
- grid.25073.330000 0004 1936 8227Michael G. DeGroote Cochrane Canada and McMaster GRADE Centres, Department of Health Research Methods, Evidence and Impact, McMaster University, 1280 Main St. W, Hamilton, Ontario L8S 4K1 Canada
| | - Ami Baba
- grid.42327.300000 0004 0473 9646Child Health Evaluative Sciences, The Hospital for Sick Children Research Institute, Toronto, Ontario Canada
| | - Matthew Prebeg
- grid.155956.b0000 0000 8793 5925Centre for Addiction and Mental Health, Toronto, Ontario Canada
| | - Jacqueline Relihan
- grid.155956.b0000 0000 8793 5925Centre for Addiction and Mental Health, Toronto, Ontario Canada
| | - Shannon D. Scott
- grid.17089.370000 0001 2190 316XFaculty of Nursing, University of Alberta, Edmonton, Alberta Canada
| | - Jozef Suvada
- Departments of Science and International Studies, St. Elizabeth University of Public Health and Social Science, Bratislava, Slovak Republic
| | - Maicon Falavigna
- grid.8532.c0000 0001 2200 7498National Institute for Health Technology Assessment, Federal University of Rio Grande do Sul, Porto Alegre, Brazil
| | - Miloslav Klugar
- grid.10267.320000 0001 2194 0956Czech National Centre for Evidence-Based Healthcare and Knowledge Translation (Cochrane Czech Republic, Czech EBHC: JBI Centre of Excellence, Masaryk University GRADE Centre), Institute of Biostatistics and Analyses, Faculty of Medicine, Masaryk University, 625 00 Brno, Czech Republic
| | - Tamara Lotfi
- grid.25073.330000 0004 1936 8227Michael G. DeGroote Cochrane Canada and McMaster GRADE Centres, Department of Health Research Methods, Evidence and Impact, McMaster University, 1280 Main St. W, Hamilton, Ontario L8S 4K1 Canada
| | - Adrienne Stevens
- grid.415368.d0000 0001 0805 4386Centre for Immunization Readiness, Public Health Agency of Canada, Ottawa, Canada
| | - Kevin Pottie
- grid.39381.300000 0004 1936 8884Schulich School of Medicine & Dentistry, Western University, London, Ontario Canada ,grid.39381.300000 0004 1936 8884Department of Family Medicine, Western University, London, Ontario Canada
| | - Holger J. Schünemann
- grid.25073.330000 0004 1936 8227Michael G. DeGroote Cochrane Canada and McMaster GRADE Centres, Department of Health Research Methods, Evidence and Impact, McMaster University, 1280 Main St. W, Hamilton, Ontario L8S 4K1 Canada ,grid.452490.eDepartment of Biomedical Sciences, Humanitas University, Milan, Italy
| |
Collapse
|