1
|
Frennesson NF, McQuire C, Aijaz Khan S, Barnett J, Zuccolo L. Evaluating Messaging on Prenatal Health Behaviors Using Social Media Data: Systematic Review. J Med Internet Res 2023; 25:e44912. [PMID: 38117557 PMCID: PMC10765287 DOI: 10.2196/44912] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/08/2022] [Revised: 10/27/2023] [Accepted: 11/29/2023] [Indexed: 12/21/2023] Open
Abstract
BACKGROUND Social media platforms are increasingly being used to disseminate messages about prenatal health. However, to date, we lack a systematic assessment of how to evaluate the impact of official prenatal health messaging and campaigns using social media data. OBJECTIVE This study aims to review both the published and gray literature on how official prenatal health messaging and campaigns have been evaluated to date in terms of impact, acceptability, effectiveness, and unintended consequences, using social media data. METHODS A total of 6 electronic databases were searched and supplemented with the hand-searching of reference lists. Both published and gray literature were eligible for review. Data were analyzed using content analysis for descriptive data and a thematic synthesis approach to summarize qualitative evidence. A quality appraisal tool, designed especially for use with social media data, was used to assess the quality of the included articles. RESULTS A total of 11 studies were eligible for the review. The results showed that the most common prenatal health behavior targeted was alcohol consumption, and Facebook was the most commonly used source of social media data. The majority (n=6) of articles used social media data for descriptive purposes only. The results also showed that there was a lack of evaluation of the effectiveness, acceptability, and unintended consequences of the prenatal health message or campaign. CONCLUSIONS Social media is a widely used and potentially valuable resource for communicating and evaluating prenatal health messaging. However, this review suggests that there is a need to develop and adopt sound methodology on how to evaluate prenatal health messaging using social media data, for the benefit of future research and to inform public health practice.
Collapse
Affiliation(s)
- Nessie Felicia Frennesson
- Tobacco and Alcohol Research Group, School of Psychological Science, University of Bristol, Bristol, United Kingdom
| | - Cheryl McQuire
- Centre for Public Health, Bristol Medical School, University of Bristol, Bristol, United Kingdom
- National Institute for Health and Care Research, School for Public Health Research, Newcastle, United Kingdom
| | - Saher Aijaz Khan
- Population Health Sciences, Bristol Medical School, University of Bristol, Bristol, United Kingdom
| | - Julie Barnett
- Department of Psychology, University of Bath, Bath, United Kingdom
| | - Luisa Zuccolo
- Population Health Sciences, Bristol Medical School, University of Bristol, Bristol, United Kingdom
- Health Data Science Centre, Human Technopole, Milan, Italy
- Medical Research Council Integrative Epidemiology Unit, University of Bristol, Bristol, United Kingdom
| |
Collapse
|
2
|
Ceretti E, Covolo L, Cappellini F, Nanni A, Sorosina S, Beatini A, Taranto M, Gasparini A, De Castro P, Brusaferro S, Gelatti U. Evaluating the effectiveness of Internet-based communication for public health: a systematic review (Preprint). J Med Internet Res 2022; 24:e38541. [PMID: 36098994 PMCID: PMC9516364 DOI: 10.2196/38541] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/06/2022] [Revised: 06/13/2022] [Accepted: 07/19/2022] [Indexed: 11/13/2022] Open
Abstract
Background Communicating strategically is a key issue for health organizations. Over the past decade, health care communication via social media and websites has generated a great deal of studies examining different realities of communication strategies. However, when it comes to systematic reviews, there is fragmentary evidence on this type of communication. Objective The aim of this systematic review was to summarize the evidence on web institutional health communication for public health authorities to evaluate possible aim-specific key points based on these existing studies. Methods Guided by the PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) statement, we conducted a comprehensive review across 2 electronic databases (PubMed and Web of Science) from January 1, 2011, to October 7, 2021, searching for studies investigating institutional health communication. In total, 2 independent researchers (AN and SS) reviewed the articles for inclusion, and the assessment of methodological quality was based on the Kmet appraisal checklist. Results A total of 78 articles were selected. Most studies (35/78, 45%) targeted health promotion and disease prevention, followed by crisis communication (24/78, 31%), general health (13/78, 17%), and misinformation correction and health promotion (6/78, 8%). Engagement and message framing were the most analyzed aspects. Few studies (14/78, 18%) focused on campaign effectiveness. Only 23% (18/78) of the studies had an experimental design. The Kmet evaluation was used to distinguish studies presenting a solid structure from lacking studies. In particular, considering the 0.75-point threshold, 36% (28/78) of the studies were excluded. Studies above this threshold were used to identify a series of aim-specific and medium-specific suggestions as the communication strategies used differed greatly. Conclusions Overall, the findings suggest that no single strategy works best in the case of web-based health care communication. The extreme variability of outcomes and the lack of a unitary measure for assessing the end points of a specific campaign or study lead us to reconsider the tools we use to evaluate the efficacy of web-based health communication.
Collapse
Affiliation(s)
- Elisabetta Ceretti
- Section of Public Health and Human Sciences, Department of Medical and Surgical Specialties, Radiological Sciences and Public Health, University of Brescia, Brescia, Italy
| | - Loredana Covolo
- Section of Public Health and Human Sciences, Department of Medical and Surgical Specialties, Radiological Sciences and Public Health, University of Brescia, Brescia, Italy
| | - Francesca Cappellini
- Section of Public Health and Human Sciences, Department of Medical and Surgical Specialties, Radiological Sciences and Public Health, University of Brescia, Brescia, Italy
| | - Alberto Nanni
- Post-graduate School of Public Health, University of Brescia, Brescia, Italy
| | - Sara Sorosina
- Post-graduate School of Public Health, University of Brescia, Brescia, Italy
| | - Andrea Beatini
- Post-graduate School of Public Health, University of Brescia, Brescia, Italy
| | | | | | | | | | - Umberto Gelatti
- Section of Public Health and Human Sciences, Department of Medical and Surgical Specialties, Radiological Sciences and Public Health, University of Brescia, Brescia, Italy
| |
Collapse
|
3
|
Schwarzman J, Bauman A, Gabbe BJ, Rissel C, Shilton T, Smith BJ. How practitioner, organisational and system-level factors act to influence health promotion evaluation capacity: Validation of a conceptual framework. EVALUATION AND PROGRAM PLANNING 2022; 91:102019. [PMID: 34756707 DOI: 10.1016/j.evalprogplan.2021.102019] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/28/2020] [Revised: 10/04/2021] [Accepted: 10/17/2021] [Indexed: 06/13/2023]
Abstract
The need to improve the practice and quality of evaluation in the health promotion and disease prevention field is widely recognised. In order to plan, implement and evaluate health promotion evaluation capacity building efforts, there is a need to better understand the practitioner, organisational and system-level determinants of evaluation capacity and practice. This study aimed to assess the validity Evaluation Practice Analysis Survey (EPAS) constructs using confirmatory factor analysis and validate a conceptual framework of health promotion evaluation capacity using path analysis. Experienced Australian health promotion practitioners completed the survey (n = 219). Twenty-one of the original 23 EPAS scales were assessed as reliable and valid. The final model was found to have good fit (χ214 = 18.72, p = 0.18, root mean square error of approximation = 0.04, 90% CI 0.00-0.82, Comparative Fit Index = 1.00, standardised root mean square residual = 0.04). This model supports the role of the organisation in facilitating evaluation practice through leadership, culture, systems, support and resources. It builds on existing frameworks from other fields to incorporate political, funding and administrative factors. This study provides an evidence-based model of evaluation capacity that organisations, funders and policy makers can use to plan and implement more effective evaluation capacity building strategies within organisations and the wider prevention field.
Collapse
Affiliation(s)
- Joanna Schwarzman
- School of Public Health and Preventive Medicine, Monash University, 553 St Kilda Road, Melbourne, VIC 3004, Australia.
| | - Adrian Bauman
- Prevention Research Collaboration, School of Public Health, The University of Sydney, Sydney, NSW 2006, Australia
| | - Belinda J Gabbe
- School of Public Health and Preventive Medicine, Monash University, 553 St Kilda Road, Melbourne, VIC 3004, Australia; Health Data Research UK, Swansea University Medical School, Swansea University, Singleton Park, Swansea SA2 8PP, Wales, UK
| | - Chris Rissel
- Prevention Research Collaboration, School of Public Health, The University of Sydney, Sydney, NSW 2006, Australia
| | - Trevor Shilton
- School of Public Health, Curtin University, Kent Street, Bentley, WA 6102, Australia; National Heart Foundation of Australia, 334 Rokeby Road, Subiaco, WA 6008, Australia
| | - Ben J Smith
- School of Public Health and Preventive Medicine, Monash University, 553 St Kilda Road, Melbourne, VIC 3004, Australia; Prevention Research Collaboration, School of Public Health, The University of Sydney, Sydney, NSW 2006, Australia
| |
Collapse
|
4
|
Rivera YM, Moran MB, Thrul J, Joshu C, Smith KC. Contextualizing Engagement With Health Information on Facebook: Using the Social Media Content and Context Elicitation Method. J Med Internet Res 2022; 24:e25243. [PMID: 35254266 PMCID: PMC8933799 DOI: 10.2196/25243] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/25/2020] [Revised: 08/07/2021] [Accepted: 12/27/2021] [Indexed: 11/13/2022] Open
Abstract
Background
Most of what is known regarding health information engagement on social media stems from quantitative methodologies. Public health literature often quantifies engagement by measuring likes, comments, and/or shares of posts within health organizations’ Facebook pages. However, this content may not represent the health information (and misinformation) generally available to and consumed by platform users. Furthermore, some individuals may prefer to engage with information without leaving quantifiable digital traces. Mixed methods approaches may provide a way of surpassing the constraints of assessing engagement with health information by using only currently available social media metrics.
Objective
This study aims to discuss the limitations of current approaches in assessing health information engagement on Facebook and presents the social media content and context elicitation method, a qualitatively driven, mixed methods approach to understanding engagement with health information and how engagement may lead to subsequent actions.
Methods
Data collection, management, and analysis using the social media content and context elicitation method are presented. This method was developed for a broader study exploring how and why US Latinos and Latinas engage with cancer prevention and screening information on Facebook. The study included 20 participants aged between 40 and 75 years without cancer who participated in semistructured, in-depth interviews to discuss their Facebook use and engagement with cancer information on the platform. Participants accessed their Facebook account alongside the researcher, typed cancer in the search bar, and discussed cancer-related posts they engaged with during the previous 12 months. Engagement was defined as liking, commenting, and/or sharing a post; clicking on a post link; reading an article in a post; and/or watching a video within a post. Content engagement prompted questions regarding the reasons for engagement and whether engagement triggered further action. Data were managed using MAXQDA (VERBI GmbH) and analyzed using thematic and content analyses.
Results
Data emerging from the social media content and context elicitation method demonstrated that participants mainly engaged with cancer prevention and screening information by viewing and/or reading content (48/66, 73%) without liking, commenting, or sharing it. This method provided rich content regarding how US Latinos and Latinas engage with and act upon cancer prevention and screening information on Facebook. We present 2 emblematic cases from the main study to exemplify the additional information and context elicited from this methodology, which is currently lacking from quantitative approaches.
Conclusions
The social media content and context elicitation method allows a better representation and deeper contextualization of how people engage with and act upon health information and misinformation encountered on social media. This method may be applied to future studies regarding how to best communicate health information on social media, including how these affect assessments of message credibility and accuracy, which can influence health outcomes.
Collapse
Affiliation(s)
- Yonaira M Rivera
- Department of Communication, School of Communication & Information, Rutgers University, New Brunswick, NJ, United States
- Cancer Prevention and Control Program, Rutgers Cancer Institute of New Jersey, New Brusnwick, NJ, United States
| | - Meghan B Moran
- Department of Health, Behavior & Society, Johns Hopkins Bloomberg School of Public Health, Baltimore, MD, United States
| | - Johannes Thrul
- Department of Mental Health, Johns Hopkins Bloomberg School of Public Health, Baltimore, MD, United States
| | - Corinne Joshu
- Department of Epidemiology, Johns Hopkins Bloomberg School of Public Health, Baltimore, MD, United States
| | - Katherine C Smith
- Department of Health, Behavior & Society, Johns Hopkins Bloomberg School of Public Health, Baltimore, MD, United States
| |
Collapse
|
5
|
De Santis KK, Jahnel T, Mergenthal L, Zeeb H, Matthias K. Evaluation of Digital Interventions for Physical Activity Promotion: Protocol for a Scoping Review. JMIR Res Protoc 2022; 11:e35332. [PMID: 35238321 PMCID: PMC8931641 DOI: 10.2196/35332] [Citation(s) in RCA: 5] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/01/2021] [Revised: 01/12/2022] [Accepted: 02/03/2022] [Indexed: 12/24/2022] Open
Abstract
Background Digital interventions (DIs) could support physical activity (PA) promotion, according to recent reviews. However, it remains unclear if and how DIs for PA promotion are evaluated; thus, it is unclear if they support behavior change in real-world settings. A mapping of evidence from published reviews is required to focus on the evaluation of DIs for PA promotion. Objective The aim of our study is to investigate evaluation strategies for any outcome in the context of DIs for PA promotion by conducting a scoping review of published reviews. Methods Our scoping review adheres to the PRISMA-ScR (Preferred Reporting Items for Systematic Reviews and Meta-Analyses extension for Scoping Reviews) guidelines. The information sources include bibliographic databases (MEDLINE, PsycINFO, and CINAHL) and the bibliographies of the selected studies. The electronic search strategy was developed and conducted in collaboration with an experienced database specialist. The electronic search was conducted in English with no limits up to March 19, 2021, for sources with the terms digital intervention AND evaluation AND physical activity in titles or abstracts. After deduplication, 300 reviews selected from 4912 search results were assessed for eligibility by 2 authors working independently. The inclusion criteria were (1) healthy or clinical samples (population), (2) DIs for PA promotion (intervention), (3) comparisons to any other intervention or no intervention (comparison), (4) evaluation strategies (methods, results, or frameworks) for any outcome in the context of DIs for PA promotion (outcome), and (5) any published review (study type). According to the consensus reached during a discussion, 40 reviews met the inclusion criteria—36 from the electronic search and 4 from the manual search of the bibliographies of the 36 reviews. All reviews reported the evaluation strategies for any outcomes in the context of DIs for PA promotion in healthy or clinical samples. Data coding and the quality appraisal of systematic reviews are currently being performed independently by 2 authors. Results Our scoping review includes data from 40 published reviews (1 rapid review, 9 scoping reviews, and 30 systematic reviews). The focus of data coding is on evaluation strategies in the context of DIs for PA promotion and on the critical appraisal of the included systematic reviews. The final consensus regarding all data is expected in early 2022. Conclusions Interventions for PA promotion that are supported by digital technologies require evaluation to ensure their efficacy in real-world settings. Our scoping review is needed because it addresses novel objectives that focus on such evaluations and are not answered in the published reviews identified in our search. The evaluation strategies addressing DIs for PA promotion will be mapped to synthesize the results that have been reported in published reviews so far. International Registered Report Identifier (IRRID) DERR1-10.2196/35332
Collapse
Affiliation(s)
- Karina Karolina De Santis
- Department of Prevention and Evaluation, Leibniz Institute for Prevention Research and Epidemiology - BIPS, Bremen, Germany
| | - Tina Jahnel
- Department of Prevention and Evaluation, Leibniz Institute for Prevention Research and Epidemiology - BIPS, Bremen, Germany.,Faculty 11 Human and Health Sciences, University of Bremen, Bremen, Germany
| | - Lea Mergenthal
- Department of Prevention and Evaluation, Leibniz Institute for Prevention Research and Epidemiology - BIPS, Bremen, Germany
| | - Hajo Zeeb
- Department of Prevention and Evaluation, Leibniz Institute for Prevention Research and Epidemiology - BIPS, Bremen, Germany
| | - Katja Matthias
- Faculty of Electrical Engineering and Computer Science, University of Applied Science Stralsund, Stralsund, Germany
| |
Collapse
|
6
|
Webb M, Carrotte ER, Flego A, Vincent B, Lee-Bates B, Heath J, Blanchard M. Safety, Acceptability, and Initial Effectiveness of a Novel Digital Suicide Prevention Campaign Challenging Perceived Burdensomeness. CRISIS 2022. [PMID: 35086355 DOI: 10.1027/0227-5910/a000840] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/23/2022]
Abstract
Background: Better Off With You is a peer-to-peer, digital suicide prevention campaign pilot designed to challenge the idea of perceived burdensomeness; the schema experienced by many people contemplating suicide that they are a burden on others. Aims: To investigate the safety, acceptability, and initial effectiveness of the campaign. Method: This mixed methods pilot involved a general community sample (N = 157), from targeted sites within two Australian communities. Data were collected at baseline and after 1-week exposure to the campaign videos and website. Qualitative interviews were conducted with a subset of participants (N = 15). Results: Participants rated the campaign as highly engaging and relevant to local communities. In interviews, participants identified the campaign as being unique, safe, and impactful. Overall, exposure to Better Off With You did not result in any notable changes in perceived burdensomeness, psychological distress, or help-seeking. Limitations: The pilot involved a community sample. As such, outcome measurement scores were low at baseline. Conclusion: This pilot provides new insights about the safety, engagement and initial effectiveness of the Better Off With You campaign. Future research is needed to explore its impact on people experiencing suicidal ideation.
Collapse
Affiliation(s)
- Marianne Webb
- Anne Deveson Research Centre, SANE Australia, Carlton, VIC, Australia
| | - Elise R Carrotte
- Anne Deveson Research Centre, SANE Australia, Carlton, VIC, Australia
| | - Anna Flego
- Anne Deveson Research Centre, SANE Australia, Carlton, VIC, Australia
| | - Bonnie Vincent
- Anne Deveson Research Centre, SANE Australia, Carlton, VIC, Australia
| | | | - Jack Heath
- Anne Deveson Research Centre, SANE Australia, Carlton, VIC, Australia
| | - Michelle Blanchard
- Anne Deveson Research Centre, SANE Australia, Carlton, VIC, Australia.,Faculty of Medicine, Dentistry and Health Sciences, School of Psychological Sciences, University of Melbourne, VIC, Australia
| |
Collapse
|
7
|
Lim MSC, Molenaar A, Brennan L, Reid M, McCaffrey T. Young Adults' Use of Different Social Media Platforms for Health Information: Insights From Web-Based Conversations. J Med Internet Res 2022; 24:e23656. [PMID: 35040796 PMCID: PMC8808344 DOI: 10.2196/23656] [Citation(s) in RCA: 35] [Impact Index Per Article: 17.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/07/2020] [Revised: 02/03/2021] [Accepted: 11/19/2021] [Indexed: 12/20/2022] Open
Abstract
Background Social media–delivered health promotion has demonstrated limited uptake and effectiveness among young adults. Understanding how young adults interact with existing social media platforms for health might provide insight for future health promotion interventions. Objective The aim of this study is to describe how young adults interact with different social media platforms for health and health information. Methods We used a web-based conversation methodology to collect data from 165 young adults aged 18 to 24 years. Participants participated in an extended conversation with moderators and other participants about health and social media. They were prompted to discuss how they find health information, how they use different social media platforms, and how they evaluate the trustworthiness of information. A thematic qualitative analysis was applied to the data. Results Young adults spent a lot of time scrolling through Facebook newsfeeds, which often resulted in seeing health-related content either from their friends, news sources, or advertisements. Some actively sought out information about specific health areas by joining groups or following relevant pages. YouTube was considered a useful source for learning about everything and was often the go-to when searching for information or advice (after Google). Young adults found the video format easy to learn from. They stated that they could identify accurate YouTube health content by cross-checking multiple videos, by feeling that the presenter was real and relatable, or just through instinctively judging a video’s credibility. Instagram was a source of inspiration for health and wellness from those whose lives were dedicated to healthy lifestyles and fitness. Twitter, Tumblr, and Snapchat were rarely used for health information. Conclusions Most young adults obtain health information from social media, both actively and through passive exposure. Participants indicated looking to social media influencers for health and lifestyle inspiration and judged the credibility of sources by appearance and instinct. Health experts should try to use the channels in the way that young adults already use them; use relatable role models on Instagram and YouTube, eye-catching headlines and support groups on Facebook, and easy to follow instruction videos via YouTube. International Registered Report Identifier (IRRID) RR2-10.1111/1747-0080.12448
Collapse
Affiliation(s)
- Megan S C Lim
- Burnet Institute, Melbourne, Australia.,Monash University, Melbourne, Australia.,University of Melbourne, Melbourne, Australia
| | | | | | - Mike Reid
- RMIT University, Melbourne, Australia
| | | |
Collapse
|
8
|
Carrotte ER, Webb M, Flego A, Vincent B, Heath J, Blanchard M. Acceptability, Safety, and Resonance of the Pilot Digital Suicide Prevention Campaign "Better Off With You": Qualitative Study. JMIR Form Res 2021; 5:e23892. [PMID: 33656441 PMCID: PMC7970163 DOI: 10.2196/23892] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/03/2020] [Revised: 12/14/2020] [Accepted: 01/17/2021] [Indexed: 01/26/2023] Open
Abstract
Background The Interpersonal Theory of Suicide posits that there are three key elements of suicidal behavior: perceived burdensomeness, thwarted belongingness, and the acquired capability for suicide. The digital campaign Better Off With You was developed to directly challenge the idea of perceived burdensomeness among people who are contemplating suicide in 2 communities within Australia. Objective The aim of this study is to explore the needs and preferences of people with lived experience of suicidal thoughts and actions to inform the development of Better Off With You. Methods This study involved a series of focus groups that aimed to discuss campaign messaging, scope, and approach. People with lived experience of suicidal thoughts and actions attended the focus groups. After the completion of initial focus groups, the results informed the creation of campaign collateral by creative agencies. Early versions of the campaign collateral were then presented in the user testing sessions. Transcriptions were analyzed via thematic analysis. Results In total, 13 participants attended the focus groups and 14 attended the user testing sessions. The following three overarching themes were presented: acceptability, safety, and resonance. Participants believed that suicide is a serious and ongoing issue in their communities and welcomed a localized suicide prevention focus via peer-to-peer storytelling. The idea of perceived burdensomeness required clarification but was perceived as acceptable and relevant. Participants seemed drawn toward peer narratives that they perceived to be authentic, genuine, and believable as given by real people with lived experience. Campaign messaging needs to be clear and empathetic while directly talking about suicide. Participants did not anticipate any significant negative or harmful impact from any campaign videos and highlighted the importance of providing appropriate help-seeking information. Conclusions This iterative study provided important insights and knowledge about peer-to-peer storytelling in suicide prevention campaigns. Future campaigns should involve simple messaging, be validating and empathetic, and consider including a lived experience perspective.
Collapse
Affiliation(s)
| | - Marianne Webb
- Anne Deveson Research Centre, SANE Australia, South Melbourne, Australia
| | - Anna Flego
- Anne Deveson Research Centre, SANE Australia, South Melbourne, Australia
| | - Bonnie Vincent
- Anne Deveson Research Centre, SANE Australia, South Melbourne, Australia
| | - Jack Heath
- Anne Deveson Research Centre, SANE Australia, South Melbourne, Australia
| | - Michelle Blanchard
- Anne Deveson Research Centre, SANE Australia, South Melbourne, Australia.,Melbourne School of Psychological Sciences, The University of Melbourne, Melbourne, Australia
| |
Collapse
|
9
|
Miller S, Keenan C, Hanratty J, Hamilton J, Coughlan C, Mackie P, Fitzpatrick S, Maddock A. PROTOCOL: Improving access to health and social services for individuals experiencing, or at risk of experiencing, homelessness. CAMPBELL SYSTEMATIC REVIEWS 2020; 16:e1118. [PMID: 37016614 PMCID: PMC8356276 DOI: 10.1002/cl2.1118] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Indexed: 06/19/2023]
Affiliation(s)
- Sarah Miller
- Centre for Evidence and Social Innovation, Campbell UK & IrelandQueen's University BelfastBelfastUK
| | - Ciara Keenan
- School of Geography and PlanningCardiff UniversityCardiffUK
| | - Jennifer Hanratty
- Institute for Social Policy, Housing, Environment and Real Estate (I‐SPHERE)Heriot‐Watt UniversityEdinburghUK
| | - Jayne Hamilton
- Centre for Evidence and Social Innovation, Campbell UK & IrelandQueen's University BelfastBelfastUK
| | - Christopher Coughlan
- Centre for Evidence and Social Innovation, Campbell UK & IrelandQueen's University BelfastBelfastUK
| | - Peter Mackie
- School of Geography and PlanningCardiff UniversityCardiffUK
| | - Suzanne Fitzpatrick
- Institute for Social Policy, Housing, Environment and Real Estate (I‐SPHERE)Heriot‐Watt UniversityEdinburghUK
| | - Alan Maddock
- School of Social Sciences, Education and Social WorkQueen's University BelfastBelfastUK
| |
Collapse
|
10
|
Chan L, O'Hara B, Phongsavan P, Bauman A, Freeman B. Review of Evaluation Metrics Used in Digital and Traditional Tobacco Control Campaigns. J Med Internet Res 2020; 22:e17432. [PMID: 32348272 PMCID: PMC7448186 DOI: 10.2196/17432] [Citation(s) in RCA: 17] [Impact Index Per Article: 4.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/12/2019] [Revised: 02/12/2020] [Accepted: 02/21/2020] [Indexed: 12/13/2022] Open
Abstract
BACKGROUND Mass media campaigns for public health are increasingly using digital media platforms, such as web-based advertising and social media; however, there is a lack of evidence on how to best use these digital platforms for public health campaigns. To generate this evidence, appropriate campaign evaluations are needed, but with the proliferation of digital media-related metrics, there is no clear consensus on which evaluation metrics should be used. Public health campaigns are diverse in nature, so to facilitate analysis, this review has selected tobacco control campaigns as the scope of the study. OBJECTIVE This literature review aimed to examine how tobacco control campaigns that use traditional and digital media platforms have been evaluated. METHODS Medicine and science databases (Medical Literature Analysis and Retrieval System Online [MEDLINE], EMBASE, PsycINFO, Cumulative Index to Nursing and Allied Health Literature [CINAHL], and Scopus), and a marketing case study database (World Advertising Research Center) were searched for articles published between 2013 and 2018. Two authors established the eligibility criteria and reviewed articles for inclusion. Individual campaigns were identified from the articles, and information on campaigns and their evaluations were supplemented with searches on Google, Google Scholar, and social media platforms. Data about campaign evaluations were tabulated and mapped to a conceptual framework. RESULTS In total, 17 campaigns were included in this review, with evaluations reported on by 51 articles, 17 marketing reports, and 4 grey literature reports. Most campaigns were from English-speaking countries, with behavioral change as the primary objective. In the process evaluations, a wide range of metrics were used to assess the reach of digital campaign activities, making comparison between campaigns difficult. Every campaign in the review, except one, reported some type of engagement impact measure, with website visits being the most commonly reported metric (11 of the 17 campaigns). Other commonly reported evaluation measures identified in this review include engagement on social media, changes in attitudes, and number of people contacting smoking cessation services. Of note, only 7 of the 17 campaigns attempted to measure media platform attribution, for example, by asking participants where they recalled seeing the campaign or using unique website tracking codes for ads on different media platforms. CONCLUSIONS One of the key findings of this review is the numerous and diverse range of measures and metrics used in tobacco control campaign evaluations. To address this issue, we propose principles to guide the selection of digital media-related metrics for campaign evaluations, and also outline a conceptual framework to provide a coherent organization to the diverse range of metrics. Future research is needed to specifically investigate whether engagement metrics are associated with desired campaign outcomes, to determine whether reporting of engagement metrics is meaningful in campaign evaluations.
Collapse
Affiliation(s)
- Lilian Chan
- Sydney School of Public Health and Charles Perkins Centre, Prevention Research Collaboration, The University of Sydney, Camperdown, Australia
| | - Blythe O'Hara
- Sydney School of Public Health and Charles Perkins Centre, Prevention Research Collaboration, The University of Sydney, Camperdown, Australia
| | - Philayrath Phongsavan
- Sydney School of Public Health and Charles Perkins Centre, Prevention Research Collaboration, The University of Sydney, Camperdown, Australia
| | - Adrian Bauman
- Sydney School of Public Health and Charles Perkins Centre, Prevention Research Collaboration, The University of Sydney, Camperdown, Australia
| | - Becky Freeman
- Sydney School of Public Health and Charles Perkins Centre, Prevention Research Collaboration, The University of Sydney, Camperdown, Australia
| |
Collapse
|
11
|
Young LE, Soliz S, Xu JJ, Young SD. A review of social media analytic tools and their applications to evaluate activity and engagement in online sexual health interventions. Prev Med Rep 2020; 19:101158. [PMID: 32685364 PMCID: PMC7358714 DOI: 10.1016/j.pmedr.2020.101158] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/19/2019] [Revised: 06/25/2020] [Accepted: 06/28/2020] [Indexed: 11/05/2022] Open
Abstract
Social media analytic tools offer ways to evaluate online sex health interventions. Most tools measure reach, aggregate activity, and page- and post-level engagement. User-level activity and engagement metrics are rarely provided. Various metrics comprising composite engagement scores are difficult to discern. Most tools have limited or no capabilities in text and social network analytics.
Unprecedented public engagement with social media has provided viable and culturally relevant platforms for application in sexual health interventions, yet there are concerns that methods for evaluating engagement in these interventions have not kept pace with their implementation. More recently, the rise of social media analytics (SMA) and online marketing has spawned the development of analytic tools that boast promise for such a task. In this paper, we review a sample of the most popular of these tools, paying particular attention to: (1) the social media platforms that can be analyzed; (2) analytic capabilities; and (3) measures of engagement. We follow this with a review of sexual health intervention studies that apply these tools in evaluation efforts. Our findings suggest that these tools have numerous analytic capabilities that would be useful for evaluating interventions more efficiently. However, in nearly all cases, the tools we reviewed alone would not be sufficient to fully grasp engagement dynamics, as they need to be complemented with additional tools for textual analysis and social network analysis. Therefore, we consider this fertile ground for future collaborations between software developers and behavioral health scientists to develop more comprehensive analytic platforms with applications for public health research.
Collapse
Affiliation(s)
- Lindsay E Young
- Annenberg School for Communication and Journalism, University of Southern California, Los Angeles, CA, United States
| | - Stephanie Soliz
- School of Social Work, University of Washington, Seattle, United States
| | - Jackie Jingyi Xu
- Annenberg School for Communication and Journalism, University of Southern California, Los Angeles, CA, United States
| | - Sean D Young
- Department of Informatics, Donald Bren School of Information and Computer Sciences, University of California, Irvine, CA, United States
| |
Collapse
|
12
|
Fynn JF, Hardeman W, Milton K, Jones AP. A scoping review of evaluation frameworks and their applicability to real-world physical activity and dietary change programme evaluation. BMC Public Health 2020; 20:1000. [PMID: 32586301 PMCID: PMC7318477 DOI: 10.1186/s12889-020-09062-0] [Citation(s) in RCA: 12] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/20/2019] [Accepted: 06/05/2020] [Indexed: 02/02/2023] Open
Abstract
BACKGROUND Physical activity and dietary change programmes play a central role in addressing public health priorities. Programme evaluation contributes to the evidence-base about these programmes; and helps justify and inform policy, programme and funding decisions. A range of evaluation frameworks have been published, but there is uncertainty about their usability and applicability to different programmes and evaluation objectives, and the extent to which they are appropriate for practitioner-led or researcher-led evaluation. This review appraises the frameworks that may be applicable to evaluation of physical activity and/or dietary change programmes, and develops a typology of the frameworks to help guide decision making by practitioners, commissioners and evaluators. METHODS A scoping review approach was used. This included a systematic search and consultation with evaluation experts to identify evaluation frameworks and to develop a set of evaluation components to appraise them. Data related to each framework's general characteristics and components were extracted. This was used to construct a typology of the frameworks based on their intended programme type, evaluation objective and format. Each framework was then mapped against the evaluation components to generate an overview of the guidance included within each framework. RESULTS The review identified 71 frameworks. These were described variously in terms of purpose, content, or applicability to different programme contexts. The mapping of frameworks highlighted areas of overlap and strengths and limitations in the available guidance. Gaps within the frameworks which may warrant further development included guidance on participatory approaches, non-health and unanticipated outcomes, wider contextual and implementation factors, and sustainability. CONCLUSIONS Our typology and mapping signpost to frameworks where guidance on specific components can be found, where there is overlap, and where there are gaps in the guidance. Practitioners and evaluators can use these to identify, agree upon and apply appropriate frameworks. Researchers can use them to identify evaluation components where there is already guidance available and where further development may be useful. This should help focus research efforts where it is most needed and promote the uptake and use of evaluation frameworks in practice to improve the quality of evaluation and reporting.
Collapse
Affiliation(s)
- Judith F Fynn
- UKCRC Centre for Diet and Activity Research (CEDAR) and Norwich Medical School, University of East Anglia, Norwich, UK.
| | - Wendy Hardeman
- School of Health Sciences, University of East Anglia, Norwich, UK
| | - Karen Milton
- Norwich Medical School, University of East Anglia, Norwich, UK
| | - Andy P Jones
- UKCRC Centre for Diet and Activity Research (CEDAR) and Norwich Medical School, University of East Anglia, Norwich, UK
| |
Collapse
|
13
|
Paterson M, Whitty M, Boyer C. An overview of digital and online strategies to reduce gambling harm. Health Promot J Austr 2020; 32:248-257. [PMID: 32246884 DOI: 10.1002/hpja.341] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/18/2019] [Revised: 02/18/2020] [Accepted: 03/24/2020] [Indexed: 01/06/2023] Open
Abstract
ISSUE ADDRESSED Advancements in mobile- and web-based technologies proliferate everyday opportunities to gamble. The increased availability, popularity and intensity of online gambling platforms and interactive gaming activities also changes the way we construct gambling harm reduction interventions. Information and communication technologies (ICT) provide potential opportunities to reduce harm from online gambling through harm minimisation initiatives and currently available services. The aim of this review was to firstly understand the scope of peer-reviewed evidence on ICT-based strategies to reduce online gambling harm, and secondly, what evidence exists specifically in relation to ICT-based harm reduction initiatives for people who gamble online. METHODS Scoping review methods and a five-stage model of analysis were used to: identify the published literature on ICT-based harm minimisation activities for online gambling; distil models appropriate to address gambling harm in this setting; and synthesise all available evidence, noting gaps and patterns. RESULTS Sixteen gambling-specific ICT-based interventions were reviewed in depth. The majority of included studies focused on different components of computer-assisted or online therapy programs for disordered gambling, specifically the development of individual skills in managing problematic gambling behaviour. CONCLUSIONS The review found that despite the widespread potential ICT represent for addressing gambling harm there has been only limited published research to date. SO WHAT There is a clear need for further investigation into uptake, usage, focus and effectiveness of all online gambling interventions on offer. The dearth of gambling-specific empirical knowledge potentially indicates a serious resourcing and reporting issues in this area.
Collapse
Affiliation(s)
- Marisa Paterson
- Centre for Gambling Research, ANU Centre for Social Research and Methods, Research School of Social Sciences, ANU College of Arts and Social Sciences, Australian National University, Canberra, ACT, Australia
| | - Megan Whitty
- Centre for Gambling Research, ANU Centre for Social Research and Methods, Research School of Social Sciences, ANU College of Arts and Social Sciences, Australian National University, Canberra, ACT, Australia
| | - Charlotte Boyer
- Centre for Gambling Research, ANU Centre for Social Research and Methods, Research School of Social Sciences, ANU College of Arts and Social Sciences, Australian National University, Canberra, ACT, Australia
| |
Collapse
|
14
|
Schwarzman J, Nau T, Bauman A, Gabbe BJ, Rissel C, Shilton T, Smith BJ. An assessment of program evaluation methods and quality in Australian prevention agencies. Health Promot J Austr 2019; 31:456-467. [PMID: 31408247 DOI: 10.1002/hpja.287] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/26/2019] [Accepted: 08/06/2019] [Indexed: 11/11/2022] Open
Abstract
ISSUE ADDRESSED This study aimed to examine evaluation methods and quality in Australian health promotion agencies and the factors associated with this. The evidence base for prevention strategies is limited, with the evidence generated through program evaluation by health promotion and disease prevention agencies lacking rigour. Despite the need to improve the quality of evaluation, there is limited evidence of what influences evaluation quality in the prevention field. METHODS Data were collected using the Evaluation Practice Analysis Survey and an audit and appraisal of evaluation reports. Descriptive analysis was used to examine evaluation characteristics and multivariable regression was used to explore the association between evaluation and organisational attributes and evaluation quality. RESULTS In total, 392 evaluation reports were reviewed from 78 government and non-government agencies. Process evaluation was conducted most frequently, followed by impact evaluation. Overall evaluation quality was low (median 24.5%). In multivariable regression analysis, only two factors were associated with evaluation quality: health promotion budget (ratio of geometric means 1.53 [95% CI 1.02-2.29]); and, conducting statewide or national prevention programs (1.38 [95% CI 1.05-1.82]). CONCLUSIONS The findings show that the potential to improve evaluation quality is greatest in smaller organisations that deliver health promotion at a local or regional scale. SO WHAT?: By improving the rigour of existing evaluation, there is opportunity to build the evidence base for prevention strategies, which highlights the importance of embedding the enablers of program learning and evidence generation within health promotion and prevention organisations.
Collapse
Affiliation(s)
- Joanna Schwarzman
- School of Public Health and Preventive Medicine, Monash University, Melbourne, VIC, Australia
| | - Tracy Nau
- School of Public Health and Preventive Medicine, Monash University, Melbourne, VIC, Australia.,Prevention Research Collaboration, Sydney School of Public Health, The University of Sydney, Sydney, NSW, Australia
| | - Adrian Bauman
- Prevention Research Collaboration, Sydney School of Public Health, The University of Sydney, Sydney, NSW, Australia
| | - Belinda J Gabbe
- School of Public Health and Preventive Medicine, Monash University, Melbourne, VIC, Australia.,Health Data Research UK, Swansea University Medical School, Swansea University, Swansea, Wales, UK
| | - Chris Rissel
- Prevention Research Collaboration, Sydney School of Public Health, The University of Sydney, Sydney, NSW, Australia
| | - Trevor Shilton
- School of Public Health, Curtin University, Bentley, WA, Australia.,National Heart Foundation of Australia, Subiaco, WA, Australia
| | - Ben J Smith
- School of Public Health and Preventive Medicine, Monash University, Melbourne, VIC, Australia.,Prevention Research Collaboration, Sydney School of Public Health, The University of Sydney, Sydney, NSW, Australia
| |
Collapse
|
15
|
Schwarzman J, Bauman A, Gabbe BJ, Rissel C, Shilton T, Smith BJ. Understanding the factors that influence health promotion evaluation: The development and validation of the evaluation practice analysis survey. EVALUATION AND PROGRAM PLANNING 2019; 74:76-83. [PMID: 30928767 DOI: 10.1016/j.evalprogplan.2019.03.002] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/31/2018] [Revised: 01/22/2019] [Accepted: 03/18/2019] [Indexed: 06/09/2023]
Abstract
The demand for improved quality of health promotion evaluation and greater capacity to undertake evaluation is growing, yet evidence of the challenges and facilitators to evaluation practice within the health promotion field is lacking. A limited number of evaluation capacity measurement instruments have been validated in government or non-government organisations (NGO), however there is no instrument designed for health promotion organisations. This study aimed to develop and validate an Evaluation Practice Analysis Survey (EPAS) to examine evaluation practices in health promotion organisations. Qualitative interviews, existing frameworks and instruments informed the survey development. Health promotion practitioners from government agencies and NGOs completed the survey (n = 169). Principal components analysis was used to determine scale structure and Cronbach's α used to estimate internal reliability. Logistic regression was conducted to assess predictive validity of selected EPAS scale. The final survey instrument included 25 scales (125 items). The EPAS demonstrated good internal reliability (α > 0.7) for 23 scales. Dedicated resources and time for evaluation, leadership, organisational culture and internal support for evaluation showed promising predictive validity. The EPAS can be used to describe elements of evaluation capacity at the individual, organisational and system levels and to guide initiatives to improve evaluation practice in health promotion organisations.
Collapse
Affiliation(s)
- Joanna Schwarzman
- School of Public Health and Preventive Medicine, Monash University, 553 St Kilda Road, Melbourne, VIC, 3004, Australia.
| | - Adrian Bauman
- Prevention Research Collaboration, School of Public Health, The University of Sydney, Sydney, NSW 2006, Australia
| | - Belinda J Gabbe
- School of Public Health and Preventive Medicine, Monash University, 553 St Kilda Road, Melbourne, VIC, 3004, Australia; Health Data Research UK, Swansea UniversityMedical School, Swansea University, Singleton Park, Swansea, SA2 8PP, Wales, UK
| | - Chris Rissel
- Prevention Research Collaboration, School of Public Health, The University of Sydney, Sydney, NSW 2006, Australia
| | - Trevor Shilton
- National Heart Foundation of Australia, 334 Rokeby Road, Subiaco, WA 6008, Australia
| | - Ben J Smith
- School of Public Health and Preventive Medicine, Monash University, 553 St Kilda Road, Melbourne, VIC, 3004, Australia; Prevention Research Collaboration, School of Public Health, The University of Sydney, Sydney, NSW 2006, Australia
| |
Collapse
|
16
|
Consumer Neuroscience and Digital/Social Media Health/Social Cause Advertisement Effectiveness. Behav Sci (Basel) 2019; 9:bs9040042. [PMID: 31003529 PMCID: PMC6523507 DOI: 10.3390/bs9040042] [Citation(s) in RCA: 17] [Impact Index Per Article: 3.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/26/2019] [Revised: 04/12/2019] [Accepted: 04/14/2019] [Indexed: 11/17/2022] Open
Abstract
This research investigated the use of consumer neuroscience to improve and determine the effectiveness of action/emotion-based public health and social cause (HSC) advertisements. Action-based advertisements ask individuals to 'do something' such as 'act', 'share', make a 'pledge' or complete a 'challenge' on behalf of a brand, such as doing 'something good, somewhere, for someone else'. Public health messages as noncommercial advertisements attempt to positively change behavioural intent or increase awareness. Australian health expenditure was $180.7 billion AUD (Australian dollars) in 2016/17 with $17 million AUD spent on government health campaigns. However, evaluation of health advertisement effectiveness has been difficult to determine. Few studies use neuroscience techniques with traditional market research methods. A 2-part study with an exploratory design was conducted using (1) electroencephalography (EEG) using a 64 channel EEG wet cap (n = 47); and (2) a Qualtrics online psychometric survey (n = 256). Participants were asked to make a donation before and after viewing 7 HSC digital/social media advertisements and logos (6 action/emotion-based; 1 control) to measure changes in behavioural intent. Attention is considered a key factor in determining advertising effectiveness. EEG results showed theta synchronisation (increase)/alpha desynchronisation (decrease) indicating attention with episodic memory encoding. sLORETA results displayed approach responses to action/emotion-based advertisements with left prefrontal and right parietal cortex activation. EEG and survey results showed the greatest liking for the ManUp action/emotion-based advertisement which used male facial expressions of raw emotion and vulnerability. ManUp also had the highest increased amount donated after viewing. Lower theta amplitude results for the International Fund for Animal Welfare (IFAW) action/emotion-based advertisement indicated that novel (possessing distinct features) rather than attractive/conventional faces were more appealing, while the rapid presentation of faces was less effective. None of the highest peak amplitudes for each ad occurred when viewing brand logos within the advertisement. This research contributes to the academic consumer neuroscience, advertising effectiveness, and social media literature with the use of action/challenge/emotion-based marketing strategies, which remains limited, while demonstrating the value in combining EEG and neuroscientific techniques with traditional market research methods. The research provides a greater understanding of advertising effectiveness and changes in behavioural intent with managerial implications regarding the effective use of action/challenge/emotion-based HSC communications to potentially help save a life and reduce expenditure on ineffectual HSC marketing campaigns.
Collapse
|
17
|
Wright CJC, Schwarzman J, Dietze PM, Crockett B, Lim MSC. Barriers and opportunities in the translation of mobile phone and social media interventions between research and health promotion practice in Australia: a qualitative study of expert perspectives. Health Res Policy Syst 2019; 17:5. [PMID: 30630497 PMCID: PMC6329110 DOI: 10.1186/s12961-018-0406-x] [Citation(s) in RCA: 11] [Impact Index Per Article: 2.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/08/2017] [Accepted: 12/11/2018] [Indexed: 12/03/2022] Open
Abstract
Background Newer technologies, such as smartphones and social networking sites, offer new opportunities for health promotion interventions. There is evidence to show that these technologies can be effectively and acceptably used for health promotion activities. However, most interventions produced in research do not end up benefitting non-research populations, while the majority of technology-facilitated interventions which are available outside of research settings are either undocumented or have limited or no evidence to support any benefit. We therefore aimed to explore the perspectives of researchers and health promotion experts on efforts to translate technology-facilitated prevention initiatives into practice, and the barriers to achieving translation. Methods We utilised a qualitative study design, involving in-depth interviews with researchers experienced with technology-facilitated prevention interventions and prominent health promotion experts. Results Some barriers mirror the findings of other studies into health promotion practice, which have found that competing priorities, resource limitations and organisational capacity are important in determining use of evidence in programme planning, engagement in translation and evaluation practice. We add to this literature by describing barriers that are more specifically related to technology-facilitated prevention, such as the pace of developments in technology, and how this clashes with the time taken to develop and ready evidence for translation. Conclusions In order to maximise the vast potential of technology-facilitated prevention interventions to promote population health, it is essential that translation is at the forefront of consideration for both researchers and practitioners. We suggest actions that can be taken by both researchers and practitioners to improve translation of technology-facilitated prevention interventions, and also highlight how funding schemes can be modified to facilitate translation.
Collapse
Affiliation(s)
- Cassandra J C Wright
- Centre for Population Health, Burnet Institute, 85 Commercial Rd, Melbourne, Victoria, 3004, Australia. .,Department of Epidemiology and Preventive Medicine, Monash University, 99 Commercial Rd, Melbourne, Victoria, Australia.
| | - Joanna Schwarzman
- Department of Epidemiology and Preventive Medicine, Monash University, 99 Commercial Rd, Melbourne, Victoria, Australia
| | - Paul M Dietze
- Centre for Population Health, Burnet Institute, 85 Commercial Rd, Melbourne, Victoria, 3004, Australia.,Department of Epidemiology and Preventive Medicine, Monash University, 99 Commercial Rd, Melbourne, Victoria, Australia
| | - Belinda Crockett
- Department of Epidemiology and Preventive Medicine, Monash University, 99 Commercial Rd, Melbourne, Victoria, Australia
| | - Megan S C Lim
- Centre for Population Health, Burnet Institute, 85 Commercial Rd, Melbourne, Victoria, 3004, Australia.,Department of Epidemiology and Preventive Medicine, Monash University, 99 Commercial Rd, Melbourne, Victoria, Australia.,Melbourne School of Population and Global Health, University of Melbourne, 235 Bouverie St, Carlton, Victoria, Australia
| |
Collapse
|
18
|
Klippert H, Schaper A. Using Facebook to communicate mammography messages to rural audiences. Public Health Nurs 2018; 36:164-171. [PMID: 30370687 DOI: 10.1111/phn.12556] [Citation(s) in RCA: 14] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/23/2018] [Revised: 08/19/2018] [Accepted: 09/22/2018] [Indexed: 11/29/2022]
Abstract
OBJECTIVE The purpose of this scholarly project was to answer the following question: What is the highest level of engagement achieved with a mammography campaign on Facebook? DESIGN AND SAMPLE An Idaho public health department implemented a tailored message mammography campaign on Facebook during Breast Cancer Awareness Month. Target sample for the Facebook campaign were women and men over the age of 40 in rural Idaho. MEASURES Data collected from Facebook were used to measure and stratify engagement into a hierarchy of six levels, with intent to get a mammogram representing the highest level of engagement. A survey measuring women's intent to a get a mammogram was distributed via an online link. RESULTS The posts reached 48,503 Facebook users-11,147 of the total reach were unique users. Intent to get a mammogram, the highest level of engagement, was stated both in Facebook comments and on the online survey. Forty-nine women completed the survey, and 82% of women expressed intent to get a mammogram in the next year. CONCLUSION This project conducted as a program evaluation demonstrates how public health nurses can develop, implement, and evaluate Facebook mammography campaigns in the future.
Collapse
|
19
|
Klassen KM, Douglass CH, Brennan L, Truby H, Lim MSC. Social media use for nutrition outcomes in young adults: a mixed-methods systematic review. Int J Behav Nutr Phys Act 2018; 15:70. [PMID: 30041699 PMCID: PMC6057054 DOI: 10.1186/s12966-018-0696-y] [Citation(s) in RCA: 72] [Impact Index Per Article: 12.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/03/2017] [Accepted: 06/25/2018] [Indexed: 02/06/2023] Open
Abstract
BACKGROUND Social media has been widely adopted by young adults, consequently health researchers are looking for ways to leverage this engagement with social media for the delivery of interventions and health promotion campaigns. Weight gain and sub-optimal dietary choices are common in young adults, and social media may be a potential tool to facilitate and support healthier choices. METHODS We conducted a mixed-methods systematic review of studies examining social media use for nutrition-related outcomes in young adults. Seven databases [EBscohost, ERIC, ProQuest Central, PubMed, Ovid, Scopus, and Emerald] were systematically searched; 1225 abstracts were screened, and 47 full-text articles were assessed for eligibility. Study designs included both quantitative, such as experimental and observational studies, and qualitative, such as focus groups and interviews, approaches. Quality was assessed using the Mixed Methods Appraisal Tool. Quantitative and qualitative results were examined separately, and then synthesized. RESULTS Twenty-one studies were included although their use of social media was highly variable. The main purpose of social media was to provide information and social support to participants. In the nine randomized controlled trials, social media was used as one aspect of a multi-faceted intervention. Interventions had a positive statistically significant impact on nutritional outcomes in 1/9 trials. Engagement with the social media component of interventions varied, from 3 to 69%. Young adults appear to be open to receiving healthy eating and recipe tips through social media, however, they are reluctant to share personal weight-related information on their online social networks. CONCLUSIONS Information-dissemination is now an acceptable use of social media by young adults. Using social media effectively for social support, either via private groups or public pages, requires careful evaluation as its effectiveness is yet to be demonstrated in experimental designs. Concerns about public social media use may be a contributing factor to poor engagement with social media in research intervention studies aimed at influencing weight. Future research should consider how to best engage with young adults using social media, how to more effectively use social media to support young adults and to facilitate social and peer-to-peer support in making healthier choices.
Collapse
Affiliation(s)
- Karen M. Klassen
- Department of Nutrition, Dietetics & Food, Monash University, Level 1 264 Ferntree Gully Road, Notting Hill, VIC 3168 Australia
| | | | - Linda Brennan
- School of Media and Communications, RMIT University, Melbourne, Australia
| | - Helen Truby
- Department of Nutrition, Dietetics & Food, Monash University, Level 1 264 Ferntree Gully Road, Notting Hill, VIC 3168 Australia
| | - Megan S. C. Lim
- Department of Nutrition, Dietetics & Food, Monash University, Level 1 264 Ferntree Gully Road, Notting Hill, VIC 3168 Australia
- Burnet Institute, Melbourne, Australia
- Melbourne School of Population and Global Health, University of Melbourne, Melbourne, Australia
| |
Collapse
|
20
|
Lombard C, Brennan L, Reid M, Klassen KM, Palermo C, Walker T, Lim MSC, Dean M, Mccaffrey TA, Truby H. Communicating health-Optimising young adults' engagement with health messages using social media: Study protocol. Nutr Diet 2018; 75:509-519. [PMID: 30009396 DOI: 10.1111/1747-0080.12448] [Citation(s) in RCA: 24] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/11/2018] [Revised: 05/01/2018] [Accepted: 05/24/2018] [Indexed: 11/30/2022]
Abstract
BACKGROUND Obesity is a global health problem. Understanding how to utilise social media (SM) as a platform for intervention and engagement with young adults (YAs) will help the practitioners to harness this media more effectively for obesity prevention. AIM Communicating health (CH) aims to understand the use of SM by YAs, including Aboriginal YAs, and in doing so will improve the effectiveness of SM strategies to motivate, engage and retain YAs in interventions to reduce the risk of obesity, and identify and disseminate effective ways for health professionals to deliver obesity prevention interventions via SM. METHODS The present study describes the theoretical framework and methodologies for the CH study, which is organised into four interrelated phases, each building on the outcomes of preceding phases. Phase 1 is a mixed methods approach to understand how YAs use SM to navigate their health issues, including healthy eating. Phase 2 utilises co-creation workshops where YAs and public health practitioners collaboratively generate healthy eating messages and communication strategies. Phase 3 evaluates these messages in a real-world setting. Phase 4 is the translation phase where public health practitioners use outcomes from CH to inform future strategies and to develop tools for SM for use by stakeholders and the research community. DISCUSSION The outcomes will include a rich understanding of psychosocial drivers and behaviours associated with healthy eating and will provide insight into the use of SM to reach and influence the health and eating behaviours of YAs.
Collapse
Affiliation(s)
- Catherine Lombard
- Department of Nutrition, Dietetics and Food, Monash University, Melbourne, Victoria, Australia
| | - Linda Brennan
- School of Media and Communication, RMIT University, Melbourne, Victoria, Australia
| | - Michael Reid
- School of Economics, Finance and Marketing, RMIT University, Melbourne, Victoria, Australia
| | - Karen M Klassen
- Department of Nutrition, Dietetics and Food, Monash University, Melbourne, Victoria, Australia
| | - Claire Palermo
- Department of Nutrition, Dietetics and Food, Monash University, Melbourne, Victoria, Australia
| | - Troy Walker
- Department of Nutrition, Dietetics and Food, Monash University, Melbourne, Victoria, Australia
| | | | - Moira Dean
- School of Biological Sciences, Institute for Global Food Security, Queen's University Belfast, Belfast, UK.,School of Public Health and Preventive Medicine, Monash University, Melbourne, Victoria, Australia.,School of Population and Global Health, University of Melbourne, Melbourne, Victoria, Australia
| | - Tracy A Mccaffrey
- Department of Nutrition, Dietetics and Food, Monash University, Melbourne, Victoria, Australia
| | - Helen Truby
- Department of Nutrition, Dietetics and Food, Monash University, Melbourne, Victoria, Australia
| |
Collapse
|
21
|
Schwarzman J, Bauman A, Gabbe B, Rissel C, Shilton T, Smith BJ. Organizational determinants of evaluation practice in Australian prevention agencies. HEALTH EDUCATION RESEARCH 2018; 33:243-255. [PMID: 29746649 DOI: 10.1093/her/cyy015] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 10/10/2017] [Accepted: 04/20/2018] [Indexed: 06/08/2023]
Abstract
Program evaluation is essential to inform decision making, contribute to the evidence base for strategies, and facilitate learning in health promotion and disease prevention organizations. Theoretical frameworks of organizational learning, and studies of evaluation capacity building describe the organization as central to evaluation capacity. Australian prevention organizations recognize limitations to current evaluation effectiveness and are seeking guidance to build evaluation capacity. This qualitative study identifies organizational facilitators and barriers to evaluation practice, and explores their interactions in Australian prevention organizations. We conducted semi-structured interviews with 40 experienced practitioners from government and non-government organizations. Using thematic analysis, we identified seven key themes that influence evaluation practice: leadership, organizational culture, organizational systems and structures, partnerships, resources, workforce development and training and recruitment and skills mix. We found organizational determinants of evaluation to have multi-level interactions. Leadership and organizational culture influenced organizational systems, resource allocation and support of staff. Partnerships were important to overcome resource deficits, and systems were critical to embed evaluation within the organization. Organizational factors also influenced the opportunities for staff to develop skills and confidence. We argue that investment to improve these factors would allow organizations to address evaluation capacity at multiple levels, and ultimately facilitate effective evaluation practice.
Collapse
Affiliation(s)
- J Schwarzman
- School of Public Health and Preventive Medicine, Monash University, 553 St Kilda Road, Melbourne, VIC 3004, Australia
| | - A Bauman
- Prevention Research Collaboration, School of Public Health, L6 The Hub, Charles Perkins Centre, University of Sydney, Sydney, NSW 2006, Australia
| | - B Gabbe
- School of Public Health and Preventive Medicine, Monash University, 553 St Kilda Road, Melbourne, VIC 3004, Australia
| | - C Rissel
- NSW Office of Preventive Health, Don Everett Building, Level 1, Liverpool Hospital, Liverpool, NSW 2170, Australia
| | - T Shilton
- National Heart Foundation Western Australia, 334 Rokeby Road, Subiaco, WA 6008, Australia
| | - B J Smith
- School of Public Health and Preventive Medicine, Monash University, 553 St Kilda Road, Melbourne, VIC 3004, Australia
- Prevention Research Collaboration, School of Public Health, L6 The Hub, Charles Perkins Centre, University of Sydney, Sydney, NSW 2006, Australia
| |
Collapse
|
22
|
Stockings EA. Commentary on Boumparis et al. (2017): It works, but only if they use it-addressing treatment adherence and attrition in internet interventions for illicit substance use. Addiction 2017; 112:1533-1534. [PMID: 28778118 DOI: 10.1111/add.13862] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 04/20/2017] [Revised: 04/25/2017] [Accepted: 05/02/2017] [Indexed: 11/29/2022]
Affiliation(s)
- Emily A Stockings
- National Drug and Alcohol Research Centre (NDARC), University of New South Wales, Randwick, New South Wales, Australia
| |
Collapse
|
23
|
Smith BJ, Rissel C, Shilton T, Bauman A. Advancing evaluation practice in health promotion. Health Promot J Austr 2016; 27:184-186. [PMID: 29241481 DOI: 10.1071/hev27n3_ed2] [Citation(s) in RCA: 12] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/23/2022] Open
|