Changes in Quitline Caller Characteristics During a National Tobacco Education Campaign

Review of Evaluation Metrics Used in Digital and Traditional Tobacco Control Campaigns

BACKGROUND

Mass media campaigns for public health are increasingly using digital media platforms, such as web-based advertising and social media; however, there is a lack of evidence on how to best use these digital platforms for public health campaigns. To generate this evidence, appropriate campaign evaluations are needed, but with the proliferation of digital media-related metrics, there is no clear consensus on which evaluation metrics should be used. Public health campaigns are diverse in nature, so to facilitate analysis, this review has selected tobacco control campaigns as the scope of the study.

OBJECTIVE

This literature review aimed to examine how tobacco control campaigns that use traditional and digital media platforms have been evaluated.

METHODS

Medicine and science databases (Medical Literature Analysis and Retrieval System Online [MEDLINE], EMBASE, PsycINFO, Cumulative Index to Nursing and Allied Health Literature [CINAHL], and Scopus), and a marketing case study database (World Advertising Research Center) were searched for articles published between 2013 and 2018. Two authors established the eligibility criteria and reviewed articles for inclusion. Individual campaigns were identified from the articles, and information on campaigns and their evaluations were supplemented with searches on Google, Google Scholar, and social media platforms. Data about campaign evaluations were tabulated and mapped to a conceptual framework.

RESULTS

In total, 17 campaigns were included in this review, with evaluations reported on by 51 articles, 17 marketing reports, and 4 grey literature reports. Most campaigns were from English-speaking countries, with behavioral change as the primary objective. In the process evaluations, a wide range of metrics were used to assess the reach of digital campaign activities, making comparison between campaigns difficult. Every campaign in the review, except one, reported some type of engagement impact measure, with website visits being the most commonly reported metric (11 of the 17 campaigns). Other commonly reported evaluation measures identified in this review include engagement on social media, changes in attitudes, and number of people contacting smoking cessation services. Of note, only 7 of the 17 campaigns attempted to measure media platform attribution, for example, by asking participants where they recalled seeing the campaign or using unique website tracking codes for ads on different media platforms.

CONCLUSIONS

One of the key findings of this review is the numerous and diverse range of measures and metrics used in tobacco control campaign evaluations. To address this issue, we propose principles to guide the selection of digital media-related metrics for campaign evaluations, and also outline a conceptual framework to provide a coherent organization to the diverse range of metrics. Future research is needed to specifically investigate whether engagement metrics are associated with desired campaign outcomes, to determine whether reporting of engagement metrics is meaningful in campaign evaluations.

The Potential Impact of the New York State Smokers' Quitline on Population-Level Smoking Rates in New York

Receiving smoking cessation services from telephone quitlines significantly increases quit success compared with no intervention or other quitting methods. To affect population-level smoking, quitlines must provide a sufficient proportion of smokers with effective interventions. Nationally, quitlines reach around 1% of adult smokers annually. From 2011 through 2016, the average annual reach of the New York State Smokers' Quitline (NYSSQL) was 2.9%. We used data on the reach and cessation outcomes of NYSSQL to estimate its current impact on population-level smoking prevalence and to estimate how much reach would have to increase to achieve population-level smoking prevalence reductions. We estimate NYSSQL is associated with a 0.02 to 0.04 percentage point reduction in smoking prevalence in New York annually. If NYSSQL achieved the recommended annual reach of 8% (CDC Best Practices) and 16% (NAQC), state-level prevalence would decrease by an estimated 0.07-0.12 and 0.13-0.24 percentage points per year, respectively. To achieve those recommended levels of reach, NYSSQL would need to provide services to approximately 3.5 to 6.9 times more smokers annually. Given their reach, quitlines are limited in their ability to affect population-level smoking. Increasing quitline reach may not be feasible and would likely be cost-prohibitive. It may be necessary to re-think the role of quitlines in tobacco control efforts. In New York, the quitline is being integrated into larger efforts to promote cessation through health systems change.

Perceptions of Tobacco Control Media Campaigns Among Smokers With Lower Socioeconomic Status

People with low socioeconomic status (SES) in the United States have disparately high rates of smoking and experience disproportionately high burdens of smoking-related disease. Tobacco control media campaigns are a critical strategy for reducing tobacco use prevalence, but evidence is mixed about the optimal use of mass media to reach and promote tobacco use cessation among people with low SES. Improved understanding of the factors influencing how low-SES tobacco users evaluate tobacco control media campaigns may inform development of more effective messages and strategies. Focus groups with primarily low-SES smokers in Connecticut were conducted, finding that participants had seen many tobacco control television ads that used graphic imagery and testimonials, but participants voiced two main themes that limited ad effectiveness: (1) skepticism about the content of ads, the role of the tobacco industry and the government in sponsoring the ads, and the safety and efficacy of cessation supports; and (2) barriers to quitting such as stress, social contexts, and addiction that participants perceived as being underappreciated in the context of the ads. Tobacco control media campaigns targeting low-SES tobacco users may need additional messages, tools, or refinements to more optimally motivate this group to make quit attempts.

Race/Ethnic Variations in Quitline Use Among US Adult Tobacco Users in 45 States, 2011-2013

Introduction

State quitlines provide free telephone-based cessation services and are available in all states. However, quitlines presently reach 1% of US cigarette smokers. We assessed variations in quitline reach by race/ethnicity across 45 US states included in the National Quitline Data Warehouse, a repository on non-identifiable data reported by state quitlines.

Methods

During 2011 to 2013, we analyzed 1 220 171 records from the National Quitline Data Warehouse. Annual quitline reach was defined as the proportion of cigarette smokers and smokeless tobacco users who utilized quitline services during each year, and was calculated by dividing the number of state-specific quitline registrants in each year by the number of adult cigarette smokers and smokeless tobacco users in the state.

Results

Average annual reach ranged from: 0.08% (Tennessee) to 3.42% (Hawaii) among non-Hispanic whites; 0.17% (Tennessee) to 3.85% (Delaware) among non-Hispanic blacks; 0.27% (Nevada) to 9.98% (Delaware) among non-Hispanic American Indians/Alaska Native; 0.03% (Alabama) to 2.43% (Hawaii) among non-Hispanic Asian/Pacific Islanders; and from 0.08% (Tennessee) to 3.18% (Maine) among Hispanics. Average annual reach was highest among non-Hispanic American Indians/Alaska Native in 27 states, non-Hispanic blacks in 14 states, and non-Hispanic whites in four states.

Conclusions

Quitlines appear to be reaching minority populations; however, overall reach remains low and variations in quitline reach exist by race/ethnicity. Opportunities exist to increase the utilization of quitlines and other effective cessation treatments among racial/ethnic minority populations.

Implications

Some studies have assessed quitline reach across demographic groups in individual states; however, no studies have provided multistate data about quitline reach across race/ethnic groups. Ongoing monitoring of the use of state quitlines can help guide targeted outreach to particular race/ethnic groups with the goal of increasing the overall proportion and number of tobacco users that use quitlines. These efforts should be complemented by comprehensive tobacco control initiatives that increase cessation including mass media campaigns, smoke-free policies, increased tobacco prices, expansion of health insurance coverage, and health systems change.

Mass media interventions for smoking cessation in adults

BACKGROUND

Mass media tobacco control campaigns can reach large numbers of people. Much of the literature is focused on the effects of tobacco control advertising on young people, but there are also a number of evaluations of campaigns targeting adult smokers, which show mixed results. Campaigns may be local, regional or national, and may be combined with other components of a comprehensive tobacco control policy.

OBJECTIVES

To assess the effectiveness of mass media interventions in reducing smoking among adults.

SEARCH METHODS

The Cochrane Tobacco Addiction Group search strategy was combined with additional searches for any studies that referred to tobacco/smoking cessation, mass media and adults. We also searched the Cochrane Central Register of Controlled Trials (CENTRAL) and a number of electronic databases. The last search was carried out in November 2016.

SELECTION CRITERIA

Controlled trials allocating communities, regions or states to intervention or control conditions; interrupted time series.Adults, 25 years or older, who regularly smoke cigarettes. Studies which cover all adults as defined in studies were included.Mass media are defined here as channels of communication such as television, radio, newspapers, billboards, posters, leaflets or booklets intended to reach large numbers of people, and which are not dependent on person-to-person contact. The purpose of the mass media campaign must be primarily to encourage smokers to quit. They could be carried out alone or in conjunction with tobacco control programmes.The primary outcome was change in smoking behaviour. This could be reported as changes in prevalence, changes in cigarette consumption, quit rates, or odds of being a smoker.

DATA COLLECTION AND ANALYSIS

Two authors independently assessed all studies for inclusion criteria and for study quality (MB, LS, RTM). One author (MB) extracted data, and a second author (LS) checked them.Results were not pooled due to heterogeneity of the included studies and are presented narratively and in table form.

MAIN RESULTS

Eleven campaigns met the inclusion criteria for this review. Studies differed in design, settings, duration, content and intensity of intervention, length of follow-up, methods of evaluation and also in definitions and measures of smoking behaviour used. Among seven campaigns reporting smoking prevalence, significant decreases were observed in the California and Massachusetts statewide tobacco control campaigns compared with the rest of the USA. Some positive effects on prevalence in the whole population or in the subgroups were observed in three of the remaining seven studies. Three large-scale campaigns of the seven presenting results for tobacco consumption found statistically significant decreases. Among the eight studies presenting abstinence or quit rates, four showed some positive effect, although in one of them the effect was measured for quitting and cutting down combined. Among the three that did not show significant decreases, one demonstrated a significant intervention effect on smokers and ex-smokers combined.

AUTHORS' CONCLUSIONS

There is evidence that comprehensive tobacco control programmes which include mass media campaigns can be effective in changing smoking behaviour in adults, but the evidence comes from a heterogeneous group of studies of variable methodological quality. One state-wide tobacco control programme (Massachusetts) showed positive results up to eight years after the campaign. Another (California) showed positive results during the period of adequate funding and implementation and in final evaluation since the beginning of the programme. Six of nine studies carried out in communities or regions showed some positive effects on smoking behaviour and at least one significant change in smoking prevalence (Sydney). The intensity and duration of mass media campaigns may influence effectiveness, but length of follow-up and concurrent secular trends and events can make this difficult to quantify. No consistent relationship was observed between campaign effectiveness and age, education, ethnicity or gender.

Comparing the New York State Smokers' Quitline Reach, Services Offered, and Quit Outcomes to 44 Other State Quitlines, 2010 to 2015

PURPOSE

To summarize the reach, services offered, and cessation outcomes of the New York Quitline and compare with other state quitlines.

DESIGN

Descriptive study.

SETTING

Forty-five US states.

PARTICIPANTS

State-sponsored tobacco cessation quitlines in 45 US states that provided complete data to the Centers for Disease Control and Prevention's National Quitline Data Warehouse (NQDW) for 24 quarters over 6 years (2010-Q1 through 2015-Q4).

INTERVENTION

Telephone quitlines that offer tobacco use cessation services, including counseling, self-help materials, and nicotine replacement therapy (NRT), to smokers at no cost to them.

MEASURES

Percentage of adult tobacco users in the state who received counseling and/or free NRT from state quitlines (reach), services offered by state quitlines, and cessation outcomes among quitline clients 7 months after using quitline services.

ANALYSIS

Reach, services offered, and cessation outcomes for the New York Quitline were compared with similar measures for the other 44 state quitlines with complete NQDW data for all quarters from 2010 through 2015.

RESULTS

New York's average annual quitline reach from 2010 through 2015 was 3.0% per year compared to 1.1% per year for the other 44 states examined.

CONCLUSION

Although the New York Quitline was open fewer hours per week and offered fewer counseling sessions and a smaller amount of free NRT than most of the other 44 state quitlines, the New York Quitline had similar quit rates to most of those state quitlines.

Cessation Outcomes Among Quitline Callers in Three States During a National Tobacco Education Campaign

Introduction

Antismoking mass media campaigns, such as the Centers for Disease Control and Prevention’s Tips from Former Smokers (Tips) campaign, increase the number of tobacco users calling tobacco quitlines. Few studies have investigated long-term tobacco use cessation for callers during antismoking media campaigns. Studies have suggested that callers during campaigns may be less committed to quitting and have lower quit rates. This study examines tobacco user cessation outcomes 7 months after quitline enrollment during the 2012 Tips campaign (March 19 through June 10, 2012).

Methods

We analyzed data for 715 tobacco users who enrolled in the Nebraska, North Carolina, or Texas state quitline multiple-call programs during the 2012 Tips campaign and responded to a 7-month postenrollment survey (38.5% survey response rate). We used multivariable logistic regression analyses to determine whether 7-day and 30-day point prevalence abstinence rates 7 months after enrollment were related to level of exposure to the campaign.

Results

In multivariable models, only lower nicotine dependence and higher call completion were associated with higher odds of 7-day and 30-day abstinence 7 months after enrollment. Tips campaign exposure was not associated with abstinence.

Conclusion

Once enrolled in quitline counseling, quitline callers achieved similar outcomes regardless of Tips campaign exposure levels. While the campaign did not appear to directly affect odds of tobacco abstinence through quitlines, antismoking mass media campaigns such as Tips are valuable in increasing tobacco users’ exposure to quitlines and thus increasing their likelihood of making a quit attempt and eventually achieving tobacco abstinence.