Secure Asynchronous Communication Between Smokers and Tobacco Treatment Specialists: Secondary Analysis of a Web-Assisted Tobacco Intervention in the QUIT-PRIMO and National Dental PBRN Networks

Content Validity and Cognitive Testing in the Development of a Motivational Interviewing Self-Assessment Questionnaire

Aim

To develop and content validate a self-assessment questionnaire on motivational interviewing (MI) practice as the first stages in forming the questionnaire to be used in cross-sectional studies involving practitioners conducting the MI-based alcohol screening and brief intervention (ASBI).

Methods

A comprehensive mixed methods approach included a literature review, 3 rounds of expert panel (EP) opinions (n=10), cognitive testing (CT) with 10 MI-based ASBI practitioners, and questionnaire piloting with 31 MI-based ASBI practitioners. Based on the EP opinions in the second round, content validity indices (CVIs) and the modified kappa coefficient (k*) were calculated, focusing on the relevance and understandability of questions and comprehensiveness and meaningfulness of the response options. This analysis was performed in 2020, at the conclusion of the national "Together for a Responsible Attitude Towards Alcohol Consumption" ("Skupaj za odgovoren odnos do pitja alkohola", SOPA) project's pilot implementation.

Results

On a scale level, CVI values based on universal agreement for the entire questionnaire were high for 3/4 categories (S-CVI-UA>0.80), and CVI values based on average agreement were high across all categories (S-CVI-Ave>0.90). At the item level, CVI values (I-CVI) were never <0.50 (automatic item rejection), and the modified kappa value (k*) indicated poor validity for two items in the understandability category (k*=0.33). All problematic parts of the questionnaire were further tested and successfully modified based on the results of CT, and accepted in the third round of testing.

Conclusions

The final version of the questionnaire demonstrated appropriate content validity for use in studies among Slovenian MI-based ASBI practitioners and is now ready for further psychometric testing.

Outcomes of a Comprehensive Mobile Smoking Cessation Program With Nicotine Replacement Therapy in Adult Smokers: Pilot Randomized Controlled Trial

BACKGROUND

Cigarette smoking remains the leading cause of preventable illness and death, underscoring ongoing need for evidence-based solutions. Pivot, a US Clinical Practice Guideline-based mobile smoking cessation program, comprises a personal carbon monoxide breath sensor; a smartphone app; in-app, text-based human-provided coaching; nicotine replacement therapy; and a moderated web-based community. Promising Pivot cohort studies have established the foundation for comparative assessment.

OBJECTIVE

This study aimed to compare engagement, retention, attitudes toward quitting smoking, smoking behavior, and participant feedback between Pivot and QuitGuide, a US Clinical Practice Guideline-based smoking cessation smartphone app from the National Cancer Institute.

METHODS

In this remote pilot randomized controlled trial, cigarette smokers in the United States were recruited on the web and randomized to Pivot or QuitGuide. Participants were offered 12 weeks of free nicotine replacement therapy. Data were self-reported via weekly web-based questionnaires for 12 weeks and at 26 weeks. Outcomes included engagement and retention, attitudes toward quitting smoking, smoking behavior, and participant feedback. The primary outcome was self-reported app openings at 12 weeks. Cessation outcomes included self-reported 7- and 30-day point prevalence abstinence (PPA), abstinence from all tobacco products, and continuous abstinence at 12 and 26 weeks. PPA and continuous abstinence were biovalidated via breath carbon monoxide samples.

RESULTS

Participants comprised 188 smokers (94 Pivot and 94 QuitGuide): mean age 46.4 (SD 9.2) years, 104 (55.3%) women, 128 (68.1%) White individuals, and mean cigarettes per day 17.6 (SD 9.0). Engagement via mean "total app openings through 12 weeks" (primary outcome) was Pivot, 157.9 (SD 210.6) versus QuitGuide, 86.5 (SD 66.3; P<.001). Self-reported 7-day PPA at 12 and 26 weeks was Pivot, 35% (33/94) versus QuitGuide, 28% (26/94; intention to treat [ITT]: P=.28) and Pivot, 36% (34/94) versus QuitGuide, 27% (25/94; ITT: P=.12), respectively. Self-reported 30-day PPA at 12 and 26 weeks was Pivot, 29% (27/94) versus QuitGuide, 22% (21/94; ITT: P=.32) and Pivot, 32% (30/94) versus QuitGuide, 22% (21/94; ITT: P=.12), respectively. The biovalidated abstinence rate at 12 weeks was Pivot, 29% (27/94) versus QuitGuide, 13% (12/94; ITT: P=.008). Biovalidated continuous abstinence at 26 weeks was Pivot, 21% (20/94) versus QuitGuide, 10% (9/94; ITT: P=.03). Participant feedback, including ease of setup, impact on smoking, and likelihood of program recommendation were favorable for Pivot.

CONCLUSIONS

In this randomized controlled trial comparing the app-based smoking cessation programs Pivot and QuitGuide, Pivot participants had higher engagement and biovalidated cessation rates and more favorable user feedback at 12 and 26 weeks. These findings support Pivot as an effective, durable mobile smoking cessation program.

TRIAL REGISTRATION

ClinicalTrials.gov NCT04955639; https://clinicaltrials.gov/ct2/show/NCT04955639.