Cigarette Smoking Detection with An Inertial Sensor and A Smart Lighter

Acceptability of a smart lighter for tracking cigarette smoking: A focus group study

Background

Smart lighters track cigarette smoking episodes, which can help identify smoking patterns and intervention approaches to promote cessation. We gauged the acceptability of smart lighters among individuals with low socioeconomic status (SES), a target population for a newly developed smoking cessation mobile intervention, to evaluate their potential use during the intervention pre-quit period.

Methods

Twelve virtual focus group discussions were conducted with 38 current cigarette smokers, 18-29 years old, who were not 4-year college-educated nor enrolled in a 4-year college as an SES indicator. Focus groups were audio recorded, transcribed, and analyzed using a deductive thematic approach. Themes captured sentiment (i.e., negative, neutral, positive) and constructs from the Second Unified Theory of Acceptance and Use of Technology (i.e., effort expectancy, facilitating conditions, hedonic motivation, performance expectancy, social influence).

Results

Sentiment toward smart lighters was positive (54.36%). Prominent themes relevant to acceptance of smart lighters were facilitating conditions (33.98%), performance expectancy (29.12%), and effort expectancy (16.50%). Concerns about privacy, lack of awareness of smart lighters, and their unaffordability were the primary facilitating conditions discussed. Smart lighters were considered easy to use and useful cessation aids because they minimize user burden in tracking smoking behavior. Skepticism about their usefulness centered on the possibility of inadvertently triggering cravings and subsequent smoking.

Conclusions

Ensuring the affordability, awareness, and usability of smart lighters can increase their acceptability. Use of smart lighters in cessation interventions can provide insights into smoking patterns with minimal user burden. Consideration must be given to their potential unintended effects as cueing smoking.

Smartband-based smoking detection and real-time brief mindfulness intervention: findings from a feasibility clinical trial

BACKGROUND

Smartbands can be used to detect cigarette smoking and deliver real time smoking interventions. Brief mindfulness interventions have been found to reduce smoking.

OBJECTIVE

This single arm feasibility trial used a smartband to detect smoking and deliver brief mindfulness exercises.

METHODS

Daily smokers who were motivated to reduce their smoking wore a smartband for 60 days. For 21 days, the smartband monitored, detected and notified the user of smoking in real time. After 21 days, a 'mindful smoking' exercise was triggered by detected smoking. After 28 days, a 'RAIN' (recognize, allow, investigate, nonidentify) exercise was delivered to predicted smoking. Participants received mindfulness exercises by text message and online mindfulness training. Feasibility measures included treatment fidelity, adherence and acceptability.

RESULTS

Participants (N=155) were 54% female, 76% white non-Hispanic, and treatment starters (n=115) were analyzed. Treatment fidelity cutoffs were met, including for detecting smoking and delivering mindfulness exercises. Adherence was mixed, including moderate smartband use and low completion of mindfulness exercises. Acceptability was mixed, including high helpfulness ratings and mixed user experiences data. Retention of treatment starters was high (81.9%).

CONCLUSIONS

Findings demonstrate the feasibility of using a smartband to track smoking and deliver quit smoking interventions contingent on smoking.

Sensors for Smoking Detection in Epidemiological Research: Scoping Review

BACKGROUND

The use of wearable sensors is being explored as a challenging way to accurately identify smoking behaviors by measuring physiological and environmental factors in real-life settings. Although they hold potential benefits for aiding smoking cessation, no single wearable device currently achieves high accuracy in detecting smoking events. Furthermore, it is crucial to emphasize that this area of study is dynamic and requires ongoing updates.

OBJECTIVE

This scoping review aims to map the scientific literature for identifying the main sensors developed or used for tobacco smoke detection, with a specific focus on wearable sensors, as well as describe their key features and categorize them by type.

METHODS

According to the PRISMA-ScR (Preferred Reporting Items for Systematic Reviews and Meta-Analyses extension for Scoping Reviews) protocol, an electronic search was conducted on the PubMed, MEDLINE, and Web of Science databases, using the following keywords: ("biosensors" OR "biosensor" OR "sensors" OR "sensor" OR "wearable") AND ("smoking" OR "smoke").

RESULTS

Among a total of 37 studies included in this scoping review published between 2012 and March 2024, 16 described sensors based on wearable bands, 15 described multisensory systems, and 6 described other strategies to detect tobacco smoke exposure. Included studies provided details about the design or application of wearable sensors based on an elastic band to detect different aspects of tobacco smoke exposure (eg, arm, wrist, and finger movements, and lighting events). Some studies proposed a system composed of different sensor modalities (eg, Personal Automatic Cigarette Tracker [PACT], PACT 2.0, and AutoSense).

CONCLUSIONS

Our scoping review has revealed both the obstacles and opportunities linked to wearable devices, offering valuable insights for future research initiatives. Tackling the recognized challenges and delving into potential avenues for enhancement could elevate wearable devices into even more effective tools for aiding smoking cessation. In this context, continuous research is essential to fine-tune and optimize these devices, guaranteeing their practicality and reliability in real-world applications.

HabitSense: A Privacy-Aware, AI-Enhanced Multimodal Wearable Platform for mHealth Applications

Wearable cameras provide an objective method to visually confirm and automate the detection of health-risk behaviors such as smoking and overeating, which is critical for developing and testing adaptive treatment interventions. Despite the potential of wearable camera systems, adoption is hindered by inadequate clinician input in the design, user privacy concerns, and user burden. To address these barriers, we introduced HabitSense, an open-source, multi-modal neck-worn platform developed with input from focus groups with clinicians (N=36) and user feedback from in-wild studies involving 105 participants over 35 days. Optimized for monitoring health-risk behaviors, the platform utilizes RGB, thermal, and inertial measurement unit sensors to detect eating and smoking events in real time. In a 7-day study involving 15 participants, HabitSense recorded 768 hours of footage, capturing 420.91 minutes of hand-to-mouth gestures associated with eating and smoking data crucial for training machine learning models, achieving a 92% F1-score in gesture recognition. To address privacy concerns, the platform records only during likely health-risk behavior events using SECURE, a smart activation algorithm. Additionally, HabitSense employs on-device obfuscation algorithms that selectively obfuscate the background during recording, maintaining individual privacy while leaving gestures related to health-risk behaviors unobfuscated. Our implementation of SECURE has resulted in a 48% reduction in storage needs and a 30% increase in battery life. This paper highlights the critical roles of clinician feedback, extensive field testing, and privacy-enhancing algorithms in developing an unobtrusive, lightweight, and reproducible wearable system that is both feasible and acceptable for monitoring health-risk behaviors in real-world settings.

Towards Predicting Smoking Events for Just-in-time Interventions

Consumer-grade heart rate (HR) sensors are widely used for tracking physical and mental health status. We explore the feasibility of using Polar H10 electrocardiogram (ECG) sensor to detect and predict cigarette smoking events in naturalistic settings with several machine learning approaches. We have collected and analyzed data for 28 participants observed over a two-week period. We found that using bidirectional long short-term memory (BiLSTM) with ECG-derived and GPS location input features yielded the highest mean accuracy of 69% for smoking event detection. For predicting smoking events, the highest accuracy of 67% was achieved using the fine-tuned LSTM approach. We also found a significant correlation between accuracy and the number of smoking events available from each participant. Our findings indicate that both detection and prediction of smoking events are feasible but require an individualized approach to training the models, particularly for prediction.

CigTrak: Smartwatch-Based Accurate Online Smoking Puff & Episode Detection with Gesture-Focused Windowing for CNN

Wearable-based motion sensing solutions are capable of automatically detecting and tracking individual smoking puffs and/or episodes to aid the users in their journey of smoking cessation. But they are either obtrusive to use, perform with a low accuracy, or have questionable ability of running fully on a low-power device like a smartwatch, all affecting their widespread adoption. We propose 'CigTrak', a novel pipeline for an accurate smoking puff and episode detection using 6-DoF motion sensor on a smartwatch. A multi-stage method for puff detection is devised, comprising a novel kinematic analysis of puffing motion enabling temporal localization of puff. A Convolutional Neural Network (CNN)-backed model uses this candidate puff as an input instance by re-sampling it to required input size for the final decision. Clusters of detected puffs are further used to detect episodes. Data from 13 subjects was used for evaluating puff detection, and 9 subjects for evaluating episode detection. CigTrak achieved a high subject-independent performance for puff detection (F1-score 0.94) and free-living episode detection (F1-score 0.89), surpassing state of the art performance. CigTrak was also implemented fully online on two different smartwatches for testing a real-time puff detection.Clinical Relevance- Cigarette smoking affects physical & mental well-being of a person, and is the leading cause of preventable diseases, adversely affecting cardiac and respiratory systems. With many adults wanting to quit smoking [1], a reliable way of auto-journaling of smoking activities can greatly aid in cessation efforts through self-help, and reduce burden on healthcare industry. CigTrak, with its high accuracy in detecting smoking puffs and episodes, and capability of running fully on a smartwatch, can be readily used for this purpose.

Machine learning applications in tobacco research: a scoping review

OBJECTIVE

Identify and review the body of tobacco research literature that self-identified as using machine learning (ML) in the analysis.

DATA SOURCES

MEDLINE, EMABSE, PubMed, CINAHL Plus, APA PsycINFO and IEEE Xplore databases were searched up to September 2020. Studies were restricted to peer-reviewed, English-language journal articles, dissertations and conference papers comprising an empirical analysis where ML was identified to be the method used to examine human experience of tobacco. Studies of genomics and diagnostic imaging were excluded.

STUDY SELECTION

Two reviewers independently screened the titles and abstracts. The reference list of articles was also searched. In an iterative process, eligible studies were classified into domains based on their objectives and types of data used in the analysis.

DATA EXTRACTION

Using data charting forms, two reviewers independently extracted data from all studies. A narrative synthesis method was used to describe findings from each domain such as study design, objective, ML classes/algorithms, knowledge users and the presence of a data sharing statement. Trends of publication were visually depicted.

DATA SYNTHESIS

74 studies were grouped into four domains: ML-powered technology to assist smoking cessation (n=22); content analysis of tobacco on social media (n=32); smoker status classification from narrative clinical texts (n=6) and tobacco-related outcome prediction using administrative, survey or clinical trial data (n=14). Implications of these studies and future directions for ML researchers in tobacco control were discussed.

CONCLUSIONS

ML represents a powerful tool that could advance the research and policy decision-making of tobacco control. Further opportunities should be explored.

SmokeMon: Unobtrusive Extraction of Smoking Topography Using Wearable Energy-Efficient Thermal

Smoking is the leading cause of preventable death worldwide. Cigarette smoke includes thousands of chemicals that are harmful and cause tobacco-related diseases. To date, the causality between human exposure to specific compounds and the harmful effects is unknown. A first step in closing the gap in knowledge has been measuring smoking topography, or how the smoker smokes the cigarette (puffs, puff volume, and duration). However, current gold-standard approaches to smoking topography involve expensive, bulky, and obtrusive sensor devices, creating unnatural smoking behavior and preventing their potential for real-time interventions in the wild. Although motion-based wearable sensors and their corresponding machine-learned models have shown promise in unobtrusively tracking smoking gestures, they are notorious for confounding smoking with other similar hand-to-mouth gestures such as eating and drinking. In this paper, we present SmokeMon, a chest-worn thermal-sensing wearable system that can capture spatial, temporal, and thermal information around the wearer and cigarette all day to unobtrusively and passively detect smoking events. We also developed a deep learning-based framework to extract puffs and smoking topography. We evaluate SmokeMon in both controlled and free-living experiments with a total of 19 participants, more than 110 hours of data, and 115 smoking sessions achieving an F1-score of 0.9 for puff detection in the laboratory and 0.8 in the wild. By providing SmokeMon as an open platform, we provide measurement of smoking topography in free-living settings to enable testing of smoking topography in the real world, with potential to facilitate timely smoking cessation interventions.

Analyzing Impact of Mouthpiece-based Puff Topography Devices on Smoking Behavior using Wearable Sensors

Detailed assessment of smoking topography (puffing and post-puffing metrics) can lead to a better understanding of factors that influence tobacco use. Research suggests that portable mouthpiece-based devices used for puff topography measurement may alter natural smoking behavior. This paper evaluated the impact of a portable puff topography device (CReSS Pocket) on puffing & post-puffing topography using a wearable system, the Personal Automatic Cigarette Tracker v2 (PACT 2.0) as a reference measurement. Data from 45 smokers who smoked one cigarette in the lab and an unrestricted number of cigarettes under free-living conditions over 4 consecutive days were used for analysis. PACT 2.0 was worn on all four days. A puff topography instrument (CReSS pocket) was used for cigarette smoking on two random days during the four days of study in the laboratory and free-living conditions. Smoke inhalations were automatically detected using PACT2.0 signals. Respiratory smoke exposure metrics (i.e., puff count, duration of cigarette, puff duration, inhale-exhale duration, inhale-exhale volume, volume over time, smoke hold duration, inter-puff interval) were computed for each puff/smoke inhalation. Analysis comparing respiratory smoke exposure metrics during CReSS days and days without CReSS revealed a significant difference in puff duration, inhale-exhale duration and volume, smoke hold duration, inter-puff interval, and volume over time. However, the number of cigarettes per day and number of puffs per cigarette were statistically the same irrespective of the use of the CReSS device. The results suggested that the use of mouthpiece-based puff topography devices may influence measures of smoking topography with corresponding changes in smoking behavior and smoke exposure.

Smoking Cessation System for Preemptive Smoking Detection

Smoking cessation is a significant challenge for many people addicted to cigarettes and tobacco. Mobile health-related research into smoking cessation is primarily focused on mobile phone data collection either using self-reporting or sensor monitoring techniques. In the past 5 years with the increased popularity of smartwatch devices, research has been conducted to predict smoking movements associated with smoking behaviors based on accelerometer data analyzed from the internal sensors in a user's smartwatch. Previous smoking detection methods focused on classifying current user smoking behavior. For many users who are trying to quit smoking, this form of detection may be insufficient as the user has already relapsed. In this paper, we present a smoking cessation system utilizing a smartwatch and finger sensor that is capable of detecting pre-smoking activities to discourage users from future smoking behavior. Pre-smoking activities include grabbing a pack of cigarettes or lighting a cigarette and these activities are often immediately succeeded by smoking. Therefore, through accurate detection of pre-smoking activities, we can alert the user before they have relapsed. Our smoking cessation system combines data from a smartwatch for gross accelerometer and gyroscope information and a wearable finger sensor for detailed finger bend-angle information. We compare the results of a smartwatch-only system with a combined smartwatch and finger sensor system to illustrate the accuracy of each system. The combined smartwatch and finger sensor system performed at an 80.6% accuracy for the classification of pre-smoking activities compared to 47.0% accuracy of the smartwatch-only system.

Real-time prediction of smoking activity using machine learning based multi-class classification model

Smoking cessation efforts can be greatly influenced by providing just-in-time intervention to individuals who are trying to quit smoking. Detecting smoking activity accurately among the confounding activities of daily living (ADLs) being monitored by the wearable device is a challenging and intriguing research problem. This study aims to develop a machine learning based modeling framework to identify the smoking activity among the confounding ADLs in real-time using the streaming data from the wrist-wearable IMU (6-axis inertial measurement unit) sensor. A low-cost wrist-wearable device has been designed and developed to collect raw sensor data from subjects for the activities. A sliding window mechanism has been used to process the streaming raw sensor data and extract several time-domain, frequency-domain, and descriptive features. Hyperparameter tuning and feature selection have been done to identify best hyperparameters and features respectively. Subsequently, multi-class classification models are developed and validated using in-sample and out-of-sample testing. The developed models obtained predictive accuracy (area under receiver operating curve) up to 98.7% for predicting the smoking activity. The findings of this study will lead to a novel application of wearable devices to accurately detect smoking activity in real-time. It will further help the healthcare professionals in monitoring their patients who are smokers by providing just-in-time intervention to help them quit smoking. The application of this framework can be extended to more preventive healthcare use-cases and detection of other activities of interest.

SUPPLEMENTARY INFORMATION

The online version contains supplementary material available at 10.1007/s11042-022-12349-6.

Using Smartwatches to Detect Face Touching

Frequent spontaneous facial self-touches, predominantly during outbreaks, have the theoretical potential to be a mechanism of contracting and transmitting diseases. Despite the recent advent of vaccines, behavioral approaches remain an integral part of reducing the spread of COVID-19 and other respiratory illnesses. The aim of this study was to utilize the functionality and the spread of smartwatches to develop a smartwatch application to identify motion signatures that are mapped accurately to face touching. Participants (n = 10, five women, aged 20–83) performed 10 physical activities classified into face touching (FT) and non-face touching (NFT) categories in a standardized laboratory setting. We developed a smartwatch application on Samsung Galaxy Watch to collect raw accelerometer data from participants. Data features were extracted from consecutive non-overlapping windows varying from 2 to 16 s. We examined the performance of state-of-the-art machine learning methods on face-touching movement recognition (FT vs. NFT) and individual activity recognition (IAR): logistic regression, support vector machine, decision trees, and random forest. While all machine learning models were accurate in recognizing FT categories, logistic regression achieved the best performance across all metrics (accuracy: 0.93 ± 0.08, recall: 0.89 ± 0.16, precision: 0.93 ± 0.08, F1-score: 0.90 ± 0.11, AUC: 0.95 ± 0.07) at the window size of 5 s. IAR models resulted in lower performance, where the random forest classifier achieved the best performance across all metrics (accuracy: 0.70 ± 0.14, recall: 0.70 ± 0.14, precision: 0.70 ± 0.16, F1-score: 0.67 ± 0.15) at the window size of 9 s. In conclusion, wearable devices, powered by machine learning, are effective in detecting facial touches. This is highly significant during respiratory infection outbreaks as it has the potential to limit face touching as a transmission vector.

Electromyogram in Cigarette Smoking Activity Recognition

In this study, information from surface electromyogram (sEMG) signals was used to recognize cigarette smoking. The sEMG signals collected from lower arm were used in two different ways: (1) as an individual predictor of smoking activity and (2) as an additional sensor/modality along with the inertial measurement unit (IMU) to augment recognition performance. A convolutional and a recurrent neural network were utilized to recognize smoking-related hand gestures. The model was developed and evaluated with leave-one-subject-out (LOSO) cross-validation on a dataset from 16 subjects who performed ten activities of daily living including smoking. The results show that smoking detection using only sEMG signal achieved an F1-score of 75% in person-independent cross-validation. The combination of sEMG and IMU improved reached the F1-score of 84%, while IMU alone sensor modality was 81%. The study showed that using only sEMG signals would not provide superior cigarette smoking detection performance relative to IMU signals. However, sEMG improved smoking detection results when combined with IMU signals without using an additional device.

Quantification of Smoking Characteristics Using Smartwatch Technology: Pilot Feasibility Study of New Technology

Background

While there have been many technological advances in studying the neurobiological and clinical basis of tobacco use disorder and nicotine addiction, there have been relatively minor advances in technologies for monitoring, characterizing, and intervening to prevent smoking in real time. Better understanding of real-time smoking behavior can be helpful in numerous applications without the burden and recall bias associated with self-report.

Objective

The goal of this study was to test the validity of using a smartwatch to advance the study of temporal patterns and characteristics of smoking in a controlled laboratory setting prior to its implementation in situ. Specifically, the aim was to compare smoking characteristics recorded by Automated Smoking PerceptIon and REcording (ASPIRE) on a smartwatch with the pocket Clinical Research Support System (CReSS) topography device, using video observation as the gold standard.

Methods

Adult smokers (N=27) engaged in a video-recorded laboratory smoking task using the pocket CReSS while also wearing a Polar M600 smartwatch. In-house software, ASPIRE, was used to record accelerometer data to identify the duration of puffs and interpuff intervals (IPIs). The recorded sessions from CReSS and ASPIRE were manually annotated to assess smoking topography. Agreement between CReSS-recorded and ASPIRE-recorded smoking behavior was compared.

Results

ASPIRE produced more consistent number of puffs and IPI durations relative to CReSS, when comparing both methods to visual puff count. In addition, CReSS recordings reported many implausible measurements in the order of milliseconds. After filtering implausible data recorded from CReSS, ASPIRE and CReSS produced consistent results for puff duration (R²=.79) and IPIs (R²=.73).

Conclusions

Agreement between ASPIRE and other indicators of smoking characteristics was high, suggesting that the use of ASPIRE is a viable method of passively characterizing smoking behavior. Moreover, ASPIRE was more accurate than CReSS for measuring puffs and IPIs. Results from this study provide the foundation for future utilization of ASPIRE to passively and accurately monitor and quantify smoking behavior in situ.

Detection of Smoking in Indoor Environment Using Machine Learning

Revealed by the effect of indoor pollutants on the human body, indoor air quality management is increasing. In particular, indoor smoking is one of the common sources of indoor air pollution, and its harmfulness has been well studied. Accordingly, the regulation of indoor smoking is emerging all over the world. Technical approaches are also being carried out to regulate indoor smoking, but research is focused on detection hardware. This study includes analytical and machine learning approach of cigarette detection by detecting typical gases (total volatile organic compounds, CO2 etc.) being collected from IoT sensors. In detail, data set for machine learning was built using IoT sensors, including training data set securely collected from the rotary smoking machine and test data set gained from actual indoor environment with spontaneous smokers. The prediction accuracy was evaluated with accuracy, precision, and recall. As a result, the non-linear support vector machine (SVM) model showed the best performance with 93% in accuracy and 88% in the F1 score. The supervised learning k-nearest neighbors (KNN) and multilayer perceptron (MLP) models also showed relatively fine results, but shows effectivity simplifying prediction with binary classification to improve accuracy and speed.

Wearable Egocentric Camera as a Monitoring Tool of Free-Living Cigarette Smoking: A Feasibility Study

INTRODUCTION

Wearable sensors may be used for the assessment of behavioral manifestations of cigarette smoking under natural conditions. This paper introduces a new camera-based sensor system to monitor smoking behavior. The goals of this study were (1) identification of the best position of sensor placement on the body and (2) feasibility evaluation of the sensor as a free-living smoking-monitoring tool.

METHODS

A sensor system was developed with a 5MP camera that captured images every second for continuously up to 26 hours. Five on-body locations were tested for the selection of sensor placement. A feasibility study was then performed on 10 smokers to monitor full-day smoking under free-living conditions. Captured images were manually annotated to obtain behavioral metrics of smoking including smoking frequency, smoking environment, and puffs per cigarette. The smoking environment and puff counts captured by the camera were compared with self-reported smoking.

RESULTS

A camera located on the eyeglass temple produced the maximum number of images of smoking and the minimal number of blurry or overexposed images (53.9%, 4.19%, and 0.93% of total captured, respectively). During free-living conditions, 286,245 images were captured with a mean (±standard deviation) duration of sensor wear of 647(±74) minutes/participant. Image annotation identified consumption of 5(±2.3) cigarettes/participant, 3.1(±1.1) cigarettes/participant indoors, 1.9(±0.9) cigarettes/participant outdoors, and 9.02(±2.5) puffs/cigarette. Statistical tests found significant differences between manual annotations and self-reported smoking environment or puff counts.

CONCLUSIONS

A wearable camera-based sensor may facilitate objective monitoring of cigarette smoking, categorization of smoking environments, and identification of behavioral metrics of smoking in free-living conditions.

IMPLICATIONS

The proposed camera-based sensor system can be employed to examine cigarette smoking under free-living conditions. Smokers may accept this unobtrusive sensor for extended wear, as the sensor would not restrict the natural pattern of smoking or daily activities, nor would it require any active participation from a person except wearing it. Critical metrics of smoking behavior, such as the smoking environment and puff counts obtained from this sensor, may generate important information for smoking interventions.

A CNN-LSTM neural network for recognition of puffing in smoking episodes using wearable sensors

A detailed assessment of smoking behavior under free-living conditions is a key challenge for health behavior research. A number of methods using wearable sensors and puff topography devices have been developed for smoking and individual puff detection. In this paper, we propose a novel algorithm for automatic detection of puffs in smoking episodes by using a combination of Respiratory Inductance Plethysmography and Inertial Measurement Unit sensors. The detection of puffs was performed by using a deep network containing convolutional and recurrent neural networks. Convolutional neural networks (CNN) were utilized to automate feature learning from raw sensor streams. Long Short Term Memory (LSTM) network layers were utilized to obtain the temporal dynamics of sensor signals and classify sequence of time segmented sensor streams. An evaluation was performed by using a large, challenging dataset containing 467 smoking events from 40 participants under free-living conditions. The proposed approach achieved an F1-score of 78% in leave-one-subject-out cross-validation. The results suggest that CNN-LSTM based neural network architecture sufficiently detect puffing episodes in free-living condition. The proposed model be used as a detection tool for smoking cessation programs and scientific research.

The potential of digital phenotyping to advance the contributions of mobile health to self-management science

Digital phenotyping consists of moment-by-moment quantification of behavioral data from individual people, typically collected passively from smartphones and other sensors. Within the evolving context of precision health, digital phenotyping can advance the use of mobile health -based self-management tools and interventions by enabling more accurate prediction for prevention and treatment, facilitating supportive strategies, and informing the development of features to motivate self-management behaviors within real-world conditions. This represents an advancement in self-management science: with digital phenotyping, nurse scientists have opportunities to tailor interventions with increased precision. In this paper, we discuss the emergence of digital phenotyping, the historical background of ecological momentary assessment, and the current state of the science of digital phenotyping, with implications for research design, computational requirements, and ethical considerations in self-management science, as well as limitations.

A CNN-LSTM neural network for recognition of puffing in smoking episodes using wearable sensors

A detailed assessment of smoking behavior under free-living conditions is a key challenge for health behavior research. A number of methods using wearable sensors and puff topography devices have been developed for smoking and individual puff detection. In this paper, we propose a novel algorithm for automatic detection of puffs in smoking episodes by using a combination of Respiratory Inductance Plethysmography and Inertial Measurement Unit sensors. The detection of puffs was performed by using a deep network containing convolutional and recurrent neural networks. Convolutional neural networks (CNN) were utilized to automate feature learning from raw sensor streams. Long Short Term Memory (LSTM) network layers were utilized to obtain the temporal dynamics of sensor signals and classify sequence of time segmented sensor streams. An evaluation was performed by using a large, challenging dataset containing 467 smoking events from 40 participants under free-living conditions. The proposed approach achieved an F1-score of 78% in leave-one-subject-out cross-validation. The results suggest that CNN-LSTM based neural network architecture sufficiently detect puffing episodes in free-living condition. The proposed model be used as a detection tool for smoking cessation programs and scientific research.

A Report on Smoking Detection and Quitting Technologies

Mobile health technologies are being developed for personal lifestyle and medical healthcare support, of which a growing number are designed to assist smokers to quit. The potential impact of these technologies in the fight against smoking addiction and on improving quitting rates must be systematically evaluated. The aim of this report is to identify and appraise the most promising smoking detection and quitting technologies (e.g., smartphone apps, wearable devices) supporting smoking reduction or quitting programs. We searched PubMed and Scopus databases (2008-2019) for studies on mobile health technologies developed to assist smokers to quit using a combination of Medical Subject Headings topics and free text terms. A Google search was also performed to retrieve the most relevant smartphone apps for quitting smoking, considering the average user's rating and the ranking computed by the search engine algorithms. All included studies were evaluated using consolidated criteria for reporting qualitative research, such as applied methodologies and the performed evaluation protocol. Main outcome measures were usability and effectiveness of smoking detection and quitting technologies supporting smoking reduction or quitting programs. Our search identified 32 smoking detection and quitting technologies (12 smoking detection systems and 20 smoking quitting smartphone apps). Most of the existing apps for quitting smoking require the users to register every smoking event. Moreover, only a restricted group of them have been scientifically evaluated. The works supported by documented experimental evaluation show very high detection scores, however the experimental protocols usually lack in variability (e.g., only right-hand patients, not natural sequence of gestures) and have been conducted with limited numbers of patients as well as under constrained settings quite far from real-life use scenarios. Several recent scientific works show very promising results but, at the same time, present obstacles for the application on real-life daily scenarios.

Machine Learning-Based CYGNSS Soil Moisture Estimates over ISMN sites in CONUS

Soil moisture (SM) derived from satellite-based remote sensing measurements plays a vital role for understanding Earth’s land and near-surface atmosphere interactions. Bistatic Global Navigation Satellite System (GNSS) Reflectometry (GNSS-R) has emerged in recent years as a new domain of microwave remote sensing with great potential for SM retrievals, particularly at high spatio-temporal resolutions. In this work, a machine learning (ML)-based framework is presented for obtaining SM data products over the International Soil Moisture Network (ISMN) sites in the Continental United States (CONUS) by leveraging spaceborne GNSS-R observations provided by NASA’s Cyclone GNSS (CYGNSS) constellation alongside remotely sensed geophysical data products. Three widely-used ML approaches—artificial neural network (ANN), random forest (RF), and support vector machine (SVM)—are compared and analyzed for the SM retrieval through utilizing multiple validation strategies. Specifically, using a 5-fold cross-validation method, overall RMSE values of 0.052, 0.061, and 0.065 cm3/cm3 are achieved for the RF, ANN, and SVM techniques, respectively. In addition, both a site-independent and a year-based validation techniques demonstrate satisfactory accuracy of the proposed ML model, suggesting that this SM approach can be generalized in space and time domains. Moreover, the achieved accuracy can be further improved when the model is trained and tested over individual SM networks as opposed to combining all available SM networks. Additionally, factors including soil type and land cover are analyzed with respect to their impacts on the accuracy of SM retrievals. Overall, the results demonstrated here indicate that the proposed technique can confidently provide SM estimates over lightly-vegetated areas with vegetation water content (VWC) less than 5 kg/m2 and relatively low spatial heterogeneity.

SmokingOpp: Detecting the Smoking 'Opportunity' Context Using Mobile Sensors

Context plays a key role in impulsive adverse behaviors such as fights, suicide attempts, binge-drinking, and smoking lapse. Several contexts dissuade such behaviors, but some may trigger adverse impulsive behaviors. We define these latter contexts as 'opportunity' contexts, as their passive detection from sensors can be used to deliver context-sensitive interventions. In this paper, we define the general concept of 'opportunity' contexts and apply it to the case of smoking cessation. We operationalize the smoking 'opportunity' context, using self-reported smoking allowance and cigarette availability. We show its clinical utility by establishing its association with smoking occurrences using Granger causality. Next, we mine several informative features from GPS traces, including the novel location context of smoking spots, to develop the SmokingOpp model for automatically detecting the smoking 'opportunity' context. Finally, we train and evaluate the SmokingOpp model using 15 million GPS points and 3,432 self-reports from 90 newly abstinent smokers in a smoking cessation study.

A Comparison of SVM and CNN-LSTM Based Approach for Detecting Smoke Inhalations from Respiratory signal

Wearable sensors have successfully been used in recent studies to monitor cigarette smoking events and analyze people's smoking behavior. Respiratory inductive plethysmography (RIP) has been employed to track breathing and to identify characteristic breathing pattern specific to smoking. Pattern recognition algorithms such as Support Vector Machine (SVM), Hidden Markov Model, Decision tree, or ensemble approaches have been used to identify smoke inhalations. However, no deep learning approaches, which have been proved effective to many time series datasets, have ever been tested yet. Hence, a Convolutional Neural Network (CNN) and Long Term Short Memory (LSTM) based approach is presented in this paper to detect smoke inhalations in the breathing signal. To illustrate the effectiveness of this deep learning approach, a traditional machine learning (SVM) based approach was used for comparison. On the validation dataset of 120 smoking sessions performed in a laboratory setting by 30 moderate-to-heavy smokers, the CNN-LSTM approach achieved an F1-score of 72% in leave-one-subject-out (LOSO) cross-validation method whereas the classical SVM approach scored 63%. These results suggest that deep learning-based approaches might provide a better analytical method for detection of smoke inhalations than more conventional machine learning approaches.

Computation of Cigarette Smoke Exposure Metrics From Breathing

Traditional metrics of smoke exposure in cigarette smokers are derived either from self-report, biomarkers, or puff topography. Methods involving biomarkers measure concentrations of nicotine, nicotine metabolites, or carbon monoxide. Puff-topography methods employ portable instruments to measure puff count, puff volume, puff duration, and inter-puff interval. In this article, we propose smoke exposure metrics calculated from the breathing signal and describe a novel algorithm for the computation of these metrics. The Personal Automatic Cigarette Tracker v2 (PACT-2) sensors, puff topography devices (CReSS), and video observation were used in a study of 38 moderate to heavy smokers in a controlled environment. Parameters of smoke inhalation including the start and end of each puff, inhale and exhale cycle, and smoke holding were computed from the breathing signal. From these, the traditional metrics of puff duration, inhale-exhale cycle duration, smoke holding duration, inter-puff interval, and novel Respiratory Smoke Exposure Metrics (RSEMs) such as inhale-exhale cycle volume, and inhale-exhale volume over time were calculated. The proposed RSEM algorithm to extract smoke exposure metrics named generated interclass correlations (ICCs) of 0.85 and 0.87 and Pearson's correlations of 0.97 and 0.77 with video observation and CReSS, respectively, for puff duration. Similarly, for the inhale-exhale duration, an ICC of 0.84 and Pearson's correlation of 0.81 was obtained with video observation. The RSEMs provided measures previously unavailable in research that are proportional to the depth and duration of smoke inhalation. The results suggest that the breathing signal may be used to compute smoke exposure metrics.

An electronic, smart lighter to measure cigarette smoking: A pilot study to assess feasibility and initial validity

Understanding variability in smoking patterns may inform smoking cessation interventions. Retrospective reports of cigarettes smoked per day may be biased and typically do not provide temporal precision regarding when cigarettes are smoked. However, real-time, user-initiated tracking, such as logging each time a cigarette is smoked, can be burdensome over long time frames. In this study, adult, non-treatment seeking daily smokers (N = 22) used an electronic, smart lighter to light and timestamp cigarettes for 14 days. Participants reported number of cigarettes smoked per day (CPD) via a mobile device (daily diary) and retrospectively reported CPD at the end of the study using the Timeline Followback (TLFB). Self-reported lighter satisfaction and adherence varied with 68% of participants reporting that they liked using the lighter and participants reporting using the lighter for 92% of cigarettes smoked, on average. Lighter-estimated CPD did not differ from daily diary-estimated CPD, but was significantly lower than TLFB estimates. The lighter resulted in greater day-to-day variability relative to other methods and fewer rounded cigarette counts (digit bias) relative to the TLFB. The lighter appears to be feasible for capturing data on smoking patterns in daily smokers. Though false positive cigarettes are likely low, additional technologies that augment data captured from the lighter may be necessary to reduce false negatives (missed cigarettes) and alternative lighter designs may appeal more to certain smokers.

Wearable Sensors for Monitoring of Cigarette Smoking in Free-Living: A Systematic Review

Globally, cigarette smoking is widespread among all ages, and smokers struggle to quit. The design of effective cessation interventions requires an accurate and objective assessment of smoking frequency and smoke exposure metrics. Recently, wearable devices have emerged as a means of assessing cigarette use. However, wearable technologies have inherent limitations, and their sensor responses are often influenced by wearers' behavior, motion and environmental factors. This paper presents a systematic review of current and forthcoming wearable technologies, with a focus on sensing elements, body placement, detection accuracy, underlying algorithms and applications. Full-texts of 86 scientific articles were reviewed in accordance with the Preferred Reporting Items for Systematic Review and Meta-Analyses (PRISMA) guidelines to address three research questions oriented to cigarette smoking, in order to: (1) Investigate the behavioral and physiological manifestations of cigarette smoking targeted by wearable sensors for smoking detection; (2) explore sensor modalities employed for detecting these manifestations; (3) evaluate underlying signal processing and pattern recognition methodologies and key performance metrics. The review identified five specific smoking manifestations targeted by sensors. The results suggested that no system reached 100% accuracy in the detection or evaluation of smoking-related features. Also, the testing of these sensors was mostly limited to laboratory settings. For a realistic evaluation of accuracy metrics, wearable devices require thorough testing under free-living conditions.

Objective Detection of Cigarette Smoking from Physiological Sensor Signals

Cigarette smoking has severe health impacts on those who smoke and the people around them. Several wearable sensing modalities have recently been investigated to collect objective data on daily smoking, including detection of smoking episodes from breathing patterns, hand to mouth behavior, and characteristic hand gestures or cigarette lighting events. In order to provide new insight into ongoing research on the objective collection of smoking-related events, this paper proposes a novel method to identify smoking events from the associated changes in heart rate parameters specific to smoking. The proposed method also accounts for the breathing rate and body motion of the person who is smoking to better distinguish these changes from intense physical activities. In this research, a human study was first performed on 20 daily cigarette smokers to record heart rate, breathing rate, and body acceleration collected from a wearable chest sensor consisting of an ECG and bioimpedance measurement sensor and a 3D inertial sensor. Each participant spent ~2 hours in a laboratory environment (mimicking daily activities that included smoking 4 cigarettes) and ~24 hours under unconstrained free-living conditions. A support vector machine-based classifier was developed to automatically detect smoking episodes from the captured sensor signals using fifteen features selected by a forward-feature selection method. In a leave one subject out cross-validation, the proposed approach detected smoking events (187 out of total 232) with the sensitivity and F-score accuracy of 0.87 and 0.79, respectively, in the laboratory setting (known activities) and 0.77 and 0.61, respectively, under free-living conditions. These results validate the proof-of-concept that, although further research is necessary for performance improvement, characteristic changes in heart rate parameters could be a useful indicator of cigarette smoking even under free-living conditions.