1
|
Fernandes GJ, Zheng J, Pedram M, Romano C, Shahabi F, Rothrock B, Cohen T, Zhu H, Butani TS, Hester J, Katsaggelos AK, Alshurafa N. HabitSense: A Privacy-Aware, AI-Enhanced Multimodal Wearable Platform for mHealth Applications. PROCEEDINGS OF THE ACM ON INTERACTIVE, MOBILE, WEARABLE AND UBIQUITOUS TECHNOLOGIES 2024; 8:101. [PMID: 40041122 PMCID: PMC11879279 DOI: 10.1145/3678591] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 03/06/2025]
Abstract
Wearable cameras provide an objective method to visually confirm and automate the detection of health-risk behaviors such as smoking and overeating, which is critical for developing and testing adaptive treatment interventions. Despite the potential of wearable camera systems, adoption is hindered by inadequate clinician input in the design, user privacy concerns, and user burden. To address these barriers, we introduced HabitSense, an open-source, multi-modal neck-worn platform developed with input from focus groups with clinicians (N=36) and user feedback from in-wild studies involving 105 participants over 35 days. Optimized for monitoring health-risk behaviors, the platform utilizes RGB, thermal, and inertial measurement unit sensors to detect eating and smoking events in real time. In a 7-day study involving 15 participants, HabitSense recorded 768 hours of footage, capturing 420.91 minutes of hand-to-mouth gestures associated with eating and smoking data crucial for training machine learning models, achieving a 92% F1-score in gesture recognition. To address privacy concerns, the platform records only during likely health-risk behavior events using SECURE, a smart activation algorithm. Additionally, HabitSense employs on-device obfuscation algorithms that selectively obfuscate the background during recording, maintaining individual privacy while leaving gestures related to health-risk behaviors unobfuscated. Our implementation of SECURE has resulted in a 48% reduction in storage needs and a 30% increase in battery life. This paper highlights the critical roles of clinician feedback, extensive field testing, and privacy-enhancing algorithms in developing an unobtrusive, lightweight, and reproducible wearable system that is both feasible and acceptable for monitoring health-risk behaviors in real-world settings.
Collapse
|
2
|
Stump TK, Fastner S, Jo Y, Chipman J, Haaland B, Nagelhout ES, Wankier AP, Lensink R, Zhu A, Parsons B, Grossman D, Wu YP. Objectively-Assessed Ultraviolet Radiation Exposure and Sunburn Occurrence. INTERNATIONAL JOURNAL OF ENVIRONMENTAL RESEARCH AND PUBLIC HEALTH 2023; 20:5234. [PMID: 37047850 PMCID: PMC10094127 DOI: 10.3390/ijerph20075234] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 01/13/2023] [Revised: 03/09/2023] [Accepted: 03/15/2023] [Indexed: 06/19/2023]
Abstract
Ultraviolet radiation (UVR) exposure is the primary modifiable risk factor for melanoma. Wearable UVR sensors provide a means of quantifying UVR exposure objectively and with a lower burden than self-report measures used in most research. The purpose of this study was to evaluate the relationship between detected UVR exposure and reported sunburn occurrence. In this study, a UVR monitoring device was worn by 97 parent-child dyads during waking hours for 14 days to measure instantaneous and accumulated UVR exposure. The results showed that the participants' total UVR exposure was associated with reported sunburn after adjusting for Fitzpatrick skin type and geographic location. It was observed that one standard erythemal dose (SED) increase in the participants' daily total UVR exposure was associated with reported sunburn (an odds ratio (OR) of 1.26 with a 95% CI of 1.13 and 1.41, and p < 0.001 for parents and an OR of 1.28 with a 95% CI of 1.12 and 1.47, and p < 0.001 for children). A one-SED increase in the participants' UVR exposure from 10 am to 4 pm was also associated with reported sunburn (an OR of 1.31 with a 95% CI of 1.15 and 1.49, and p < 0.001 for parents and an OR of 1.33 with a 95% CI of 1.12 and 1.59, and p = 0.001 for children). We found that elevated UVR exposure recordings measured by the UVR sensor were associated with reported sunburn occurrence. Future directions for wearable UVR sensors may include their use as an intervention tool to support in-the-moment sunburn prevention.
Collapse
Affiliation(s)
- Tammy K. Stump
- Department of Dermatology, University of Utah Health Sciences Center, Salt Lake City, UT 84132, USA
- Huntsman Cancer Institute, University of Utah, Salt Lake City, UT 84112, USA
| | - Suzanne Fastner
- Department of Dermatology, University of Utah Health Sciences Center, Salt Lake City, UT 84132, USA
- Huntsman Cancer Institute, University of Utah, Salt Lake City, UT 84112, USA
| | - Yeonjung Jo
- Department of Population Health Sciences, University of Utah, Salt Lake City, UT 84108, USA
| | - Jonathan Chipman
- Huntsman Cancer Institute, University of Utah, Salt Lake City, UT 84112, USA
- Department of Population Health Sciences, University of Utah, Salt Lake City, UT 84108, USA
| | - Benjamin Haaland
- Huntsman Cancer Institute, University of Utah, Salt Lake City, UT 84112, USA
- Department of Population Health Sciences, University of Utah, Salt Lake City, UT 84108, USA
| | - Elizabeth S. Nagelhout
- Division of Public Health, Department of Family & Preventive Medicine, University of Utah, Salt Lake City, UT 84108, USA
| | - Ali P. Wankier
- Huntsman Cancer Institute, University of Utah, Salt Lake City, UT 84112, USA
| | - Riley Lensink
- Huntsman Cancer Institute, University of Utah, Salt Lake City, UT 84112, USA
| | - Angela Zhu
- Department of Pediatrics, University of Utah, Salt Lake City, UT 84113, USA
| | - Bridget Parsons
- Huntsman Cancer Institute, University of Utah, Salt Lake City, UT 84112, USA
| | - Douglas Grossman
- Department of Dermatology, University of Utah Health Sciences Center, Salt Lake City, UT 84132, USA
- Huntsman Cancer Institute, University of Utah, Salt Lake City, UT 84112, USA
| | - Yelena P. Wu
- Department of Dermatology, University of Utah Health Sciences Center, Salt Lake City, UT 84132, USA
- Huntsman Cancer Institute, University of Utah, Salt Lake City, UT 84112, USA
| |
Collapse
|
3
|
Robinson JK, Patel S, Heo SY, Gray E, Lim J, Kwon K, Christiansen Z, Model J, Trueb J, Banks A, Kwasny M, Rogers JA. Real-Time UV Measurement With a Sun Protection System for Warning Young Adults About Sunburn: Prospective Cohort Study. JMIR Mhealth Uhealth 2021; 9:e25895. [PMID: 33955844 PMCID: PMC8138709 DOI: 10.2196/25895] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/19/2020] [Revised: 01/22/2021] [Accepted: 04/05/2021] [Indexed: 01/06/2023] Open
Abstract
Background Melanoma is attributable to predisposing phenotypical factors, such as skin that easily sunburns and unprotected exposure to carcinogenic UV radiation. Reducing the proportion of young adults who get sunburned may reduce the incidence of melanoma, a deadly form of skin cancer. Advances in technology have enabled the delivery of real-time UV light exposure and content-relevant health interventions. Objective This study aims to examine the feasibility of young adults performing the following tasks daily: wearing a UV dosimeter, receiving text messages and real-time UV-B doses on their smartphone, and responding to daily web-based surveys about sunburn and sun protection. Methods Young adults aged 18-39 years (n=42) were recruited in the United States in June 2020 via social media. Participants received the UV Guard sun protection system, which consisted of a UV dosimeter and a smartphone app. During 3 consecutive periods, intervention intensity increased as follows: real-time UV-B dose; UV-B dose and daily behavioral facilitation text messages; and UV-B dose, goal setting, and daily text messages to support self-efficacy and self-regulation. Data were self-reported through daily web-based surveys for 28 days, and UV-B doses were transmitted to cloud-based storage. Results Patients’ median age was 22 years (IQR 20, 29), and all patients had sun-sensitive skin. Sunburns were experienced during the study by fewer subjects (n=18) than those in the preceding 28 days (n=30). In July and August, the face was the most commonly sunburned area among 13 body locations; 52% (22/42) of sunburns occurred before the study and 45% (19/42) occurred during the study. The mean daily UV-B dose decreased during the 3 periods; however, this was not statistically significant. Young adults were most often exercising outdoors from 2 to 6 PM, walking from 10 AM to 6 PM, and relaxing from noon to 2 PM. Sunburn was most often experienced during exercise (odds ratio [OR] 5.65, 95% CI 1.60-6.10) and relaxation (OR 3.69, 95% CI 1.03-4.67) relative to those that did not exercise or relax in each category. The self-reported exit survey indicated that participants felt that they spent less time outdoors this summer compared to the last summer because of the COVID-19 pandemic and work. In addition, 38% (16/42) of the participants changed their use of sun protection based on their app-reported UV exposure, and 48% (20/42) shifted the time they went outside to periods with less-intense UV exposure. A total of 79% (33/42) of the participants were willing to continue using the UV Guard system outside of a research setting. Conclusions In this proof-of-concept research, young adults demonstrated that they used the UV Guard system; however, optimization was needed. Although some sun protection behaviors changed, sunburn was not prevented in all participants, especially during outdoor exercise. Trial Registration ClinicalTrials.gov NCT03344796; http://clinicaltrials.gov/ct2/show/NCT03344796
Collapse
Affiliation(s)
- June K Robinson
- Northwestern University Feinberg School of Medicine, Chicago, IL, United States
| | - Shiv Patel
- Northwestern University Feinberg School of Medicine, Chicago, IL, United States
| | - Seung Yun Heo
- Department of Biomedical Engineering, Center for Bio-Integrated Electronics, Simpson Querrey Institute for BioNanotechnology, Northwestern University, Evanston, IL, United States
| | - Elizabeth Gray
- Department of Preventive Medicine, Northwestern University Feinberg School of Medicine, Chicago, IL, United States
| | - Jaeman Lim
- Wearifi Inc, Evanston, IL, United States
| | - Kyeongha Kwon
- Department of Biomedical Engineering, Center for Bio-Integrated Electronics, Simpson Querrey Institute for BioNanotechnology, Northwestern University, Evanston, IL, United States.,School of Electrical Engineering, Korea Advanced Institute of Science and Technology, Daejeon, Republic of Korea
| | | | | | - Jacob Trueb
- Department of Biomedical Engineering, Center for Bio-Integrated Electronics, Simpson Querrey Institute for BioNanotechnology, Northwestern University, Evanston, IL, United States
| | - Anthony Banks
- Department of Biomedical Engineering, Center for Bio-Integrated Electronics, Simpson Querrey Institute for BioNanotechnology, Northwestern University, Evanston, IL, United States
| | - Mary Kwasny
- Department of Preventive Medicine, Northwestern University Feinberg School of Medicine, Chicago, IL, United States
| | - John A Rogers
- Department of Biomedical Engineering, Center for Bio-Integrated Electronics, Simpson Querrey Institute for BioNanotechnology, Northwestern University, Evanston, IL, United States
| |
Collapse
|
4
|
Robinson JK, Durst DA, Gray E, Kwasny M. Protection-adjusted UV dose estimated for body areas: Daily self-reported sun protection modification of wearable UV sensor dose. PHOTODERMATOLOGY PHOTOIMMUNOLOGY & PHOTOMEDICINE 2020; 36:357-364. [PMID: 32189399 DOI: 10.1111/phpp.12557] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/03/2019] [Revised: 02/16/2020] [Accepted: 03/13/2020] [Indexed: 12/19/2022]
Abstract
BACKGROUND During the last 20 years, 50% of adults with sun-sensitive skin have sunburned annually. Reducing the proportion of people who sunburn requires understanding the circumstances and outdoor activities during which at-risk people sunburn. METHODS A 7-day observational study of melanoma survivors (n = 20) and young adult first-degree relatives of melanoma survivors (FDRs) (n = 20) captured daily UV exposure, sun protection, and sunburns during spring and summer in the Midwest of the United States (latitude 41.8°N). Participants wore UV and physical activity sensors and completed a daily self-reported survey of sun protection, sunburn, and physical activities. The estimated protection-adjusted UV dose was calculated for each body area by integrating self-reported sun protection with UV sensor dose. RESULTS In 254 days, at least one body area in 9 of 20 (45%) melanoma survivors and 11 of 20 (55%) FDRs was sunburned (erythema at 24 hours). Sunburns were associated with spring and walking for transportation or leisure, especially walking the dog. Melanoma survivors used sunscreen daily on the face; however, forearms and lower legs were not protected during walking. Young adults did not use sun protection on the face, forearms or lower legs during walking for transportation and use was ineffective during sports. CONCLUSION The sun protection patterns of daily living identified in this study may promote recognition of erythema as sunburn and inform the development of tailored sun protection mobile applications promoting self-monitoring with wearable UV sensors.
Collapse
Affiliation(s)
- June K Robinson
- Department of Dermatology, Northwestern University, Feinberg School of Medicine, Chicago, IL, USA
| | - Dalya A Durst
- Department of Dermatology, Northwestern University, Feinberg School of Medicine, Chicago, IL, USA
| | - Elizabeth Gray
- Department of Preventive Medicine, Northwestern University, Feinberg School of Medicine, Chicago, IL, USA
| | - Mary Kwasny
- Department of Preventive Medicine, Northwestern University, Feinberg School of Medicine, Chicago, IL, USA
| |
Collapse
|
5
|
Stump TK, Spring B, Marchese SH, Alshurafa N, Robinson JK. Toward a precision behavioral medicine approach to addressing high-risk sun exposure: a qualitative analysis. JAMIA Open 2019; 2:547-553. [PMID: 32025652 PMCID: PMC6994011 DOI: 10.1093/jamiaopen/ooz034] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/15/2019] [Revised: 07/11/2019] [Accepted: 08/01/2019] [Indexed: 11/17/2022] Open
Abstract
OBJECTIVES Precision behavioral medicine techniques integrating wearable ultraviolet radiation (UVR) sensors may help individuals avoid sun exposure that places them at-risk for skin cancer. As a preliminary step in our patient-centered process of developing a just-in-time adaptive intervention, this study evaluated reactions and preferences to UVR sensors among melanoma survivors. MATERIALS AND METHODS Early stage adult melanoma survivors were recruited for a focus group (n = 11) or 10-day observational study, which included daily wearing a UVR sensor and sun exposure surveys (n = 39). Both the focus group moderator guide and observational study exit interviews included questions on UVR sensing as a potential intervention strategy. These responses were transcribed and coded using an inductive strategy. RESULTS Most observational study participants (84.6%) said they would find information provided by UVR sensors to be useful to help them learn about how specific conditions (eg, clouds, location) impact sun exposure and provide in-the-moment alerts. Focus group participants expressed enthusiasm for UVR information and identified preferred qualities of a UVR sensor, such as small size and integration with other devices. Participants in both studies indicated concern that UVR feedback may be difficult to interpret and some expressed that a UVR sensor may not be convenient or desirable to wear in daily life. DISCUSSION Melanoma survivors believe that personalized UVR exposure information could improve their sun protection and want this information delivered in a method that is meaningful and actionable. CONCLUSION UVR sensing is a promising component of a precision behavioral medicine strategy to reduce skin cancer risk.
Collapse
Affiliation(s)
- Tammy K Stump
- Department of Preventive Medicine, Northwestern University Feinberg School of Medicine, Chicago, Illinois, USA
| | - Bonnie Spring
- Department of Preventive Medicine, Northwestern University Feinberg School of Medicine, Chicago, Illinois, USA
| | - Sara Hoffman Marchese
- Department of Preventive Medicine, Northwestern University Feinberg School of Medicine, Chicago, Illinois, USA
| | - Nabil Alshurafa
- Department of Preventive Medicine, Northwestern University Feinberg School of Medicine, Chicago, Illinois, USA
| | - June K Robinson
- Department of Dermatology, Northwestern University Feinberg School of Medicine, Chicago, Illinois, USA
- Robert H. Lurie Comprehensive Cancer Center, Northwestern University, Chicago, Illinois, USA
| |
Collapse
|