1
|
King ZD, Yu H, Vaessen T, Myin-Germeys I, Sano A. Investigating Receptivity and Affect Using Machine Learning: Ecological Momentary Assessment and Wearable Sensing Study. JMIR Mhealth Uhealth 2024; 12:e46347. [PMID: 38324358 PMCID: PMC10882474 DOI: 10.2196/46347] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/08/2023] [Revised: 11/01/2023] [Accepted: 11/21/2023] [Indexed: 02/08/2024] Open
Abstract
BACKGROUND As mobile health (mHealth) studies become increasingly productive owing to the advancements in wearable and mobile sensor technology, our ability to monitor and model human behavior will be constrained by participant receptivity. Many health constructs are dependent on subjective responses, and without such responses, researchers are left with little to no ground truth to accompany our ever-growing biobehavioral data. This issue can significantly impact the quality of a study, particularly for populations known to exhibit lower compliance rates. To address this challenge, researchers have proposed innovative approaches that use machine learning (ML) and sensor data to modify the timing and delivery of surveys. However, an overarching concern is the potential introduction of biases or unintended influences on participants' responses when implementing new survey delivery methods. OBJECTIVE This study aims to demonstrate the potential impact of an ML-based ecological momentary assessment (EMA) delivery system (using receptivity as the predictor variable) on the participants' reported emotional state. We examine the factors that affect participants' receptivity to EMAs in a 10-day wearable and EMA-based emotional state-sensing mHealth study. We study the physiological relationships indicative of receptivity and affect while also analyzing the interaction between the 2 constructs. METHODS We collected data from 45 healthy participants wearing 2 devices measuring electrodermal activity, accelerometer, electrocardiography, and skin temperature while answering 10 EMAs daily, containing questions about perceived mood. Owing to the nature of our constructs, we can only obtain ground truth measures for both affect and receptivity during responses. Therefore, we used unsupervised and supervised ML methods to infer affect when a participant did not respond. Our unsupervised method used k-means clustering to determine the relationship between physiology and receptivity and then inferred the emotional state during nonresponses. For the supervised learning method, we primarily used random forest and neural networks to predict the affect of unlabeled data points as well as receptivity. RESULTS Our findings showed that using a receptivity model to trigger EMAs decreased the reported negative affect by >3 points or 0.29 SDs in our self-reported affect measure, scored between 13 and 91. The findings also showed a bimodal distribution of our predicted affect during nonresponses. This indicates that this system initiates EMAs more commonly during states of higher positive emotions. CONCLUSIONS Our results showed a clear relationship between affect and receptivity. This relationship can affect the efficacy of an mHealth study, particularly those that use an ML algorithm to trigger EMAs. Therefore, we propose that future work should focus on a smart trigger that promotes EMA receptivity without influencing affect during sampled time points.
Collapse
Affiliation(s)
- Zachary D King
- Department of Electrical and Computer Engineering, Rice University, Houston, TX, United States
| | - Han Yu
- Department of Electrical and Computer Engineering, Rice University, Houston, TX, United States
| | - Thomas Vaessen
- Center For Contextual Psychiatry, Katholieke Universiteit Leuven, Leuven, Belgium
- Department of Psychology, Health & Technology, University of Twente, Enschede, Netherlands
| | - Inez Myin-Germeys
- Center For Contextual Psychiatry, Katholieke Universiteit Leuven, Leuven, Belgium
| | - Akane Sano
- Department of Electrical and Computer Engineering, Rice University, Houston, TX, United States
| |
Collapse
|
2
|
Lu S, Stone JE, Klerman EB, McHill AW, Barger LK, Robbins R, Fischer D, Sano A, Czeisler CA, Rajaratnam SMW, Phillips AJK. The organization of sleep-wake patterns around daily schedules in college students. Sleep 2023:zsad278. [PMID: 37930792 DOI: 10.1093/sleep/zsad278] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/14/2023] [Indexed: 11/07/2023] Open
Abstract
Time is a zero-sum game, and consequently, sleep is often sacrificed for waking activities. For college students, daily activities, comprised of scheduled classes, work, study, social and other extracurricular events, are major contributors to insufficient and poor-quality sleep. We investigated the impact of daily schedules on sleep-wake timing in 223 undergraduate students (age: 18-27 years, 37% females) from a United States (U.S.) university, monitored for approximately 30 days. Sleep-wake timing and daily recorded activities (attendance at academic, studying, exercise-based and/or extracurricular activities) were captured by a twice-daily internet-based diary. Wrist-worn actigraphy was conducted to confirm sleep-wake timing. Linear mixed models were used to quantify associations between daily schedule and sleep-wake timing at between-person and within-person levels. Later schedule start time predicted later sleep onset (between and within: p<.001), longer sleep duration on the previous night (within: p<.001), and later wake time (between and within: p<.001). Later schedule end time predicted later sleep onset (between: p<.05, within: p<.001) and shorter sleep duration that night (within: p<.001). For every 1 hour that recorded activities extended beyond 10pm, sleep onset was delayed by 15 minutes at the within-person level and 45 minutes at the between-person level, and sleep duration was shortened by 5 and 23 minutes, respectively. Increased daily documented total activity time predicted earlier wake (between and within: p<.001), later sleep onset that night (within: p<.05), and shorter sleep duration (within: p<.001). These results indicate that daily schedules are an important factor in shaping sleep timing and duration in college students.
Collapse
Affiliation(s)
- Sinh Lu
- Turner Institute for Brain and Mental Health, School of Psychological Sciences, Monash University, Clayton, Victoria, Australia
| | - Julia E Stone
- Turner Institute for Brain and Mental Health, School of Psychological Sciences, Monash University, Clayton, Victoria, Australia
| | - Elizabeth B Klerman
- Department of Neurology, Massachusetts General Hospital, Boston, Massachusetts, USA
- Division of Sleep and Circadian Disorders, Department of Medicine and Neurology, Brigham and Women's Hospital, Boston, Massachusetts, USA
- Division of Sleep Medicine, Harvard Medical School, Boston, Massachusetts, USA
| | - Andrew W McHill
- Division of Sleep and Circadian Disorders, Department of Medicine and Neurology, Brigham and Women's Hospital, Boston, Massachusetts, USA
- Division of Sleep Medicine, Harvard Medical School, Boston, Massachusetts, USA
- Sleep, Chronobiology, and Health Laboratory, School of Nursing, Oregon Health & Science University, Portland, Oregon, USA
| | - Laura K Barger
- Division of Sleep and Circadian Disorders, Department of Medicine and Neurology, Brigham and Women's Hospital, Boston, Massachusetts, USA
- Division of Sleep Medicine, Harvard Medical School, Boston, Massachusetts, USA
| | - Rebecca Robbins
- Division of Sleep and Circadian Disorders, Department of Medicine and Neurology, Brigham and Women's Hospital, Boston, Massachusetts, USA
- Division of Sleep Medicine, Harvard Medical School, Boston, Massachusetts, USA
| | - Dorothee Fischer
- Department of Sleep and Human Factors Research, Institute for Aerospace Medicine, German Aerospace Center, Cologne, Germany
| | - Akane Sano
- Department of Electrical and Computer Engineering, Rice University, Houston, Texas, USA
- Affective Computing Group, Media Lab, Massachusetts Institute of Technology, Cambridge, MA, USA
| | - Charles A Czeisler
- Division of Sleep and Circadian Disorders, Department of Medicine and Neurology, Brigham and Women's Hospital, Boston, Massachusetts, USA
- Division of Sleep Medicine, Harvard Medical School, Boston, Massachusetts, USA
| | - Shantha M W Rajaratnam
- Turner Institute for Brain and Mental Health, School of Psychological Sciences, Monash University, Clayton, Victoria, Australia
- Division of Sleep and Circadian Disorders, Department of Medicine and Neurology, Brigham and Women's Hospital, Boston, Massachusetts, USA
- Division of Sleep Medicine, Harvard Medical School, Boston, Massachusetts, USA
| | - Andrew J K Phillips
- Turner Institute for Brain and Mental Health, School of Psychological Sciences, Monash University, Clayton, Victoria, Australia
- Division of Sleep and Circadian Disorders, Department of Medicine and Neurology, Brigham and Women's Hospital, Boston, Massachusetts, USA
- Division of Sleep Medicine, Harvard Medical School, Boston, Massachusetts, USA
| |
Collapse
|
3
|
Masumoto N, Kato S, Aichi M, Hasegawa S, Sahara K, Suyama K, Sano A, Miyazaki T, Okudela K, Kaneko T, Takahashi T. AMPAR receptor inhibitors suppress proliferation of human small cell lung cancer cell lines. Thorac Cancer 2023; 14:2897-2908. [PMID: 37605807 PMCID: PMC10569908 DOI: 10.1111/1759-7714.15075] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/19/2023] [Revised: 07/31/2023] [Accepted: 08/01/2023] [Indexed: 08/23/2023] Open
Abstract
BACKGROUND Small cell lung cancer (SCLC) is a neuroendocrine tumor with poor prognosis. Neuroendocrine tumors possess characteristics of both nerve cells and hormone-secreting cells; therefore, targeting the neuronal properties of these tumors may lead to the development of new therapeutic options. Among the endogenous signaling pathways in the nervous system, targeting the glutamate pathway may be a useful strategy for glioblastoma treatment. Perampanel, an antagonist of the synaptic glutamate α-amino-3-hydroxy-5-methyl-4-isoxazole propionic acid receptor (AMPAR), has been reported to be effective in patients with glioblastoma. In this study, we aimed to investigate the antitumor effects of AMPAR antagonists in human SCLC cell lines. METHODS We performed to examine the expression of AMPAR using Western blot and immunohistochemical analysis. The antitumor effects of AMPAR antagonists on human SCLC cell lines were investigated in vitro and in vivo. We also analyzed the signaling pathway of AMPAR antagonists in SCLC cell lines. Statistical analysis was performed by the GraphPad Prism 6 software. RESULTS We first examined the expression of endogenous AMPAR in six human SCLC cell lines, detecting AMPAR proteins in all of them. Next, we tested the anti-proliferative effect of two AMPAR antagonists, talampanel and cyanquixaline, using SCLC cells in vitro and in vivo. Both AMPAR antagonists inhibited cell proliferation and mitogen-activated protein kinase (MAPK) phosphorylation in SCLC cells in vitro. Further, we observed reduced proliferation of implanted cell lines in an in vivo setting, assessed by Ki-67 immunohistochemistry. Additionally, using immunohistochemical analysis we confirmed AMPAR protein expression in human SCLC samples. CONCLUSION AMPAR may be a potential therapeutic target for SCLC.
Collapse
Affiliation(s)
- Nami Masumoto
- Department of PulmonologyYokohama City University Graduate School of MedicineYokohamaJapan
- Department of PhysiologyYokohama City University Graduate School of MedicineYokohamaJapan
- Department of RespirologyNational Hospital Organization Yokohama Medical CenterYokohamaJapan
| | - Shingo Kato
- Department of Clinical Cancer GenomicsYokohama City University HospitalYokohamaJapan
- Department of Gastroenterology and HepatologyYokohama City University Graduate School of MedicineYokohamaJapan
| | - Masahiro Aichi
- Department of PhysiologyYokohama City University Graduate School of MedicineYokohamaJapan
- Department of Obstetrics, Gynecology and Molecular Reproductive ScienceYokohama City University Graduate School of MedicineYokohamaJapan
| | - Sho Hasegawa
- Department of Gastroenterology and HepatologyYokohama City University Graduate School of MedicineYokohamaJapan
| | - Kota Sahara
- Department of PhysiologyYokohama City University Graduate School of MedicineYokohamaJapan
- Department of Gastroenterological SurgeryYokohama City University Graduate School of MedicineYokohamaJapan
| | - Kumiko Suyama
- Department of PhysiologyYokohama City University Graduate School of MedicineYokohamaJapan
| | - Akane Sano
- Department of PhysiologyYokohama City University Graduate School of MedicineYokohamaJapan
| | - Tomoyuki Miyazaki
- Department of PhysiologyYokohama City University Graduate School of MedicineYokohamaJapan
- Center for Promotion of Research and Industry‐Academic Collaboration, Department of Core Project PromotionYokohama City UniversityYokohamaJapan
| | - Koji Okudela
- Department of PathologyYokohama City University Graduate School of MedicineYokohamaJapan
| | - Takeshi Kaneko
- Department of PulmonologyYokohama City University Graduate School of MedicineYokohamaJapan
| | - Takuya Takahashi
- Department of PhysiologyYokohama City University Graduate School of MedicineYokohamaJapan
| |
Collapse
|
4
|
Ito-Masui A, Sakamoto R, Matsuo E, Kawamoto E, Motomura E, Tanii H, Yu H, Sano A, Imai H, Shimaoka M. Effect of an Internet-Delivered Cognitive Behavioral Therapy-Based Sleep Improvement App for Shift Workers at High Risk of Sleep Disorder: Single-Arm, Nonrandomized Trial. J Med Internet Res 2023; 25:e45834. [PMID: 37606971 PMCID: PMC10481224 DOI: 10.2196/45834] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/19/2023] [Revised: 06/02/2023] [Accepted: 07/04/2023] [Indexed: 08/23/2023] Open
Abstract
BACKGROUND Shift workers are at high risk of developing sleep disorders such as shift worker sleep disorder or chronic insomnia. Cognitive behavioral therapy (CBT) is the first-line treatment for insomnia, and emerging evidence shows that internet-based CBT is highly effective with additional features such as continuous tracking and personalization. However, there are limited studies on internet-based CBT for shift workers with sleep disorders. OBJECTIVE This study aimed to evaluate the impact of a 4-week, physician-assisted, internet-delivered CBT program incorporating machine learning-based well-being prediction on the sleep duration of shift workers at high risk of sleep disorders. We evaluated these outcomes using an internet-delivered CBT app and fitness trackers in the intensive care unit. METHODS A convenience sample of 61 shift workers (mean age 32.9, SD 8.3 years) from the intensive care unit or emergency department participated in the study. Eligible participants were on a 3-shift schedule and had a Pittsburgh Sleep Quality Index score ≥5. The study comprised a 1-week baseline period, followed by a 4-week intervention period. Before the study, the participants completed questionnaires regarding the subjective evaluation of sleep, burnout syndrome, and mental health. Participants were asked to wear a commercial fitness tracker to track their daily activities, heart rate, and sleep for 5 weeks. The internet-delivered CBT program included well-being prediction, activity and sleep chart, and sleep advice. A job-based multitask and multilabel convolutional neural network-based model was used for well-being prediction. Participant-specific sleep advice was provided by sleep physicians based on daily surveys and fitness tracker data. The primary end point of this study was sleep duration. For continuous measurements (sleep duration, steps, etc), the mean baseline and week-4 intervention data were compared. The 2-tailed paired t test or Wilcoxon signed rank test was performed depending on the distribution of the data. RESULTS In the fourth week of intervention, the mean daily sleep duration for 7 days (6.06, SD 1.30 hours) showed a statistically significant increase compared with the baseline (5.54, SD 1.36 hours; P=.02). Subjective sleep quality, as measured by the Pittsburgh Sleep Quality Index, also showed statistically significant improvement from baseline (9.10) to after the intervention (7.84; P=.001). However, no significant improvement was found in the subjective well-being scores (all P>.05). Feature importance analysis for all 45 variables in the prediction model showed that sleep duration had the highest importance. CONCLUSIONS The physician-assisted internet-delivered CBT program targeting shift workers with a high risk of sleep disorders showed a statistically significant increase in sleep duration as measured by wearable sensors along with subjective sleep quality. This study shows that sleep improvement programs using an app and wearable sensors are feasible and may play an important role in preventing shift work-related sleep disorders. INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID) RR2-10.2196/24799.
Collapse
Affiliation(s)
- Asami Ito-Masui
- Emergency and Critical Care Center, Mie University, Tsu, Japan
| | - Ryota Sakamoto
- Department of Medical Informatics, Mie University Hospital, Tsu, Japan
| | - Eri Matsuo
- Department of Molecular Pathology & Cell Adhesion Biology, Mie University Graduate School of Medicine, Tsu, Japan
| | - Eiji Kawamoto
- Emergency and Critical Care Center, Mie University, Tsu, Japan
| | - Eishi Motomura
- Department of Neuropsychiatry, Mie University Graduate School of Medicine, Tsu, Japan
| | - Hisashi Tanii
- Center for Physical & Mental Health, Mie University, Tsu, Japan
| | - Han Yu
- Department of Electrical & Computer Engineering, Rice University, Houston, TX, United States
| | - Akane Sano
- Department of Electrical & Computer Engineering, Rice University, Houston, TX, United States
| | - Hiroshi Imai
- Emergency and Critical Care Center, Mie University, Tsu, Japan
| | - Motomu Shimaoka
- Department of Molecular Pathology & Cell Adhesion Biology, Mie University Graduate School of Medicine, Tsu, Japan
| |
Collapse
|
5
|
Clay I, De Luca V, Sano A. Editorial: Multimodal digital approaches to personalized medicine. Front Big Data 2023; 6:1242482. [PMID: 37469442 PMCID: PMC10352833 DOI: 10.3389/fdata.2023.1242482] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/19/2023] [Accepted: 06/26/2023] [Indexed: 07/21/2023] Open
Affiliation(s)
- Ieuan Clay
- Vivosense Inc., Newport Coast, CA, United States
| | - Valeria De Luca
- Novartis Institutes for Biomedical Research, Basel, Switzerland
| | - Akane Sano
- Department of Electrical Computer Engineering, Computer Science, and Bioengineering, Rice University, Houston, TX, United States
| |
Collapse
|
6
|
Khalid M, Sano A. Exploiting social graph networks for emotion prediction. Sci Rep 2023; 13:6069. [PMID: 37055459 PMCID: PMC10100636 DOI: 10.1038/s41598-023-32825-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/19/2022] [Accepted: 04/03/2023] [Indexed: 04/15/2023] Open
Abstract
Emotion prediction plays an essential role in mental healthcare and emotion-aware computing. The complex nature of emotion resulting from its dependency on a person's physiological health, mental state, and his surroundings makes its prediction a challenging task. In this work, we utilize mobile sensing data to predict self-reported happiness and stress levels. In addition to a person's physiology, we also incorporate the environment's impact through weather and social network. To this end, we leverage phone data to construct social networks and develop a machine learning architecture that aggregates information from multiple users of the graph network and integrates it with the temporal dynamics of data to predict emotion for all users. The construction of social networks does not incur additional costs in terms of ecological momentary assessments or data collection from users and does not raise privacy concerns. We propose an architecture that automates the integration of the user's social network in affect prediction and is capable of dealing with the dynamic distribution of real-life social networks, making it scalable to large-scale networks. The extensive evaluation highlights the prediction performance improvement provided by the integration of social networks. We further investigate the impact of graph topology on the model's performance.
Collapse
Affiliation(s)
- Maryam Khalid
- Computational Wellbeing Group, Department of Electrical and Computer Engineering, Rice University, 6500 Main Street, Houston, 77005, TX, USA.
| | - Akane Sano
- Computational Wellbeing Group, Department of Electrical and Computer Engineering, Rice University, 6500 Main Street, Houston, 77005, TX, USA
| |
Collapse
|
7
|
Eiro T, Miyazaki T, Hatano M, Nakajima W, Arisawa T, Takada Y, Kimura K, Sano A, Nakano K, Mihara T, Takayama Y, Ikegaya N, Iwasaki M, Hishimoto A, Noda Y, Miyazaki T, Uchida H, Tani H, Nagai N, Koizumi T, Nakajima S, Mimura M, Matsuda N, Kanai K, Takahashi K, Ito H, Hirano Y, Kimura Y, Matsumoto R, Ikeda A, Takahashi T. Dynamics of AMPA receptors regulate epileptogenesis in patients with epilepsy. Cell Rep Med 2023; 4:101020. [PMID: 37080205 DOI: 10.1016/j.xcrm.2023.101020] [Citation(s) in RCA: 3] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/07/2022] [Revised: 02/08/2023] [Accepted: 03/22/2023] [Indexed: 04/22/2023]
Abstract
The excitatory glutamate α-amino-3-hydroxy-5-methyl-4-isoxazole propionic acid receptors (AMPARs) contribute to epileptogenesis. Thirty patients with epilepsy and 31 healthy controls are scanned using positron emission tomography with our recently developed radiotracer for AMPARs, [11C]K-2, which measures the density of cell-surface AMPARs. In patients with focal-onset seizures, an increase in AMPAR trafficking augments the amplitude of abnormal gamma activity detected by electroencephalography. In contrast, patients with generalized-onset seizures exhibit a decrease in AMPARs coupled with increased amplitude of abnormal gamma activity. Patients with epilepsy had reduced AMPAR levels compared with healthy controls, and AMPARs are reduced in larger areas of the cortex in patients with generalized-onset seizures compared with those with focal-onset seizures. Thus, epileptic brain function can be regulated by the enhanced trafficking of AMPAR due to Hebbian plasticity with increased simultaneous neuronal firing and compensational downregulation of cell-surface AMPARs by the synaptic scaling.
Collapse
Affiliation(s)
- Tsuyoshi Eiro
- Department of Physiology, Yokohama City University Graduate School of Medicine, Yokohama 236-0004, Japan; Department of Psychiatry, Yokohama City University Graduate School of Medicine, Yokohama 236-0004, Japan
| | - Tomoyuki Miyazaki
- Department of Physiology, Yokohama City University Graduate School of Medicine, Yokohama 236-0004, Japan
| | - Mai Hatano
- Department of Physiology, Yokohama City University Graduate School of Medicine, Yokohama 236-0004, Japan
| | - Waki Nakajima
- Department of Physiology, Yokohama City University Graduate School of Medicine, Yokohama 236-0004, Japan
| | - Tetsu Arisawa
- Department of Physiology, Yokohama City University Graduate School of Medicine, Yokohama 236-0004, Japan
| | - Yuuki Takada
- Department of Physiology, Yokohama City University Graduate School of Medicine, Yokohama 236-0004, Japan
| | - Kimito Kimura
- Department of Physiology, Yokohama City University Graduate School of Medicine, Yokohama 236-0004, Japan
| | - Akane Sano
- Department of Physiology, Yokohama City University Graduate School of Medicine, Yokohama 236-0004, Japan
| | - Kotaro Nakano
- Department of Physiology, Yokohama City University Graduate School of Medicine, Yokohama 236-0004, Japan
| | - Takahiro Mihara
- Department of Health Data Science, Yokohama City University Graduate School of Data Science, Yokohama 236-0004, Japan
| | - Yutaro Takayama
- Department of Neurosurgery, Yokohama City University Graduate School of Medicine, Yokohama 236-0004, Japan
| | - Naoki Ikegaya
- Department of Neurosurgery, Yokohama City University Graduate School of Medicine, Yokohama 236-0004, Japan
| | - Masaki Iwasaki
- Department of Neurosurgery, National Center Hospital, National Center of Neurology and Psychiatry, Kodaira 187-8551, Japan
| | - Akitoyo Hishimoto
- Department of Psychiatry, Yokohama City University Graduate School of Medicine, Yokohama 236-0004, Japan
| | - Yoshihiro Noda
- Department of Neuropsychiatry, Keio University School of Medicine, Tokyo 160-0016, Japan
| | - Takahiro Miyazaki
- Department of Neuropsychiatry, Keio University School of Medicine, Tokyo 160-0016, Japan
| | - Hiroyuki Uchida
- Department of Neuropsychiatry, Keio University School of Medicine, Tokyo 160-0016, Japan
| | - Hideaki Tani
- Department of Neuropsychiatry, Keio University School of Medicine, Tokyo 160-0016, Japan
| | - Nobuhiro Nagai
- Department of Neuropsychiatry, Keio University School of Medicine, Tokyo 160-0016, Japan
| | - Teruki Koizumi
- Department of Neuropsychiatry, Keio University School of Medicine, Tokyo 160-0016, Japan
| | - Shinichiro Nakajima
- Department of Neuropsychiatry, Keio University School of Medicine, Tokyo 160-0016, Japan
| | - Masaru Mimura
- Department of Neuropsychiatry, Keio University School of Medicine, Tokyo 160-0016, Japan
| | - Nozomu Matsuda
- Department of Neurology, Fukushima Medical University, Fukushima 960-1295, Japan
| | - Kazuaki Kanai
- Department of Neurology, Fukushima Medical University, Fukushima 960-1295, Japan
| | - Kazuhiro Takahashi
- Advanced Clinical Research Center, Fukushima Global Medical Science Center, Fukushima Medical University, Fukushima 960-1295, Japan
| | - Hiroshi Ito
- Advanced Clinical Research Center, Fukushima Global Medical Science Center, Fukushima Medical University, Fukushima 960-1295, Japan; Department of Radiology and Nuclear Medicine, Fukushima Medical University, Fukushima 960-1295, Japan
| | - Yoji Hirano
- Department of Neuropsychiatry, Graduate School of Medical Sciences, Kyushu University, Fukuoka 812-8582, Japan; Department of Psychiatry, Division of Clinical Neuroscience, Faculty of Medicine, University of Miyazaki, 5200 Kihara, Kiyotake, Miyazaki 889-1692, Japan
| | - Yuichi Kimura
- Faculty of Informatics, Cyber Informatics Research Institute, Kindai University, Higashi-Osaka 577-8502, Japan
| | - Riki Matsumoto
- Division of Neurology, Kobe University Graduate School of Medicine, Kobe 650-0017, Japan
| | - Akio Ikeda
- Department of Epilepsy, Movement Disorders and Physiology, Kyoto University Graduate School of Medicine, Kyoto 606-8507, Japan
| | - Takuya Takahashi
- Department of Physiology, Yokohama City University Graduate School of Medicine, Yokohama 236-0004, Japan; The University of Tokyo, International Research Center for Neurointelligence, Tokyo 113-0033, Japan.
| |
Collapse
|
8
|
Lamichhane B, Zhou J, Sano A. Psychotic Relapse Prediction in Schizophrenia Patients Using a Personalized Mobile Sensing-Based Supervised Deep Learning Model. IEEE J Biomed Health Inform 2023; PP. [PMID: 37037254 DOI: 10.1109/jbhi.2023.3265684] [Citation(s) in RCA: 4] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 04/12/2023]
Abstract
Mobile sensing-based modeling of behavioral changes could predict an oncoming psychotic relapse in schizophrenia patients for timely interventions. Deep learning models could complement existing non-deep learning models for relapse prediction by modeling latent behavioral features relevant to the prediction. However, given the inter-individual behavioral differences, model personalization might be required for a predictive model. In this work, we propose RelapsePredNet, a Long Short-Term Memory (LSTM) neural network-based model for relapse prediction. The model is personalized for a particular patient by training using data from patients most similar to the given patient. Several demographics and baseline mental health scores were considered as personalization metrics to define patient similarity. We investigated the effect of personalization on training dataset characteristics, learned embeddings, and relapse prediction performance. We compared RelapsePredNet with a deep learning-based anomaly detection model for relapse prediction. Further, we investigated if RelapsePredNet could complement ClusterRFModel (a random forest model leveraging clustering and template features proposed in prior work) in a fusion model, by identifying latent behavioral features relevant to relapse prediction. The CrossCheck dataset consisting of continuous mobile sensing data obtained from 63 schizophrenia patients, each monitored for up to a year, was used for our evaluations. The proposed RelapsePredNet outperformed the deep learning-based anomaly detection model for relapse prediction. The F2 score for prediction were 0.21 and 0.52 in the full test set and the Relapse Test Set (consisting of data from patients who have had relapse only), respectively. These corresponded to a 29.4% and 38.8% improvement compared to the existing deep learning-based model for relapse prediction. Patients' SFS score was the best personalization metric to define patient similarity. RelapsePredNet complemented the ClusterRFModel as it improved the F2 score by 26.1% with a fusion model, resulting in an F2 score of 0.30 in the full test set.
Collapse
|
9
|
Ando Y, Ono Y, Sano A, Fujita N, Ono S, Tanaka Y. Clinical characteristics and outcomes of pheochromocytoma crisis: a literature review of 200 cases. J Endocrinol Invest 2022; 45:2313-2328. [PMID: 35857218 DOI: 10.1007/s40618-022-01868-6] [Citation(s) in RCA: 5] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 03/09/2022] [Accepted: 07/08/2022] [Indexed: 10/17/2022]
Abstract
PURPOSE Pheochromocytoma crisis is a life-threatening endocrine emergency that requires prompt diagnosis and treatment. Because of its rarity, sudden onset, and lack of internationally uniform and validated diagnostic criteria, pheochromocytoma crisis remains to be fully clarified. Therefore, we aimed to describe the clinical characteristics and outcomes of pheochromocytoma crisis through a literature review. METHODS We performed a systematic literature search of PubMed/MEDLINE database, Igaku-Chuo-Zasshi (Japanese database), and Google Scholar to identify case reports of pheochromocytoma crisis published until February 5, 2021. Information was extracted and analyzed from the literature that reported adequate individual patient data of pheochromocytoma crisis in English or Japanese. Cases were also termed as pheochromocytoma multisystem crisis (PMC) if patients had signs of hyperthermia, multiple organ failure, encephalopathy, and labile blood pressure. RESULTS In the 200 cases of pheochromocytoma crisis identified from 187 articles, the mean patient age was 43.8 ± 15.5 years. The most common symptom was headache (39.5%). The heart was the most commonly damaged organ resulting from a complication of a pheochromocytoma crisis (99.0%), followed by the lungs (44.0%) and the kidney (21.5%). PMC accounted for 19.0% of all pheochromocytoma crisis cases. After excluding 12 cases with unknown survival statuses, the mortality rate was 13.8% (26/188 cases). Multivariable logistic regression analysis revealed that nausea and vomiting were significantly associated with a higher mortality rate. CONCLUSION Pheochromocytoma can present with different symptomatology, affecting different organ systems. Clinicians should be aware that patients with nausea or vomiting are at a higher risk of death because of pheochromocytoma crisis.
Collapse
Affiliation(s)
- Y Ando
- Department of General Medicine, National Defense Medical College, 3-2 Namiki, Tokorozawa, Saitama, 359-8513, Japan
- Department of Family Medicine, Graduate School of Medical and Dental Sciences, Tokyo Medical and Dental University, Bunkyo-ku, Tokyo, Japan
| | - Y Ono
- Department of General Medicine, National Defense Medical College, 3-2 Namiki, Tokorozawa, Saitama, 359-8513, Japan.
| | - A Sano
- Department of General Medicine, National Defense Medical College, 3-2 Namiki, Tokorozawa, Saitama, 359-8513, Japan
| | - N Fujita
- Department of General Medicine, National Defense Medical College, 3-2 Namiki, Tokorozawa, Saitama, 359-8513, Japan
| | - S Ono
- Department of Eat-Loss Medicine, Graduate School of Medicine, The University of Tokyo, Bunkyo-ku, Tokyo, Japan
| | - Y Tanaka
- Department of General Medicine, National Defense Medical College, 3-2 Namiki, Tokorozawa, Saitama, 359-8513, Japan
| |
Collapse
|
10
|
Moukaddam N, Sano A, Salas R, Hammal Z, Sabharwal A. Turning data into better mental health: Past, present, and future. Front Digit Health 2022; 4:916810. [PMID: 36060543 PMCID: PMC9428351 DOI: 10.3389/fdgth.2022.916810] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/10/2022] [Accepted: 07/21/2022] [Indexed: 11/13/2022] Open
Abstract
In this mini-review, we discuss the fundamentals of using technology in mental health diagnosis and tracking. We highlight those principles using two clinical concepts: (1) cravings and relapse in the context of addictive disorders and (2) anhedonia in the context of depression. This manuscript is useful for both clinicians wanting to understand the scope of technology use in psychiatry and for computer scientists and engineers wishing to assess psychiatric frameworks useful for diagnosis and treatment. The increase in smartphone ownership and internet connectivity, as well as the accelerated development of wearable devices, have made the observation and analysis of human behavior patterns possible. This has, in turn, paved the way to understand mental health conditions better. These technologies have immense potential in facilitating the diagnosis and tracking of mental health conditions; they also allow the implementation of existing behavioral treatments in new contexts (e.g., remotely, online, and in rural/underserved areas), and the possibility to develop new treatments based on new understanding of behavior patterns. The path to understand how to best use technology in mental health includes the need to match interdisciplinary frameworks from engineering/computer sciences and psychiatry. Thus, we start our review by introducing bio-behavioral sensing, the types of information available, and what behavioral patterns they may reflect and be related to in psychiatric diagnostic frameworks. This information is linked to the use of functional imaging, highlighting how imaging modalities can be considered "ground truth" for mental health/psychiatric dimensions, given the heterogeneity of clinical presentations, and the difficulty of determining what symptom corresponds to what disease. We then discuss how mental health/psychiatric dimensions overlap, yet differ from, psychiatric diagnoses. Using two clinical examples, we highlight the potential agreement areas in assessment/management of anhedonia and cravings. These two dimensions were chosen because of their link to two very prevalent diseases worldwide: depression and addiction. Anhedonia is a core symptom of depression, which is one of the leading causes of disability worldwide. Cravings, the urge to use a substance or perform an action (e.g., shopping, internet), is the leading step before relapse. Lastly, through the manuscript, we discuss potential mental health dimensions.
Collapse
Affiliation(s)
- Nidal Moukaddam
- Department of Psychiatry, Baylor College of Medicine, Houston Texas, United States
| | - Akane Sano
- Department of Electrical and Computer Engineering, Rice University, Houston, Texas, United States
| | - Ramiro Salas
- Department of Psychiatry, Baylor College of Medicine, The Menninger Clinic, Michael E DeBakey VA Medical Center, Houston, Texas, United States
| | - Zakia Hammal
- The Robotics Institute Department in the School of Computer Science, Carnegie Mellon University, Pittsburgh, PA, United States
| | - Ashutosh Sabharwal
- Department of Electrical and Computer Engineering, Rice University, Houston, Texas, United States
| |
Collapse
|
11
|
Yang H, Yu H, Sridhar K, Vaessen T, Myin-Germeys I, Sano A. More to Less (M2L): Enhanced Health Recognition in the Wild with Reduced Modality of Wearable Sensors. Annu Int Conf IEEE Eng Med Biol Soc 2022; 2022:3253-3256. [PMID: 36086549 DOI: 10.1109/embc48229.2022.9871472] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/15/2023]
Abstract
Accurately recognizing health-related conditions from wearable data is crucial for improved healthcare outcomes. To improve the recognition accuracy, various approaches have focused on how to effectively fuse information from multiple sensors. Fusing multiple sensors is a common choice in many applications, but may not always be feasible in real-world scenarios. For example, although combining biosignals from multiple sensors (i.e., a chest pad sensor and a wrist wearable sensor) has been proved effective for improved performance, wearing multiple devices might be impractical in the free-living context. To solve the challenges, we propose an effective more to less (M2L) learning framework to improve testing performance with reduced sensors through leveraging the complementary information of multiple modalities during training. More specifically, different sensors may carry different but complementary information, and our model is designed to enforce collaborations among different modalities, where positive knowledge transfer is encouraged and negative knowledge transfer is suppressed, so that better representation is learned for individual modalities. Our experimental results show that our framework achieves comparable performance when compared with the full modalities. Our code and results will be available at https://github.com/comp-well-org/More2Less.git.
Collapse
|
12
|
Clay I, Cormack F, Fedor S, Foschini L, Gentile G, van Hoof C, Kumar P, Lipsmeier F, Sano A, Smarr B, Vandendriessche B, De Luca V. Measuring Health-Related Quality of Life With Multimodal Data: Viewpoint. J Med Internet Res 2022; 24:e35951. [PMID: 35617003 PMCID: PMC9185357 DOI: 10.2196/35951] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/23/2021] [Revised: 02/14/2022] [Accepted: 04/25/2022] [Indexed: 11/18/2022] Open
Abstract
The ability to objectively measure aspects of performance and behavior is a fundamental pillar of digital health, enabling digital wellness products, decentralized trial concepts, evidence generation, digital therapeutics, and more. Emerging multimodal technologies capable of measuring several modalities simultaneously and efforts to integrate inputs across several sources are further expanding the limits of what digital measures can assess. Experts from the field of digital health were convened as part of a multi-stakeholder workshop to examine the progress of multimodal digital measures in two key areas: detection of disease and the measurement of meaningful aspects of health relevant to the quality of life. Here we present a meeting report, summarizing key discussion points, relevant literature, and finally a vision for the immediate future, including how multimodal measures can provide value to stakeholders across drug development and care delivery, as well as three key areas where headway will need to be made if we are to continue to build on the encouraging progress so far: collaboration and data sharing, removal of barriers to data integration, and alignment around robust modular evaluation of new measurement capabilities.
Collapse
Affiliation(s)
- Ieuan Clay
- Digital Medicine Society, Boston, MA, United States
| | | | | | | | | | | | | | | | - Akane Sano
- Department of Electrical and Computer Engineering, Rice University, Houston, TX, United States
| | - Benjamin Smarr
- Department of Bioengineering and Halicioglu Data Science Institute, University of California, San Diego, San Diego, CA, United States
| | | | - Valeria De Luca
- Novartis Institutes for Biomedical Research, Basel, Switzerland
| |
Collapse
|
13
|
Zhou J, Lamichhane B, Ben-Zeev D, Campbell A, Sano A. Predicting Psychotic Relapse in Schizophrenia With Mobile Sensor Data: Routine Cluster Analysis. JMIR Mhealth Uhealth 2022; 10:e31006. [PMID: 35404256 PMCID: PMC9039818 DOI: 10.2196/31006] [Citation(s) in RCA: 8] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/12/2021] [Revised: 10/19/2021] [Accepted: 02/17/2022] [Indexed: 01/20/2023] Open
Abstract
BACKGROUND Behavioral representations obtained from mobile sensing data can be helpful for the prediction of an oncoming psychotic relapse in patients with schizophrenia and the delivery of timely interventions to mitigate such relapse. OBJECTIVE In this study, we aim to develop clustering models to obtain behavioral representations from continuous multimodal mobile sensing data for relapse prediction tasks. The identified clusters can represent different routine behavioral trends related to daily living of patients and atypical behavioral trends associated with impending relapse. METHODS We used the mobile sensing data obtained from the CrossCheck project for our analysis. Continuous data from six different mobile sensing-based modalities (ambient light, sound, conversation, acceleration, etc) obtained from 63 patients with schizophrenia, each monitored for up to a year, were used for the clustering models and relapse prediction evaluation. Two clustering models, Gaussian mixture model (GMM) and partition around medoids (PAM), were used to obtain behavioral representations from the mobile sensing data. These models have different notions of similarity between behaviors as represented by the mobile sensing data, and thus, provide different behavioral characterizations. The features obtained from the clustering models were used to train and evaluate a personalized relapse prediction model using balanced random forest. The personalization was performed by identifying optimal features for a given patient based on a personalization subset consisting of other patients of similar age. RESULTS The clusters identified using the GMM and PAM models were found to represent different behavioral patterns (such as clusters representing sedentary days, active days but with low communication, etc). Although GMM-based models better characterized routine behaviors by discovering dense clusters with low cluster spread, some other identified clusters had a larger cluster spread, likely indicating heterogeneous behavioral characterizations. On the other hand, PAM model-based clusters had lower variability of cluster spread, indicating more homogeneous behavioral characterization in the obtained clusters. Significant changes near the relapse periods were observed in the obtained behavioral representation features from the clustering models. The clustering model-based features, together with other features characterizing the mobile sensing data, resulted in an F2 score of 0.23 for the relapse prediction task in a leave-one-patient-out evaluation setting. The obtained F2 score was significantly higher than that of a random classification baseline with an average F2 score of 0.042. CONCLUSIONS Mobile sensing can capture behavioral trends using different sensing modalities. Clustering of the daily mobile sensing data may help discover routine and atypical behavioral trends. In this study, we used GMM-based and PAM-based cluster models to obtain behavioral trends in patients with schizophrenia. The features derived from the cluster models were found to be predictive for detecting an oncoming psychotic relapse. Such relapse prediction models can be helpful in enabling timely interventions.
Collapse
Affiliation(s)
- Joanne Zhou
- Department of Statistics, Rice University, Houston, TX, United States
| | - Bishal Lamichhane
- Department of Electrical and Computer Engineering, Rice University, Houston, TX, United States
| | - Dror Ben-Zeev
- Behavioral Research in Technology and Engineering Center, Psychiatry and Behavioral Sciences, University of Washington, Seattle, WA, United States
| | - Andrew Campbell
- Department of Computer Science, Dartmouth College, Hanover, NH, United States
| | - Akane Sano
- Department of Electrical and Computer Engineering, Rice University, Houston, TX, United States
| |
Collapse
|
14
|
Lyon EN, Victor LH, Sano A. Health Label and Behavioral Feature Prediction Using Bayesian Hierarchical Vector Autoregression Models. Annu Int Conf IEEE Eng Med Biol Soc 2021; 2021:2290-2293. [PMID: 34891744 DOI: 10.1109/embc46164.2021.9630732] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/14/2023]
Abstract
The rising availability and accessibility of data from wearable devices and ubiquitous sensors allow the leveraging of computational methods to address human health and behavioral challenges. In particular, recent works have created time series, interpretable, and generalizable models for predicting patient healthcare outcomes from multidimensional data including expensive self-reported patient data, clinical data, and data from mobile and wearable devices. In this work, we used a Bayesian Hierarchical Vector Autoregression (BHVAR) model to predict behavioral and self-reported health outcomes on college student participants from passively collected data from their smartphones, wearable devices, and environment, as well as their self-reports. We also evaluated how the model performed being trained on 3, 7, 11, and 13 different features including some actionable and modifiable behavioral features. Then, we showed the value of augmenting self-reported datasets with many different types of data by demonstrating that additional inferences can be made with no significant toll on accuracy in comparison to using only self-reported features. Our models proved to be robust despite the greatly increased variable count as the reduced mean squared error (RMSE) of BHVAR over the patient-specific, maximum likelihood estimate (MLE) model was 10.5%, 14.9%, 26.6%, 39.6% in the 3, 7, 11, and 13 variable models respectively. We also obtained patient-level insights from clustering analysis of patient-level coefficients.
Collapse
|
15
|
Brown LS, Hilaire MAS, McHill AW, Phillips AJK, Barger LK, Sano A, Czeisler CA, Doyle FJ, Klerman EB. A classification approach to estimating human circadian phase under circadian alignment from actigraphy and photometry data. J Pineal Res 2021; 71:e12745. [PMID: 34050968 PMCID: PMC8474125 DOI: 10.1111/jpi.12745] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 04/01/2021] [Revised: 05/21/2021] [Accepted: 05/24/2021] [Indexed: 11/30/2022]
Abstract
The time of dim light melatonin onset (DLMO) is the gold standard for circadian phase assessment in humans, but collection of samples for DLMO is time and resource-intensive. Numerous studies have attempted to estimate circadian phase from actigraphy data, but most of these studies have involved individuals on controlled and stable sleep-wake schedules, with mean errors reported between 0.5 and 1 hour. We found that such algorithms are less successful in estimating DLMO in a population of college students with more irregular schedules: Mean errors in estimating the time of DLMO are approximately 1.5-1.6 hours. We reframed the problem as a classification problem and estimated whether an individual's current phase was before or after DLMO. Using a neural network, we found high classification accuracy of about 90%, which decreased the mean error in DLMO estimation-identifying the time at which the switch in classification occurs-to approximately 1.3 hours. To test whether this classification approach was valid when activity and circadian rhythms are decoupled, we applied the same neural network to data from inpatient forced desynchrony studies in which participants are scheduled to sleep and wake at all circadian phases (rather than their habitual schedules). In participants on forced desynchrony protocols, overall classification accuracy dropped to 55%-65% with a range of 20%-80% for a given day; this accuracy was highly dependent upon the phase angle (ie, time) between DLMO and sleep onset, with the highest accuracy at phase angles associated with nighttime sleep. Circadian patterns in activity, therefore, should be included when developing and testing actigraphy-based approaches to circadian phase estimation. Our novel algorithm may be a promising approach for estimating the onset of melatonin in some conditions and could be generalized to other hormones.
Collapse
Affiliation(s)
- Lindsey S. Brown
- Harvard John A. Paulson School of Engineering and Applied Sciences, Allston, MA 02134
- Corresponding author: 150 Western Avenue, Allston, MA 02134, ,
| | - Melissa A. St. Hilaire
- Division of Sleep Medicine, Harvard Medical School, Boston, MA 02115
- Division of Sleep and Circadian Disorders, Departments of Medicine and Neurology, Brigham and Women’s Hospital, Boston, MA 02115
| | - Andrew W. McHill
- Division of Sleep Medicine, Harvard Medical School, Boston, MA 02115
- Division of Sleep and Circadian Disorders, Departments of Medicine and Neurology, Brigham and Women’s Hospital, Boston, MA 02115
- Oregon Institute of Occupational Health Sciences, Oregon Health & Science University, Portland OR 97239
| | - Andrew J. K. Phillips
- Turner Institute for Brain and Mental Health, School of Psychological Science, Monash University, Clayton VIC 3168, Australia
| | - Laura K. Barger
- Division of Sleep Medicine, Harvard Medical School, Boston, MA 02115
- Division of Sleep and Circadian Disorders, Departments of Medicine and Neurology, Brigham and Women’s Hospital, Boston, MA 02115
| | - Akane Sano
- Affective Computing Group, Media Lab, Massachusetts Institute of Technology, Cambridge, MA 02139 (Akane Sano’s current address: Department of Electrical and Computer Engineering, Rice University, Houston, TX, 77098)
| | - Charles A. Czeisler
- Division of Sleep Medicine, Harvard Medical School, Boston, MA 02115
- Division of Sleep and Circadian Disorders, Departments of Medicine and Neurology, Brigham and Women’s Hospital, Boston, MA 02115
| | - Francis J. Doyle
- Harvard John A. Paulson School of Engineering and Applied Sciences, Allston, MA 02134
- Division of Sleep Medicine, Harvard Medical School, Boston, MA 02115
| | - Elizabeth B. Klerman
- Division of Sleep Medicine, Harvard Medical School, Boston, MA 02115
- Division of Sleep and Circadian Disorders, Departments of Medicine and Neurology, Brigham and Women’s Hospital, Boston, MA 02115
- Department of Neurology, Massachusetts General Hospital, Boston, MA 02114
- Corresponding author: 150 Western Avenue, Allston, MA 02134, ,
| |
Collapse
|
16
|
Arisawa T, Miyazaki T, Ota W, Sano A, Suyama K, Takada Y, Takahashi T. [ 11C]K-2 image with positron emission tomography represents cell surface AMPA receptors. Neurosci Res 2021; 173:106-113. [PMID: 34033829 DOI: 10.1016/j.neures.2021.05.009] [Citation(s) in RCA: 7] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/01/2021] [Revised: 04/29/2021] [Accepted: 05/20/2021] [Indexed: 11/27/2022]
Abstract
The glutamate α-amino-3-hydroxy-5-methyl-4-isoxazole propionic acid receptors (AMPARs) is an important molecule in neurotransmission. We have recently developed the first positron emission tomography (PET) tracer [11C]K-2 to visualize and quantify AMPARs in the living human brain. After injection, [11C]K-2 is hydrolyzed at the terminal amide (and is thus metabolized to a major metabolite, [11C]K-2OH) within 10 min, representing the PET image in rodents and humans. Here, we found that K-2OH did not penetrate the cell membrane but slowly passed through the blood brain barrier (BBB) with paracellular transport. Furthermore, major efflux transporters in the BBB did not carry K-2OH. Logan graphical analysis exhibited reversible binding kinetics of this radiotracer in healthy individuals; these results demonstrated that the PET image of this tracer represents cell surface AMPARs with passive penetration of [11C]K-2OH through the BBB, resulting in reversible binding kinetics. Thus, PET images with this tracer depict the physiologically crucial fraction of AMPARs.
Collapse
Affiliation(s)
- Tetsu Arisawa
- Yokohama City University Graduate School of Medicine, Department of Physiology, Yokohama, 236-0004, Japan
| | - Tomoyuki Miyazaki
- Yokohama City University Graduate School of Medicine, Department of Physiology, Yokohama, 236-0004, Japan
| | - Wataru Ota
- Yokohama City University Graduate School of Medicine, Department of Physiology, Yokohama, 236-0004, Japan
| | - Akane Sano
- Yokohama City University Graduate School of Medicine, Department of Physiology, Yokohama, 236-0004, Japan
| | - Kumiko Suyama
- Yokohama City University Graduate School of Medicine, Department of Physiology, Yokohama, 236-0004, Japan
| | - Yuuki Takada
- Yokohama City University Graduate School of Medicine, Department of Physiology, Yokohama, 236-0004, Japan
| | - Takuya Takahashi
- Yokohama City University Graduate School of Medicine, Department of Physiology, Yokohama, 236-0004, Japan.
| |
Collapse
|
17
|
McHill AW, Sano A, Hilditch CJ, Barger LK, Czeisler CA, Picard R, Klerman EB. Robust stability of melatonin circadian phase, sleep metrics, and chronotype across months in young adults living in real-world settings. J Pineal Res 2021; 70:e12720. [PMID: 33523499 PMCID: PMC9135480 DOI: 10.1111/jpi.12720] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 01/13/2021] [Accepted: 01/24/2021] [Indexed: 01/26/2023]
Abstract
Appropriate synchronization of the timing of behaviors with the circadian clock and adequate sleep are both important for almost every physiological process. The timing of the circadian clock relative to social (ie, local) clock time and the timing of sleep can vary greatly among individuals. Whether the timing of these processes is stable within an individual is not well-understood. We examined the stability of circadian-controlled melatonin timing, sleep timing, and their interaction across ~ 100 days in 15 students at a single university. At three time points ~ 35-days apart, circadian timing was determined from the dim-light melatonin onset (DLMO). Sleep behaviors (timing and duration) and chronotype (ie, mid-sleep time on free days corrected for sleep loss on school/work days) were determined via actigraphy and analyzed in ~ 1-month bins. Melatonin timing was stable, with an almost perfect relationship strength as determined via intraclass correlation coefficients ([ICC]=0.85); average DLMO timing across all participants only changed from the first month by 21 minutes in month 2 and 5 minutes in month 3. Sleep behaviors also demonstrated high stability, with ICC relationship strengths ranging from substantial to almost perfect (ICCs = 0.65-0.85). Average DLMO was significantly associated with average chronotype (r2 = 0.53, P <.01), with chronotype displaying substantial stability across months (ICC = 0.61). These findings of a robust stability in melatonin timing and sleep behaviors in young adults living in real-world settings holds promise for a better understanding of the reliability of previous cross-sectional reports and for the future individualized strategies to combat circadian-associated disease and impaired safety (ie, "chronomedicine").
Collapse
Affiliation(s)
- Andrew W. McHill
- Division of Sleep and Circadian Disorders, Departments of Medicine and Neurology, Brigham and Women’s Hospital, Boston, MA, USA
- Division of Sleep Medicine, Department of Medicine, Harvard Medical School, Boston, MA, USA
- Oregon Institute of Occupational Health Sciences, Oregon Health & Science University, Portland, OR, USA
| | - Akane Sano
- Affective Computing Group, Media Lab, Massachusetts Institute of Technology, Cambridge, MA, USA
- Department of Electrical and Computer Engineering, Rice University, Houston, TX, USA
| | - Cassie J. Hilditch
- Division of Sleep and Circadian Disorders, Departments of Medicine and Neurology, Brigham and Women’s Hospital, Boston, MA, USA
- Division of Sleep Medicine, Department of Medicine, Harvard Medical School, Boston, MA, USA
- Fatigue Countermeasures Laboratory, Department of Psychology, San José State University, San Jose, CA, USA
| | - Laura K. Barger
- Division of Sleep and Circadian Disorders, Departments of Medicine and Neurology, Brigham and Women’s Hospital, Boston, MA, USA
- Division of Sleep Medicine, Department of Medicine, Harvard Medical School, Boston, MA, USA
| | - Charles A. Czeisler
- Division of Sleep and Circadian Disorders, Departments of Medicine and Neurology, Brigham and Women’s Hospital, Boston, MA, USA
- Division of Sleep Medicine, Department of Medicine, Harvard Medical School, Boston, MA, USA
| | - Rosalind Picard
- Affective Computing Group, Media Lab, Massachusetts Institute of Technology, Cambridge, MA, USA
| | - Elizabeth B. Klerman
- Division of Sleep and Circadian Disorders, Departments of Medicine and Neurology, Brigham and Women’s Hospital, Boston, MA, USA
- Division of Sleep Medicine, Department of Medicine, Harvard Medical School, Boston, MA, USA
- Department of Neurology, Massachusetts General Hospital, Boston, MA, USA
| |
Collapse
|
18
|
Jitsuki-Takahashi A, Jitsuki S, Yamashita N, Kawamura M, Abe M, Sakimura K, Sano A, Nakamura F, Goshima Y, Takahashi T. Activity-induced secretion of semaphorin 3A mediates learning. Eur J Neurosci 2021; 53:3279-3293. [PMID: 33772906 PMCID: PMC8252788 DOI: 10.1111/ejn.15210] [Citation(s) in RCA: 9] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/02/2020] [Revised: 03/16/2021] [Accepted: 03/22/2021] [Indexed: 12/31/2022]
Abstract
The semaphorin family is a well‐characterized family of secreted or membrane‐bound proteins that are involved in activity‐independent neurodevelopmental processes, such as axon guidance, cell migration, and immune functions. Although semaphorins have recently been demonstrated to regulate activity‐dependent synaptic scaling, their roles in Hebbian synaptic plasticity as well as learning and memory remain poorly understood. Here, using a rodent model, we found that an inhibitory avoidance task, a hippocampus‐dependent contextual learning paradigm, increased secretion of semaphorin 3A in the hippocampus. Furthermore, the secreted semaphorin 3A in the hippocampus mediated contextual memory formation likely by driving AMPA receptors into hippocampal synapses via the neuropilin1–plexin A4–semaphorin receptor complex. This signaling process involves alteration of the phosphorylation status of collapsin response mediator protein 2, which has been characterized as a downstream molecule in semaphorin signaling. These findings implicate semaphorin family as a regulator of Hebbian synaptic plasticity and learning.
Collapse
Affiliation(s)
- Aoi Jitsuki-Takahashi
- Department of Physiology, Yokohama City University Graduate School of Medicine, Yokohama, Japan.,Department of Molecular Pharmacology and Neurobiology, Yokohama City University Graduate School of Medicine, Yokohama, Japan.,Department of Biochemistry, Tokyo Women's Medical University School of Medicine, Tokyo, Japan
| | - Susumu Jitsuki
- Department of Physiology, Yokohama City University Graduate School of Medicine, Yokohama, Japan
| | - Naoya Yamashita
- Department of Pharmacology, Juntendo University School of Medicine, Tokyo, Japan
| | - Meiko Kawamura
- Department of Animal Model Development, Brain Research Institute, Niigata University, Niigata, Japan
| | - Manabu Abe
- Department of Animal Model Development, Brain Research Institute, Niigata University, Niigata, Japan
| | - Kenji Sakimura
- Department of Animal Model Development, Brain Research Institute, Niigata University, Niigata, Japan
| | - Akane Sano
- Department of Physiology, Yokohama City University Graduate School of Medicine, Yokohama, Japan
| | - Fumio Nakamura
- Department of Biochemistry, Tokyo Women's Medical University School of Medicine, Tokyo, Japan
| | - Yoshio Goshima
- Department of Molecular Pharmacology and Neurobiology, Yokohama City University Graduate School of Medicine, Yokohama, Japan
| | - Takuya Takahashi
- Department of Physiology, Yokohama City University Graduate School of Medicine, Yokohama, Japan
| |
Collapse
|
19
|
Ito-Masui A, Kawamoto E, Sakamoto R, Yu H, Sano A, Motomura E, Tanii H, Sakano S, Esumi R, Imai H, Shimaoka M. Internet-Based Individualized Cognitive Behavioral Therapy for Shift Work Sleep Disorder Empowered by Well-Being Prediction: Protocol for a Pilot Study. JMIR Res Protoc 2021; 10:e24799. [PMID: 33626497 PMCID: PMC8088862 DOI: 10.2196/24799] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/07/2020] [Revised: 01/10/2021] [Accepted: 02/24/2021] [Indexed: 11/16/2022] Open
Abstract
Background Shift work sleep disorders (SWSDs) are associated with the high turnover rates of nurses, and are considered a major medical safety issue. However, initial management can be hampered by insufficient awareness. In recent years, it has become possible to visualize, collect, and analyze the work-life balance of health care workers with irregular sleeping and working habits using wearable sensors that can continuously monitor biometric data under real-life settings. In addition, internet-based cognitive behavioral therapy for psychiatric disorders has been shown to be effective. Application of wearable sensors and machine learning may potentially enhance the beneficial effects of internet-based cognitive behavioral therapy. Objective In this study, we aim to develop and evaluate the effect of a new internet-based cognitive behavioral therapy for SWSD (iCBTS). This system includes current methods such as medical sleep advice, as well as machine learning well-being prediction to improve the sleep durations of shift workers and prevent declines in their well-being. Methods This study consists of two phases: (1) preliminary data collection and machine learning for well-being prediction; (2) intervention and evaluation of iCBTS for SWSD. Shift workers in the intensive care unit at Mie University Hospital will wear a wearable sensor that collects biometric data and answer daily questionnaires regarding their well-being. They will subsequently be provided with an iCBTS app for 4 weeks. Sleep and well-being measurements between baseline and the intervention period will be compared. Results Recruitment for phase 1 ended in October 2019. Recruitment for phase 2 has started in October 2020. Preliminary results are expected to be available by summer 2021. Conclusions iCBTS empowered with well-being prediction is expected to improve the sleep durations of shift workers, thereby enhancing their overall well-being. Findings of this study will reveal the potential of this system for improving sleep disorders among shift workers. Trial Registration UMIN Clinical Trials Registry UMIN000036122 (phase 1), UMIN000040547 (phase 2); https://tinyurl.com/dkfmmmje, https://upload.umin.ac.jp/cgi-open-bin/ctr_e/ctr_view.cgi?recptno=R000046284 International Registered Report Identifier (IRRID) DERR1-10.2196/24799
Collapse
Affiliation(s)
- Asami Ito-Masui
- Departments of Molecular and Pathobiology and Cell Adhesion Biology, Mie University Graduate School of Medicine, Tsu City, Mie, Japan.,Departments of Emergency and Disaster Medicine, Mie University Graduate School of Medicine, Tsu City, Mie, Japan.,Emergency and Critical Care Center, Mie University Hospital, Tsu City, Mie, Japan
| | - Eiji Kawamoto
- Departments of Molecular and Pathobiology and Cell Adhesion Biology, Mie University Graduate School of Medicine, Tsu City, Mie, Japan.,Departments of Emergency and Disaster Medicine, Mie University Graduate School of Medicine, Tsu City, Mie, Japan.,Emergency and Critical Care Center, Mie University Hospital, Tsu City, Mie, Japan
| | - Ryota Sakamoto
- Department of Medical Informatics, Mie University Hospital, Tsu City, Mie, Japan
| | - Han Yu
- Department of Electrical and Computer Engineering, Rice University, Houston, TX, United States
| | - Akane Sano
- Department of Electrical and Computer Engineering, Rice University, Houston, TX, United States
| | - Eishi Motomura
- Department of Neuropsychiatry, Mie University Graduate School of Medicine, Tsu City, Mie, Japan
| | - Hisashi Tanii
- Center for Physical and Mental Health, Mie University, Tsu City, Mie, Japan
| | - Shoko Sakano
- Mie Prefectural Mental Medical Center, Tsu City, Mie, Japan
| | - Ryo Esumi
- Departments of Molecular and Pathobiology and Cell Adhesion Biology, Mie University Graduate School of Medicine, Tsu City, Mie, Japan.,Departments of Emergency and Disaster Medicine, Mie University Graduate School of Medicine, Tsu City, Mie, Japan.,Emergency and Critical Care Center, Mie University Hospital, Tsu City, Mie, Japan
| | - Hiroshi Imai
- Departments of Emergency and Disaster Medicine, Mie University Graduate School of Medicine, Tsu City, Mie, Japan.,Emergency and Critical Care Center, Mie University Hospital, Tsu City, Mie, Japan
| | - Motomu Shimaoka
- Departments of Molecular and Pathobiology and Cell Adhesion Biology, Mie University Graduate School of Medicine, Tsu City, Mie, Japan
| |
Collapse
|
20
|
Wiernik BM, Ones DS, Marlin BM, Giordano C, Dilchert S, Mercado BK, Stanek KC, Birkland A, Wang Y, Ellis B, Yazar Y, Kostal JW, Kumar S, Hnat T, Ertin E, Sano A, Ganesan DK, Choudhoury T, al’Absi M. Using Mobile Sensors to Study Personality Dynamics. European Journal of Psychological Assessment 2020. [DOI: 10.1027/1015-5759/a000576] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/23/2022]
Abstract
Abstract. Research interest in personality dynamics over time is rapidly growing. Passive personality assessment via mobile sensors offers an intriguing new approach for measuring a wide variety of personality dynamics. In this paper, we address the possibility of integrating sensor-based assessments to enhance personality dynamics research. We consider a variety of research designs that can incorporate sensor-based measures and address pitfalls and limitations in terms of psychometrics and practical implementation. We also consider analytic challenges related to data quality and model evaluation that researchers must address when applying machine learning methods to translate sensor data into composite personality assessments.
Collapse
Affiliation(s)
| | - Deniz S. Ones
- Department of Psychology, University of Minnesota-Twin Cities, Minneapolis, MN, USA
| | - Benjamin M. Marlin
- College of Information and Computer Sciences, University of Massachusetts, Amherst, MS, USA
| | - Casey Giordano
- Department of Psychology, University of Minnesota-Twin Cities, Minneapolis, MN, USA
| | - Stephan Dilchert
- Department of Management, Zicklin School of Business, Baruch College, CUNY, New York, NY, USA
| | | | | | - Adib Birkland
- Department of Psychology, University of Minnesota-Twin Cities, Minneapolis, MN, USA
| | - Yilei Wang
- Department of Psychology, University of Minnesota-Twin Cities, Minneapolis, MN, USA
| | - Brenda Ellis
- Department of Psychology, University of Minnesota-Twin Cities, Minneapolis, MN, USA
| | - Yagizhan Yazar
- Department of Psychology, University of Minnesota-Twin Cities, Minneapolis, MN, USA
| | - Jack W. Kostal
- Department of Psychology, University of Minnesota-Twin Cities, Minneapolis, MN, USA
| | - Santosh Kumar
- Department of Computer Science, University of Memphis, TN, USA
| | - Timothy Hnat
- Department of Computer Science, University of Memphis, TN, USA
| | - Emre Ertin
- Department of Electrical and Computer Engineering, The Ohio State University, OH, USA
| | - Akane Sano
- Department of Electrical and Computer Engineering, Rice University, Houston, TX, USA
| | - Deepak K. Ganesan
- College of Information and Computer Sciences, University of Massachusetts, Amherst, MS, USA
| | | | - Mustafa al’Absi
- Department of Family Medicine & Biobehavioral Health, Medical School, University of Minnesota-Duluth, Duluth, MN, USA
| |
Collapse
|
21
|
Yu H, Sano A. Passive Sensor Data Based Future Mood, Health, and Stress Prediction: User Adaptation Using Deep Learning. Annu Int Conf IEEE Eng Med Biol Soc 2020; 2020:5884-5887. [PMID: 33019313 DOI: 10.1109/embc44109.2020.9176242] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/10/2022]
Abstract
Predicting one's mood, health, and stress in the future may provide useful feedback before wellbeing related problems become severe. Previously, researchers developed participant-dependent wellbeing prediction models using mobile and wearable sensors, where the models were trained and tested with the same group of people. However, in real-world applications, it is essential to consider the adaptability of the developed models to new users for predicting new users' wellbeing immediately and accurately. In this paper, we built wellbeing prediction models using passively sensed data from wearable sensors, mobile phones, and weather API, and deep learning methods, and evaluated the models with the data from new users. We compared deep long short-term memory (LSTM) network and the combination of convolutional neural network (CNN) and the LSTM model. We found that our deep LSTM model provided performances, in mean absolute error (MAE), as 15.7, 15.6, and 16.8 out of 100 in predicting self-reported mood, health, and stress respectively for new users. Furthermore, we applied a fine-tuning transfer learning method based on our deep LSTM model, which provided new participants with more accurate predictions, especially when the volume of new participants' data was limited. The transfer learning model improved the MAE performances to 13.5, 13.2, and 14.4 out of 100 for mood, health, and stress, respectively.
Collapse
|
22
|
Victor LH, Sano A. Frequency-Dependent Light Stimulation Effects on Performance During Vigilance Tasks on a Laptop. Annu Int Conf IEEE Eng Med Biol Soc 2020; 2020:5232-5235. [PMID: 33019164 DOI: 10.1109/embc44109.2020.9175214] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/05/2022]
Abstract
Students, office workers, or other computer and mobile device users can suffer from decrements in alertness or productivity, but many intervention methods on these can be too distracting or even affect daily routines. Using heart rate (HR) to determine a fast and slow target frequency at which to oscillate light brightness stimulation on a laptop, thirty-six participants joined a cognitive task where we hypothesized that fast frequency stimulation would increase alertness and decrease relaxation, while slow frequency stimulation would have the opposite effects. We found that slow frequency stimulation produces a statistically significant delay in response time, users react more slowly (3.8e2 ± 5.5e1 ms), when compared to the no stimulation (3.7e2 ± 4.1e1 ms) (p = 9.0e-3) conditions. The (Slow - No Stimulation) response time (1.7e1 ± 2.7e2 ms) produced a statistically significant delay in response time versus the (Fast - No Stimulation) response time (-0.74 ± 2.4e1 ms) (p = .016). These delays due to slow stimulation occurred without influencing accuracy or subjective sleepiness ratings. We observed that frequency-dependent light stimulation can potentially influence HRV metrics such as the mean normal-to-normal intervals and mean HR. Future work will target breathing rate to determine light stimulation oscillations as we further investigate the potential of using the slow-frequency domain to unobtrusively influence user performance and physiology.
Collapse
|
23
|
Umematsu T, Sano A, Taylor S, Tsujikawa M, Picard RW. Forecasting stress, mood, and health from daytime physiology in office workers and students. Annu Int Conf IEEE Eng Med Biol Soc 2020; 2020:5953-5957. [PMID: 33019329 DOI: 10.1109/embc44109.2020.9176706] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/11/2022]
Abstract
We examine the problem of forecasting tomorrow morning's three self-reported levels (on scales from 0 to 100) of stressed-calm, sad-happy, and sick-healthy based on physiological data (skin conductance, skin temperature, and acceleration) from a sensor worn on the wrist from 10am-5pm today. We train automated forecasting regression algorithms using Random Forests and compare their performance over two sets of data: "workers" consisting of 490 days of weekday data from 39 employees at a high-tech company in Japan and "students" consisting of 3,841 days of weekday data from 201 New England USA college students. Mean absolute errors on held-out test data achieved 10.8, 13.5, and 14.4 for the estimated levels of mood, stress, and health respectively of office workers, and 17.8, 20.3, and 20.4 for the mood, stress, and health respectively of students. Overall the two groups reported comparable stress and mood scores, while employees reported slightly poorer health, and engaged in significantly lower levels of physical activity as measured by accelerometers. We further examine differences in population features and how systems trained on each population performed when tested on the other.
Collapse
|
24
|
Tseng VWS, Sano A, Ben-Zeev D, Brian R, Campbell AT, Hauser M, Kane JM, Scherer EA, Wang R, Wang W, Wen H, Choudhury T. Using behavioral rhythms and multi-task learning to predict fine-grained symptoms of schizophrenia. Sci Rep 2020; 10:15100. [PMID: 32934246 PMCID: PMC7492221 DOI: 10.1038/s41598-020-71689-1] [Citation(s) in RCA: 13] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/28/2019] [Accepted: 08/11/2020] [Indexed: 12/16/2022] Open
Abstract
Schizophrenia is a severe and complex psychiatric disorder with heterogeneous and dynamic multi-dimensional symptoms. Behavioral rhythms, such as sleep rhythm, are usually disrupted in people with schizophrenia. As such, behavioral rhythm sensing with smartphones and machine learning can help better understand and predict their symptoms. Our goal is to predict fine-grained symptom changes with interpretable models. We computed rhythm-based features from 61 participants with 6,132 days of data and used multi-task learning to predict their ecological momentary assessment scores for 10 different symptom items. By taking into account both the similarities and differences between different participants and symptoms, our multi-task learning models perform statistically significantly better than the models trained with single-task learning for predicting patients' individual symptom trajectories, such as feeling depressed, social, and calm and hearing voices. We also found different subtypes for each of the symptoms by applying unsupervised clustering to the feature weights in the models. Taken together, compared to the features used in the previous studies, our rhythm features not only improved models' prediction accuracy but also provided better interpretability for how patients' behavioral rhythms and the rhythms of their environments influence their symptom conditions. This will enable both the patients and clinicians to monitor how these factors affect a patient's condition and how to mitigate the influence of these factors. As such, we envision that our solution allows early detection and early intervention before a patient's condition starts deteriorating without requiring extra effort from patients and clinicians.
Collapse
Affiliation(s)
| | - Akane Sano
- Department of Electrical and Computer Engineering, Rice University, Houston, 77005, USA
| | - Dror Ben-Zeev
- Psychiatry and Behavioral Sciences, University of Washington, Seattle, 98195, USA
| | - Rachel Brian
- Psychiatry and Behavioral Sciences, University of Washington, Seattle, 98195, USA
| | | | | | - John M Kane
- Department of Psychiatry, The Donald and Barbara School of Medicine at Hofstra/Northwell, Hempstead, 11549, USA
| | - Emily A Scherer
- Biomedical Data Science Department, Dartmouth Geisel School of Medicine, Hanover, 03755, USA
| | | | - Weichen Wang
- Computer Science, Dartmouth College, Hanover, 03755, USA
| | - Hongyi Wen
- Information Science, Cornell University, Ithaca, 14850, USA
| | | |
Collapse
|
25
|
Li B, Sano A. Early versus Late Modality Fusion of Deep Wearable Sensor Features for Personalized Prediction of Tomorrow's Mood, Health, and Stress . Annu Int Conf IEEE Eng Med Biol Soc 2020; 2020:5896-5899. [PMID: 33019316 DOI: 10.1109/embc44109.2020.9175463] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/11/2023]
Abstract
Predicting mood, health, and stress can sound an early alarm against mental illness. Multi-modal data from wearable sensors provide rigorous and rich insights into one's internal states. Recently, deep learning-based features on continuous high-resolution sensor data have outperformed statistical features in several ubiquitous and affective computing applications including sleep detection and depression diagnosis. Motivated by this, we investigate multi-modal data fusion strategies featuring deep representation learning of skin conductance, skin temperature, and acceleration data to predict self-reported mood, health, and stress scores (0 - 100) of college students (N = 239). Our cross-validated results from the early fusion framework exhibit a significantly higher (p <; 0.05) prediction precision over the late fusion for unseen users. Therefore, our findings call attention to the benefits of fusing physiological data modalities at a low level and corroborate the predictive efficacy of the deeply learned features.
Collapse
|
26
|
Fischer D, McHill AW, Sano A, Picard RW, Barger LK, Czeisler CA, Klerman EB, Phillips AJK. Irregular sleep and event schedules are associated with poorer self-reported well-being in US college students. Sleep 2020; 43:zsz300. [PMID: 31837266 PMCID: PMC7294408 DOI: 10.1093/sleep/zsz300] [Citation(s) in RCA: 31] [Impact Index Per Article: 7.8] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/22/2019] [Revised: 11/11/2019] [Indexed: 12/24/2022] Open
Abstract
STUDY OBJECTIVES Sleep regularity, in addition to duration and timing, is predictive of daily variations in well-being. One possible contributor to changes in these sleep dimensions are early morning scheduled events. We applied a composite metric-the Composite Phase Deviation (CPD)-to assess mistiming and irregularity of both sleep and event schedules to examine their relationship with self-reported well-being in US college students. METHODS Daily well-being, actigraphy, and timing of sleep and first scheduled events (academic/exercise/other) were collected for approximately 30 days from 223 US college students (37% females) between 2013 and 2016. Participants rated well-being daily upon awakening on five scales: Sleepy-Alert, Sad-Happy, Sluggish-Energetic, Sick-Healthy, and Stressed-Calm. A longitudinal growth model with time-varying covariates was used to assess relationships between sleep variables (i.e. CPDSleep, sleep duration, and midsleep time) and daily and average well-being. Cluster analysis was used to examine relationships between CPD for sleep vs. event schedules. RESULTS CPD for sleep was a significant predictor of average well-being (e.g. Stressed-Calm: b = -6.3, p < 0.01), whereas sleep duration was a significant predictor of daily well-being (Stressed-Calm, b = 1.0, p < 0.001). Although cluster analysis revealed no systematic relationship between CPD for sleep vs. event schedules (i.e. more mistimed/irregular events were not associated with more mistimed/irregular sleep), they interacted upon well-being: the poorest well-being was reported by students for whom both sleep and event schedules were mistimed and irregular. CONCLUSIONS Sleep regularity and duration may be risk factors for lower well-being in college students. Stabilizing sleep and/or event schedules may help improve well-being. CLINICAL TRIAL REGISTRATION NCT02846077.
Collapse
Affiliation(s)
- Dorothee Fischer
- Division of Sleep and Circadian Disorders, Departments of Medicine and Neurology, Brigham and Women’s Hospital, Boston, MA
- Division of Sleep Medicine, Harvard Medical School, Boston, MA
| | - Andrew W McHill
- Division of Sleep and Circadian Disorders, Departments of Medicine and Neurology, Brigham and Women’s Hospital, Boston, MA
- Division of Sleep Medicine, Harvard Medical School, Boston, MA
- Oregon Institute of Occupational Health Sciences, Oregon Health and Science University, Portland, OR
| | - Akane Sano
- Department of Electrical and Computer Engineering, Rice University, Houston, TX
| | - Rosalind W Picard
- Media Lab, Affective Computing Group, Massachusetts Institute of Technology, Cambridge, MA
| | - Laura K Barger
- Division of Sleep and Circadian Disorders, Departments of Medicine and Neurology, Brigham and Women’s Hospital, Boston, MA
- Division of Sleep Medicine, Harvard Medical School, Boston, MA
| | - Charles A Czeisler
- Division of Sleep and Circadian Disorders, Departments of Medicine and Neurology, Brigham and Women’s Hospital, Boston, MA
- Division of Sleep Medicine, Harvard Medical School, Boston, MA
| | - Elizabeth B Klerman
- Division of Sleep and Circadian Disorders, Departments of Medicine and Neurology, Brigham and Women’s Hospital, Boston, MA
- Department of Neurology, Massachusetts General Hospital, Boston, MA
| | - Andrew J K Phillips
- Division of Sleep and Circadian Disorders, Departments of Medicine and Neurology, Brigham and Women’s Hospital, Boston, MA
- Division of Sleep Medicine, Harvard Medical School, Boston, MA
- Monash Institute of Cognitive and Clinical Neurosciences, School of Psychological Sciences, Monash University, Melbourne, Victoria, Australia
| |
Collapse
|
27
|
Li B, Sano A. Extraction and Interpretation of Deep Autoencoder-based Temporal Features from Wearables for Forecasting Personalized Mood, Health, and Stress. ACTA ACUST UNITED AC 2020. [DOI: 10.1145/3397318] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/12/2022]
Abstract
Continuous wearable sensor data in high resolution contain physiological and behavioral information that can be utilized to predict human health and wellbeing, establishing the foundation for developing early warning systems to eventually improve human health and wellbeing. We propose a deep neural network framework, the Locally Connected Long Short-Term Memory Denoising AutoEncoder (LC-LSTM-DAE), to automatically extract features from passively collected raw sensor data and perform personalized prediction of self-reported mood, health, and stress scores with high precision. We enabled personalized learning of features by finetuning the general representation model with participant-specific data. The framework was evaluated using wearable sensor data and wellbeing labels collected from college students (total 6391 days from N=239). Sensor data include skin temperature, skin conductance, and acceleration; wellbeing labels include self-reported mood, health and stress scored 0 - 100. Compared to the prediction performance based on hand-crafted features, the proposed framework achieved higher precision with a smaller number of features. We also provide statistical interpretation and visual explanation to the automatically learned features and the prediction models. Our results show the possibility of predicting self-reported mood, health, and stress accurately using an interpretable deep learning framework, ultimately for developing real-time health and wellbeing monitoring and intervention systems that can benefit various populations.
Collapse
Affiliation(s)
- Boning Li
- Department of Electrical and Computer Engineering, Rice University, Houston, Texas
| | - Akane Sano
- Department of Electrical and Computer Engineering, Rice University, Houston, Texas
| |
Collapse
|
28
|
Taylor S, Jaques N, Nosakhare E, Sano A, Picard R. Personalized Multitask Learning for Predicting Tomorrow's Mood, Stress, and Health. IEEE Trans Affect Comput 2020; 11:200-213. [PMID: 32489521 PMCID: PMC7266106 DOI: 10.1109/taffc.2017.2784832] [Citation(s) in RCA: 32] [Impact Index Per Article: 8.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/11/2023]
Abstract
While accurately predicting mood and wellbeing could have a number of important clinical benefits, traditional machine learning (ML) methods frequently yield low performance in this domain. We posit that this is because a one-size-fits-all machine learning model is inherently ill-suited to predicting outcomes like mood and stress, which vary greatly due to individual differences. Therefore, we employ Multitask Learning (MTL) techniques to train personalized ML models which are customized to the needs of each individual, but still leverage data from across the population. Three formulations of MTL are compared: i) MTL deep neural networks, which share several hidden layers but have final layers unique to each task; ii) Multi-task Multi-Kernel learning, which feeds information across tasks through kernel weights on feature types; and iii) a Hierarchical Bayesian model in which tasks share a common Dirichlet Process prior. We offer the code for this work in open source. These techniques are investigated in the context of predicting future mood, stress, and health using data collected from surveys, wearable sensors, smartphone logs, and the weather. Empirical results demonstrate that using MTL to account for individual differences provides large performance improvements over traditional machine learning methods and provides personalized, actionable insights.
Collapse
Affiliation(s)
| | | | - Ehimwenma Nosakhare
- Department of Electrical Engineering and Computer Science and the MIT Media Lab
| | - Akane Sano
- Program of Media Arts and Sciences and the MIT Media Lab
| | | |
Collapse
|
29
|
Abstract
Human biology is deeply rooted in the daily 24-hour temporal period. Our biochemistry varies significantly and idiosyncratically over the course of a day. Staying out of sync with one's circadian rhythm can lead to many complications over time, including a higher likelihood for cardiovascular disease, cancer, obesity, and mental health problems [1]. Constant changes in daily rhythm due to shift work has been shown to increase risk factors for cancer, obesity, and Type 2 diabetes. Moreover, the advent of technology and the resultant always-on ethos can cause rhythm disruption on personal and societal levels for about 70% of the population [2].
Circadian disruption can also cause a serious deficit in cognitive performance. In particular, alertness - a key biological process underlying our cognitive performance - reflects circadian rhythms [3]. Sleep deprivation and circadian disruption can result in poor alertness and reaction time [3]. The decline in cognitive performance after 20 to 25 hours of wakefulness is equivalent to a Blood Alcohol Concentration (BAC) of 0.10% [4]. To compare, in New York State, a BAC of more than 0.05% is considered "impaired" and 0.08% is considered "intoxicated" [5]. In other words, the effects of sustained sleep deprivation and circadian disruption on cognitive performance is similar (or worse) to being intoxicated.
Collapse
Affiliation(s)
| | | | - Mi Zhang
- Michigan State University, Lansing, MI, USA
| | | | | |
Collapse
|
30
|
Umematsu T, Sano A, Picard RW. Daytime Data and LSTM can Forecast Tomorrow's Stress, Health, and Happiness. Annu Int Conf IEEE Eng Med Biol Soc 2019; 2019:2186-2190. [PMID: 31946335 DOI: 10.1109/embc.2019.8856862] [Citation(s) in RCA: 27] [Impact Index Per Article: 5.4] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/10/2022]
Abstract
Accurately forecasting well-being may enable people to make desirable behavioral changes that could improve their future well-being. In this paper, we evaluate how well an automated model can forecast the next-day's well-being (specifically focusing on stress, health, and happiness) from static models (support vector machine and logistic regression) and time-series models (long short-term memory neural network models (LSTM)) using the previous seven days of physiological, mobile phone, and behavioral survey data. We especially examine how using only a portion of the day's data (e.g. just night-time, or just daytime) influences the forecasting accuracy. The results show that accuracy is improved, across every condition tested, by using an LSTM instead of using static models. We find that daytime-only physiology data from wearable sensors, using an LSTM, can provide an accurate forecast of tomorrow's well-being using students' daily life data (stress: 80.4%, health: 86.0%, and happiness: 79.1%), achieving the same accuracy as using data collected from around the clock. These findings are valuable steps toward developing a practical and convenient well-being forecasting system.
Collapse
|
31
|
Sano A, Chen W, Lopez-Martinez D, Taylor S, Picard RW. Multimodal Ambulatory Sleep Detection Using LSTM Recurrent Neural Networks. IEEE J Biomed Health Inform 2018; 23:1607-1617. [PMID: 30176613 DOI: 10.1109/jbhi.2018.2867619] [Citation(s) in RCA: 19] [Impact Index Per Article: 3.2] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
Abstract
Unobtrusive and accurate ambulatory methods are needed to monitor long-term sleep patterns for improving health. Previously developed ambulatory sleep detection methods rely either in whole or in part on self-reported diary data as ground truth, which is a problem, since people often do not fill them out accurately. This paper presents an algorithm that uses multimodal data from smartphones and wearable technologies to detect sleep/wake state and sleep onset/offset using a type of recurrent neural network with long-short-term memory (LSTM) cells for synthesizing temporal information. We collected 5580 days of multimodal data from 186 participants and compared the new method for sleep/wake classification and sleep onset/offset detection to, first, nontemporal machine learning methods and, second, a state-of-the-art actigraphy software. The new LSTM method achieved a sleep/wake classification accuracy of 96.5%, and sleep onset/offset detection F1 scores of 0.86 and 0.84, respectively, with mean absolute errors of 5.0 and 5.5 min, res-pectively, when compared with sleep/wake state and sleep onset/offset assessed using actigraphy and sleep diaries. The LSTM results were statistically superior to those from nontemporal machine learning algorithms and the actigraphy software. We show good generalization of the new algorithm by comparing participant-dependent and participant-independent models, and we show how to make the model nearly realtime with slightly reduced performance.
Collapse
|
32
|
Kubota S, Yoshikawa K, Takeuchi R, Endo Y, Sano A, Koseki K, Mataki Y, Iwasaki N, Kohno Y, Mutsuzaki H. Robotic rehabilitation training with a newly developed upper limb single-joint hybrid assistive limb (HAL-SJ) for an adult with birth palsy. Ann Phys Rehabil Med 2018. [DOI: 10.1016/j.rehab.2018.05.1160] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/28/2022]
|
33
|
Sano A, Taylor S, McHill AW, Phillips AJ, Barger LK, Klerman E, Picard R. Identifying Objective Physiological Markers and Modifiable Behaviors for Self-Reported Stress and Mental Health Status Using Wearable Sensors and Mobile Phones: Observational Study. J Med Internet Res 2018; 20:e210. [PMID: 29884610 PMCID: PMC6015266 DOI: 10.2196/jmir.9410] [Citation(s) in RCA: 111] [Impact Index Per Article: 18.5] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/13/2017] [Revised: 02/24/2018] [Accepted: 04/22/2018] [Indexed: 01/18/2023] Open
Abstract
Background Wearable and mobile devices that capture multimodal data have the potential to identify risk factors for high stress and poor mental health and to provide information to improve health and well-being. Objective We developed new tools that provide objective physiological and behavioral measures using wearable sensors and mobile phones, together with methods that improve their data integrity. The aim of this study was to examine, using machine learning, how accurately these measures could identify conditions of self-reported high stress and poor mental health and which of the underlying modalities and measures were most accurate in identifying those conditions. Methods We designed and conducted the 1-month SNAPSHOT study that investigated how daily behaviors and social networks influence self-reported stress, mood, and other health or well-being-related factors. We collected over 145,000 hours of data from 201 college students (age: 18-25 years, male:female=1.8:1) at one university, all recruited within self-identified social groups. Each student filled out standardized pre- and postquestionnaires on stress and mental health; during the month, each student completed twice-daily electronic diaries (e-diaries), wore two wrist-based sensors that recorded continuous physical activity and autonomic physiology, and installed an app on their mobile phone that recorded phone usage and geolocation patterns. We developed tools to make data collection more efficient, including data-check systems for sensor and mobile phone data and an e-diary administrative module for study investigators to locate possible errors in the e-diaries and communicate with participants to correct their entries promptly, which reduced the time taken to clean e-diary data by 69%. We constructed features and applied machine learning to the multimodal data to identify factors associated with self-reported poststudy stress and mental health, including behaviors that can be possibly modified by the individual to improve these measures. Results We identified the physiological sensor, phone, mobility, and modifiable behavior features that were best predictors for stress and mental health classification. In general, wearable sensor features showed better classification performance than mobile phone or modifiable behavior features. Wearable sensor features, including skin conductance and temperature, reached 78.3% (148/189) accuracy for classifying students into high or low stress groups and 87% (41/47) accuracy for classifying high or low mental health groups. Modifiable behavior features, including number of naps, studying duration, calls, mobility patterns, and phone-screen-on time, reached 73.5% (139/189) accuracy for stress classification and 79% (37/47) accuracy for mental health classification. Conclusions New semiautomated tools improved the efficiency of long-term ambulatory data collection from wearable and mobile devices. Applying machine learning to the resulting data revealed a set of both objective features and modifiable behavioral features that could classify self-reported high or low stress and mental health groups in a college student population better than previous studies and showed new insights into digital phenotyping.
Collapse
Affiliation(s)
- Akane Sano
- Affective Computing Group, Media Lab, Massachusetts Institute of Technology, Cambridge, MA, United States
| | - Sara Taylor
- Affective Computing Group, Media Lab, Massachusetts Institute of Technology, Cambridge, MA, United States
| | - Andrew W McHill
- Brigham and Women's Hospital, Boston, MA, United States.,Harvard Medical School, Boston, MA, United States
| | - Andrew Jk Phillips
- Brigham and Women's Hospital, Boston, MA, United States.,Harvard Medical School, Boston, MA, United States
| | - Laura K Barger
- Brigham and Women's Hospital, Boston, MA, United States.,Harvard Medical School, Boston, MA, United States
| | - Elizabeth Klerman
- Brigham and Women's Hospital, Boston, MA, United States.,Harvard Medical School, Boston, MA, United States
| | - Rosalind Picard
- Affective Computing Group, Media Lab, Massachusetts Institute of Technology, Cambridge, MA, United States
| |
Collapse
|
34
|
Fischer D, McHill A, Sano A, Picard RW, Barger LK, Czeisler CA, Klerman EB, Phillips AJ. 0338 Composite Phase Deviation (CPD) As A Predictor Of Mood In College Students. Sleep 2018. [DOI: 10.1093/sleep/zsy061.337] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/13/2022] Open
Affiliation(s)
- D Fischer
- Brigham and Women’s Hospital/Harvard Medical School, Boston, MA
| | - A McHill
- Oregon Health and Science University, Portland, OR
| | - A Sano
- Massachusetts Institute of Technology, Cambridge, MA
| | - R W Picard
- Massachusetts Institute of Technology, Cambridge, MA
| | - L K Barger
- Brigham and Women’s Hospital/Harvard Medical School, Boston, MA
| | - C A Czeisler
- Brigham and Women’s Hospital/Harvard Medical School, Boston, MA
| | - E B Klerman
- Brigham and Women’s Hospital/Harvard Medical School, Boston, MA
| | - A J Phillips
- Brigham and Women’s Hospital/Harvard Medical School, Boston, MA
- Monash University, Melbourne, AUSTRALIA
| |
Collapse
|
35
|
Abe H, Jitsuki S, Nakajima W, Murata Y, Jitsuki-Takahashi A, Katsuno Y, Tada H, Sano A, Suyama K, Mochizuki N, Komori T, Masuyama H, Okuda T, Goshima Y, Higo N, Takahashi T. CRMP2-binding compound, edonerpic maleate, accelerates motor function recovery from brain damage. Science 2018; 360:50-57. [DOI: 10.1126/science.aao2300] [Citation(s) in RCA: 49] [Impact Index Per Article: 8.2] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/29/2017] [Accepted: 02/01/2018] [Indexed: 12/25/2022]
Abstract
Brain damage such as stroke is a devastating neurological condition that may severely compromise patient quality of life. No effective medication-mediated intervention to accelerate rehabilitation has been established. We found that a small compound, edonerpic maleate, facilitated experience-driven synaptic glutamate AMPA (α-amino-3-hydroxy-5-methyl-4-isoxazole-propionic-acid) receptor delivery and resulted in the acceleration of motor function recovery after motor cortex cryoinjury in mice in a training-dependent manner through cortical reorganization. Edonerpic bound to collapsin-response-mediator-protein 2 (CRMP2) and failed to augment recovery in CRMP2-deficient mice. Edonerpic maleate enhanced motor function recovery from internal capsule hemorrhage in nonhuman primates. Thus, edonerpic maleate, a neural plasticity enhancer, could be a clinically potent small compound with which to accelerate rehabilitation after brain damage.
Collapse
|
36
|
Taylor S, Sano A, Ferguson C, Mohan A, Picard RW. QuantifyMe: An Open-Source Automated Single-Case Experimental Design Platform. Sensors (Basel) 2018; 18:s18041097. [PMID: 29621133 PMCID: PMC5948910 DOI: 10.3390/s18041097] [Citation(s) in RCA: 10] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 02/20/2018] [Revised: 03/25/2018] [Accepted: 04/02/2018] [Indexed: 02/03/2023]
Abstract
Smartphones and wearable sensors have enabled unprecedented data collection, with many products now providing feedback to users about recommended step counts or sleep durations. However, these recommendations do not provide personalized insights that have been shown to be best suited for a specific individual. A scientific way to find individualized recommendations and causal links is to conduct experiments using single-case experimental design; however, properly designed single-case experiments are not easy to conduct on oneself. We designed, developed, and evaluated a novel platform, QuantifyMe, for novice self-experimenters to conduct proper-methodology single-case self-experiments in an automated and scientific manner using their smartphones. We provide software for the platform that we used (available for free on GitHub), which provides the methodological elements to run many kinds of customized studies. In this work, we evaluate its use with four different kinds of personalized investigations, examining how variables such as sleep duration and regularity, activity, and leisure time affect personal happiness, stress, productivity, and sleep efficiency. We conducted a six-week pilot study (N = 13) to evaluate QuantifyMe. We describe the lessons learned developing the platform and recommendations for its improvement, as well as its potential for enabling personalized insights to be scientifically evaluated in many individuals, reducing the high administrative cost for advancing human health and wellbeing.
Collapse
Affiliation(s)
- Sara Taylor
- Affective Computing Group, MIT Media Lab, Massachusetts Institute of Technology, Cambridge, MA 02139, USA.
| | - Akane Sano
- Affective Computing Group, MIT Media Lab, Massachusetts Institute of Technology, Cambridge, MA 02139, USA.
| | - Craig Ferguson
- Affective Computing Group, MIT Media Lab, Massachusetts Institute of Technology, Cambridge, MA 02139, USA.
| | - Akshay Mohan
- Affective Computing Group, MIT Media Lab, Massachusetts Institute of Technology, Cambridge, MA 02139, USA.
| | - Rosalind W Picard
- Affective Computing Group, MIT Media Lab, Massachusetts Institute of Technology, Cambridge, MA 02139, USA.
| |
Collapse
|
37
|
Hino H, Nishimura T, Sano A, Yoshida Y, Fukami T, Furuhata Y, Tanaka M, Karasaki T, Takahashi T, Kawashima M, Kuwano H, Nagayama K, Nitadori J, Anraku M, Sato M, Nakajima J. P-153PROGNOSTIC IMPACT ON LUNG CANCER SURGERY IN OCTOGENARIANS: A JAPANESE MULTICENTRE RETROSPECTIVE ANALYSIS. Interact Cardiovasc Thorac Surg 2017. [DOI: 10.1093/icvts/ivx280.153] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/14/2022] Open
|
38
|
Phillips AJK, Clerx WM, O'Brien CS, Sano A, Barger LK, Picard RW, Lockley SW, Klerman EB, Czeisler CA. Irregular sleep/wake patterns are associated with poorer academic performance and delayed circadian and sleep/wake timing. Sci Rep 2017; 7:3216. [PMID: 28607474 PMCID: PMC5468315 DOI: 10.1038/s41598-017-03171-4] [Citation(s) in RCA: 246] [Impact Index Per Article: 35.1] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/07/2016] [Accepted: 04/24/2017] [Indexed: 12/20/2022] Open
Abstract
The association of irregular sleep schedules with circadian timing and academic performance has not been systematically examined. We studied 61 undergraduates for 30 days using sleep diaries, and quantified sleep regularity using a novel metric, the sleep regularity index (SRI). In the most and least regular quintiles, circadian phase and light exposure were assessed using salivary dim-light melatonin onset (DLMO) and wrist-worn photometry, respectively. DLMO occurred later (00:08 ± 1:54 vs. 21:32 ± 1:48; p < 0.003); the daily sleep propensity rhythm peaked later (06:33 ± 0:19 vs. 04:45 ± 0:11; p < 0.005); and light rhythms had lower amplitude (102 ± 19 lux vs. 179 ± 29 lux; p < 0.005) in Irregular compared to Regular sleepers. A mathematical model of the circadian pacemaker and its response to light was used to demonstrate that Irregular vs. Regular group differences in circadian timing were likely primarily due to their different patterns of light exposure. A positive correlation (r = 0.37; p < 0.004) between academic performance and SRI was observed. These findings show that irregular sleep and light exposure patterns in college students are associated with delayed circadian rhythms and lower academic performance. Moreover, the modeling results reveal that light-based interventions may be therapeutically effective in improving sleep regularity in this population.
Collapse
Affiliation(s)
- Andrew J K Phillips
- Sleep Health Institute and Division of Sleep and Circadian Disorders, Departments of Medicine and Neurology, Brigham and Women's Hospital, Boston, MA, USA. .,Division of Sleep Medicine, Harvard Medical School, Boston, MA, USA.
| | - William M Clerx
- Sleep Health Institute and Division of Sleep and Circadian Disorders, Departments of Medicine and Neurology, Brigham and Women's Hospital, Boston, MA, USA.,Division of Sleep Medicine, Harvard Medical School, Boston, MA, USA
| | - Conor S O'Brien
- Sleep Health Institute and Division of Sleep and Circadian Disorders, Departments of Medicine and Neurology, Brigham and Women's Hospital, Boston, MA, USA
| | - Akane Sano
- Affective Computing Group, Media Lab, Massachusetts Institute of Technology, Cambridge, MA, USA
| | - Laura K Barger
- Sleep Health Institute and Division of Sleep and Circadian Disorders, Departments of Medicine and Neurology, Brigham and Women's Hospital, Boston, MA, USA.,Division of Sleep Medicine, Harvard Medical School, Boston, MA, USA
| | - Rosalind W Picard
- Affective Computing Group, Media Lab, Massachusetts Institute of Technology, Cambridge, MA, USA
| | - Steven W Lockley
- Sleep Health Institute and Division of Sleep and Circadian Disorders, Departments of Medicine and Neurology, Brigham and Women's Hospital, Boston, MA, USA.,Division of Sleep Medicine, Harvard Medical School, Boston, MA, USA
| | - Elizabeth B Klerman
- Sleep Health Institute and Division of Sleep and Circadian Disorders, Departments of Medicine and Neurology, Brigham and Women's Hospital, Boston, MA, USA.,Division of Sleep Medicine, Harvard Medical School, Boston, MA, USA
| | - Charles A Czeisler
- Sleep Health Institute and Division of Sleep and Circadian Disorders, Departments of Medicine and Neurology, Brigham and Women's Hospital, Boston, MA, USA.,Division of Sleep Medicine, Harvard Medical School, Boston, MA, USA
| |
Collapse
|
39
|
Phillips AJ, McHill AM, Chen D, Beckett S, Barger LK, O’Brien CS, Sano A, Taylor S, Lockley SW, Czeisler CA, Klerman EB. 0079 PREDICTING THE TIMING OF DIM LIGHT MELATONIN ONSET IN REAL-WORLD CONDITIONS USING A MATHEMATICAL MODEL. Sleep 2017. [DOI: 10.1093/sleepj/zsx050.078] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/13/2022] Open
|
40
|
McHill AW, Barger LK, Sano A, Phillips AJ, Czeisler CA, Klerman EB. 0061 INFLUENCE OF SLEEP AND CIRCADIAN PREFERENCE ON EXERCISE AND SUBJECTIVE MOOD IN COLLEGE UNDERGRADUATES. Sleep 2017. [DOI: 10.1093/sleepj/zsx050.060] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/13/2022] Open
|
41
|
Chen W, Sano A, Lopez D, Taylor S, McHill AW, Phillips AJ, Barger LK, Czeisler CA, Picard RW. 1179 MULTIMODAL AMBULATORY SLEEP DETECTION USING RECURRENT NEURAL NETWORKS. Sleep 2017. [DOI: 10.1093/sleepj/zsx050.1178] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [What about the content of this article? (0)] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/12/2022] Open
|
42
|
Sano A, Phillips AJ, McHill AW, Taylor S, Barger LK, Czeisler CA, Picard RW. 0182 INFLUENCE OF WEEKLY SLEEP REGULARITY ON SELF-REPORTED WELLBEING. Sleep 2017. [DOI: 10.1093/sleepj/zsx050.181] [Citation(s) in RCA: 22] [Impact Index Per Article: 3.1] [Reference Citation Analysis] [What about the content of this article? (0)] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/13/2022] Open
|
43
|
Taylor S, Jaques N, Nosakhare E, Sano A, Klerman EB, Picard RW. 0795 IMPORTANCE OF SLEEP DATA IN PREDICTING
NEXT-DAY STRESS, HAPPINESS, AND HEALTH IN COLLEGE STUDENTS. Sleep 2017. [DOI: 10.1093/sleepj/zsx050.794] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/12/2022] Open
|
44
|
Taylor S, Sano A, Picard RW. 0113 STRUCTURE OF ELECTRODERMAL RESPONSES DURING SLEEP. Sleep 2017. [DOI: 10.1093/sleepj/zsx050.112] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/14/2022] Open
|
45
|
Okahashi K, Oiso N, Ishii N, Miyake M, Uchida S, Matsuda H, Kitano M, Hida J, Kawai S, Sano A, Hashimoto T, Kawada A. Paraneoplastic pemphigus associated with Castleman disease: progression from mucous to mucocutaneous lesions with epitope-spreading phenomena. Br J Dermatol 2017; 176:1406-1409. [DOI: 10.1111/bjd.15389] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.1] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/29/2022]
Affiliation(s)
- K. Okahashi
- Department of Dermatology; Kindai University Faculty of Medicine; Osaka-Sayama Japan
| | - N. Oiso
- Department of Dermatology; Kindai University Faculty of Medicine; Osaka-Sayama Japan
| | - N. Ishii
- Department of Dermatology; Kurume University School of Medicine; Kurume Japan
| | - M. Miyake
- Department of Dermatology; Kindai University Faculty of Medicine; Osaka-Sayama Japan
| | - S. Uchida
- Department of Dermatology; Kindai University Faculty of Medicine; Osaka-Sayama Japan
| | - H. Matsuda
- Department of Dermatology; Kindai University Faculty of Medicine; Osaka-Sayama Japan
| | - M. Kitano
- Department of Otolaryngology - Head and Neck Surgery; Kindai University Faculty of Medicine; Osaka-Sayama Japan
| | - J. Hida
- Department of Surgery; Kindai University Faculty of Medicine; Osaka-Sayama Japan
| | - S. Kawai
- Department of Neurology; Kindai University Faculty of Medicine; Osaka-Sayama Japan
| | - A. Sano
- Department of Respiratory Medicine and Allergology; Kindai University Faculty of Medicine; Osaka-Sayama Japan
| | - T. Hashimoto
- Kurume University Institute of Cutaneous Cell Biology; Kurume Japan
| | - A. Kawada
- Department of Dermatology; Kindai University Faculty of Medicine; Osaka-Sayama Japan
| |
Collapse
|
46
|
Chen W, Sano A, Martinez DL, Taylor S, McHill AW, Phillips AJK, Barger L, Klerman EB, Picard RW. Multimodal Ambulatory Sleep Detection. IEEE EMBS Int Conf Biomed Health Inform 2017; 2017:465-468. [PMID: 29938711 PMCID: PMC6010306 DOI: 10.1109/bhi.2017.7897306] [Citation(s) in RCA: 11] [Impact Index Per Article: 1.6] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
Abstract
Inadequate sleep affects health in multiple ways. Unobtrusive ambulatory methods to monitor long-term sleep patterns in large populations could be useful for health and policy decisions. This paper presents an algorithm that uses multimodal data from smartphones and wearable technologies to detect sleep/wake state and sleep episode on/offset. We collected 5580 days of multimodal data and applied recurrent neural networks for sleep/wake classification, followed by cross-correlation-based template matching for sleep episode on/offset detection. The method achieved a sleep/wake classification accuracy of 96.5%, and sleep episode on/offset detection F1 scores of 0.85 and 0.82, respectively, with mean errors of 5.3 and 5.5 min, respectively, when compared with sleep/wake state and sleep episode on/offset assessed using actigraphy and sleep diaries.
Collapse
Affiliation(s)
- Weixuan Chen
- Affective Computing Group, Media Lab, Massachusetts Institute of Technology
| | - Akane Sano
- Affective Computing Group, Media Lab, Massachusetts Institute of Technology
| | - Daniel Lopez Martinez
- Affective Computing Group, Media Lab, Massachusetts Institute of Technology
- Harvard-MIT Division of Health Sciences and Technology, Massachusetts Institute of Technology
| | - Sara Taylor
- Affective Computing Group, Media Lab, Massachusetts Institute of Technology
| | - Andrew W McHill
- Division of Sleep and Circadian Disorders, Brigham and Women's Hospital, Harvard Medical School
| | - Andrew J K Phillips
- Division of Sleep and Circadian Disorders, Brigham and Women's Hospital, Harvard Medical School
| | - Laura Barger
- Division of Sleep and Circadian Disorders, Brigham and Women's Hospital, Harvard Medical School
| | - Elizabeth B Klerman
- Division of Sleep and Circadian Disorders, Brigham and Women's Hospital, Harvard Medical School
| | - Rosalind W Picard
- Affective Computing Group, Media Lab, Massachusetts Institute of Technology
| |
Collapse
|
47
|
Affiliation(s)
- Y. Tanaka
- Department of Engineering Physics, Electronics and Mechanics, Graduate School of Engineering, Nagoya Institute of Technology, Nagoya, Japan
| | - Y. Goto
- Department of Engineering Physics, Electronics and Mechanics, Graduate School of Engineering, Nagoya Institute of Technology, Nagoya, Japan
| | - A. Sano
- Department of Engineering Physics, Electronics and Mechanics, Graduate School of Engineering, Nagoya Institute of Technology, Nagoya, Japan
| |
Collapse
|
48
|
Tada H, Miyazaki T, Takemoto K, Takase K, Jitsuki S, Nakajima W, Koide M, Yamamoto N, Komiya K, Suyama K, Sano A, Taguchi A, Takahashi T. Neonatal isolation augments social dominance by altering actin dynamics in the medial prefrontal cortex. Proc Natl Acad Sci U S A 2016; 113:E7097-E7105. [PMID: 27791080 PMCID: PMC5111648 DOI: 10.1073/pnas.1606351113] [Citation(s) in RCA: 42] [Impact Index Per Article: 5.3] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/04/2023] Open
Abstract
Social separation early in life can lead to the development of impaired interpersonal relationships and profound social disorders. However, the underlying cellular and molecular mechanisms involved are largely unknown. Here, we found that isolation of neonatal rats induced glucocorticoid-dependent social dominance over nonisolated control rats in juveniles from the same litter. Furthermore, neonatal isolation inactivated the actin-depolymerizing factor (ADF)/cofilin in the juvenile medial prefrontal cortex (mPFC). Isolation-induced inactivation of ADF/cofilin increased stable actin fractions at dendritic spines in the juvenile mPFC, decreasing glutamate synaptic AMPA receptors. Expression of constitutively active ADF/cofilin in the mPFC rescued the effect of isolation on social dominance. Thus, neonatal isolation affects spines in the mPFC by reducing actin dynamics, leading to altered social behavior later in life.
Collapse
Affiliation(s)
- Hirobumi Tada
- Department of Physiology, Yokohama City University Graduate School of Medicine, Yokohama 236-0004, Japan
| | - Tomoyuki Miyazaki
- Department of Physiology, Yokohama City University Graduate School of Medicine, Yokohama 236-0004, Japan
| | - Kiwamu Takemoto
- Department of Physiology, Yokohama City University Graduate School of Medicine, Yokohama 236-0004, Japan
- Precursory Research for Embryonic Science and Technology, Japan Science and Technology Agency, Saitama 332-0012, Japan
| | - Kenkichi Takase
- Laboratory of Psychology, Jichi Medical University, Tochigi 329-0498, Japan
| | - Susumu Jitsuki
- Department of Physiology, Yokohama City University Graduate School of Medicine, Yokohama 236-0004, Japan
| | - Waki Nakajima
- Department of Physiology, Yokohama City University Graduate School of Medicine, Yokohama 236-0004, Japan
| | - Mayu Koide
- Department of Physiology, Yokohama City University Graduate School of Medicine, Yokohama 236-0004, Japan
| | - Naoko Yamamoto
- Department of Physiology, Yokohama City University Graduate School of Medicine, Yokohama 236-0004, Japan
| | - Kasane Komiya
- Department of Physiology, Yokohama City University Graduate School of Medicine, Yokohama 236-0004, Japan
| | - Kumiko Suyama
- Department of Physiology, Yokohama City University Graduate School of Medicine, Yokohama 236-0004, Japan
| | - Akane Sano
- Department of Physiology, Yokohama City University Graduate School of Medicine, Yokohama 236-0004, Japan
| | - Akiko Taguchi
- Department of Integrative Aging Neuroscience, National Center for Geriatrics and Gerontology, Aichi 474-8511, Japan
| | - Takuya Takahashi
- Department of Physiology, Yokohama City University Graduate School of Medicine, Yokohama 236-0004, Japan;
| |
Collapse
|
49
|
Ohashi M, Hirano T, Watanabe K, Katsumi K, Shoji H, Sano A, Tashi H, Takahashi I, Wakasugi M, Shibuya Y, Endo N. Preoperative prediction for regaining ambulatory ability in paretic non-ambulatory patients with metastatic spinal cord compression. Spinal Cord 2016; 55:447-453. [PMID: 27752060 DOI: 10.1038/sc.2016.145] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/26/2016] [Revised: 07/28/2016] [Accepted: 09/02/2016] [Indexed: 11/09/2022]
Abstract
STUDY DESIGN Retrospective multicenter study. OBJECTIVES To analyze the predictive factors for postoperative ambulatory recovery in paretic non-ambulatory patients with metastatic spinal cord compression (MSCC). SETTING Japan. METHODS Eighty-two consecutive patients (74.4% men; mean age, 66.2 years) who could not walk before surgery due to cervical or thoracic MSCC and underwent posterior decompressive surgery between 2003 and 2014 were included. Patients were divided into two groups according to ambulatory status at 6 weeks after surgery: recovery (group R) and non-recovery (group NR). To evaluate the speed of progression of motor deficits, we assessed the period from onset of neurological symptoms to gait inability (T1). RESULTS Fifty patients (61.0%) regained the ability to walk (group R). The period of T1 demonstrated a positive correlation with probability of ambulatory recovery (P=0.00; Kendall's tau-b=0.38), and a receiver operating characteristic curve analysis showed that the cutoff value of T1 was 5 days (area under the curve=0.72; P=0.001). In multivariate analysis, <6 days of T1 was one of the independent risk factors for failing to regain ambulatory ability (odds ratio, 8.74; P=0.00). CONCLUSIONS The speed of progression of motor deficits can independently and powerfully predict the chance of postoperative ambulatory recovery as well as previously identified predictors. Since information about the speed of progression can be obtained easily by interviewing patients or family members, even if the patient is in an urgent state, our results will be helpful in clinical decision-making.
Collapse
Affiliation(s)
- M Ohashi
- Division of Orthopedic Surgery, Department of Regenerative and Transplant Medicine, Niigata University Graduate School of Medical and Dental Sciences, Niigata, Japan
| | - T Hirano
- Division of Orthopedic Surgery, Department of Regenerative and Transplant Medicine, Niigata University Graduate School of Medical and Dental Sciences, Niigata, Japan
| | - K Watanabe
- Division of Orthopedic Surgery, Department of Regenerative and Transplant Medicine, Niigata University Graduate School of Medical and Dental Sciences, Niigata, Japan
| | - K Katsumi
- Division of Orthopedic Surgery, Department of Regenerative and Transplant Medicine, Niigata University Graduate School of Medical and Dental Sciences, Niigata, Japan
| | - H Shoji
- Division of Orthopedic Surgery, Department of Regenerative and Transplant Medicine, Niigata University Graduate School of Medical and Dental Sciences, Niigata, Japan
| | - A Sano
- Department of Orthopedic Surgery, Niigata Prefectural Shibata Hospital, Shibata, Japan
| | - H Tashi
- Department of Orthopedic Surgery, Niigata Prefectural Central Hospital, Joetsu, Japan
| | - I Takahashi
- Department of Orthopedic Surgery, Niigata City General Hospital, Niigata, Japan
| | - M Wakasugi
- Department of Orthopedic Surgery, Niigata Prefectural Central Hospital, Joetsu, Japan
| | - Y Shibuya
- Department of Orthopedic Surgery, Tsuruoka Municipal Hospital, Tsuruoka, Japan
| | - N Endo
- Division of Orthopedic Surgery, Department of Regenerative and Transplant Medicine, Niigata University Graduate School of Medical and Dental Sciences, Niigata, Japan
| |
Collapse
|
50
|
Sano A, Picard RW. Comparison of sleep-wake classification using electroencephalogram and wrist-worn multi-modal sensor data. Annu Int Conf IEEE Eng Med Biol Soc 2016; 2014:930-3. [PMID: 25570112 DOI: 10.1109/embc.2014.6943744] [Citation(s) in RCA: 17] [Impact Index Per Article: 2.1] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/10/2022]
Abstract
This paper presents the comparison of sleep-wake classification using electroencephalogram (EEG) and multi-modal data from a wrist wearable sensor. We collected physiological data while participants were in bed: EEG, skin conductance (SC), skin temperature (ST), and acceleration (ACC) data, from 15 college students, computed the features and compared the intra-/inter-subject classification results. As results, EEG features showed 83% while features from a wrist wearable sensor showed 74% and the combination of ACC and ST played more important roles in sleep/wake classification.
Collapse
|