1
|
Tsutsumi H, Kondo K, Takenaka K, Hasegawa T. Sensor-Based Activity Recognition Using Frequency Band Enhancement Filters and Model Ensembles. SENSORS (BASEL, SWITZERLAND) 2023; 23:1465. [PMID: 36772504 PMCID: PMC9919843 DOI: 10.3390/s23031465] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 11/17/2022] [Revised: 01/19/2023] [Accepted: 01/23/2023] [Indexed: 06/18/2023]
Abstract
Deep learning methods are widely used in sensor-based activity recognition, contributing to improved recognition accuracy. Accelerometer and gyroscope data are mainly used as input to the models. Accelerometer data are sometimes converted to a frequency spectrum. However, data augmentation based on frequency characteristics has not been thoroughly investigated. This study proposes an activity recognition method that uses ensemble learning and filters that emphasize the frequency that is important for recognizing a certain activity. To realize the proposed method, we experimentally identified the important frequency of various activities by masking some frequency bands in the accelerometer data and comparing the accuracy using the masked data. To demonstrate the effectiveness of the proposed method, we compared its accuracy with and without enhancement filters during training and testing and with and without ensemble learning. The results showed that applying a frequency band enhancement filter during training and testing and ensemble learning achieved the highest recognition accuracy. In order to demonstrate the robustness of the proposed method, we used four different datasets and compared the recognition accuracy between a single model and a model using ensemble learning. As a result, in three of the four datasets, the proposed method showed the highest recognition accuracy, indicating the robustness of the proposed method.
Collapse
|
2
|
Wang J, Lu S, Wang SH, Zhang YD. A review on extreme learning machine. MULTIMEDIA TOOLS AND APPLICATIONS 2022; 81:41611-41660. [DOI: 10.1007/s11042-021-11007-7] [Citation(s) in RCA: 31] [Impact Index Per Article: 10.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/21/2020] [Revised: 02/26/2021] [Accepted: 05/05/2021] [Indexed: 08/30/2023]
Abstract
AbstractExtreme learning machine (ELM) is a training algorithm for single hidden layer feedforward neural network (SLFN), which converges much faster than traditional methods and yields promising performance. In this paper, we hope to present a comprehensive review on ELM. Firstly, we will focus on the theoretical analysis including universal approximation theory and generalization. Then, the various improvements are listed, which help ELM works better in terms of stability, efficiency, and accuracy. Because of its outstanding performance, ELM has been successfully applied in many real-time learning tasks for classification, clustering, and regression. Besides, we report the applications of ELM in medical imaging: MRI, CT, and mammogram. The controversies of ELM were also discussed in this paper. We aim to report these advances and find some future perspectives.
Collapse
|
3
|
Thomas BL, Holder LB, Cook DJ. Automated Cognitive Health Assessment Using Partially Complete Time Series Sensor Data. Methods Inf Med 2022; 61:99-110. [PMID: 36220111 PMCID: PMC9847015 DOI: 10.1055/s-0042-1756649] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/27/2023]
Abstract
BACKGROUND Behavior and health are inextricably linked. As a result, continuous wearable sensor data offer the potential to predict clinical measures. However, interruptions in the data collection occur, which create a need for strategic data imputation. OBJECTIVE The objective of this work is to adapt a data generation algorithm to impute multivariate time series data. This will allow us to create digital behavior markers that can predict clinical health measures. METHODS We created a bidirectional time series generative adversarial network to impute missing sensor readings. Values are imputed based on relationships between multiple fields and multiple points in time, for single time points or larger time gaps. From the complete data, digital behavior markers are extracted and are mapped to predicted clinical measures. RESULTS We validate our approach using continuous smartwatch data for n = 14 participants. When reconstructing omitted data, we observe an average normalized mean absolute error of 0.0197. We then create machine learning models to predict clinical measures from the reconstructed, complete data with correlations ranging from r = 0.1230 to r = 0.7623. This work indicates that wearable sensor data collected in the wild can be used to offer insights on a person's health in natural settings.
Collapse
Affiliation(s)
- Brian L Thomas
- School of Electrical Engineering and Computer Science, Washington State University, Pullman, Washington, United States
| | - Lawrence B Holder
- School of Electrical Engineering and Computer Science, Washington State University, Pullman, Washington, United States
| | - Diane J Cook
- School of Electrical Engineering and Computer Science, Washington State University, Pullman, Washington, United States
| |
Collapse
|
4
|
COOK DIANEJ, STRICKLAND MIRANDA, SCHMITTER-EDGECOMBE MAUREEN. Detecting Smartwatch-based Behavior Change in Response to a Multi-domain Brain Health Intervention. ACM TRANSACTIONS ON COMPUTING FOR HEALTHCARE 2022; 3:33. [PMID: 35815157 PMCID: PMC9268550 DOI: 10.1145/3508020] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/01/2020] [Accepted: 12/01/2021] [Indexed: 06/15/2023]
Abstract
In this study, we introduce and validate a computational method to detect lifestyle change that occurs in response to a multi-domain healthy brain aging intervention. To detect behavior change, digital behavior markers (DM) are extracted from smartwatch sensor data and a Permutation-based Change Detection (PCD) algorithm quantifies the change in marker-based behavior from a pre-intervention, one-week baseline. To validate the method, we verify that changes are successfully detected from synthetic data with known pattern differences. Next, we employ this method to detect overall behavior change for n=28 BHI subjects and n=17 age-matched control subjects. For these individuals, we observe a monotonic increase in behavior change from the baseline week with a slope of 0.7460 for the intervention group and a slope of 0.0230 for the control group. Finally, we utilize a random forest algorithm to perform leave-one-subject-out prediction of intervention versus control subjects based on digital marker delta values. The random forest predicts whether the subject is in the intervention or control group with an accuracy of 0.87. This work has implications for capturing objective, continuous data to inform our understanding of intervention adoption and impact.
Collapse
|
5
|
Zhou X, Wen S. Analysis of Body Behavior Characteristics after Sports Training Based on Convolution Neural Network. COMPUTATIONAL INTELLIGENCE AND NEUROSCIENCE 2021; 2021:7006541. [PMID: 34335723 PMCID: PMC8318741 DOI: 10.1155/2021/7006541] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 06/29/2021] [Revised: 07/10/2021] [Accepted: 07/14/2021] [Indexed: 11/18/2022]
Abstract
The use of artificial intelligence technology to analyze human behavior is one of the key research topics in the world. In order to detect and analyze the characteristics of human body behavior after training, a detection model combined with a convolutional neural network (CNN) is proposed. Firstly, the human skeleton suggestion model is established to analyze the driving mode of the human body in motion. Secondly, the number of layers and neurons in CNN are set according to the skeleton feature map. Then, the output information is classified according to the fatigue degree according to the body state after exercise. Finally, the training and performance test of the model are carried out, and the effect of the body behavior feature detection model in use is analyzed. The results show that the CNN designed in the study shows high accuracy and low loss rate in training and testing and also has high accuracy in the practical application of fatigue degree recognition after human training. According to the subjective evaluation of volunteers, the overall average evaluation is more than 9 points. The above results show that the designed convolution neural network-based detection model of body behavior characteristics after training has good performance and is feasible and practical, which has guiding significance for the design of sports training and training schemes.
Collapse
Affiliation(s)
- Xinliang Zhou
- School of Physical Education, Xihua University, Chengdu, Sichuan 610039, China
| | - Shantian Wen
- School of Physical Education, Huzhou University, Huzhou, Zhejiang 313000, China
| |
Collapse
|
6
|
Das K, Paital B. Future call for policy making to speed up interdisciplinarity between natural and social sciences and humanities in countries such as India. Heliyon 2021; 7:e06484. [PMID: 33768177 PMCID: PMC7980073 DOI: 10.1016/j.heliyon.2021.e06484] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/23/2020] [Revised: 07/31/2020] [Accepted: 03/08/2021] [Indexed: 12/30/2022] Open
Abstract
OBJECTIVES Science is the erudite methodical systematic practises to study the structure and behaviour of natural objects and/or phenomena. It clearly unknot about the fact that science is a human (society) need based process that starts with social affairs, for example, need to exchange emotion and cognitive processes (psychology), feelings (literature), relation (sociology), money (economics) etc. Humanities are the use of approaches that are predominantly hypothetical but critical, and have a noteworthy historical component, and the methodical aspects distinguish it from the mainly experiential approaches of the science. The basic approaches in both remains the same that it needs a hypothesis, sound methodology, and interpretation of data. Human is the end user in both the cases. So, why only interdisciplinary research focused on the core subjects of science? For example, philosophy, deals with general and vital complications relating to matters including existence, knowledge, language, attitude, behaviour, values, ethics, reason, mind, peace and harmony in life which can be essentially a part of science (especially natural sciences and more particularly animals sciences such as zoology) or vice versa could be true. The current and future time will allow us to believe on such concept, is the main theme of the current article. METHODS Articles from all published sources are considered for answering the objective that why not concentrating to speed up interdisciplinarity. Few tables and figure are reproduced or redrawn as per the need. And numerical data are collected to present the current status of the interdisciplinarity and the need of the pace it requires. RESULTS It is noticed that number of research articles on interdisciplinarity in comparison to several core subject area in major databases including environmental biology are still negligible. Countries still need to inter-collaborate at interdisciplinary level for the development and benefit of human race. This needs to be done mainly at socio-economic, intercultural and scientific levels. Although numbers of steps are taken such as establishment of interdisciplinary institutes, introduction of interdisciplinary courses, interdisciplinary research and publication platforms in specialized dedicated journals, still concrete steps to introduce the course of interdisciplinarity at educational and professional level is wanting. CONCLUSION Therefore, policy on pace in interdisciplinarity across science and humanities is highly wanting especially in developing countries to fix several national and international issues. Present article deals with the current status and future prospective or policies required on interdisciplinarity.
Collapse
Affiliation(s)
- Kabita Das
- Post Graduate Department of Philosophy, Utkal University, Bhubaneswar, Odisha, India
| | - Biswaranjan Paital
- Redox Regulation Laboratory, Department of Zoology, College of Basic Science and Humanities, Odisha University of Agriculture and Technology, Bhubaneswar, India
| |
Collapse
|
7
|
Li X, Liu Z, Gao X, Zhang J. Bicycling Phase Recognition for Lower Limb Amputees Using Support Vector Machine Optimized by Particle Swarm Optimization. SENSORS 2020; 20:s20226533. [PMID: 33203169 PMCID: PMC7696493 DOI: 10.3390/s20226533] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 10/09/2020] [Revised: 11/10/2020] [Accepted: 11/12/2020] [Indexed: 11/16/2022]
Abstract
A novel method for recognizing the phases in bicycling of lower limb amputees using support vector machine (SVM) optimized by particle swarm optimization (PSO) is proposed in this paper. The method is essential for enhanced prosthetic knee joint control for lower limb amputees in carrying out bicycling activity. Some wireless wearable accelerometers and a knee joint angle sensor are installed in the prosthesis to obtain data on the knee joint and ankle joint horizontal, vertical acceleration signal and knee joint angle. In order to overcome the problem of high noise content in the collected data, a soft-hard threshold filter was used to remove the noise caused by the vibration. The filtered information is then used to extract the multi-dimensional feature vector for the training of SVM for performing bicycling phase recognition. The SVM is optimized by PSO to enhance its classification accuracy. The recognition accuracy of the PSO-SVM classification model on testing data is 93%, which is much higher than those of BP, SVM and PSO-BP classification models.
Collapse
Affiliation(s)
- Xinxin Li
- School of Artificial Intelligence, Hebei University of Technology, Tianjin 300130, China; (X.L.); (X.G.)
| | - Zuojun Liu
- School of Artificial Intelligence, Hebei University of Technology, Tianjin 300130, China; (X.L.); (X.G.)
- Correspondence:
| | - Xinzhi Gao
- School of Artificial Intelligence, Hebei University of Technology, Tianjin 300130, China; (X.L.); (X.G.)
| | - Jie Zhang
- School of Engineering, Merz Court, Newcastle University, Newcastle upon Tyne NE1 7RU, UK;
| |
Collapse
|
8
|
Liu H, Wu Y, Cao Y, Lv W, Han H, Li Z, Chang J. Well Logging Based Lithology Identification Model Establishment Under Data Drift: A Transfer Learning Method. SENSORS 2020; 20:s20133643. [PMID: 32610586 PMCID: PMC7374305 DOI: 10.3390/s20133643] [Citation(s) in RCA: 19] [Impact Index Per Article: 3.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 05/29/2020] [Revised: 06/21/2020] [Accepted: 06/23/2020] [Indexed: 12/14/2022]
Abstract
Recent years have witnessed the development of the applications of machine learning technologies to well logging-based lithology identification. Most of the existing work assumes that the well loggings gathered from different wells share the same probability distribution; however, the variations in sedimentary environment and well-logging technique might cause the data drift problem; i.e., data of different wells have different probability distributions. Therefore, the model trained on old wells does not perform well in predicting the lithologies in newly-coming wells, which motivates us to propose a transfer learning method named the data drift joint adaptation extreme learning machine (DDJA-ELM) to increase the accuracy of the old model applying to new wells. In such a method, three key points, i.e., the project mean maximum mean discrepancy, joint distribution domain adaptation, and manifold regularization, are incorporated into extreme learning machine. As found experimentally in multiple wells in Jiyang Depression, Bohai Bay Basin, DDJA-ELM could significantly increase the accuracy of an old model when identifying the lithologies in new wells.
Collapse
Affiliation(s)
- Haining Liu
- School of Geosciences, China University of Petroleum, Qingdao 266580, China; (H.L.); (Y.C.)
- Shengli Geophysical Research Institute of SINOPEC, Dongying 257022, China;
| | - Yuping Wu
- School of Electrical Engineering, Yanshan University, Qinhuangdao 066004, China;
| | - Yingchang Cao
- School of Geosciences, China University of Petroleum, Qingdao 266580, China; (H.L.); (Y.C.)
| | - Wenjun Lv
- Department of Automation, University of Science and Technology of China, Hefei 230027, China; (Z.L.); (J.C.)
- Correspondence:
| | - Hongwei Han
- Shengli Geophysical Research Institute of SINOPEC, Dongying 257022, China;
| | - Zerui Li
- Department of Automation, University of Science and Technology of China, Hefei 230027, China; (Z.L.); (J.C.)
| | - Ji Chang
- Department of Automation, University of Science and Technology of China, Hefei 230027, China; (Z.L.); (J.C.)
| |
Collapse
|
9
|
Eldib M, Philips W, Aghajan H. Discovering Human Activities from Binary Data in Smart Homes. SENSORS (BASEL, SWITZERLAND) 2020; 20:s20092513. [PMID: 32365545 PMCID: PMC7248863 DOI: 10.3390/s20092513] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 03/11/2020] [Revised: 04/23/2020] [Accepted: 04/26/2020] [Indexed: 06/11/2023]
Abstract
With the rapid development in sensing technology, data mining, and machine learning fields for human health monitoring, it became possible to enable monitoring of personal motion and vital signs in a manner that minimizes the disruption of an individual's daily routine and assist individuals with difficulties to live independently at home. A primary difficulty that researchers confront is acquiring an adequate amount of labeled data for model training and validation purposes. Therefore, activity discovery handles the problem that activity labels are not available using approaches based on sequence mining and clustering. In this paper, we introduce an unsupervised method for discovering activities from a network of motion detectors in a smart home setting. First, we present an intra-day clustering algorithm to find frequent sequential patterns within a day. As a second step, we present an inter-day clustering algorithm to find the common frequent patterns between days. Furthermore, we refine the patterns to have more compressed and defined cluster characterizations. Finally, we track the occurrences of various regular routines to monitor the functional health in an individual's patterns and lifestyle. We evaluate our methods on two public data sets captured in real-life settings from two apartments during seven-month and three-month periods.
Collapse
Affiliation(s)
- Mohamed Eldib
- Correspondence: ; Tel.: +32-9-264-79-66; Fax: +32-9-264-42-95
| | | | | |
Collapse
|
10
|
Lu B, Fu L, Nie B, Peng Z, Liu H. A Novel Framework with High Diagnostic Sensitivity for Lung Cancer Detection by Electronic Nose. SENSORS 2019; 19:s19235333. [PMID: 31817006 PMCID: PMC6928832 DOI: 10.3390/s19235333] [Citation(s) in RCA: 10] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 11/07/2019] [Revised: 11/27/2019] [Accepted: 11/29/2019] [Indexed: 12/11/2022]
Abstract
The electronic nose (e-nose) system is a newly developing detection technology for its advantages of non-invasiveness, simple operation, and low cost. However, lung cancer screening through e-nose requires effective pattern recognition frameworks. Existing frameworks rely heavily on hand-crafted features and have relatively low diagnostic sensitivity. To handle these problems, gated recurrent unit based autoencoder (GRU-AE) is adopted to automatically extract features from temporal and high-dimensional e-nose data. Moreover, we propose a novel margin and sensitivity based ordering ensemble pruning (MSEP) model for effective classification. The proposed heuristic model aims to reduce missed diagnosis rate of lung cancer patients while maintaining a high rate of overall identification. In the experiments, five state-of-the-art classification models and two popular dimensionality reduction methods were involved for comparison to demonstrate the validity of the proposed GRU-AE-MSEP framework, through 214 collected breath samples measured by e-nose. Experimental results indicated that the proposed intelligent framework achieved high sensitivity of 94.22%, accuracy of 93.55%, and specificity of 92.80%, thereby providing a new practical means for wide disease screening by e-nose in medical scenarios.
Collapse
Affiliation(s)
- Binchun Lu
- Chongqing University-University of Cincinnati Joint Co-op Institute, Chongqing University, Chongqing 400030, China; (B.L.); (L.F.)
| | - Lidan Fu
- Chongqing University-University of Cincinnati Joint Co-op Institute, Chongqing University, Chongqing 400030, China; (B.L.); (L.F.)
| | - Bo Nie
- Key Laboratory of Biotechnology Science and Technology, Ministry of Education, College of Bioengineering, Chongqing University, Chongqing 400030, China;
| | - Zhiyun Peng
- State Key Laboratory of Power Transmission Equipment & System Security and New Technology, Chongqing University, Chongqing 400030, China;
| | - Hongying Liu
- Key Laboratory of Biotechnology Science and Technology, Ministry of Education, College of Bioengineering, Chongqing University, Chongqing 400030, China;
- Correspondence:
| |
Collapse
|