1
|
Monteiro S, Figueiredo J, Fonseca P, Vilas-Boas JP, Santos CP. Human-in-the-Loop Optimization of Knee Exoskeleton Assistance for Minimizing User's Metabolic and Muscular Effort. SENSORS (BASEL, SWITZERLAND) 2024; 24:3305. [PMID: 38894101 PMCID: PMC11174841 DOI: 10.3390/s24113305] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/25/2024] [Revised: 05/10/2024] [Accepted: 05/20/2024] [Indexed: 06/21/2024]
Abstract
Lower limb exoskeletons have the potential to mitigate work-related musculoskeletal disorders; however, they often lack user-oriented control strategies. Human-in-the-loop (HITL) controls adapt an exoskeleton's assistance in real time, to optimize the user-exoskeleton interaction. This study presents a HITL control for a knee exoskeleton using a CMA-ES algorithm to minimize the users' physical effort, a parameter innovatively evaluated using the interaction torque with the exoskeleton (a muscular effort indicator) and metabolic cost. This work innovates by estimating the user's metabolic cost within the HITL control through a machine-learning model. The regression model estimated the metabolic cost, in real time, with a root mean squared error of 0.66 W/kg and mean absolute percentage error of 26% (n = 5), making faster (10 s) and less noisy estimations than a respirometer (K5, Cosmed). The HITL reduced the user's metabolic cost by 7.3% and 5.9% compared to the zero-torque and no-device conditions, respectively, and reduced the interaction torque by 32.3% compared to a zero-torque control (n = 1). The developed HITL control surpassed a non-exoskeleton and zero-torque condition regarding the user's physical effort, even for a task such as slow walking. Furthermore, the user-specific control had a lower metabolic cost than the non-user-specific assistance. This proof-of-concept demonstrated the potential of HITL controls in assisted walking.
Collapse
Affiliation(s)
- Sara Monteiro
- Center for MicroElectroMechanical Systems (CMEMS), University of Minho, 4800-058 Guimarães, Portugal; (S.M.); (C.P.S.)
| | - Joana Figueiredo
- Center for MicroElectroMechanical Systems (CMEMS), University of Minho, 4800-058 Guimarães, Portugal; (S.M.); (C.P.S.)
- LABBELS—Associate Laboratory, 4710-057 Braga, Portugal
- LABBELS—Associate Laboratory, 4800-058 Guimarães, Portugal
| | - Pedro Fonseca
- Porto Biomechanics Laboratory (LABIOMEP), University of Porto, 4200-450 Porto, Portugal; (P.F.); (J.P.V.-B.)
| | - J. Paulo Vilas-Boas
- Porto Biomechanics Laboratory (LABIOMEP), University of Porto, 4200-450 Porto, Portugal; (P.F.); (J.P.V.-B.)
- Centre of Research, Education, Innovation and Intervention in Sport (CIFI2D), Faculty of Sport, University of Porto, 4200-450 Porto, Portugal
| | - Cristina P. Santos
- Center for MicroElectroMechanical Systems (CMEMS), University of Minho, 4800-058 Guimarães, Portugal; (S.M.); (C.P.S.)
- LABBELS—Associate Laboratory, 4710-057 Braga, Portugal
- LABBELS—Associate Laboratory, 4800-058 Guimarães, Portugal
| |
Collapse
|
2
|
Hossain MB, LaMunion SR, Crouter SE, Melanson EL, Sazonov E. A CNN Model for Physical Activity Recognition and Energy Expenditure Estimation from an Eyeglass-Mounted Wearable Sensor. SENSORS (BASEL, SWITZERLAND) 2024; 24:3046. [PMID: 38793899 PMCID: PMC11125058 DOI: 10.3390/s24103046] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/04/2024] [Revised: 05/04/2024] [Accepted: 05/10/2024] [Indexed: 05/26/2024]
Abstract
Metabolic syndrome poses a significant health challenge worldwide, prompting the need for comprehensive strategies integrating physical activity monitoring and energy expenditure. Wearable sensor devices have been used both for energy intake and energy expenditure (EE) estimation. Traditionally, sensors are attached to the hip or wrist. The primary aim of this research is to investigate the use of an eyeglass-mounted wearable energy intake sensor (Automatic Ingestion Monitor v2, AIM-2) for simultaneous recognition of physical activity (PAR) and estimation of steady-state EE as compared to a traditional hip-worn device. Study data were collected from six participants performing six structured activities, with the reference EE measured using indirect calorimetry (COSMED K5) and reported as metabolic equivalents of tasks (METs). Next, a novel deep convolutional neural network-based multitasking model (Multitasking-CNN) was developed for PAR and EE estimation. The Multitasking-CNN was trained with a two-step progressive training approach for higher accuracy, where in the first step the model for PAR was trained, and in the second step the model was fine-tuned for EE estimation. Finally, the performance of Multitasking-CNN on AIM-2 attached to eyeglasses was compared to the ActiGraph GT9X (AG) attached to the right hip. On the AIM-2 data, Multitasking-CNN achieved a maximum of 95% testing accuracy of PAR, a minimum of 0.59 METs mean square error (MSE), and 11% mean absolute percentage error (MAPE) in EE estimation. Conversely, on AG data, the Multitasking-CNN model achieved a maximum of 82% testing accuracy in PAR, a minimum of 0.73 METs MSE, and 13% MAPE in EE estimation. These results suggest the feasibility of using an eyeglass-mounted sensor for both PAR and EE estimation.
Collapse
Affiliation(s)
- Md Billal Hossain
- Department of Electrical and Computer Engineering, The University of Alabama, Tuscaloosa, AL 35487, USA;
| | - Samuel R. LaMunion
- Department of Kinesiology, Recreation and Sport Studies, The University of Tennessee, Knoxville, TN 37996, USA; (S.R.L.); (S.E.C.)
| | - Scott E. Crouter
- Department of Kinesiology, Recreation and Sport Studies, The University of Tennessee, Knoxville, TN 37996, USA; (S.R.L.); (S.E.C.)
| | - Edward L. Melanson
- USA Division of Endocrinology, Metabolism, and Diabetes, University of Colorado Anschutz Medical Campus, Aurora, CO 80045, USA;
| | - Edward Sazonov
- Department of Electrical and Computer Engineering, The University of Alabama, Tuscaloosa, AL 35487, USA;
| |
Collapse
|
3
|
Boborzi L, Decker J, Rezaei R, Schniepp R, Wuehr M. Human Activity Recognition in a Free-Living Environment Using an Ear-Worn Motion Sensor. SENSORS (BASEL, SWITZERLAND) 2024; 24:2665. [PMID: 38732771 PMCID: PMC11085719 DOI: 10.3390/s24092665] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/29/2024] [Revised: 04/16/2024] [Accepted: 04/20/2024] [Indexed: 05/13/2024]
Abstract
Human activity recognition (HAR) technology enables continuous behavior monitoring, which is particularly valuable in healthcare. This study investigates the viability of using an ear-worn motion sensor for classifying daily activities, including lying, sitting/standing, walking, ascending stairs, descending stairs, and running. Fifty healthy participants (between 20 and 47 years old) engaged in these activities while under monitoring. Various machine learning algorithms, ranging from interpretable shallow models to state-of-the-art deep learning approaches designed for HAR (i.e., DeepConvLSTM and ConvTransformer), were employed for classification. The results demonstrate the ear sensor's efficacy, with deep learning models achieving a 98% accuracy rate of classification. The obtained classification models are agnostic regarding which ear the sensor is worn and robust against moderate variations in sensor orientation (e.g., due to differences in auricle anatomy), meaning no initial calibration of the sensor orientation is required. The study underscores the ear's efficacy as a suitable site for monitoring human daily activity and suggests its potential for combining HAR with in-ear vital sign monitoring. This approach offers a practical method for comprehensive health monitoring by integrating sensors in a single anatomical location. This integration facilitates individualized health assessments, with potential applications in tele-monitoring, personalized health insights, and optimizing athletic training regimes.
Collapse
Affiliation(s)
- Lukas Boborzi
- German Center for Vertigo and Balance Disorders (DSGZ), Ludwig-Maximilians-University of Munich, 81377 Munich, Germany
| | - Julian Decker
- German Center for Vertigo and Balance Disorders (DSGZ), Ludwig-Maximilians-University of Munich, 81377 Munich, Germany
| | - Razieh Rezaei
- German Center for Vertigo and Balance Disorders (DSGZ), Ludwig-Maximilians-University of Munich, 81377 Munich, Germany
| | - Roman Schniepp
- Institute for Emergency Medicine and Medical Management, Ludwig-Maximilians-University of Munich, 80336 Munich, Germany
| | - Max Wuehr
- German Center for Vertigo and Balance Disorders (DSGZ), Ludwig-Maximilians-University of Munich, 81377 Munich, Germany
- Department of Neurology, Ludwig-Maximilians-University of Munich, 81377 Munich, Germany
| |
Collapse
|
4
|
Adigal SS, Kuzhuppilly NIR, Hegde N, V R N, Rizvi A, John RV, George SD, Kartha VB, Bhandary SV, Chidangil S. HPLC-LED-Induced Fluorescence Analysis of Tear Fluids: An Objective Method for Primary Open Angle Glaucoma Diagnosis. Curr Eye Res 2024; 49:260-269. [PMID: 38078692 DOI: 10.1080/02713683.2023.2289862] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/29/2023] [Accepted: 11/28/2023] [Indexed: 02/24/2024]
Abstract
PURPOSE The study showcased the application of the lab-assembled HPLC-LED-IF system to analyze proteins in tear fluid samples collected from individuals diagnosed with primary open-angle glaucoma (POAG). METHODS Clinical application of the said technique was evaluated by recording chromatograms of tear fluid samples from control and POAG subjects and by analyzing the protein profile using multivariate analysis. The data analysis methods involved are principal component analysis (PCA), Match/No-Match, and artificial neural network (ANN) based binary classification for disease diagnosis. RESULTS Mahalanobis distance and spectral residual values calculated using a standard calibration set of clinically confirmed POAG samples for the Match/No-Match test gave 86.9% sensitivity and 81.8% specificity. ANN with leaving one out procedure has given 87.1% sensitivity and 81.8% specificity. CONCLUSION The results of the study revealed that the utilization of a 278 nm LED excitation in the HPLC system offers good sensitivity for detecting proteins at low concentrations allowing to obtain reliable protein profiles for the diagnosis of POAG.
Collapse
Affiliation(s)
- Sphurti S Adigal
- Centre of Excellence for Biophotonics, Department of Atomic and Molecular Physics, Manipal Academy of Higher Education, Manipal, Karnataka, India
| | - Neetha I R Kuzhuppilly
- Department of Ophthalmology, Kasturba Medical College, Manipal, Manipal Academy of Higher Education, Manipal, Karnataka, India
| | - Nagaraj Hegde
- Arion, The Randstad Netherlands, Eindhoven City, the Netherlands
| | - Nidheesh V R
- Centre of Excellence for Biophotonics, Department of Atomic and Molecular Physics, Manipal Academy of Higher Education, Manipal, Karnataka, India
| | - Alisha Rizvi
- Department of Ophthalmology, Kasturba Medical College, Manipal, Manipal Academy of Higher Education, Manipal, Karnataka, India
| | - Reena V John
- Centre of Excellence for Biophotonics, Department of Atomic and Molecular Physics, Manipal Academy of Higher Education, Manipal, Karnataka, India
| | - Sajan D George
- Centre for Applied Nanosciences, Department of Atomic and Molecular Physics, Manipal Academy of Higher Education, Manipal, Karnataka, India
| | - Vasudevan B Kartha
- Centre of Excellence for Biophotonics, Department of Atomic and Molecular Physics, Manipal Academy of Higher Education, Manipal, Karnataka, India
| | - Sulatha V Bhandary
- Department of Ophthalmology, Kasturba Medical College, Manipal, Manipal Academy of Higher Education, Manipal, Karnataka, India
| | - Santhosh Chidangil
- Centre of Excellence for Biophotonics, Department of Atomic and Molecular Physics, Manipal Academy of Higher Education, Manipal, Karnataka, India
| |
Collapse
|
5
|
Morimoto T, Hirata H, Kobayashi T, Tsukamoto M, Yoshihara T, Toda Y, Mawatari M. Gait analysis using digital biomarkers including smart shoes in lumbar spinal canal stenosis: a scoping review. Front Med (Lausanne) 2023; 10:1302136. [PMID: 38162877 PMCID: PMC10757616 DOI: 10.3389/fmed.2023.1302136] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/26/2023] [Accepted: 11/23/2023] [Indexed: 01/03/2024] Open
Abstract
Lumbar spinal canal stenosis (LSS) is characterized by gait abnormalities, and objective quantitative gait analysis is useful for diagnosis and treatment. This review aimed to provide a review of objective quantitative gait analysis in LSS and note the current status and potential of smart shoes in diagnosing and treating LSS. The characteristics of gait deterioration in LSS include decreased gait velocity and asymmetry due to neuropathy (muscle weakness and pain) in the lower extremities. Previous laboratory objective and quantitative gait analyses mainly comprised marker-based three-dimensional motion analysis and ground reaction force. However, workforce, time, and costs pose some challenges. Recent developments in wearable sensor technology and markerless motion analysis systems have made gait analysis faster, easier, and less expensive outside the laboratory. Smart shoes can provide more accurate gait information than other wearable sensors. As only a few reports exist on gait disorders in patients with LSS, future studies should focus on the accuracy and cost-effectiveness of gait analysis using smart shoes.
Collapse
Affiliation(s)
- Tadatsugu Morimoto
- Department of Orthopaedic Surgery, Faculty of Medicine, Saga University, Saga, Japan
| | | | | | | | | | | | | |
Collapse
|
6
|
Yang G, Zhang L, Bu C, Wang S, Wu H, Song A. FreqSense: Adaptive Sampling Rates for Sensor-Based Human Activity Recognition Under Tunable Computational Budgets. IEEE J Biomed Health Inform 2023; 27:5791-5802. [PMID: 37792660 DOI: 10.1109/jbhi.2023.3321639] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/06/2023]
Abstract
Recent years have witnessed great success of deep convolutional networks in sensor-based human activity recognition (HAR), yet their practical deployment remains a challenge due to the varying computational budgets required to obtain a reliable prediction. This article focuses on adaptive inference from a novel perspective of signal frequency, which is motivated by an intuition that low-frequency features are enough for recognizing "easy" activity samples, while only "hard" activity samples need temporally detailed information. We propose an adaptive resolution network by combining a simple subsampling strategy with conditional early-exit. Specifically, it is comprised of multiple subnetworks with different resolutions, where "easy" activity samples are first classified by lightweight subnetwork using the lowest sampling rate, while the subsequent subnetworks in higher resolution would be sequentially applied once the former one fails to reach a confidence threshold. Such dynamical decision process could adaptively select a proper sampling rate for each activity sample conditioned on an input if the budget varies, which will be terminated until enough confidence is obtained, hence avoiding excessive computations. Comprehensive experiments on four diverse HAR benchmark datasets demonstrate the effectiveness of our method in terms of accuracy-cost tradeoff. We benchmark the average latency on a real hardware.
Collapse
|
7
|
Helmstetter S, Matthiesen S. Human Posture Estimation: A Systematic Review on Force-Based Methods-Analyzing the Differences in Required Expertise and Result Benefits for Their Utilization. SENSORS (BASEL, SWITZERLAND) 2023; 23:8997. [PMID: 37960696 PMCID: PMC10647597 DOI: 10.3390/s23218997] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/02/2023] [Revised: 10/27/2023] [Accepted: 10/31/2023] [Indexed: 11/15/2023]
Abstract
Force-based human posture estimation (FPE) provides a valuable alternative when camera-based human motion capturing is impractical. It offers new opportunities for sensor integration in smart products for patient monitoring, ergonomic optimization and sports science. Due to the interdisciplinary research on the topic, an overview of existing methods and the required expertise for their utilization is lacking. This paper presents a systematic review by the PRISMA 2020 review process. In total, 82 studies are selected (59 machine learning (ML)-based and 23 digital human model (DHM)-based posture estimation methods). The ML-based methods use input data from hardware sensors-mostly pressure mapping sensors-and trained ML models for estimating human posture. The ML-based human posture estimation algorithms mostly reach an accuracy above 90%. DHMs, which represent the structure and kinematics of the human body, adjust posture to minimize physical stress. The required expert knowledge for the utilization of these methods and their resulting benefits are analyzed and discussed. DHM-based methods have shown their general applicability without the need for application-specific training but require expertise in human physiology. ML-based methods can be used with less domain-specific expertise, but an application-specific training of these models is necessary.
Collapse
Affiliation(s)
| | - Sven Matthiesen
- Karlsruhe Institute of Technology (KIT), IPEK—Institute of Product Engineering, 76131 Karlsruhe, Germany;
| |
Collapse
|
8
|
D’Arco L, Wang H, Zheng H. DeepHAR: a deep feed-forward neural network algorithm for smart insole-based human activity recognition. Neural Comput Appl 2023. [DOI: 10.1007/s00521-023-08363-w] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 03/28/2023]
Abstract
AbstractHealth monitoring, rehabilitation, and fitness are just a few domains where human activity recognition can be applied. In this study, a deep learning approach has been proposed to recognise ambulation and fitness activities from data collected by five participants using smart insoles. Smart insoles, consisting of pressure and inertial sensors, allowed for seamless data collection while minimising user discomfort, laying the baseline for the development of a monitoring and/or rehabilitation system for everyday life. The key objective has been to enhance the deep learning model performance through several techniques, including data segmentation with overlapping technique (2 s with 50% overlap), signal down-sampling by averaging contiguous samples, and a cost-sensitive re-weighting strategy for the loss function for handling the imbalanced dataset. The proposed solution achieved an Accuracy and F1-Score of 98.56% and 98.57%, respectively. The Sitting activities obtained the highest degree of recognition, closely followed by the Spinning Bike class, but fitness activities were recognised at a higher rate than ambulation activities. A comparative analysis was carried out both to determine the impact that pre-processing had on the proposed core architecture and to compare the proposed solution with existing state-of-the-art solutions. The results, in addition to demonstrating how deep learning solutions outperformed those of shallow machine learning, showed that in our solution the use of data pre-processing increased performance by about 2%, optimising the handling of the imbalanced dataset and allowing a relatively simple network to outperform more complex networks, reducing the computational impact required for such applications.
Collapse
|
9
|
Lopez-de-Ipina K, Iradi J, Fernandez E, Calvo PM, Salle D, Poologaindran A, Villaverde I, Daelman P, Sanchez E, Requejo C, Suckling J. HUMANISE: Human-Inspired Smart Management, towards a Healthy and Safe Industrial Collaborative Robotics. SENSORS (BASEL, SWITZERLAND) 2023; 23:1170. [PMID: 36772209 PMCID: PMC9920065 DOI: 10.3390/s23031170] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 11/27/2022] [Revised: 01/10/2023] [Accepted: 01/14/2023] [Indexed: 06/18/2023]
Abstract
The workplace is evolving towards scenarios where humans are acquiring a more active and dynamic role alongside increasingly intelligent machines. Moreover, the active population is ageing and consequently emerging risks could appear due to health disorders of workers, which requires intelligent intervention both for production management and workers' support. In this sense, the innovative and smart systems oriented towards monitoring and regulating workers' well-being will become essential. This work presents HUMANISE, a novel proposal of an intelligent system for risk management, oriented to workers suffering from disease conditions. The developed support system is based on Computer Vision, Machine Learning and Intelligent Agents. Results: The system was applied to a two-arm Cobot scenario during a Learning from Demonstration task for collaborative parts transportation, where risk management is critical. In this environment with a worker suffering from a mental disorder, safety is successfully controlled by means of human/robot coordination, and risk levels are managed through the integration of human/robot behaviour models and worker's models based on the workplace model of the World Health Organization. The results show a promising real-time support tool to coordinate and monitoring these scenarios by integrating workers' health information towards a successful risk management strategy for safe industrial Cobot environments.
Collapse
Affiliation(s)
- Karmele Lopez-de-Ipina
- Department of Psychiatry, University of Cambridge, Cambridge CB2 3PT, UK
- EleKin Lab, Systems Engineering and Automation, Computers’ Architecture and Technology, and Enterprise Management Departments, University of the Basque Country UPV/EHU, 20018 Donostia-San Sebastian, Spain
| | - Jon Iradi
- EleKin Lab, Systems Engineering and Automation, Computers’ Architecture and Technology, and Enterprise Management Departments, University of the Basque Country UPV/EHU, 20018 Donostia-San Sebastian, Spain
| | - Elsa Fernandez
- EleKin Lab, Systems Engineering and Automation, Computers’ Architecture and Technology, and Enterprise Management Departments, University of the Basque Country UPV/EHU, 20018 Donostia-San Sebastian, Spain
| | - Pilar M. Calvo
- EleKin Lab, Systems Engineering and Automation, Computers’ Architecture and Technology, and Enterprise Management Departments, University of the Basque Country UPV/EHU, 20018 Donostia-San Sebastian, Spain
| | - Damien Salle
- Tecnalia Research Centre, Tecnalia Industry and Transport Division, 20009 Donostia-San Sebastia, Spain
| | - Anujan Poologaindran
- Department of Psychiatry, University of Cambridge, Cambridge CB2 3PT, UK
- The Alan Turing Institute, British Library, London NW1 2DB, UK
| | - Ivan Villaverde
- Tecnalia Research Centre, Tecnalia Industry and Transport Division, 20009 Donostia-San Sebastia, Spain
| | - Paul Daelman
- Tecnalia Research Centre, Tecnalia Industry and Transport Division, 20009 Donostia-San Sebastia, Spain
| | - Emilio Sanchez
- Department of Mechanical Engineering and Materials, Engineering School, University of Navarra, TECNUN, 20018 Donostia-San Sebastian, Spain
- CEIT, Manufacturing Division, 20018 Donostia-San Sebastian, Spain
| | - Catalina Requejo
- Cajal Institute, Consejo Superior de Investigaciones Científicas (CSIC), 28002 Madrid, Spain
| | - John Suckling
- Department of Psychiatry, University of Cambridge, Cambridge CB2 3PT, UK
| |
Collapse
|
10
|
Posture positioning estimation for players based on attention mechanism and hierarchical context. Neural Comput Appl 2022. [DOI: 10.1007/s00521-022-07800-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/15/2022]
|
11
|
Leone A, Rescio G, Diraco G, Manni A, Siciliano P, Caroppo A. Ambient and Wearable Sensor Technologies for Energy Expenditure Quantification of Ageing Adults. SENSORS 2022; 22:s22134893. [PMID: 35808387 PMCID: PMC9269397 DOI: 10.3390/s22134893] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 05/18/2022] [Revised: 06/23/2022] [Accepted: 06/26/2022] [Indexed: 12/10/2022]
Abstract
COVID-19 has affected daily life in unprecedented ways, with dramatic changes in mental health, sleep time and level of physical activity. These changes have been especially relevant in the elderly population, with important health-related consequences. In this work, two different sensor technologies were used to quantify the energy expenditure of ageing adults. To this end, a technological platform based on Raspberry Pi 4, as an elaboration unit, was designed and implemented. It integrates an ambient sensor node, a wearable sensor node and a coordinator node that uses the information provided by the two sensor technologies in a combined manner. Ambient and wearable sensors are used for the real-time recognition of four human postures (standing, sitting, bending and lying down), walking activity and for energy expenditure quantification. An important first aim of this work was to realize a platform with a high level of user acceptability. In fact, through the use of two unobtrusive sensors and a low-cost processing unit, the solution is easily accessible and usable in the domestic environment; moreover, it is versatile since it can be used by end-users who accept being monitored by a specific sensor. Another added value of the platform is the ability to abstract from sensing technologies, as the use of human posture and walking activity for energy expenditure quantification enables the integration of a wide set of devices, provided that they can reproduce the same set of features. The obtained results showed the ability of the proposed platform to automatically quantify energy expenditure, both with each sensing technology and with the combined version. Specifically, for posture and walking activity classification, an average accuracy of 93.8% and 93.3% was obtained, respectively, with the wearable and ambient sensor, whereas an improvement of approximately 4% was reached using data fusion. Consequently, the estimated energy expenditure quantification always had a relative error of less than 3.2% for each end-user involved in the experimentation stage, classifying the high level information (postures and walking activities) with the combined version of the platform, justifying the proposed overall architecture from a hardware and software point of view.
Collapse
|
12
|
D’Arco L, Wang H, Zheng H. Assessing Impact of Sensors and Feature Selection in Smart-Insole-Based Human Activity Recognition. Methods Protoc 2022; 5:mps5030045. [PMID: 35736546 PMCID: PMC9230734 DOI: 10.3390/mps5030045] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/30/2022] [Revised: 05/26/2022] [Accepted: 05/27/2022] [Indexed: 11/16/2022] Open
Abstract
Human Activity Recognition (HAR) is increasingly used in a variety of applications, including health care, fitness tracking, and rehabilitation. To reduce the impact on the user’s daily activities, wearable technologies have been advanced throughout the years. In this study, an improved smart insole-based HAR system is proposed. The impact of data segmentation, sensors used, and feature selection on HAR was fully investigated. The Support Vector Machine (SVM), a supervised learning algorithm, has been used to recognise six ambulation activities: downstairs, sit to stand, sitting, standing, upstairs, and walking. Considering the impact that data segmentation can have on the classification, the sliding window size was optimised, identifying the length of 10 s with 50% of overlap as the best performing. The inertial sensors and pressure sensors embedded into the smart insoles have been assessed to determine the importance that each one has in the classification. A feature selection technique has been applied to reduce the number of features from 272 to 227 to improve the robustness of the proposed system and to investigate the importance of features in the dataset. According to the findings, the inertial sensors are reliable for the recognition of dynamic activities, while pressure sensors are reliable for stationary activities; however, the highest accuracy (94.66%) was achieved by combining both types of sensors.
Collapse
|
13
|
Wearable Sensors and Machine Learning for Hypovolemia Problems in Occupational, Military and Sports Medicine: Physiological Basis, Hardware and Algorithms. SENSORS 2022; 22:s22020442. [PMID: 35062401 PMCID: PMC8781307 DOI: 10.3390/s22020442] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 11/05/2021] [Revised: 12/14/2021] [Accepted: 12/30/2021] [Indexed: 11/16/2022]
Abstract
Hypovolemia is a physiological state of reduced blood volume that can exist as either (1) absolute hypovolemia because of a lower circulating blood (plasma) volume for a given vascular space (dehydration, hemorrhage) or (2) relative hypovolemia resulting from an expanded vascular space (vasodilation) for a given circulating blood volume (e.g., heat stress, hypoxia, sepsis). This paper examines the physiology of hypovolemia and its association with health and performance problems common to occupational, military and sports medicine. We discuss the maturation of individual-specific compensatory reserve or decompensation measures for future wearable sensor systems to effectively manage these hypovolemia problems. The paper then presents areas of future work to allow such technologies to translate from lab settings to use as decision aids for managing hypovolemia. We envision a future that incorporates elements of the compensatory reserve measure with advances in sensing technology and multiple modalities of cardiovascular sensing, additional contextual measures, and advanced noise reduction algorithms into a fully wearable system, creating a robust and physiologically sound approach to manage physical work, fatigue, safety and health issues associated with hypovolemia for workers, warfighters and athletes in austere conditions.
Collapse
|
14
|
Yadav SK, Tiwari K, Pandey HM, Akbar SA. A review of multimodal human activity recognition with special emphasis on classification, applications, challenges and future directions. Knowl Based Syst 2021. [DOI: 10.1016/j.knosys.2021.106970] [Citation(s) in RCA: 35] [Impact Index Per Article: 8.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/16/2023]
|
15
|
Chew HSJ, Ang WHD, Lau Y. The potential of artificial intelligence in enhancing adult weight loss: a scoping review. Public Health Nutr 2021; 24:1993-2020. [PMID: 33592164 PMCID: PMC8145469 DOI: 10.1017/s1368980021000598] [Citation(s) in RCA: 11] [Impact Index Per Article: 2.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/14/2020] [Revised: 01/12/2021] [Accepted: 02/03/2021] [Indexed: 11/07/2022]
Abstract
OBJECTIVE To present an overview of how artificial intelligence (AI) could be used to regulate eating and dietary behaviours, exercise behaviours and weight loss. DESIGN A scoping review of global literature published from inception to 15 December 2020 was conducted according to Arksey and O'Malley's five-step framework. Eight databases (CINAHL, Cochrane-Central, Embase, IEEE Xplore, PsycINFO, PubMed, Scopus and Web of Science) were searched. Included studies were independently screened for eligibility by two reviewers with good interrater reliability (k = 0·96). RESULTS Sixty-six out of 5573 potential studies were included, representing more than 2031 participants. Three tenets of self-regulation were identified - self-monitoring (n 66, 100 %), optimisation of goal setting (n 10, 15·2 %) and self-control (n 10, 15·2 %). Articles were also categorised into three AI applications, namely machine perception (n 50), predictive analytics only (n 6) and real-time analytics with personalised micro-interventions (n 10). Machine perception focused on recognising food items, eating behaviours, physical activities and estimating energy balance. Predictive analytics focused on predicting weight loss, intervention adherence, dietary lapses and emotional eating. Studies on the last theme focused on evaluating AI-assisted weight management interventions that instantaneously collected behavioural data, optimised prediction models for behavioural lapse events and enhance behavioural self-control through adaptive and personalised nudges/prompts. Only six studies reported average weight losses (2·4-4·7 %) of which two were statistically significant. CONCLUSION The use of AI for weight loss is still undeveloped. Based on the current study findings, we proposed a framework on the applicability of AI for weight loss but cautioned its contingency upon engagement and contextualisation.
Collapse
Affiliation(s)
- Han Shi Jocelyn Chew
- Alice Lee Centre for Nursing Studies, Yong Loo Lin School of Medicine, National University of Singapore, 10 Medical Dr, Singapore 117597, Singapore
| | - Wei How Darryl Ang
- Alice Lee Centre for Nursing Studies, Yong Loo Lin School of Medicine, National University of Singapore, 10 Medical Dr, Singapore 117597, Singapore
| | - Ying Lau
- Alice Lee Centre for Nursing Studies, Yong Loo Lin School of Medicine, National University of Singapore, 10 Medical Dr, Singapore 117597, Singapore
| |
Collapse
|
16
|
Som A, Krishnamurthi N, Buman M, Turaga P. Unsupervised Pre-trained Models from Healthy ADLs Improve Parkinson's Disease Classification of Gait Patterns. ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. ANNUAL INTERNATIONAL CONFERENCE 2020; 2020:784-788. [PMID: 33018103 PMCID: PMC7545260 DOI: 10.1109/embc44109.2020.9176572] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/07/2022]
Abstract
Application and use of deep learning algorithms for different healthcare applications is gaining interest at a steady pace. However, use of such algorithms can prove to be challenging as they require large amounts of training data that capture different possible variations. This makes it difficult to use them in a clinical setting since in most health applications researchers often have to work with limited data. Less data can cause the deep learning model to over-fit. In this paper, we ask how can we use data from a different environment, different use-case, with widely differing data distributions. We exemplify this use case by using single-sensor accelerometer data from healthy subjects performing activities of daily living - ADLs (source dataset), to extract features relevant to multi-sensor accelerometer gait data (target dataset) for Parkinson's disease classification. We train the pre-trained model using the source dataset and use it as a feature extractor. We show that the features extracted for the target dataset can be used to train an effective classification model. Our pretrained source model consists of a convolutional autoencoder, and the target classification model is a simple multi-layer perceptron model. We explore two different pre-trained source models, trained using different activity groups, and analyze the influence the choice of pre-trained model has over the task of Parkinson's disease classification.
Collapse
|
17
|
Ngueleu AM, Blanchette AK, Maltais D, Moffet H, McFadyen BJ, Bouyer L, Batcho CS. Validity of Instrumented Insoles for Step Counting, Posture and Activity Recognition: A Systematic Review. SENSORS 2019; 19:s19112438. [PMID: 31141973 PMCID: PMC6603748 DOI: 10.3390/s19112438] [Citation(s) in RCA: 23] [Impact Index Per Article: 3.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 04/19/2019] [Revised: 05/23/2019] [Accepted: 05/24/2019] [Indexed: 11/16/2022]
Abstract
With the growing interest in daily activity monitoring, several insole designs have been developed to identify postures, detect activities, and count steps. However, the validity of these devices is not clearly established. The aim of this systematic review was to synthesize the available information on the criterion validity of instrumented insoles in detecting postures activities and steps. The literature search through six databases led to 33 articles that met inclusion criteria. These studies evaluated 17 different insole models and involved 290 participants from 16 to 75 years old. Criterion validity was assessed using six statistical indicators. For posture and activity recognition, accuracy varied from 75.0% to 100%, precision from 65.8% to 100%, specificity from 98.1% to 100%, sensitivity from 73.0% to 100%, and identification rate from 66.2% to 100%. For step counting, accuracies were very high (94.8% to 100%). Across studies, different postures and activities were assessed using different criterion validity indicators, leading to heterogeneous results. Instrumented insoles appeared to be highly accurate for steps counting. However, measurement properties were variable for posture and activity recognition. These findings call for a standardized methodology to investigate the measurement properties of such devices.
Collapse
Affiliation(s)
- Armelle M Ngueleu
- Centre for Interdisciplinary Research in Rehabilitation and Social Integration (CIRRIS), Centre intégré universitaire de santé et de services sociaux de la Capitale-Nationale (CIUSSS-CN), Quebec City, QC G1M2S8, Canada.
| | - Andréanne K Blanchette
- Centre for Interdisciplinary Research in Rehabilitation and Social Integration (CIRRIS), Centre intégré universitaire de santé et de services sociaux de la Capitale-Nationale (CIUSSS-CN), Quebec City, QC G1M2S8, Canada.
- Department of Rehabilitation, Faculty of Medicine, Université Laval, Quebec City, QC G1M2S8, Canada.
| | - Désirée Maltais
- Centre for Interdisciplinary Research in Rehabilitation and Social Integration (CIRRIS), Centre intégré universitaire de santé et de services sociaux de la Capitale-Nationale (CIUSSS-CN), Quebec City, QC G1M2S8, Canada.
- Department of Rehabilitation, Faculty of Medicine, Université Laval, Quebec City, QC G1M2S8, Canada.
| | - Hélène Moffet
- Centre for Interdisciplinary Research in Rehabilitation and Social Integration (CIRRIS), Centre intégré universitaire de santé et de services sociaux de la Capitale-Nationale (CIUSSS-CN), Quebec City, QC G1M2S8, Canada.
- Department of Rehabilitation, Faculty of Medicine, Université Laval, Quebec City, QC G1M2S8, Canada.
| | - Bradford J McFadyen
- Centre for Interdisciplinary Research in Rehabilitation and Social Integration (CIRRIS), Centre intégré universitaire de santé et de services sociaux de la Capitale-Nationale (CIUSSS-CN), Quebec City, QC G1M2S8, Canada.
- Department of Rehabilitation, Faculty of Medicine, Université Laval, Quebec City, QC G1M2S8, Canada.
| | - Laurent Bouyer
- Centre for Interdisciplinary Research in Rehabilitation and Social Integration (CIRRIS), Centre intégré universitaire de santé et de services sociaux de la Capitale-Nationale (CIUSSS-CN), Quebec City, QC G1M2S8, Canada.
- Department of Rehabilitation, Faculty of Medicine, Université Laval, Quebec City, QC G1M2S8, Canada.
| | - Charles S Batcho
- Centre for Interdisciplinary Research in Rehabilitation and Social Integration (CIRRIS), Centre intégré universitaire de santé et de services sociaux de la Capitale-Nationale (CIUSSS-CN), Quebec City, QC G1M2S8, Canada.
- Department of Rehabilitation, Faculty of Medicine, Université Laval, Quebec City, QC G1M2S8, Canada.
| |
Collapse
|
18
|
Garnotel M, Bastian T, Romero-Ugalde HM, Maire A, Dugas J, Zahariev A, Doron M, Jallon P, Charpentier G, Franc S, Blanc S, Bonnet S, Simon C. Prior automatic posture and activity identification improves physical activity energy expenditure prediction from hip-worn triaxial accelerometry. J Appl Physiol (1985) 2018; 124:780-790. [DOI: 10.1152/japplphysiol.00556.2017] [Citation(s) in RCA: 10] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/22/2022] Open
Abstract
Accelerometry is increasingly used to quantify physical activity (PA) and related energy expenditure (EE). Linear regression models designed to derive PAEE from accelerometry-counts have shown their limits, mostly due to the lack of consideration of the nature of activities performed. Here we tested whether a model coupling an automatic activity/posture recognition (AAR) algorithm with an activity-specific count-based model, developed in 61 subjects in laboratory conditions, improved PAEE and total EE (TEE) predictions from a hip-worn triaxial-accelerometer (ActigraphGT3X+) in free-living conditions. Data from two independent subject groups of varying body mass index and age were considered: 20 subjects engaged in a 3-h urban-circuit, with activity-by-activity reference PAEE from combined heart-rate and accelerometry monitoring (Actiheart); and 56 subjects involved in a 14-day trial, with PAEE and TEE measured using the doubly-labeled water method. PAEE was estimated from accelerometry using the activity-specific model coupled to the AAR algorithm (AAR model), a simple linear model (SLM), and equations provided by the companion-software of used activity-devices (Freedson and Actiheart models). AAR-model predictions were in closer agreement with selected references than those from other count-based models, both for PAEE during the urban-circuit (RMSE = 6.19 vs 7.90 for SLM and 9.62 kJ/min for Freedson) and for EE over the 14-day trial, reaching Actiheart performances in the latter (PAEE: RMSE = 0.93 vs. 1.53 for SLM, 1.43 for Freedson, 0.91 MJ/day for Actiheart; TEE: RMSE = 1.05 vs. 1.57 for SLM, 1.70 for Freedson, 0.95 MJ/day for Actiheart). Overall, the AAR model resulted in a 43% increase of daily PAEE variance explained by accelerometry predictions.NEW & NOTEWORTHY Although triaxial accelerometry is widely used in free-living conditions to assess the impact of physical activity energy expenditure (PAEE) on health, its precision and accuracy are often debated. Here we developed and validated an activity-specific model which, coupled with an automatic activity-recognition algorithm, improved the variance explained by the predictions from accelerometry counts by 43% of daily PAEE compared with models relying on a simple relationship between accelerometry counts and EE.
Collapse
Affiliation(s)
- M. Garnotel
- CARMEN, INSERM U1060/University of Lyon/INRA U1235, Lyon, France
- Human Nutrition Research Centre of Rhône-Alpes, Hospices Civils de Lyon, Lyon, France
| | - T. Bastian
- CARMEN, INSERM U1060/University of Lyon/INRA U1235, Lyon, France
- Human Nutrition Research Centre of Rhône-Alpes, Hospices Civils de Lyon, Lyon, France
| | | | - A. Maire
- CARMEN, INSERM U1060/University of Lyon/INRA U1235, Lyon, France
- Human Nutrition Research Centre of Rhône-Alpes, Hospices Civils de Lyon, Lyon, France
| | - J. Dugas
- CARMEN, INSERM U1060/University of Lyon/INRA U1235, Lyon, France
- Human Nutrition Research Centre of Rhône-Alpes, Hospices Civils de Lyon, Lyon, France
| | - A. Zahariev
- Institut Pluridisciplinaire Hubert Curien, University of Strasbourg, CNRS UMR 7178, Strasbourg, France
| | - M. Doron
- CEA LETI MINATEC, University of Grenoble Alpes, Grenoble, France
| | - P. Jallon
- CEA LETI MINATEC, University of Grenoble Alpes, Grenoble, France
| | - G. Charpentier
- CERITD-BIOPARC GENOPOLE Evry, Centre Hospitalier Sud-Francilien, Corbeil-Essonnes, France
| | - S. Franc
- CERITD-BIOPARC GENOPOLE Evry, Centre Hospitalier Sud-Francilien, Corbeil-Essonnes, France
| | - S. Blanc
- Institut Pluridisciplinaire Hubert Curien, University of Strasbourg, CNRS UMR 7178, Strasbourg, France
| | - S. Bonnet
- CEA LETI MINATEC, University of Grenoble Alpes, Grenoble, France
| | - C. Simon
- CARMEN, INSERM U1060/University of Lyon/INRA U1235, Lyon, France
- Human Nutrition Research Centre of Rhône-Alpes, Hospices Civils de Lyon, Lyon, France
| |
Collapse
|
19
|
Hegde N, Zhang T, Uswatte G, Taub E, Barman J, McKay S, Taylor A, Morris DM, Griffin A, Sazonov ES. The Pediatric SmartShoe: Wearable Sensor System for Ambulatory Monitoring of Physical Activity and Gait. IEEE Trans Neural Syst Rehabil Eng 2018; 26:477-486. [DOI: 10.1109/tnsre.2017.2786269] [Citation(s) in RCA: 32] [Impact Index Per Article: 4.6] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/09/2022]
|
20
|
An Event-Triggered Machine Learning Approach for Accelerometer-Based Fall Detection. SENSORS 2017; 18:s18010020. [PMID: 29271895 PMCID: PMC5795925 DOI: 10.3390/s18010020] [Citation(s) in RCA: 42] [Impact Index Per Article: 5.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 11/13/2017] [Revised: 12/15/2017] [Accepted: 12/18/2017] [Indexed: 11/17/2022]
Abstract
The fixed-size non-overlapping sliding window (FNSW) and fixed-size overlapping sliding window (FOSW) approaches are the most commonly used data-segmentation techniques in machine learning-based fall detection using accelerometer sensors. However, these techniques do not segment by fall stages (pre-impact, impact, and post-impact) and thus useful information is lost, which may reduce the detection rate of the classifier. Aligning the segment with the fall stage is difficult, as the segment size varies. We propose an event-triggered machine learning (EvenT-ML) approach that aligns each fall stage so that the characteristic features of the fall stages are more easily recognized. To evaluate our approach, two publicly accessible datasets were used. Classification and regression tree (CART), k-nearest neighbor (k-NN), logistic regression (LR), and the support vector machine (SVM) were used to train the classifiers. EvenT-ML gives classifier F-scores of 98% for a chest-worn sensor and 92% for a waist-worn sensor, and significantly reduces the computational cost compared with the FNSW- and FOSW-based approaches, with reductions of up to 8-fold and 78-fold, respectively. EvenT-ML achieves a significantly better F-score than existing fall detection approaches. These results indicate that aligning feature segments with fall stages significantly increases the detection rate and reduces the computational cost.
Collapse
|
21
|
Hegde N, Bries M, Swibas T, Melanson E, Sazonov E, Hegde N, Bries M, Swibas T, Melanson E, Sazonov E. Automatic Recognition of Activities of Daily Living Utilizing Insole-Based and Wrist-Worn Wearable Sensors. IEEE J Biomed Health Inform 2017; 22:979-988. [PMID: 28783651 DOI: 10.1109/jbhi.2017.2734803] [Citation(s) in RCA: 59] [Impact Index Per Article: 7.4] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/09/2022]
Abstract
Automatic recognition of activities of daily living (ADL) is an important component in understanding of energy balance, quality of life, and other areas of health and well-being. In our previous work, we had proposed an insole-based activity monitor-SmartStep, designed to be socially acceptable and comfortable. The goals of the current study were: first, validation of SmartStep in recognition of a broad set of ADL; second, comparison of the SmartStep to a wrist sensor and testing these in combination; third, evaluation of SmartStep's accuracy in measuring wear noncompliance and a novel activity class (driving); fourth, performing the validation in free living against a well-studied criterion measure (ActivPAL, PAL Technologies); and fifth, quantitative evaluation of the perceived comfort of SmartStep. The activity classification models were developed from a laboratory study consisting of 13 different activities under controlled conditions. Leave-one-out cross validation showed 89% accuracy for the combined SmartStep and wrist sensor, 81% for the SmartStep alone, and 69% for the wrist sensor alone. When household activities were grouped together as one class, SmartStep performed equally well compared to the combination of SmartStep and wrist-worn sensor (90% versus 94%), whereas the accuracy of the wrist sensor increased marginally (73% from 69%). SmartStep achieved 92% accuracy in recognition of nonwear and 82% in recognition of driving. Participants then were studied for a day under free-living conditions. The overall agreement with ActivPAL was 82.5% (compared to 97% for the laboratory study). The SmartStep scored the best on the perceived comfort reported at the end of the study. These results suggest that insole-based activity sensors may present a compelling alternative or companion to commonly used wrist devices.
Collapse
|
22
|
Hegde N, Bries M, Melanson E, Sazonov E. One size fits all electronics for insole-based activity monitoring. ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. ANNUAL INTERNATIONAL CONFERENCE 2017; 2017:3564-3567. [PMID: 29060668 DOI: 10.1109/embc.2017.8037627] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/07/2023]
Abstract
Footwear based wearable sensors are becoming prominent in many areas of monitoring health and wellness, such as gait and activity monitoring. In our previous research we introduced an insole based wearable system SmartStep, which is completely integrated in a socially acceptable package. From a manufacturing perspective, SmartStep's electronics had to be custom made for each shoe size, greatly complicating the manufacturing process. In this work we explore the possibility of making a universal electronics platform for SmartStep - SmartStep 3.0, which can be used in the most common insole sizes without modifications. A pilot human subject experiments were run to compare the accuracy between the one-size fits all (SmartStep 3.0) and custom size SmartStep 2.0. A total of ~10 hours of data was collected in the pilot study involving three participants performing different activities of daily living while wearing SmartStep 2.0 and SmartStep 3.0. Leave one out cross validation resulted in a 98.5% average accuracy from SmartStep 2.0, while SmartStep 3.0 resulted in 98.3% accuracy, suggesting that the SmartStep 3.0 can be as accurate as SmartStep 2.0, while fitting most common shoe sizes.
Collapse
|
23
|
Hegde N, Melanson E, Sazonov E. Development of a real time activity monitoring Android application utilizing SmartStep. ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. ANNUAL INTERNATIONAL CONFERENCE 2017; 2016:1886-1889. [PMID: 28268695 DOI: 10.1109/embc.2016.7591089] [Citation(s) in RCA: 11] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
Abstract
Footwear based activity monitoring systems are becoming popular in academic research as well as consumer industry segments. In our previous work, we had presented developmental aspects of an insole based activity and gait monitoring system-SmartStep, which is a socially acceptable, fully wireless and versatile insole. The present work describes the development of an Android application that captures the SmartStep data wirelessly over Bluetooth Low energy (BLE), computes features on the received data, runs activity classification algorithms and provides real time feedback. The development of activity classification methods was based on the the data from a human study involving 4 participants. Participants were asked to perform activities of sitting, standing, walking, and cycling while they wore SmartStep insole system. Multinomial Logistic Discrimination (MLD) was utilized in the development of machine learning model for activity prediction. The resulting classification model was implemented in an Android Smartphone. The Android application was benchmarked for power consumption and CPU loading. Leave one out cross validation resulted in average accuracy of 96.9% during model training phase. The Android application for real time activity classification was tested on a human subject wearing SmartStep resulting in testing accuracy of 95.4%.
Collapse
|
24
|
Caron N, Peyrot N, Caderby T, Verkindt C, Dalleau G. Energy Expenditure in People with Diabetes Mellitus: A Review. Front Nutr 2016; 3:56. [PMID: 28066773 PMCID: PMC5177618 DOI: 10.3389/fnut.2016.00056] [Citation(s) in RCA: 31] [Impact Index Per Article: 3.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/15/2016] [Accepted: 12/08/2016] [Indexed: 12/22/2022] Open
Abstract
Physical activity (PA) is an important non-therapeutic tool in primary prevention and treatment of diabetes mellitus (DM). To improve activity-based health management, patients need to quantify activity-related energy expenditure and the other components of total daily energy expenditure. This review explores differences between the components of total energy expenditure in patients with DM and healthy people and presents various tools for assessing the energy expenditure in subjects with DM. From this review, it appears that patients with uncontrolled DM have a higher basal energy expenditure (BEE) than healthy people which must be considered in the establishment of new BEE estimate equations. Moreover, studies showed a lower activity energy expenditure in patients with DM than in healthy ones. This difference may be partially explained by patient with DMs poor compliance with exercise recommendations and their greater participation in lower intensity activities. These specificities of PA need to be taken into account in the development of adapted tools to assess activity energy expenditure and daily energy expenditure in people with DM. Few estimation tools are tested in subjects with DM and this results in a lack of accuracy especially for their particular patterns of activity. Thus, future studies should examine sensors coupling different technologies or method that is specifically designed to accurately assess energy expenditure in patients with diabetes in daily life.
Collapse
Affiliation(s)
- Nathan Caron
- Laboratoire IRISSE, UFR des Sciences de l’Homme et de l’Environnement, Université de la Réunion, Le Tampon, La Réunion, France
| | - Nicolas Peyrot
- Laboratoire IRISSE, UFR des Sciences de l’Homme et de l’Environnement, Université de la Réunion, Le Tampon, La Réunion, France
| | - Teddy Caderby
- Laboratoire IRISSE, UFR des Sciences de l’Homme et de l’Environnement, Université de la Réunion, Le Tampon, La Réunion, France
| | - Chantal Verkindt
- Laboratoire IRISSE, UFR des Sciences de l’Homme et de l’Environnement, Université de la Réunion, Le Tampon, La Réunion, France
| | - Georges Dalleau
- Laboratoire IRISSE, UFR des Sciences de l’Homme et de l’Environnement, Université de la Réunion, Le Tampon, La Réunion, France
| |
Collapse
|
25
|
|