1
|
Richer R, Koch V, Abel L, Hauck F, Kurz M, Ringgold V, Müller V, Küderle A, Schindler-Gmelch L, Eskofier BM, Rohleder N. Machine learning-based detection of acute psychosocial stress from body posture and movements. Sci Rep 2024; 14:8251. [PMID: 38589504 DOI: 10.1038/s41598-024-59043-1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/11/2023] [Accepted: 04/05/2024] [Indexed: 04/10/2024] Open
Abstract
Investigating acute stress responses is crucial to understanding the underlying mechanisms of stress. Current stress assessment methods include self-reports that can be biased and biomarkers that are often based on complex laboratory procedures. A promising additional modality for stress assessment might be the observation of body movements, which are affected by negative emotions and threatening situations. In this paper, we investigated the relationship between acute psychosocial stress induction and body posture and movements. We collected motion data from N = 59 individuals over two studies (Pilot Study: N = 20, Main Study: N = 39) using inertial measurement unit (IMU)-based motion capture suits. In both studies, individuals underwent the Trier Social Stress Test (TSST) and a stress-free control condition (friendly-TSST; f-TSST) in randomized order. Our results show that acute stress induction leads to a reproducible freezing behavior, characterized by less overall motion as well as more and longer periods of no movement. Based on these data, we trained machine learning pipelines to detect acute stress solely from movement information, achieving an accuracy of75.0 ± 17.7 % (Pilot Study) and73.4 ± 7.7 % (Main Study). This, for the first time, suggests that body posture and movements can be used to detect whether individuals are exposed to acute psychosocial stress. While more studies are needed to further validate our approach, we are convinced that motion information can be a valuable extension to the existing biomarkers and can help to obtain a more holistic picture of the human stress response. Our work is the first to systematically explore the use of full-body body posture and movement to gain novel insights into the human stress response and its effects on the body and mind.
Collapse
Affiliation(s)
- Robert Richer
- Machine Learning and Data Analytics Lab (MaD Lab), Department Artificial Intelligence in Biomedical Engineering (AIBE), Friedrich-Alexander-Universität Erlangen-Nürnberg (FAU), 91052, Erlangen, Germany.
| | - Veronika Koch
- Fraunhofer Institute for Integrated Circuits IIS, 91058, Erlangen, Germany
| | - Luca Abel
- Machine Learning and Data Analytics Lab (MaD Lab), Department Artificial Intelligence in Biomedical Engineering (AIBE), Friedrich-Alexander-Universität Erlangen-Nürnberg (FAU), 91052, Erlangen, Germany
| | - Felicitas Hauck
- Chair of Health Psychology, Friedrich-Alexander-Universität Erlangen-Nürnberg (FAU), 91052, Erlangen, Germany
| | - Miriam Kurz
- Chair of Health Psychology, Friedrich-Alexander-Universität Erlangen-Nürnberg (FAU), 91052, Erlangen, Germany
| | - Veronika Ringgold
- Machine Learning and Data Analytics Lab (MaD Lab), Department Artificial Intelligence in Biomedical Engineering (AIBE), Friedrich-Alexander-Universität Erlangen-Nürnberg (FAU), 91052, Erlangen, Germany
- Chair of Health Psychology, Friedrich-Alexander-Universität Erlangen-Nürnberg (FAU), 91052, Erlangen, Germany
| | - Victoria Müller
- Machine Learning and Data Analytics Lab (MaD Lab), Department Artificial Intelligence in Biomedical Engineering (AIBE), Friedrich-Alexander-Universität Erlangen-Nürnberg (FAU), 91052, Erlangen, Germany
| | - Arne Küderle
- Machine Learning and Data Analytics Lab (MaD Lab), Department Artificial Intelligence in Biomedical Engineering (AIBE), Friedrich-Alexander-Universität Erlangen-Nürnberg (FAU), 91052, Erlangen, Germany
| | - Lena Schindler-Gmelch
- Chair of Clinical Psychology and Psychotherapy, Friedrich-Alexander-Universität Erlangen-Nürnberg (FAU), 91052, Erlangen, Germany
| | - Bjoern M Eskofier
- Machine Learning and Data Analytics Lab (MaD Lab), Department Artificial Intelligence in Biomedical Engineering (AIBE), Friedrich-Alexander-Universität Erlangen-Nürnberg (FAU), 91052, Erlangen, Germany
- Translational Digital Health Group, Institute of AI for Health, Helmholtz Zentrum München - German Research Center for Environmental Health, 85764, Neuherberg, Germany
| | - Nicolas Rohleder
- Chair of Health Psychology, Friedrich-Alexander-Universität Erlangen-Nürnberg (FAU), 91052, Erlangen, Germany
| |
Collapse
|
2
|
Küderle A, Ullrich M, Roth N, Ollenschläger M, Ibrahim AA, Moradi H, Richer R, Seifer AK, Zürl M, Sîmpetru RC, Herzer L, Prossel D, Kluge F, Eskofier BM. Gaitmap-An Open Ecosystem for IMU-Based Human Gait Analysis and Algorithm Benchmarking. IEEE Open J Eng Med Biol 2024; 5:163-172. [PMID: 38487091 PMCID: PMC10939318 DOI: 10.1109/ojemb.2024.3356791] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/04/2023] [Revised: 11/15/2023] [Accepted: 01/17/2024] [Indexed: 03/17/2024] Open
Abstract
Goal: Gait analysis using inertial measurement units (IMUs) has emerged as a promising method for monitoring movement disorders. However, the lack of public data and easy-to-use open-source algorithms hinders method comparison and clinical application development. To address these challenges, this publication introduces the gaitmap ecosystem, a comprehensive set of open source Python packages for gait analysis using foot-worn IMUs. Methods: This initial release includes over 20 state-of-the-art algorithms, enables easy access to seven datasets, and provides eight benchmark challenges with reference implementations. Together with its extensive documentation and tooling, it enables rapid development and validation of new algorithm and provides a foundation for novel clinical applications. Conclusion: The published software projects represent a pioneering effort to establish an open-source ecosystem for IMU-based gait analysis. We believe that this work can democratize the access to high-quality algorithm and serve as a driver for open and reproducible research in the field of human gait analysis and beyond.
Collapse
Affiliation(s)
- Arne Küderle
- Machine Learning and Data Analytics LabFriedrich-Alexander Universität Erlangen-Nürnberg (FAU)91054ErlangenGermany
| | - Martin Ullrich
- Machine Learning and Data Analytics LabFriedrich-Alexander Universität Erlangen-Nürnberg (FAU)91054ErlangenGermany
| | - Nils Roth
- Machine Learning and Data Analytics LabFriedrich-Alexander Universität Erlangen-Nürnberg (FAU)91054ErlangenGermany
| | - Malte Ollenschläger
- Machine Learning and Data Analytics LabFriedrich-Alexander Universität Erlangen-Nürnberg (FAU)91054ErlangenGermany
| | - Alzhraa A. Ibrahim
- Machine Learning and Data Analytics LabFriedrich-Alexander Universität Erlangen-Nürnberg (FAU)91054ErlangenGermany
- Department of Molecular NeurologyFAU Erlangen91054ErlangenGermany
- Computer Science Department, Faculty of Computers and InformationAssiut UniversityAssiut Governorate71515Egypt
| | - Hamid Moradi
- Machine Learning and Data Analytics LabFriedrich-Alexander Universität Erlangen-Nürnberg (FAU)91054ErlangenGermany
| | - Robert Richer
- Machine Learning and Data Analytics LabFriedrich-Alexander Universität Erlangen-Nürnberg (FAU)91054ErlangenGermany
| | - Ann-Kristin Seifer
- Machine Learning and Data Analytics LabFriedrich-Alexander Universität Erlangen-Nürnberg (FAU)91054ErlangenGermany
| | - Matthias Zürl
- Machine Learning and Data Analytics LabFriedrich-Alexander Universität Erlangen-Nürnberg (FAU)91054ErlangenGermany
| | - Raul C. Sîmpetru
- Machine Learning and Data Analytics LabFriedrich-Alexander Universität Erlangen-Nürnberg (FAU)91054ErlangenGermany
| | - Liv Herzer
- Machine Learning and Data Analytics LabFriedrich-Alexander Universität Erlangen-Nürnberg (FAU)91054ErlangenGermany
| | - Dominik Prossel
- Machine Learning and Data Analytics LabFriedrich-Alexander Universität Erlangen-Nürnberg (FAU)91054ErlangenGermany
| | - Felix Kluge
- Machine Learning and Data Analytics LabFriedrich-Alexander Universität Erlangen-Nürnberg (FAU)91054ErlangenGermany
| | - Bjoern M. Eskofier
- Machine Learning and Data Analytics LabFriedrich-Alexander Universität Erlangen-Nürnberg (FAU)91054ErlangenGermany
| |
Collapse
|
3
|
Kirk C, Küderle A, Micó-Amigo ME, Bonci T, Paraschiv-Ionescu A, Ullrich M, Soltani A, Gazit E, Salis F, Alcock L, Aminian K, Becker C, Bertuletti S, Brown P, Buckley E, Cantu A, Carsin AE, Caruso M, Caulfield B, Cereatti A, Chiari L, D'Ascanio I, Garcia-Aymerich J, Hansen C, Hausdorff JM, Hiden H, Hume E, Keogh A, Kluge F, Koch S, Maetzler W, Megaritis D, Mueller A, Niessen M, Palmerini L, Schwickert L, Scott K, Sharrack B, Sillén H, Singleton D, Vereijken B, Vogiatzis I, Yarnall AJ, Rochester L, Mazzà C, Eskofier BM, Del Din S. Mobilise-D insights to estimate real-world walking speed in multiple conditions with a wearable device. Sci Rep 2024; 14:1754. [PMID: 38243008 PMCID: PMC10799009 DOI: 10.1038/s41598-024-51766-5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/22/2023] [Accepted: 01/09/2024] [Indexed: 01/21/2024] Open
Abstract
This study aimed to validate a wearable device's walking speed estimation pipeline, considering complexity, speed, and walking bout duration. The goal was to provide recommendations on the use of wearable devices for real-world mobility analysis. Participants with Parkinson's Disease, Multiple Sclerosis, Proximal Femoral Fracture, Chronic Obstructive Pulmonary Disease, Congestive Heart Failure, and healthy older adults (n = 97) were monitored in the laboratory and the real-world (2.5 h), using a lower back wearable device. Two walking speed estimation pipelines were validated across 4408/1298 (2.5 h/laboratory) detected walking bouts, compared to 4620/1365 bouts detected by a multi-sensor reference system. In the laboratory, the mean absolute error (MAE) and mean relative error (MRE) for walking speed estimation ranged from 0.06 to 0.12 m/s and - 2.1 to 14.4%, with ICCs (Intraclass correlation coefficients) between good (0.79) and excellent (0.91). Real-world MAE ranged from 0.09 to 0.13, MARE from 1.3 to 22.7%, with ICCs indicating moderate (0.57) to good (0.88) agreement. Lower errors were observed for cohorts without major gait impairments, less complex tasks, and longer walking bouts. The analytical pipelines demonstrated moderate to good accuracy in estimating walking speed. Accuracy depended on confounding factors, emphasizing the need for robust technical validation before clinical application.Trial registration: ISRCTN - 12246987.
Collapse
Affiliation(s)
- Cameron Kirk
- Translational and Clinical Research Institute, Faculty of Medical Sciences, Newcastle University, The Catalyst 3 Science Square, Room 3.27, Newcastle Upon Tyne, NE4 5TG, UK
| | - Arne Küderle
- Machine Learning and Data Analytics Lab, Department Artificial Intelligence in Biomedical Engineering, Friedrich-Alexander-Universität Erlangen-Nürnberg, Erlangen, Germany
| | - M Encarna Micó-Amigo
- Translational and Clinical Research Institute, Faculty of Medical Sciences, Newcastle University, The Catalyst 3 Science Square, Room 3.27, Newcastle Upon Tyne, NE4 5TG, UK
| | - Tecla Bonci
- Department of Mechanical Engineering and Insigneo Institute for in Silico Medicine, The University of Sheffield, Sheffield, UK
| | - Anisoara Paraschiv-Ionescu
- Laboratory of Movement Analysis and Measurement, Ecole Polytechnique Federale de Lausanne, Lausanne, Switzerland
| | - Martin Ullrich
- Machine Learning and Data Analytics Lab, Department Artificial Intelligence in Biomedical Engineering, Friedrich-Alexander-Universität Erlangen-Nürnberg, Erlangen, Germany
| | - Abolfazl Soltani
- Laboratory of Movement Analysis and Measurement, Ecole Polytechnique Federale de Lausanne, Lausanne, Switzerland
| | - Eran Gazit
- Center for the Study of Movement, Cognition and Mobility, Neurological Institute, Tel Aviv Sourasky Medical Center, Tel Aviv, Israel
| | - Francesca Salis
- Department of Biomedical Sciences, University of Sassari, Sassari, Italy
| | - Lisa Alcock
- Translational and Clinical Research Institute, Faculty of Medical Sciences, Newcastle University, The Catalyst 3 Science Square, Room 3.27, Newcastle Upon Tyne, NE4 5TG, UK
- National Institute for Health and Care Research (NIHR) Newcastle Biomedical Research Centre (BRC), Newcastle University and the Newcastle Upon Tyne Hospitals NHS Foundation Trust, Newcastle Upon Tyne, UK
| | - Kamiar Aminian
- Laboratory of Movement Analysis and Measurement, Ecole Polytechnique Federale de Lausanne, Lausanne, Switzerland
| | - Clemens Becker
- Robert Bosch Gesellschaft für Medizinische Forschung, Stuttgart, Germany
| | - Stefano Bertuletti
- Department of Biomedical Sciences, University of Sassari, Sassari, Italy
| | - Philip Brown
- The Newcastle Upon Tyne Hospitals NHS Foundation Trust, Newcastle Upon Tyne, UK
| | - Ellen Buckley
- Department of Mechanical Engineering and Insigneo Institute for in Silico Medicine, The University of Sheffield, Sheffield, UK
| | - Alma Cantu
- School of Computing, Newcastle University, Newcastle Upon Tyne, UK
| | - Anne-Elie Carsin
- Barcelona Institute for Global Health (ISGlobal), Barcelona, Spain
- Universitat Pompeu Fabra, Barcelona, Catalonia, Spain
- CIBER Epidemiología y Salud Pública (CIBERESP), Madrid, Spain
| | - Marco Caruso
- Department of Electronics and Telecommunications, Politecnico di Torino, Turin, Italy
| | - Brian Caulfield
- Insight Centre for Data Analytics, University College Dublin, Dublin, Ireland
- School of Public Health, Physiotherapy and Sports Science, University College Dublin, Dublin, Ireland
| | - Andrea Cereatti
- Department of Electronics and Telecommunications, Politecnico di Torino, Turin, Italy
| | - Lorenzo Chiari
- Department of Electrical, Electronic and Information Engineering «Guglielmo Marconi», University of Bologna, Bologna, Italy
- Health Sciences and Technologies-Interdepartmental Center for Industrial Research (CIRI-SDV), University of Bologna, Bologna, Italy
| | - Ilaria D'Ascanio
- Department of Electrical, Electronic and Information Engineering «Guglielmo Marconi», University of Bologna, Bologna, Italy
| | - Judith Garcia-Aymerich
- Barcelona Institute for Global Health (ISGlobal), Barcelona, Spain
- Universitat Pompeu Fabra, Barcelona, Catalonia, Spain
- CIBER Epidemiología y Salud Pública (CIBERESP), Madrid, Spain
| | - Clint Hansen
- Department of Neurology, University Medical Center Schleswig-Holstein Campus Kiel, Kiel, Germany
| | - Jeffrey M Hausdorff
- Center for the Study of Movement, Cognition and Mobility, Neurological Institute, Tel Aviv Sourasky Medical Center, Tel Aviv, Israel
- Department of Physical Therapy, Sagol School of Neuroscience, Sackler Faculty of Medicine, Tel Aviv University, Tel Aviv, Israel
- Rush Alzheimer's Disease Center and Department of Orthopaedic Surgery, Rush University Medical Center, Chicago, IL, USA
| | - Hugo Hiden
- The Newcastle Upon Tyne Hospitals NHS Foundation Trust, Newcastle Upon Tyne, UK
| | - Emily Hume
- Department of Sport, Exercise and Rehabilitation, Northumbria University Newcastle, Newcastle Upon Tyne, UK
| | - Alison Keogh
- Insight Centre for Data Analytics, University College Dublin, Dublin, Ireland
- School of Public Health, Physiotherapy and Sports Science, University College Dublin, Dublin, Ireland
| | - Felix Kluge
- Machine Learning and Data Analytics Lab, Department Artificial Intelligence in Biomedical Engineering, Friedrich-Alexander-Universität Erlangen-Nürnberg, Erlangen, Germany
- Novartis Institutes of Biomedical Research, Novartis Pharma AG, Basel, Switzerland
| | - Sarah Koch
- Barcelona Institute for Global Health (ISGlobal), Barcelona, Spain
- Universitat Pompeu Fabra, Barcelona, Catalonia, Spain
- CIBER Epidemiología y Salud Pública (CIBERESP), Madrid, Spain
| | - Walter Maetzler
- Department of Neurology, University Medical Center Schleswig-Holstein Campus Kiel, Kiel, Germany
| | - Dimitrios Megaritis
- Department of Sport, Exercise and Rehabilitation, Northumbria University Newcastle, Newcastle Upon Tyne, UK
| | - Arne Mueller
- Novartis Institutes of Biomedical Research, Novartis Pharma AG, Basel, Switzerland
| | | | - Luca Palmerini
- Department of Electrical, Electronic and Information Engineering «Guglielmo Marconi», University of Bologna, Bologna, Italy
- Health Sciences and Technologies-Interdepartmental Center for Industrial Research (CIRI-SDV), University of Bologna, Bologna, Italy
| | - Lars Schwickert
- Robert Bosch Gesellschaft für Medizinische Forschung, Stuttgart, Germany
| | - Kirsty Scott
- Department of Mechanical Engineering and Insigneo Institute for in Silico Medicine, The University of Sheffield, Sheffield, UK
| | - Basil Sharrack
- Department of Neuroscience and Sheffield NIHR Translational Neuroscience BRC, Sheffield Teaching Hospitals NHS Foundation Trust, Sheffield, UK
| | | | - David Singleton
- Insight Centre for Data Analytics, University College Dublin, Dublin, Ireland
- School of Public Health, Physiotherapy and Sports Science, University College Dublin, Dublin, Ireland
| | - Beatrix Vereijken
- Department of Neuromedicine and Movement Science, Norwegian University of Science and Technology, Trondheim, Norway
| | - Ioannis Vogiatzis
- Department of Sport, Exercise and Rehabilitation, Northumbria University Newcastle, Newcastle Upon Tyne, UK
| | - Alison J Yarnall
- Translational and Clinical Research Institute, Faculty of Medical Sciences, Newcastle University, The Catalyst 3 Science Square, Room 3.27, Newcastle Upon Tyne, NE4 5TG, UK
- National Institute for Health and Care Research (NIHR) Newcastle Biomedical Research Centre (BRC), Newcastle University and the Newcastle Upon Tyne Hospitals NHS Foundation Trust, Newcastle Upon Tyne, UK
- The Newcastle Upon Tyne Hospitals NHS Foundation Trust, Newcastle Upon Tyne, UK
| | - Lynn Rochester
- Translational and Clinical Research Institute, Faculty of Medical Sciences, Newcastle University, The Catalyst 3 Science Square, Room 3.27, Newcastle Upon Tyne, NE4 5TG, UK
- National Institute for Health and Care Research (NIHR) Newcastle Biomedical Research Centre (BRC), Newcastle University and the Newcastle Upon Tyne Hospitals NHS Foundation Trust, Newcastle Upon Tyne, UK
- The Newcastle Upon Tyne Hospitals NHS Foundation Trust, Newcastle Upon Tyne, UK
| | - Claudia Mazzà
- Department of Mechanical Engineering and Insigneo Institute for in Silico Medicine, The University of Sheffield, Sheffield, UK
| | - Bjoern M Eskofier
- Machine Learning and Data Analytics Lab, Department Artificial Intelligence in Biomedical Engineering, Friedrich-Alexander-Universität Erlangen-Nürnberg, Erlangen, Germany
| | - Silvia Del Din
- Translational and Clinical Research Institute, Faculty of Medical Sciences, Newcastle University, The Catalyst 3 Science Square, Room 3.27, Newcastle Upon Tyne, NE4 5TG, UK.
- National Institute for Health and Care Research (NIHR) Newcastle Biomedical Research Centre (BRC), Newcastle University and the Newcastle Upon Tyne Hospitals NHS Foundation Trust, Newcastle Upon Tyne, UK.
| |
Collapse
|
4
|
Raab R, Küderle A, Zakreuskaya A, Stern AD, Klucken J, Kaissis G, Rueckert D, Boll S, Eils R, Wagener H, Eskofier BM. Federated electronic health records for the European Health Data Space. Lancet Digit Health 2023; 5:e840-e847. [PMID: 37741765 DOI: 10.1016/s2589-7500(23)00156-5] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/15/2022] [Revised: 04/11/2023] [Accepted: 08/02/2023] [Indexed: 09/25/2023]
Abstract
The European Commission's draft for the European Health Data Space (EHDS) aims to empower citizens to access their personal health data and share it with physicians and other health-care providers. It further defines procedures for the secondary use of electronic health data for research and development. Although this planned legislation is undoubtedly a step in the right direction, implementation approaches could potentially result in centralised data silos that pose data privacy and security risks for individuals. To address this concern, we propose federated personal health data spaces, a novel architecture for storing, managing, and sharing personal electronic health records that puts citizens at the centre-both conceptually and technologically. The proposed architecture puts citizens in control by storing personal health data on a combination of personal devices rather than in centralised data silos. We describe how this federated architecture fits within the EHDS and can enable the same features as centralised systems while protecting the privacy of citizens. We further argue that increased privacy and control do not contradict the use of electronic health data for research and development. Instead, data sovereignty and transparency encourage active participation in studies and data sharing. This combination of privacy-by-design and transparent, privacy-preserving data sharing can enable health-care leaders to break the privacy-exploitation barrier, which currently limits the secondary use of health data in many cases.
Collapse
Affiliation(s)
- René Raab
- Machine Learning and Data Analytics Lab, Department of Artificial Intelligence in Biomedical Engineering, Friedrich-Alexander-Universität Erlangen-Nürnberg, Erlangen, Germany
| | - Arne Küderle
- Machine Learning and Data Analytics Lab, Department of Artificial Intelligence in Biomedical Engineering, Friedrich-Alexander-Universität Erlangen-Nürnberg, Erlangen, Germany
| | - Anastasiya Zakreuskaya
- Machine Learning and Data Analytics Lab, Department of Artificial Intelligence in Biomedical Engineering, Friedrich-Alexander-Universität Erlangen-Nürnberg, Erlangen, Germany
| | - Ariel D Stern
- Harvard Business School and Harvard-MIT Center for Regulatory Science, Boston, MA, USA
| | - Jochen Klucken
- Chair of Digital Medicine, Luxembourg Centre for Systems Biomedicine, University of Luxembourg, Esch-sur-Alzette, Luxembourg; Digital Medicine Group, Luxembourg Institute of Health, Strassen, Luxembourg; Centre Hospitalier de Luxembourg, Luxembourg, Luxembourg
| | - Georgios Kaissis
- Klinikum Rechts der Isar, Technical University of Munich, Institute for Artificial Intelligence and Informatics in Medicine, Munich, Germany; Helmholtz Munich, Institute for Machine Learning in Biomedical Imaging, Neuherberg, Germany; Department of Computing, Imperial College London, London, UK
| | - Daniel Rueckert
- Klinikum Rechts der Isar, Technical University of Munich, Institute for Artificial Intelligence and Informatics in Medicine, Munich, Germany; Department of Computing, Imperial College London, London, UK
| | - Susanne Boll
- OFFIS-Institut für Informatik, Oldenburg, Germany
| | - Roland Eils
- Berlin Institute of Health at Charité - Universitätsmedizin Berlin, Digital Health Center, Berlin, Germany
| | - Harald Wagener
- Berlin Institute of Health at Charité - Universitätsmedizin Berlin, Digital Health Center, Berlin, Germany
| | - Bjoern M Eskofier
- Machine Learning and Data Analytics Lab, Department of Artificial Intelligence in Biomedical Engineering, Friedrich-Alexander-Universität Erlangen-Nürnberg, Erlangen, Germany.
| |
Collapse
|
5
|
Romijnders R, Salis F, Hansen C, Küderle A, Paraschiv-Ionescu A, Cereatti A, Alcock L, Aminian K, Becker C, Bertuletti S, Bonci T, Brown P, Buckley E, Cantu A, Carsin AE, Caruso M, Caulfield B, Chiari L, D'Ascanio I, Del Din S, Eskofier B, Fernstad SJ, Fröhlich MS, Garcia Aymerich J, Gazit E, Hausdorff JM, Hiden H, Hume E, Keogh A, Kirk C, Kluge F, Koch S, Mazzà C, Megaritis D, Micó-Amigo E, Müller A, Palmerini L, Rochester L, Schwickert L, Scott K, Sharrack B, Singleton D, Soltani A, Ullrich M, Vereijken B, Vogiatzis I, Yarnall A, Schmidt G, Maetzler W. Ecological validity of a deep learning algorithm to detect gait events from real-life walking bouts in mobility-limiting diseases. Front Neurol 2023; 14:1247532. [PMID: 37909030 PMCID: PMC10615212 DOI: 10.3389/fneur.2023.1247532] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/26/2023] [Accepted: 09/18/2023] [Indexed: 11/02/2023] Open
Abstract
Introduction The clinical assessment of mobility, and walking specifically, is still mainly based on functional tests that lack ecological validity. Thanks to inertial measurement units (IMUs), gait analysis is shifting to unsupervised monitoring in naturalistic and unconstrained settings. However, the extraction of clinically relevant gait parameters from IMU data often depends on heuristics-based algorithms that rely on empirically determined thresholds. These were mainly validated on small cohorts in supervised settings. Methods Here, a deep learning (DL) algorithm was developed and validated for gait event detection in a heterogeneous population of different mobility-limiting disease cohorts and a cohort of healthy adults. Participants wore pressure insoles and IMUs on both feet for 2.5 h in their habitual environment. The raw accelerometer and gyroscope data from both feet were used as input to a deep convolutional neural network, while reference timings for gait events were based on the combined IMU and pressure insoles data. Results and discussion The results showed a high-detection performance for initial contacts (ICs) (recall: 98%, precision: 96%) and final contacts (FCs) (recall: 99%, precision: 94%) and a maximum median time error of -0.02 s for ICs and 0.03 s for FCs. Subsequently derived temporal gait parameters were in good agreement with a pressure insoles-based reference with a maximum mean difference of 0.07, -0.07, and <0.01 s for stance, swing, and stride time, respectively. Thus, the DL algorithm is considered successful in detecting gait events in ecologically valid environments across different mobility-limiting diseases.
Collapse
Affiliation(s)
- Robbin Romijnders
- Digital Signal Processing and System Theory, Electrical and Information Engineering, Faculty of Engineering, Kiel University, Kiel, Germany
- Arbeitsgruppe Neurogeriatrie, Department of Neurology, Universitätsklinikum Schleswig-Holstein, Kiel, Germany
| | - Francesca Salis
- Department of Biomedical Sciences, University of Sassari, Sassari, Italy
| | - Clint Hansen
- Arbeitsgruppe Neurogeriatrie, Department of Neurology, Universitätsklinikum Schleswig-Holstein, Kiel, Germany
| | - Arne Küderle
- Department of Artificial Intelligence in Biomedical Engineering, Friedrich-Alexander-Universität Erlangen-Nürnberg, Erlangen, Germany
| | - Anisoara Paraschiv-Ionescu
- Laboratory of Movement Analysis and Measurement, École Polytechnique Fédérale de Lausanne, Lausanne, Switzerland
| | - Andrea Cereatti
- Department of Electronics and Telecommunications, Polytechnic of Turin, Turin, Italy
| | - Lisa Alcock
- Faculty of Medical Sciences, Newcastle University, Newcastle upon Tyne, United Kingdom
| | - Kamiar Aminian
- Laboratory of Movement Analysis and Measurement, École Polytechnique Fédérale de Lausanne, Lausanne, Switzerland
| | - Clemens Becker
- Gesellschaft für Medizinische Forschung, Robert-Bosch Foundation GmbH, Stuttgart, Germany
| | - Stefano Bertuletti
- Department of Biomedical Sciences, University of Sassari, Sassari, Italy
| | - Tecla Bonci
- INSIGNEO Institute for In Silico Medicine, The University of Sheffield, Sheffield, United Kingdom
- Department of Mechanical Engineering, The University of Sheffield, Sheffield, United Kingdom
| | - Philip Brown
- Newcastle upon Tyne Hospitals NHS Foundation Trust, Newcastle upon Tyne, United Kingdom
| | - Ellen Buckley
- INSIGNEO Institute for In Silico Medicine, The University of Sheffield, Sheffield, United Kingdom
- Department of Mechanical Engineering, The University of Sheffield, Sheffield, United Kingdom
| | - Alma Cantu
- School of Computing, Newcastle University, Newcastle upon Tyne, United Kingdom
| | - Anne-Elie Carsin
- Barcelona Institute for Global Health (ISGlobal), Barcelona, Spain
- Faculty of Health and Life Sciences, Universitat Pompeu Fabra, Barcelona, Spain
- CIBER Epidemiología y Salud Pública, Madrid, Spain
| | - Marco Caruso
- Department of Electronics and Telecommunications, Polytechnic of Turin, Turin, Italy
| | - Brian Caulfield
- Insight Centre for Data Analytics, University College Dublin, Dublin, Ireland
- School of Public Health, Physiotherapy and Sports Science, University College Dublin, Dublin, Ireland
| | - Lorenzo Chiari
- Department of Electrical, Electronic and Information Engineering “Guglielmo Marconi”, University of Bologna, Bologna, Italy
- Health Sciences and Technologies—Interdepartmental Center for Industrial Research (CIRISDV), University of Bologna, Bologna, Italy
| | - Ilaria D'Ascanio
- Department of Electrical, Electronic and Information Engineering “Guglielmo Marconi”, University of Bologna, Bologna, Italy
| | - Silvia Del Din
- Faculty of Medical Sciences, Newcastle University, Newcastle upon Tyne, United Kingdom
- Translational and Clinical Research Institute, Newcastle University, Newcastle upon Tyne, United Kingdom
| | - Björn Eskofier
- Department of Artificial Intelligence in Biomedical Engineering, Friedrich-Alexander-Universität Erlangen-Nürnberg, Erlangen, Germany
| | | | | | - Judith Garcia Aymerich
- Barcelona Institute for Global Health (ISGlobal), Barcelona, Spain
- Faculty of Health and Life Sciences, Universitat Pompeu Fabra, Barcelona, Spain
- CIBER Epidemiología y Salud Pública, Madrid, Spain
| | - Eran Gazit
- Center for the Study of Movement, Cognition and Mobility, Tel Aviv Sourasky Medical Center, Tel Aviv, Israel
| | - Jeffrey M. Hausdorff
- Center for the Study of Movement, Cognition and Mobility, Tel Aviv Sourasky Medical Center, Tel Aviv, Israel
- Department of Physical Therapy, Sackler Faculty of Medicine & Sagol School of Neuroscience, Tel Aviv University, Tel Aviv, Israel
| | - Hugo Hiden
- School of Computing, Newcastle University, Newcastle upon Tyne, United Kingdom
| | - Emily Hume
- Department of Sport, Exercise and Rehabilitation, Northumbria University, Newcastle upon Tyne, United Kingdom
| | - Alison Keogh
- Insight Centre for Data Analytics, University College Dublin, Dublin, Ireland
- School of Public Health, Physiotherapy and Sports Science, University College Dublin, Dublin, Ireland
| | - Cameron Kirk
- Faculty of Medical Sciences, Newcastle University, Newcastle upon Tyne, United Kingdom
| | - Felix Kluge
- Department of Artificial Intelligence in Biomedical Engineering, Friedrich-Alexander-Universität Erlangen-Nürnberg, Erlangen, Germany
- Novartis Institute of Biomedical Research, Novartis Pharma AG, Basel, Switzerland
| | - Sarah Koch
- Barcelona Institute for Global Health (ISGlobal), Barcelona, Spain
- Faculty of Health and Life Sciences, Universitat Pompeu Fabra, Barcelona, Spain
- CIBER Epidemiología y Salud Pública, Madrid, Spain
| | - Claudia Mazzà
- INSIGNEO Institute for In Silico Medicine, The University of Sheffield, Sheffield, United Kingdom
- Department of Mechanical Engineering, The University of Sheffield, Sheffield, United Kingdom
| | - Dimitrios Megaritis
- Department of Sport, Exercise and Rehabilitation, Northumbria University, Newcastle upon Tyne, United Kingdom
| | - Encarna Micó-Amigo
- Faculty of Medical Sciences, Newcastle University, Newcastle upon Tyne, United Kingdom
| | - Arne Müller
- Novartis Institute of Biomedical Research, Novartis Pharma AG, Basel, Switzerland
| | - Luca Palmerini
- Department of Electrical, Electronic and Information Engineering “Guglielmo Marconi”, University of Bologna, Bologna, Italy
- Health Sciences and Technologies—Interdepartmental Center for Industrial Research (CIRISDV), University of Bologna, Bologna, Italy
| | - Lynn Rochester
- Faculty of Medical Sciences, Newcastle University, Newcastle upon Tyne, United Kingdom
- Newcastle upon Tyne Hospitals NHS Foundation Trust, Newcastle upon Tyne, United Kingdom
| | - Lars Schwickert
- Gesellschaft für Medizinische Forschung, Robert-Bosch Foundation GmbH, Stuttgart, Germany
| | - Kirsty Scott
- INSIGNEO Institute for In Silico Medicine, The University of Sheffield, Sheffield, United Kingdom
- Department of Mechanical Engineering, The University of Sheffield, Sheffield, United Kingdom
| | - Basil Sharrack
- Department of Neuroscience and Sheffield NIHR Translational Neuroscience BRC, Sheffield Teaching Hospitals NHS Foundation Trust, Sheffield, United Kingdom
| | - David Singleton
- Insight Centre for Data Analytics, University College Dublin, Dublin, Ireland
- School of Public Health, Physiotherapy and Sports Science, University College Dublin, Dublin, Ireland
| | - Abolfazl Soltani
- Laboratory of Movement Analysis and Measurement, École Polytechnique Fédérale de Lausanne, Lausanne, Switzerland
- Digital Health Department, CSEM SA, Neuchâtel, Switzerland
| | - Martin Ullrich
- Department of Artificial Intelligence in Biomedical Engineering, Friedrich-Alexander-Universität Erlangen-Nürnberg, Erlangen, Germany
| | - Beatrix Vereijken
- Department of Neuromedicine and Movement Science, Norwegian University of Science and Technology, Trondheim, Norway
| | - Ioannis Vogiatzis
- Department of Sport, Exercise and Rehabilitation, Northumbria University, Newcastle upon Tyne, United Kingdom
| | - Alison Yarnall
- Faculty of Medical Sciences, Newcastle University, Newcastle upon Tyne, United Kingdom
- Department of Mechanical Engineering, The University of Sheffield, Sheffield, United Kingdom
| | - Gerhard Schmidt
- Digital Signal Processing and System Theory, Electrical and Information Engineering, Faculty of Engineering, Kiel University, Kiel, Germany
| | - Walter Maetzler
- Arbeitsgruppe Neurogeriatrie, Department of Neurology, Universitätsklinikum Schleswig-Holstein, Kiel, Germany
| |
Collapse
|
6
|
Seifer AK, Dorschky E, Küderle A, Moradi H, Hannemann R, Eskofier BM. EarGait: Estimation of Temporal Gait Parameters from Hearing Aid Integrated Inertial Sensors. Sensors (Basel) 2023; 23:6565. [PMID: 37514858 PMCID: PMC10383770 DOI: 10.3390/s23146565] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/06/2023] [Revised: 07/14/2023] [Accepted: 07/18/2023] [Indexed: 07/30/2023]
Abstract
Wearable sensors are able to monitor physical health in a home environment and detect changes in gait patterns over time. To ensure long-term user engagement, wearable sensors need to be seamlessly integrated into the user's daily life, such as hearing aids or earbuds. Therefore, we present EarGait, an open-source Python toolbox for gait analysis using inertial sensors integrated into hearing aids. This work contributes a validation for gait event detection algorithms and the estimation of temporal parameters using ear-worn sensors. We perform a comparative analysis of two algorithms based on acceleration data and propose a modified version of one of the algorithms. We conducted a study with healthy young and elderly participants to record walking data using the hearing aid's integrated sensors and an optical motion capture system as a reference. All algorithms were able to detect gait events (initial and terminal contacts), and the improved algorithm performed best, detecting 99.8% of initial contacts and obtaining a mean stride time error of 12 ± 32 ms. The existing algorithms faced challenges in determining the laterality of gait events. To address this limitation, we propose modifications that enhance the determination of the step laterality (ipsi- or contralateral), resulting in a 50% reduction in stride time error. Moreover, the improved version is shown to be robust to different study populations and sampling frequencies but is sensitive to walking speed. This work establishes a solid foundation for a comprehensive gait analysis system integrated into hearing aids that will facilitate continuous and long-term home monitoring.
Collapse
Affiliation(s)
- Ann-Kristin Seifer
- Machine Learning and Data Analytics Lab (MaD Lab), Department Artificial Intelligence in Biomedical Engineering (AIBE), Friedrich-Alexander-Universität Erlangen-Nürnberg (FAU), 91052 Erlangen, Germany
| | - Eva Dorschky
- Machine Learning and Data Analytics Lab (MaD Lab), Department Artificial Intelligence in Biomedical Engineering (AIBE), Friedrich-Alexander-Universität Erlangen-Nürnberg (FAU), 91052 Erlangen, Germany
| | - Arne Küderle
- Machine Learning and Data Analytics Lab (MaD Lab), Department Artificial Intelligence in Biomedical Engineering (AIBE), Friedrich-Alexander-Universität Erlangen-Nürnberg (FAU), 91052 Erlangen, Germany
| | - Hamid Moradi
- Machine Learning and Data Analytics Lab (MaD Lab), Department Artificial Intelligence in Biomedical Engineering (AIBE), Friedrich-Alexander-Universität Erlangen-Nürnberg (FAU), 91052 Erlangen, Germany
| | | | - Björn M Eskofier
- Machine Learning and Data Analytics Lab (MaD Lab), Department Artificial Intelligence in Biomedical Engineering (AIBE), Friedrich-Alexander-Universität Erlangen-Nürnberg (FAU), 91052 Erlangen, Germany
| |
Collapse
|
7
|
Micó-Amigo ME, Bonci T, Paraschiv-Ionescu A, Ullrich M, Kirk C, Soltani A, Küderle A, Gazit E, Salis F, Alcock L, Aminian K, Becker C, Bertuletti S, Brown P, Buckley E, Cantu A, Carsin AE, Caruso M, Caulfield B, Cereatti A, Chiari L, D'Ascanio I, Eskofier B, Fernstad S, Froehlich M, Garcia-Aymerich J, Hansen C, Hausdorff JM, Hiden H, Hume E, Keogh A, Kluge F, Koch S, Maetzler W, Megaritis D, Mueller A, Niessen M, Palmerini L, Schwickert L, Scott K, Sharrack B, Sillén H, Singleton D, Vereijken B, Vogiatzis I, Yarnall AJ, Rochester L, Mazzà C, Del Din S. Assessing real-world gait with digital technology? Validation, insights and recommendations from the Mobilise-D consortium. J Neuroeng Rehabil 2023; 20:78. [PMID: 37316858 PMCID: PMC10265910 DOI: 10.1186/s12984-023-01198-5] [Citation(s) in RCA: 6] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/21/2022] [Accepted: 05/26/2023] [Indexed: 06/16/2023] Open
Abstract
BACKGROUND Although digital mobility outcomes (DMOs) can be readily calculated from real-world data collected with wearable devices and ad-hoc algorithms, technical validation is still required. The aim of this paper is to comparatively assess and validate DMOs estimated using real-world gait data from six different cohorts, focusing on gait sequence detection, foot initial contact detection (ICD), cadence (CAD) and stride length (SL) estimates. METHODS Twenty healthy older adults, 20 people with Parkinson's disease, 20 with multiple sclerosis, 19 with proximal femoral fracture, 17 with chronic obstructive pulmonary disease and 12 with congestive heart failure were monitored for 2.5 h in the real-world, using a single wearable device worn on the lower back. A reference system combining inertial modules with distance sensors and pressure insoles was used for comparison of DMOs from the single wearable device. We assessed and validated three algorithms for gait sequence detection, four for ICD, three for CAD and four for SL by concurrently comparing their performances (e.g., accuracy, specificity, sensitivity, absolute and relative errors). Additionally, the effects of walking bout (WB) speed and duration on algorithm performance were investigated. RESULTS We identified two cohort-specific top performing algorithms for gait sequence detection and CAD, and a single best for ICD and SL. Best gait sequence detection algorithms showed good performances (sensitivity > 0.73, positive predictive values > 0.75, specificity > 0.95, accuracy > 0.94). ICD and CAD algorithms presented excellent results, with sensitivity > 0.79, positive predictive values > 0.89 and relative errors < 11% for ICD and < 8.5% for CAD. The best identified SL algorithm showed lower performances than other DMOs (absolute error < 0.21 m). Lower performances across all DMOs were found for the cohort with most severe gait impairments (proximal femoral fracture). Algorithms' performances were lower for short walking bouts; slower gait speeds (< 0.5 m/s) resulted in reduced performance of the CAD and SL algorithms. CONCLUSIONS Overall, the identified algorithms enabled a robust estimation of key DMOs. Our findings showed that the choice of algorithm for estimation of gait sequence detection and CAD should be cohort-specific (e.g., slow walkers and with gait impairments). Short walking bout length and slow walking speed worsened algorithms' performances. Trial registration ISRCTN - 12246987.
Collapse
Affiliation(s)
- M Encarna Micó-Amigo
- Translational and Clinical Research Institute, Faculty of Medical Sciences, Newcastle University, Newcastle upon Tyne, UK
| | - Tecla Bonci
- Department of Mechanical Engineering and Insigneo Institute for in Silico Medicine, The University of Sheffield, Sheffield, UK
| | - Anisoara Paraschiv-Ionescu
- Laboratory of Movement Analysis and Measurement, Ecole Polytechnique Federale de Lausanne, Lausanne, Switzerland
| | - Martin Ullrich
- Machine Learning and Data Analytics Lab, Department of Artificial Intelligence in Biomedical Engineering, Friedrich-Alexander-Universität Erlangen-Nürnberg, Erlangen, Germany
| | - Cameron Kirk
- Translational and Clinical Research Institute, Faculty of Medical Sciences, Newcastle University, Newcastle upon Tyne, UK
| | - Abolfazl Soltani
- Laboratory of Movement Analysis and Measurement, Ecole Polytechnique Federale de Lausanne, Lausanne, Switzerland
| | - Arne Küderle
- Machine Learning and Data Analytics Lab, Department of Artificial Intelligence in Biomedical Engineering, Friedrich-Alexander-Universität Erlangen-Nürnberg, Erlangen, Germany
| | - Eran Gazit
- Center for the Study of Movement, Cognition and Mobility, Neurological Institute, Tel Aviv Sourasky Medical Center, Tel Aviv, Israel
| | - Francesca Salis
- Department of Biomedical Sciences, University of Sassari, Sassari, Italy
- Department of Electronics and Telecommunications, Politecnico di Torino, Turin, Italy
| | - Lisa Alcock
- Translational and Clinical Research Institute, Faculty of Medical Sciences, Newcastle University, Newcastle upon Tyne, UK
- National Institute for Health and Care Research (NIHR) Newcastle Biomedical Research Centre (BRC), Newcastle University and The Newcastle upon Tyne Hospitals NHS Foundation Trust, Newcastle upon Tyne, UK
| | - Kamiar Aminian
- Laboratory of Movement Analysis and Measurement, Ecole Polytechnique Federale de Lausanne, Lausanne, Switzerland
| | - Clemens Becker
- Robert Bosch Gesellschaft für Medizinische Forschung, Stuttgart, Germany
| | - Stefano Bertuletti
- Department of Electronics and Telecommunications, Politecnico di Torino, Turin, Italy
| | - Philip Brown
- The Newcastle Upon Tyne Hospitals NHS Foundation Trust, Newcastle upon Tyne, UK
| | - Ellen Buckley
- Department of Mechanical Engineering and Insigneo Institute for in Silico Medicine, The University of Sheffield, Sheffield, UK
| | - Alma Cantu
- School of Computing, Newcastle University, Newcastle upon Tyne, UK
| | - Anne-Elie Carsin
- Barcelona Institute for Global Health (ISGlobal), Barcelona, Spain
- Universitat Pompeu Fabra, Barcelona, Catalonia, Spain
- CIBER Epidemiología y Salud Pública (CIBERESP), Madrid, Spain
| | - Marco Caruso
- Department of Electronics and Telecommunications, Politecnico di Torino, Turin, Italy
| | - Brian Caulfield
- Insight Centre for Data Analytics, University College Dublin, Dublin, Ireland
- School of Public Health, Physiotherapy and Sports Science, University College Dublin, Dublin, Ireland
| | - Andrea Cereatti
- Department of Electronics and Telecommunications, Politecnico di Torino, Turin, Italy
| | - Lorenzo Chiari
- Department of Electrical, Electronic and Information Engineering «Guglielmo Marconi», University of Bologna, Bologna, Italy
- Health Sciences and Technologies-Interdepartmental Center for Industrial Research (CIRI-SDV), University of Bologna, Bologna, Italy
| | - Ilaria D'Ascanio
- Department of Electrical, Electronic and Information Engineering «Guglielmo Marconi», University of Bologna, Bologna, Italy
| | - Bjoern Eskofier
- Machine Learning and Data Analytics Lab, Department of Artificial Intelligence in Biomedical Engineering, Friedrich-Alexander-Universität Erlangen-Nürnberg, Erlangen, Germany
| | - Sara Fernstad
- School of Computing, Newcastle University, Newcastle upon Tyne, UK
| | | | - Judith Garcia-Aymerich
- Barcelona Institute for Global Health (ISGlobal), Barcelona, Spain
- Universitat Pompeu Fabra, Barcelona, Catalonia, Spain
- CIBER Epidemiología y Salud Pública (CIBERESP), Madrid, Spain
| | - Clint Hansen
- Department of Neurology, University Medical Center Schleswig-Holstein Campus Kiel, Kiel, Germany
| | - Jeffrey M Hausdorff
- Center for the Study of Movement, Cognition and Mobility, Neurological Institute, Tel Aviv Sourasky Medical Center, Tel Aviv, Israel
- Sagol School of Neuroscience and Department of Physical Therapy, Sackler Faculty of Medicine, Tel Aviv University, Tel Aviv, Israel
- Rush Alzheimer's Disease Center and Department of Orthopaedic Surgery, Rush University Medical Center, Chicago, IL, USA
| | - Hugo Hiden
- School of Computing, Newcastle University, Newcastle upon Tyne, UK
| | - Emily Hume
- Department of Sport, Exercise and Rehabilitation, Northumbria University Newcastle, Newcastle upon Tyne, UK
| | - Alison Keogh
- Insight Centre for Data Analytics, University College Dublin, Dublin, Ireland
- School of Public Health, Physiotherapy and Sports Science, University College Dublin, Dublin, Ireland
| | - Felix Kluge
- Machine Learning and Data Analytics Lab, Department of Artificial Intelligence in Biomedical Engineering, Friedrich-Alexander-Universität Erlangen-Nürnberg, Erlangen, Germany
- Novartis Institutes of Biomedical Research, Novartis Pharma AG, Basel, Switzerland
| | - Sarah Koch
- Barcelona Institute for Global Health (ISGlobal), Barcelona, Spain
- Universitat Pompeu Fabra, Barcelona, Catalonia, Spain
- CIBER Epidemiología y Salud Pública (CIBERESP), Madrid, Spain
| | - Walter Maetzler
- Department of Neurology, University Medical Center Schleswig-Holstein Campus Kiel, Kiel, Germany
| | - Dimitrios Megaritis
- Department of Sport, Exercise and Rehabilitation, Northumbria University Newcastle, Newcastle upon Tyne, UK
| | - Arne Mueller
- Novartis Institutes of Biomedical Research, Novartis Pharma AG, Basel, Switzerland
| | | | - Luca Palmerini
- Department of Electrical, Electronic and Information Engineering «Guglielmo Marconi», University of Bologna, Bologna, Italy
- Health Sciences and Technologies-Interdepartmental Center for Industrial Research (CIRI-SDV), University of Bologna, Bologna, Italy
| | - Lars Schwickert
- Robert Bosch Gesellschaft für Medizinische Forschung, Stuttgart, Germany
| | - Kirsty Scott
- Department of Mechanical Engineering and Insigneo Institute for in Silico Medicine, The University of Sheffield, Sheffield, UK
| | - Basil Sharrack
- Department of Neuroscience and Sheffield NIHR Translational Neuroscience BRC, Sheffield Teaching Hospitals NHS Foundation Trust, Sheffield, UK
| | | | - David Singleton
- Insight Centre for Data Analytics, University College Dublin, Dublin, Ireland
- School of Public Health, Physiotherapy and Sports Science, University College Dublin, Dublin, Ireland
| | - Beatrix Vereijken
- Department of Neuromedicine and Movement Science, Norwegian University of Science and Technology, Trondheim, Norway
| | - Ioannis Vogiatzis
- Department of Sport, Exercise and Rehabilitation, Northumbria University Newcastle, Newcastle upon Tyne, UK
| | - Alison J Yarnall
- Translational and Clinical Research Institute, Faculty of Medical Sciences, Newcastle University, Newcastle upon Tyne, UK
- National Institute for Health and Care Research (NIHR) Newcastle Biomedical Research Centre (BRC), Newcastle University and The Newcastle upon Tyne Hospitals NHS Foundation Trust, Newcastle upon Tyne, UK
- The Newcastle Upon Tyne Hospitals NHS Foundation Trust, Newcastle upon Tyne, UK
| | - Lynn Rochester
- Translational and Clinical Research Institute, Faculty of Medical Sciences, Newcastle University, Newcastle upon Tyne, UK
- National Institute for Health and Care Research (NIHR) Newcastle Biomedical Research Centre (BRC), Newcastle University and The Newcastle upon Tyne Hospitals NHS Foundation Trust, Newcastle upon Tyne, UK
- The Newcastle Upon Tyne Hospitals NHS Foundation Trust, Newcastle upon Tyne, UK
| | - Claudia Mazzà
- Department of Mechanical Engineering and Insigneo Institute for in Silico Medicine, The University of Sheffield, Sheffield, UK
| | - Silvia Del Din
- Translational and Clinical Research Institute, Faculty of Medical Sciences, Newcastle University, Newcastle upon Tyne, UK.
- National Institute for Health and Care Research (NIHR) Newcastle Biomedical Research Centre (BRC), Newcastle University and The Newcastle upon Tyne Hospitals NHS Foundation Trust, Newcastle upon Tyne, UK.
| |
Collapse
|
8
|
Abdullahi IY, Raab R, Küderle A, Eskofier B. Aligning Federated Learning with Existing Trust Structures in Health Care Systems. Int J Environ Res Public Health 2023; 20:5378. [PMID: 37047992 PMCID: PMC10094512 DOI: 10.3390/ijerph20075378] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 02/15/2023] [Revised: 03/17/2023] [Accepted: 03/29/2023] [Indexed: 06/19/2023]
Abstract
Patient-centered health care information systems (PHSs) on peer-to-peer (P2P) networks (e.g., decentralized personal health records) enable storing data locally at the edge to enhance data sovereignty and resilience to single points of failure. Nonetheless, these systems raise concerns on trust and adoption in medical workflow due to non-alignment to current health care processes and stakeholders' needs. The distributed nature of the data makes it more challenging to train and deploy machine learning models (using traditional methods) at the edge, for instance, for disease prediction. Federated learning (FL) has been proposed as a possible solution to these limitations. However, the P2P PHS architecture challenges current FL solutions because they use centralized engines (or random entities that could pose privacy concerns) for model update aggregation. Consequently, we propose a novel conceptual FL framework, CareNetFL, that is suitable for P2P PHS multi-tier and hybrid architecture and leverages existing trust structures in health care systems to ensure scalability, trust, and security. Entrusted parties (practitioners' nodes) are used in CareNetFL to aggregate local model updates in the network hierarchy for their patients instead of random entities that could actively become malicious. Involving practitioners in their patients' FL model training increases trust and eases access to medical data. The proposed concepts mitigate communication latency and improve FL performance through patient-practitioner clustering, reducing skewed and imbalanced data distributions and system heterogeneity challenges of FL at the edge. The framework also ensures end-to-end security and accountability through leveraging identity-based systems and privacy-preserving techniques that only guarantee security during training.
Collapse
|
9
|
Richer R, Abel L, Küderle A, Eskofier BM, Rohleder N. CARWatch - A smartphone application for improving the accuracy of cortisol awakening response sampling. Psychoneuroendocrinology 2023; 151:106073. [PMID: 36868094 DOI: 10.1016/j.psyneuen.2023.106073] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 10/24/2022] [Revised: 02/22/2023] [Accepted: 02/22/2023] [Indexed: 03/05/2023]
Abstract
BACKGROUND Many studies investigating the cortisol awakening response (CAR) suffer from low adherence to the study protocol as well as from the lack of precise and objective methods for assessing the awakening and saliva sampling times which leads to measurement bias on CAR quantification. METHODS To address this issue, we have developed "CARWatch", a smartphone application that aims to enable low-cost and objective assessment of saliva sampling times as well as to concurrently increase protocol adherence. As proof-of-concept study, we assessed the CAR of N = 117 healthy participants (24.2 ± 8.7 years, 79.5% female) on two consecutive days. During the study, we recorded awakening times (AW) using self-reports, the CARWatch application, and a wrist-worn sensor, and saliva sampling times (ST) using self-reports and the CARWatch application. Using combinations of different AW and ST modalities, we derived different reporting strategies and compared the reported time information to a Naive sampling strategy assuming an ideal sampling schedule. Additionally, we compared the AUCI, computed using information from different reporting strategies, against each other to demonstrate the effect of inaccurate sampling on the CAR. RESULTS The use of CARWatch led to a more consistent sampling behavior and reduced sampling delay compared to self-reported saliva sampling times. Additionally, we observed that inaccurate saliva sampling times, as resulting from self-reports, were associated with an underestimation of CAR measures. Our findings also revealed potential error sources for inaccuracies in self-reported sampling times and showed that CARWatch can help in better identifying, and possibly excluding, sampling outliers that would remain undiscovered by self-reported sampling. CONCLUSION The results from our proof-of-concept study demonstrated that CARWatch can be used to objectively record saliva sampling times. Further, it suggests its potential of increasing protocol adherence and sampling accuracy in CAR studies and might help to reduce inconsistencies in CAR literature resulting from inaccurate saliva sampling. For that reason, we published CARWatch and all necessary tools under an open-source license, making it freely accessible to every researcher.
Collapse
Affiliation(s)
- Robert Richer
- Machine Learning and Data Analytics Lab (MaD Lab), Department Artificial Intelligence in Biomedical Engineering (AIBE), Friedrich-Alexander-Universität Erlangen-Nürnberg (FAU), Erlangen, Germany.
| | - Luca Abel
- Machine Learning and Data Analytics Lab (MaD Lab), Department Artificial Intelligence in Biomedical Engineering (AIBE), Friedrich-Alexander-Universität Erlangen-Nürnberg (FAU), Erlangen, Germany
| | - Arne Küderle
- Machine Learning and Data Analytics Lab (MaD Lab), Department Artificial Intelligence in Biomedical Engineering (AIBE), Friedrich-Alexander-Universität Erlangen-Nürnberg (FAU), Erlangen, Germany
| | - Bjoern M Eskofier
- Machine Learning and Data Analytics Lab (MaD Lab), Department Artificial Intelligence in Biomedical Engineering (AIBE), Friedrich-Alexander-Universität Erlangen-Nürnberg (FAU), Erlangen, Germany
| | - Nicolas Rohleder
- Chair of Health Psychology, Institute of Psychology, Friedrich-Alexander-Universität Erlangen-Nürnberg (FAU), Erlangen, Germany
| |
Collapse
|
10
|
Palmerini L, Reggi L, Bonci T, Del Din S, Micó-Amigo ME, Salis F, Bertuletti S, Caruso M, Cereatti A, Gazit E, Paraschiv-Ionescu A, Soltani A, Kluge F, Küderle A, Ullrich M, Kirk C, Hiden H, D’Ascanio I, Hansen C, Rochester L, Mazzà C, Chiari L. Mobility recorded by wearable devices and gold standards: the Mobilise-D procedure for data standardization. Sci Data 2023; 10:38. [PMID: 36658136 PMCID: PMC9852581 DOI: 10.1038/s41597-023-01930-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/12/2022] [Accepted: 01/03/2023] [Indexed: 01/21/2023] Open
Abstract
Wearable devices are used in movement analysis and physical activity research to extract clinically relevant information about an individual's mobility. Still, heterogeneity in protocols, sensor characteristics, data formats, and gold standards represent a barrier for data sharing, reproducibility, and external validation. In this study, we aim at providing an example of how movement data (from the real-world and the laboratory) recorded from different wearables and gold standard technologies can be organized, integrated, and stored. We leveraged on our experience from a large multi-centric study (Mobilise-D) to provide guidelines that can prove useful to access, understand, and re-use the data that will be made available from the study. These guidelines highlight the encountered challenges and the adopted solutions with the final aim of supporting standardization and integration of data in other studies and, in turn, to increase and facilitate comparison of data recorded in the scientific community. We also provide samples of standardized data, so that both the structure of the data and the procedure can be easily understood and reproduced.
Collapse
Affiliation(s)
- Luca Palmerini
- grid.6292.f0000 0004 1757 1758University of Bologna, Department of Electrical, Electronic and Information Engineering ‘Guglielmo Marconi’, Bologna, Italy ,grid.6292.f0000 0004 1757 1758University of Bologna, Health Sciences and Technologies—Interdepartmental Center for Industrial Research (CIRI-SDV), Bologna, Italy
| | - Luca Reggi
- grid.6292.f0000 0004 1757 1758University of Bologna, Health Sciences and Technologies—Interdepartmental Center for Industrial Research (CIRI-SDV), Bologna, Italy
| | - Tecla Bonci
- grid.11835.3e0000 0004 1936 9262The University of Sheffield, INSIGNEO Institute for in silico Medicine, Sheffield, UK ,grid.11835.3e0000 0004 1936 9262The University of Sheffield, Department of Mechanical Engineering, Sheffield, UK
| | - Silvia Del Din
- grid.1006.70000 0001 0462 7212Newcastle University, Translational and Clinical Research Institute, Faculty of Medical Sciences, Newcastle, UK
| | - M. Encarna Micó-Amigo
- grid.1006.70000 0001 0462 7212Newcastle University, Translational and Clinical Research Institute, Faculty of Medical Sciences, Newcastle, UK
| | - Francesca Salis
- grid.11450.310000 0001 2097 9138University of Sassari, Department of Biomedical Sciences, Sassari, Italy
| | - Stefano Bertuletti
- grid.11450.310000 0001 2097 9138University of Sassari, Department of Biomedical Sciences, Sassari, Italy
| | - Marco Caruso
- grid.4800.c0000 0004 1937 0343Politecnico di Torino, Department of Electronics and Telecommunications, Torino, Italy ,grid.4800.c0000 0004 1937 0343Politecnico di Torino, PolitoBIOMed Lab – Biomedical Engineering Lab, Torino, Italy
| | - Andrea Cereatti
- grid.4800.c0000 0004 1937 0343Politecnico di Torino, Department of Electronics and Telecommunications, Torino, Italy
| | - Eran Gazit
- grid.413449.f0000 0001 0518 6922Tel Aviv Sourasky Medical Center, Center for the Study of Movement, Cognition and Mobility, Neurological Institute, Tel Aviv-Yafo, Israel
| | - Anisoara Paraschiv-Ionescu
- grid.5333.60000000121839049Laboratory of Movement Analysis and Measurement, Ecole Polytechnique Federale de Lausanne, Lausanne, Switzerland
| | - Abolfazl Soltani
- grid.5333.60000000121839049Laboratory of Movement Analysis and Measurement, Ecole Polytechnique Federale de Lausanne, Lausanne, Switzerland
| | - Felix Kluge
- grid.5330.50000 0001 2107 3311Machine Learning and Data Analytics Lab, Department of Artificial Intelligence in Biomedical Engineering, Friedrich-Alexander-University Erlangen-Nürnberg, Erlangen, Germany
| | - Arne Küderle
- grid.5330.50000 0001 2107 3311Machine Learning and Data Analytics Lab, Department of Artificial Intelligence in Biomedical Engineering, Friedrich-Alexander-University Erlangen-Nürnberg, Erlangen, Germany
| | - Martin Ullrich
- grid.5330.50000 0001 2107 3311Machine Learning and Data Analytics Lab, Department of Artificial Intelligence in Biomedical Engineering, Friedrich-Alexander-University Erlangen-Nürnberg, Erlangen, Germany
| | - Cameron Kirk
- grid.1006.70000 0001 0462 7212Newcastle University, Translational and Clinical Research Institute, Faculty of Medical Sciences, Newcastle, UK
| | - Hugo Hiden
- grid.1006.70000 0001 0462 7212Newcastle University, School of Computing, Newcastle, UK
| | - Ilaria D’Ascanio
- grid.6292.f0000 0004 1757 1758University of Bologna, Department of Electrical, Electronic and Information Engineering ‘Guglielmo Marconi’, Bologna, Italy
| | - Clint Hansen
- grid.412468.d0000 0004 0646 2097Neurogeriatrics Kiel, Department of Neurology, University Hospital Schleswig-Holstein, Kiel, Germany
| | - Lynn Rochester
- grid.1006.70000 0001 0462 7212Newcastle University, Translational and Clinical Research Institute, Faculty of Medical Sciences, Newcastle, UK ,The Newcastle upon Tyne NHS Foundation Trust, Newcastle, UK
| | - Claudia Mazzà
- grid.11835.3e0000 0004 1936 9262The University of Sheffield, INSIGNEO Institute for in silico Medicine, Sheffield, UK ,grid.11835.3e0000 0004 1936 9262The University of Sheffield, Department of Mechanical Engineering, Sheffield, UK
| | - Lorenzo Chiari
- grid.6292.f0000 0004 1757 1758University of Bologna, Department of Electrical, Electronic and Information Engineering ‘Guglielmo Marconi’, Bologna, Italy ,grid.6292.f0000 0004 1757 1758University of Bologna, Health Sciences and Technologies—Interdepartmental Center for Industrial Research (CIRI-SDV), Bologna, Italy
| |
Collapse
|
11
|
Ollenschläger M, Küderle A, Mehringer W, Seifer AK, Winkler J, Gaßner H, Kluge F, Eskofier BM. MaD GUI: An Open-Source Python Package for Annotation and Analysis of Time-Series Data. Sensors (Basel) 2022; 22:5849. [PMID: 35957406 PMCID: PMC9371110 DOI: 10.3390/s22155849] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 06/21/2022] [Revised: 07/17/2022] [Accepted: 08/03/2022] [Indexed: 06/15/2023]
Abstract
Developing machine learning algorithms for time-series data often requires manual annotation of the data. To do so, graphical user interfaces (GUIs) are an important component. Existing Python packages for annotation and analysis of time-series data have been developed without addressing adaptability, usability, and user experience. Therefore, we developed a generic open-source Python package focusing on adaptability, usability, and user experience. The developed package, Machine Learning and Data Analytics (MaD) GUI, enables developers to rapidly create a GUI for their specific use case. Furthermore, MaD GUI enables domain experts without programming knowledge to annotate time-series data and apply algorithms to it. We conducted a small-scale study with participants from three international universities to test the adaptability of MaD GUI by developers and to test the user interface by clinicians as representatives of domain experts. MaD GUI saves up to 75% of time in contrast to using a state-of-the-art package. In line with this, subjective ratings regarding usability and user experience show that MaD GUI is preferred over a state-of-the-art package by developers and clinicians. MaD GUI reduces the effort of developers in creating GUIs for time-series analysis and offers similar usability and user experience for clinicians as a state-of-the-art package.
Collapse
Affiliation(s)
- Malte Ollenschläger
- Machine Learning and Data Analytics Lab, Department of Artificial Intelligence in Biomedical Engineering (AIBE), Friedrich-Alexander-Universität Erlangen-Nürnberg (FAU), 91052 Erlangen, Germany
- Department of Molecular Neurology, University Hospital Erlangen, Friedrich-Alexander-Universität Erlangen-Nürnberg (FAU), 91054 Erlangen, Germany
| | - Arne Küderle
- Machine Learning and Data Analytics Lab, Department of Artificial Intelligence in Biomedical Engineering (AIBE), Friedrich-Alexander-Universität Erlangen-Nürnberg (FAU), 91052 Erlangen, Germany
| | - Wolfgang Mehringer
- Machine Learning and Data Analytics Lab, Department of Artificial Intelligence in Biomedical Engineering (AIBE), Friedrich-Alexander-Universität Erlangen-Nürnberg (FAU), 91052 Erlangen, Germany
| | - Ann-Kristin Seifer
- Machine Learning and Data Analytics Lab, Department of Artificial Intelligence in Biomedical Engineering (AIBE), Friedrich-Alexander-Universität Erlangen-Nürnberg (FAU), 91052 Erlangen, Germany
| | - Jürgen Winkler
- Department of Molecular Neurology, University Hospital Erlangen, Friedrich-Alexander-Universität Erlangen-Nürnberg (FAU), 91054 Erlangen, Germany
| | - Heiko Gaßner
- Department of Molecular Neurology, University Hospital Erlangen, Friedrich-Alexander-Universität Erlangen-Nürnberg (FAU), 91054 Erlangen, Germany
- Fraunhofer IIS, Fraunhofer Institute for Integrated Circuits IIS, 91058 Erlangen, Germany
| | - Felix Kluge
- Machine Learning and Data Analytics Lab, Department of Artificial Intelligence in Biomedical Engineering (AIBE), Friedrich-Alexander-Universität Erlangen-Nürnberg (FAU), 91052 Erlangen, Germany
| | - Bjoern M. Eskofier
- Machine Learning and Data Analytics Lab, Department of Artificial Intelligence in Biomedical Engineering (AIBE), Friedrich-Alexander-Universität Erlangen-Nürnberg (FAU), 91052 Erlangen, Germany
| |
Collapse
|
12
|
Küderle A, Roth N, Zlatanovic J, Zrenner M, Eskofier B, Kluge F. The placement of foot-mounted IMU sensors does affect the accuracy of spatial parameters during regular walking. PLoS One 2022; 17:e0269567. [PMID: 35679231 PMCID: PMC9182246 DOI: 10.1371/journal.pone.0269567] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/10/2021] [Accepted: 05/24/2022] [Indexed: 11/19/2022] Open
Abstract
Gait analysis using foot-worn inertial measurement units has proven to be a reliable tool to diagnose and monitor many neurological and musculoskeletal indications. However, only few studies have investigated the robustness of such systems to changes in the sensor attachment and no consensus for suitable sensor positions exists in the research community. Specifically for unsupervised real-world measurements, understanding how the reliability of the monitoring system changes when the sensor is attached differently is from high importance. In these scenarios, placement variations are expected because of user error or personal preferences. In this manuscript, we present the largest study to date comparing different sensor positions and attachments. We recorded 9000 strides with motion-capture reference from 14 healthy participants with six synchronized sensors attached at each foot. Spatial gait parameters were calculated using a double-integration method and compared to the reference system. The results indicate that relevant differences in the accuracy of the stride length exists between the sensor positions. While the average error over multiple strides is comparable, single stride errors and variability parameters differ greatly. We further present a physics model and an analysis of the raw sensor data to understand the origin of the observed differences. This analysis indicates that a variety of attachment parameters can influence the systems’ performance. While this is only the starting point to understand and mitigate these types of errors, we conclude that sensor systems and algorithms must be reevaluated when the sensor position or attachment changes.
Collapse
Affiliation(s)
- Arne Küderle
- Machine Learning and Data Analytics Lab, Friedrich-Alexander-Universität Erlangen-Nürnberg, Erlangen, Germany
- * E-mail:
| | - Nils Roth
- Machine Learning and Data Analytics Lab, Friedrich-Alexander-Universität Erlangen-Nürnberg, Erlangen, Germany
| | - Jovana Zlatanovic
- Machine Learning and Data Analytics Lab, Friedrich-Alexander-Universität Erlangen-Nürnberg, Erlangen, Germany
| | - Markus Zrenner
- Machine Learning and Data Analytics Lab, Friedrich-Alexander-Universität Erlangen-Nürnberg, Erlangen, Germany
| | - Bjoern Eskofier
- Machine Learning and Data Analytics Lab, Friedrich-Alexander-Universität Erlangen-Nürnberg, Erlangen, Germany
| | - Felix Kluge
- Machine Learning and Data Analytics Lab, Friedrich-Alexander-Universität Erlangen-Nürnberg, Erlangen, Germany
| |
Collapse
|
13
|
Antunes RS, da Costa CA, Küderle A, Yari IA, Eskofier B. Federated Learning for Healthcare: Systematic Review and Architecture Proposal. ACM T INTEL SYST TEC 2022. [DOI: 10.1145/3501813] [Citation(s) in RCA: 6] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/28/2022]
Abstract
The use of machine learning (ML) with electronic health records (EHR) is growing in popularity as a means to extract knowledge that can improve the decision-making process in healthcare. Such methods require training of high-quality learning models based on diverse and comprehensive datasets, which are hard to obtain due to the sensitive nature of medical data from patients. In this context, federated learning (FL) is a methodology that enables the distributed training of machine learning models with remotely hosted datasets without the need to accumulate data and, therefore, compromise it. FL is a promising solution to improve ML-based systems, better aligning them to regulatory requirements, improving trustworthiness and data sovereignty. However, many open questions must be addressed before the use of FL becomes widespread. This article aims at presenting a systematic literature review on current research about FL in the context of EHR data for healthcare applications. Our analysis highlights the main research topics, proposed solutions, case studies, and respective ML methods. Furthermore, the article discusses a general architecture for FL applied to healthcare data based on the main insights obtained from the literature review. The collected literature corpus indicates that there is extensive research on the privacy and confidentiality aspects of training data and model sharing, which is expected given the sensitive nature of medical data. Studies also explore improvements to the aggregation mechanisms required to generate the learning model from distributed contributions and case studies with different types of medical data.
Collapse
Affiliation(s)
| | | | | | | | - Björn Eskofier
- Friedrich-Alexander-Universität Erlangen-Nürnberg, Germany
| |
Collapse
|
14
|
Mazzà C, Alcock L, Aminian K, Becker C, Bertuletti S, Bonci T, Brown P, Brozgol M, Buckley E, Carsin AE, Caruso M, Caulfield B, Cereatti A, Chiari L, Chynkiamis N, Ciravegna F, Del Din S, Eskofier B, Evers J, Garcia Aymerich J, Gazit E, Hansen C, Hausdorff JM, Helbostad JL, Hiden H, Hume E, Paraschiv-Ionescu A, Ireson N, Keogh A, Kirk C, Kluge F, Koch S, Küderle A, Lanfranchi V, Maetzler W, Micó-Amigo ME, Mueller A, Neatrour I, Niessen M, Palmerini L, Pluimgraaff L, Reggi L, Salis F, Schwickert L, Scott K, Sharrack B, Sillen H, Singleton D, Soltani A, Taraldsen K, Ullrich M, Van Gelder L, Vereijken B, Vogiatzis I, Warmerdam E, Yarnall A, Rochester L. Technical validation of real-world monitoring of gait: a multicentric observational study. BMJ Open 2021; 11:e050785. [PMID: 34857567 PMCID: PMC8640671 DOI: 10.1136/bmjopen-2021-050785] [Citation(s) in RCA: 37] [Impact Index Per Article: 12.3] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 12/17/2022] Open
Abstract
INTRODUCTION Existing mobility endpoints based on functional performance, physical assessments and patient self-reporting are often affected by lack of sensitivity, limiting their utility in clinical practice. Wearable devices including inertial measurement units (IMUs) can overcome these limitations by quantifying digital mobility outcomes (DMOs) both during supervised structured assessments and in real-world conditions. The validity of IMU-based methods in the real-world, however, is still limited in patient populations. Rigorous validation procedures should cover the device metrological verification, the validation of the algorithms for the DMOs computation specifically for the population of interest and in daily life situations, and the users' perspective on the device. METHODS AND ANALYSIS This protocol was designed to establish the technical validity and patient acceptability of the approach used to quantify digital mobility in the real world by Mobilise-D, a consortium funded by the European Union (EU) as part of the Innovative Medicine Initiative, aiming at fostering regulatory approval and clinical adoption of DMOs.After defining the procedures for the metrological verification of an IMU-based device, the experimental procedures for the validation of algorithms used to calculate the DMOs are presented. These include laboratory and real-world assessment in 120 participants from five groups: healthy older adults; chronic obstructive pulmonary disease, Parkinson's disease, multiple sclerosis, proximal femoral fracture and congestive heart failure. DMOs extracted from the monitoring device will be compared with those from different reference systems, chosen according to the contexts of observation. Questionnaires and interviews will evaluate the users' perspective on the deployed technology and relevance of the mobility assessment. ETHICS AND DISSEMINATION The study has been granted ethics approval by the centre's committees (London-Bloomsbury Research Ethics committee; Helsinki Committee, Tel Aviv Sourasky Medical Centre; Medical Faculties of The University of Tübingen and of the University of Kiel). Data and algorithms will be made publicly available. TRIAL REGISTRATION NUMBER ISRCTN (12246987).
Collapse
Affiliation(s)
- Claudia Mazzà
- INSIGNEO Institute for in silico Medicine, The University of Sheffield, Sheffield, UK
- Department of Mechanical Engineering, The University of Sheffield, Sheffield, UK
| | - Lisa Alcock
- Translational and Clinical Research Institute, Faculty of Medical Sciences, Newcastle University, Newcastle upon Tyne, UK
| | - Kamiar Aminian
- Laboratory of Movement Analysis and Measurement, Ecole Polytechnique Federale de Lausanne, Lausanne, Switzerland
| | - Clemens Becker
- Robert Bosch Gesellschaft für Medizinische Forschung, Stuttgart, Germany
| | - Stefano Bertuletti
- Department of Biomedical Sciences, University of Sassari, Sassari, Sardegna, Italy
| | - Tecla Bonci
- INSIGNEO Institute for in silico Medicine, The University of Sheffield, Sheffield, UK
- Department of Mechanical Engineering, The University of Sheffield, Sheffield, UK
| | - Philip Brown
- The Newcastle Upon Tyne Hospitals NHS Foundation Trust, Newcastle Upon Tyne, UK
| | - Marina Brozgol
- Center for the Study of Movement, Cognition and Mobility, Neurological Institute, Tel Aviv Sourasky Medical Center, Tel Aviv, Israel
| | - Ellen Buckley
- INSIGNEO Institute for in silico Medicine, The University of Sheffield, Sheffield, UK
- Department of Mechanical Engineering, The University of Sheffield, Sheffield, UK
| | - Anne-Elie Carsin
- ISGlobal, Barcelona, Spain
- Universitat Pompeu Fabra (UPF), Barcelona, Spain
- CIBER Epidemiología y Salud Pública (CIBERESP), Madrid, Spain
- IMIM (Hospital del Mar Medical Research Institute), Barcelona, Spain
| | - Marco Caruso
- Dipartimento di Elettronica e Telecomunicazioni, Politecnico di Torino, Torino, Italy
- PolitoBIOMed Lab - Biomedical Engineering Lab, Politecnico di Torino, Torino, Italy
| | - Brian Caulfield
- Insight Centre for Data Analytics, O'Brien Science Centre, University College Dublin, Dublin, Ireland
- UCD School of Public Health, Physiotherapy and Sports Science, University College Dublin, Dublin, Ireland
| | - Andrea Cereatti
- Dipartimento di Elettronica e Telecomunicazioni, Politecnico di Torino, Torino, Italy
| | - Lorenzo Chiari
- Department of Electrical, Electronic and Information Engineering «Guglielmo Marconi», University of Bologna, Bologna, Italy
- Health Sciences and Technologies-Interdepartmental Center for Industrial Research (CIRI-SDV), University of Bologna, Bologna, Italy
| | - Nikolaos Chynkiamis
- Department of Sport, Exercise and Rehabilitation, Northumbria University Newcastle, Newcastle upon Tyne, UK
| | - Fabio Ciravegna
- INSIGNEO Institute for in silico Medicine, The University of Sheffield, Sheffield, UK
- Department of Computer Science, The University of Sheffield, Sheffield, UK
| | - Silvia Del Din
- Translational and Clinical Research Institute, Faculty of Medical Sciences, Newcastle University, Newcastle upon Tyne, UK
| | - Björn Eskofier
- Machine Learning and Data Analytics Lab, Department of Artificial Intelligence in Biomedical Engineering, Friedrich-Alexander-Universität Erlangen-Nürnberg, Erlangen, Germany
| | - Jordi Evers
- McRoberts BV, Den Haag, Zuid-Holland, Netherlands
| | - Judith Garcia Aymerich
- ISGlobal, Barcelona, Spain
- Universitat Pompeu Fabra (UPF), Barcelona, Spain
- CIBER Epidemiología y Salud Pública (CIBERESP), Madrid, Spain
| | - Eran Gazit
- Center for the Study of Movement, Cognition and Mobility, Neurological Institute, Tel Aviv Sourasky Medical Center, Tel Aviv, Israel
| | - Clint Hansen
- Department of Neurology, University Medical Center Schleswig-Holstein Campus Kiel, Kiel, Germany
| | - Jeffrey M Hausdorff
- Center for the Study of Movement, Cognition and Mobility, Neurological Institute, Tel Aviv Sourasky Medical Center, Tel Aviv, Israel
- Department of Physical Therapy, Sackler Faculty of Medicine & Sagol School of Neuroscience, Tel Aviv University, Tel Aviv, Israel
| | - Jorunn L Helbostad
- Department of Neuromedicine and Movement Science, Norwegian University of Science and Technology, Trondheim, Norway
| | - Hugo Hiden
- School of Computing, Newcastle University, Newcastle upon Tyne, UK
| | - Emily Hume
- Department of Sport, Exercise and Rehabilitation, Northumbria University Newcastle, Newcastle upon Tyne, UK
| | - Anisoara Paraschiv-Ionescu
- Laboratory of Movement Analysis and Measurement, Ecole Polytechnique Federale de Lausanne, Lausanne, Switzerland
| | - Neil Ireson
- INSIGNEO Institute for in silico Medicine, The University of Sheffield, Sheffield, UK
- Department of Computer Science, The University of Sheffield, Sheffield, UK
| | - Alison Keogh
- Insight Centre for Data Analytics, O'Brien Science Centre, University College Dublin, Dublin, Ireland
- UCD School of Public Health, Physiotherapy and Sports Science, University College Dublin, Dublin, Ireland
| | - Cameron Kirk
- Translational and Clinical Research Institute, Faculty of Medical Sciences, Newcastle University, Newcastle upon Tyne, UK
| | - Felix Kluge
- Machine Learning and Data Analytics Lab, Department of Artificial Intelligence in Biomedical Engineering, Friedrich-Alexander-Universität Erlangen-Nürnberg, Erlangen, Germany
| | - Sarah Koch
- ISGlobal, Barcelona, Spain
- Universitat Pompeu Fabra (UPF), Barcelona, Spain
- CIBER Epidemiología y Salud Pública (CIBERESP), Madrid, Spain
| | - Arne Küderle
- Machine Learning and Data Analytics Lab, Department of Artificial Intelligence in Biomedical Engineering, Friedrich-Alexander-Universität Erlangen-Nürnberg, Erlangen, Germany
| | - Vitaveska Lanfranchi
- INSIGNEO Institute for in silico Medicine, The University of Sheffield, Sheffield, UK
- Department of Computer Science, The University of Sheffield, Sheffield, UK
| | - Walter Maetzler
- Department of Neurology, University Medical Center Schleswig-Holstein Campus Kiel, Kiel, Germany
| | - M Encarna Micó-Amigo
- Translational and Clinical Research Institute, Faculty of Medical Sciences, Newcastle University, Newcastle upon Tyne, UK
| | - Arne Mueller
- Novartis Institutes of Biomedical Research, Novartis Pharma AG, Basel, Switzerland
| | - Isabel Neatrour
- Translational and Clinical Research Institute, Faculty of Medical Sciences, Newcastle University, Newcastle upon Tyne, UK
| | | | - Luca Palmerini
- Department of Electrical, Electronic and Information Engineering «Guglielmo Marconi», University of Bologna, Bologna, Italy
- Health Sciences and Technologies-Interdepartmental Center for Industrial Research (CIRI-SDV), University of Bologna, Bologna, Italy
| | | | - Luca Reggi
- Health Sciences and Technologies-Interdepartmental Center for Industrial Research (CIRI-SDV), University of Bologna, Bologna, Italy
| | - Francesca Salis
- Department of Biomedical Sciences, University of Sassari, Sassari, Sardegna, Italy
| | - Lars Schwickert
- Robert Bosch Gesellschaft für Medizinische Forschung, Stuttgart, Germany
| | - Kirsty Scott
- INSIGNEO Institute for in silico Medicine, The University of Sheffield, Sheffield, UK
- Department of Mechanical Engineering, The University of Sheffield, Sheffield, UK
| | - Basil Sharrack
- Department of Neuroscience and Sheffield NIHR Translational Neuroscience BRC, Sheffield Teaching Hospitals NHS Foundation Trust, Sheffield, UK
| | - Henrik Sillen
- Digital Health R&D, AstraZeneca Sweden, Sodertalje, Sweden
| | - David Singleton
- Insight Centre for Data Analytics, O'Brien Science Centre, University College Dublin, Dublin, Ireland
- UCD School of Public Health, Physiotherapy and Sports Science, University College Dublin, Dublin, Ireland
| | - Abolfazi Soltani
- Laboratory of Movement Analysis and Measurement, Ecole Polytechnique Federale de Lausanne, Lausanne, Switzerland
| | - Kristin Taraldsen
- Department of Neuromedicine and Movement Science, Norwegian University of Science and Technology, Trondheim, Norway
| | - Martin Ullrich
- Machine Learning and Data Analytics Lab, Department of Artificial Intelligence in Biomedical Engineering, Friedrich-Alexander-Universität Erlangen-Nürnberg, Erlangen, Germany
| | - Linda Van Gelder
- INSIGNEO Institute for in silico Medicine, The University of Sheffield, Sheffield, UK
- Department of Mechanical Engineering, The University of Sheffield, Sheffield, UK
| | - Beatrix Vereijken
- Department of Neuromedicine and Movement Science, Norwegian University of Science and Technology, Trondheim, Norway
| | - Ioannis Vogiatzis
- Department of Sport, Exercise and Rehabilitation, Northumbria University Newcastle, Newcastle upon Tyne, UK
| | - Elke Warmerdam
- Department of Neurology, University Medical Center Schleswig-Holstein Campus Kiel, Kiel, Germany
| | - Alison Yarnall
- Translational and Clinical Research Institute, Faculty of Medical Sciences, Newcastle University, Newcastle upon Tyne, UK
- The Newcastle Upon Tyne Hospitals NHS Foundation Trust, Newcastle Upon Tyne, UK
| | - Lynn Rochester
- Translational and Clinical Research Institute, Faculty of Medical Sciences, Newcastle University, Newcastle upon Tyne, UK
- The Newcastle Upon Tyne Hospitals NHS Foundation Trust, Newcastle Upon Tyne, UK
| |
Collapse
|
15
|
Kluge F, Del Din S, Cereatti A, Gaßner H, Hansen C, Helbostad JL, Klucken J, Küderle A, Müller A, Rochester L, Ullrich M, Eskofier BM, Mazzà C. Consensus based framework for digital mobility monitoring. PLoS One 2021; 16:e0256541. [PMID: 34415959 PMCID: PMC8378707 DOI: 10.1371/journal.pone.0256541] [Citation(s) in RCA: 25] [Impact Index Per Article: 8.3] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/18/2021] [Accepted: 08/09/2021] [Indexed: 12/31/2022] Open
Abstract
Digital mobility assessment using wearable sensor systems has the potential to capture walking performance in a patient's natural environment. It enables monitoring of health status and disease progression and evaluation of interventions in real-world situations. In contrast to laboratory settings, real-world walking occurs in non-conventional environments and under unconstrained and uncontrolled conditions. Despite the general understanding, there is a lack of agreed definitions about what constitutes real-world walking, impeding the comparison and interpretation of the acquired data across systems and studies. The goal of this study was to obtain expert-based consensus on specific aspects of real-world walking and to provide respective definitions in a common terminological framework. An adapted Delphi method was used to obtain agreed definitions related to real-world walking. In an online survey, 162 participants from a panel of academic, clinical and industrial experts with experience in the field of gait analysis were asked for agreement on previously specified definitions. Descriptive statistics was used to evaluate whether consent (> 75% agreement as defined a priori) was reached. Of 162 experts invited to participate, 51 completed all rounds (31.5% response rate). We obtained consensus on all definitions ("Walking" > 90%, "Purposeful" > 75%, "Real-world" > 90%, "Walking bout" > 80%, "Walking speed" > 75%, "Turning" > 90% agreement) after two rounds. The identification of a consented set of real-world walking definitions has important implications for the development of assessment and analysis protocols, as well as for the reporting and comparison of digital mobility outcomes across studies and systems. The definitions will serve as a common framework for implementing digital and mobile technologies for gait assessment and are an important link for the transition from supervised to unsupervised gait assessment.
Collapse
Affiliation(s)
- Felix Kluge
- Machine Learning and Data Analytics Lab, Department Artificial Intelligence in Biomedical Engineering, Friedrich-Alexander University Erlangen-Nürnberg, Erlangen, Germany
| | - Silvia Del Din
- Translational and Clinical Research Institute, Faculty of Medical Sciences, Newcastle University, Newcastle upon Tyne, United Kingdom
| | - Andrea Cereatti
- Department of Electronics and Telecommunications, Politecnico di Torino, Torino, Italy
| | - Heiko Gaßner
- Department of Molecular Neurology, University Hospital Erlangen, Erlangen, Germany
| | - Clint Hansen
- Department of Neurology, University of Kiel, Kiel, Germany
| | - Jorunn L. Helbostad
- Department of Neuromedicine and Movement Science, Faculty of Medicine and Health Sciences, Norwegian University of Science and Technology, Trondheim, Norway
| | - Jochen Klucken
- Department of Molecular Neurology, University Hospital Erlangen, Erlangen, Germany
| | - Arne Küderle
- Machine Learning and Data Analytics Lab, Department Artificial Intelligence in Biomedical Engineering, Friedrich-Alexander University Erlangen-Nürnberg, Erlangen, Germany
| | | | - Lynn Rochester
- Translational and Clinical Research Institute, Faculty of Medical Sciences, Newcastle University, Newcastle upon Tyne, United Kingdom
- The Newcastle upon Tyne NHS Foundation Trust, Newcastle upon Tyne, United Kingdom
| | - Martin Ullrich
- Machine Learning and Data Analytics Lab, Department Artificial Intelligence in Biomedical Engineering, Friedrich-Alexander University Erlangen-Nürnberg, Erlangen, Germany
| | - Bjoern M. Eskofier
- Machine Learning and Data Analytics Lab, Department Artificial Intelligence in Biomedical Engineering, Friedrich-Alexander University Erlangen-Nürnberg, Erlangen, Germany
| | - Claudia Mazzà
- Department of Mechanical Engineering & Insigneo Institute for in Silico Medicine, The University of Sheffield, Sheffield, United Kingdom
| | | |
Collapse
|
16
|
Ibrahim AA, Küderle A, Gaßner H, Klucken J, Eskofier BM, Kluge F. Inertial sensor-based gait parameters reflect patient-reported fatigue in multiple sclerosis. J Neuroeng Rehabil 2020; 17:165. [PMID: 33339530 PMCID: PMC7749504 DOI: 10.1186/s12984-020-00798-9] [Citation(s) in RCA: 18] [Impact Index Per Article: 4.5] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/18/2020] [Accepted: 12/09/2020] [Indexed: 12/30/2022] Open
Abstract
Background Multiple sclerosis (MS) is a disabling disease affecting the central nervous system and consequently the whole body’s functional systems resulting in different gait disorders. Fatigue is the most common symptom in MS with a prevalence of 80%. Previous research studied the relation between fatigue and gait impairment using stationary gait analysis systems and short gait tests (e.g. timed 25 ft walk). However, wearable inertial sensors providing gait data from longer and continuous gait bouts have not been used to assess the relation between fatigue and gait parameters in MS. Therefore, the aim of this study was to evaluate the association between fatigue and spatio-temporal gait parameters extracted from wearable foot-worn sensors and to predict the degree of fatigue. Methods Forty-nine patients with MS (32 women; 17 men; aged 41.6 years, EDSS 1.0–6.5) were included where each participant was equipped with a small Inertial Measurement Unit (IMU) on each foot. Spatio-temporal gait parameters were obtained from the 6-min walking test, and the Borg scale of perceived exertion was used to represent fatigue. Gait parameters were normalized by taking the difference of averaged gait parameters between the beginning and end of the test to eliminate inter-individual differences. Afterwards, normalized parameters were transformed to principle components that were used as input to a Random Forest regression model to formulate the relationship between gait parameters and fatigue. Results Six principal components were used as input to our model explaining more than 90% of variance within our dataset. Random Forest regression was used to predict fatigue. The model was validated using 10-fold cross validation and the mean absolute error was 1.38 points. Principal components consisting mainly of stride time, maximum toe clearance, heel strike angle, and stride length had large contributions (67%) to the predictions made by the Random Forest. Conclusions The level of fatigue can be predicted based on spatio-temporal gait parameters obtained from an IMU based system. The results can help therapists to monitor fatigue before and after treatment and in rehabilitation programs to evaluate their efficacy. Furthermore, this can be used in home monitoring scenarios where therapists can monitor fatigue using IMUs reducing time and effort of patients and therapists.
Collapse
Affiliation(s)
- Alzhraa A Ibrahim
- Machine Learning and Data Analytics Lab, Friedrich-Alexander-University Erlangen-Nürnberg (FAU), Erlangen, Germany. .,Computer Science Department, Faculty of Computers and Information, Assiut University, Asyut, Egypt.
| | - Arne Küderle
- Machine Learning and Data Analytics Lab, Friedrich-Alexander-University Erlangen-Nürnberg (FAU), Erlangen, Germany
| | - Heiko Gaßner
- Department of Molecular Neurology, University Hospital Erlangen, Erlangen, Bavaria, Germany
| | - Jochen Klucken
- Department of Molecular Neurology, University Hospital Erlangen, Erlangen, Bavaria, Germany.,Fraunhofer Institut for Integrated Circuits, Erlangen, Bavaria, Germany.,Medical Valley Digital Health Application Center, Bamberg, Bavaria, Germany
| | - Bjoern M Eskofier
- Machine Learning and Data Analytics Lab, Friedrich-Alexander-University Erlangen-Nürnberg (FAU), Erlangen, Germany
| | - Felix Kluge
- Machine Learning and Data Analytics Lab, Friedrich-Alexander-University Erlangen-Nürnberg (FAU), Erlangen, Germany
| |
Collapse
|
17
|
Tietsch M, Muaremi A, Clay I, Kluge F, Hoefling H, Ullrich M, Küderle A, Eskofier BM, Müller A. Robust Step Detection from Different Waist-Worn Sensor Positions: Implications for Clinical Studies. Digit Biomark 2020; 4:50-58. [PMID: 33442580 PMCID: PMC7768099 DOI: 10.1159/000511611] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/31/2020] [Accepted: 09/15/2020] [Indexed: 11/19/2022] Open
Abstract
Analyzing human gait with inertial sensors provides valuable insights into a wide range of health impairments, including many musculoskeletal and neurological diseases. A representative and reliable assessment of gait requires continuous monitoring over long periods and ideally takes place in the subjects' habitual environment (real-world). An inconsistent sensor wearing position can affect gait characterization and influence clinical study results, thus clinical study protocols are typically highly proscriptive, instructing all participants to wear the sensor in a uniform manner. This restrictive approach improves data quality but reduces overall adherence. In this work, we analyze the impact of altering the sensor wearing position around the waist on sensor signal and step detection. We demonstrate that an asymmetrically worn sensor leads to additional odd-harmonic frequency components in the frequency spectrum. We propose a robust solution for step detection based on autocorrelation to overcome sensor position variation (sensitivity = 0.99, precision = 0.99). The proposed solution reduces the impact of inconsistent sensor positioning on gait characterization in clinical studies, thus providing more flexibility to protocol implementation and more freedom to participants to wear the sensor in the position most comfortable to them. This work is a first step towards truly position-agnostic gait assessment in clinical settings.
Collapse
Affiliation(s)
- Matthias Tietsch
- Novartis Institutes of Biomedical Research, Novartis Pharma AG, Basel, Switzerland
- Machine Learning and Data Analytics Lab, Department of Computer Science, Friedrich-Alexander University Erlangen-Nürnberg, Nürnberg, Germany
| | - Amir Muaremi
- Novartis Institutes of Biomedical Research, Novartis Pharma AG, Basel, Switzerland
| | - Ieuan Clay
- Evidation Health Inc., San Mateo, California, USA
| | - Felix Kluge
- Machine Learning and Data Analytics Lab, Department of Computer Science, Friedrich-Alexander University Erlangen-Nürnberg, Nürnberg, Germany
| | - Holger Hoefling
- Novartis Institutes of Biomedical Research, Novartis Pharma AG, Basel, Switzerland
| | - Martin Ullrich
- Machine Learning and Data Analytics Lab, Department of Computer Science, Friedrich-Alexander University Erlangen-Nürnberg, Nürnberg, Germany
| | - Arne Küderle
- Machine Learning and Data Analytics Lab, Department of Computer Science, Friedrich-Alexander University Erlangen-Nürnberg, Nürnberg, Germany
| | - Bjoern M. Eskofier
- Machine Learning and Data Analytics Lab, Department of Computer Science, Friedrich-Alexander University Erlangen-Nürnberg, Nürnberg, Germany
| | - Arne Müller
- Novartis Institutes of Biomedical Research, Novartis Pharma AG, Basel, Switzerland
| |
Collapse
|
18
|
Zrenner M, Küderle A, Roth N, Jensen U, Dümler B, Eskofier BM. Does the Position of Foot-Mounted IMU Sensors Influence the Accuracy of Spatio-Temporal Parameters in Endurance Running? Sensors (Basel) 2020; 20:E5705. [PMID: 33036477 PMCID: PMC7584014 DOI: 10.3390/s20195705] [Citation(s) in RCA: 18] [Impact Index Per Article: 4.5] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 09/15/2020] [Revised: 10/02/2020] [Accepted: 10/04/2020] [Indexed: 11/16/2022]
Abstract
Wearable sensor technology already has a great impact on the endurance running community. Smartwatches and heart rate monitors are heavily used to evaluate runners' performance and monitor their training progress. Additionally, foot-mounted inertial measurement units (IMUs) have drawn the attention of sport scientists due to the possibility to monitor biomechanically relevant spatio-temporal parameters outside the lab in real-world environments. Researchers developed and investigated algorithms to extract various features using IMU data of different sensor positions on the foot. In this work, we evaluate whether the sensor position of IMUs mounted to running shoes has an impact on the accuracy of different spatio-temporal parameters. We compare both the raw data of the IMUs at different sensor positions as well as the accuracy of six endurance running-related parameters. We contribute a study with 29 subjects wearing running shoes equipped with four IMUs on both the left and the right shoes and a motion capture system as ground truth. The results show that the IMUs measure different raw data depending on their position on the foot and that the accuracy of the spatio-temporal parameters depends on the sensor position. We recommend to integrate IMU sensors in a cavity in the sole of a running shoe under the foot's arch, because the raw data of this sensor position is best suitable for the reconstruction of the foot trajectory during a stride.
Collapse
Affiliation(s)
- Markus Zrenner
- Machine Learning and Data Analytics Lab, Department of Computer Science, Friedrich-Alexander-Universität Erlangen-Nürnberg (FAU), 91052 Erlangen, Germany; (A.K.); (N.R.); (B.M.E.)
| | - Arne Küderle
- Machine Learning and Data Analytics Lab, Department of Computer Science, Friedrich-Alexander-Universität Erlangen-Nürnberg (FAU), 91052 Erlangen, Germany; (A.K.); (N.R.); (B.M.E.)
| | - Nils Roth
- Machine Learning and Data Analytics Lab, Department of Computer Science, Friedrich-Alexander-Universität Erlangen-Nürnberg (FAU), 91052 Erlangen, Germany; (A.K.); (N.R.); (B.M.E.)
| | - Ulf Jensen
- Finance & IT - IT Innovation, Adidas AG, 91074 Herzogenaurach, Germany; (U.J.); (B.D.)
| | - Burkhard Dümler
- Finance & IT - IT Innovation, Adidas AG, 91074 Herzogenaurach, Germany; (U.J.); (B.D.)
| | - Bjoern M. Eskofier
- Machine Learning and Data Analytics Lab, Department of Computer Science, Friedrich-Alexander-Universität Erlangen-Nürnberg (FAU), 91052 Erlangen, Germany; (A.K.); (N.R.); (B.M.E.)
| |
Collapse
|
19
|
Ceron JD, Kluge F, Küderle A, Eskofier BM, López DM. Simultaneous Indoor Pedestrian Localization and House Mapping Based on Inertial Measurement Unit and Bluetooth Low-Energy Beacon Data. Sensors (Basel) 2020; 20:E4742. [PMID: 32842566 PMCID: PMC7506668 DOI: 10.3390/s20174742] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 06/21/2020] [Revised: 07/27/2020] [Accepted: 08/03/2020] [Indexed: 12/12/2022]
Abstract
Indoor location estimation is crucial to provide context-based assistance in home environments. In this study, a method for simultaneous indoor pedestrian localization and house mapping is proposed and evaluated. The method fuses a person's movement data from an Inertial Measurement Unit (IMU) with proximity and activity-related data from Bluetooth Low-Energy (BLE) beacons deployed in the indoor environment. The person's and beacons' localization is performed simultaneously using a combination of particle and Kalman Filters. We evaluated the method using data from eight participants who performed different activities in an indoor environment. As a result, the average participant's localization error was 1.05 ± 0.44 m, and the average beacons' localization error was 0.82 ± 0.24 m. The proposed method is able to construct a map of the indoor environment by localizing the BLE beacons and simultaneously locating the person. The results obtained demonstrate that the proposed method could point to a promising roadmap towards the development of simultaneous localization and home mapping system based only on one IMU and a few BLE beacons. To the best of our knowledge, this is the first method that includes the beacons' data movement as activity-related events in a method for pedestrian Simultaneous Localization and Mapping (SLAM).
Collapse
Affiliation(s)
- Jesus D. Ceron
- Telematics Engineering Research Group, Telematics Department, Universidad Del Cauca (Unicauca), Popayán 190002, Colombia;
- Machine Learning and Data Analytics Lab, Computer Science Department, Friedrich-Alexander University, Erlangen-Nürnberg (FAU), 91052 Erlangen, Germany; (F.K.); (A.K.)
| | - Felix Kluge
- Machine Learning and Data Analytics Lab, Computer Science Department, Friedrich-Alexander University, Erlangen-Nürnberg (FAU), 91052 Erlangen, Germany; (F.K.); (A.K.)
| | - Arne Küderle
- Machine Learning and Data Analytics Lab, Computer Science Department, Friedrich-Alexander University, Erlangen-Nürnberg (FAU), 91052 Erlangen, Germany; (F.K.); (A.K.)
| | - Bjoern M. Eskofier
- Machine Learning and Data Analytics Lab, Computer Science Department, Friedrich-Alexander University, Erlangen-Nürnberg (FAU), 91052 Erlangen, Germany; (F.K.); (A.K.)
| | - Diego M. López
- Telematics Engineering Research Group, Telematics Department, Universidad Del Cauca (Unicauca), Popayán 190002, Colombia;
| |
Collapse
|
20
|
Küderle A, Becker S, Disselhorst-Klug C. Increasing the Robustness of the automatic IMU calibration for lower Extremity Motion Analysis. Current Directions in Biomedical Engineering 2018. [DOI: 10.1515/cdbme-2018-0104] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/15/2022] Open
Abstract
AbstractWith the advances of IMU-based human motion tracking, joint angle tracking in an home environment has become a realistic goal. Achieving it, could enable novel applications in rehabilitation and sports medicine. However, in existing systems the process of aligning the mounted sensors with the body coordinate system is either not robust enough or to complicated for fully unsupervised usage. In this publication the performance of a promising existing algorithm is evaluated with a range of different calibration motions. Further, an extension to this implementation is proposed, aiming to improve its stability when only non-ideal calibration data is available. It could be validated that the modification of the algorithm can increase the stability and reduce the dependency of the calibration on specific calibration motions. Based on these results, we recommend the proposed extension of the algorithm as a drop-in replacement for the existing implementation.
Collapse
Affiliation(s)
- Arne Küderle
- 1Machine Learning and Data Analytics Lab, University of Erlangen-Nürnberg (FAU), Carl-Thiersch-Strasse 2b,Erlangen, Germany
| | - Sebastian Becker
- 2Department of Rehabilitation and Prevention Engineering, Institute of Applied Medical Engineering, RWTH Aachen University,Aachen, Germany
| | - Catherine Disselhorst-Klug
- 2Department of Rehabilitation and Prevention Engineering, Institute of Applied Medical Engineering, RWTH Aachen University,Aachen, Germany
| |
Collapse
|
21
|
Bauer A, Hertzberg O, Küderle A, Strobel D, Pleitez MA, Mäntele W. IR-spectroscopy of skin in vivo: Optimal skin sites and properties for non-invasive glucose measurement by photoacoustic and photothermal spectroscopy. J Biophotonics 2018; 11:e201600261. [PMID: 28417584 DOI: 10.1002/jbio.201600261] [Citation(s) in RCA: 16] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 10/11/2016] [Revised: 01/18/2017] [Accepted: 01/21/2017] [Indexed: 05/23/2023]
Abstract
We have reported two methods to analyze glucose in the interstitial fluid of skin based on mid-infrared excitation with a tunable quantum cascade laser and photoacoustic or photothermal detection. These methods were evaluated for optimum skin locations to obtain reproducible glucose information. The lower part of the arm, the hypothenar, the tips of the index finger and the thumb were tested. The thumb appears to be the optimal skin location, followed by the index finger. Basic requirements for an optimum site are good capillary blood perfusion, low Stratum corneum thickness and the absence of fat layers. To obtain a correlation on such a site, spectra were recorded on volunteers continuously after blood glucose manipulation. However, continuous measurements on an in vivo sample such as the skin have to cope with physiological alterations such as the formation of sweat. We have used both detection schemes to investigate the acid mantle reformation after washing during time scales similar to continuous measurements for calibration spectra. We found that reconstitution of the acid mantle of skin may be seen in less than one hour. Precleaning of the measurement site may thus be useful for intermittent, but not for long term continuous measurements.
Collapse
Affiliation(s)
- Alexander Bauer
- Institut für Biophysik, Goethe Universität Frankfurt, Max-von-Laue-Str. 1, D-60438 Frankfurt am Main, Germany
| | - Otto Hertzberg
- Institut für Biophysik, Goethe Universität Frankfurt, Max-von-Laue-Str. 1, D-60438 Frankfurt am Main, Germany
| | - Arne Küderle
- Institut für Biophysik, Goethe Universität Frankfurt, Max-von-Laue-Str. 1, D-60438 Frankfurt am Main, Germany
| | - Dominik Strobel
- Institut für Biophysik, Goethe Universität Frankfurt, Max-von-Laue-Str. 1, D-60438 Frankfurt am Main, Germany
| | - Miguel A Pleitez
- Helmholtz-Zentrum München, Institute for Biological and Medical Imaging, D-, 85764, Neuherberg, Germany
| | - Werner Mäntele
- Institut für Biophysik, Goethe Universität Frankfurt, Max-von-Laue-Str. 1, D-60438 Frankfurt am Main, Germany
| |
Collapse
|
22
|
Hertzberg O, Bauer A, Küderle A, Pleitez MA, Mäntele W. Depth-selective photothermal IR spectroscopy of skin: potential application for non-invasive glucose measurement. Analyst 2017; 142:495-502. [DOI: 10.1039/c6an02278b] [Citation(s) in RCA: 32] [Impact Index Per Article: 4.6] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/21/2022]
Abstract
Photothermal depth profiling is applied to total internal reflection enhanced photothermal deflection spectroscopy (TIR-PTDS) in order to study skin characteristicsin vivoand to improve the sensing technique for non-invasive glucose monitoring.
Collapse
Affiliation(s)
- Otto Hertzberg
- Institute für Biophysik
- Goethe-Universität Frankfurt
- 60438 Frankfurt am Main
- Germany
| | - Alexander Bauer
- Institute für Biophysik
- Goethe-Universität Frankfurt
- 60438 Frankfurt am Main
- Germany
| | - Arne Küderle
- Institute für Biophysik
- Goethe-Universität Frankfurt
- 60438 Frankfurt am Main
- Germany
| | - Miguel A. Pleitez
- Institute für Biophysik
- Goethe-Universität Frankfurt
- 60438 Frankfurt am Main
- Germany
| | - Werner Mäntele
- Institute für Biophysik
- Goethe-Universität Frankfurt
- 60438 Frankfurt am Main
- Germany
| |
Collapse
|