1
|
Kim D, Jin Y, Cho H, Jones T, Zhou YM, Fadaie A, Popov D, Swaminathan K, Walsh CJ. Learning-based 3D human kinematics estimation using behavioral constraints from activity classification. Nat Commun 2025; 16:3454. [PMID: 40216761 PMCID: PMC11992036 DOI: 10.1038/s41467-025-58624-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/15/2024] [Accepted: 03/28/2025] [Indexed: 04/14/2025] Open
Abstract
Inertial measurement units offer a cost-effective, portable alternative to lab-based motion capture systems. However, measuring joint angles and movement trajectories with inertial measurement units is challenging due to signal drift errors caused by biases and noise, which are amplified by numerical integration. Existing approaches use anatomical constraints to reduce drift but require body parameter measurements. Learning-based approaches show promise but often lack accuracy for broad applications (e.g., strength training). Here, we introduce the Activity-in-the-loop Kinematics Estimator, an end-to-end machine learning model incorporating human behavioral constraints for enhanced kinematics estimation using two inertial measurement units. It integrates activity classification with kinematics estimation, leveraging limited movement patterns during specific activities. In dynamic scenarios, our approach achieved trajectory and shoulder joint angle errors under 0.021 m and 6 . 5 ∘ , respectively, 52% and 17% lower than errors without including activity classification. These results highlight accurate motion tracking with minimal inertial measurement units and domain-specific context.
Collapse
Affiliation(s)
- Daekyum Kim
- John A. Paulson School of Engineering and Applied Sciences, Harvard University, Cambridge, MA, USA
- School of Mechanical Engineering, Korea University, Seoul, Republic of Korea
- School of Smart Mobility, Korea University, Seoul, Republic of Korea
| | - Yichu Jin
- John A. Paulson School of Engineering and Applied Sciences, Harvard University, Cambridge, MA, USA
| | - Haedo Cho
- John A. Paulson School of Engineering and Applied Sciences, Harvard University, Cambridge, MA, USA
| | - Truman Jones
- John A. Paulson School of Engineering and Applied Sciences, Harvard University, Cambridge, MA, USA
| | - Yu Meng Zhou
- John A. Paulson School of Engineering and Applied Sciences, Harvard University, Cambridge, MA, USA
| | - Ameneh Fadaie
- John A. Paulson School of Engineering and Applied Sciences, Harvard University, Cambridge, MA, USA
| | - Dmitry Popov
- John A. Paulson School of Engineering and Applied Sciences, Harvard University, Cambridge, MA, USA
| | - Krithika Swaminathan
- John A. Paulson School of Engineering and Applied Sciences, Harvard University, Cambridge, MA, USA
| | - Conor J Walsh
- John A. Paulson School of Engineering and Applied Sciences, Harvard University, Cambridge, MA, USA.
| |
Collapse
|
2
|
Yan F, Gong J, Zhang Q, He H. Learning Motion Primitives for the Quantification and Diagnosis of Mobility Deficits. IEEE Trans Biomed Eng 2024; 71:3339-3349. [PMID: 38776195 DOI: 10.1109/tbme.2024.3404357] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 05/24/2024]
Abstract
The severity of mobility deficits is one of the most critical parameters in the diagnosis of Parkinson's disease (PD) and rehabilitation. The current approach for severity evaluation is clinical scaling that relies on a clinician's subjective observations and experience, and the observation in laboratories or clinics may not suffice to reflect the severity of motion deficits as compared to daily living activities. This paper presents an approach to modeling and quantifying the severity of mobility deficits from motion data by using nonintrusive wearable physio-biological sensors. The approach provides a user-specific metric that measures mobility deficits in terms of the quantities of motion primitives that are learned from motion tracking data. The proposed method achieved 99.84% prediction accuracy on laboratory data and 93.95% prediction accuracy on clinical data. This approach presents the potential to supplant traditional observation-based clinical scaling, providing an avenue for real-time feedback to fortify positive progression throughout the course of rehabilitation.
Collapse
|
3
|
Liu S, Zhou S, Li B, Niu Z, Abdullah M, Wang R. Servo torque fault diagnosis implementation for heavy-legged robots using insufficient information. ISA TRANSACTIONS 2024; 147:439-452. [PMID: 38350797 DOI: 10.1016/j.isatra.2024.02.004] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/16/2023] [Revised: 12/02/2023] [Accepted: 02/07/2024] [Indexed: 02/15/2024]
Abstract
The reliability of sensors and servos is paramount in diagnosing the Heavy-Legged Robot (HLR). Servo faults stemming from mechanical wear, environmental disturbances, or electrical issues pose significant challenges to traditional diagnostic methods, which rely heavily on delicate sensors. This study introduces a framework that solely relies on joint position and permanent magnet synchronous motor (PMSM) information to mitigate dependency on fragile sensors for servo-fault diagnosis. An essential contribution involves refining a model that directly connects PMSM currents to HLR motion. Moreover, to address scenarios where actual servo outputs and HLR cylinder velocities are unavailable, an improved sliding mode observer (ISMO) is proposed. Additionally, a Fourier expansion model characterizes the relationship between operation time and fault-free disturbance in the HLR. Subsequently, the dual-line particle filter (DPF) algorithm is employed to predict fault-free disturbance. The outputs of DPF serve as a feedforward to the ISMO, enabling the real-time servo torque fault diagnosis. The accuracy and validity of this technical framework are verified through various simulations in MATLAB/SIMSCAPE and real-world experiments.
Collapse
Affiliation(s)
- Shaoxun Liu
- Shanghai Jiao Tong University, School of Mechanical Engineering, 800 Dongchuan RD. Minhang District, Shanghai, 200240, China.
| | - Shiyu Zhou
- Shanghai Jiao Tong University, School of Mechanical Engineering, 800 Dongchuan RD. Minhang District, Shanghai, 200240, China.
| | - Boyuan Li
- Shanghai Jiao Tong University, School of Mechanical Engineering, 800 Dongchuan RD. Minhang District, Shanghai, 200240, China.
| | - Zhihua Niu
- Shanghai Jiao Tong University, School of Mechanical Engineering, 800 Dongchuan RD. Minhang District, Shanghai, 200240, China.
| | - Mohamed Abdullah
- Shanghai Jiao Tong University, School of Mechanical Engineering, 800 Dongchuan RD. Minhang District, Shanghai, 200240, China.
| | - Rongrong Wang
- Shanghai Jiao Tong University, School of Mechanical Engineering, 800 Dongchuan RD. Minhang District, Shanghai, 200240, China.
| |
Collapse
|
4
|
Venås GA, Stølen MF, Kyrkjebø E. Exploring human-robot cooperation with gamified user training: a user study on cooperative lifting. Front Robot AI 2024; 10:1290104. [PMID: 38283803 PMCID: PMC10811071 DOI: 10.3389/frobt.2023.1290104] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/06/2023] [Accepted: 12/05/2023] [Indexed: 01/30/2024] Open
Abstract
Human-robot cooperation (HRC) is becoming increasingly relevant with the surge in collaborative robots (cobots) for industrial applications. Examples of humans and robots cooperating actively on the same workpiece can be found in research labs around the world, but industrial applications are still mostly limited to robots and humans taking turns. In this paper, we use a cooperative lifting task (co-lift) as a case study to explore how well this task can be learned within a limited time, and how background factors of users may impact learning. The experimental study included 32 healthy adults from 20 to 54 years who performed a co-lift with a collaborative robot. The physical setup is designed as a gamified user training system as research has validated that gamification is an effective methodology for user training. Human motions and gestures were measured using Inertial Measurement Unit (IMU) sensors and used to interact with the robot across three role distributions: human as the leader, robot as the leader, and shared leadership. We find that regardless of age, gender, job category, gaming background, and familiarity with robots, the learning curve of all users showed a satisfactory progression and that all users could achieve successful cooperation with the robot on the co-lift task after seven or fewer trials. The data indicates that some of the background factors of the users such as occupation, past gaming habits, etc., may affect learning outcomes, which will be explored further in future experiments. Overall, the results indicate that the potential of the adoption of HRC in the industry is promising for a diverse set of users after a relatively short training process.
Collapse
|
5
|
Du B, Lv Y, Liu L, Liu Y. High-Range and High-Linearity 2D Angle Measurement System for a Fast Steering Mirror. SENSORS (BASEL, SWITZERLAND) 2023; 23:9192. [PMID: 38005578 PMCID: PMC10675254 DOI: 10.3390/s23229192] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/03/2023] [Revised: 11/11/2023] [Accepted: 11/14/2023] [Indexed: 11/26/2023]
Abstract
In order to solve the problem of the insufficient range of the traditional fast mirror (FSM) angle measurement system in practical applications, a 2D large-angle FSM photoelectric angle measurement system based on the principle of diffuse reflection is proposed. A mathematical model of the angle measurement system is established by combining the physical properties of the diffuse reflecting plate, such as the rotation angle, rotation center, rotation radius, reflection coefficient and the radius of the diffuse reflecting surface. This paper proposes a method that optimizes the degree of nonlinearity based on this mathematical model. The system is designed and tested. The experimental results show that changing the diffuse reflection surface area can improve the nonlinearity of the angle measurement system effectively. When the radius of the diffuse reflection surface is 3.3 mm, the range is ±20°, the non-linearity is 0.74%, and the resolution can reach up to 2.3″. The system's body is simple and compact. It is also capable of measuring a wider range of angles while linearity is guaranteed.
Collapse
Affiliation(s)
| | - Yong Lv
- Instrumental Science and Optoelectronic Engineering Faculty, Beijing Information Science & Technology University, Beijing 100192, China; (B.D.); (L.L.); (Y.L.)
| | | | | |
Collapse
|
6
|
Chen H, Schall MC, Martin SM, Fethke NB. Drift-Free Joint Angle Calculation Using Inertial Measurement Units without Magnetometers: An Exploration of Sensor Fusion Methods for the Elbow and Wrist. SENSORS (BASEL, SWITZERLAND) 2023; 23:7053. [PMID: 37631592 PMCID: PMC10458653 DOI: 10.3390/s23167053] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/13/2023] [Revised: 08/05/2023] [Accepted: 08/07/2023] [Indexed: 08/27/2023]
Abstract
Joint angles of the lower extremities have been calculated using gyroscope and accelerometer measurements from inertial measurement units (IMUs) without sensor drift by leveraging kinematic constraints. However, it is unknown whether these methods are generalizable to the upper extremity due to differences in motion dynamics. Furthermore, the extent that post-processed sensor fusion algorithms can improve measurement accuracy relative to more commonly used Kalman filter-based methods remains unknown. This study calculated the elbow and wrist joint angles of 13 participants performing a simple ≥30 min material transfer task at three rates (slow, medium, fast) using IMUs and kinematic constraints. The best-performing sensor fusion algorithm produced total root mean square errors (i.e., encompassing all three motion planes) of 6.6°, 3.6°, and 2.0° for the slow, medium, and fast transfer rates for the elbow and 2.2°, 1.7°, and 1.5° for the wrist, respectively.
Collapse
Affiliation(s)
- Howard Chen
- Industrial & Systems Engineering and Engineering Management Department, University of Alabama in Huntsville, Huntsville, AL 35899, USA
| | - Mark C. Schall
- Department of Industrial & Systems Engineering, Auburn University, Auburn, AL 36849, USA;
| | - Scott M. Martin
- Department of Mechanical Engineering, Auburn University, Auburn, AL 36849, USA;
| | - Nathan B. Fethke
- Department of Occupational & Environmental Health, The University of Iowa, Iowa City, IA 52242, USA;
| |
Collapse
|
7
|
Bonifati P, Baracca M, Menolotto M, Averta G, Bianchi M. A Multi-Modal Under-Sensorized Wearable System for Optimal Kinematic and Muscular Tracking of Human Upper Limb Motion. SENSORS (BASEL, SWITZERLAND) 2023; 23:3716. [PMID: 37050776 PMCID: PMC10098930 DOI: 10.3390/s23073716] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 02/28/2023] [Revised: 03/24/2023] [Accepted: 03/30/2023] [Indexed: 06/19/2023]
Abstract
Wearable sensing solutions have emerged as a promising paradigm for monitoring human musculoskeletal state in an unobtrusive way. To increase the deployability of these systems, considerations related to cost reduction and enhanced form factor and wearability tend to discourage the number of sensors in use. In our previous work, we provided a theoretical solution to the problem of jointly reconstructing the entire muscular-kinematic state of the upper limb, when only a limited amount of optimally retrieved sensory data are available. However, the effective implementation of these methods in a physical, under-sensorized wearable has never been attempted before. In this work, we propose to bridge this gap by presenting an under-sensorized system based on inertial measurement units (IMUs) and surface electromyography (sEMG) electrodes for the reconstruction of the upper limb musculoskeletal state, focusing on the minimization of the sensors' number. We found that, relying on two IMUs only and eight sEMG sensors, we can conjointly reconstruct all 17 degrees of freedom (five joints, twelve muscles) of the upper limb musculoskeletal state, yielding a median normalized RMS error of 8.5% on the non-measured joints and 2.5% on the non-measured muscles.
Collapse
Affiliation(s)
- Paolo Bonifati
- Research Center “E. Piaggio”, Department of Information Engineering, University of Pisa, Largo Lucio Lazzarino 1, 56126 Pisa, Italy
| | - Marco Baracca
- Research Center “E. Piaggio”, Department of Information Engineering, University of Pisa, Largo Lucio Lazzarino 1, 56126 Pisa, Italy
| | - Mariangela Menolotto
- Research Center “E. Piaggio”, Department of Information Engineering, University of Pisa, Largo Lucio Lazzarino 1, 56126 Pisa, Italy
| | - Giuseppe Averta
- Department of Control and Computer Engineering, Politecnico di Torino, 10129 Torino, Italy
| | - Matteo Bianchi
- Research Center “E. Piaggio”, Department of Information Engineering, University of Pisa, Largo Lucio Lazzarino 1, 56126 Pisa, Italy
| |
Collapse
|
8
|
Mason R, Pearson LT, Barry G, Young F, Lennon O, Godfrey A, Stuart S. Wearables for Running Gait Analysis: A Systematic Review. Sports Med 2023; 53:241-268. [PMID: 36242762 PMCID: PMC9807497 DOI: 10.1007/s40279-022-01760-6] [Citation(s) in RCA: 42] [Impact Index Per Article: 21.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 08/21/2022] [Indexed: 01/12/2023]
Abstract
BACKGROUND Running gait assessment has traditionally been performed using subjective observation or expensive laboratory-based objective technologies, such as three-dimensional motion capture or force plates. However, recent developments in wearable devices allow for continuous monitoring and analysis of running mechanics in any environment. Objective measurement of running gait is an important (clinical) tool for injury assessment and provides measures that can be used to enhance performance. OBJECTIVES We aimed to systematically review the available literature investigating how wearable technology is being used for running gait analysis in adults. METHODS A systematic search of the literature was conducted in the following scientific databases: PubMed, Scopus, Web of Science and SPORTDiscus. Information was extracted from each included article regarding the type of study, participants, protocol, wearable device(s), main outcomes/measures, analysis and key findings. RESULTS A total of 131 articles were reviewed: 56 investigated the validity of wearable technology, 22 examined the reliability and 77 focused on applied use. Most studies used inertial measurement units (n = 62) [i.e. a combination of accelerometers, gyroscopes and magnetometers in a single unit] or solely accelerometers (n = 40), with one using gyroscopes alone and 31 using pressure sensors. On average, studies used one wearable device to examine running gait. Wearable locations were distributed among the shank, shoe and waist. The mean number of participants was 26 (± 27), with an average age of 28.3 (± 7.0) years. Most studies took place indoors (n = 93), using a treadmill (n = 62), with the main aims seeking to identify running gait outcomes or investigate the effects of injury, fatigue, intrinsic factors (e.g. age, sex, morphology) or footwear on running gait outcomes. Generally, wearables were found to be valid and reliable tools for assessing running gait compared to reference standards. CONCLUSIONS This comprehensive review highlighted that most studies that have examined running gait using wearable sensors have done so with young adult recreational runners, using one inertial measurement unit sensor, with participants running on a treadmill and reporting outcomes of ground contact time, stride length, stride frequency and tibial acceleration. Future studies are required to obtain consensus regarding terminology, protocols for testing validity and the reliability of devices and suitability of gait outcomes. CLINICAL TRIAL REGISTRATION CRD42021235527.
Collapse
Affiliation(s)
- Rachel Mason
- Department of Sport, Exercise and Rehabilitation, Faculty of Health and Life Sciences, Northumbria University, Newcastle upon Tyne, UK
| | - Liam T Pearson
- Department of Sport, Exercise and Rehabilitation, Faculty of Health and Life Sciences, Northumbria University, Newcastle upon Tyne, UK
| | - Gillian Barry
- Department of Sport, Exercise and Rehabilitation, Faculty of Health and Life Sciences, Northumbria University, Newcastle upon Tyne, UK
| | - Fraser Young
- Department of Computer and Information Sciences, Northumbria University, Newcastle upon Tyne, UK
| | | | - Alan Godfrey
- Department of Computer and Information Sciences, Northumbria University, Newcastle upon Tyne, UK
| | - Samuel Stuart
- Department of Sport, Exercise and Rehabilitation, Faculty of Health and Life Sciences, Northumbria University, Newcastle upon Tyne, UK.
- Northumbria Healthcare NHS Foundation Trust, Newcastle upon Tyne, UK.
| |
Collapse
|
9
|
Shi J, Ghaffar A, Li Y, Mehdi I, Mehdi R, A. Soomro F, Hussain S, Mehdi M, Li Q, Li Z. Dynamic Rotational Sensor Using Polymer Optical Fiber for Robot Movement Assessment Based on Intensity Variation. Polymers (Basel) 2022; 14:polym14235167. [PMID: 36501562 PMCID: PMC9737921 DOI: 10.3390/polym14235167] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/12/2022] [Revised: 11/18/2022] [Accepted: 11/23/2022] [Indexed: 11/30/2022] Open
Abstract
A complex signal processing technique is usually required to process the data in most sensor design structures, and integration into real applications is also challenging. This work presents a dynamic rotational sensor using polymethyl methacrylate (PMMA) fiber for robot movement assessment. The sensor design structure is based on the coupling of light intensity, in which two PMMA fibers are twisted together. Both fibers are bent after twisting and attached on the linear translation stage, which is further attached to the robot. The variation in bending radius causes the bending loss, and that loss is coupled in the second fiber. The change in the macro-bend radius corresponds to the rotation of the robot. Experimental results indicate that the sensor can operate in full rotational cycle (i.e., 0°-360°) as well as for clock and anti-clockwise rotation. Moreover, different rotational speeds (2°/s, 3°/s, 5°/s, and 10°/s) were carried out. The hysteresis loss of the sensor was about 0.77% and the sensitivity was 8.69 nW/°. The presented dynamic rotational sensor is cost-effective and easily integrated into the robot structure to analyze the robot's circular motion.
Collapse
Affiliation(s)
- Jianwei Shi
- Department of Automation, Taiyuan Institute of Technology, Taiyuan 030051, China
| | - Abdul Ghaffar
- State Key Laboratory of Geomechanics and Geotechnical Engineering, Institute of Rock and Soil Mechanics, Chinese Academy of Sciences, Wuhan 430071, China
- University of Chinese Academy of Sciences, Beijing 100049, China
- Correspondence: or (A.G.); (Y.L.); (M.M.)
| | - Yongwei Li
- Department of Automation, Taiyuan Institute of Technology, Taiyuan 030051, China
- Science and Technology on Electronic Test & Measurement Laboratory, North University of China, Taiyuan 030051, China
- Correspondence: or (A.G.); (Y.L.); (M.M.)
| | - Irfan Mehdi
- Department of Chemical Engineering, QUEST Nawabshah, Nawabshah 67450, Pakistan
| | - Rehan Mehdi
- National Centre of Excellence in Analytical Chemistry, University of Sindh, Jamshoro 76060, Pakistan
| | - Fayaz A. Soomro
- Department of Management Science, Qurtuba University of Science and Information Technology, Peshawar 24800, Pakistan
| | - Sadam Hussain
- Key Laboratory of Air-Driven Equipment Technology of Zhejiang Province, College of Mechanical Engineering, Quzhou University, Quzhou 324000, China
- Institute of Turbomachinery, Xi’an Jiatong University, Xi’an 710049, China
| | - Mujahid Mehdi
- National Centre of Excellence in Analytical Chemistry, University of Sindh, Jamshoro 76060, Pakistan
- Correspondence: or (A.G.); (Y.L.); (M.M.)
| | - Qiang Li
- Science and Technology on Electronic Test & Measurement Laboratory, North University of China, Taiyuan 030051, China
| | - Zhiqiang Li
- Science and Technology on Electronic Test & Measurement Laboratory, North University of China, Taiyuan 030051, China
| |
Collapse
|
10
|
Liu Z, Kong J, Qu M, Zhao G, Zhang C. Progress in Data Acquisition of Wearable Sensors. BIOSENSORS 2022; 12:889. [PMID: 36291026 PMCID: PMC9599646 DOI: 10.3390/bios12100889] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 09/08/2022] [Revised: 10/10/2022] [Accepted: 10/13/2022] [Indexed: 06/16/2023]
Abstract
Wearable sensors have demonstrated wide applications from medical treatment, health monitoring to real-time tracking, human-machine interface, smart home, and motion capture because of the capability of in situ and online monitoring. Data acquisition is extremely important for wearable sensors, including modules of probes, signal conditioning, and analog-to-digital conversion. However, signal conditioning, analog-to-digital conversion, and data transmission have received less attention than probes, especially flexible sensing materials, in research on wearable sensors. Here, as a supplement, this paper systematically reviews the recent progress of characteristics, applications, and optimizations of transistor amplifiers and typical filters in signal conditioning, and mainstream analog-to-digital conversion strategies. Moreover, possible research directions on the data acquisition of wearable sensors are discussed at the end of the paper.
Collapse
|
11
|
Yun D, Park C, Park D, Kim HS. Magnetorheological damper for vibration reduction in a robot arm. INTEL SERV ROBOT 2022. [DOI: 10.1007/s11370-022-00445-3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/28/2022]
|
12
|
Alarcón-Aldana AC, Callejas-Cuervo M, Bastos-Filho T, Bó APL. A Kinematic Information Acquisition Model That Uses Digital Signals from an Inertial and Magnetic Motion Capture System. SENSORS (BASEL, SWITZERLAND) 2022; 22:4898. [PMID: 35808393 PMCID: PMC9269534 DOI: 10.3390/s22134898] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 06/01/2022] [Revised: 06/15/2022] [Accepted: 06/23/2022] [Indexed: 11/29/2022]
Abstract
This paper presents a model that enables the transformation of digital signals generated by an inertial and magnetic motion capture system into kinematic information. First, the operation and data generated by the used inertial and magnetic system are described. Subsequently, the five stages of the proposed model are described, concluding with its implementation in a virtual environment to display the kinematic information. Finally, the applied tests are presented to evaluate the performance of the model through the execution of four exercises on the upper limb: flexion and extension of the elbow, and pronation and supination of the forearm. The results show a mean squared error of 3.82° in elbow flexion-extension movements and 3.46° in forearm pronation-supination movements. The results were obtained by comparing the inertial and magnetic system versus an optical motion capture system, allowing for the identification of the usability and functionality of the proposed model.
Collapse
Affiliation(s)
| | - Mauro Callejas-Cuervo
- Faculty of Engineering, Universidad Pedagógica y Tecnológica de Colombia, Tunja 150002, Colombia;
| | - Teodiano Bastos-Filho
- Postgraduate Program in Electrical Engineering, Federal University of Espírito Santo, Vitória 29075-910, Brazil;
| | - Antônio Padilha Lanari Bó
- School of Information Technology and Electrical Engineering, The University of Queensland, Brisbane 4072, Australia;
| |
Collapse
|
13
|
Smith Fine A, Kaufman M, Goodman J, Turk B, Bastian A, Lin D, Fatemi A, Keller J. Wearable sensors detect impaired gait and coordination in LBSL during remote assessments. Ann Clin Transl Neurol 2022; 9:468-477. [PMID: 35257509 PMCID: PMC8994975 DOI: 10.1002/acn3.51509] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/29/2021] [Revised: 12/17/2021] [Accepted: 12/28/2021] [Indexed: 02/02/2023] Open
Abstract
Background Leukoencephalopathy with brainstem and spinal cord involvement and lactate elevation (LBSL) is a rare leukodystrophy with motor impairment due to biallelic mutations in DARS2, which encodes mitochondrial aspartyl tRNA synthetase. Progressive ataxia is the primary feature. Objective The study objective is to determine the feasibility of remotely collecting quantitative gait and balance measures in LBSL. Methods The study design uses wearable accelerometers and the scale for the assessment and rating of ataxia (SARA) scale to assess gait and postural sway in LBSL and control participants' homes through video conferencing. Results Lateral step variability (LSV), which indicates stride variability, and elevation of the step at mid‐swing are increased for LBSL patients during brief walking tests. During stance with the eyes closed, LBSL participants show rapid accelerations and decelerations of body movement covering a large sway area and path. Both the LSV and sway area during stance with the feet together and eyes closed correlate strongly with the SARA. Conclusions Wearable accelerometers are valid and sensitive for detecting ataxia in LBSL patients during remote assessments. The finding of large increases in the sway area during stance with the eyes closed is intriguing since dorsal column dysfunction is universally seen in LBSL. This approach can be applied to related rare diseases that feature ataxia.
Collapse
Affiliation(s)
- Amena Smith Fine
- Department of Neurology and Developmental Medicine, Kennedy Krieger Institute, Baltimore, Maryland, USA
| | - Miriam Kaufman
- Department of Neurology and Developmental Medicine, Kennedy Krieger Institute, Baltimore, Maryland, USA
| | - Jordan Goodman
- Department of Neurology and Developmental Medicine, Kennedy Krieger Institute, Baltimore, Maryland, USA
| | - Bela Turk
- Department of Neurology and Developmental Medicine, Kennedy Krieger Institute, Baltimore, Maryland, USA
| | - Amy Bastian
- Center for Movement Studies, Kennedy Krieger Institute, Baltimore, Maryland, USA
| | - Doris Lin
- Department of Radiology and Radiological Science, Johns Hopkins University School of Medicine, Baltimore, Maryland, USA
| | - Ali Fatemi
- Department of Neurology and Developmental Medicine, Kennedy Krieger Institute, Baltimore, Maryland, USA
| | - Jennifer Keller
- Center for Movement Studies, Kennedy Krieger Institute, Baltimore, Maryland, USA
| |
Collapse
|
14
|
González-Alonso J, Oviedo-Pastor D, Aguado HJ, Díaz-Pernas FJ, González-Ortega D, Martínez-Zarzuela M. Custom IMU-Based Wearable System for Robust 2.4 GHz Wireless Human Body Parts Orientation Tracking and 3D Movement Visualization on an Avatar. SENSORS 2021; 21:s21196642. [PMID: 34640961 PMCID: PMC8512038 DOI: 10.3390/s21196642] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 08/03/2021] [Revised: 09/30/2021] [Accepted: 09/30/2021] [Indexed: 02/06/2023]
Abstract
Recent studies confirm the applicability of Inertial Measurement Unit (IMU)-based systems for human motion analysis. Notwithstanding, high-end IMU-based commercial solutions are yet too expensive and complex to democratize their use among a wide range of potential users. Less featured entry-level commercial solutions are being introduced in the market, trying to fill this gap, but still present some limitations that need to be overcome. At the same time, there is a growing number of scientific papers using not commercial, but custom do-it-yourself IMU-based systems in medical and sports applications. Even though these solutions can help to popularize the use of this technology, they have more limited features and the description on how to design and build them from scratch is yet too scarce in the literature. The aim of this work is two-fold: (1) Proving the feasibility of building an affordable custom solution aimed at simultaneous multiple body parts orientation tracking; while providing a detailed bottom-up description of the required hardware, tools, and mathematical operations to estimate and represent 3D movement in real-time. (2) Showing how the introduction of a custom 2.4 GHz communication protocol including a channel hopping strategy can address some of the current communication limitations of entry-level commercial solutions. The proposed system can be used for wireless real-time human body parts orientation tracking with up to 10 custom sensors, at least at 50 Hz. In addition, it provides a more reliable motion data acquisition in Bluetooth and Wi-Fi crowded environments, where the use of entry-level commercial solutions might be unfeasible. This system can be used as a groundwork for developing affordable human motion analysis solutions that do not require an accurate kinematic analysis.
Collapse
Affiliation(s)
- Javier González-Alonso
- Grupo de Telemática e Imagen, Universidad de Valladolid, 47011 Valladolid, Spain; (D.O.-P.); (F.J.D.-P.); (D.G.-O.)
- Correspondence: (J.G.-A.); (M.M.-Z.)
| | - David Oviedo-Pastor
- Grupo de Telemática e Imagen, Universidad de Valladolid, 47011 Valladolid, Spain; (D.O.-P.); (F.J.D.-P.); (D.G.-O.)
| | - Héctor J. Aguado
- Unidad de Traumatología, Hospital Clínico Universitario de Valladolid, 47003 Valladolid, Spain;
| | - Francisco J. Díaz-Pernas
- Grupo de Telemática e Imagen, Universidad de Valladolid, 47011 Valladolid, Spain; (D.O.-P.); (F.J.D.-P.); (D.G.-O.)
| | - David González-Ortega
- Grupo de Telemática e Imagen, Universidad de Valladolid, 47011 Valladolid, Spain; (D.O.-P.); (F.J.D.-P.); (D.G.-O.)
| | - Mario Martínez-Zarzuela
- Grupo de Telemática e Imagen, Universidad de Valladolid, 47011 Valladolid, Spain; (D.O.-P.); (F.J.D.-P.); (D.G.-O.)
- Correspondence: (J.G.-A.); (M.M.-Z.)
| |
Collapse
|
15
|
Hallett M, DelRosso LM, Elble R, Ferri R, Horak FB, Lehericy S, Mancini M, Matsuhashi M, Matsumoto R, Muthuraman M, Raethjen J, Shibasaki H. Evaluation of movement and brain activity. Clin Neurophysiol 2021; 132:2608-2638. [PMID: 34488012 PMCID: PMC8478902 DOI: 10.1016/j.clinph.2021.04.023] [Citation(s) in RCA: 27] [Impact Index Per Article: 6.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/23/2021] [Revised: 04/07/2021] [Accepted: 04/25/2021] [Indexed: 11/25/2022]
Abstract
Clinical neurophysiology studies can contribute important information about the physiology of human movement and the pathophysiology and diagnosis of different movement disorders. Some techniques can be accomplished in a routine clinical neurophysiology laboratory and others require some special equipment. This review, initiating a series of articles on this topic, focuses on the methods and techniques. The methods reviewed include EMG, EEG, MEG, evoked potentials, coherence, accelerometry, posturography (balance), gait, and sleep studies. Functional MRI (fMRI) is also reviewed as a physiological method that can be used independently or together with other methods. A few applications to patients with movement disorders are discussed as examples, but the detailed applications will be the subject of other articles.
Collapse
Affiliation(s)
- Mark Hallett
- Human Motor Control Section, National Institute of Neurological Disorders and Stroke, NIH, Bethesda, MD, USA.
| | | | - Rodger Elble
- Department of Neurology, Southern Illinois University School of Medicine, Springfield, IL, USA
| | | | - Fay B Horak
- Department of Neurology, Oregon Health & Science University, Portland, OR, USA
| | - Stephan Lehericy
- Paris Brain Institute (ICM), Centre de NeuroImagerie de Recherche (CENIR), Team "Movement, Investigations and Therapeutics" (MOV'IT), INSERM U 1127, CNRS UMR 7225, Sorbonne Université, Paris, France
| | - Martina Mancini
- Department of Neurology, Oregon Health & Science University, Portland, OR, USA
| | - Masao Matsuhashi
- Department of Epilepsy, Movement Disorders and Physiology, Kyoto University Graduate, School of Medicine, Japan
| | - Riki Matsumoto
- Division of Neurology, Kobe University Graduate School of Medicine, Japan
| | - Muthuraman Muthuraman
- Section of Movement Disorders and Neurostimulation, Biomedical Statistics and Multimodal Signal Processing unit, Department of Neurology, Focus Program Translational Neuroscience (FTN), University Medical Center of the Johannes Gutenberg-University Mainz, Mainz, Germany
| | - Jan Raethjen
- Neurology Outpatient Clinic, Preusserstr. 1-9, 24105 Kiel, Germany
| | | |
Collapse
|
16
|
Recognizing Physical Activities for Spinal Cord Injury Rehabilitation Using Wearable Sensors. SENSORS 2021; 21:s21165479. [PMID: 34450921 PMCID: PMC8398510 DOI: 10.3390/s21165479] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 06/06/2021] [Revised: 07/24/2021] [Accepted: 08/12/2021] [Indexed: 11/16/2022]
Abstract
The research area of activity recognition is fast growing with diverse applications. However, advances in this field have not yet been used to monitor the rehabilitation of individuals with spinal cord injury. Noteworthily, relying on patient surveys to assess adherence can undermine the outcomes of rehabilitation. Therefore, this paper presents and implements a systematic activity recognition method to recognize physical activities applied by subjects during rehabilitation for spinal cord injury. In the method, raw sensor data are divided into fragments using a dynamic segmentation technique, providing higher recognition performance compared to the sliding window, which is a commonly used approach. To develop the method and build a predictive model, a machine learning approach was adopted. The proposed method was evaluated on a dataset obtained from a single wrist-worn accelerometer. The results demonstrated the effectiveness of the proposed method in recognizing all of the activities that were examined, and it achieved an overall accuracy of 96.86%.
Collapse
|
17
|
Mallat R, Bonnet V, Dumas R, Adjel M, Venture G, Khalil M, Mohammed S. Sparse Visual-Inertial Measurement Units Placement for Gait Kinematics Assessment. IEEE Trans Neural Syst Rehabil Eng 2021; 29:1300-1311. [PMID: 34138711 DOI: 10.1109/tnsre.2021.3089873] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/07/2022]
Abstract
This study investigates the possibility of estimating lower-limb joint kinematics and meaningful performance indexes for physiotherapists, during gait on a treadmill based on data collected from a sparse placement of new Visual Inertial Measurement Units (VIMU) and the use of an Extended Kalman Filter (EKF). The proposed EKF takes advantage of the biomechanics of the human body and of the investigated task to reduce sensor inaccuracies. Two state-vector formulations, one based on the use of constant acceleration model and one based on Fourier series, and the tuning of their corresponding parameters were analyzed. The constant acceleration model, due to its inherent inconsistency for human motion, required a cumbersome optimisation process and needed the a-priori knowledge of reference joint trajectories for EKF parameters tuning. On the other hand, the Fourier series formulation could be used without a specific parameters tuning process. In both cases, the average root mean square difference and correlation coefficient between the estimated joint angles and those reconstructed with a reference stereophotogrammetric system was 3.5deg and 0.70, respectively. Moreover, the stride lengths were estimated with a normalized root mean square difference inferior to 2% when using the forward kinematics model receiving as input the estimated joint angles. The popular gait deviation index was also estimated and showed similar results very close to 100, using both the proposed method and the reference stereophotogrammetric system. Such consistency was obtained using only three wireless and affordable VIMU located at the pelvis and both heels and tracked using two affordable RGB cameras. Being further easy-to-use and suitable for applications taking place outside of the laboratory, the proposed method thus represents a good compromise between accurate reference stereophotogrammetric systems and markerless ones for which accuracy is still under debate.
Collapse
|
18
|
Keri MI, Shehata AW, Marasco PD, Hebert JS, Vette AH. A Cost-Effective Inertial Measurement System for Tracking Movement and Triggering Kinesthetic Feedback in Lower-Limb Prosthesis Users. SENSORS (BASEL, SWITZERLAND) 2021; 21:1844. [PMID: 33800790 PMCID: PMC7961441 DOI: 10.3390/s21051844] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 02/02/2021] [Revised: 02/28/2021] [Accepted: 03/02/2021] [Indexed: 11/16/2022]
Abstract
Advances in lower-limb prosthetic technologies have facilitated the restoration of ambulation; however, users of such technologies still experience reduced balance control, also due to the absence of proprioceptive feedback. Recent efforts have demonstrated the ability to restore kinesthetic feedback in upper-limb prosthesis applications; however, technical solutions to trigger the required muscle vibration and provide automated feedback have not been explored for lower-limb prostheses. The study's first objective was therefore to develop a feedback system capable of tracking lower-limb movement and automatically triggering a muscle vibrator to induce the kinesthetic illusion. The second objective was to investigate the developed system's ability to provide kinesthetic feedback in a case participant. A low-cost, wireless feedback system, incorporating two inertial measurement units to trigger a muscle vibrator, was developed and tested in an individual with limb loss above the knee. Our system had a maximum communication delay of 50 ms and showed good tracking of Gaussian and sinusoidal movement profiles for velocities below 180 degrees per second (error < 8 degrees), mimicking stepping and walking, respectively. We demonstrated in the case participant that the developed feedback system can successfully elicit the kinesthetic illusion. Our work contributes to the integration of sensory feedback in lower-limb prostheses, to increase their use and functionality.
Collapse
Affiliation(s)
- McNiel-Inyani Keri
- Donadeo Innovation Centre for Engineering, Department of Mechanical Engineering, University of Alberta, 9211 116 Street NW, Edmonton, AB T6G 1H9, Canada;
| | - Ahmed W. Shehata
- Division of Physical Medicine and Rehabilitation, Faculty of Medicine and Dentistry, University of Alberta, 5005 Katz Group Centre, Edmonton, AB T6G 2E1, Canada; (A.W.S.); (J.S.H.)
| | - Paul D. Marasco
- Laboratory for Bionic Integration, Department of Biomedical Engineering, Lerner Research Institute, Cleveland Clinic, 9500 Euclid Avenue, ND20, Cleveland, OH 44195, USA;
- Advanced Platform Technology Center, Louis Stokes Cleveland Department of Veterans Affairs Medical Center, 10701 East Boulevard 151 W/APT, Cleveland, OH 44106, USA
| | - Jacqueline S. Hebert
- Division of Physical Medicine and Rehabilitation, Faculty of Medicine and Dentistry, University of Alberta, 5005 Katz Group Centre, Edmonton, AB T6G 2E1, Canada; (A.W.S.); (J.S.H.)
- Department of Biomedical Engineering, 1098 Research Transition Facility, University of Alberta, Edmonton, AB T6G 2V2, Canada
- Glenrose Rehabilitation Hospital, Alberta Health Services, 10230 111 Avenue NW, Edmonton, AB T5G 0B7, Canada
| | - Albert H. Vette
- Donadeo Innovation Centre for Engineering, Department of Mechanical Engineering, University of Alberta, 9211 116 Street NW, Edmonton, AB T6G 1H9, Canada;
- Glenrose Rehabilitation Hospital, Alberta Health Services, 10230 111 Avenue NW, Edmonton, AB T5G 0B7, Canada
| |
Collapse
|
19
|
Sports medicine: bespoke player management. Digit Health 2021. [DOI: 10.1016/b978-0-12-818914-6.00021-1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/19/2022] Open
|
20
|
A wearable motion capture device able to detect dynamic motion of human limbs. Nat Commun 2020; 11:5615. [PMID: 33154381 PMCID: PMC7645594 DOI: 10.1038/s41467-020-19424-2] [Citation(s) in RCA: 51] [Impact Index Per Article: 10.2] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/15/2020] [Accepted: 10/13/2020] [Indexed: 01/28/2023] Open
Abstract
Limb motion capture is essential in human motion-recognition, motor-function assessment and dexterous human-robot interaction for assistive robots. Due to highly dynamic nature of limb activities, conventional inertial methods of limb motion capture suffer from serious drift and instability problems. Here, a motion capture method with integral-free velocity detection is proposed and a wearable device is developed by incorporating micro tri-axis flow sensors with micro tri-axis inertial sensors. The device allows accurate measurement of three-dimensional motion velocity, acceleration, and attitude angle of human limbs in daily activities, strenuous, and prolonged exercises. Additionally, we verify an intra-limb coordination relationship exists between thigh and shank in human walking and running, and establish a neural network model for it. Using the intra-limb coordination model, dynamic motion capture of human lower limbs including thigh and shank is tactfully implemented by a single shank-worn device, which simplifies the capture device and reduces cost. Experiments in strenuous activities and long-time running validate excellent performance and robustness of the wearable device in dynamic motion recognition and reconstruction of human limbs. Current wearable motion capture technologies are unable to accurately detect dynamic motion of human limbs due to drift and instability problems. Here, the authors report a wearable motion capture device combining tri-axis velocity sensor and inertial sensors for accurate 3D limb motion capture.
Collapse
|
21
|
Chen H, Schall MC, Fethke NB. Measuring upper arm elevation using an inertial measurement unit: An exploration of sensor fusion algorithms and gyroscope models. APPLIED ERGONOMICS 2020; 89:103187. [PMID: 32854821 PMCID: PMC9605636 DOI: 10.1016/j.apergo.2020.103187] [Citation(s) in RCA: 16] [Impact Index Per Article: 3.2] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/18/2019] [Revised: 04/23/2020] [Accepted: 06/07/2020] [Indexed: 05/14/2023]
Abstract
Many sensor fusion algorithms for analyzing human motion information collected with inertial measurement units have been reported in the scientific literature. Selecting which algorithm to use can be a challenge for ergonomists that may be unfamiliar with the strengths and limitations of the various options. In this paper, we describe fundamental differences among several algorithms, including differences in sensor fusion approach (e.g., complementary filter vs. Kalman Filter) and gyroscope error modeling (i.e., inclusion or exclusion of gyroscope bias). We then compare different sensor fusion algorithms considering the fundamentals discussed using laboratory-based measurements of upper arm elevation collected under three motion speeds. Results indicate peak displacement errors of <4.5° with a computationally efficient, non-proprietary complementary filter that did not account for gyroscope bias during each of the one-minute trials. Controlling for gyroscope bias reduced peak displacement errors to <3.0°. The complementary filters were comparable (<1° peak displacement difference) to the more complex Kalman filters.
Collapse
Affiliation(s)
- Howard Chen
- Department of Mechanical Engineering, Auburn University, AL, USA.
| | - Mark C Schall
- Department of Industrial and Systems Engineering, Auburn University, AL, USA
| | - Nathan B Fethke
- Department of Occupational and Environmental Health, University of Iowa, Iowa City, IA, USA
| |
Collapse
|
22
|
Validation of Spatiotemporal and Kinematic Measures in Functional Exercises Using a Minimal Modeling Inertial Sensor Methodology. SENSORS 2020; 20:s20164586. [PMID: 32824216 PMCID: PMC7472244 DOI: 10.3390/s20164586] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 07/22/2020] [Revised: 08/12/2020] [Accepted: 08/13/2020] [Indexed: 11/17/2022]
Abstract
This study proposes a minimal modeling magnetic, angular rate and gravity (MARG) methodology for assessing spatiotemporal and kinematic measures of functional fitness exercises. Thirteen healthy persons performed repetitions of the squat, box squat, sandbag pickup, shuffle-walk, and bear crawl. Sagittal plane hip, knee, and ankle range of motion (ROM) and stride length, stride time, and stance time measures were compared for the MARG method and an optical motion capture (OMC) system. The root mean square error (RMSE), mean absolute percentage error (MAPE), and Bland–Altman plots and limits of agreement were used to assess agreement between methods. Hip and knee ROM showed good to excellent agreement with the OMC system during the squat, box squat, and sandbag pickup (RMSE: 4.4–9.8°), while ankle ROM agreement ranged from good to unacceptable (RMSE: 2.7–7.2°). Unacceptable hip and knee ROM agreement was observed for the shuffle-walk and bear crawl (RMSE: 3.3–8.6°). The stride length, stride time, and stance time showed good to excellent agreement between methods (MAPE: (3.2 ± 2.8)%–(8.2 ± 7.9)%). Although the proposed MARG-based method is a valid means of assessing spatiotemporal and kinematic measures during various exercises, further development is required to assess the joint kinematics of small ROM, high velocity movements.
Collapse
|
23
|
Gait Analysis in a Box: A System Based on Magnetometer-Free IMUs or Clusters of Optical Markers with Automatic Event Detection. SENSORS 2020; 20:s20123338. [PMID: 32545515 PMCID: PMC7348770 DOI: 10.3390/s20123338] [Citation(s) in RCA: 11] [Impact Index Per Article: 2.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 04/29/2020] [Revised: 06/06/2020] [Accepted: 06/10/2020] [Indexed: 11/16/2022]
Abstract
Gait analysis based on full-body motion capture technology (MoCap) can be used in rehabilitation to aid in decision making during treatments or therapies. In order to promote the use of MoCap gait analysis based on inertial measurement units (IMUs) or optical technology, it is necessary to overcome certain limitations, such as the need for magnetically controlled environments, which affect IMU systems, or the need for additional instrumentation to detect gait events, which affects IMUs and optical systems. We present a MoCap gait analysis system called Move Human Sensors (MH), which incorporates proposals to overcome both limitations and can be configured via magnetometer-free IMUs (MH-IMU) or clusters of optical markers (MH-OPT). Using a test-retest reliability experiment with thirty-three healthy subjects (20 men and 13 women, 21.7 ± 2.9 years), we determined the reproducibility of both configurations. The assessment confirmed that the proposals performed adequately and allowed us to establish usage considerations. This study aims to enhance gait analysis in daily clinical practice.
Collapse
|
24
|
Liu SQ, Zhang JC, Zhu R. A Wearable Human Motion Tracking Device Using Micro Flow Sensor Incorporating a Micro Accelerometer. IEEE Trans Biomed Eng 2020; 67:940-948. [DOI: 10.1109/tbme.2019.2924689] [Citation(s) in RCA: 21] [Impact Index Per Article: 4.2] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/07/2022]
|
25
|
Liu SQ, Zhang JC, Li GZ, Zhu R. A Wearable Flow-MIMU Device for Monitoring Human Dynamic Motion. IEEE Trans Neural Syst Rehabil Eng 2020; 28:637-645. [PMID: 32031941 DOI: 10.1109/tnsre.2020.2971762] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.6] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/06/2022]
Abstract
For personalized rehabilitation or sports training, it is necessary to monitor dynamic motions and track postures of human body and limbs. Traditional methods using micro inertial sensors usually suffer from drift problems in tracking dynamic motions. In this paper, a wearable flow-MIMU human motion capture device is proposed by incorporating micro flow sensor with micro inertial measurement unit (MIMU). Motion velocity is detected by a micro flow sensor and utilized to figure out the motion acceleration. The gravity accelerations are extracted by eliminating the motion accelerations from the accelerometer outputs. Finally, posture estimation is implemented by using a tailor-designed Kalman-based data fusion of the gyroscope outputs and the extracted gravity accelerations. The flow-MIMU device with wireless communication is designed like a watch to be wearable. Experimental results validate that the motion velocity, acceleration and posture of human limb are determined accurately and free of accumulative error in monitoring of dynamic motions using the proposed method. The wearable flow-MIMU device provides an advantageous monitoring approach for applications of personalized rehabilitation, sports training, intelligent prosthetics, etc.
Collapse
|
26
|
Magnetic Condition-Independent 3D Joint Angle Estimation Using Inertial Sensors and Kinematic Constraints. SENSORS 2019; 19:s19245522. [PMID: 31847254 PMCID: PMC6960945 DOI: 10.3390/s19245522] [Citation(s) in RCA: 11] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 10/28/2019] [Revised: 12/02/2019] [Accepted: 12/12/2019] [Indexed: 11/18/2022]
Abstract
In biomechanics, joint angle estimation using wearable inertial measurement units (IMUs) has been getting great popularity. However, magnetic disturbance issue is considered problematic as the disturbance can seriously degrade the accuracy of the estimated joint angles. This study proposes a magnetic condition-independent three-dimensional (3D) joint angle estimation method based on IMU signals. The proposed method is implemented in a sequential direction cosine matrix-based orientation Kalman filter (KF), which is composed of an attitude estimation KF followed by a heading estimation KF. In the heading estimation KF, an acceleration-level kinematic constraint from a spherical joint replaces the magnetometer signals for the correction procedure. Because the proposed method does not rely on the magnetometer, it is completely magnetic condition-independent and is not affected by the magnetic disturbance. For the averaged root mean squared errors of the three tests performed using a rigid two-link system, the proposed method produced 1.58°, while the conventional method with the magnetic disturbance compensation mechanism produced 5.38°, showing a higher accuracy of the proposed method in the magnetically disturbed conditions. Due to the independence of the proposed method from the magnetic condition, the proposed approach could be reliably applied in various fields that require robust 3D joint angle estimation through IMU signals in an unspecified arbitrary magnetic environment.
Collapse
|
27
|
Adamowicz L, Gurchiek RD, Ferri J, Ursiny AT, Fiorentino N, McGinnis RS. Validation of Novel Relative Orientation and Inertial Sensor-to-Segment Alignment Algorithms for Estimating 3D Hip Joint Angles. SENSORS 2019; 19:s19235143. [PMID: 31771263 PMCID: PMC6929122 DOI: 10.3390/s19235143] [Citation(s) in RCA: 17] [Impact Index Per Article: 2.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 10/16/2019] [Revised: 11/16/2019] [Accepted: 11/22/2019] [Indexed: 11/16/2022]
Abstract
Wearable sensor-based algorithms for estimating joint angles have seen great improvements in recent years. While the knee joint has garnered most of the attention in this area, algorithms for estimating hip joint angles are less available. Herein, we propose and validate a novel algorithm for this purpose with innovations in sensor-to-sensor orientation and sensor-to-segment alignment. The proposed approach is robust to sensor placement and does not require specific calibration motions. The accuracy of the proposed approach is established relative to optical motion capture and compared to existing methods for estimating relative orientation, hip joint angles, and range of motion (ROM) during a task designed to exercise the full hip range of motion (ROM) and fast walking using root mean square error (RMSE) and regression analysis. The RMSE of the proposed approach was less than that for existing methods when estimating sensor orientation ( 12 . 32 ∘ and 11 . 82 ∘ vs. 24 . 61 ∘ and 23 . 76 ∘ ) and flexion/extension joint angles ( 7 . 88 ∘ and 8 . 62 ∘ vs. 14 . 14 ∘ and 15 . 64 ∘ ). Also, ROM estimation error was less than 2 . 2 ∘ during the walking trial using the proposed method. These results suggest the proposed approach presents an improvement to existing methods and provides a promising technique for remote monitoring of hip joint angles.
Collapse
Affiliation(s)
- Lukas Adamowicz
- M-Sense Research Group, University of Vermont, Burlington, VT 05405, USA; (L.A.); (R.D.G.); (J.F.); (A.T.U.)
| | - Reed D. Gurchiek
- M-Sense Research Group, University of Vermont, Burlington, VT 05405, USA; (L.A.); (R.D.G.); (J.F.); (A.T.U.)
| | - Jonathan Ferri
- M-Sense Research Group, University of Vermont, Burlington, VT 05405, USA; (L.A.); (R.D.G.); (J.F.); (A.T.U.)
| | - Anna T. Ursiny
- M-Sense Research Group, University of Vermont, Burlington, VT 05405, USA; (L.A.); (R.D.G.); (J.F.); (A.T.U.)
| | - Niccolo Fiorentino
- Department of Mechanical Engineering, University of Vermont, Burlington, VT 05405, USA;
| | - Ryan S. McGinnis
- M-Sense Research Group, University of Vermont, Burlington, VT 05405, USA; (L.A.); (R.D.G.); (J.F.); (A.T.U.)
- Correspondence:
| |
Collapse
|
28
|
Marín J, Blanco T, Marín JJ, Moreno A, Martitegui E, Aragüés JC. Integrating a gait analysis test in hospital rehabilitation: A service design approach. PLoS One 2019; 14:e0224409. [PMID: 31665158 PMCID: PMC6821402 DOI: 10.1371/journal.pone.0224409] [Citation(s) in RCA: 15] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/09/2019] [Accepted: 10/11/2019] [Indexed: 11/18/2022] Open
Abstract
BACKGROUND Gait analysis with motion capture (MoCap) during rehabilitation can provide objective information to facilitate treatment decision making. However, designing a test to be integrated into healthcare services requires considering multiple design factors. The difficulty of integrating a 'micro-service' (gait test) within a 'macro-service' (healthcare service) has received little attention in the gait analysis literature. It is a challenge that goes beyond the gait analysis case study because service design methods commonly focus on the entire service design (macro-level). OBJECTIVE This study aims to extract design considerations and generate guidelines to integrate MoCap technology for gait analysis in the hospital rehabilitation setting. Specifically, the aim is to design a gait test to assess the response of the applied treatments through pre- and post-measurement sessions. METHODS We focused on patients with spasticity who received botulinum toxin treatment. A qualitative research design was used to investigate the integration of a gait analysis system based on inertial measurement units in a rehabilitation service at a reference hospital. The methodological approach was based on contrasted methodologies from the service design field, which materialise through observation techniques (during system use), semi-structured interviews, and workshops with healthcare professionals (13 patients, 10 'proxies', and 6 doctors). RESULTS The analysis resulted in six themes: (1) patients' understanding, (2) guiding the gait tests, (3) which professionals guide the gait tests, (4) gait test reports, (5) requesting gait tests (doctors and test guide communication), and the (6) conceptual design of the service with the gait test. CONCLUSIONS The extracted design considerations and guidelines increase the applicability and usefulness of the gait analysis technology, improving the link between technologists and healthcare professionals. The proposed methodological approach can also be useful for service design teams that deal with the integration of one service into another.
Collapse
Affiliation(s)
- Javier Marín
- IDERGO (Research and Development in Ergonomics) Research Group, I3A (Aragon Institute of Engineering Research), University of Zaragoza, Zaragoza, Spain
- Department of Design and Manufacturing Engineering, University of Zaragoza, Zaragoza, Spain
| | - Teresa Blanco
- HOWLab (Human Openware Research Lab) Research Group, I3A, University of Zaragoza, Zaragoza, Spain
- GeoSpatiumLab, S.L. Zaragoza, Spain
| | - José J. Marín
- IDERGO (Research and Development in Ergonomics) Research Group, I3A (Aragon Institute of Engineering Research), University of Zaragoza, Zaragoza, Spain
- Department of Design and Manufacturing Engineering, University of Zaragoza, Zaragoza, Spain
| | - Alejandro Moreno
- IDERGO (Research and Development in Ergonomics) Research Group, I3A (Aragon Institute of Engineering Research), University of Zaragoza, Zaragoza, Spain
- Department of Health and Sports Sciences, University of Zaragoza, Zaragoza, Spain
| | - Elena Martitegui
- Rehabilitation and Physical Medicine Service, HUMS (Miguel Servet University Hospital), Zaragoza, Spain
| | - Juan C. Aragüés
- Rehabilitation and Physical Medicine Service, HUMS (Miguel Servet University Hospital), Zaragoza, Spain
| |
Collapse
|
29
|
Soussé R, Verdú J, Jauregui R, Ferrer-Roca V, Balocco S. Non-rigid alignment pipeline applied to human gait signals acquired with optical motion capture systems and inertial sensors. J Biomech 2019; 98:109429. [PMID: 31662198 DOI: 10.1016/j.jbiomech.2019.109429] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/04/2019] [Revised: 10/02/2019] [Accepted: 10/13/2019] [Indexed: 11/19/2022]
Abstract
An accurate gait characterization is fundamental for diagnosis and treatment in both clinical and sportive fields. Although several devices allow such measurements, the performance comparison between the acquired signals may be a challenging task. A novel pipeline for the accurate non-rigid alignment of gait signals is proposed. In this paper, the measurements of Inertial Measurement Units (IMU) and Optical Motion Capture Systems (OMCAP) are aligned using a modified version of the Dynamic Time Warping (DTW) algorithm. The differences between the two acquisitions are evaluated using both global (RMSE, Correlation Coefficient (CC)) and local (Statistical Parametric Mapping (SPM)) metrics. The method is applied to a data-set obtained measuring the gait of ten healthy subjects walking on a treadmill at three different gait paces. Results show a global bias between the signal acquisition of 0.05°. Regarding the global metrics, a mean RMSE value of 2.65° (0.73°) and an average CC value of 0.99 (0.01) were obtained. The SPM profile shows, in each gait cycle phase, the percentage of cases when two curves are statistically identical and reaches an average of 48% (22%).
Collapse
Affiliation(s)
| | - Jorge Verdú
- Dycare, C. Ávila 48-50, 08005 Barcelona, Spain; Dept. Mathematics and Informatics, University of Barcelona, Gran Via 585, 08007 Barcelona, Spain
| | | | | | - Simone Balocco
- Dept. Mathematics and Informatics, University of Barcelona, Gran Via 585, 08007 Barcelona, Spain; Computer Vision Center, 08193 Bellaterra, Spain.
| |
Collapse
|
30
|
Argent R, Drummond S, Remus A, O'Reilly M, Caulfield B. Evaluating the use of machine learning in the assessment of joint angle using a single inertial sensor. J Rehabil Assist Technol Eng 2019; 6:2055668319868544. [PMID: 31452927 PMCID: PMC6700879 DOI: 10.1177/2055668319868544] [Citation(s) in RCA: 13] [Impact Index Per Article: 2.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/08/2018] [Accepted: 06/04/2019] [Indexed: 01/05/2023] Open
Abstract
Introduction Joint angle measurement is an important objective marker in rehabilitation. Inertial measurement units may provide an accurate and reliable method of joint angle assessment. The objective of this study was to assess whether a single sensor with the application of machine learning algorithms could accurately measure hip and knee joint angle, and investigate the effect of inertial measurement unit orientation algorithms and person-specific variables on accuracy. Methods Fourteen healthy participants completed eight rehabilitation exercises with kinematic data captured by a 3D motion capture system, used as the reference standard, and a wearable inertial measurement unit. Joint angle was calculated from the single inertial measurement unit using four machine learning models, and was compared to the reference standard to evaluate accuracy. Results Average root-mean-squared error for the best performing algorithms across all exercises was 4.81° (SD = 1.89). The use of an inertial measurement unit orientation algorithm as a pre-processing step improved accuracy; however, the addition of person-specific variables increased error with average RMSE 4.99° (SD = 1.83°). Conclusions Hip and knee joint angle can be measured with a good degree of accuracy from a single inertial measurement unit using machine learning. This offers the ability to monitor and record dynamic joint angle with a single sensor outside of the clinic.
Collapse
Affiliation(s)
- Rob Argent
- Insight Centre for Data Analytics, University College Dublin, Dublin, Ireland.,Beacon Hospital, Dublin, Ireland.,School of Public Health, Physiotherapy and Sport Science, University College Dublin, Dublin, Ireland
| | - Sean Drummond
- Insight Centre for Data Analytics, University College Dublin, Dublin, Ireland
| | - Alexandria Remus
- Insight Centre for Data Analytics, University College Dublin, Dublin, Ireland.,School of Public Health, Physiotherapy and Sport Science, University College Dublin, Dublin, Ireland
| | - Martin O'Reilly
- Insight Centre for Data Analytics, University College Dublin, Dublin, Ireland.,School of Public Health, Physiotherapy and Sport Science, University College Dublin, Dublin, Ireland
| | - Brian Caulfield
- Insight Centre for Data Analytics, University College Dublin, Dublin, Ireland.,School of Public Health, Physiotherapy and Sport Science, University College Dublin, Dublin, Ireland
| |
Collapse
|
31
|
Horenstein RE, Lewis CL, Yan S, Halverstadt A, Shefelbine SJ. Validation of magneto-inertial measuring units for measuring hip joint angles. J Biomech 2019; 91:170-174. [PMID: 31147099 DOI: 10.1016/j.jbiomech.2019.05.029] [Citation(s) in RCA: 11] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/24/2018] [Revised: 05/17/2019] [Accepted: 05/20/2019] [Indexed: 10/26/2022]
Abstract
Camera-based motion capture systems are the current gold standard for motion analysis. However, the use of wireless inertial sensor-based systems is increasing in popularity, largely due to convenient portability. The purpose of this study was to validate the use of wireless inertial sensors for measuring hip joint motion with a functional calibration requiring only one motion (walking) and neutral standing. Data were concurrently collected using a 10-camera motion capture system and a wireless inertial sensor-based system. Hip joint angles were measured for 10 participants during walking, jumping jack, and bilateral squat tasks and for a subset (n = 5) a jump turn task. Camera-based system hip joint angles were calculated from retro-reflective marker positions and sensor-based system angles were calculated in MATLAB using the sensor output quaternions. Most hip joint angles measured with the sensor-based system were within 6° of angles measured with the camera motion capture system. Accurate measurement of motion outside of a laboratory setting has broad implications for diagnosing movement abnormalities, monitoring sports performance, and assessing rehabilitation progress.
Collapse
Affiliation(s)
- Rachel E Horenstein
- Department of Mechanical and Industrial Engineering, Northeastern University, Boston, MA 02115, USA
| | - Cara L Lewis
- Department of Physical Therapy & Athletic Training, Boston University, Boston, MA 02215, USA
| | - Sherry Yan
- Department of Physical Therapy & Athletic Training, Boston University, Boston, MA 02215, USA
| | - Anne Halverstadt
- Department of Physical Therapy & Athletic Training, Boston University, Boston, MA 02215, USA
| | - Sandra J Shefelbine
- Department of Mechanical and Industrial Engineering, Northeastern University, Boston, MA 02115, USA; Department of Bioengineering, Northeastern University, Boston, MA 02115, USA.
| |
Collapse
|
32
|
Rodgers MM, Alon G, Pai VM, Conroy RS. Wearable technologies for active living and rehabilitation: Current research challenges and future opportunities. J Rehabil Assist Technol Eng 2019; 6:2055668319839607. [PMID: 31245033 PMCID: PMC6582279 DOI: 10.1177/2055668319839607] [Citation(s) in RCA: 38] [Impact Index Per Article: 6.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/22/2017] [Accepted: 02/20/2019] [Indexed: 12/28/2022] Open
Abstract
This paper presents some recent developments in the field of wearable sensors and systems that are relevant to rehabilitation and provides examples of systems with evidence supporting their effectiveness for rehabilitation. A discussion of current challenges and future developments for selected systems is followed by suggestions for future directions needed to advance towards wider deployment of wearable sensors and systems for rehabilitation.
Collapse
Affiliation(s)
- Mary M Rodgers
- Department of Physical Therapy & Rehabilitation Science, University of Maryland School of Medicine, Baltimore, MD, USA
| | - Gad Alon
- Department of Physical Therapy & Rehabilitation Science, University of Maryland School of Medicine, Baltimore, MD, USA
| | | | - Richard S Conroy
- Office of Strategic Coordination, National Institutes of Health, Bethesda, MD, USA
| |
Collapse
|
33
|
Portable Sensors Add Reliable Kinematic Measures to the Assessment of Upper Extremity Function. SENSORS 2019; 19:s19051241. [PMID: 30870999 PMCID: PMC6427602 DOI: 10.3390/s19051241] [Citation(s) in RCA: 15] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 01/17/2019] [Revised: 02/27/2019] [Accepted: 03/06/2019] [Indexed: 11/16/2022]
Abstract
Ordinal scales with low resolution are used to assess arm function in clinic. These scales may be improved by adding objective kinematic measures. The aim was to analyze within-subject, inter-rater and overall reliability (i.e., including within-subject and inter-rater reliability) and check the system’s validity of kinematic measures from inertial sensors for two such protocols on one person. Twenty healthy volunteers repeatedly performed two tasks, finger-to-nose and drinking, during two test sessions with two different raters. Five inertial sensors, on the forearms, upper arms and xiphoid process were used. Comparisons against an optical camera system evaluated the measurement validity. Cycle time, range of motion (ROM) in shoulder and elbow were calculated. Bland–Altman plots and linear mixed models including the generalizability (G) coefficient evaluated the reliability of the measures. Within-subject reliability was good to excellent in both tests (G = 0.80–0.97) and may serve as a baseline when assessing upper extremities in future patient groups. Overall reliability was acceptable to excellent (G = 0.77–0.94) for all parameters except elbow axial rotation in finger-to-nose task and both elbow axial rotation and flexion/extension in drinking task, mainly due to poor inter-rater reliability in these parameters. The low to good reliability for elbow ROM probably relates to high within-subject variability. The sensors provided good to excellent measures of cycle time and shoulder ROM in non-disabled individuals and thus have the potential to improve today’s assessment of arm function.
Collapse
|
34
|
Lee JK, Choi MJ. Robust Inertial Measurement Unit-Based Attitude Determination Kalman Filter for Kinematically Constrained Links. SENSORS (BASEL, SWITZERLAND) 2019; 19:E768. [PMID: 30781860 PMCID: PMC6412196 DOI: 10.3390/s19040768] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 01/08/2019] [Revised: 02/07/2019] [Accepted: 02/11/2019] [Indexed: 11/18/2022]
Abstract
The external acceleration of a fast-moving body induces uncertainty in attitude determination based on inertial measurement unit (IMU) signals and thus, frequently degrades the determination accuracy. Although previous works adopt acceleration-compensating mechanisms to deal with this problem, they cannot completely eliminate the uncertainty as they are, inherently, approaches to an underdetermined problem. This paper presents a novel constraint-augmented Kalman filter (KF) that eliminates the acceleration-induced uncertainty for a robust IMU-based attitude determination when IMU is attached to a constrained link. Particularly, this research deals with an acceleration-level kinematic constraint derived on the basis of a ball joint. Experimental results demonstrate the superiority of the proposed constrained KF over the conventional unconstrained KF: The average accuracy improved by 1.88° with a maximum of 4.18°. More importantly, whereas the accuracy of conventional KF is dependent to some extent on test acceleration conditions, that of the proposed KF is independent of these conditions. Due to the robustness of the proposed KF, it may be applied when accurate attitude estimation is needed regardless of dynamic conditions.
Collapse
Affiliation(s)
- Jung Keun Lee
- Inertial Motion Capture Lab, Department of Mechanical Engineering, Hankyong National University, Anseong 17579, Korea.
| | - Mi Jin Choi
- Inertial Motion Capture Lab, Department of Mechanical Engineering, Hankyong National University, Anseong 17579, Korea.
| |
Collapse
|
35
|
Bloomfield RA, Fennema MC, McIsaac KA, Teeter MG. Proposal and Validation of a Knee Measurement System for Patients With Osteoarthritis. IEEE Trans Biomed Eng 2019; 66:319-326. [DOI: 10.1109/tbme.2018.2837620] [Citation(s) in RCA: 13] [Impact Index Per Article: 2.2] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
|
36
|
Kianifar R, Joukov V, Lee A, Raina S, Kulić D. Inertial measurement unit-based pose estimation: Analyzing and reducing sensitivity to sensor placement and body measures. J Rehabil Assist Technol Eng 2019; 6:2055668318813455. [PMID: 31245025 PMCID: PMC6582294 DOI: 10.1177/2055668318813455] [Citation(s) in RCA: 11] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/22/2018] [Accepted: 10/17/2018] [Indexed: 11/16/2022] Open
Abstract
Introduction Inertial measurement units have been proposed for automated pose estimation and exercise monitoring in clinical settings. However, many existing methods assume an extensive calibration procedure, which may not be realizable in clinical practice. In this study, an inertial measurement unit-based pose estimation method using extended Kalman filter and kinematic chain modeling is adapted for lower body pose estimation during clinical mobility tests such as the single leg squat, and the sensitivity to parameter calibration is investigated. Methods The sensitivity of pose estimation accuracy to each of the kinematic model and sensor placement parameters was analyzed. Sensitivity analysis results suggested that accurate extraction of inertial measurement unit orientation on the body is a key factor in improving the accuracy. Hence, a simple calibration protocol was proposed to reach a better approximation for inertial measurement unit orientation. Results After applying the protocol, the ankle, knee, and hip joint angle errors improved to 4 . 2 ∘ , 6 . 3 ∘ , and 8 . 3 ∘ , without the need for any other calibration. Conclusions Only a small subset of kinematic and sensor parameters contribute significantly to pose estimation accuracy when using body worn inertial sensors. A simple calibration procedure identifying the inertial measurement unit orientation on the body can provide good pose estimation performance.
Collapse
Affiliation(s)
- Rezvan Kianifar
- Electrical and Computer Engineering Department, University of Waterloo, Waterloo, ON, Canada
| | - Vladimir Joukov
- Electrical and Computer Engineering Department, University of Waterloo, Waterloo, ON, Canada
| | | | | | - Dana Kulić
- Electrical and Computer Engineering Department, University of Waterloo, Waterloo, ON, Canada
| |
Collapse
|
37
|
Walmsley CP, Williams SA, Grisbrook T, Elliott C, Imms C, Campbell A. Measurement of Upper Limb Range of Motion Using Wearable Sensors: A Systematic Review. SPORTS MEDICINE-OPEN 2018; 4:53. [PMID: 30499058 PMCID: PMC6265374 DOI: 10.1186/s40798-018-0167-7] [Citation(s) in RCA: 41] [Impact Index Per Article: 5.9] [Reference Citation Analysis] [Abstract] [Key Words] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 07/31/2018] [Accepted: 10/24/2018] [Indexed: 12/18/2022]
Abstract
Background Wearable sensors are portable measurement tools that are becoming increasingly popular for the measurement of joint angle in the upper limb. With many brands emerging on the market, each with variations in hardware and protocols, evidence to inform selection and application is needed. Therefore, the objectives of this review were related to the use of wearable sensors to calculate upper limb joint angle. We aimed to describe (i) the characteristics of commercial and custom wearable sensors, (ii) the populations for whom researchers have adopted wearable sensors, and (iii) their established psychometric properties. Methods A systematic review of literature was undertaken using the following data bases: MEDLINE, EMBASE, CINAHL, Web of Science, SPORTDiscus, IEEE, and Scopus. Studies were eligible if they met the following criteria: (i) involved humans and/or robotic devices, (ii) involved the application or simulation of wearable sensors on the upper limb, and (iii) calculated a joint angle. Results Of 2191 records identified, 66 met the inclusion criteria. Eight studies compared wearable sensors to a robotic device and 22 studies compared to a motion analysis system. Commercial (n = 13) and custom (n = 7) wearable sensors were identified, each with variations in placement, calibration methods, and fusion algorithms, which were demonstrated to influence accuracy. Conclusion Wearable sensors have potential as viable instruments for measurement of joint angle in the upper limb during active movement. Currently, customised application (i.e. calibration and angle calculation methods) is required to achieve sufficient accuracy (error < 5°). Additional research and standardisation is required to guide clinical application. Trial Registration This systematic review was registered with PROSPERO (CRD42017059935).
Collapse
Affiliation(s)
- Corrin P Walmsley
- School of Occupational Therapy, Social Work and Speech Pathology, Curtin University, Perth, WA, 6027, Australia
| | - Sîan A Williams
- School of Physiotherapy and Exercise Science, Curtin University, Perth, WA, 6027, Australia.,Department of Surgery, University of Auckland, Auckland, 1010, New Zealand
| | - Tiffany Grisbrook
- School of Physiotherapy and Exercise Science, Curtin University, Perth, WA, 6027, Australia
| | - Catherine Elliott
- School of Occupational Therapy, Social Work and Speech Pathology, Curtin University, Perth, WA, 6027, Australia.,Kids Rehab WA, Perth Children's Hospital, Perth, WA, 6008, Australia
| | - Christine Imms
- Centre for Disability and Development Research, School of Allied Health, Australian Catholic University, Melbourne, VIC, 3065, Australia.
| | - Amity Campbell
- School of Physiotherapy and Exercise Science, Curtin University, Perth, WA, 6027, Australia
| |
Collapse
|
38
|
Gad* A. Functional Electrical Stimulation (FES): Clinical successes and failures to date. ACTA ACUST UNITED AC 2018. [DOI: 10.29328/journal.jnpr.1001022] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
|
39
|
An Orthopaedic Robotic-Assisted Rehabilitation Method of the Forearm in Virtual Reality Physiotherapy. JOURNAL OF HEALTHCARE ENGINEERING 2018; 2018:7438609. [PMID: 30154992 PMCID: PMC6093033 DOI: 10.1155/2018/7438609] [Citation(s) in RCA: 10] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 11/18/2017] [Revised: 02/28/2018] [Accepted: 03/28/2018] [Indexed: 11/18/2022]
Abstract
The use of robotic rehabilitation in orthopaedics has been briefly explored. Despite its possible advantages, the use of computer-assisted physiotherapy of patients with musculoskeletal injuries has received little attention. In this paper, we detailed the development and evaluation of a robotic-assisted rehabilitation system as a new methodology of assisted physiotherapy in orthopaedics. The proposal consists of an enhanced end-effector haptic interface mounted in a passive mechanism for allowing patients to perform upper-limb exercising and integrates virtual reality games conceived explicitly for assisting the treatment of the forearm after injuries at the wrist or elbow joints. The present methodology represents a new approach to assisted physiotherapy for strength and motion recovery of wrist pronation/supination and elbow flexion-extension movements. We design specific game scenarios enriched by proprioceptive and haptic force feedback in three training modes: passive, active, and assisted exercising. The system allows the therapist to tailor the difficulty level on the observed motion capacity of the patients and the kinesiology measurements provided by the system itself. We evaluated the system through the analysis of the muscular activity of two healthy subjects, showing that the system can assign significant working loads during typical physiotherapy treatment profiles. Subsequently, a group of ten patients undergoing manual orthopaedic rehabilitation of the forearm tested the system, under similar conditions at variable intensities. Patients tolerated changes in difficulty through the tests, and they expressed a favourable opinion of the system through the administered questionnaires, which indicates that the system was well accepted and that the proposed methodology was feasible for the case study for subsequently controlled trials. Finally, a predictive model of the performance score in the form of a linear combination of kinesiology observations was implemented in function of difficult training parameters, as a way of systematically individualising the training during the therapy, for subsequent studies.
Collapse
|
40
|
Teufl W, Miezal M, Taetz B, Fröhlich M, Bleser G. Validity, Test-Retest Reliability and Long-Term Stability of Magnetometer Free Inertial Sensor Based 3D Joint Kinematics. SENSORS (BASEL, SWITZERLAND) 2018; 18:E1980. [PMID: 29933568 PMCID: PMC6068643 DOI: 10.3390/s18071980] [Citation(s) in RCA: 53] [Impact Index Per Article: 7.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 04/12/2018] [Revised: 06/04/2018] [Accepted: 06/07/2018] [Indexed: 11/26/2022]
Abstract
The present study investigates an algorithm for the calculation of 3D joint angles based on inertial measurement units (IMUs), omitting magnetometer data. Validity, test-retest reliability, and long-term stability are evaluated in reference to an optical motion capture (OMC) system. Twenty-eight healthy subjects performed a 6 min walk test. Three-dimensional joint kinematics of the lower extremity was recorded simultaneously by means of seven IMUs and an OptiTrack OMC system. To evaluate the performance, the root mean squared error (RMSE), mean range of motion error (ROME), coefficient of multiple correlations (CMC), Bland-Altman (BA) analysis, and intraclass correlation coefficient (ICC) were calculated. For all joints, the RMSE was lower than 2.40°, and the ROME was lower than 1.60°. The CMC revealed good to excellent waveform similarity. Reliability was moderate to excellent with ICC values of 0.52⁻0.99 for all joints. Error measures did not increase over time. When considering soft tissue artefacts, RMSE and ROME increased by an average of 2.2° ± 1.5° and 2.9° ± 1.7°. This study revealed an excellent correspondence of a magnetometer-free IMU system with an OMC system when excluding soft tissue artefacts.
Collapse
Affiliation(s)
- Wolfgang Teufl
- Junior Research Group wearHEALTH, Technische Universität Kaiserslautern, Gottlieb-Daimler-Str. 48, 67663 Kaiserslautern, Germany.
| | - Markus Miezal
- Junior Research Group wearHEALTH, Technische Universität Kaiserslautern, Gottlieb-Daimler-Str. 48, 67663 Kaiserslautern, Germany.
| | - Bertram Taetz
- Junior Research Group wearHEALTH, Technische Universität Kaiserslautern, Gottlieb-Daimler-Str. 48, 67663 Kaiserslautern, Germany.
| | - Michael Fröhlich
- Department of Sports Science, Technische Universität Kaiserslautern, Erwin-Schrödinger-Str. 57, 67663 Kaiserslautern, Germany.
| | - Gabriele Bleser
- Junior Research Group wearHEALTH, Technische Universität Kaiserslautern, Gottlieb-Daimler-Str. 48, 67663 Kaiserslautern, Germany.
| |
Collapse
|
41
|
Schall MC, Sesek RF, Cavuoto LA. Barriers to the Adoption of Wearable Sensors in the Workplace: A Survey of Occupational Safety and Health Professionals. HUMAN FACTORS 2018; 60:351-362. [PMID: 29320232 PMCID: PMC9307130 DOI: 10.1177/0018720817753907] [Citation(s) in RCA: 57] [Impact Index Per Article: 8.1] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/27/2023]
Abstract
OBJECTIVE To gather information on the (a) types of wearable sensors, particularly personal activity monitors, currently used by occupational safety and health (OSH) professionals; (b) potential benefits of using such technologies in the workplace; and (c) perceived barriers preventing the widespread adoption of wearable sensors in industry. BACKGROUND Wearable sensors are increasingly being promoted as a means to improve employee health and well-being, and there is mounting evidence supporting their use as exposure assessment and personal health tools. Despite this, many workplaces have been hesitant to adopt these technologies. METHODS An electronic survey was emailed to 28,428 registered members of the American Society of Safety Engineers (ASSE) and 1,302 professionals certified by the Board of Certification in Professional Ergonomics (BCPE). RESULTS A total of 952 valid responses were returned. Over half of respondents described being in favor of using wearable sensors to track OSH-related risk factors and relevant exposure metrics at their respective workplaces. However, barriers including concerns regarding employee privacy/confidentiality of collected data, employee compliance, sensor durability, the cost/benefit ratio of using wearables, and good manufacturing practice requirements were described as challenges precluding adoption. CONCLUSION The broad adoption of wearable technologies appears to depend largely on the scientific community's ability to successfully address the identified barriers. APPLICATION Investigators may use the information provided to develop research studies that better address OSH practitioner concerns and help technology developers operationalize wearable sensors to improve employee health and well-being.
Collapse
|
42
|
Chen H, Schall MC, Fethke N. Accuracy of angular displacements and velocities from inertial-based inclinometers. APPLIED ERGONOMICS 2018; 67:151-161. [PMID: 29122186 PMCID: PMC9605618 DOI: 10.1016/j.apergo.2017.09.007] [Citation(s) in RCA: 11] [Impact Index Per Article: 1.6] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/18/2017] [Revised: 08/08/2017] [Accepted: 09/13/2017] [Indexed: 05/27/2023]
Abstract
The objective of this study was to evaluate the accuracy of various sensor fusion algorithms for measuring upper arm elevation relative to gravity (i.e., angular displacement and velocity summary measures) across different motion speeds. Thirteen participants completed a cyclic, short duration, arm-intensive work task that involved transfering wooden dowels at three work rates (slow, medium, fast). Angular displacement and velocity measurements of upper arm elevation were simultaneously measured using an inertial measurement unit (IMU) and an optical motion capture (OMC) system. Results indicated that IMU-based inclinometer solutions can reduce root-mean-square errors in comparison to accelerometer-based inclination estimates by as much as 87%, depending on the work rate and sensor fusion approach applied. The findings suggest that IMU-based inclinometers can substantially improve inclinometer accuracy in comparison to traditional accelerometer-based inclinometers. Ergonomists may use the non-proprietary sensor fusion algorithms provided here to more accurately estimate upper arm elevation.
Collapse
Affiliation(s)
- Howard Chen
- Department of Mechanical Engineering, Auburn University, AL, USA; Department of Mechanical and Industrial Engineering, University of Iowa, IA, USA; Department of Occupational and Environmental Health, University of Iowa, Iowa City, IA, USA.
| | - Mark C Schall
- Department of Industrial and Systems Engineering, Auburn University, Auburn, AL, USA
| | - Nathan Fethke
- Department of Occupational and Environmental Health, University of Iowa, Iowa City, IA, USA
| |
Collapse
|
43
|
Rose M, Curtze C, O'Sullivan J, El-Gohary M, Crawford D, Friess D, Brady JM. Wearable Inertial Sensors Allow for Quantitative Assessment of Shoulder and Elbow Kinematics in a Cadaveric Knee Arthroscopy Model. Arthroscopy 2017; 33:2110-2116. [PMID: 28866347 DOI: 10.1016/j.arthro.2017.06.042] [Citation(s) in RCA: 17] [Impact Index Per Article: 2.1] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 01/25/2017] [Revised: 05/09/2017] [Accepted: 06/17/2017] [Indexed: 02/02/2023]
Abstract
PURPOSE To develop a model using wearable inertial sensors to assess the performance of orthopaedic residents while performing a diagnostic knee arthroscopy. METHODS Fourteen subjects performed a diagnostic arthroscopy on a cadaveric right knee. Participants were divided into novices (5 postgraduate year 3 residents), intermediates (5 postgraduate year 4 residents), and experts (4 faculty) based on experience. Arm movement data were collected by inertial measurement units (Opal sensors) by securing 2 sensors to each upper extremity (dorsal forearm and lateral arm) and 2 sensors to the trunk (sternum and lumbar spine). Kinematics of the elbow and shoulder joints were calculated from the inertial data by biomechanical modeling based on a sequence of links connected by joints. Range of motion required to complete the procedure was calculated for each group. Histograms were used to compare the distribution of joint positions for an expert, intermediate, and novice. RESULTS For both the right and left upper extremities, skill level corresponded well with shoulder abduction-adduction and elbow prono-supination. Novices required on average 17.2° more motion in the right shoulder abduction-adduction plane than experts to complete the diagnostic arthroscopy (P = .03). For right elbow prono-supination (probe hand), novices required on average 23.7° more motion than experts to complete the procedure (P = .03). Histogram data showed novices had markedly more variability in shoulder abduction-adduction and elbow prono-supination compared with the other groups. CONCLUSIONS Our data show wearable inertial sensors can measure joint kinematics during diagnostic knee arthroscopy. Range-of-motion data in the shoulder and elbow correlated inversely with arthroscopic experience. Motion pattern-based analysis shows promise as a metric of resident skill acquisition and development in arthroscopy. CLINICAL RELEVANCE Wearable inertial sensors show promise as metrics of arthroscopic skill acquisition among residents.
Collapse
Affiliation(s)
- Michael Rose
- Department of Orthopaedic Surgery and Rehabilitation, Oregon Health and Science University, Portland, Oregon, U.S.A
| | - Carolin Curtze
- Department of Neurology, Oregon Health and Science University, Portland, Oregon, U.S.A
| | - Joseph O'Sullivan
- Department of Orthopaedic Surgery and Rehabilitation, Oregon Health and Science University, Portland, Oregon, U.S.A
| | | | - Dennis Crawford
- Department of Orthopaedic Surgery and Rehabilitation, Oregon Health and Science University, Portland, Oregon, U.S.A
| | - Darin Friess
- Department of Orthopaedic Surgery and Rehabilitation, Oregon Health and Science University, Portland, Oregon, U.S.A
| | - Jacqueline M Brady
- Department of Orthopaedic Surgery and Rehabilitation, Oregon Health and Science University, Portland, Oregon, U.S.A..
| |
Collapse
|
44
|
Human Actions Analysis: Templates Generation, Matching and Visualization Applied to Motion Capture of Highly-Skilled Karate Athletes. SENSORS 2017; 17:s17112590. [PMID: 29125560 PMCID: PMC5713128 DOI: 10.3390/s17112590] [Citation(s) in RCA: 20] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 10/01/2017] [Revised: 11/03/2017] [Accepted: 11/07/2017] [Indexed: 12/02/2022]
Abstract
The aim of this paper is to propose and evaluate the novel method of template generation, matching, comparing and visualization applied to motion capture (kinematic) analysis. To evaluate our approach, we have used motion capture recordings (MoCap) of two highly-skilled black belt karate athletes consisting of 560 recordings of various karate techniques acquired with wearable sensors. We have evaluated the quality of generated templates; we have validated the matching algorithm that calculates similarities and differences between various MoCap data; and we have examined visualizations of important differences and similarities between MoCap data. We have concluded that our algorithms works the best when we are dealing with relatively short (2–4 s) actions that might be averaged and aligned with the dynamic time warping framework. In practice, the methodology is designed to optimize the performance of some full body techniques performed in various sport disciplines, for example combat sports and martial arts. We can also use this approach to generate templates or to compare the correct performance of techniques between various top sportsmen in order to generate a knowledge base of reference MoCap videos. The motion template generated by our method can be used for action recognition purposes. We have used the DTW classifier with angle-based features to classify various karate kicks. We have performed leave-one-out action recognition for the Shorin-ryu and Oyama karate master separately. In this case, 100% actions were correctly classified. In another experiment, we used templates generated from Oyama master recordings to classify Shorin-ryu master recordings and vice versa. In this experiment, the overall recognition rate was 94.2%, which is a very good result for this type of complex action.
Collapse
|
45
|
Survey of Motion Tracking Methods Based on Inertial Sensors: A Focus on Upper Limb Human Motion. SENSORS 2017; 17:s17061257. [PMID: 28587178 PMCID: PMC5492902 DOI: 10.3390/s17061257] [Citation(s) in RCA: 123] [Impact Index Per Article: 15.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 03/28/2017] [Revised: 05/23/2017] [Accepted: 05/24/2017] [Indexed: 11/17/2022]
Abstract
Motion tracking based on commercial inertial measurements units (IMUs) has been widely studied in the latter years as it is a cost-effective enabling technology for those applications in which motion tracking based on optical technologies is unsuitable. This measurement method has a high impact in human performance assessment and human-robot interaction. IMU motion tracking systems are indeed self-contained and wearable, allowing for long-lasting tracking of the user motion in situated environments. After a survey on IMU-based human tracking, five techniques for motion reconstruction were selected and compared to reconstruct a human arm motion. IMU based estimation was matched against motion tracking based on the Vicon marker-based motion tracking system considered as ground truth. Results show that all but one of the selected models perform similarly (about 35 mm average position estimation error).
Collapse
|
46
|
Vasilyev P, Pearson S, El-Gohary M, Aboy M, McNames J. Inertial and time-of-arrival ranging sensor fusion. Gait Posture 2017; 54:1-7. [PMID: 28242567 PMCID: PMC5481529 DOI: 10.1016/j.gaitpost.2017.02.011] [Citation(s) in RCA: 9] [Impact Index Per Article: 1.1] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 07/07/2016] [Revised: 02/11/2017] [Accepted: 02/16/2017] [Indexed: 02/02/2023]
Abstract
Wearable devices with embedded kinematic sensors including triaxial accelerometers, gyroscopes, and magnetometers are becoming widely used in applications for tracking human movement in domains that include sports, motion gaming, medicine, and wellness. The kinematic sensors can be used to estimate orientation, but can only estimate changes in position over short periods of time. We developed a prototype sensor that includes ultra wideband ranging sensors and kinematic sensors to determine the feasibility of fusing the two sensor technologies to estimate both orientation and position. We used a state space model and applied the unscented Kalman filter to fuse the sensor information. Our results demonstrate that it is possible to estimate orientation and position with less error than is possible with either sensor technology alone. In our experiment we obtained a position root mean square error of 5.2cm and orientation error of 4.8° over a 15min recording.
Collapse
Affiliation(s)
- Paul Vasilyev
- APDM, Inc., 2828 SW Corbett Avenue, Portland, OR, USA
| | - Sean Pearson
- APDM, Inc., 2828 SW Corbett Avenue, Portland, OR, USA
| | - Mahmoud El-Gohary
- APDM, Inc., 2828 SW Corbett Avenue, Portland, OR, USA,Corresponding author: (Mahmoud El-Gohary)
| | - Mateo Aboy
- APDM, Inc., 2828 SW Corbett Avenue, Portland, OR, USA
| | - James McNames
- APDM, Inc., 2828 SW Corbett Avenue, Portland, OR, USA,Department of Electrical and Computer Engineering, Portland State University, Portland, OR, USA
| |
Collapse
|
47
|
Inertial Motion Capture Costume Design Study. SENSORS 2017; 17:s17030612. [PMID: 28304337 PMCID: PMC5375898 DOI: 10.3390/s17030612] [Citation(s) in RCA: 20] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 11/29/2016] [Revised: 03/09/2017] [Accepted: 03/13/2017] [Indexed: 11/17/2022]
Abstract
The paper describes a scalable, wearable multi-sensor system for motion capture based on inertial measurement units (IMUs). Such a unit is composed of accelerometer, gyroscope and magnetometer. The final quality of an obtained motion arises from all the individual parts of the described system. The proposed system is a sequence of the following stages: sensor data acquisition, sensor orientation estimation, system calibration, pose estimation and data visualisation. The construction of the system's architecture with the dataflow programming paradigm makes it easy to add, remove and replace the data processing steps. The modular architecture of the system allows an effortless introduction of a new sensor orientation estimation algorithms. The original contribution of the paper is the design study of the individual components used in the motion capture system. The two key steps of the system design are explored in this paper: the evaluation of sensors and algorithms for the orientation estimation. The three chosen algorithms have been implemented and investigated as part of the experiment. Due to the fact that the selection of the sensor has a significant impact on the final result, the sensor evaluation process is also explained and tested. The experimental results confirmed that the choice of sensor and orientation estimation algorithm affect the quality of the final results.
Collapse
|
48
|
Majumder S, Mondal T, Deen MJ. Wearable Sensors for Remote Health Monitoring. SENSORS (BASEL, SWITZERLAND) 2017; 17:E130. [PMID: 28085085 PMCID: PMC5298703 DOI: 10.3390/s17010130] [Citation(s) in RCA: 401] [Impact Index Per Article: 50.1] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 09/30/2016] [Revised: 12/12/2016] [Accepted: 12/21/2016] [Indexed: 01/01/2023]
Abstract
Life expectancy in most countries has been increasing continually over the several few decades thanks to significant improvements in medicine, public health, as well as personal and environmental hygiene. However, increased life expectancy combined with falling birth rates are expected to engender a large aging demographic in the near future that would impose significant burdens on the socio-economic structure of these countries. Therefore, it is essential to develop cost-effective, easy-to-use systems for the sake of elderly healthcare and well-being. Remote health monitoring, based on non-invasive and wearable sensors, actuators and modern communication and information technologies offers an efficient and cost-effective solution that allows the elderly to continue to live in their comfortable home environment instead of expensive healthcare facilities. These systems will also allow healthcare personnel to monitor important physiological signs of their patients in real time, assess health conditions and provide feedback from distant facilities. In this paper, we have presented and compared several low-cost and non-invasive health and activity monitoring systems that were reported in recent years. A survey on textile-based sensors that can potentially be used in wearable systems is also presented. Finally, compatibility of several communication technologies as well as future perspectives and research challenges in remote monitoring systems will be discussed.
Collapse
Affiliation(s)
- Sumit Majumder
- Department of Electrical and Computer Engineering, McMaster University, Hamilton, ON L8S 4L8, Canada.
| | - Tapas Mondal
- Department of Pediatrics, McMaster University, Hamilton, ON L8S 4L8, Canada.
| | - M Jamal Deen
- Department of Electrical and Computer Engineering, McMaster University, Hamilton, ON L8S 4L8, Canada.
| |
Collapse
|
49
|
Majumder S, Mondal T, Deen MJ. Wearable Sensors for Remote Health Monitoring. SENSORS (BASEL, SWITZERLAND) 2017; 17:s17010130. [PMID: 28085085 DOI: 10.1109/jsen.2017.2726304] [Citation(s) in RCA: 9] [Impact Index Per Article: 1.1] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 09/30/2016] [Revised: 12/12/2016] [Accepted: 12/21/2016] [Indexed: 05/27/2023]
Abstract
Life expectancy in most countries has been increasing continually over the several few decades thanks to significant improvements in medicine, public health, as well as personal and environmental hygiene. However, increased life expectancy combined with falling birth rates are expected to engender a large aging demographic in the near future that would impose significant burdens on the socio-economic structure of these countries. Therefore, it is essential to develop cost-effective, easy-to-use systems for the sake of elderly healthcare and well-being. Remote health monitoring, based on non-invasive and wearable sensors, actuators and modern communication and information technologies offers an efficient and cost-effective solution that allows the elderly to continue to live in their comfortable home environment instead of expensive healthcare facilities. These systems will also allow healthcare personnel to monitor important physiological signs of their patients in real time, assess health conditions and provide feedback from distant facilities. In this paper, we have presented and compared several low-cost and non-invasive health and activity monitoring systems that were reported in recent years. A survey on textile-based sensors that can potentially be used in wearable systems is also presented. Finally, compatibility of several communication technologies as well as future perspectives and research challenges in remote monitoring systems will be discussed.
Collapse
Affiliation(s)
- Sumit Majumder
- Department of Electrical and Computer Engineering, McMaster University, Hamilton, ON L8S 4L8, Canada.
| | - Tapas Mondal
- Department of Pediatrics, McMaster University, Hamilton, ON L8S 4L8, Canada.
| | - M Jamal Deen
- Department of Electrical and Computer Engineering, McMaster University, Hamilton, ON L8S 4L8, Canada.
| |
Collapse
|
50
|
Muller P, Begin MA, Schauer T, Seel T. Alignment-Free, Self-Calibrating Elbow Angles Measurement Using Inertial Sensors. IEEE J Biomed Health Inform 2016; 21:312-319. [PMID: 28113331 DOI: 10.1109/jbhi.2016.2639537] [Citation(s) in RCA: 36] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/09/2022]
Abstract
Due to their relative ease of handling and low cost, inertial measurement unit (IMU)-based joint angle measurements are used for a widespread range of applications. These include sports performance, gait analysis, and rehabilitation (e.g., Parkinson's disease monitoring or poststroke assessment). However, a major downside of current algorithms, recomposing human kinematics from IMU data, is that they require calibration motions and/or the careful alignment of the IMUs with respect to the body segments. In this article, we propose a new method, which is alignment-free and self-calibrating using arbitrary movements of the user and an initial zero reference arm pose. The proposed method utilizes real-time optimization to identify the two dominant axes of rotation of the elbow joint. The performance of the algorithm was assessed in an optical motion capture laboratory. The estimated IMU-based angles of a human subject were compared to the ones from a marker-based optical tracking system. The self-calibration converged in under 9.5 s on average and the rms errors with respect to the optical reference system were 2.7° for the flexion/extension and 3.8° for the pronation/supination angle. Our method can be particularly useful in the field of rehabilitation, where precise manual sensor-to-segment alignment as well as precise, predefined calibration movements are impractical.
Collapse
|