A machine learning approach to detect changes in gait parameters following a fatiguing occupational task

Automatic Detection of Fatigued Gait Patterns in Older Adults: An Intelligent Portable Device Integrating Force and Inertial Measurements with Machine Learning

PURPOSE

This study aimed to assess the feasibility of early detection of fatigued gait patterns for older adults through the development of a smart portable device.

METHODS

The smart device incorporated seven force sensors and a single inertial measurement unit (IMU) to measure regional plantar forces and foot kinematics. Data were collected from 18 older adults walking briskly on a treadmill for 60 min. The optimal feature set for each recognition model was determined using forward sequential feature selection in a wrapper fashion through fivefold cross-validation. The recognition model was selected from four machine learning models through leave-one-subject-out cross-validation.

RESULTS

Five selected characteristics that best represented the state of fatigue included impulse at the medial and lateral arches (increased, p = 0.002 and p < 0.001), contact angle and rotation range of angle in the sagittal plane (increased, p < 0.001), and the variability of the resultant swing angular acceleration (decreased, p < 0.001). The detection accuracy based on the dual signal source of IMU and plantar force was 99%, higher than the 95% accuracy based on the single source. The intelligent portable device demonstrated excellent generalization (ranging from 93 to 100%), real-time performance (2.79 ms), and portability (32 g).

CONCLUSION

The proposed smart device can detect fatigue patterns with high precision and in real time.

SIGNIFICANCE

The application of this device possesses the potential to reduce the injury risk for older adults related to fatigue during gait.

Quantifying Asymmetric Gait Pattern Changes Using a Hidden Markov Model Similarity Measure (HMM-SM) on Inertial Sensor Signals

Wearable gait analysis systems using inertial sensors offer the potential for easy-to-use gait assessment in lab and free-living environments. This can enable objective long-term monitoring and decision making for individuals with gait disabilities. This study explores a novel approach that applies a hidden Markov model-based similarity measure (HMM-SM) to assess changes in gait patterns based on the gyroscope and accelerometer signals from just one or two inertial sensors. Eleven able-bodied individuals were equipped with a system which perturbed gait patterns by manipulating stance-time symmetry. Inertial sensor data were collected from various locations on the lower body to train hidden Markov models. The HMM-SM was evaluated to determine whether it corresponded to changes in gait as individuals deviated from their baseline, and whether it could provide a reliable measure of gait similarity. The HMM-SM showed consistent changes in accordance with stance-time symmetry in the following sensor configurations: pelvis, combined upper leg signals, and combined lower leg signals. Additionally, the HMM-SM demonstrated good reliability for the combined upper leg signals (ICC = 0.803) and lower leg signals (ICC = 0.795). These findings provide preliminary evidence that the HMM-SM could be useful in assessing changes in overall gait patterns. This could enable the development of compact, wearable systems for unsupervised gait assessment, without the requirement to pre-identify and measure a set of gait parameters.

Wearable network for multilevel physical fatigue prediction in manufacturing workers

Manufacturing workers face prolonged strenuous physical activities, impacting both financial aspects and their health due to work-related fatigue. Continuously monitoring physical fatigue and providing meaningful feedback is crucial to mitigating human and monetary losses in manufacturing workplaces. This study introduces a novel application of multimodal wearable sensors and machine learning techniques to quantify physical fatigue and tackle the challenges of real-time monitoring on the factory floor. Unlike past studies that view fatigue as a dichotomous variable, our central formulation revolves around the ability to predict multilevel fatigue, providing a more nuanced understanding of the subject's physical state. Our multimodal sensing framework is designed for continuous monitoring of vital signs, including heart rate, heart rate variability, skin temperature, and more, as well as locomotive signs by employing inertial motion units strategically placed at six locations on the upper body. This comprehensive sensor placement allows us to capture detailed data from both the torso and arms, surpassing the capabilities of single-point data collection methods. We developed an innovative asymmetric loss function for our machine learning model, which enhances prediction accuracy for numerical fatigue levels and supports real-time inference. We collected data on 43 subjects following an authentic manufacturing protocol and logged their self-reported fatigue. Based on the analysis, we provide insights into our multilevel fatigue monitoring system and discuss results from an in-the-wild evaluation of actual operators on the factory floor. This study demonstrates our system's practical applicability and contributes a valuable open-access database for future research.

Designing a practical fatigue detection system: A review on recent developments and challenges

INTRODUCTION

Fatigue is considered to have a life-threatening effect on human health and it has been an active field of research in different sectors. Deploying wearable physiological sensors helps to detect the level of fatigue objectively without any concern of bias in subjective assessment and interfering with work.

METHODS

This paper provides an in-depth review of fatigue detection approaches using physiological signals to pinpoint their main achievements, identify research gaps, and recommend avenues for future research. The review results are presented under three headings, including: signal modality, experimental environments, and fatigue detection models. Fatigue detection studies are first divided based on signal modality into uni-modal and multi-modal approaches. Then, the experimental environments utilized for fatigue data collection are critically analyzed. At the end, the machine learning models used for the classification of fatigue state are reviewed.

PRACTICAL APPLICATIONS

The directions for future research are provided based on critical analysis of past studies. Finally, the challenges of objective fatigue detection in the real-world scenario are discussed.

Evaluation of walking activity and gait to identify physical and mental fatigue in neurodegenerative and immune disorders: preliminary insights from the IDEA-FAST feasibility study

BACKGROUND

Many individuals with neurodegenerative (NDD) and immune-mediated inflammatory disorders (IMID) experience debilitating fatigue. Currently, assessments of fatigue rely on patient reported outcomes (PROs), which are subjective and prone to recall biases. Wearable devices, however, provide objective and reliable estimates of gait, an essential component of health, and may present objective evidence of fatigue. This study explored the relationships between gait characteristics derived from an inertial measurement unit (IMU) and patient-reported fatigue in the IDEA-FAST feasibility study.

METHODS

Participants with IMIDs and NDDs (Parkinson's disease (PD), Huntington's disease (HD), rheumatoid arthritis (RA), systemic lupus erythematosus (SLE), primary Sjogren's syndrome (PSS), and inflammatory bowel disease (IBD)) wore a lower-back IMU continuously for up to 10 days at home. Concurrently, participants completed PROs (physical fatigue (PF) and mental fatigue (MF)) up to four times a day. Macro (volume, variability, pattern, and acceleration vector magnitude) and micro (pace, rhythm, variability, asymmetry, and postural control) gait characteristics were extracted from the accelerometer data. The associations of these measures with the PROs were evaluated using a generalised linear mixed-effects model (GLMM) and binary classification with machine learning.

RESULTS

Data were recorded from 72 participants: PD = 13, HD = 9, RA = 12, SLE = 9, PSS = 14, IBD = 15. For the GLMM, the variability of the non-walking bouts length (in seconds) with PF returned the highest conditional R2, 0.165, and with MF the highest marginal R2, 0.0018. For the machine learning classifiers, the highest accuracy of the current analysis was returned by the micro gait characteristics with an intrasubject cross validation method and MF as 56.90% (precision = 43.9%, recall = 51.4%). Overall, the acceleration vector magnitude, bout length variation, postural control, and gait rhythm were the most interesting characteristics for future analysis.

CONCLUSIONS

Counterintuitively, the outcomes indicate that there is a weak relationship between typical gait measures and abnormal fatigue. However, factors such as the COVID-19 pandemic may have impacted gait behaviours. Therefore, further investigations with a larger cohort are required to fully understand the relationship between gait and abnormal fatigue.

A scoping review of applications of artificial intelligence in kinematics and kinetics of ankle sprains - current state-of-the-art and future prospects

BACKGROUND

Despite the existence of evidence-based rehabilitation strategies that address biomechanical deficits, the persistence of recurrent ankle problems in 70% of patients with acute ankle sprains highlights the unresolved nature of this issue. Artificial intelligence (AI) emerges as a promising tool to identify definitive predictors for ankle sprains. This paper aims to summarize the use of AI in investigating the ankle biomechanics of healthy and subjects with ankle sprains.

METHODS

Articles published between 2010 and 2023 were searched from five electronic databases. 59 papers were included for analysis with regards to: i). types of motion tested (functional vs. purposeful ankle movement); ii) types of biomechanical parameters measured (kinetic vs kinematic); iii) types of sensor systems used (lab-based vs field-based); and, iv) AI techniques used.

FINDINGS

Most studies (83.1%) examined biomechanics during functional motion. Single kinematic parameter, specifically ankle range of motion, could obtain accuracy up to 100% in identifying injury status. Wearable sensor exhibited high reliability for use in both laboratory and on-field/clinical settings. AI algorithms primarily utilized electromyography and joint angle information as input data. Support vector machine was the most used supervised learning algorithm (18.64%), while artificial neural network demonstrated the highest accuracy in eight studies.

INTERPRETATIONS

The potential for remote patient monitoring is evident with the adoption of field-based devices. Nevertheless, AI-based sensors are underutilized in detecting ankle motions at risk of sprain. We identify three key challenges: sensor designs, the controllability of AI models, and the integration of AI-sensor models, providing valuable insights for future research.

Ergonomic investigations on novel dynamic postural estimator using blaze pose and transfer learning

The aim is to develop a computer-based assessment model for novel dynamic postural evaluation using RULA. The present study proposed a camera-based, three-dimensional (3D) dynamic human pose estimation model using 'BlazePose' with a data set of 50,000 action-level-based images. The model was investigated using the Deep Neural Network (DNN) and Transfer Learning (TL) approach. The model has been trained to evaluate the posture with high accuracy, precision, and recall for each output prediction class. The model can quickly analyse the ergonomics of dynamic posture online and offline with a promising accuracy of 94.12%. A novel dynamic postural estimator using blaze pose and transfer learning is proposed and assessed for accuracy. The model is subjected to a constant muscle loading factor and foot support score that could evaluate one person with good image clarity at a time.Practitioner summary: A detailed investigation of dynamic work postures is largely missing in the literature. Experimental analysis has been performed using transfer learning, BlazePose, and RULA action levels. An overall accuracy of 94.12% is achieved for dynamic postural assessment.

Automatic Body Segment and Side Recognition of an Inertial Measurement Unit Sensor during Gait

Inertial measurement unit (IMU) sensors are widely used for motion analysis in sports and rehabilitation. The attachment of IMU sensors to predefined body segments and sides (left/right) is complex, time-consuming, and error-prone. Methods for solving the IMU-2-segment (I2S) pairing work properly only for a limited range of gait speeds or require a similar sensor configuration. Our goal was to propose an algorithm that works over a wide range of gait speeds with different sensor configurations while being robust to footwear type and generalizable to pathologic gait patterns. Eight IMU sensors were attached to both feet, shanks, thighs, sacrum, and trunk, and 12 healthy subjects (training dataset) and 22 patients (test dataset) with medial compartment knee osteoarthritis walked at different speeds with/without insole. First, the mean stride time was estimated and IMU signals were scaled. Using a decision tree, the body segment was recognized, followed by the side of the lower limb sensor. The accuracy and precision of the whole algorithm were 99.7% and 99.0%, respectively, for gait speeds ranging from 0.5 to 2.2 m/s. In conclusion, the proposed algorithm was robust to gait speed and footwear type and can be widely used for different sensor configurations.

The relationship between ratings of perceived exertion (RPE) and relative strength for a fatiguing dynamic upper extremity task: A consideration of multiple cycles and conditions

The goal of this study was to evaluate the relationship between ratings of perceived exertion (RPE) and relative strength with respect to baseline for a fatiguing free dynamic task targeting the upper extremity, namely simulated order picking, and determine whether the relationship remains the same for different conditions (i.e., pace and weight) and with fatigue. Fourteen participants (seven males, seven females) performed four sessions that included two 45-min work periods separated by 15 min of rest. The work periods involved picking weighted bottles from shoulder height and packaging them at waist height for four combinations of bottle mass and picking rate: 2.5 kg-15 bottles per minute (bpm), 2.5 kg-10 bpm, 2.5 kg-5 bpm, and 1.5 kg-15 bpm. Participants reported their RPEs every 5 min and performed a maximum isometric shoulder flexion exertion every 9 min. Pearson product-moment correlation was used to evaluate the linear relationship between RPE and relative strength for each subject and work period. Then, the effects of condition and work period on the average relationship were assessed using a repeated-measures analysis of variance (ANOVA). For the first 45-min period, there were no significantly different correlations between RPE and relative strength across conditions (average r = -0.62 (standard deviation = 0.38); p = 0.57). There was a significant decrease in average correlation for the second work period (r = -0.39 (0.53)). These results suggest that individual subjective responses consistently increase while relative strength declines when starting from a non-fatigued state. However, correlations are weaker when re-engaging in work following incomplete recovery. Thus, starting fatigue levels should be accounted for when considering the expected relationship between RPE and relative strength.

Classifying Changes in Amputee Gait following Physiotherapy Using Machine Learning and Continuous Inertial Sensor Signals

Wearable sensors allow for the objective analysis of gait and motion both in and outside the clinical setting. However, it remains a challenge to apply such systems to highly diverse patient populations, including individuals with lower-limb amputations (LLA) that present with unique gait deviations and rehabilitation goals. This paper presents the development of a novel method using continuous gyroscope data from a single inertial sensor for person-specific classification of gait changes from a physiotherapist-led gait training session. Gyroscope data at the thigh were collected using a wearable gait analysis system for five LLA before, during, and after completing a gait training session. Data from able-bodied participants receiving no intervention were also collected. Models using dynamic time warping (DTW) and Euclidean distance in combination with the nearest neighbor classifier were applied to the gyroscope data to classify the pre- and post-training gait. The model achieved an accuracy of 98.65% ± 0.69 (Euclidean) and 98.98% ± 0.83 (DTW) on pre-training and 95.45% ± 6.20 (Euclidean) and 94.18% ± 5.77 (DTW) on post-training data across the participants whose gait changed significantly during their session. This study provides preliminary evidence that continuous angular velocity data from a single gyroscope could be used to assess changes in amputee gait. This supports future research and the development of wearable gait analysis and feedback systems that are adaptable to a broad range of mobility impairments.

Machine Learning Approach to Model Physical Fatigue during Incremental Exercise among Firefighters

Physical fatigue is a serious threat to the health and safety of firefighters. Its effects include decreased cognitive abilities and a heightened risk of accidents. Subjective scales and, recently, on-body sensors have been used to monitor physical fatigue among firefighters and safety-sensitive professionals. Considering the capabilities (e.g., noninvasiveness and continuous monitoring) and limitations (e.g., assessed fatiguing tasks and models validation procedures) of current approaches, this study aimed to develop a physical fatigue prediction model combining cardiorespiratory and thermoregulatory measures and machine learning algorithms within a firefighters' sample. Sensory data from heart rate, breathing rate and core temperature were recorded from 24 participants during an incremental running protocol. Various supervised machine learning algorithms were examined using 21 features extracted from the physiological variables and participants' characteristics to estimate four physical fatigue conditions: low, moderate, heavy and severe. Results showed that the XGBoosted Trees algorithm achieved the best outcomes with an average accuracy of 82% and accuracies of 93% and 86% for recognising the low and severe levels. Furthermore, this study evaluated different methods to assess the models' performance, concluding that the group cross-validation method presents the most practical results. Overall, this study highlights the advantages of using multiple physiological measures for enhancing physical fatigue modelling. It proposes a promising health and safety management tool and lays the foundation for future studies in field conditions.

Experts' opinions about lasting innovative technologies in City Logistics

The COVID-19 pandemic has highlighted the relevance of goods delivery in urban areas. However, this activity often generates negative environmental impact and several technologies have been proposed in recent years to reduce it, thus forming a complex innovation landscape characterized by different levels of maturity and effects on the City Logistics (CL) system. This complexity causes a deep uncertainty over the future of CL. This paper aims to tackle this uncertainty by forecasting the future of a set of CL technologies. A Delphi survey has been submitted to experts of this field to achieve a stable consensus over 33 projections related to 7 CL technologies for the year 2030. Results show that real-time data collection will help the coordination process between stakeholders, engendering an increased awareness over the value of using logistics data as well as its potential drawbacks. Moreover, experts share a positive attitude towards the expansion of Parcel Lockers, which should be monitored by public authorities to avoid a negative impact on land use. Finally, technologies such as drones and crowd-logistics have drawn the lowest level of consensus due to their lower level of maturity, which arouse the necessity to further explore several issues such as legal and technical barriers.

Identity and Gender Recognition Using a Capacitive Sensing Floor and Neural Networks

In recent publications, capacitive sensing floors have been shown to be able to localize individuals in an unobtrusive manner. This paper demonstrates that it might be possible to utilize the walking characteristics extracted from a capacitive floor to recognize subject and gender. Several neural network-based machine learning techniques are developed for recognizing the gender and identity of a target. These algorithms were trained and validated using a dataset constructed from the information captured from 23 subjects while walking, alone, on the sensing floor. A deep neural network comprising a Bi-directional Long Short-Term Memory (BLSTM) provided the most accurate identity performance, classifying individuals with an accuracy of 98.12% on the test data. On the other hand, a Convolutional Neural Network (CNN) was the most accurate for gender recognition, attaining an accuracy of 93.3%. The neural network-based algorithms are benchmarked against Support Vector Machine (SVM), which is a classifier used in many reported works for floor-based recognition tasks. The majority of the neural networks outperform SVM across all accuracy metrics.

Enabling Fairness in Healthcare Through Machine Learning

The use of machine learning systems for decision-support in healthcare may exacerbate health inequalities. However, recent work suggests that algorithms trained on sufficiently diverse datasets could in principle combat health inequalities. One concern about these algorithms is that their performance for patients in traditionally disadvantaged groups exceeds their performance for patients in traditionally advantaged groups. This renders the algorithmic decisions unfair relative to the standard fairness metrics in machine learning. In this paper, we defend the permissible use of affirmative algorithms; that is, algorithms trained on diverse datasets that perform better for traditionally disadvantaged groups. Whilst such algorithmic decisions may be unfair, the fairness of algorithmic decisions is not the appropriate locus of moral evaluation. What matters is the fairness of final decisions, such as diagnoses, resulting from collaboration between clinicians and algorithms. We argue that affirmative algorithms can permissibly be deployed provided the resultant final decisions are fair.

Multiple inertial measurement unit combination and location for recognizing general, fatigue, and simulated-fatigue gait

BACKGROUND

Muscle fatigue of the lower limbs results in dynamic imbalance and gait instability, increasing the risk of falling. However, people might slow walk without physical muscle fatigue due to mental fatigue. Wearable inertial measurement units (IMU) and machine learning approaches have been well employed for recognizing human activities.

RESEARCH QUESTION

The study aims to use a machine learning technique to recognize the data collected from IMUs for physically fatigued or slow-walking gaits. Second, the study aims to reveal the location or the number of IMUs can have the best performance.

METHODS

Sixteen healthy adults with six IMUs attached to their heels, toes, sacrum, and head participated in the experiment. On the first day, the participants were instructed to walk along a hallway before and after the fatigue protocol as the Pre- and Post-fatigue gait. On the second day, the participants were instructed to walk along a hallway following the beat of their fatigue gait cadence measured on the first day as the simulated cadence (SC) gait. Gait cycles of each condition were segmented as the inputs of the Long Short-Term Memory (LSTM) model for recognization.

RESULTS

The result revealed that the LSTM model could recognize the gait of simulated cadence with the highest accuracy among these three gaits. For the signal body part, the highest accuracy was 93.20 % observed at the IMUs of toes. For the best combination, the IMUs of toes and sacrum achieved the highest accuracy of 95.71 %.

SIGNIFICANCE

The machine learning technique of LSTM with one or more IMUs can recognize the gait under normal, physical fatigue, or simulated cadence without muscle fatigue. Our model and approach would be expected to provide conditional warning in multiple fields, such as industrial safety for potential applications.

K-score: A novel scoring system to quantify fatigue-related ergonomic risk based on joint angle measurements via wearable inertial measurement units

Work-related musculoskeletal disorders have been recognized as a global problem that affects millions of people annually. Fatigue is one of the main contributors to musculoskeletal disorders. Thus, this study investigated fatigue detection based on the measured body motion by wearable inertial measurement units. We quantified the body motion during manual handling tasks using a novel kinematic score (i.e., K-score), and the Rapid Entire Body Assessment (REBA). K-score and REBA were calculated using joint angles. Nevertheless, unlike REBA, K-score showed a significant correlation (Spearman's correlation coefficient of ρ(302) = 0.21, p < 0.05) with electromyography (EMG) signal amplitude, which was affected by muscle fatigue. Therefore, in-field measurement of K-score using inertial measurement units could detect the fatigue-induced change of body motion in long-duration manual handling tasks. Our proposed K-score can be used to assess fatigue-related ergonomic risk in long-term and real-world working conditions without the need for tedious EMG recording at workplaces.

A data analytic end-to-end framework for the automated quantification of ergonomic risk factors across multiple tasks using a single wearable sensor

Existing ergonomic risk assessment tools require monitoring of multiple risk factors. To eliminate the direct observation, we investigated the effectiveness of an end-to-end framework that works with the data from a single wearable sensor. The framework is used to identify the performed task as the major contextual risk factor, and then estimate the task duration and number of repetitions as two main indicators of task intensity. For evaluation of the framework, we recruited 37 participants to complete 10 simulated work tasks in a laboratory setting. In testing, we achieved an average accuracy of 92% for task identification, 7.3% error in estimation of task duration, and 7.1% error for counting the number of task repetitions. Moreover, we showed the utility of the framework outputs in two ergonomic tools to estimate the risk of injury. Overall, we indicated the feasibility of using data from wearable sensors to automate the ergonomic risk assessment in workplaces.

A machine learning approach for the identification of kinematic biomarkers of chronic neck pain during single- and dual-task gait

BACKGROUND

Changes in gait characteristics have been reported in people with chronic neck pain (CNP).

RESEARCH QUESTION

Can we classify people with and without CNP by training machine learning models with Inertial Measurement Units (IMU)-based gait kinematic data?

METHODS

Eighteen asymptomatic individuals and 21 participants with CNP were recruited for the study and performed two gait trajectories, (1) linear walking with their head straight (single-task) and (2) linear walking with continuous head-rotation (dual-task). Kinematic data were recorded from three IMU sensors attached to the forehead, upper thoracic spine (T1), and lower thoracic spine (T12). Temporal and spectral features were extracted to generate the dataset for both single- and dual-task gait. To evaluate the most significant features and simultaneously reduce the dataset size, the Neighbourhood Component Analysis (NCA) method was utilized. Three supervised models were applied, including K-Nearest Neighbour, Support Vector Machine, and Linear Discriminant Analysis to test the performance of the most important temporal and spectral features.

RESULTS

The performance of all classifiers increased after the implementation of NCA. The best performance was achieved by NCA-Support Vector Machine with an accuracy of 86.85%, specificity of 83.30%, and sensitivity of 92.85% during the dual-task gait using only nine features.

SIGNIFICANCE

The results present a data-driven approach and machine learning-based methods to identify test conditions and features from high-dimensional data obtained during gait for the classification of people with and without CNP.

Accelerometer-Based Identification of Fatigue in the Lower Limbs during Cyclical Physical Exercise: A Systematic Review

Physical exercise (PE) is beneficial for both physical and psychological health aspects. However, excessive training can lead to physical fatigue and an increased risk of lower limb injuries. In order to tailor training loads and durations to the needs and capacities of an individual, physical fatigue must be estimated. Different measurement devices and techniques (i.e., ergospirometers, electromyography, and motion capture systems) can be used to identify physical fatigue. The field of biomechanics has succeeded in capturing changes in human movement with optical systems, as well as with accelerometers or inertial measurement units (IMUs), the latter being more user-friendly and adaptable to real-world scenarios due to its wearable nature. There is, however, still a lack of consensus regarding the possibility of using biomechanical parameters measured with accelerometers to identify physical fatigue states in PE. Nowadays, the field of biomechanics is beginning to open towards the possibility of identifying fatigue state using machine learning algorithms. Here, we selected and summarized accelerometer-based articles that either (a) performed analyses of biomechanical parameters that change due to fatigue in the lower limbs or (b) performed fatigue identification based on features including biomechanical parameters. We performed a systematic literature search and analysed 39 articles on running, jumping, walking, stair climbing, and other gym exercises. Peak tibial and sacral acceleration were the most common measured variables and were found to significantly increase with fatigue (respectively, in 6/13 running articles and 2/4 jumping articles). Fatigue classification was performed with an accuracy between 78% and 96% and Pearson's correlation with an RPE (rate of perceived exertion) between r = 0.79 and r = 0.95. We recommend future effort toward the standardization of fatigue protocols and methods across articles in order to generalize fatigue identification results and increase the use of accelerometers to quantify physical fatigue in PE.

An AI-Assisted and Self-Powered Smart Robotic Gripper Based on Eco-EGaIn Nanocomposite for Pick-and-Place Operation

High compliance and muscle-alike soft robotic grippers have shown promising performance in addressing the challenges in traditional rigid grippers. Nevertheless, a lack of control feedback (gasping speed and contact force) in a grasping operation can result in undetectable slipping and false positioning. In this study, a pneumatically driven and self-powered soft robotic gripper that can recognize the grabbed object is reported. We integrated pressure (P-TENG) and bend (B-TENG) triboelectric sensors into a soft robotic gripper to transduce the features of gripped objects in a pick-and-place operation. Both the P-TENG and B-TENG sensors are fabricated using a porous structure made of soft Ecoflex and Euthethic Gallium-Indium nanocomposite (Eco-EGaIn). The output voltage of this porous setup has been improved by 63%, as compared to the non-porous structure. The developed soft gripper successfully recognizes three different objects, cylinder, cuboid, and pyramid prism, with a good accuracy of 91.67% and has shown its potential to be beneficial in the assembly lines, sorting, VR/AR application, and education training.

A Survey of Human Gait-Based Artificial Intelligence Applications

We performed an electronic database search of published works from 2012 to mid-2021 that focus on human gait studies and apply machine learning techniques. We identified six key applications of machine learning using gait data: 1) Gait analysis where analyzing techniques and certain biomechanical analysis factors are improved by utilizing artificial intelligence algorithms, 2) Health and Wellness, with applications in gait monitoring for abnormal gait detection, recognition of human activities, fall detection and sports performance, 3) Human Pose Tracking using one-person or multi-person tracking and localization systems such as OpenPose, Simultaneous Localization and Mapping (SLAM), etc., 4) Gait-based biometrics with applications in person identification, authentication, and re-identification as well as gender and age recognition 5) “Smart gait” applications ranging from smart socks, shoes, and other wearables to smart homes and smart retail stores that incorporate continuous monitoring and control systems and 6) Animation that reconstructs human motion utilizing gait data, simulation and machine learning techniques. Our goal is to provide a single broad-based survey of the applications of machine learning technology in gait analysis and identify future areas of potential study and growth. We discuss the machine learning techniques that have been used with a focus on the tasks they perform, the problems they attempt to solve, and the trade-offs they navigate.

The role of machine learning in the primary prevention of work-related musculoskeletal disorders: A scoping review

To determine the applications of machine learning (ML) techniques used for the primary prevention of work-related musculoskeletal disorders (WMSDs), a scoping review was conducted using seven literature databases. Of the 4,639 initial results, 130 primary research studies were deemed relevant for inclusion. Studies were reviewed and classified as a contribution to one of six steps within the primary WMSD prevention research framework by van der Beek et al. (2017). ML techniques provided the greatest contributions to the development of interventions (48 studies), followed by risk factor identification (33 studies), underlying mechanisms (29 studies), incidence of WMSDs (14 studies), evaluation of interventions (6 studies), and implementation of effective interventions (0 studies). Nearly a quarter (23.8%) of all included studies were published in 2020. These findings provide insight into the breadth of ML techniques used for primary WMSD prevention and can help identify areas for future research and development.

Machine learning methods for electromyography error detection in field research: An application in full-shift field assessment of shoulder muscle activity in apple harvesting workers

This study presented an alternative technique for processing electromyography (EMG) data with sporadic errors due to challenges associated with the field collection of EMG data. The application of this technique was used to detect errors, clean and optimize EMG data in order characterize and compare shoulder muscular load in farmworkers during apple harvesting in a trellised orchard. Surface EMG was used to take measurements from twenty-four participants in an actual field work environment. Anomalies in the EMG data were detected and removed with a customized algorithm using principal component analysis, interquartile range cut-off and unsupervised cluster analysis. This study found significantly greater upper trapezius muscle activity in farmworkers who used a ladder as compared to the alternative platform-based method where a team of mobile platform workers harvested apples from the tree tops and a second separate team of ground workers harvested apples from the tree bottoms. By comparing the unprocessed and the processed, anomaly-free EMG data, the robustness of our proposed method was demonstrated.

Heat Stress Increases Movement Jerk During Physical Exertion

Objective: Movement efficiency can be quantified during physical tasks by measuring the rate of change of acceleration (jerk). Jerk captures the smoothness of a motion and has been used to quantify movement for upper extremity and torso-based tasks. We collected triaxial accelerometer data during four physical tasks commonly performed in the work place to determine if jerk increases with physiologic strain.

Methods: Participants completed a circuit of activities that mimicked the demands of manual labor in hot (40°C) and temperate (18°C) conditions. The circuit included walking on a treadmill carrying a load on the shoulder, lifting objects from the floor to the table, using a dead blow to strike the end of a heavy steel beam, and a kneeling rope pull. After the 9 min circuit, the participant had a standing rest for 1 min before repeating the circuit 3 additional times. Participants were instrumented with four 3-axis accelerometers (Actigraph wGT3X) secured to the torso, wrist, and upper arm.

Results: There were 20 trials in the hot condition and 12 trials in the temperate condition. Heart rate and core body temperature increased during both protocols (p < 0.001). Measures of jerk varied by accelerometer location and activity. During treadmill walking, the wrist, torso, arm accelerometers measured higher jerk during the fourth circuit in the hot condition. During the lifting task, mean jerk increased in the hot condition in all accelerometers. Max jerk increased in the temperate condition in the arm accelerometer and jerk cost increased in the hot condition in the torso and arm accelerometers.

Conclusions: Forty minutes of paced work performed in the heat resulted in increased acceleration and jerk in accelerometers placed on the torso, arm, and wrist. The accelerometers most consistently reporting these changes were task specific and suggest that a limited number of worn sensors could identify the onset of fatigue and increased injury risk.

Gait Characteristics and Fatigue Profiles When Standing on Surfaces with Different Hardness: Gait Analysis and Machine Learning Algorithms

Simple Summary

The purpose of this study was to explore if an anti-fatigue soft mat could improve the gait performance after standing for long periods and to examine if a machine-learning algorithm could evaluate fatigue state objectively. Compared with standing directly on the hard ground, using an anti-fatigue mat could reduce the negative effect of standing for a long time (4 h). The machine-learning algorithm demonstrated moderate accuracy in measuring fatigue. The accuracy of gait parameters used to consider a non-fatigued state following the use of an anti-fatigue mat was higher than that of the fatigue state. The results may indicate that it is beneficial to use anti-fatigue mats when standing for long periods, and it is feasible to use gait parameters and machine-learning algorithms to detect fatigue.

Abstract

Background: Longtime standing may cause fatigue and discomfort in the lower extremities, leading to an increased risk of falls and related musculoskeletal diseases. Therefore, preventive interventions and fatigue detection are crucial. This study aims to explore whether anti-fatigue mats can improve gait parameters following long periods of standing and try to use machine learning algorithms to identify the fatigue states of standing workers objectively. Methods: Eighteen healthy young subjects were recruited to stand on anti-fatigue mats and hard ground to work 4 h, including 10 min rest. The portable gait analyzer collected walking speed, stride length, gait frequency, single support time/double support time, swing work, and leg fall intensity. A Paired sample t-test was used to compare the difference of gait parameters without standing intervention and standing on two different hardness planes for 4 h. An independent sample t-test was used to analyze the difference between males and females. The K-nearest neighbor (KNN) classification algorithm was performed, the subject’s gait characteristics were divided into non-fatigued and fatigue groups. The gait parameters selection and the error rate of fatigue detection were analyzed. Results: When gender differences were not considered, the intensity of leg falling after standing on the hard ground for 4 h was significantly lower than prior to the intervention (p < 0.05). When considering the gender, the stride length and leg falling strength of female subjects standing on the ground for 4 h were significantly lower than those before the intervention (p < 0.05), and the leg falling strength after standing on the mat for 4 h was significantly lower than that recorded before the standing intervention (p < 0.05). The leg falling strength of male subjects standing on the ground for 4 h was significantly lower than before the intervention (p < 0.05). After standing on the ground for 4 h, female subjects’ walking speed and stride length were significantly lower than those of male subjects (p < 0.05). In addition, the accuracy of testing gait parameters to predict fatigue was medium (75%). After standing on the mat was divided into fatigue, the correct rate was 38.9%, and when it was divided into the non-intervention state, the correct rate was 44.4%. Conclusion: The results show that the discomfort and fatigue caused by standing for 4 h could lead to the gait parameters variation, especially in females. The use of anti-fatigue mats may improve the negative influence caused by standing for a long period. The results of the KNN classification algorithm showed that gait parameters could be identified after fatigue, and the use of an anti-fatigue mat could improve the negative effect of standing for a long time. The accuracy of the prediction results in this study was moderate. For future studies, researchers need to optimize the algorithm and include more factors to improve the prediction accuracy.

A Taxonomy of Technologies for Human-Centred Logistics 4.0

Following the spread of the Industry 4.0 paradigm, the role of digital technologies in manufacturing, especially in production and industrial logistics processes, has become increasingly pivotal. Although the push towards digitalization and processes interconnection can bring substantial benefits, it may also increase the complexity of processes in terms of integration and management. To fully exploit the potential of technology, companies are required to develop an in-depth knowledge of each operational activity and related human aspects in the contexts where technology solutions can be implemented. Indeed, analyzing the impacts of technology on human work is key to promoting human-centred smart manufacturing and logistics processes. Therefore, this paper aims at increasing and systematizing knowledge about technologies supporting internal logistics working activities The main contribution of this paper is a taxonomy of the technologies that may be implemented in the different internal logistics areas to support a Logistics 4.0 model. Such a contribution is elaborated in accordance with a deductive approach (i.e., reasoning from the particular to the general), and backed up by an analysis of the literature. The taxonomy represents a useful framework to understand the current and possible technological implementations to drive logistics processes towards Logistics 4.0, with specific attention to the relation between human operators and technologies.

Wearable inertial sensors for human movement analysis: a five-year update

INTRODUCTION

The aim of the present review is to track the evolution of wearable IMUs from their use in supervised laboratory- and ambulatory-based settings to their application for long-term monitoring of human movement in unsupervised naturalistic settings.

AREAS COVERED

Four main emerging areas of application were identified and synthesized, namely, mobile health solutions (specifically, for the assessment of frailty, risk of falls, chronic neurological diseases, and for the monitoring and promotion of active living), occupational ergonomics, rehabilitation and telerehabilitation, and cognitive assessment. Findings from recent scientific literature in each of these areas was synthesized from an applied and/or clinical perspective with the purpose of providing clinical researchers and practitioners with practical guidance on contemporary uses of inertial sensors in applied clinical settings.

EXPERT OPINION

IMU-based wearable devices have undergone a rapid transition from use in laboratory-based clinical practice to unsupervised, applied settings. Successful use of wearable inertial sensing for assessing mobility, motor performance and movement disorders in applied settings will rely also on machine learning algorithms for managing the vast amounts of data generated by these sensors for extracting information that is both clinically relevant and interpretable by practitioners.

Towards Machine Learning-Based Detection of Running-Induced Fatigue in Real-World Scenarios: Evaluation of IMU Sensor Configurations to Reduce Intrusiveness

Physical fatigue is a recurrent problem in running that negatively affects performance and leads to an increased risk of being injured. Identification and management of fatigue helps reducing such negative effects, but is presently commonly based on subjective fatigue measurements. Inertial sensors can record movement data continuously, allowing recording for long durations and extensive amounts of data. Here we aimed to assess if inertial measurement units (IMUs) can be used to distinguish between fatigue levels during an outdoor run with a machine learning classification algorithm trained on IMU-derived biomechanical features, and what is the optimal configuration to do so. Eight runners ran 13 laps of 400 m on an athletic track at a constant speed with 8 IMUs attached to their body (feet, tibias, thighs, pelvis, and sternum). Three segments were extracted from the run: laps 2–4 (no fatigue condition, Rating of Perceived Exertion (RPE) = 6.0 ± 0.0); laps 8–10 (mild fatigue condition, RPE = 11.7 ± 2.0); laps 11–13 (heavy fatigue condition, RPE = 14.2 ± 3.0), run directly after a fatiguing protocol (progressive increase of speed until RPE ≥ 16) that followed lap 10. A random forest classification algorithm was trained with selected features from the 400 m moving average of the IMU-derived accelerations, angular velocities, and joint angles. A leave-one-subject-out cross validation was performed to assess the optimal combination of IMU locations to detect fatigue and selected sensor configurations were considered. The left tibia was the most recurrent sensor location, resulting in accuracies ranging between 0.761 (single left tibia location) and 0.905 (all IMU locations). These findings contribute toward a balanced choice between higher accuracy and lower intrusiveness in the development of IMU-based fatigue detection devices in running.

Smartphone-based human fatigue level detection using machine learning approaches

Human muscle fatigue is the main result of diminishing muscle capability, leading to reduced performance and increased risk of falls and injury. This study provides a classification model to identify the human fatigue level based on the motion signals collected by a smartphone. 24 participants were recruited and performed the fatiguing exercise (i.e. squatting). Upon completing each set of squatting, they walked for a fixed distance while the smartphone attached to their right shank and the gait data were associated with the Borg's Rating of Perceived Exertion (i.e. data label). Our machine-learning model of two (no- vs. strong-fatigue), three (no-, medium-, and strong-fatigue) and four (no-, low-, medium-, and strong-fatigue) levels of fatigue reached the accuracy of 91, 78, and 64%, respectively. The outcomes of this study may facilitate the accessibility of a fatigue-monitoring tool in the workplace, which improves the workers' performance and reduce the risk of falls and injury. Practitioner Summary: This study aimed to develop a machine-learning model to identify human fatigue level using motion data captured by a smartphone attached to the shank. Our results can facilitate the development of an accessible fatigue-monitoring system that may improve the workers' performance and reduce the risk of falls and injury. Abbreviations: WMSD: work-related musculoskeletal disorders; IMU: inertial measurement unit; RPE: rating of perceived exertion; SVM: support vector machine; IRB: institutional review board; SOM: self-organizing map; LDA: linear discriminant analysis; PCA: principal component analysis; FT: fourier transformation; RBF: radial basis function; CUSUM: cumulative sum; ROM: range of motion; MVC: maximum voluntary contractions.

Chen B. A Data-Driven Approach to Predict Fatigue in Exercise Based on Motion Data from Wearable Sensors or Force Plate

Fatigue increases the risk of injury during sports training and rehabilitation. Early detection of fatigue during exercises would help adapt the training in order to prevent over-training and injury. This study lays the foundation for a data-driven model to automatically predict the onset of fatigue and quantify consequent fatigue changes using a force plate (FP) or inertial measurement units (IMUs). The force plate and body-worn IMUs were used to capture movements associated with exercises (squats, high knee jacks, and corkscrew toe-touch) to estimate participant-specific fatigue levels in a continuous fashion using random forest (RF) regression and convolutional neural network (CNN) based regression models. Analysis of unseen data showed high correlation (up to 89%, 93%, and 94% for the squat, jack, and corkscrew exercises, respectively) between the predicted fatigue levels and self-reported fatigue levels. Predictions using force plate data achieved similar performance as those with IMU data; the best results in both cases were achieved with a convolutional neural network. The displacement of the center of pressure (COP) was found to be correlated with fatigue compared to other commonly used features of the force plate. Bland-Altman analysis also confirmed that the predicted fatigue levels were close to the true values. These results contribute to the field of human motion recognition by proposing a deep neural network model that can detect fairly small changes of motion data in a continuous process and quantify the movement. Based on the successful findings with three different exercises, the general nature of the methodology is potentially applicable to a variety of other forms of exercises, thereby contributing to the future adaptation of exercise programs and prevention of over-training and injury as a result of excessive fatigue.

A forecasting framework for predicting perceived fatigue: Using time series methods to forecast ratings of perceived exertion with features from wearable sensors

Advancements in sensing and network technologies have increased the amount of data being collected to monitor the worker conditions. In this study, we consider the use of time series methods to forecast physical fatigue using subjective ratings of perceived exertion (RPE) and gait data from wearable sensors captured during a simulated in-lab manual material handling task (Lab Study 1) and a fatiguing squatting with intermittent walking cycle (Lab Study 2). To determine whether time series models can accurately forecast individual response and for how many time periods ahead, five models were compared: naïve method, autoregression (AR), autoregressive integrated moving average (ARIMA), vector autoregression (VAR), and the vector error correction model (VECM). For forecasts of three or more time periods ahead, the VECM model that incorporates historical RPE and wearable sensor data outperformed the other models with median mean absolute error (MAE) <1.24 and median MAE <1.22 across all participants for Lab Study 1 and Lab Study 2, respectively. These results suggest that wearable sensor data can support forecasting a worker's condition and the forecasts obtained are as good as current state-of-the-art models using multiple sensors for current time prediction.

Driver Fatigue Detection Systems Using Multi-Sensors, Smartphone, and Cloud-Based Computing Platforms: A Comparative Analysis

Internet of things (IoT) cloud-based applications deliver advanced solutions for smart cities to decrease traffic accidents caused by driver fatigue while driving on the road. Environmental conditions or driver behavior can ultimately lead to serious roadside accidents. In recent years, the authors have developed many low-cost, computerized, driver fatigue detection systems (DFDs) to help drivers, by using multi-sensors, and mobile and cloud-based computing architecture. To promote safe driving, these are the most current emerging platforms that were introduced in the past. In this paper, we reviewed state-of-the-art approaches for predicting unsafe driving styles using three common IoT-based architectures. The novelty of this article is to show major differences among multi-sensors, smartphone-based, and cloud-based architectures in multimodal feature processing. We discussed all of the problems that machine learning techniques faced in recent years, particularly the deep learning (DL) model, to predict driver hypovigilance, especially in terms of these three IoT-based architectures. Moreover, we performed state-of-the-art comparisons by using driving simulators to incorporate multimodal features of the driver. We also mention online data sources in this article to test and train network architecture in the field of DFDs on public available multimodal datasets. These comparisons assist other authors to continue future research in this domain. To evaluate the performance, we mention the major problems in these three architectures to help researchers use the best IoT-based architecture for detecting DFDs in a real-time environment. Moreover, the important factors of Multi-Access Edge Computing (MEC) and 5th generation (5G) networks are analyzed in the context of deep learning architecture to improve the response time of DFD systems. Lastly, it is concluded that there is a research gap when it comes to implementing the DFD systems on MEC and 5G technologies by using multimodal features and DL architecture.

Motion Capture Technology in Industrial Applications: A Systematic Review

The rapid technological advancements of Industry 4.0 have opened up new vectors for novel industrial processes that require advanced sensing solutions for their realization. Motion capture (MoCap) sensors, such as visual cameras and inertial measurement units (IMUs), are frequently adopted in industrial settings to support solutions in robotics, additive manufacturing, teleworking and human safety. This review synthesizes and evaluates studies investigating the use of MoCap technologies in industry-related research. A search was performed in the Embase, Scopus, Web of Science and Google Scholar. Only studies in English, from 2015 onwards, on primary and secondary industrial applications were considered. The quality of the articles was appraised with the AXIS tool. Studies were categorized based on type of used sensors, beneficiary industry sector, and type of application. Study characteristics, key methods and findings were also summarized. In total, 1682 records were identified, and 59 were included in this review. Twenty-one and 38 studies were assessed as being prone to medium and low risks of bias, respectively. Camera-based sensors and IMUs were used in 40% and 70% of the studies, respectively. Construction (30.5%), robotics (15.3%) and automotive (10.2%) were the most researched industry sectors, whilst health and safety (64.4%) and the improvement of industrial processes or products (17%) were the most targeted applications. Inertial sensors were the first choice for industrial MoCap applications. Camera-based MoCap systems performed better in robotic applications, but camera obstructions caused by workers and machinery was the most challenging issue. Advancements in machine learning algorithms have been shown to increase the capabilities of MoCap systems in applications such as activity and fatigue detection as well as tool condition monitoring and object recognition.

Fatigue Monitoring in Running Using Flexible Textile Wearable Sensors

Fatigue is a multifunctional and complex phenomenon that affects how individuals perform an activity. Fatigue during running causes changes in normal gait parameters and increases the risk of injury. To address this problem, wearable sensors have been proposed as an unobtrusive and portable system to measure changes in human movement as a result of fatigue. Recently, a category of wearable devices that has gained attention is flexible textile strain sensors because of their ability to be woven into garments to measure kinematics. This study uses flexible textile strain sensors to continuously monitor the kinematics during running and uses a machine learning approach to estimate the level of fatigue during running. Five female participants used the sensor-instrumented garment while running to a state of fatigue. In addition to the kinematic data from the flexible textile strain sensors, the perceived level of exertion was monitored for each participant as an indication of their actual fatigue level. A stacked random forest machine learning model was used to estimate the perceived exertion levels from the kinematic data. The machine learning algorithm obtained a root mean squared value of 0.06 and a coefficient of determination of 0.96 in participant-specific scenarios. This study highlights the potential of flexible textile strain sensors to objectively estimate the level of fatigue during running by detecting slight perturbations in lower extremity kinematics. Future iterations of this technology may lead to real-time biofeedback applications that could reduce the risk of running-related overuse injuries.

Data analytics interrogates robotic surgical performance using a microsurgery-specific haptic device

OBJECTIVES

With the increase in robot-assisted cases, recording the quantifiable dexterity of surgeons is essential for proficiency evaluations. The present study employs sensor-based kinematics and recorded surgeon experience for evaluating a new haptic device.

METHODS

Thirty surgeons performed a task simulating micromanipulation with neuroArmPLUS^HD and two commercially available hand-controllers. The surgical performance was evaluated based on subjective measures obtained from survey and objective features derived from the sensors. Statistical analyses were performed to assess the hand-controllers and regression analysis was used to identify the key features and develop a machine learning model for surgical skill assessment.

FINDINGS

MANCOVA tests on objective features demonstrated significance (α = 0.05) for time (p = 0.02), errors (p = 0.01), distance (p = 0.03), clutch incidents (p = 0.03), and forces (p = 0.00). The majority of metrics were in favor of neuroArmPLUS^HD. The surgeons found it smoother, more comfortable, less tiring, and easier to maneuver with more realistic force feedback. The ensemble machine learning model trained with 5-fold cross-validation showed an accuracy (SD) of 0.78 (0.15) in surgeon skill classification.

CONCLUSIONS

This study validates the importance of incorporating a superior haptic device in telerobotic surgery for standardization of surgical education and patient care.