Validation of Inertial Sensing-Based Wearable Device for Tremor and Bradykinesia Quantification

Multi-Scale and Multi-Level Feature Assessment Framework for Classification of Parkinson's Disease State From Short-Term Motor Tasks

OBJECTIVE

Recent quantification research on Parkinson's disease (PD) integrates wearable technology with machine learning methods, indicating a strong potential for practical applications. However, the effectiveness of these techniques is influenced by environmental settings and is hardly applied in real-world situations. This paper aims to propose an effective feature assessment framework to automatically rate the severity of PD motor symptoms from short-term motor tasks, and then classify different PD severity levels in the real world.

METHODS

This paper identified specific PD motor symptoms using a novel feature-assessment framework at both segment-level and sample-level. Features were selected after calculating SHapley Additive exPlanation(SHAP) value, and verified by different machine learning methods with appropriate parameters. This framework has been verified on real-world data from 100 PD patients performing Unified Parkinson's Disease Rating Scale(UPDRS)-recommended short motor tasks, each task lasting 20-50 seconds.

RESULTS

The sensitivity for recognizing motor fluctuations reached 88% in tremor recognition. Additionally, LightGBM achieved the highest accuracy for early detection(92.59%) and achieved 71.58% in fine-grained severity classification using 31 selected features.

CONCLUSION

This paper reports the first effort to assess multi-level and multi-scale features for automatic quantification of motor symptoms and PD severity levels. The proposed framework has been proven effective in assessing key PD information for recognition during short-term tasks.

SIGNIFICANCE

The explanatory analysis of digital features in this study provides more prior knowledge for PD self-assessment in a free-living environment.

Relative sparing of dopaminergic terminals in the caudate nucleus is a feature of rest tremor in Parkinson's disease

Resting tremor (RT) is a Parkinson's disease (PD) symptom with an unclear relationship to the dopaminergic system. We analysed data from 432 subjects from the Parkinson's Progression Markers Initiative, 57 additional PD patients and controls and 86 subjects referred for dopamine transporter single-photon emission computed tomography (DaT-SPECT). Caudate binding ratio (CBR), but not putamen binding ratio, was higher in RT patients. Furthermore, higher baseline CBR was linked to RT development. In the smaller cohorts, a 4-6 Hz oscillation-based metric from inertial sensors correlated with RT amplitude, distinguished controls from patients with reduced DaT binding and correlated with CBR in the latter group. In silico modelling uncovered that higher CBR in RT patients explained correlations between RT and DaT-SPECT found in several datasets, supporting a spurious origin for ipsilateral correlations between CBR and RT. These results suggest that caudate dopaminergic terminals integrity is a feature of RT with potential pathophysiological implications.

Validation of computer vision technology for analyzing bradykinesia in outpatient clinic videos of people with Parkinson's disease

BACKGROUND

Current diagnosis and monitoring of Parkinson's disease (PD) is based on subjective clinical assessments. Objective measures of motor functioning could support clinical acumen. Computer vision (CV) technology is a promising contactless technique but requires further validation.

AIM

To investigate the performance of CV analysis of clinic-based videos of finger-tapping. Our goals were (i) to distinguish PD from healthy controls (HC), when compared to human raters, (ii) to measure the severity of bradykinesia, and (iii) detect ON/OFF medication state.

METHODS

Videos of thirty-one persons with PD and forty-nine HC were collected during clinical outpatient visits. Videos were analysed using CV to produce speed, amplitude, rhythm and composite bradykinesia measures. All videos were independently rated by three raters using the Movement Disorder Society Unified Parkinson's Disease Rating Scale (MDS-UPDRS) and Modified Bradykinesia Rating Scale (MBRS). Twenty video pairs were conducted in ON and OFF states. Classification accuracy for PD/HC state and ON/OFF state were measured using the Area under Receiver Operating characteristic curve and a confusion matrix. CV and clinical measures were correlated using Spearman coefficients.

RESULTS

CV classified disease state with higher accuracy than clinical raters (91 % sensitivity; 97 % specificity). CV measures of bradykinesia correlated significantly with clinical ratings: R = 0.740 for MDS-UPDRS, 0.715 for MBRS speed, 0.714 for amplitude and 0.504 for rhythm. CV classified ON/OFF state as accurately as clinical raters.

DISCUSSION

CV can provide a valid, objective and contactless bradykinesia assessment based on clinically collected videos, which offers promise as a new clinical outcome, including in remote settings.

A Framework for the Human-Centered Design of Service Processes Enabled by Medical Devices: A Case Study of Wearable Devices for Parkinson's Disease

The successful introduction of medical devices (MDs) in real-world settings hinges on designing service processes that cater to stakeholders' needs. While human-centered design (HCD) approaches have been widely applied to service process innovation, the literature lacks a methodology that leverages MDs' key features to design service processes that meet stakeholders' needs. This study aims to fill this gap by developing a framework for the HCD of service processes enabled by MDs. The proposed framework mixes and adapts methodological elements from HCD and technology-enabled design approaches and proposes four new tools. The five-phase framework was applied to the design of a new Parkinson's disease diagnosis and treatment process (PD-DTP) enabled by two wearable MDs for the detection of motor symptoms. The case study lasted five months and involved 42 stakeholders in 21 meetings (interviews, focus groups, etc.). Thanks to the case study, the framework was tested, and a new PD-DTP that could benefit all stakeholders involved was identified. This study provides a framework that, in addition to contributing to theory, could assist MDs developers and healthcare managers in designing service processes that cater to stakeholders' needs by leveraging MDs' key features.

Machine learning and wearable sensors for automated Parkinson's disease diagnosis aid: a systematic review

BACKGROUND

The diagnosis of Parkinson's disease is currently based on clinical evaluation. Despite clinical hallmarks, unfortunately, the error rate is still significant. Low in-vivo diagnostic accuracy of clinical evaluation mainly relies on the lack of quantitative biomarkers for an objective motor performance assessment. Non-invasive technologies, such as wearable sensors, coupled with machine learning algorithms, assess quantitatively and objectively the motor performances, with possible benefits either for in-clinic and at-home settings. We conducted a systematic review of the literature on machine learning algorithms embedded in smart devices in Parkinson's disease diagnosis.

METHODS

Following Preferred Reporting Items for Systematic Reviews and Meta-Analyses guidelines, we searched PubMed for articles published between December, 2007 and July, 2023, using a search string combining "Parkinson's disease" AND ("healthy" or "control") AND "diagnosis", within the Groups and Outcome domains. Additional search terms included "Algorithm", "Technology" and "Performance".

RESULTS

From 89 identified studies, 47 met the inclusion criteria based on the search string and four additional studies were included based on the Authors' expertise. Gait emerged as the most common parameter analysed by machine learning models, with Support Vector Machines as the prevalent algorithm. The results suggest promising accuracy with complex algorithms like Random Forest, Support Vector Machines, and K-Nearest Neighbours.

DISCUSSION

Despite the promise shown by machine learning algorithms, real-world applications may still face limitations. This review suggests that integrating machine learning with wearable sensors has the potential to improve Parkinson's disease diagnosis. These tools could provide clinicians with objective data, potentially aiding in earlier detection.

Deep Learning for hand tracking in Parkinson's Disease video-based assessment: Current and future perspectives

BACKGROUND

Parkinson's Disease (PD) demands early diagnosis and frequent assessment of symptoms. In particular, analysing hand movements is pivotal to understand disease progression. Advancements in hand tracking using Deep Learning (DL) allow for the automatic and objective disease evaluation from video recordings of standardised motor tasks, which are the foundation of neurological examinations. In view of this scenario, this narrative review aims to describe the state of the art and the future perspective of DL frameworks for hand tracking in video-based PD assessment.

METHODS

A rigorous search of PubMed, Web of Science, IEEE Explorer, and Scopus until October 2023 using primary keywords such as parkinson, hand tracking, and deep learning was performed to select eligible by focusing on video-based PD assessment through DL-driven hand tracking frameworks RESULTS:: After accurate screening, 23 publications met the selection criteria. These studies used various solutions, from well-established pose estimation frameworks, like OpenPose and MediaPipe, to custom deep architectures designed to accurately track hand and finger movements and extract relevant disease features. Estimated hand tracking data were then used to differentiate PD patients from healthy individuals, characterise symptoms such as tremors and bradykinesia, or regress the Movement Disorder Society-Unified Parkinson's Disease Rating Scale (MDS-UPDRS) by automatically assessing clinical tasks such as finger tapping, hand movements, and pronation-supination.

CONCLUSIONS

DL-driven hand tracking holds promise for PD assessment, offering precise, objective measurements for early diagnosis and monitoring, especially in a telemedicine scenario. However, to ensure clinical acceptance, standardisation and validation are crucial. Future research should prioritise large open datasets, rigorous validation on patients, and the investigation of new frontiers such as tracking hand-hand and hand-object interactions for daily-life tasks assessment.

Multi-Shared-Task Self-Supervised CNN-LSTM for Monitoring Free-Body Movement UPDRS-III Using Wearable Sensors

The Unified Parkinson's Disease Rating Scale (UPDRS) is used to recognize patients with Parkinson's disease (PD) and rate its severity. The rating is crucial for disease progression monitoring and treatment adjustment. This study aims to advance the capabilities of PD management by developing an innovative framework that integrates deep learning with wearable sensor technology to enhance the precision of UPDRS assessments. We introduce a series of deep learning models to estimate UPDRS Part III scores, utilizing motion data from wearable sensors. Our approach leverages a novel Multi-shared-task Self-supervised Convolutional Neural Network-Long Short-Term Memory (CNN-LSTM) framework that processes raw gyroscope signals and their spectrogram representations. This technique aims to refine the estimation accuracy of PD severity during naturalistic human activities. Utilizing 526 min of data from 24 PD patients engaged in everyday activities, our methodology demonstrates a strong correlation of 0.89 between estimated and clinically assessed UPDRS-III scores. This model outperforms the benchmark set by single and multichannel CNN, LSTM, and CNN-LSTM models and establishes a new standard in UPDRS-III score estimation for free-body movements compared to recent state-of-the-art methods. These results signify a substantial step forward in bioengineering applications for PD monitoring, providing a robust framework for reliable and continuous assessment of PD symptoms in daily living settings.

ATST-Net: A method to identify early symptoms in the upper and lower extremities of PD

Bradykinesia, a core symptom of motor disorders in Parkinson's disease (PD), is a major criterion for screening early PD patients in clinical practice. Currently, many studies have proposed automatic assessment schemes for bradykinesia in PD. However, existing schemes suffer from problems such as dependence on professional equipment, single evaluation tasks, difficulty in obtaining samples and low accuracy. This paper proposes a manual feature extraction- and neural network-based method to evaluate bradykinesia, effectively solving the problem of a small sample size. This method can automatically assess finger tapping (FT), hand movement (HM), toe tapping (TT) and bilateral foot sensitivity tasks (LA) through a unified model. Data were obtained from 120 individuals, including 93 patients with Parkinson's disease and 27 age- and sex-matched normal controls (NCs). Manual feature extraction and Attention Time Series Two-stream Networks (ATST-Net) were used for classification. Accuracy rates of 0.844, 0.819, 0.728, and 0.768 were achieved for FT, HM, TT, and LA, respectively. To our knowledge, this study is the first to simultaneously evaluate the upper and lower limbs using a unified model that has significant advantages in both model training and transfer learning.

Wearable-Sensor-Based Weakly Supervised Parkinson's Disease Assessment with Data Augmentation

Parkinson's disease (PD) is the second most prevalent dementia in the world. Wearable technology has been useful in the computer-aided diagnosis and long-term monitoring of PD in recent years. The fundamental issue remains how to assess the severity of PD using wearable devices in an efficient and accurate manner. However, in the real-world free-living environment, there are two difficult issues, poor annotation and class imbalance, both of which could potentially impede the automatic assessment of PD. To address these challenges, we propose a novel framework for assessing the severity of PD patient's in a free-living environment. Specifically, we use clustering methods to learn latent categories from the same activities, while latent Dirichlet allocation (LDA) topic models are utilized to capture latent features from multiple activities. Then, to mitigate the impact of data imbalance, we augment bag-level data while retaining key instance prototypes. To comprehensively demonstrate the efficacy of our proposed framework, we collected a dataset containing wearable-sensor signals from 83 individuals in real-life free-living conditions. The experimental results show that our framework achieves an astounding 73.48% accuracy in the fine-grained (normal, mild, moderate, severe) classification of PD severity based on hand movements. Overall, this study contributes to more accurate PD self-diagnosis in the wild, allowing doctors to provide remote drug intervention guidance.

Upper limb intention tremor assessment: opportunities and challenges in wearable technology

BACKGROUND

Tremors are involuntary rhythmic movements commonly present in neurological diseases such as Parkinson's disease, essential tremor, and multiple sclerosis. Intention tremor is a subtype associated with lesions in the cerebellum and its connected pathways, and it is a common symptom in diseases associated with cerebellar pathology. While clinicians traditionally use tests to identify tremor type and severity, recent advancements in wearable technology have provided quantifiable ways to measure movement and tremor using motion capture systems, app-based tasks and tools, and physiology-based measurements. However, quantifying intention tremor remains challenging due to its changing nature.

METHODOLOGY & RESULTS

This review examines the current state of upper limb tremor assessment technology and discusses potential directions to further develop new and existing algorithms and sensors to better quantify tremor, specifically intention tremor. A comprehensive search using PubMed and Scopus was performed using keywords related to technologies for tremor assessment. Afterward, screened results were filtered for relevance and eligibility and further classified into technology type. A total of 243 publications were selected for this review and classified according to their type: body function level: movement-based, activity level: task and tool-based, and physiology-based. Furthermore, each publication's methods, purpose, and technology are summarized in the appendix table.

CONCLUSIONS

Our survey suggests a need for more targeted tasks to evaluate intention tremors, including digitized tasks related to intentional movements, neurological and physiological measurements targeting the cerebellum and its pathways, and signal processing techniques that differentiate voluntary from involuntary movement in motion capture systems.

Cortical thickness and white matter microstructure predict freezing of gait development in Parkinson's disease

The clinical applications of the association of cortical thickness and white matter fiber with freezing of gait (FoG) are limited in patients with Parkinson's disease (PD). In this retrospective study, using white matter fiber from diffusion-weighted imaging and cortical thickness from structural-weighted imaging of magnetic resonance imaging, we investigated whether a machine learning-based model can help assess the risk of FoG at the individual level in patients with PD. Data from the Parkinson's Disease Progression Marker Initiative database were used as the discovery cohort, whereas those from the Fujian Medical University Union Hospital Parkinson's Disease database were used as the external validation cohort. Clinical variables, white matter fiber, and cortical thickness were selected by random forest regression. The selected features were used to train the support vector machine(SVM) learning models. The median area under the receiver operating characteristic curve (AUC) was calculated. Model performance was validated using the external validation cohort. In the discovery cohort, 25 patients with PD were defined as FoG converters (15 men, mean age 62.1 years), whereas 60 were defined as FoG nonconverters (38 men, mean age 58.5 years). In the external validation cohort, 18 patients with PD were defined as FoG converters (8 men, mean age 66.9 years), whereas 37 were defined as FoG nonconverters (21 men, mean age 65.1 years). In the discovery cohort, the model trained with clinical variables, cortical thickness, and white matter fiber exhibited better performance (AUC, 0.67-0.88). More importantly, SVM-radial kernel models trained using random over-sampling examples, incorporating white matter fiber, cortical thickness, and clinical variables exhibited better performance (AUC, 0.88). This model trained using the above mentioned features was successfully validated in an external validation cohort (AUC, 0.91). Furthermore, the following minimal feature sets that were used: fractional anisotropy value and mean diffusivity value for right thalamic radiation, age at baseline, and cortical thickness for left precentral gyrus and right dorsal posterior cingulate gyrus. Therefore, machine learning-based models using white matter fiber and cortical thickness can help predict the risk of FoG conversion at the individual level in patients with PD, with improved performance when combined with clinical variables.

Machine learning to detect, stage and classify diseases and their symptoms based on inertial sensor data: a mapping review

This article presents a systematic review aimed at mapping the literature published in the last decade on the use of machine learning (ML) for clinical decision-making through wearable inertial sensors. The review aims to analyze the trends, perspectives, strengths, and limitations of current literature in integrating ML and inertial measurements for clinical applications. The review process involved defining four research questions and applying four relevance assessment indicators to filter the search results, providing insights into the pathologies studied, technologies and setups used, data processing schemes, ML techniques applied, and their clinical impact. When combined with ML techniques, inertial measurement units (IMUs) have primarily been utilized to detect and classify diseases and their associated motor symptoms. They have also been used to monitor changes in movement patterns associated with the presence, severity, and progression of pathology across a diverse range of clinical conditions. ML models trained with IMU data have shown potential in improving patient care by objectively classifying and predicting motor symptoms, often with a minimally encumbering setup. The findings contribute to understanding the current state of ML integration with wearable inertial sensors in clinical practice and identify future research directions. Despite the widespread adoption of these technologies and techniques in clinical applications, there is still a need to translate them into routine clinical practice. This underscores the importance of fostering a closer collaboration between technological experts and professionals in the medical field.

"Self-care selfies": Patient-uploaded videos capture meaningful changes in dexterity over 6 months

OBJECTIVE

Upper extremity function reflects disease progression in multiple sclerosis (MS). This study evaluated the feasibility, validity, and sensitivity to change of remote dexterity assessments applying human pose estimation to patient-uploaded videos.

METHODS

A discovery cohort of 50 adults with MS recorded "selfie" videos of self-care tasks at home: buttoning, brushing teeth, and eating. Kinematic data were extracted using MediaPipe Hand pose estimation software. Clinical comparison tests were grip and pinch strength, 9 hole peg test (9HPT), and vibration, and patient-reported dexterity assessments (ABILHAND). Feasibility and acceptability were evaluated (Health-ITUES framework). A validation cohort (N = 35) completed 9HPT and videos.

RESULTS

The modality was feasible: 88% of the 50 enrolled participants uploaded ≥3 videos, and 74% completed the study. It was also usable: assessments easy to access (95%), platform easy to use (97%), and tasks representative of daily activities (86%). The buttoning task revealed four metrics with strong correlations with 9HPT (nondominant: r = 0.60-0.69, dominant: r = 0.51-0.57, P < 0.05) and ABILHAND (r = -0.48, P = 0.05). Retest validity at 1 week was stable (r > 0.8). Cross-sectional correlations between video metrics and 9HPT were similar at 6 months, and in the validation cohort (nondominant: r = 0.46, dominant: r = 0.45, P < 0.05). Over 6 months, pinch strength (5.8-5.0 kg/cm2 , P = 0.05) and self-reported pinch (ABILHAND) decreased marginally. While only 15% of participants worsened by 20% on 9HPT, 70% worsened in key buttoning video metrics.

INTERPRETATION

Patient-uploaded videos represent a novel, patient-centered modality for capturing dexterity that appears valid and sensitive to change, enhancing its potential to be disseminated for neurological disease monitoring and treatment.

A Three-Dimensional Finger-Tapping Framework for Recognition of Patients With Mild Parkinson's Disease

The finger tapping test is a widely-used and important examination in the Movement Disorder Society Clinical Diagnosis for Parkinson's Disease. However, finger tapping motion could be affected by age, medication, and other conditions. As a result, Parkinson's disease patients with mild sign and healthy people could be rated as similar scores on the Movement Disorder Society-sponsored revision of the Unified Parkinson's Disease Rating Scale, making it difficult for community doctors to perform diagnosis. We therefore propose a three-dimensional finger tapping framework to recognize mild PD patients. Specifically, we first derive the three-dimensional finger-tapping motion using a self-designed three-dimensional finger-tapping measurement system. We then propose a three-dimensional finger-tapping segmentation algorithm to segment three-dimensional finger tapping motion. We next extract three-dimensional pattern features of motor coordination, imbalance impairment, and entropy. We finally adopted the support vector machine as the classifier to recognize PD patients. We evaluated the proposed framework on 49 PD patients and 29 healthy controls and reached an accuracy of 94.9% for the right hand and 89.4% for the left hand. Moreover, the proposed framework reached an accuracy of 95.0% for the right hand and 97.8% for the left hand on 17 mild PD patients and 28 healthy controls who were both rated as 0 or 1 on the Movement Disorder Society-sponsored revision of the Unified Parkinson's Disease Rating Scale. The results demonstrated that the proposed framework was less sensitive to traditional features and performed well in recognizing mild PD patients by involving three-dimensional patter features.

A Deep Learning Approach for Grading of Motor Impairment Severity in Parkinson's Disease

Objective and quantitative monitoring of movement impairments is crucial for detecting progression in neurological conditions such as Parkinson's disease (PD). This study examined the ability of deep learning approaches to grade motor impairment severity in a modified version of the Movement Disorders Society-sponsored revision of the Unified Parkinson's Disease Rating Scale (MDS-UPDRS) using low-cost wearable sensors. A convolutional neural network architecture, XceptionTime, was used to classify lower and higher levels of motor impairment in persons with PD, across five distinct rhythmic tasks: finger tapping, hand movements, pronation-supination movements of the hands, toe tapping, and leg agility. In addition, an aggregate model was trained on data from all tasks together for evaluating bradykinesia symptom severity in PD. The model performance was highest in the hand movement tasks with an accuracy of 82.6% in the hold-out test dataset; the accuracy for the aggregate model was 79.7%, however, it demonstrated the lowest variability. Overall, these findings suggest the feasibility of integrating low-cost wearable technology and deep learning approaches to automatically and objectively quantify motor impairment in persons with PD. This approach may provide a viable solution for a widely deployable telemedicine solution.

Vision-based estimation of MDS-UPDRS scores for quantifying Parkinson's disease tremor severity

Parkinson's disease (PD) is a common neurodegenerative movement disorder among older individuals. As one of the typical symptoms of PD, tremor is a critical reference in the PD assessment. A widely accepted clinical approach to assessing tremors in PD is based on part III of the Movement Disorder Society-Unified Parkinson's Disease Rating Scale (MDS-UPDRS). However, expert assessment of tremor is a time-consuming and laborious process that poses considerable challenges to the medical evaluation of PD. In this paper, we proposed a novel model, Global Temporal-difference Shift Network (GTSN), to estimate the MDS-UPDRS score of PD tremors based on video. The PD tremor videos were scored according to the majority vote of multiple raters. We used Eulerian Video Magnification (EVM) pre-processing to enhance the representations of subtle PD tremors in the videos. To make the model better focus on the tremors in the video, we proposed a special temporal difference module, which stacks the current optical flow to the result of inter-frame difference. The prediction scores were obtained from the Residual Networks (ResNet) embedded with a novel module, the Global Shift Module (GSM), which allowed the features of the current segment to include the global segment features. We carried out independent experiments using PD tremor videos of different body parts based on the scoring content of the MDS-UPDRS. On a fairly large dataset, our method achieved an accuracy of 90.6% for hands with rest tremors, 85.9% for tremors in the leg, and 89.0% for the jaw. An accuracy of 84.9% was obtained for postural tremors. Our study demonstrated the effectiveness of computer-assisted assessment for PD tremors based on video analysis. The latest version of the code is available at https://github.com/199507284711/PD-GTSN.

Improved Parkinsonian tremor quantification based on automatic label modification and SVM with RBF kernel

Objective. The quantitative assessment of Parkinsonian tremor, e.g. (0, 1, 2, 3, 4) according to the Movement Disorder Society-Unified Parkinson's Disease Rating Scale, is crucial for treating Parkinson's disease. However, the tremor amplitude constantly fluctuates due to environmental and psychological effects on the patient. In clinical practice, clinicians assess the tremor severity for a short duration, whereas manual tremor labeling relies on the clinician's physician experience. Therefore, automatic tremor quantification based on wearable inertial sensors and machine learning algorithms is affected by the manual labels of clinicians. In this study, an automatic modification method for the labels judged by clinicians is presented to improve Parkinsonian tremor quantitation.Approach. For the severe overlapping of dynamic feature range between different severities, an outlier modification algorithm (PCA-IQR) based on the combination of principal component analysis and interquartile range statistic rule is proposed to learn the blurred borders between different severity scores, thereby optimizing the labels. Afterward, according to the modified feature vectors, a support vector machine (SVM) with a radial basis function (RBF) kernel is proposed to classify the tremor severity. The classifier models of SVM with RBF kernel,k-nearest neighbors, and SVM with the linear kernel are compared.Main results. Experimental results show that the proposed method has high classification performance and excellent model generalization ability for tremor quantitation (accuracy: 97.93%, precision: 97.96%, sensitivity: 97.93%, F1-score: 97.94%).Significance. The proposed method may not only provide valuable assistance for clinicians to assess the tremor severity accurately, but also provides self-monitoring for patients at home and improve the assessment skills of clinicians.

Classification of Kinematic and Electromyographic Signals Associated with Pathological Tremor Using Machine and Deep Learning

Peripheral Electrical Stimulation (PES) of afferent pathways has received increased interest as a solution to reduce pathological tremors with minimal side effects. Closed-loop PES systems might present some advantages in reducing tremors, but further developments are required in order to reliably detect pathological tremors to accurately enable the stimulation only if a tremor is present. This study explores different machine learning (K-Nearest Neighbors, Random Forest and Support Vector Machines) and deep learning (Long Short-Term Memory neural networks) models in order to provide a binary (Tremor; No Tremor) classification of kinematic (angle displacement) and electromyography (EMG) signals recorded from patients diagnosed with essential tremors and healthy subjects. Three types of signal sequences without any feature extraction were used as inputs for the classifiers: kinematics (wrist flexion-extension angle), raw EMG and EMG envelopes from wrist flexor and extensor muscles. All the models showed high classification scores (Tremor vs. No Tremor) for the different input data modalities, ranging from 0.8 to 0.99 for the f1 score. The LSTM models achieved 0.98 f1 scores for the classification of raw EMG signals, showing high potential to detect tremors without any processed features or preliminary information. These models may be explored in real-time closed-loop PES strategies to detect tremors and enable stimulation with minimal signal processing steps.

Real-time detection of freezing of gait in Parkinson's disease using multi-head convolutional neural networks and a single inertial sensor

BACKGROUND

Freezing of gait (FOG) is one of the most disabling symptoms of Parkinson's disease (PD), contributing to poor quality of life and increased risk of falls. Wearable sensors represent a valuable means for detecting FOG in the home environment. Moreover, real-time feedback has proven to help reduce the duration of FOG episodes. This work proposes a robust real-time FOG detection algorithm, which is easy to implement in stand-alone devices working in non-supervised conditions.

METHOD

Data from three different data sets were used in this study, with two employed as independent test sets. Acceleration recordings from 118 PD patients and 21 healthy elderly subjects were collected while they performed simulated daily living activities. A single inertial sensor was attached to the waist of each subject. More than 17 h of valid data and a total number of 1110 FOG episodes were analyzed in this study. The implemented algorithm consisted of a multi-head convolutional neural network, which exploited different spatial resolutions in the analysis of inertial data. The architecture and the model parameters were designed to provide optimal performance while reducing computational complexity and testing time.

RESULTS

The developed algorithm demonstrated good to excellent classification performance, with more than 50% (30%) of FOG episodes predicted on average 3.1 s (1.3 s) before the actual onset in the main (independent) data set. Around 50% of FOG was detected with an average delay of 0.8 s (1.1 s) in the main (independent) data set. Moreover, a specificity above 88% (93%) was obtained when testing the algorithm on the main (independent) test set, while 100% specificity was obtained on healthy elderly subjects.

CONCLUSION

The algorithm proved robust, with low computational complexity and processing time, thus paving the way to a real-time implementation in a stand-alone device that can be used in non-supervised environments.

Diagnosis and Treatment of Tremor in Parkinson's Disease Using Mechanical Devices

BACKGROUND

Parkinsonian tremors are sometimes confused with essential tremors or other conditions. Recently, researchers conducted several studies on tremor evaluation using wearable sensors and devices, which may support accurate diagnosis. Mechanical devices are also commonly used to treat tremors and have been actively researched and developed. Here, we aimed to review recent progress and the efficacy of the devices related to Parkinsonian tremors.

METHODS

The PubMed and Scopus databases were searched for articles. We searched for "Parkinson disease" and "tremor" and "device".

RESULTS

Eighty-six articles were selected by our systematic approach. Many studies demonstrated that the diagnosis and evaluation of tremors in patients with PD can be done accurately by machine learning algorithms. Mechanical devices for tremor suppression include deep brain stimulation (DBS), electrical muscle stimulation, and orthosis. In recent years, adaptive DBS and optimization of stimulation parameters have been studied to further improve treatment efficacy.

CONCLUSIONS

Due to developments using state-of-the-art techniques, effectiveness in diagnosing and evaluating tremor and suppressing it using these devices is satisfactorily high in many studies. However, other than DBS, no devices are in practical use. To acquire high-level evidence, large-scale studies and randomized controlled trials are needed for these devices.

A non-contact system for intraoperative quantitative assessment of bradykinesia in deep brain stimulation surgery

BACKGROUND AND OBJECTIVE

Deep brain stimulation (DBS) is an effective treatment for a number of neurological diseases, especially for the advanced stage of Parkinson's disease (PD). Objective assessment of patients' motor symptoms is crucial for accurate electrode targeting and treatment. Existing approaches suffer from subjective variability or interference with voluntary motion. This work is aimed to establish an objective assessment system to quantify bradykinesia in DBS surgery.

METHODS

Based on the analysis of the requirements for intraoperative assessment, we developed a system with non-contact measurement, online movement feature extraction, and interactive data analysis and visualization. An optical sensor, Leap Motion Controller (LMC), was taken to detect hand movement in three clinical tasks. A graphic user interface was designed to process, compare and visualize the collected data and assessment results online. Quantified movement features include amplitude, frequency, velocity, their decrement and variability, etc. Technical validation of the system was performed with a motion capture system (Mocap), with respect to data-level and feature-level accuracy and reliability. Clinical validation was conducted with 20 PD patients for intraoperative assessments in DBS surgery. Treatment responses with respect to the bradykinesia movement features were analyzed. Single case analysis and group statistical analysis were performed to examine the differences between preoperative and intraoperative performance, and the correlation between the clinical ratings and the quantified assessment was analyzed.

RESULTS

For the movements measured by LMC and Mocap, the average Pearson's correlation coefficient was 0.986, and the mean amplitude difference was 2.11 mm. No significant difference was found for all movement features quantified by LMC and Mocap. For the clinical tests, key movement features showed significant differences between the preoperative baseline and intraoperative performance when the brain stimulation was ON. The assessment results were significantly correlated with the MDS-UPDRS clinical ratings.

CONCLUSIONS

The proposed non-contact system has established itself as an objective intraoperative assessment, analysis, and visualization tool for DBS treatment of Parkinson's disease.

IMU-Based Monitoring for Assistive Diagnosis and Management of IoHT: A Review

With the rapid development of Internet of Things (IoT) technologies, traditional disease diagnoses carried out in medical institutions can now be performed remotely at home or even ambient environments, yielding the concept of the Internet of Health Things (IoHT). Among the diverse IoHT applications, inertial measurement unit (IMU)-based systems play a significant role in the detection of diseases in many fields, such as neurological, musculoskeletal, and mental. However, traditional numerical interpretation methods have proven to be challenging to provide satisfying detection accuracies owing to the low quality of raw data, especially under strong electromagnetic interference (EMI). To address this issue, in recent years, machine learning (ML)-based techniques have been proposed to smartly map IMU-captured data on disease detection and progress. After a decade of development, the combination of IMUs and ML algorithms for assistive disease diagnosis has become a hot topic, with an increasing number of studies reported yearly. A systematic search was conducted in four databases covering the aforementioned topic for articles published in the past six years. Eighty-one articles were included and discussed concerning two aspects: different ML techniques and application scenarios. This review yielded the conclusion that, with the help of ML technology, IMUs can serve as a crucial element in disease diagnosis, severity assessment, characteristic estimation, and monitoring during the rehabilitation process. Furthermore, it summarizes the state-of-the-art, analyzes challenges, and provides foreseeable future trends for developing IMU-ML systems for IoHT.

Remote Assessments of Hand Function in Neurological Disorders: Systematic Review

BACKGROUND

Loss of fine motor skills is observed in many neurological diseases, and remote monitoring assessments can aid in early diagnosis and intervention. Hand function can be regularly assessed to monitor loss of fine motor skills in people with central nervous system disorders; however, there are challenges to in-clinic assessments. Remotely assessing hand function could facilitate monitoring and supporting of early diagnosis and intervention when warranted.

OBJECTIVE

Remote assessments can facilitate the tracking of limitations, aiding in early diagnosis and intervention. This study aims to systematically review existing evidence regarding the remote assessment of hand function in populations with chronic neurological dysfunction.

METHODS

PubMed and MEDLINE, CINAHL, Web of Science, and Embase were searched for studies that reported remote assessment of hand function (ie, outside of traditional in-person clinical settings) in adults with chronic central nervous system disorders. We excluded studies that included participants with orthopedic upper limb dysfunction or used tools for intervention and treatment. We extracted data on the evaluated hand function domains, validity and reliability, feasibility, and stage of development.

RESULTS

In total, 74 studies met the inclusion criteria for Parkinson disease (n=57, 77% studies), stroke (n=9, 12%), multiple sclerosis (n=6, 8%), spinal cord injury (n=1, 1%), and amyotrophic lateral sclerosis (n=1, 1%). Three assessment modalities were identified: external device (eg, wrist-worn accelerometer), smartphone or tablet, and telerehabilitation. The feasibility and overall participant acceptability were high. The most common hand function domains assessed included finger tapping speed (fine motor control and rigidity), hand tremor (pharmacological and rehabilitation efficacy), and finger dexterity (manipulation of small objects required for daily tasks) and handwriting (coordination). Although validity and reliability data were heterogeneous across studies, statistically significant correlations with traditional in-clinic metrics were most commonly reported for telerehabilitation and smartphone or tablet apps. The most readily implementable assessments were smartphone or tablet-based.

CONCLUSIONS

The findings show that remote assessment of hand function is feasible in neurological disorders. Although varied, the assessments allow clinicians to objectively record performance in multiple hand function domains, improving the reliability of traditional in-clinic assessments. Remote assessments, particularly via telerehabilitation and smartphone- or tablet-based apps that align with in-clinic metrics, facilitate clinic to home transitions, have few barriers to implementation, and prompt remote identification and treatment of hand function impairments.

Internet of Things Technologies and Machine Learning Methods for Parkinson's Disease Diagnosis, Monitoring and Management: A Systematic Review

Parkinson's disease is a chronic neurodegenerative disease that affects a large portion of the population, especially the elderly. It manifests with motor, cognitive and other types of symptoms, decreasing significantly the patients' quality of life. The recent advances in the Internet of Things and Artificial Intelligence fields, including the subdomains of machine learning and deep learning, can support Parkinson's disease patients, their caregivers and clinicians at every stage of the disease, maximizing the treatment effectiveness and minimizing the respective healthcare costs at the same time. In this review, the considered studies propose machine learning models, trained on data acquired via smart devices, wearable or non-wearable sensors and other Internet of Things technologies, to provide predictions or estimations regarding Parkinson's disease aspects. Seven hundred and seventy studies have been retrieved from three dominant academic literature databases. Finally, one hundred and twelve of them have been selected in a systematic way and have been considered in the state-of-the-art systematic review presented in this paper. These studies propose various methods, applied on various sensory data to address different Parkinson's disease-related problems. The most widely deployed sensors, the most commonly addressed problems and the best performing algorithms are highlighted. Finally, some challenges are summarized along with some future considerations and opportunities that arise.

An Evaluation of KELVIN, an Artificial Intelligence Platform, as an Objective Assessment of the MDS UPDRS Part III

BACKGROUND

Parkinson's disease severity is typically measured using the Movement Disorder Society Unified Parkinson's disease rating scale (MDS-UPDRS). While training for this scale exists, users may vary in how they score a patient with the consequence of intra-rater and inter-rater variability.

OBJECTIVE

In this study we explored the consistency of an artificial intelligence platform compared with traditional clinical scoring in the assessment of motor severity in PD.

METHODS

Twenty-two PD patients underwent simultaneous MDS-UPDRS scoring by two experienced MDS-UPDRS raters and the two sets of accompanying video footage were also scored by an artificial intelligence video analysis platform known as KELVIN.

RESULTS

KELVIN was able to produce a summary score for 7 MDS-UPDRS part 3 items with good inter-rater reliability (Intraclass Correlation Coefficient (ICC) 0.80 in the OFF-medication state, ICC 0.73 in the ON-medication state). Clinician scores had exceptionally high levels of inter-rater reliability in both the OFF (0.99) and ON (0.94) medication conditions (possibly reflecting the highly experienced team). There was an ICC of 0.84 in the OFF-medication state and 0.31 in the ON-medication state between the mean Clinician and mean Kelvin scores for the equivalent 7 motor items, possibly due to dyskinesia impacting on the KELVIN scores.

CONCLUSION

We conclude that KELVIN may prove useful in the capture and scoring of multiple items of MDS-UPDRS part 3 with levels of consistency not far short of that achieved by experienced MDS-UPDRS clinical raters, and is worthy of further investigation.

Fitts Law-Based Performance Metrics to Quantify Tremor in Individuals with Essential Tremor

Current methods of evaluating essential tremor (ET) either rely on subjective ratings or use limited tremor metrics (i.e., severity/amplitude and frequency). In this study, we explored performance metrics from Fitts law tasks that replicate and expand existing tremor metrics, to enable low-cost, home-based tremor quantification and analyze the cursor movements of individuals using a 3D mouse while performing a collection of drawing tasks. We analyzed the 3D mouse cursor movements of 11 patients with ET and three controls, on three computer-based tasksa spiral navigation (SPN) task, a rectangular track navigation (RTN) task, and multi-directional tapping/clicking (MDT)with several performance metrics (i.e., outside area (OA), throughput (TP in Fitts law), path efficiency (PE), and completion time (CT)). Using an accelerometer and scores from the Essential Tremor Rating Assessment Scale (TETRAS), we correlated the proposed performance metrics with the baseline tremor metrics and found that the OA of the SPN and RTN tasks were strongly correlated with baseline tremor severity (R²=0.57 and R²=0.83). We also found that the TP in the MDT tasks were strongly correlated with tremor frequency (R²=0.70). In addition, as the OA of the SPN and RTN tasks was correlated with tremor severity and frequency, it may represent an independent metric that increases the dimensionality of the characterization of an individuals tremor. Thus, this pilot study of the analysis of those with ET-associated tremor performing Fitts law tasks demonstrates the feasibility of introducing a new tremor metric that can be expanded for repeatable multi-dimensional data analyses.

Wearable Devices for Assessment of Tremor

Tremor is an impairing symptom associated with several neurological diseases. Some of such diseases are neurodegenerative, and tremor characterization may be of help in differential diagnosis. To date, electromyography (EMG) is the gold standard for the analysis and diagnosis of tremors. In the last decade, however, several studies have been conducted for the validation of different techniques and new, non-invasive, portable, or even wearable devices have been recently proposed as complementary tools to EMG for a better characterization of tremors. Such devices have proven to be useful for monitoring the efficacy of therapies or even aiding in differential diagnosis. The aim of this review is to present systematically such new solutions, trying to highlight their potentialities and limitations, with a hint to future developments.

A Study on the Essential and Parkinson’s Arm Tremor Classification

In this article, the challenge of discriminating between essential and Parkinson’s tremor is addressed. Although a variety of methods have been proposed for diagnosing the severity of these highly occurring tremor types, their rapid and effective identification, especially in their early stages, proves particularly difficult and complicated due to their wide range of causes and similarity of symptoms. To this goal, a clinical analysis was performed, where a number of volunteers including essential and Parkinson’s tremor-diagnosed patients underwent a series of pre-defined motion patterns, during which a wearable sensing setup was used to measure their lower arm tremor characteristics from multiple selected points. Extracted features from the acquired accelerometer signals were used to train classification algorithms, including decision trees, discriminant analysis, support vector machine (SVM), K-nearest neighbor (KNN) and ensemble learning algorithms, for providing a comparative study and evaluating the potential of utilizing machine learning to accurately discriminate among different tremor types. Overall, SVM related classifiers proved to be the most successful in terms of classifying between Parkinson’s, essential and no tremor diagnosed with percentages reaching up to 100% for a single accelerometer measurement at the metacarpal area. In general and in motion while holding an object position, Coarse Gaussian SVM classifier reached 82.62% accuracy.