1
|
Jenei AZ, Sztahó D, Valálik I. Recognition analysis of spiral and straight-line drawings in tremor assessment. BIOMED ENG-BIOMED TE 2025; 70:147-156. [PMID: 39602901 DOI: 10.1515/bmt-2023-0080] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/23/2023] [Accepted: 11/13/2024] [Indexed: 11/29/2024]
Abstract
OBJECTIVES No standard, objective diagnostic procedure exists for most neurological diseases causing tremors. Therefore, drawing tests have been widely analyzed to support diagnostic procedures. In this study, we examine the comparison of Archimedean spiral and line drawings, the possibilities of their joint application, and the relevance of displaying pressure on the drawings to recognize Parkinsonism and cerebellar dysfunction. We further attempted to use an automatic processing and evaluation system. METHODS Digital images were developed from raw data by adding or omitting pressure data. Pre-trained (MobileNet, Xception, ResNet50) models and a Baseline (from scratch) model were applied for binary classification with a fold cross-validation procedure. Predictions were analyzed separately by drawing tasks and in combination. RESULTS The neurological diseases presented here can be recognized with a significantly higher macro f1 score from the spiral drawing task (up to 95.7 %) than lines (up to 84.3 %). A significant improvement can be achieved if the spiral is supplemented with line drawing. The pressure inclusion in the images did not result in significant information gain. CONCLUSIONS The spiral drawing has a robust recognition power and can be supplemented with a line drawing task to increase the correct recognition. Moreover, X and Y coordinates appeared sufficient without pressure with this methodology.
Collapse
Affiliation(s)
- Attila Z Jenei
- Department of Telecommunications and Artificial Intelligence, 61810 Budapest University of Technology and Economics , Budapest, Hungary
| | - Dávid Sztahó
- Department of Telecommunications and Artificial Intelligence, 61810 Budapest University of Technology and Economics , Budapest, Hungary
| | - István Valálik
- Department of Neurosurgery, St. John's Hospital, Budapest, Hungary
| |
Collapse
|
2
|
Anandapadmanabhan R, Vishnoi A, Raman G, Thachan J, Gangaraju BA, Radhakrishnan D, Vishnu VY, Kamble N, Holla V, James P, Srivastava A, Joshi D, Mahabal A, Krishnan S, Pal P, Rajan R. Deep Learning-Based Artificial Intelligence Algorithm to Classify Tremors from Hand-Drawn Spirals. Mov Disord 2025. [PMID: 40095435 DOI: 10.1002/mds.30176] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/09/2024] [Revised: 02/23/2025] [Accepted: 03/03/2025] [Indexed: 03/19/2025] Open
Abstract
BACKGROUND No objective biomarkers exist for diagnosing and classifying tremor syndromes. OBJECTIVE The aim was to develop and validate a deep learning (DL) algorithm for classifying tremors from hand-drawn pen-on-paper spirals. METHODS We recruited participants with dystonic tremor (DT), essential tremor (ET), essential tremor plus (ETP), Parkinson's disease (PD), cerebellar ataxia (AT), and healthy volunteers (HV). Participants drew free-hand spirals on paper, which were used to train a DL algorithm based on transfer learning using InceptionResNetV2 and Keras sequential model. We validated the model externally in two independent tremor cohorts, evaluating accuracy and F1 scores, and compared its performance to expert raters. RESULTS We recruited 521 participants and obtained 2078 spirals (365 DT, 215 ET, 208 ETP, 212 PD, 78 AT, and 525 HV). Mean age of the participants was 46.1 ± 12.4 years, duration of illness was 8.9 ± 8.3 years, and the mean Fahn-Tolosa-Marin Tremor Rating Scale score in patients was 32.4 ± 14.7. The DL classifier demonstrated an overall accuracy of 81% [95% confidence interval, CI: 0.77-0.85] in distinguishing among tremor syndromes. To mitigate the potential risks of data leakage and digital fingerprinting, the algorithm was redeveloped and reanalyzed, yielding an adjusted accuracy of 70% [95% CI: 0.66-0.74]. External validation on an independent cohort of 1535 spiral drawings resulted in an accuracy of 61% [95% CI: 0.59-0.63], with the adjusted algorithm achieving 59% [95% CI: 0.58-0.60], outperforming human raters (accuracy: 46%). CONCLUSION Supervised DL algorithms can effectively detect tremor syndromes from hand-drawn spirals, offering unbiased, feature-independent classification with higher accuracy than human raters. © 2025 International Parkinson and Movement Disorder Society.
Collapse
Affiliation(s)
| | - Aayushi Vishnoi
- Department of Neurology, All India Institute of Medical Sciences (AIIMS), New Delhi, India
| | - Geetha Raman
- Comprehensive Care Centre for Movement Disorders, Sree Chitra Tirunal Institute for Medical Sciences and Technology, Thiruvananthapuram, India
| | - Jeena Thachan
- Comprehensive Care Centre for Movement Disorders, Sree Chitra Tirunal Institute for Medical Sciences and Technology, Thiruvananthapuram, India
| | | | - Divya Radhakrishnan
- Department of Neurology, All India Institute of Medical Sciences (AIIMS), New Delhi, India
| | | | - Nitish Kamble
- Department of Neurology, National Institute of Mental Health and Neuro Sciences, Bengaluru, India
| | - Vikram Holla
- Department of Neurology, National Institute of Mental Health and Neuro Sciences, Bengaluru, India
| | - Praveen James
- Comprehensive Care Centre for Movement Disorders, Sree Chitra Tirunal Institute for Medical Sciences and Technology, Thiruvananthapuram, India
| | - Achal Srivastava
- Department of Neurology, All India Institute of Medical Sciences (AIIMS), New Delhi, India
| | - Deepak Joshi
- Centre for Biomedical Engineering, Indian Institute of Technology, New Delhi, India
| | - Ashish Mahabal
- Center for Data Driven Discovery, California Institute of Technology, Pasadena, California, USA
| | - Syam Krishnan
- Comprehensive Care Centre for Movement Disorders, Sree Chitra Tirunal Institute for Medical Sciences and Technology, Thiruvananthapuram, India
| | - Pramod Pal
- Department of Neurology, National Institute of Mental Health and Neuro Sciences, Bengaluru, India
| | - Roopa Rajan
- Department of Neurology, All India Institute of Medical Sciences (AIIMS), New Delhi, India
| |
Collapse
|
3
|
Gallo-Aristizabal JD, Escobar-Grisales D, Ríos-Urrego CD, Vargas-Bonilla JF, García AM, Orozco-Arroyave JR. Towards Parkinson's Disease Detection Through Analysis of Everyday Handwriting. Diagnostics (Basel) 2025; 15:381. [PMID: 39941311 PMCID: PMC11817311 DOI: 10.3390/diagnostics15030381] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/06/2025] [Revised: 01/29/2025] [Accepted: 01/30/2025] [Indexed: 02/16/2025] Open
Abstract
Background: Parkinson's disease (PD) is the second most prevalent neurodegenerative disorder worldwide. People suffering from PD exhibit motor symptoms that affect the control of upper and lower limb movement. Among daily activities that depend on proper upper limb control is the handwriting process, which has been studied in state-of-the-art research, mainly considering non-semantic drawings like spirals, geometric figures, cursive lines, and others. Objectives: This paper analyzes the suitability of modeling the handwriting process of digits from 0 to 9 to automatically discriminate between PD patients and healthy control subjects. The main hypothesis is that modeling these numbers allows a more natural evaluation of upper limb control. Methods: Two approaches are considered: modeling of the images resulting from the strokes collected by the digital tablet and modeling of the time series yielded by the digital tablet while performing the strokes, i.e., time-dependent signals. The first approach is implemented by fine-tuning a CNN-based architecture, while the second approach is based on hand-crafted features measured upon the time series, namely pressure and kinematic measurements. Features extracted from time-dependent signals are represented following two strategies, one based on statistical functionals and the other one based on creating Gaussian Mixture Models (GMMs). Results: The experiments indicate that pressure-based features modeled with functionals are the ones that yield the highest accuracy, indicating that PD-related symptoms are better modeled with dynamic approaches than those based on images. Conclusions: The dynamic approach outperformed the image-based model, indicating that the writing process, modeled with signals collected over time, reveals motor symptoms more clearly than images resulting from handwriting. This finding is in line with previous results in the state-of-the-art research and constitutes a step forward to create more accurate and informative methods to detect and monitor PD symptoms.
Collapse
Affiliation(s)
- Jeferson David Gallo-Aristizabal
- GITA Lab., Faculty of Engineering, University of Antioquia, Medellín 510010, Colombia; (J.D.G.-A.); (D.E.-G.); (C.D.R.-U.); (J.F.V.-B.)
| | - Daniel Escobar-Grisales
- GITA Lab., Faculty of Engineering, University of Antioquia, Medellín 510010, Colombia; (J.D.G.-A.); (D.E.-G.); (C.D.R.-U.); (J.F.V.-B.)
| | - Cristian David Ríos-Urrego
- GITA Lab., Faculty of Engineering, University of Antioquia, Medellín 510010, Colombia; (J.D.G.-A.); (D.E.-G.); (C.D.R.-U.); (J.F.V.-B.)
| | - Jesús Francisco Vargas-Bonilla
- GITA Lab., Faculty of Engineering, University of Antioquia, Medellín 510010, Colombia; (J.D.G.-A.); (D.E.-G.); (C.D.R.-U.); (J.F.V.-B.)
| | - Adolfo M. García
- Cognitive Neuroscience Center, Universidad de San Andrés, Buenos Aires B1644BID, Argentina;
- Global Brain Health Institute (GBHI), University of California San Francisco, San Francisco, CA 94143, USA
- Trinity College Dublin, D02 R590 Dublin, Ireland
- Departamento de Lingüística y Literatura, Facultad de Humanidades, Universidad de Santiago de Chile, Santiago 9170020, Chile
| | - Juan Rafael Orozco-Arroyave
- GITA Lab., Faculty of Engineering, University of Antioquia, Medellín 510010, Colombia; (J.D.G.-A.); (D.E.-G.); (C.D.R.-U.); (J.F.V.-B.)
- LME Lab., University of Erlangen, 91054 Erlangen, Germany
| |
Collapse
|
4
|
Lu H, Qi G, Wu D, Lin C, Ma S, Shi Y, Xue H. A novel feature extraction method based on dynamic handwriting for Parkinson's disease detection. PLoS One 2025; 20:e0318021. [PMID: 39854412 PMCID: PMC11760584 DOI: 10.1371/journal.pone.0318021] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/13/2024] [Accepted: 01/08/2025] [Indexed: 01/26/2025] Open
Abstract
Parkinson's disease (PD) is a common disease of the elderly. Given the easy accessibility of handwriting samples, many researchers have proposed handwriting-based detection methods for Parkinson's disease. Extracting more discriminative features from handwriting is an important step. Although many features have been proposed in previous researches, the insight analysis of the combination of handwriting's kinematic, pressure, and angle dynamic features is lacking. Moreover, most existing feature is incompletely represented, with feature information lost. Therefore, to solve the above problems, a new feature extraction approach for PD detection is proposed using handwriting. First, built on the kinematic, pressure, and angle dynamic features, we propose a moment feature by composed these three types of features, an overall representation of these three types of features information. Then, we proposed a feature extraction method to extract time-frequency-based statistical (TF-ST) features from dynamic handwriting features in terms of their temporal and frequency characteristics. Finally, we proposed an escape Coati Optimization Algorithm (eCOA) for global optimization to enhance classification performance. Self-constructed and public datasets are used to verify the proposed method's effectiveness respectively. The experimental results showed an accuracy of 97.95% and 98.67%, a sensitivity of 98.15% (average) and 97.78%, a specificity of 99.17% (average) and 100%, and an AUC of 98.66% (average) and 98.89%. The code is available at https://github.com/dreamhcy/MLforPD.
Collapse
Affiliation(s)
- Huimin Lu
- School of Computer Science and Engineering, Changchun University of Technology, Changchun, Jilin, China
- Jilin Provincial Smart Health Joint Innovation Laboratory for the New Generation of AI, Changchun Univerity of Technology, Changchun, Jilin, China
| | - Guolian Qi
- School of Computer Science and Engineering, Changchun University of Technology, Changchun, Jilin, China
- Jilin Provincial Smart Health Joint Innovation Laboratory for the New Generation of AI, Changchun Univerity of Technology, Changchun, Jilin, China
| | - Dalong Wu
- Affiliated Hospital to Changchun University of Chinese Medicine, Changchun, Jilin, China
| | - Chenglin Lin
- School of Computer Science and Engineering, Changchun University of Technology, Changchun, Jilin, China
- Jilin Provincial Smart Health Joint Innovation Laboratory for the New Generation of AI, Changchun Univerity of Technology, Changchun, Jilin, China
| | - Songzhe Ma
- School of Computer Science and Engineering, Changchun University of Technology, Changchun, Jilin, China
- Jilin Provincial Smart Health Joint Innovation Laboratory for the New Generation of AI, Changchun Univerity of Technology, Changchun, Jilin, China
| | - Yingqi Shi
- Changchun University of Chinese Medicine, Changchun, Jilin, China
| | - Han Xue
- School of Computer Science and Engineering, Changchun University of Technology, Changchun, Jilin, China
- Jilin Provincial Smart Health Joint Innovation Laboratory for the New Generation of AI, Changchun Univerity of Technology, Changchun, Jilin, China
| |
Collapse
|
5
|
Lomurno E, Toffoli S, Febbo DD, Matteucci M, Lunardini F, Ferrante S. Age Group Discrimination via Free Handwriting Indicators. IEEE J Biomed Health Inform 2025; 29:56-67. [PMID: 39146174 DOI: 10.1109/jbhi.2024.3444497] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 08/17/2024]
Abstract
Ageing is associated with cognitive and functional decline, which can hamper daily activities and independent living. Chronic diseases may intensify this process. Early detection of unhealthy decline is key but hindered by similarity to normal ageing. This study presents an approach for early screening of healthy ageing, using an instrumented ink pen to ecologically assess handwriting performance in three age groups: 40-59, 60-69 and 70+ years old. Raw handwriting data from 60 healthy subjects were used to extract fourteen indicators related to gesture and tremor. The indicators were then used to discriminate between subjects of different age groups in three binary classification tasks, using machine learning algorithms. This approach produced remarkable results, particularly in identifying subjects at the very beginning of the ageing process (Group 2) from elderly subjects (Group 3), achieving an accuracy of 97.5%, an F1 score of 97.44% and a ROC-AUC of 95%. Analysis of the Shapley values revealed age-dependent sensitivity of handwriting and tremor-related indicators. The proposed method represents a promising solution for early detection of abnormal signs of ageing, designed for remote, non-invasive, unsupervised home monitoring to improve the care of older adults.
Collapse
|
6
|
Demir B, Ayna Altuntaş S, Kurt İ, Ulukaya S, Erdem O, Güler S, Uzun C. Cognitive activity analysis of Parkinson's patients using artificial intelligence techniques. Neurol Sci 2025; 46:147-155. [PMID: 39256279 DOI: 10.1007/s10072-024-07734-y] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/01/2023] [Accepted: 08/19/2024] [Indexed: 09/12/2024]
Abstract
PURPOSE The development of modern Artificial Intelligence (AI) based models for the early diagnosis of Parkinson's disease (PD) has been gaining deep attention by researchers recently. In particular, the use of different types of datasets (voice, hand movements, gait, etc.) increases the variety of up-to-date models. Movement disorders and tremors are also among the most prominent symptoms of PD. The usage of drawings in the detection of PD can be a crucial decision-support approach that doctors can benefit from. METHODS A dataset was created by asking 40 PD and 40 Healthy Controls (HC) to draw spirals with and without templates using a special tablet. The patient-healthy distinction was achieved by classifying drawings of individuals using Support Vector Machine (SVM), Random Forest (RF), and Naive Bayes (NB) algorithms. Prior to classification, the data were normalized by applying the min-max normalization method. Moreover, Leave-One-Subject-Out (LOSO) Cross-Validation (CV) approach was utilized to eliminate possible overfitting scenarios. To further improve the performances of classifiers, Principal Component Analysis (PCA) dimension reduction technique were also applied to the raw data and the results were compared accordingly. RESULTS The highest accuracy among machine learning based classifiers was obtained as 90% with SVM classifier using non-template drawings with PCA application. CONCLUSION The model can be used as a pre-evaluation system in the clinic as a non-invasive method that also minimizes environmental and educational level differences by using simple hand gestures such as hand drawing, writing numbers, words, and syllables. As a result of our study, preliminary preparation has been made so that hand drawing analysis can be used as an auxiliary system that can save time for health professionals. We plan to work on more comprehensive data in the future.
Collapse
Affiliation(s)
- Bahar Demir
- Department of Computational Sciences, Trakya University, Edirne, 22030, Turkey.
| | - Sinem Ayna Altuntaş
- Department of Computational Sciences, Trakya University, Edirne, 22030, Turkey
- Department of Biomedical Device Technology, Trakya University, Edirne, 22030, Turkey
| | - İlke Kurt
- Department of Computational Sciences, Trakya University, Edirne, 22030, Turkey
- Department of Biomedical Device Technology, Trakya University, Edirne, 22030, Turkey
| | - Sezer Ulukaya
- Department of Electrical and Electronics Engineering, Trakya University, Edirne, 22030, Turkey
| | - Oğuzhan Erdem
- Department of Electrical and Electronics Engineering, Trakya University, Edirne, 22030, Turkey
| | - Sibel Güler
- Department of Neurology, Yalova University Faculty of Medicine, Yalova, 77200, Turkey.
| | - Cem Uzun
- Department of Otorhinolaryngology, Head and Neck Surgery, Koç University School of Medicine, İstanbul, 34010, Turkey
| |
Collapse
|
7
|
Ianculescu M, Petean C, Sandulescu V, Alexandru A, Vasilevschi AM. Early Detection of Parkinson's Disease Using AI Techniques and Image Analysis. Diagnostics (Basel) 2024; 14:2615. [PMID: 39682524 DOI: 10.3390/diagnostics14232615] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/27/2024] [Revised: 11/13/2024] [Accepted: 11/19/2024] [Indexed: 12/18/2024] Open
Abstract
BACKGROUND Parkinson's disease (PD) diagnosis benefits significantly from advancements in artificial intelligence (AI) and image processing techniques. This paper explores various approaches for processing hand-drawn Archimedean spirals in order to detect signs of PD. METHODS The best approach is selected to be integrated in a neurodegenerative disease management platform called NeuroPredict. The most innovative aspects of the presented approaches are related to the employed feature extraction techniques that convert hand-drawn spirals into a frequency spectra, so that frequency features may be extracted and utilized as inputs for various classification algorithms. A second category of extracted features contains information related to the thickness and pressure of drawings. RESULTS The selected approach achieves an overall accuracy of 95.24% and allows acquiring new test data using only a pencil and paper, without requiring a specialized device like a graphic tablet or a digital pen. CONCLUSIONS This study underscores the clinical relevance of AI in enhancing diagnostic precision for neurodegenerative diseases.
Collapse
Affiliation(s)
- Marilena Ianculescu
- National Institute for Research and Development in Informatics, 011455 Bucharest, Romania
| | - Corina Petean
- National Institute for Research and Development in Informatics, 011455 Bucharest, Romania
| | - Virginia Sandulescu
- National Institute for Research and Development in Informatics, 011455 Bucharest, Romania
| | - Adriana Alexandru
- National Institute for Research and Development in Informatics, 011455 Bucharest, Romania
- Faculty of Electrical Engineering, Electronics and Information Technology, Valahia University of Targoviste, 130004 Targoviste, Romania
| | | |
Collapse
|
8
|
Tigrini A, Ranaldi S, Verdini F, Mobarak R, Scattolini M, Conforto S, Schmid M, Burattini L, Gambi E, Fioretti S, Mengarelli A. Intelligent Human-Computer Interaction: Combined Wrist and Forearm Myoelectric Signals for Handwriting Recognition. Bioengineering (Basel) 2024; 11:458. [PMID: 38790325 PMCID: PMC11118072 DOI: 10.3390/bioengineering11050458] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/22/2024] [Revised: 04/19/2024] [Accepted: 05/02/2024] [Indexed: 05/26/2024] Open
Abstract
Recent studies have highlighted the possibility of using surface electromyographic (EMG) signals to develop human-computer interfaces that are also able to recognize complex motor tasks involving the hand as the handwriting of digits. However, the automatic recognition of words from EMG information has not yet been studied. The aim of this study is to investigate the feasibility of using combined forearm and wrist EMG probes for solving the handwriting recognition problem of 30 words with consolidated machine-learning techniques and aggregating state-of-the-art features extracted in the time and frequency domains. Six healthy subjects, three females and three males aged between 25 and 40 years, were recruited for the study. Two tests in pattern recognition were conducted to assess the possibility of classifying fine hand movements through EMG signals. The first test was designed to assess the feasibility of using consolidated myoelectric control technology with shallow machine-learning methods in the field of handwriting detection. The second test was implemented to assess if specific feature extraction schemes can guarantee high performances with limited complexity of the processing pipeline. Among support vector machine, linear discriminant analysis, and K-nearest neighbours (KNN), the last one showed the best classification performances in the 30-word classification problem, with a mean accuracy of 95% and 85% when using all the features and a specific feature set known as TDAR, respectively. The obtained results confirmed the validity of using combined wrist and forearm EMG data for intelligent handwriting recognition through pattern recognition approaches in real scenarios.
Collapse
Affiliation(s)
- Andrea Tigrini
- Department of Information Engineering, Università Politecnica delle Marche, 60131 Ancona, Italy; (F.V.); (R.M.); (M.S.); (L.B.); (E.G.); (S.F.); (A.M.)
| | - Simone Ranaldi
- Deparment of Industrial, Electronics and Mechanical Engineering, Roma Tre University, 00146 Rome, Italy; (S.R.); (S.C.); (M.S.)
| | - Federica Verdini
- Department of Information Engineering, Università Politecnica delle Marche, 60131 Ancona, Italy; (F.V.); (R.M.); (M.S.); (L.B.); (E.G.); (S.F.); (A.M.)
| | - Rami Mobarak
- Department of Information Engineering, Università Politecnica delle Marche, 60131 Ancona, Italy; (F.V.); (R.M.); (M.S.); (L.B.); (E.G.); (S.F.); (A.M.)
| | - Mara Scattolini
- Department of Information Engineering, Università Politecnica delle Marche, 60131 Ancona, Italy; (F.V.); (R.M.); (M.S.); (L.B.); (E.G.); (S.F.); (A.M.)
| | - Silvia Conforto
- Deparment of Industrial, Electronics and Mechanical Engineering, Roma Tre University, 00146 Rome, Italy; (S.R.); (S.C.); (M.S.)
| | - Maurizio Schmid
- Deparment of Industrial, Electronics and Mechanical Engineering, Roma Tre University, 00146 Rome, Italy; (S.R.); (S.C.); (M.S.)
| | - Laura Burattini
- Department of Information Engineering, Università Politecnica delle Marche, 60131 Ancona, Italy; (F.V.); (R.M.); (M.S.); (L.B.); (E.G.); (S.F.); (A.M.)
| | - Ennio Gambi
- Department of Information Engineering, Università Politecnica delle Marche, 60131 Ancona, Italy; (F.V.); (R.M.); (M.S.); (L.B.); (E.G.); (S.F.); (A.M.)
| | - Sandro Fioretti
- Department of Information Engineering, Università Politecnica delle Marche, 60131 Ancona, Italy; (F.V.); (R.M.); (M.S.); (L.B.); (E.G.); (S.F.); (A.M.)
| | - Alessandro Mengarelli
- Department of Information Engineering, Università Politecnica delle Marche, 60131 Ancona, Italy; (F.V.); (R.M.); (M.S.); (L.B.); (E.G.); (S.F.); (A.M.)
| |
Collapse
|
9
|
Wang X, Huang J, Chatzakou M, Medijainen K, Toomela A, Nõmm S, Ruzhansky M. LSTM-CNN: An efficient diagnostic network for Parkinson's disease utilizing dynamic handwriting analysis. COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE 2024; 247:108066. [PMID: 38364361 DOI: 10.1016/j.cmpb.2024.108066] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 12/04/2023] [Revised: 01/30/2024] [Accepted: 02/07/2024] [Indexed: 02/18/2024]
Abstract
BACKGROUND AND OBJECTIVES Dynamic handwriting analysis, due to its noninvasive and readily accessible nature, has emerged as a vital adjunctive method for the early diagnosis of Parkinson's disease (PD). An essential step involves analysing subtle variations in signals to quantify PD dysgraphia. Although previous studies have explored extracting features from the overall signal, they may ignore the potential importance of local signal segments. In this study, we propose a lightweight network architecture to analyse dynamic handwriting signal segments of patients and present visual diagnostic results, providing an efficient diagnostic method. METHODS To analyse subtle variations in handwriting, we investigate time-dependent patterns in local representation of handwriting signals. Specifically, we segment the handwriting signal into fixed-length sequential segments and design a compact one-dimensional (1D) hybrid network to extract discriminative temporal features for classifying each local segment. Finally, the category of the handwriting signal is fully diagnosed through a majority voting scheme. RESULTS The proposed method achieves impressive diagnostic performance on the new DraWritePD dataset (with an accuracy of 96.2%, sensitivity of 94.5% and specificity of 97.3%) and the well-established PaHaW dataset (with an accuracy of 90.7%, sensitivity of 94.3% and specificity of 87.5%). Moreover, the network architecture stands out for its excellent lightweight design, occupying a mere 0.084M parameters, with only 0.59M floating-point operations. It also exhibits nearly real-time CPU inference performance, with the inference time for a single handwriting signal ranging from 0.106 to 0.220 s. CONCLUSIONS We present a series of experiments with extensive analysis, which systematically demonstrate the effectiveness and efficiency of the proposed method in quantifying dysgraphia for a precise diagnosis of PD.
Collapse
Affiliation(s)
- Xuechao Wang
- Department of Mathematics: Analysis, Logic and Discrete Mathematics, Ghent University, Ghent, Belgium.
| | - Junqing Huang
- Department of Mathematics: Analysis, Logic and Discrete Mathematics, Ghent University, Ghent, Belgium
| | - Marianna Chatzakou
- Department of Mathematics: Analysis, Logic and Discrete Mathematics, Ghent University, Ghent, Belgium
| | - Kadri Medijainen
- Institute of Sport Sciences and Physiotherapy, University of Tartu, Puusepa 8, Tartu 51014, Estonia
| | - Aaro Toomela
- School of Natural Sciences and Health, Tallinn University, Narva mnt. 25, 10120, Tallinn, Estonia
| | - Sven Nõmm
- Department of Software Science, Faculty of Information Technology, Tallinn University of Technology, Akadeemia tee 15 a, 12618, Tallinn, Estonia
| | - Michael Ruzhansky
- Department of Mathematics: Analysis, Logic and Discrete Mathematics, Ghent University, Ghent, Belgium; School of Mathematical Sciences, Queen Mary University of London, Mile End Road, London E1 4NS, United Kingdom
| |
Collapse
|
10
|
Li D, Butala AA, Moro-Velazquez L, Meyer T, Oh ES, Motley C, Villalba J, Dehak N. Automating the analysis of eye movement for different neurodegenerative disorders. Comput Biol Med 2024; 170:107951. [PMID: 38219646 DOI: 10.1016/j.compbiomed.2024.107951] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/03/2023] [Revised: 12/08/2023] [Accepted: 01/01/2024] [Indexed: 01/16/2024]
Abstract
The clinical observation and assessment of extra-ocular movements is common practice in assessing neurodegenerative disorders but remains observer-dependent. In the present study, we propose an algorithm that can automatically identify saccades, fixation, smooth pursuit, and blinks using a non-invasive eye tracker. Subsequently, response-to-stimuli-derived interpretable features were elicited that objectively and quantitatively assess patient behaviors. The cohort analysis encompasses persons with mild cognitive impairment (MCI), Alzheimer's disease (AD), Parkinson's disease (PD), Parkinson's disease mimics (PDM), and controls (CTRL). Overall, results suggested that the AD/MCI and PD groups had significantly different saccade and pursuit characteristics compared to CTRL when the target moved faster or covered a larger visual angle during smooth pursuit. These two groups also displayed more omitted antisaccades and longer average antisaccade latency than CTRL. When reading a text passage silently, people with AD/MCI had more fixations. During visual exploration, people with PD demonstrated a more variable saccade duration than other groups. In the prosaccade task, the PD group showed a significantly smaller average hypometria gain and accuracy, with the most statistical significance and highest AUC scores of features studied. The minimum saccade gain was a PD-specific feature different from CTRL and PDM. These features, as oculographic biomarkers, can be potentially leveraged in distinguishing different types of NDs, yielding more objective and precise protocols to diagnose and monitor disease progression.
Collapse
Affiliation(s)
- Deming Li
- Department of Electrical and Computer Engineering, The Johns Hopkins University, Baltimore, 21218, MD, USA.
| | - Ankur A Butala
- Department of Neurology, Johns Hopkins University School of Medicine, Baltimore, 21205, MD, USA
| | - Laureano Moro-Velazquez
- Department of Electrical and Computer Engineering, The Johns Hopkins University, Baltimore, 21218, MD, USA
| | - Trevor Meyer
- Department of Electrical and Computer Engineering, The Johns Hopkins University, Baltimore, 21218, MD, USA
| | - Esther S Oh
- Division of Geriatric Medicine and Gerontology, Johns Hopkins University School of Medicine, Baltimore, 21205, MD, USA
| | - Chelsey Motley
- Department of Neurology, Johns Hopkins University School of Medicine, Baltimore, 21205, MD, USA
| | - Jesús Villalba
- Department of Electrical and Computer Engineering, The Johns Hopkins University, Baltimore, 21218, MD, USA
| | - Najim Dehak
- Department of Electrical and Computer Engineering, The Johns Hopkins University, Baltimore, 21218, MD, USA
| |
Collapse
|
11
|
Islam M, Hasan Majumder M, Hussein M, Hossain KM, Miah M. A review of machine learning and deep learning algorithms for Parkinson's disease detection using handwriting and voice datasets. Heliyon 2024; 10:e25469. [PMID: 38356538 PMCID: PMC10865258 DOI: 10.1016/j.heliyon.2024.e25469] [Citation(s) in RCA: 8] [Impact Index Per Article: 8.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/24/2023] [Revised: 11/30/2023] [Accepted: 01/27/2024] [Indexed: 02/16/2024] Open
Abstract
Parkinson's Disease (PD) is a prevalent neurodegenerative disorder with significant clinical implications. Early and accurate diagnosis of PD is crucial for timely intervention and personalized treatment. In recent years, Machine Learning (ML) and Deep Learning (DL) techniques have emerged as promis-ing tools for improving PD diagnosis. This review paper presents a detailed analysis of the current state of ML and DL-based PD diagnosis, focusing on voice, handwriting, and wave spiral datasets. The study also evaluates the effectiveness of various ML and DL algorithms, including classifiers, on these datasets and highlights their potential in enhancing diagnostic accuracy and aiding clinical decision-making. Additionally, the paper explores the identifi-cation of biomarkers using these techniques, offering insights into improving the diagnostic process. The discussion encompasses different data formats and commonly employed ML and DL methods in PD diagnosis, providing a comprehensive overview of the field. This review serves as a roadmap for future research, guiding the development of ML and DL-based tools for PD detection. It is expected to benefit both the scientific community and medical practitioners by advancing our understanding of PD diagnosis and ultimately improving patient outcomes.
Collapse
Affiliation(s)
- Md.Ariful Islam
- Department of Robotics and Mechatronics Engineering, University of Dhaka, Nilkhet Rd, Dhaka, 1000, Bangladesh
| | - Md.Ziaul Hasan Majumder
- Institute of Electronics, Bangladesh Atomic Energy Commission, Dhaka, 1207, Bangladesh
- Department of Electrical and Electronic Engineering, University of Dhaka, Dhaka, 1000, Bangladesh
| | - Md.Alomgeer Hussein
- Department of Electrical and Electronic Engineering, University of Dhaka, Dhaka, 1000, Bangladesh
| | - Khondoker Murad Hossain
- Department of Electrical and Electronic Engineering, University of Dhaka, Dhaka, 1000, Bangladesh
| | - Md.Sohel Miah
- Department of Electrical and Electronic Engineering, University of Dhaka, Dhaka, 1000, Bangladesh
- Moulvibazar Polytechnic Institute, Bangladesh
| |
Collapse
|
12
|
Cashaback JGA, Allen JL, Chou AHY, Lin DJ, Price MA, Secerovic NK, Song S, Zhang H, Miller HL. NSF DARE-transforming modeling in neurorehabilitation: a patient-in-the-loop framework. J Neuroeng Rehabil 2024; 21:23. [PMID: 38347597 PMCID: PMC10863253 DOI: 10.1186/s12984-024-01318-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/10/2023] [Accepted: 01/25/2024] [Indexed: 02/15/2024] Open
Abstract
In 2023, the National Science Foundation (NSF) and the National Institute of Health (NIH) brought together engineers, scientists, and clinicians by sponsoring a conference on computational modelling in neurorehabiilitation. To facilitate multidisciplinary collaborations and improve patient care, in this perspective piece we identify where and how computational modelling can support neurorehabilitation. To address the where, we developed a patient-in-the-loop framework that uses multiple and/or continual measurements to update diagnostic and treatment model parameters, treatment type, and treatment prescription, with the goal of maximizing clinically-relevant functional outcomes. This patient-in-the-loop framework has several key features: (i) it includes diagnostic and treatment models, (ii) it is clinically-grounded with the International Classification of Functioning, Disability and Health (ICF) and patient involvement, (iii) it uses multiple or continual data measurements over time, and (iv) it is applicable to a range of neurological and neurodevelopmental conditions. To address the how, we identify state-of-the-art and highlight promising avenues of future research across the realms of sensorimotor adaptation, neuroplasticity, musculoskeletal, and sensory & pain computational modelling. We also discuss both the importance of and how to perform model validation, as well as challenges to overcome when implementing computational models within a clinical setting. The patient-in-the-loop approach offers a unifying framework to guide multidisciplinary collaboration between computational and clinical stakeholders in the field of neurorehabilitation.
Collapse
Affiliation(s)
- Joshua G A Cashaback
- Biomedical Engineering, Mechanical Engineering, Kinesiology and Applied Physiology, Biome chanics and Movement Science Program, Interdisciplinary Neuroscience Graduate Program, University of Delaware, 540 S College Ave, Newark, DE, 19711, USA.
| | - Jessica L Allen
- Department of Mechanical Engineering, University of Florida, Gainesville, USA
| | | | - David J Lin
- Division of Neurocritical Care and Stroke Service, Department of Neurology, Center for Neurotechnology and Neurorecovery, Massachusetts General Hospital, Harvard Medical School, Boston, USA
- Department of Veterans Affairs, Center for Neurorestoration and Neurotechnology, Rehabilitation Research and Development Service, Providence, USA
| | - Mark A Price
- Department of Mechanical and Industrial Engineering, Department of Kinesiology, University of Massachusetts Amherst, Amherst, USA
| | - Natalija K Secerovic
- School of Electrical Engineering, The Mihajlo Pupin Institute, University of Belgrade, Belgrade, Serbia
- Laboratory for Neuroengineering, Institute for Robotics and Intelligent Systems ETH Zürich, Zurich, Switzerland
| | - Seungmoon Song
- Mechanical and Industrial Engineering, Northeastern University, Boston, USA
| | - Haohan Zhang
- Department of Mechanical Engineering, University of Utah, Salt Lake City, USA
| | - Haylie L Miller
- School of Kinesiology, University of Michigan, 830 N University Ave, Ann Arbor, MI, 48109, USA.
| |
Collapse
|
13
|
Cilia ND, De Stefano C, Fontanella F, Siniscalchi SM. How word semantics and phonology affect handwriting of Alzheimer's patients: A machine learning based analysis. Comput Biol Med 2024; 169:107891. [PMID: 38181607 DOI: 10.1016/j.compbiomed.2023.107891] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/28/2023] [Revised: 12/10/2023] [Accepted: 12/19/2023] [Indexed: 01/07/2024]
Abstract
Using kinematic properties of handwriting to support the diagnosis of neurodegenerative disease is a real challenge: non-invasive detection techniques combined with machine learning approaches promise big steps forward in this research field. In literature, the tasks proposed focused on different cognitive skills to elicitate handwriting movements. In particular, the meaning and phonology of words to copy can compromise writing fluency. In this paper, we investigated how word semantics and phonology affect the handwriting of people affected by Alzheimer's disease. To this aim, we used the data from six handwriting tasks, each requiring copying a word belonging to one of the following categories: regular (have a predictable phoneme-grapheme correspondence, e.g., cat), non-regular (have atypical phoneme-grapheme correspondence, e.g., laugh), and non-word (non-meaningful pronounceable letter strings that conform to phoneme-grapheme conversion rules). We analyzed the data using a machine learning approach by implementing four well-known and widely-used classifiers and feature selection. The experimental results showed that the feature selection allowed us to derive a different set of highly distinctive features for each word type. Furthermore, non-regular words needed, on average, more features but achieved excellent classification performance: the best result was obtained on a non-regular, reaching an accuracy close to 90%.
Collapse
Affiliation(s)
- Nicole D Cilia
- Department of Computer Engineering, University of Enna "Kore", Italy; Institute for Computing and Information Sciences, Radboud University Nijmegen, The Netherlands.
| | - Claudio De Stefano
- Department of Electrical and Information Engineering Mathematics, University of Cassino and Southern Lazio, Italy.
| | - Francesco Fontanella
- Department of Electrical and Information Engineering Mathematics, University of Cassino and Southern Lazio, Italy.
| | | |
Collapse
|
14
|
Ngo QC, McConnell N, Motin MA, Polus B, Bhattacharya A, Raghav S, Kumar DK. NeuroDiag: Software for Automated Diagnosis of Parkinson's Disease Using Handwriting. IEEE JOURNAL OF TRANSLATIONAL ENGINEERING IN HEALTH AND MEDICINE 2024; 12:291-297. [PMID: 38410180 PMCID: PMC10896420 DOI: 10.1109/jtehm.2024.3355432] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 08/22/2023] [Revised: 11/17/2023] [Accepted: 01/09/2024] [Indexed: 02/28/2024]
Abstract
OBJECTIVE A change in handwriting is an early sign of Parkinson's disease (PD). However, significant inter-person differences in handwriting make it difficult to identify pathological handwriting, especially in the early stages. This paper reports the testing of NeuroDiag, a software-based medical device, for the automated detection of PD using handwriting patterns. NeuroDiag is designed to direct the user to perform six drawing and writing tasks, and the recordings are then uploaded onto a server for analysis. Kinematic information and pen pressure of handwriting are extracted and used as baseline parameters. NeuroDiag was trained based on 26 PD patients in the early stage of the disease and 26 matching controls. METHODS Twenty-three people with PD (PPD) in their early stage of the disease, 25 age-matched healthy controls (AMC), and 7 young healthy controls were recruited for this study. Under the supervision of a consultant neurologist or their nurse, the participants used NeuroDiag. The reports were generated in real-time and tabulated by an independent observer. RESULTS The participants were able to use NeuroDiag without assistance. The handwriting data was successfully uploaded to the server where the report was automatically generated in real-time. There were significant differences in the writing speed between PPD and AMC (P<0.001). NeuroDiag showed 86.96% sensitivity and 76.92% specificity in differentiating PPD from those without PD. CONCLUSION In this work, we tested the reliability of NeuroDiag in differentiating between PPD and AMC for real-time applications. The results show that NeuroDiag has the potential to be used to assist neurologists and for telehealth applications. Clinical and Translational Impact Statement - This pre-clinical study shows the feasibility of developing a community-wide screening program for Parkinson's disease using automated handwriting analysis software, NeuroDiag.
Collapse
Affiliation(s)
- Quoc Cuong Ngo
- School of Engineering, STEM CollegeRMIT UniversityMelbourneVIC3000Australia
| | | | | | - Barbara Polus
- School of Engineering, STEM CollegeRMIT UniversityMelbourneVIC3000Australia
| | | | - Sanjay Raghav
- Monash Medical CentreDepartment of NeurosciencesClaytonVIC3168Australia
| | - Dinesh Kant Kumar
- School of Engineering, STEM CollegeRMIT UniversityMelbourneVIC3000Australia
| |
Collapse
|
15
|
Zhao S, Dai G, Li J, Zhu X, Huang X, Li Y, Tan M, Wang L, Fang P, Chen X, Yan N, Liu H. An interpretable model based on graph learning for diagnosis of Parkinson's disease with voice-related EEG. NPJ Digit Med 2024; 7:3. [PMID: 38182737 PMCID: PMC10770376 DOI: 10.1038/s41746-023-00983-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/23/2023] [Accepted: 11/29/2023] [Indexed: 01/07/2024] Open
Abstract
Parkinson's disease (PD) exhibits significant clinical heterogeneity, presenting challenges in the identification of reliable electroencephalogram (EEG) biomarkers. Machine learning techniques have been integrated with resting-state EEG for PD diagnosis, but their practicality is constrained by the interpretable features and the stochastic nature of resting-state EEG. The present study proposes a novel and interpretable deep learning model, graph signal processing-graph convolutional networks (GSP-GCNs), using event-related EEG data obtained from a specific task involving vocal pitch regulation for PD diagnosis. By incorporating both local and global information from single-hop and multi-hop networks, our proposed GSP-GCNs models achieved an averaged classification accuracy of 90.2%, exhibiting a significant improvement of 9.5% over other deep learning models. Moreover, the interpretability analysis revealed discriminative distributions of large-scale EEG networks and topographic map of microstate MS5 learned by our models, primarily located in the left ventral premotor cortex, superior temporal gyrus, and Broca's area that are implicated in PD-related speech disorders, reflecting our GSP-GCN models' ability to provide interpretable insights identifying distinctive EEG biomarkers from large-scale networks. These findings demonstrate the potential of interpretable deep learning models coupled with voice-related EEG signals for distinguishing PD patients from healthy controls with accuracy and elucidating the underlying neurobiological mechanisms.
Collapse
Affiliation(s)
- Shuzhi Zhao
- Department of Rehabilitation Medicine, The First Affiliated Hospital, Sun Yat-sen University, Guangzhou, China
- School of Biomedical Engineering, Sun Yat-sen University, Shenzhen, China
- CAS Key Laboratory of Human-Machine Intelligence-Synergy Systems, Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences, Shenzhen, China
| | - Guangyan Dai
- Department of Rehabilitation Medicine, The First Affiliated Hospital, Sun Yat-sen University, Guangzhou, China
| | - Jingting Li
- Department of Rehabilitation Medicine, The First Affiliated Hospital, Sun Yat-sen University, Guangzhou, China
| | - Xiaoxia Zhu
- Department of Rehabilitation Medicine, The First Affiliated Hospital, Sun Yat-sen University, Guangzhou, China
| | - Xiyan Huang
- Department of Rehabilitation Medicine, Zhujiang Hospital, Southern Medical University, Guangzhou, China
| | - Yongxue Li
- Department of Rehabilitation Medicine, The First Affiliated Hospital, Sun Yat-sen University, Guangzhou, China
| | - Mingdan Tan
- Department of Rehabilitation Medicine, The First Affiliated Hospital, Sun Yat-sen University, Guangzhou, China
| | - Lan Wang
- CAS Key Laboratory of Human-Machine Intelligence-Synergy Systems, Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences, Shenzhen, China
- Guangdong-Hong Kong-Macao Joint Laboratory of Human-Machine Intelligence-Synergy Systems, Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences, Shenzhen, China
| | - Peng Fang
- CAS Key Laboratory of Human-Machine Intelligence-Synergy Systems, Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences, Shenzhen, China
- Guangdong-Hong Kong-Macao Joint Laboratory of Human-Machine Intelligence-Synergy Systems, Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences, Shenzhen, China
| | - Xi Chen
- Department of Rehabilitation Medicine, The First Affiliated Hospital, Sun Yat-sen University, Guangzhou, China.
| | - Nan Yan
- CAS Key Laboratory of Human-Machine Intelligence-Synergy Systems, Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences, Shenzhen, China.
- Guangdong-Hong Kong-Macao Joint Laboratory of Human-Machine Intelligence-Synergy Systems, Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences, Shenzhen, China.
| | - Hanjun Liu
- Department of Rehabilitation Medicine, The First Affiliated Hospital, Sun Yat-sen University, Guangzhou, China.
- Guangdong Provincial Key Laboratory of Brain Function and Disease, Zhongshan School of Medicine, Sun Yat-sen University, Guangzhou, China.
| |
Collapse
|
16
|
Dhanalakshmi S, Maanasaa RS, Maalikaa RS, Senthil R. A review of emergent intelligent systems for the detection of Parkinson's disease. Biomed Eng Lett 2023; 13:591-612. [PMID: 37872986 PMCID: PMC10590348 DOI: 10.1007/s13534-023-00319-2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/25/2023] [Revised: 08/11/2023] [Accepted: 09/07/2023] [Indexed: 10/25/2023] Open
Abstract
Parkinson's disease (PD) is a neurodegenerative disorder affecting people worldwide. The PD symptoms are divided into motor and non-motor symptoms. Detection of PD is very crucial and essential. Such challenges can be overcome by applying artificial intelligence to diagnose PD. Many studies have also proposed the implementation of computer-aided diagnosis for the detection of PD. This systematic review comprehensively analyzed all appropriate algorithms for detecting and assessing PD based on the literature from 2012 to 2023 which are conducted as per PRISMA model. This review focused on motor symptoms, namely handwriting dynamics, voice impairments and gait, multimodal features, and brain observation using single photon emission computed tomography, magnetic resonance and electroencephalogram signals. The significant challenges are critically analyzed, and appropriate recommendations are provided. The critical discussion of this review article can be helpful in today's PD community in such a way that it allows clinicians to provide proper treatment and timely medication.
Collapse
Affiliation(s)
- Samiappan Dhanalakshmi
- Department of Electronics and Communication Engineering, SRM Institute of Science and Technology, Kattankulathur, Chennai, 603203 India
| | - Ramesh Sai Maanasaa
- Department of Electronics and Communication Engineering, SRM Institute of Science and Technology, Kattankulathur, Chennai, 603203 India
| | - Ramesh Sai Maalikaa
- Department of Electronics and Communication Engineering, SRM Institute of Science and Technology, Kattankulathur, Chennai, 603203 India
| | - Ramalingam Senthil
- Department of Mechanical Engineering, SRM Institute of Science and Technology, Kattankulathur, Chennai, 603203 India
| |
Collapse
|
17
|
Demir B, Ulukaya S, Erdem O. Detection of Parkinson's disease with keystroke data. Comput Methods Biomech Biomed Engin 2023; 26:1653-1667. [PMID: 37599616 DOI: 10.1080/10255842.2023.2245516] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/14/2022] [Revised: 03/21/2023] [Accepted: 07/16/2023] [Indexed: 08/22/2023]
Abstract
Parkinson's disease (PD) is one of the most widespread neurological disorders associated with nerve damage without definitive treatment. Impairments, such as trembling and slowing down in hand movements are among the first symptoms. For this purpose, in this study, machine learning (ML)-based models were developed by using keyboard keystroke dynamics. According to patients' drug use status, disease severity, and gender, we created 14 different sub-datasets and extracted 378 features using raw keystroke data. We developed alternative models with Support Vector Machines (SVM), k-Nearest Neighbors (kNN), and Random Forest (RF) algorithms. We further used Minimum Redundancy Maximum Relevance (mRmR), RELIEF, sequential forward selection (SFS), and RF feature selection methods to investigate prominent features in distinguishing PD. We developed ML models that jointly use the most popular features of selection algorithms (feature ensemble [FE]) and an ensemble classifier by combining multiple ML algorithms utilizing majority vote (model ensemble [ME]). With 14 different sets, FE and ME models provided accuracy (Acc.) in the range of 91.73 - 100% and 81.08 - 100%, respectively.
Collapse
Affiliation(s)
- Bahar Demir
- Department of Computational Science, Trakya University, Edirne, Turkey
| | - Sezer Ulukaya
- Department of Electrical and Electronics Engineering, Trakya University, Edirne, Turkey
| | - Oğuzhan Erdem
- Department of Electrical and Electronics Engineering, Trakya University, Edirne, Turkey
| |
Collapse
|
18
|
Beigi OM, Nóbrega LR, Houghten S, Alves Pereira A, de Oliveira Andrade A. Freezing of gait in Parkinson's disease: Classification using computational intelligence. Biosystems 2023; 232:105006. [PMID: 37634658 DOI: 10.1016/j.biosystems.2023.105006] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/31/2023] [Revised: 08/20/2023] [Accepted: 08/20/2023] [Indexed: 08/29/2023]
Abstract
Parkinson's disease (PD) is a neurodegenerative disease represented by the progressive loss of dopamine producing neurons, with motor and non-motor symptoms that may be hard to distinguish from other disorders. Affecting millions of people across the world, its symptoms include bradykinesia, tremors, depression, rigidity, postural instability, cognitive decline, and falls. Furthermore, changes in gait can be used as a primary diagnosis factor. A dataset is described that records data on healthy individuals and on PD patients, including those who experience freezing of gait, in both the ON and OFF-medication states. The dataset is comprised of data for four separate tasks: voluntary stop, timed up and go, simple motor task, and dual motor and cognitive task. Seven different classifiers are applied to two problems relating to this data. The first problem is to distinguish PD patients from healthy individuals, both overall and per task. The second problem is to determine the effectiveness of medication. A thorough analysis on the classifiers and their results is performed. Overall, multilayer perceptron and decision tree provide the most consistent results.
Collapse
Affiliation(s)
- Omid Mohamad Beigi
- Computer Science Department, Brock University, St. Catharines, Ontario, Canada
| | - Lígia Reis Nóbrega
- Faculty of Electrical Engineering, Federal University of Uberlândia, Uberlândia, Brazil
| | - Sheridan Houghten
- Computer Science Department, Brock University, St. Catharines, Ontario, Canada.
| | - Adriano Alves Pereira
- Faculty of Electrical Engineering, Federal University of Uberlândia, Uberlândia, Brazil
| | | |
Collapse
|
19
|
Valla E, Toose AJ, Nõmm S, Toomela A. Transforming fatigue assessment: Smartphone-based system with digitized motor skill tests. Int J Med Inform 2023; 177:105152. [PMID: 37499442 DOI: 10.1016/j.ijmedinf.2023.105152] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/27/2023] [Revised: 07/06/2023] [Accepted: 07/11/2023] [Indexed: 07/29/2023]
Abstract
BACKGROUND The condition of fatigue is a complex and multifaceted disorder that encompasses physical, mental, and psychological dimensions, all of which contribute to a decreased quality of life. Smartphone-based systems are gaining significant research interest due to their potential to provide noninvasive monitoring and diagnosis of diseases. OBJECTIVE This paper studies the feasibility of using smartphones to collect motor skill related data for machine learning based fatigue detection. The authors' main goal is to provide valuable insights into the nature of fatigue and support the development of more effective interventions to manage it. METHODS An application for smartphones running on Android OS is developed. Two aim-based reaction tests, an Archimedean spiral test, and a tremor test, were assembled. 41 subjects participated in the study. The resulting dataset consists of 131 trials of fatigue assessment alongside digital signals extracted from the motor skill tests. Six machine learning classifiers were trained on computed features extracted from the collected digital signals. RESULTS The collected dataset SmartPhoneFatigue is presented for further research. The real-world utility of this database was shown by creating a methodology to construct a fatigue predictive model. Our approach incorporated 60 distinct features, such as kinematic, angular, aim-based, and tremor-related measures. The machine learning models exhibited a high degree of prediction rate for fatigue state, with an accuracy exceeding 70%, sensitivity surpassing 90%, and an f1-score greater than 80%. CONCLUSION The results demonstrate that the proposed smartphone-based system is suitable for motion data acquisition in non-controlled environments and shows promise as a more objective and convenient method for measuring fatigue.
Collapse
Affiliation(s)
- Elli Valla
- Department of Software Science, School of Information Technology, Tallinn University of Technology (TalTech), Akadeemia tee 15a, 12618, Tallinn, Estonia.
| | - Ain-Joonas Toose
- Department of Software Science, School of Information Technology, Tallinn University of Technology (TalTech), Akadeemia tee 15a, 12618, Tallinn, Estonia.
| | - Sven Nõmm
- Department of Software Science, School of Information Technology, Tallinn University of Technology (TalTech), Akadeemia tee 15a, 12618, Tallinn, Estonia.
| | - Aaro Toomela
- School of Natural Sciences and Health, Tallinn University, Narva mnt. 25, 10120, Tallinn, Estonia.
| |
Collapse
|
20
|
Wu P, Cao B, Liang Z, Wu M. The advantages of artificial intelligence-based gait assessment in detecting, predicting, and managing Parkinson's disease. Front Aging Neurosci 2023; 15:1191378. [PMID: 37502426 PMCID: PMC10368956 DOI: 10.3389/fnagi.2023.1191378] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/22/2023] [Accepted: 06/05/2023] [Indexed: 07/29/2023] Open
Abstract
Background Parkinson's disease is a neurological disorder that can cause gait disturbance, leading to mobility issues and falls. Early diagnosis and prediction of freeze episodes are essential for mitigating symptoms and monitoring the disease. Objective This review aims to evaluate the use of artificial intelligence (AI)-based gait evaluation in diagnosing and managing Parkinson's disease, and to explore the potential benefits of this technology for clinical decision-making and treatment support. Methods A thorough review of published literature was conducted to identify studies, articles, and research related to AI-based gait evaluation in Parkinson's disease. Results AI-based gait evaluation has shown promise in preventing freeze episodes, improving diagnosis, and increasing motor independence in patients with Parkinson's disease. Its advantages include higher diagnostic accuracy, continuous monitoring, and personalized therapeutic interventions. Conclusion AI-based gait evaluation systems hold great promise for managing Parkinson's disease and improving patient outcomes. They offer the potential to transform clinical decision-making and inform personalized therapies, but further research is needed to determine their effectiveness and refine their use.
Collapse
Affiliation(s)
- Peng Wu
- College of Acupuncture and Orthopedics, Hubei University of Chinese Medicine, Wuhan, Hubei, China
| | - Biwei Cao
- Hubei Provincial Hospital of Traditional Chinese Medicine, Wuhan, China
- Affiliated Hospital of Hubei University of Chinese Medicine, Wuhan, Hubei, China
- Hubei Academy of Traditional Chinese Medicine, Wuhan, Hubei, China
| | - Zhendong Liang
- College of Acupuncture and Orthopedics, Hubei University of Chinese Medicine, Wuhan, Hubei, China
| | - Miao Wu
- Hubei Provincial Hospital of Traditional Chinese Medicine, Wuhan, China
- Affiliated Hospital of Hubei University of Chinese Medicine, Wuhan, Hubei, China
- Hubei Academy of Traditional Chinese Medicine, Wuhan, Hubei, China
| |
Collapse
|
21
|
Yamada E, Fujita K, Watanabe T, Koyama T, Ibara T, Yamamoto A, Tsukamoto K, Kaburagi H, Nimura A, Yoshii T, Sugiura Y, Okawa A. A screening method for cervical myelopathy using machine learning to analyze a drawing behavior. Sci Rep 2023; 13:10015. [PMID: 37340079 DOI: 10.1038/s41598-023-37253-3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/30/2023] [Accepted: 06/19/2023] [Indexed: 06/22/2023] Open
Abstract
Early detection of cervical myelopathy (CM) is important for a favorable outcome, as its prognosis is poor when left untreated. We developed a screening method for CM using machine learning-based analysis of the drawing behavior of 38 patients with CM and 66 healthy volunteers. Using a stylus pen, the participants traced three different shapes displayed on a tablet device. During the tasks, writing behaviors, such as the coordinates, velocity, and pressure of the stylus tip, along with the drawing time, were recorded. From these data, features related to the drawing pressure, and time to trace each shape and combination of shapes were used as training data for the support vector machine, a machine learning algorithm. To evaluate the accuracy, a receiver operating characteristic curve was generated, and the area under the curve (AUC) was calculated. Models with triangular waveforms tended to be the most accurate. The best triangular wave model identified patients with and without CM with 76% sensitivity and 76% specificity, yielding an AUC of 0.80. Our model was able to classify CM with high accuracy and could be applied to the development of disease screening systems useful outside the hospital setting.
Collapse
Affiliation(s)
- Eriku Yamada
- Department of Orthopedic and Spinal Surgery, Graduate School of Medical and Dental Sciences, Tokyo Medical and Dental University (TMDU), 1-5-45, Yushima, Bunkyo-ku, Tokyo, 113-8519, Japan
| | - Koji Fujita
- Department of Functional Joint Anatomy, Graduate School of Medical and Dental Sciences, Tokyo Medical and Dental University (TMDU), 1-5-45, Yushima, Bunkyo-ku, Tokyo, 113-8519, Japan.
| | - Takuro Watanabe
- School of Science for Open and Environmental Systems, Graduate School of Science and Technology, Keio University, 3-14-1 Hiyoshi, Kohoku-ku, Yokohama-shi, Kanagawa, 223-8522, Japan
| | - Takafumi Koyama
- Department of Orthopedic and Spinal Surgery, Graduate School of Medical and Dental Sciences, Tokyo Medical and Dental University (TMDU), 1-5-45, Yushima, Bunkyo-ku, Tokyo, 113-8519, Japan
| | - Takuya Ibara
- Department of Functional Joint Anatomy, Graduate School of Medical and Dental Sciences, Tokyo Medical and Dental University (TMDU), 1-5-45, Yushima, Bunkyo-ku, Tokyo, 113-8519, Japan
| | - Akiko Yamamoto
- Department of Orthopedic and Spinal Surgery, Graduate School of Medical and Dental Sciences, Tokyo Medical and Dental University (TMDU), 1-5-45, Yushima, Bunkyo-ku, Tokyo, 113-8519, Japan
| | - Kazuya Tsukamoto
- Department of Orthopedic and Spinal Surgery, Graduate School of Medical and Dental Sciences, Tokyo Medical and Dental University (TMDU), 1-5-45, Yushima, Bunkyo-ku, Tokyo, 113-8519, Japan
| | - Hidetoshi Kaburagi
- Department of Orthopedic and Spinal Surgery, Graduate School of Medical and Dental Sciences, Tokyo Medical and Dental University (TMDU), 1-5-45, Yushima, Bunkyo-ku, Tokyo, 113-8519, Japan
| | - Akimoto Nimura
- Department of Functional Joint Anatomy, Graduate School of Medical and Dental Sciences, Tokyo Medical and Dental University (TMDU), 1-5-45, Yushima, Bunkyo-ku, Tokyo, 113-8519, Japan
| | - Toshitaka Yoshii
- Department of Orthopedic and Spinal Surgery, Graduate School of Medical and Dental Sciences, Tokyo Medical and Dental University (TMDU), 1-5-45, Yushima, Bunkyo-ku, Tokyo, 113-8519, Japan
| | - Yuta Sugiura
- School of Science for Open and Environmental Systems, Graduate School of Science and Technology, Keio University, 3-14-1 Hiyoshi, Kohoku-ku, Yokohama-shi, Kanagawa, 223-8522, Japan
| | - Atsushi Okawa
- Department of Orthopedic and Spinal Surgery, Graduate School of Medical and Dental Sciences, Tokyo Medical and Dental University (TMDU), 1-5-45, Yushima, Bunkyo-ku, Tokyo, 113-8519, Japan
| |
Collapse
|
22
|
Mancini A, Albani G, Marano G, Calabrese R, Veneziano G, Paffi A, Angelucci M, Mazza M, Pallotti A. Graph and Handwriting Signals-Based Machine Learning Models Development in Parkinson’s Screening and Telemonitoring. 2023 IEEE INTERNATIONAL WORKSHOP ON METROLOGY FOR INDUSTRY 4.0 & IOT (METROIND4.0&IOT) 2023:183-188. [DOI: 10.1109/metroind4.0iot57462.2023.10180185] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 03/23/2025]
Affiliation(s)
| | | | - Giuseppe Marano
- AGIF, Institute of Psychiatry and Psychology,Department of Geriatrics, Neuroscience and Orthopedics, Fondazione Policlinico Universitario A. Gemelli IRCCS, Università Cattolica del Sacro Cuore,Rome,Italy,00168
| | | | | | | | | | - Marianna Mazza
- Istitute of Psychiatry and Psychology,Department of Geriatrics, Neuroscience and Orthopedics, Fondazione Policlinico Universitario A. Gemelli IRCSS, Università Cattolica del Sacro Cuore,Rome,Italy,00168
| | - Antonio Pallotti
- Consorzio Parco Scientifico e Tecnologico Pontino Technoscience San Raffaele University of Rome,Rome,Italy
| |
Collapse
|
23
|
Junaid M, Ali S, Eid F, El-Sappagh S, Abuhmed T. Explainable machine learning models based on multimodal time-series data for the early detection of Parkinson's disease. COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE 2023; 234:107495. [PMID: 37003039 DOI: 10.1016/j.cmpb.2023.107495] [Citation(s) in RCA: 11] [Impact Index Per Article: 5.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/20/2022] [Revised: 02/23/2023] [Accepted: 03/17/2023] [Indexed: 06/19/2023]
Abstract
BACKGROUND AND OBJECTIVES Parkinson's Disease (PD) is a devastating chronic neurological condition. Machine learning (ML) techniques have been used in the early prediction of PD progression. Fusion of heterogeneous data modalities proved its capability to improve the performance of ML models. Time series data fusion supports the tracking of the disease over time. In addition, the trustworthiness of the resulting models is improved by adding model explainability features. The literature on PD has not sufficiently explored these three points. METHODS In this work, we proposed an ML pipeline for predicting the progression of PD that is both accurate and explainable. We explore the fusion of different combinations of five time series modalities from the Parkinson's Progression Markers Initiative (PPMI) real-world dataset, including patient characteristics, biosamples, medication history, motor, and non-motor function data. Each patient has six visits. The problem has been formulated in two ways: ❶ a three-class based progression prediction with 953 patients in each time series modality, and ❷ a four-class based progression prediction with 1,060 patients in each time series modality. The statistical features of these six visits were calculated from each modality and diverse feature selection methods were applied to select the most informative feature sets. The extracted features were used to train a set of well-known ML models including Support vector machines (SVM), random forests (RF), extra tree classifier (ETC), light gradient boosting machines (LGBM), and stochastic gradient descent (SGD). We examined a number of data-balancing strategies in the pipeline with different combinations of modalities. ML models have been optimized using the Bayesian optimizer. A comprehensive evaluation of various ML methods has been conducted, and the best models have been extended to provide different explainability features. RESULTS We compare the performance of ML models before and after optimization and using and without using feature selection. In the three-class experiment and with various modality fusions, the LGBM model produced the most accurate results with a 10-fold cross-validation (10-CV) accuracy of 90.73% using non-motor function modality. RF produced the best results in the four-class experiment with various modality fusions with a 10-CV accuracy of 94.57% using non-motor modality. With the fused dataset of non-motor and motor function modalities, the LGBM model outperformed the other ML models in both the 3-class and 4-class experiments (i.e., 10-CV accuracy of 94.89% and 93.73%, respectively). Using the Shapely Additive Explanations (SHAP) framework, we employed global and instance-based explanations to explain the behavior of each ML classifier. Moreover, we extended the explainability by implementing the LIME and SHAPASH local explainers. The consistency of these explainers has been explored. The resultant classifiers were accurate, explainable, and thus medically more relevant and applicable. CONCLUSIONS The select modalities and feature sets were confirmed by the literature and medical experts. The various explainers suggest that the bradykinesia (NP3BRADY) feature was the most dominant and consistent. By providing thorough insights into the influence of multiple modalities on the disease risk, the suggested approach is expected to help improve the clinical knowledge of PD progression processes.
Collapse
Affiliation(s)
- Muhammad Junaid
- Information Laboratory (InfoLab), Department of Electrical and Computer Engineering, Sungkyunkwan University, Suwon 16419, South Korea.
| | - Sajid Ali
- Information Laboratory (InfoLab), Department of Electrical and Computer Engineering, Sungkyunkwan University, Suwon 16419, South Korea.
| | - Fatma Eid
- Technology Management, Stony Brook University, New York 11794, USA.
| | - Shaker El-Sappagh
- Information Laboratory (InfoLab), College of Computing and Informatics, Sungkyunkwan University, Suwon 16419, South Korea; Faculty of Computer Science and Engineering, Galala University, Suez 435611, Egypt; Information Systems Department, Faculty of Computers and Artificial Intelligence, Benha University, Banha, 13518, Egypt.
| | - Tamer Abuhmed
- Information Laboratory (InfoLab), College of Computing and Informatics, Sungkyunkwan University, Suwon 16419, South Korea.
| |
Collapse
|
24
|
Altmeyer K, Barz M, Lauer L, Peschel M, Sonntag D, Brünken R, Malone S. Digital ink and differentiated subjective ratings for cognitive load measurement in middle childhood. BRITISH JOURNAL OF EDUCATIONAL PSYCHOLOGY 2023:e12595. [PMID: 36967475 DOI: 10.1111/bjep.12595] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/17/2022] [Revised: 02/15/2023] [Accepted: 02/20/2023] [Indexed: 03/28/2023]
Abstract
BACKGROUND New methods are constantly being developed to adapt cognitive load measurement to different contexts. However, research on middle childhood students' cognitive load measurement is rare. Research indicates that the three cognitive load dimensions (intrinsic, extraneous, and germane) can be measured well in adults and teenagers using differentiated subjective rating instruments. Moreover, digital ink recorded by smartpens could serve as an indicator for cognitive load in adults. AIMS With the present research, we aimed at investigating the relation between subjective cognitive load ratings, velocity and pressure measures recorded with a smartpen, and performance in standardized sketching tasks in middle childhood students. SAMPLE Thirty-six children (age 7-12) participated at the university's laboratory. METHODS The children performed two standardized sketching tasks, each in two versions. The induced intrinsic cognitive load or the extraneous cognitive load was varied between the versions. Digital ink was recorded while the children drew with a smartpen on real paper and after each task, they were asked to report their perceived intrinsic and extraneous cognitive load using a newly developed 5-item scale. RESULTS Results indicated that cognitive load ratings as well as velocity and pressure measures were substantially related to the induced cognitive load and to performance in both sketching tasks. However, cognitive load ratings and smartpen measures were not substantially related. CONCLUSIONS Both subjective rating and digital ink hold potential for cognitive load and performance measurement. However, it is questionable whether they measure the exact same constructs.
Collapse
|
25
|
Singh SK, Chaturvedi A. Leveraging deep feature learning for wearable sensors based handwritten character recognition. Biomed Signal Process Control 2023. [DOI: 10.1016/j.bspc.2022.104198] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/07/2022]
|
26
|
Chai J, Wu R, Li A, Xue C, Qiang Y, Zhao J, Zhao Q, Yang Q. Classification of mild cognitive impairment based on handwriting dynamics and qEEG. Comput Biol Med 2023; 152:106418. [PMID: 36566627 DOI: 10.1016/j.compbiomed.2022.106418] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/25/2022] [Revised: 11/01/2022] [Accepted: 12/10/2022] [Indexed: 12/14/2022]
Abstract
Subtle changes in fine motor control and quantitative electroencephalography (qEEG) in patients with mild cognitive impairment (MCI) are important in screening for early dementia in primary care populations. In this study, an automated, non-invasive and rapid detection protocol for mild cognitive impairment based on handwriting kinetics and quantitative EEG analysis was proposed, and a classification model based on a dual fusion of feature and decision layers was designed for clinical decision-marking. Seventy-nine volunteers (39 healthy elderly controls and 40 patients with mild cognitive impairment) were recruited for this study, and the handwritten data and the EEG signals were performed using a tablet and MUSE under four designed handwriting tasks. Sixty-eight features were extracted from the EEG and handwriting parameters of each test. Features selected from both models were fused using a late feature fusion strategy with a weighted voting strategy for decision making, and classification accuracy was compared using three different classifiers under handwritten features, EEG features and fused features respectively. The results show that the dual fusion model can further improve the classification accuracy, with the highest classification accuracy for the combined features and the best classification result of 96.3% using SVM with RBF kernel as the base classifier. In addition, this not only supports the greater significance of multimodal data for differentiating MCI, but also tests the feasibility of using the portable EEG headband as a measure of EEG in patients with cognitive impairment.
Collapse
Affiliation(s)
- Jiali Chai
- College of Information and Computer, Taiyuan University of Technology, 030000, Taiyuan, Shanxi, China.
| | - Ruixuan Wu
- College of Information and Computer, Taiyuan University of Technology, 030000, Taiyuan, Shanxi, China
| | - Aoyu Li
- College of Information and Computer, Taiyuan University of Technology, 030000, Taiyuan, Shanxi, China
| | - Chen Xue
- College of Information and Computer, Taiyuan University of Technology, 030000, Taiyuan, Shanxi, China
| | - Yan Qiang
- College of Information and Computer, Taiyuan University of Technology, 030000, Taiyuan, Shanxi, China.
| | - Juanjuan Zhao
- College of Information and Computer, Taiyuan University of Technology, 030000, Taiyuan, Shanxi, China; Jinzhong College of Information, 030600, Taiyuan, Shanxi, China
| | - Qinghua Zhao
- College of Information and Computer, Taiyuan University of Technology, 030000, Taiyuan, Shanxi, China
| | - Qianqian Yang
- Jinzhong College of Information, 030600, Taiyuan, Shanxi, China
| |
Collapse
|
27
|
Rana A, Dumka A, Singh R, Panda MK, Priyadarshi N. A Computerized Analysis with Machine Learning Techniques for the Diagnosis of Parkinson's Disease: Past Studies and Future Perspectives. Diagnostics (Basel) 2022; 12:2708. [PMID: 36359550 PMCID: PMC9689408 DOI: 10.3390/diagnostics12112708] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/12/2022] [Revised: 10/30/2022] [Accepted: 11/02/2022] [Indexed: 08/03/2023] Open
Abstract
According to the World Health Organization (WHO), Parkinson's disease (PD) is a neurodegenerative disease of the brain that causes motor symptoms including slower movement, rigidity, tremor, and imbalance in addition to other problems like Alzheimer's disease (AD), psychiatric problems, insomnia, anxiety, and sensory abnormalities. Techniques including artificial intelligence (AI), machine learning (ML), and deep learning (DL) have been established for the classification of PD and normal controls (NC) with similar therapeutic appearances in order to address these problems and improve the diagnostic procedure for PD. In this article, we examine a literature survey of research articles published up to September 2022 in order to present an in-depth analysis of the use of datasets, various modalities, experimental setups, and architectures that have been applied in the diagnosis of subjective disease. This analysis includes a total of 217 research publications with a list of the various datasets, methodologies, and features. These findings suggest that ML/DL methods and novel biomarkers hold promising results for application in medical decision-making, leading to a more methodical and thorough detection of PD. Finally, we highlight the challenges and provide appropriate recommendations on selecting approaches that might be used for subgrouping and connection analysis with structural magnetic resonance imaging (sMRI), DaTSCAN, and single-photon emission computerized tomography (SPECT) data for future Parkinson's research.
Collapse
Affiliation(s)
- Arti Rana
- Computer Science & Engineering, Veer Madho Singh Bhandari Uttarakhand Technical University, Dehradun 248007, Uttarakhand, India
| | - Ankur Dumka
- Department of Computer Science and Engineering, Women Institute of Technology, Dehradun 248007, Uttarakhand, India
- Department of Computer Science & Engineering, Graphic Era Deemed to be University, Dehradun 248001, Uttarakhand, India
| | - Rajesh Singh
- Division of Research and Innovation, Uttaranchal Institute of Technology, Uttaranchal University, Dehradun 248007, Uttarakhand, India
- Department of Project Management, Universidad Internacional Iberoamericana, Campeche 24560, Mexico
| | - Manoj Kumar Panda
- Department of Electrical Engineering, G.B. Pant Institute of Engineering and Technology, Pauri 246194, Uttarakhand, India
| | - Neeraj Priyadarshi
- Department of Electrical Engineering, JIS College of Engineering, Kolkata 741235, West Bengal, India
| |
Collapse
|
28
|
Rana A, Dumka A, Singh R, Panda MK, Priyadarshi N, Twala B. Imperative Role of Machine Learning Algorithm for Detection of Parkinson’s Disease: Review, Challenges and Recommendations. Diagnostics (Basel) 2022; 12:diagnostics12082003. [PMID: 36010353 PMCID: PMC9407112 DOI: 10.3390/diagnostics12082003] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/27/2022] [Revised: 08/08/2022] [Accepted: 08/11/2022] [Indexed: 11/24/2022] Open
Abstract
Parkinson’s disease (PD) is a neurodegenerative disease that affects the neural, behavioral, and physiological systems of the brain. This disease is also known as tremor. The common symptoms of this disease are a slowness of movement known as ‘bradykinesia’, loss of automatic movements, speech/writing changes, and difficulty with walking at early stages. To solve these issues and to enhance the diagnostic process of PD, machine learning (ML) algorithms have been implemented for the categorization of subjective disease and healthy controls (HC) with comparable medical appearances. To provide a far-reaching outline of data modalities and artificial intelligence techniques that have been utilized in the analysis and diagnosis of PD, we conducted a literature analysis of research papers published up until 2022. A total of 112 research papers were included in this study, with an examination of their targets, data sources and different types of datasets, ML algorithms, and associated outcomes. The results showed that ML approaches and new biomarkers have a lot of promise for being used in clinical decision-making, resulting in a more systematic and informed diagnosis of PD. In this study, some major challenges were addressed along with a future recommendation.
Collapse
Affiliation(s)
- Arti Rana
- Computer Science & Engineering, Veer Madho Singh Bhandari Uttarakhand Technical University, Dehradun 248007, Uttarakhand, India
| | - Ankur Dumka
- Department of Computer Science and Engineering, Women Institute of Technology, Uttarakhand Technical University (UTU), Dehradun 248007, Uttarakhand, India
| | - Rajesh Singh
- Division of Research and Innovation, Uttaranchal Institute of Technology, Uttaranchal University, Dehradun 248007, Uttarakhand, India
- Department of Project Management, Universidad Internacional Iberoamericana, Campeche 24560, Mexico
| | - Manoj Kumar Panda
- Department of Electrical Engineering, G.B. Pant Institute of Engineering and Technology, Pauri 246194, Uttarakhand, India
| | - Neeraj Priyadarshi
- Department of Electrical Engineering, JIS College of Engineering, Kolkata 741235, West Bengal, India
| | - Bhekisipho Twala
- Digital Transformation Portfolio, Tshwane University of Technology, Staatsartillerie Rd, Pretoria West, Pretoria 0183, South Africa
- Correspondence:
| |
Collapse
|
29
|
On Extracting Digitized Spiral Dynamics’ Representations: A Study on Transfer Learning for Early Alzheimer’s Detection. Bioengineering (Basel) 2022; 9:bioengineering9080375. [PMID: 36004900 PMCID: PMC9404815 DOI: 10.3390/bioengineering9080375] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/09/2022] [Revised: 08/01/2022] [Accepted: 08/05/2022] [Indexed: 11/17/2022] Open
Abstract
This work proposes a decision-aid tool for detecting Alzheimer’s disease (AD) at an early stage, based on the Archimedes spiral, executed on a Wacom digitizer. Our work assesses the potential of the task as a dynamic gesture and defines the most pertinent methodology for exploiting transfer learning to compensate for sparse data. We embed directly in spiral trajectory images, kinematic time functions. With transfer learning, we perform automatic feature extraction on such images. Experiments on 30 AD patients and 45 healthy controls (HC) show that the extracted features allow a significant improvement in sensitivity and accuracy, compared to raw images. We study at which level of the deep network features have the highest discriminant capabilities. Results show that intermediate-level features are the best for our specific task. Decision fusion of experts trained on such descriptors outperforms low-level fusion of hybrid images. When fusing decisions of classifiers trained on the best features, from pressure, altitude, and velocity images, we obtain 84% of sensitivity and 81.5% of accuracy, achieving an absolute improvement of 22% in sensitivity and 7% in accuracy. We demonstrate the potential of the spiral task for AD detection and give a complete methodology based on off-the-shelf features.
Collapse
|
30
|
Early diagnosis of Parkinson's disease using Continuous Convolution Network: Handwriting recognition based on off-line hand drawing without template. J Biomed Inform 2022; 130:104085. [DOI: 10.1016/j.jbi.2022.104085] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/20/2021] [Revised: 03/18/2022] [Accepted: 04/25/2022] [Indexed: 11/21/2022]
|
31
|
Galaz Z, Drotar P, Mekyska J, Gazda M, Mucha J, Zvoncak V, Smekal Z, Faundez-Zanuy M, Castrillon R, Orozco-Arroyave JR, Rapcsak S, Kincses T, Brabenec L, Rektorova I. Comparison of CNN-Learned vs. Handcrafted Features for Detection of Parkinson's Disease Dysgraphia in a Multilingual Dataset. Front Neuroinform 2022; 16:877139. [PMID: 35722168 PMCID: PMC9198652 DOI: 10.3389/fninf.2022.877139] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/16/2022] [Accepted: 04/19/2022] [Indexed: 11/13/2022] Open
Abstract
Parkinson's disease dysgraphia (PDYS), one of the earliest signs of Parkinson's disease (PD), has been researched as a promising biomarker of PD and as the target of a noninvasive and inexpensive approach to monitoring the progress of the disease. However, although several approaches to supportive PDYS diagnosis have been proposed (mainly based on handcrafted features (HF) extracted from online handwriting or the utilization of deep neural networks), it remains unclear which approach provides the highest discrimination power and how these approaches can be transferred between different datasets and languages. This study aims to compare classification performance based on two types of features: features automatically extracted by a pretrained convolutional neural network (CNN) and HF designed by human experts. Both approaches are evaluated on a multilingual dataset collected from 143 PD patients and 151 healthy controls in the Czech Republic, United States, Colombia, and Hungary. The subjects performed the spiral drawing task (SDT; a language-independent task) and the sentence writing task (SWT; a language-dependent task). Models based on logistic regression and gradient boosting were trained in several scenarios, specifically single language (SL), leave one language out (LOLO), and all languages combined (ALC). We found that the HF slightly outperformed the CNN-extracted features in all considered evaluation scenarios for the SWT. In detail, the following balanced accuracy (BACC) scores were achieved: SL—0.65 (HF), 0.58 (CNN); LOLO—0.65 (HF), 0.57 (CNN); and ALC—0.69 (HF), 0.66 (CNN). However, in the case of the SDT, features extracted by a CNN provided competitive results: SL—0.66 (HF), 0.62 (CNN); LOLO—0.56 (HF), 0.54 (CNN); and ALC—0.60 (HF), 0.60 (CNN). In summary, regarding the SWT, the HF outperformed the CNN-extracted features over 6% (mean BACC of 0.66 for HF, and 0.60 for CNN). In the case of the SDT, both feature sets provided almost identical classification performance (mean BACC of 0.60 for HF, and 0.58 for CNN).
Collapse
Affiliation(s)
- Zoltan Galaz
- Department of Telecommunications, Brno University of Technology, Brno, Czechia
| | - Peter Drotar
- Intelligent Information Systems Laboratory, Faculty of Electrical Engineering and Informatics, Technical University of Kosice, Košice, Slovakia
| | - Jiri Mekyska
- Department of Telecommunications, Brno University of Technology, Brno, Czechia
| | - Matej Gazda
- Intelligent Information Systems Laboratory, Faculty of Electrical Engineering and Informatics, Technical University of Kosice, Košice, Slovakia
| | - Jan Mucha
- Department of Telecommunications, Brno University of Technology, Brno, Czechia
| | - Vojtech Zvoncak
- Department of Telecommunications, Brno University of Technology, Brno, Czechia
| | - Zdenek Smekal
- Department of Telecommunications, Brno University of Technology, Brno, Czechia
| | | | - Reinel Castrillon
- Faculty of Engineering, Universidad de Antioquia—UdeA, Medellín, Colombia
- Faculty of Engineering, Universidad Católica de Oriente, Rionegro, Colombia
| | - Juan Rafael Orozco-Arroyave
- Faculty of Engineering, Universidad de Antioquia—UdeA, Medellín, Colombia
- Pattern Recognition Lab, Friedrich-Alexander-Universität, Erlangen, Germany
| | - Steven Rapcsak
- Department of Neurology, College of Medicine, University of Arizona, Tucson, AZ, United States
| | - Tamas Kincses
- Department of Neurology, University of Szeged, Szeged, Hungary
| | - Lubos Brabenec
- Applied Neuroscience Research Group, Central European Institute of Technology—CEITEC, Masaryk University, Brno, Czechia
| | - Irena Rektorova
- Applied Neuroscience Research Group, Central European Institute of Technology—CEITEC, Masaryk University, Brno, Czechia
- First Department of Neurology, Faculty of Medicine and St. Anne's University Hospital, Masaryk University, Brno, Czechia
- *Correspondence: Irena Rektorova
| |
Collapse
|
32
|
Valla E, Nõmm S, Medijainen K, Taba P, Toomela A. Tremor-related feature engineering for machine learning based Parkinson’s disease diagnostics. Biomed Signal Process Control 2022. [DOI: 10.1016/j.bspc.2022.103551] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/22/2023]
|
33
|
Moetesum M, Diaz M, Masroor U, Siddiqi I, Vessio G. A survey of visual and procedural handwriting analysis for neuropsychological assessment. Neural Comput Appl 2022. [DOI: 10.1007/s00521-022-07185-6] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/25/2023]
Abstract
AbstractTo date, Artificial Intelligence systems for handwriting and drawing analysis have primarily targeted domains such as writer identification and sketch recognition. Conversely, the automatic characterization of graphomotor patterns as biomarkers of brain health is a relatively less explored research area. Despite its importance, the work done in this direction is limited and sporadic. This paper aims to provide a survey of related work to provide guidance to novice researchers and highlight relevant study contributions. The literature has been grouped into “visual analysis techniques” and “procedural analysis techniques”. Visual analysis techniques evaluate offline samples of a graphomotor response after completion. On the other hand, procedural analysis techniques focus on the dynamic processes involved in producing a graphomotor reaction. Since the primary goal of both families of strategies is to represent domain knowledge effectively, the paper also outlines the commonly employed handwriting representation and estimation methods presented in the literature and discusses their strengths and weaknesses. It also highlights the limitations of existing processes and the challenges commonly faced when designing such systems. High-level directions for further research conclude the paper.
Collapse
|
34
|
Chen X, Jin W, Wu Q, Zhang W, Liang H. A hybrid cost-sensitive machine learning approach for the classification of intelligent disease diagnosis. JOURNAL OF INTELLIGENT & FUZZY SYSTEMS 2022. [DOI: 10.3233/jifs-213486] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/15/2022]
Abstract
Automatic risk classification of diseases is one of the most significant health problems in medical and healthcare domain. However, the related studies are relative scarce. In this paper, we design an intelligent diagnosis model based on optimal machine learning algorithms with rich clinical data. First, the disease risk classification problem based on machine learning is defined. Then, the K-means clustering algorithm is used to validate the class label of given data, thereby removing misclassified instances from the original dataset. Furthermore, naive Bayesian algorithm is applied to build the final classifier by using 10-fold cross-validation method. In addition, a novel class-specific attribute weighted approach is adopted to alleviate the conditional independence assumption of naive Bayes, which means we assign each disease attribute a specific weight for each class. Last but not least, a hybrid cost-sensitive disease risk classification model is formulated, and a practical example from the University of California Irvine (UCI) machine learning database is used to illustrate the potential of the proposed method. Experimental results demonstrate that the approach is competitive with the state-of-the-art classifiers.
Collapse
Affiliation(s)
- Xi Chen
- School of Economics & Management, Xidian University, Xi’an, China
| | - Wenquan Jin
- School of Economics & Management, Xidian University, Xi’an, China
| | - Qirui Wu
- School of Foreign Languages, Xidian University, China
| | - Wenbo Zhang
- School of Economics & Management, Xidian University, Xi’an, China
| | | |
Collapse
|
35
|
Automated methods for diagnosis of Parkinson’s disease and predicting severity level. Neural Comput Appl 2022. [DOI: 10.1007/s00521-021-06626-y] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/18/2022]
|
36
|
Fröhlich H, Bontridder N, Petrovska-Delacréta D, Glaab E, Kluge F, Yacoubi ME, Marín Valero M, Corvol JC, Eskofier B, Van Gyseghem JM, Lehericy S, Winkler J, Klucken J. Leveraging the Potential of Digital Technology for Better Individualized Treatment of Parkinson's Disease. Front Neurol 2022; 13:788427. [PMID: 35295840 PMCID: PMC8918525 DOI: 10.3389/fneur.2022.788427] [Citation(s) in RCA: 15] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/02/2021] [Accepted: 01/31/2022] [Indexed: 12/18/2022] Open
Abstract
Recent years have witnessed a strongly increasing interest in digital technology within medicine (sensor devices, specific smartphone apps) and specifically also neurology. Quantitative measures derived from digital technology could provide Digital Biomarkers (DMs) enabling a quantitative and continuous monitoring of disease symptoms, also outside clinics. This includes the possibility to continuously and sensitively monitor the response to treatment, hence opening the opportunity to adapt medication pathways quickly. In addition, DMs may in the future allow early diagnosis, stratification of patient subgroups and prediction of clinical outcomes. Thus, DMs could complement or in certain cases even replace classical examiner-based outcome measures and molecular biomarkers measured in cerebral spinal fluid, blood, urine, saliva, or other body liquids. Altogether, DMs could play a prominent role in the emerging field of precision medicine. However, realizing this vision requires dedicated research. First, advanced data analytical methods need to be developed and applied, which extract candidate DMs from raw signals. Second, these candidate DMs need to be validated by (a) showing their correlation to established clinical outcome measures, and (b) demonstrating their diagnostic and/or prognostic value compared to established biomarkers. These points again require the use of advanced data analytical methods, including machine learning. In addition, the arising ethical, legal and social questions associated with the collection and processing of sensitive patient data and the use of machine learning methods to analyze these data for better individualized treatment of the disease, must be considered thoroughly. Using Parkinson's Disease (PD) as a prime example of a complex multifactorial disorder, the purpose of this article is to critically review the current state of research regarding the use of DMs, discuss open challenges and highlight emerging new directions.
Collapse
Affiliation(s)
- Holger Fröhlich
- Department of Bioinformatics, Fraunhofer Institute for Algorithms and Scientific Computing, Sankt Augustin, Germany
- Bonn-Aachen International Center for IT (b-it), University of Bonn, Bonn, Germany
| | - Noémi Bontridder
- Centre de Recherches Information, Droit et Societe, University of Namur, Namur, Belgium
| | | | - Enrico Glaab
- Luxembourg Center for Systems Medicine, University of Luxembourg, Esch, Luxembourg
| | - Felix Kluge
- Department of Artificial Intelligence in Biomedical Engineering, University of Erlangen Nuremberg, Erlangen, Germany
| | | | | | | | - Bjoern Eskofier
- Department of Artificial Intelligence in Biomedical Engineering, University of Erlangen Nuremberg, Erlangen, Germany
| | | | | | - Jürgen Winkler
- Department of Neurology, University Hospital Erlangen, Erlangen, Germany
| | - Jochen Klucken
- Luxembourg Center for Systems Medicine, University of Luxembourg, Esch, Luxembourg
| |
Collapse
|
37
|
Dehghanpur Deharab E, Ghaderyan P. Graphical representation and variability quantification of handwriting signals: New tools for Parkinson’s disease detection. Biocybern Biomed Eng 2022. [DOI: 10.1016/j.bbe.2021.12.007] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/02/2022]
|
38
|
Alissa M, Lones MA, Cosgrove J, Alty JE, Jamieson S, Smith SL, Vallejo M. Parkinson’s disease diagnosis using convolutional neural networks and figure-copying tasks. Neural Comput Appl 2022. [DOI: 10.1007/s00521-021-06469-7] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/29/2022]
Abstract
AbstractParkinson’s disease (PD) is a progressive neurodegenerative disorder that causes abnormal movements and an array of other symptoms. An accurate PD diagnosis can be a challenging task as the signs and symptoms, particularly at an early stage, can be similar to other medical conditions or the physiological changes of normal ageing. This work aims to contribute to the PD diagnosis process by using a convolutional neural network, a type of deep neural network architecture, to differentiate between healthy controls and PD patients. Our approach focuses on discovering deviations in patient’s movements with the use of drawing tasks. In addition, this work explores which of two drawing tasks, wire cube or spiral pentagon, are more effective in the discrimination process. With $$93.5\%$$
93.5
%
accuracy, our convolutional classifier, trained with images of the pentagon drawing task and augmentation techniques, can be used as an objective method to discriminate PD from healthy controls. Our compact model has the potential to be developed into an offline real-time automated single-task diagnostic tool, which can be easily deployed within a clinical setting.
Collapse
|
39
|
Guven Z, Atasavun Uysal S. Kinematic analysis of handwriting movements and pencil grip patterns in children with low vision. Hum Mov Sci 2021; 81:102907. [PMID: 34856452 DOI: 10.1016/j.humov.2021.102907] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/10/2020] [Revised: 11/02/2021] [Accepted: 11/16/2021] [Indexed: 11/24/2022]
Abstract
PURPOSE Handwriting skills are important for the academic life of children and the lack of visual-motor performance leads to writing problems in children with low vision. This study aims to reveal handwriting kinematics and pencil grip features in children with low vision by means of a novel method. MATERIALS AND METHODS 18 children with low vision (mean age: 9.83 ± 1.54 years) and 18 children with typical development (mean age: 9.83 ± 1.62 years) were included in the study. Children performed a sentence writing task on a digitizer tablet. During the task, the writing hand of children was photographed to analyze pencil grip patterns. RESULTS Children with low vision performed greater stroke size except for the vertical size, slower writing speed, more dysfluent movements, and less pen pressure than children with typical development. However, participants preferred mature pencil grip patterns and had high grip scores independent from the diagnosis. CONCLUSIONS The findings indicate that children with low vision have difficulties in handwriting in terms of spatial and temporal features. These results would be important for interventions to develop specific programs on writing skills to support their educational life.
Collapse
Affiliation(s)
- Zeynep Guven
- Faculty of Physical Therapy and Rehabilitation, Hacettepe University, Turkey.
| | | |
Collapse
|
40
|
Nachum R, Jackson K, Duric Z, Gerber L. A Novel Computer Vision Approach to Kinematic Analysis of Handwriting with Implications for Assessing Neurodegenerative Diseases. ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. ANNUAL INTERNATIONAL CONFERENCE 2021; 2021:1309-1313. [PMID: 34891526 DOI: 10.1109/embc46164.2021.9630492] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/14/2023]
Abstract
Fine motor movement is a demonstrated biomarker for many health conditions that are especially difficult to diagnose early and require sensitivity to change in order to monitor over time. This is particularly relevant for neurodegenerative diseases (NDs), including Parkinson's Disease (PD) and Alzheimer's Disease (AD), which are associated with early changes in handwriting and fine motor skills. Kinematic analysis of handwriting is an emerging method for assessing fine motor movement ability, with data typically collected by digitizing tablets; however, these are often expensive, unfamiliar to patients, and are limited in the scope of collectible data. In this paper, we present a vision-based system for the capture and analysis of handwriting kinematics using a commodity camera and RGB video. We achieve writing position estimation within 0.5 mm and speed and acceleration errors of less than 1.1%. We further demonstrate that this data collection process can be part of an ND screening system with a developed ensemble classifier achieving 74% classification accuracy of Parkinson's Disease patients with vision-based data. Overall, we demonstrate that this approach is an accurate, accessible, and informative alternative to digitizing tablets and with further validation has potential uses in early disease screening and long-term monitoring.Clinical relevance- This work establishes a more accessible alternative to digitizing tablets for extracting handwriting kinematic data through processing of RGB video data captured by commodity cameras, such as those in smartphones, with computer vision and machine learning. The collected data has potential for use in analysis to objectively and quantitatively differentiate between healthy individuals and patients with NDs, including AD and PD, as well as other diseases with biomarkers displayed in fine motor movement. The developed system has potential applications including providing widespread screening systems for NDs in low-income areas and resource-poor health systems, as well as an accessible form of disease long-term monitoring through telemedicine.
Collapse
|
41
|
Loh HW, Hong W, Ooi CP, Chakraborty S, Barua PD, Deo RC, Soar J, Palmer EE, Acharya UR. Application of Deep Learning Models for Automated Identification of Parkinson's Disease: A Review (2011-2021). SENSORS 2021; 21:s21217034. [PMID: 34770340 PMCID: PMC8587636 DOI: 10.3390/s21217034] [Citation(s) in RCA: 17] [Impact Index Per Article: 4.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 09/20/2021] [Revised: 10/07/2021] [Accepted: 10/19/2021] [Indexed: 12/18/2022]
Abstract
Parkinson’s disease (PD) is the second most common neurodegenerative disorder affecting over 6 million people globally. Although there are symptomatic treatments that can increase the survivability of the disease, there are no curative treatments. The prevalence of PD and disability-adjusted life years continue to increase steadily, leading to a growing burden on patients, their families, society and the economy. Dopaminergic medications can significantly slow down the progression of PD when applied during the early stages. However, these treatments often become less effective with the disease progression. Early diagnosis of PD is crucial for immediate interventions so that the patients can remain self-sufficient for the longest period of time possible. Unfortunately, diagnoses are often late, due to factors such as a global shortage of neurologists skilled in early PD diagnosis. Computer-aided diagnostic (CAD) tools, based on artificial intelligence methods, that can perform automated diagnosis of PD, are gaining attention from healthcare services. In this review, we have identified 63 studies published between January 2011 and July 2021, that proposed deep learning models for an automated diagnosis of PD, using various types of modalities like brain analysis (SPECT, PET, MRI and EEG), and motion symptoms (gait, handwriting, speech and EMG). From these studies, we identify the best performing deep learning model reported for each modality and highlight the current limitations that are hindering the adoption of such CAD tools in healthcare. Finally, we propose new directions to further the studies on deep learning in the automated detection of PD, in the hopes of improving the utility, applicability and impact of such tools to improve early detection of PD globally.
Collapse
Affiliation(s)
- Hui Wen Loh
- School of Science and Technology, Singapore University of Social Sciences, Singapore 599494, Singapore
| | - Wanrong Hong
- Cogninet Brain Team, Cogninet Australia, Sydney, NSW 2010, Australia
| | - Chui Ping Ooi
- School of Science and Technology, Singapore University of Social Sciences, Singapore 599494, Singapore
| | - Subrata Chakraborty
- Faculty of Engineering and Information Technology, University of Technology Sydney, Sydney, NSW 2007, Australia
| | - Prabal Datta Barua
- Cogninet Brain Team, Cogninet Australia, Sydney, NSW 2010, Australia
- Faculty of Engineering and Information Technology, University of Technology Sydney, Sydney, NSW 2007, Australia
- School of Business (Information Systems), Faculty of Business, Education, Law & Arts, University of Southern Queensland, Toowoomba, QLD 4350, Australia
| | - Ravinesh C Deo
- School of Sciences, University of Southern Queensland, Springfield, QLD 4300, Australia
| | - Jeffrey Soar
- School of Business (Information Systems), Faculty of Business, Education, Law & Arts, University of Southern Queensland, Toowoomba, QLD 4350, Australia
| | - Elizabeth E Palmer
- Centre of Clinical Genetics, Sydney Children's Hospitals Network, Randwick, NSW 2031, Australia
- School of Women's and Children's Health, University of New South Wales, Randwick, NSW 2031, Australia
| | - U Rajendra Acharya
- School of Science and Technology, Singapore University of Social Sciences, Singapore 599494, Singapore
- School of Business (Information Systems), Faculty of Business, Education, Law & Arts, University of Southern Queensland, Toowoomba, QLD 4350, Australia
- School of Engineering, Ngee Ann Polytechnic, Singapore 599489, Singapore
- Department of Bioinformatics and Medical Engineering, Asia University, Taichung 413, Taiwan
- Research Organization for Advanced Science and Technology (IROAST), Kumamoto University, Kumamoto 860-8555, Japan
| |
Collapse
|
42
|
Fratello M, Cordella F, Albani G, Veneziano G, Marano G, Paffi A, Pallotti A. Classification-Based Screening of Parkinson’s Disease Patients through Graph and Handwriting Signals. THE 2ND INTERNATIONAL ELECTRONIC CONFERENCE ON APPLIED SCIENCES 2021:49. [DOI: 10.3390/asec2021-11128] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 07/25/2024]
Affiliation(s)
- Maria Fratello
- Dipartimento di Scienze di Base e Applicate per l’Ingegneria, Università degli Studi di Roma “La Sapienza”-Piazzale Aldo Moro, 5, 00185 Roma, Italy
- Consorzio Parco Scientifico e Tecnologico Pontino Technoscience, 15, 04100 Latina, Italy
| | - Fulvio Cordella
- Dipartimento di Scienze di Base e Applicate per l’Ingegneria, Università degli Studi di Roma “La Sapienza”-Piazzale Aldo Moro, 5, 00185 Roma, Italy
- Consorzio Parco Scientifico e Tecnologico Pontino Technoscience, 15, 04100 Latina, Italy
| | | | | | - Giuseppe Marano
- AGIF Associazione Grafologica Italo-Francese, 8, 00153 Roma, Italy
- Department of Geriatrics, Neuroscience and Orthopedics, Policlinico Universitario Agostino Gemelli IRCSS, Università Cattolica del Sacro Cuore, 1, 20123 Milano, Italy
| | - Alessandra Paffi
- Centro Interuniversitario sulle Interazioni tra Campi Elettromagnetici e Biosistemi (ICEmB), Università di Genova, 5, 16126 Genova, Italy
- Dipartimento di Ingegneria dell’Informazione, Elettronica e Telecomunicazioni (DIET), Sapienza University of Rome, 5, 00185 Roma, Italy
| | - Antonio Pallotti
- Consorzio Parco Scientifico e Tecnologico Pontino Technoscience, 15, 04100 Latina, Italy
- Dipartimento di Management e Diritto, Università degli Studi di Roma “Tor Vergata”, 50, 00133 Roma, Italy
- Dipartimento di Scienze Umane e Promozione della Qualità della Vita, Università Telematica San Raffaele Roma, 247, 00166 Roma, Italy
| |
Collapse
|
43
|
A dual-branch model for diagnosis of Parkinson’s disease based on the independent and joint features of the left and right gait. APPL INTELL 2021. [DOI: 10.1007/s10489-020-02182-5] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/22/2022]
|
44
|
Online Handwriting, Signature and Touch Dynamics: Tasks and Potential Applications in the Field of Security and Health. Cognit Comput 2021. [DOI: 10.1007/s12559-021-09938-2] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/05/2023]
|
45
|
Screening of Parkinson's Disease Using Geometric Features Extracted from Spiral Drawings. Brain Sci 2021; 11:brainsci11101297. [PMID: 34679363 PMCID: PMC8533717 DOI: 10.3390/brainsci11101297] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/25/2021] [Revised: 09/24/2021] [Accepted: 09/24/2021] [Indexed: 12/23/2022] Open
Abstract
Conventional means of Parkinson’s Disease (PD) screening rely on qualitative tests typically administered by trained neurologists. Tablet technologies that enable data collection during handwriting and drawing tasks may provide low-cost, portable, and instantaneous quantitative methods for high-throughput PD screening. However, past efforts to use data from tablet-based drawing processes to distinguish between PD and control populations have demonstrated only moderate classification ability. Focusing on digitized drawings of Archimedean spirals, the present study utilized data from the open-access ParkinsonHW dataset to improve existing PD drawing diagnostic pipelines. Random forest classifiers were constructed using previously documented features and highly-predictive, newly-proposed features that leverage the many unique mathematical characteristics of the Archimedean spiral. This approach yielded an AUC of 0.999 on the particular dataset we tested on, and more importantly identified interpretable features with good promise for generalization across diverse patient cohorts. It demonstrated the potency of mathematical relationships inherent to the drawing shape and the usefulness of sparse feature sets and simple models, which further enhance interpretability, in the face of limited sample size. The results of this study also inform suggestions for future drawing task design and data analytics (feature extraction, shape selection, task diversity, drawing templates, and data sharing).
Collapse
|
46
|
Yin Z, Geraedts VJ, Wang Z, Contarino MF, Dibeklioglu H, van Gemert J. Assessment of Parkinson's Disease Severity from Videos using Deep Architecture. IEEE J Biomed Health Inform 2021; 26:1164-1176. [PMID: 34310333 DOI: 10.1109/jbhi.2021.3099816] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/06/2022]
Abstract
Parkinson's disease (PD) diagnosis is based on clinical criteria, i.e., bradykinesia, rest tremor, rigidity, etc. Assessment of the severity of PD symptoms with clinical rating scales, however, is subject to inter-rater variability. In this paper, we propose a deep learning based automatic PD diagnosis method using videos to assist the diagnosis in clinical practices. We deploy a 3D Convolutional Neural Network (CNN) as the baseline approach for the PD severity classification and show the effectiveness. Due to the lack of data in clinical field, we explore the possibility of transfer learning from non-medical dataset and show that PD severity classification can benefit from it. To bridge the domain discrepancy between medical and non-medical datasets, we let the network focus more on the subtle temporal visual cues, i.e., the frequency of tremors, by designing a Temporal Self-Attention (TSA) mechanism. Seven tasks from the Movement Disorders Society - Unified PD rating scale (MDS-UPDRS) part III are investigated, which reveal the symptoms of bradykinesia and postural tremors. Furthermore, we propose a multi-domain learning method to predict the patient-level PD severity through task-assembling. We show the effectiveness of TSA and task-assembling method on our PD video dataset empirically. We achieve the best MCC of 0.55 on binary task-level and 0.39 on three-class patient-level classification.
Collapse
|
47
|
Zham P, Poosapadi SA, Kempster P, Raghav S, Nagao KJ, Wong K, Kumar D. Differences in Levodopa Response for Progressive and Non-Progressive Micrographia in Parkinson's Disease. Front Neurol 2021; 12:665112. [PMID: 34046005 PMCID: PMC8147867 DOI: 10.3389/fneur.2021.665112] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/07/2021] [Accepted: 04/09/2021] [Indexed: 11/13/2022] Open
Abstract
Background: Micrographia, one element of the dysgraphia of Parkinson's disease (PD), may be classified according to the presence or absence of a decremental pattern. The decremental form, progressive micrographia, is an expression of the sequence effect seen generally in bradykinesia. Its responsiveness to levodopa has not been evaluated kinematically. Objectives: Aim of this study is to investigate the difference in levodopa response for progressive and non-progressive micrographia. Methods: Twenty-four PD patients and 24 age-matched repeatedly wrote the letter e on a computerized digital tablet. PD patients performed the task two times, in a defined off state and again after levodopa. Scripts were classified as progressive micrographia (PDPM) or non-progressive micrographia (PDNPM) depending on whether a 10% decrement was seen between the first and final characters of a line of lettering. Results: While levodopa produced a similar response on the MDS-UPDRS motor scale for the two groups, the effect on the two types of micrographia was different. While writing speed improved significantly in both groups after levodopa, the responses were over twofold greater for PDNPM. Moreover, the decremental features of PDPM-in size, speed, and pen-pressure-were largely unaltered by a levodopa dose. Conclusions: Progressive micrographia is less responsive to levodopa. Our findings agree with research showing that the sequence effect of bradykinesia is relatively resistant to medication. Yet we did not find a weaker overall levodopa motor benefit. Caution is needed in the interpretation of such micrographia measurements for estimating drug responses.
Collapse
Affiliation(s)
- Poonam Zham
- School of Engineering, RMIT University, Melbourne, VIC, Australia.,IBM Research Australia, Southbank, VIC, Australia
| | - Sridhar A Poosapadi
- School of Engineering, RMIT University, Melbourne, VIC, Australia.,Center for Human Movement Research and Analysis, Department of Electronics and Instrumentation, SRM Institute of Science and Technology, Chennai, India
| | - Peter Kempster
- Department of Medicine, Monash University, Clayton, VIC, Australia.,Neurosciences Department, Monash Medical Centre, Melbourne, VIC, Australia
| | - Sanjay Raghav
- School of Engineering, RMIT University, Melbourne, VIC, Australia.,Neurosciences Department, Monash Medical Centre, Melbourne, VIC, Australia
| | - Kanae J Nagao
- Neurosciences Department, Monash Medical Centre, Melbourne, VIC, Australia
| | - Kitty Wong
- Neurosciences Department, Monash Medical Centre, Melbourne, VIC, Australia
| | - Dinesh Kumar
- School of Engineering, RMIT University, Melbourne, VIC, Australia
| |
Collapse
|
48
|
Mei J, Desrosiers C, Frasnelli J. Machine Learning for the Diagnosis of Parkinson's Disease: A Review of Literature. Front Aging Neurosci 2021; 13:633752. [PMID: 34025389 PMCID: PMC8134676 DOI: 10.3389/fnagi.2021.633752] [Citation(s) in RCA: 102] [Impact Index Per Article: 25.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/26/2020] [Accepted: 03/22/2021] [Indexed: 12/26/2022] Open
Abstract
Diagnosis of Parkinson's disease (PD) is commonly based on medical observations and assessment of clinical signs, including the characterization of a variety of motor symptoms. However, traditional diagnostic approaches may suffer from subjectivity as they rely on the evaluation of movements that are sometimes subtle to human eyes and therefore difficult to classify, leading to possible misclassification. In the meantime, early non-motor symptoms of PD may be mild and can be caused by many other conditions. Therefore, these symptoms are often overlooked, making diagnosis of PD at an early stage challenging. To address these difficulties and to refine the diagnosis and assessment procedures of PD, machine learning methods have been implemented for the classification of PD and healthy controls or patients with similar clinical presentations (e.g., movement disorders or other Parkinsonian syndromes). To provide a comprehensive overview of data modalities and machine learning methods that have been used in the diagnosis and differential diagnosis of PD, in this study, we conducted a literature review of studies published until February 14, 2020, using the PubMed and IEEE Xplore databases. A total of 209 studies were included, extracted for relevant information and presented in this review, with an investigation of their aims, sources of data, types of data, machine learning methods and associated outcomes. These studies demonstrate a high potential for adaptation of machine learning methods and novel biomarkers in clinical decision making, leading to increasingly systematic, informed diagnosis of PD.
Collapse
Affiliation(s)
- Jie Mei
- Chemosensory Neuroanatomy Lab, Department of Anatomy, Université du Québec à Trois-Rivières (UQTR), Trois-Rivières, QC, Canada
| | - Christian Desrosiers
- Laboratoire d'Imagerie, de Vision et d'Intelligence Artificielle (LIVIA), Department of Software and IT Engineering, École de Technologie Supérieure, Montreal, QC, Canada
| | - Johannes Frasnelli
- Chemosensory Neuroanatomy Lab, Department of Anatomy, Université du Québec à Trois-Rivières (UQTR), Trois-Rivières, QC, Canada
- Centre de Recherche de l'Hôpital du Sacré-Coeur de Montréal, Centre Intégré Universitaire de Santé et de Services Sociaux du Nord-de-l'Île-de-Montréal (CIUSSS du Nord-de-l'Île-de-Montréal), Montreal, QC, Canada
| |
Collapse
|
49
|
De Vleeschhauwer J, Broeder S, Janssens L, Heremans E, Nieuwboer A, Nackaerts E. Impaired Touchscreen Skills in Parkinson's Disease and Effects of Medication. Mov Disord Clin Pract 2021; 8:546-554. [PMID: 33981787 PMCID: PMC8088105 DOI: 10.1002/mdc3.13179] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/12/2020] [Revised: 01/16/2021] [Accepted: 02/10/2021] [Indexed: 01/17/2023] Open
Abstract
BACKGROUND Deficits in fine motor skills may impair device manipulation including touchscreens in people with Parkinson's disease (PD). OBJECTIVES To investigate the impact of PD and anti-parkinsonian medication on the ability to use touchscreens. METHODS Twelve PD patients (H&Y II-III), OFF and ON medication, and 12 healthy controls (HC) performed tapping, single and multi-direction sliding tasks on a touchscreen and a mobile phone task (MPT). Task performance was compared between patients (PD-OFF, PD-ON) and HC and between medication conditions. RESULTS Significant differences were found in touchscreen timing parameters, while accuracy was comparable between groups. PD-OFF needed more time than HC to perform single (P = 0.048) and multi-direction (P = 0.004) sliding tasks and to grab the dot before sliding (i.e., transition times) (P = 0.040; P = 0.004). For tapping, dopaminergic medication significantly increased performance times (P = 0.046) to comparable levels as those of HC. However, for the more complex multi-direction sliding, movement times remained slower in PD than HC irrespective of medication intake (P < 0.050 during ON and OFF). The transition times for the multi-direction sliding task was also higher in PD-ON than HC (P = 0.048). Touchscreen parameters significantly correlated with MPT performance, supporting the ecological validity of the touchscreen tool. CONCLUSIONS PD patients show motor problems when manipulating touchscreens, even when optimally medicated. This hinders using mobile technology in daily life and has implications for developing adequate E-health applications for this group. Future work needs to establish whether touchscreen training is effective in PD.
Collapse
Affiliation(s)
- Joni De Vleeschhauwer
- KU Leuven, Department of Rehabilitation SciencesResearch Group for Neurorehabilitation (eNRGy)LeuvenBelgium
| | - Sanne Broeder
- KU Leuven, Department of Rehabilitation SciencesResearch Group for Neurorehabilitation (eNRGy)LeuvenBelgium
| | - Luc Janssens
- KU Leuven, Group T Campus, Electrical Engineering Technology (ESAT)LeuvenBelgium
| | - Elke Heremans
- Faculty of Rehabilitation SciencesHasselt University, REVALDiepenbeekBelgium
| | - Alice Nieuwboer
- KU Leuven, Department of Rehabilitation SciencesResearch Group for Neurorehabilitation (eNRGy)LeuvenBelgium
| | - Evelien Nackaerts
- KU Leuven, Department of Rehabilitation SciencesResearch Group for Neurorehabilitation (eNRGy)LeuvenBelgium
| |
Collapse
|
50
|
Tăuţan AM, Ionescu B, Santarnecchi E. Artificial intelligence in neurodegenerative diseases: A review of available tools with a focus on machine learning techniques. Artif Intell Med 2021; 117:102081. [PMID: 34127244 DOI: 10.1016/j.artmed.2021.102081] [Citation(s) in RCA: 40] [Impact Index Per Article: 10.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/14/2020] [Revised: 02/21/2021] [Accepted: 04/26/2021] [Indexed: 10/21/2022]
Abstract
Neurodegenerative diseases have shown an increasing incidence in the older population in recent years. A significant amount of research has been conducted to characterize these diseases. Computational methods, and particularly machine learning techniques, are now very useful tools in helping and improving the diagnosis as well as the disease monitoring process. In this paper, we provide an in-depth review on existing computational approaches used in the whole neurodegenerative spectrum, namely for Alzheimer's, Parkinson's, and Huntington's Diseases, Amyotrophic Lateral Sclerosis, and Multiple System Atrophy. We propose a taxonomy of the specific clinical features, and of the existing computational methods. We provide a detailed analysis of the various modalities and decision systems employed for each disease. We identify and present the sleep disorders which are present in various diseases and which represent an important asset for onset detection. We overview the existing data set resources and evaluation metrics. Finally, we identify current remaining open challenges and discuss future perspectives.
Collapse
Affiliation(s)
- Alexandra-Maria Tăuţan
- University "Politehnica" of Bucharest, Splaiul Independenţei 313, 060042 Bucharest, Romania.
| | - Bogdan Ionescu
- University "Politehnica" of Bucharest, Splaiul Independenţei 313, 060042 Bucharest, Romania.
| | - Emiliano Santarnecchi
- Berenson-Allen Center for Noninvasive Brain Stimulation, Harvard Medical School, 330 Brookline Avenue, Boston, United States.
| |
Collapse
|