Classification of exercise fatigue levels by multi-class SVM from ECG and HRV

Among the various physiological signals, electrocardiogram (ECG) is a valid criterion for the classification of various exercise fatigue. In this study, we combine features extracted by deep neural networks with linear features from ECG and heart rate variability (HRV) for exercise fatigue classification. First, the ECG signals are converted into 2-D images by using the short-term Fourier transform (STFT), and image features are extracted by the visual geometry group (VGG) . The extracted image and linear features of ECG and HRV are sent to the different types of classifiers to distinguish distinct exercise fatigue level. To validate performance, the proposed methods are tested on (i) an open-source EPHNOGRAM dataset and (ii) a self-collected dataset (n = 51). The results reveal that the classification based on the concatenated features has the highest accuracy, and the calculation time of the system is also significantly reduced. This demonstrates that the proposed novel hybrid approach can be used to assist in improving the accuracy and timeliness of exercise fatigue classification in a real-time exercise environment. The experimental results show that the proposed method outperforms other recent state-of-the-art methods in terms of accuracy 96.90%, sensitivity 96.90%, F1-score of 0.9687 in EPHNOGRAM and accuracy 92.17%, sensitivity 92.63%, F1-score of 0.9213 in self-collected dataset.

Enhancing Stress Detection: A Comprehensive Approach through rPPG Analysis and Deep Learning Techniques

Stress has emerged as a major concern in modern society, significantly impacting human health and well-being. Statistical evidence underscores the extensive social influence of stress, especially in terms of work-related stress and associated healthcare costs. This paper addresses the critical need for accurate stress detection, emphasising its far-reaching effects on health and social dynamics. Focusing on remote stress monitoring, it proposes an efficient deep learning approach for stress detection from facial videos. In contrast to the research on wearable devices, this paper proposes novel Hybrid Deep Learning (DL) networks for stress detection based on remote photoplethysmography (rPPG), employing (Long Short-Term Memory (LSTM), Gated Recurrent Units (GRU), 1D Convolutional Neural Network (1D-CNN)) models with hyperparameter optimisation and augmentation techniques to enhance performance. The proposed approach yields a substantial improvement in accuracy and efficiency in stress detection, achieving up to 95.83% accuracy with the UBFC-Phys dataset while maintaining excellent computational efficiency. The experimental results demonstrate the effectiveness of the proposed Hybrid DL models for rPPG-based-stress detection.

SLAPP: Subgraph-level attention-based performance prediction for deep learning models

The intricacy of the Deep Learning (DL) landscape, brimming with a variety of models, applications, and platforms, poses considerable challenges for the optimal design, optimization, or selection of suitable DL models. One promising avenue to address this challenge is the development of accurate performance prediction methods. However, existing methods reveal critical limitations. Operator-level methods, proficient at predicting the performance of individual operators, often neglect broader graph features, which results in inaccuracies in full network performance predictions. On the contrary, graph-level methods excel in overall network prediction by leveraging these graph features but lack the ability to predict the performance of individual operators. To bridge these gaps, we propose SLAPP, a novel subgraph-level performance prediction method. Central to SLAPP is an innovative variant of Graph Neural Networks (GNNs) that we developed, named the Edge Aware Graph Attention Network (EAGAT). This specially designed GNN enables superior encoding of both node and edge features. Through this approach, SLAPP effectively captures both graph and operator features, thereby providing precise performance predictions for individual operators and entire networks. Moreover, we introduce a mixed loss design with dynamic weight adjustment to reconcile the predictive accuracy between individual operators and entire networks. In our experimental evaluation, SLAPP consistently outperforms traditional approaches in prediction accuracy, including the ability to handle unseen models effectively. Moreover, when compared to existing research, our method demonstrates a superior predictive performance across multiple DL models.

A Review on Imaging Techniques and Artificial Intelligence Models for Osteoporosis Prediction

Osteoporosis causes harmful influences on both men and women of all races. Bone mass, also referred to as "bone density," is frequently used to assess the health of bone. Humans frequently experience bone fractures as a result of trauma, accidents, metabolic bone diseases, and disorders of bone strength, which are typically led by changes in mineral composition and result in conditions like osteoporosis, osteoarthritis, osteopenia, etc. Artificial intelligence holds a lot of promise for the healthcare system. Data collection and preprocessing seem to be more essential for analysis, so bone images from different modalities, such as X-ray, Computed Tomography (CT), and Magnetic Resonance Imaging (MRI), are taken into consideration that help to recognize, classify, and evaluate the patterns in clinical images. This research presents a comprehensive overview of the performance of various image processing techniques and deep learning approaches used to predict osteoporosis through image segmentation, classification, and fault detection. This survey outlined the proposed domain-based deep learning model for image classification in addition to the initial findings. The outcome identifies the flaws in the existing literature's methodology and lays the way for future work in the deep learning-based image analysis model.

Exploring the effects of pandemics on transportation through correlations and deep learning techniques

The COVID-19 pandemic has had a significant impact on human migration worldwide, affecting transportation patterns in cities. Many cities have issued "stay-at-home" orders during the outbreak, causing commuters to change their usual modes of transportation. For example, some transit/bus passengers have switched to driving or car-sharing. As a result, urban traffic congestion patterns have changed dramatically, and understanding these changes is crucial for effective emergency traffic management and control efforts. While previous studies have focused on natural disasters or major accidents, only a few have examined pandemic-related traffic congestion patterns. This paper uses correlations and machine learning techniques to analyze the relationship between COVID-19 and transportation. The authors simulated traffic models for five different networks and proposed a Traffic Prediction Technique (TPT), which includes an Impact Calculation Methodology that uses Pearson's Correlation Coefficient and Linear Regression, as well as a Traffic Prediction Module (TPM). The paper's main contribution is the introduction of the TPM, which uses Convolutional Neural Network to predict the impact of COVID-19 on transportation. The results indicate a strong correlation between the spread of COVID-19 and transportation patterns, and the CNN has a high accuracy rate in predicting these impacts.

CNNSplice: Robust models for splice site prediction using convolutional neural networks

The identification of splice site, or segments of an RNA gene where noncoding and coding sequences are connected in the 5' and 3' directions, is an essential post-transcriptional step for the annotation of functional genes and is required for the study and analysis of biological function in eukaryotic organisms through protein production and gene expression. Splice site detection tools have been proposed for this purpose; however, the models of these tools have a specific use case and are inefficiently or typically untransferable between organisms. Here, we present CNNSplice, a set of deep convolutional neural network models for splice site prediction. Using the five-fold cross-validation model selection technique, we explore several models based on typical machine learning applications and propose five high-performing models to efficiently predict the true and false SS in balanced and imbalanced datasets. Our evaluation results indicate that CNNSplice's models achieve a better performance compared with existing methods across five organisms' datasets. In addition, our generality test shows CNNSplice's model ability to predict and annotate splice sites in new or poorly trained genome datasets indicating a broad application spectrum. CNNSplice demonstrates improved model prediction, interpretability, and generalizability on genomic datasets compared to existing splice site prediction tools. We have developed a web server for the CNNSplice algorithm which can be publicly accessed here: http://www.cnnsplice.online.

Artificial Intelligence in Drug Formulation and Development: Applications and Future Prospects

Artificial Intelligence (AI) has emerged as a powerful tool in various domains, and the field of drug formulation and development is no exception. This review article aims to provide an overview of the applications of AI in drug formulation and development and explore its future prospects. The article begins by introducing the fundamental concepts of AI, including machine learning, deep learning, and artificial neural networks and their relevance in the pharmaceutical industry. Furthermore, the article discusses the network and tools of AI and its applications in the pharmaceutical development process, including various areas, such as drug discovery, manufacturing, quality control, clinical trial management, and drug delivery. The utilization of AI in various conventional as well as modified dosage forms has been compiled. It also highlights the challenges and limitations associated with the implementation of AI in this field, including data availability, model interpretability, and regulatory considerations. Finally, the article presents the future prospects of AI in drug formulation and development, emphasizing the potential for personalized medicine, precision drug targeting, and rapid formulation optimization. It also discusses the ethical implications of AI in this context, including issues of privacy, bias, and accountability.

3T-MRI Artificial Intelligence in Patients with Invasive Breast Cancer to Predict Distant Metastasis Status: A Pilot Study

BACKGROUND

The incidence of breast cancer metastasis has decreased over the years. However, 20-30% of patients with early breast cancer still die from metastases. The purpose of this study is to evaluate the performance of a Deep Learning Convolutional Neural Networks (CNN) model to predict the risk of distant metastasis using 3T-MRI DCE sequences (Dynamic Contrast-Enhanced).

METHODS

A total of 157 breast cancer patients who underwent staging 3T-MRI examinations from January 2011 to July 2022 were retrospectively examined. Patient data, tumor histological and MRI characteristics, and clinical and imaging follow-up examinations of up to 7 years were collected. Of the 157 MRI examinations, 39/157 patients (40 lesions) had distant metastases, while 118/157 patients (120 lesions) were negative for distant metastases (control group). We analyzed the role of the Deep Learning technique using a single variable size bounding box (SVB) option and employed a Voxel Based (VB) NET CNN model. The CNN performance was evaluated in terms of accuracy, sensitivity, specificity, and area under the ROC curve (AUC).

RESULTS

The VB-NET model obtained a sensitivity, specificity, accuracy, and AUC of 52.50%, 80.51%, 73.42%, and 68.56%, respectively. A significant correlation was found between the risk of distant metastasis and tumor size, and the expression of PgR and HER2.

CONCLUSIONS

We demonstrated a currently insufficient ability of the Deep Learning approach in predicting a distant metastasis status in patients with BC using CNNs.

An optimized deep learning approach for suicide detection through Arabic tweets

Many people worldwide suffer from mental illnesses such as major depressive disorder (MDD), which affect their thoughts, behavior, and quality of life. Suicide is regarded as the second leading cause of death among teenagers when treatment is not received. Twitter is a platform for expressing their emotions and thoughts about many subjects. Many studies, including this one, suggest using social media data to track depression and other mental illnesses. Even though Arabic is widely spoken and has a complex syntax, depressive detection methods have not been applied to the language. The Arabic tweets dataset should be scraped and annotated first. Then, a complete framework for categorizing tweet inputs into two classes (such as Normal or Suicide) is suggested in this study. The article also proposes an Arabic tweet preprocessing algorithm that contrasts lemmatization, stemming, and various lexical analysis methods. Experiments are conducted using Twitter data scraped from the Internet. Five different annotators have annotated the data. Performance metrics are reported on the suggested dataset using the latest Bidirectional Encoder Representations from Transformers (BERT) and Universal Sentence Encoder (USE) models. The measured performance metrics are balanced accuracy, specificity, F1-score, IoU, ROC, Youden Index, NPV, and weighted sum metric (WSM). Regarding USE models, the best-weighted sum metric (WSM) is 80.2%, and with regards to Arabic BERT models, the best WSM is 95.26%.

Automatic Stones Classification through a CNN-Based Approach

This paper presents an automatic recognition system for classifying stones belonging to different Calabrian quarries (Southern Italy). The tool for stone recognition has been developed in the SILPI project (acronym of "Sistema per l'Identificazione di Lapidei Per Immagini"), financed by POR Calabria FESR-FSE 2014-2020. Our study is based on the Convolutional Neural Network (CNNs) that is used in literature for many different tasks such as speech recognition, neural language processing, bioinformatics, image classification and much more. In particular, we propose a two-stage hybrid approach based on the use of a model of Deep Learning (DL), in our case the CNN, in the first stage and a model of Machine Learning (ML) in the second one. In this work, we discuss a possible solution to stones classification which uses a CNN for the feature extraction phase and the Softmax or Multinomial Logistic Regression (MLR), Support Vector Machine (SVM), k-Nearest Neighbors (kNN), Random Forest (RF) and Gaussian Naive Bayes (GNB) ML techniques in order to perform the classification phase basing our study on the approach called Transfer Learning (TL). We show the image acquisition process in order to collect adequate information for creating an opportune database of the stone typologies present in the Calabrian quarries, also performing the identification of quarries in the considered region. Finally, we show a comparison of different DL and ML combinations in our Two-Stage Hybrid Model solution.

DIAROP: Automated Deep Learning-Based Diagnostic Tool for Retinopathy of Prematurity

Retinopathy of Prematurity (ROP) affects preterm neonates and could cause blindness. Deep Learning (DL) can assist ophthalmologists in the diagnosis of ROP. This paper proposes an automated and reliable diagnostic tool based on DL techniques called DIAROP to support the ophthalmologic diagnosis of ROP. It extracts significant features by first obtaining spatial features from the four Convolution Neural Networks (CNNs) DL techniques using transfer learning and then applying Fast Walsh Hadamard Transform (FWHT) to integrate these features. Moreover, DIAROP explores the best-integrated features extracted from the CNNs that influence its diagnostic capability. The results of DIAROP indicate that DIAROP achieved an accuracy of 93.2% and an area under receiving operating characteristic curve (AUC) of 0.98. Furthermore, DIAROP performance is compared with recent ROP diagnostic tools. Its promising performance shows that DIAROP may assist the ophthalmologic diagnosis of ROP.

Epileptic EEG Classification by Using Time-Frequency Images for Deep Learning

Epilepsy is one of the most common brain disorders worldwide. The most frequently used clinical tool to detect epileptic events and monitor epilepsy patients is the EEG recordings. There have been proposed many computer-aided diagnosis systems using EEG signals for the detection and prediction of seizures. In this study, a novel method based on Fourier-based Synchrosqueezing Transform (SST), which is a high-resolution time-frequency (TF) representation, and Convolutional Neural Network (CNN) is proposed to detect and predict seizure segments. SST is based on the reassignment of signal components in the TF plane which provides highly localized TF energy distributions. Epileptic seizures cause sudden energy discharges which are well represented in the TF plane by using the SST method. The proposed SST-based CNN method is evaluated using the IKCU dataset we collected, and the publicly available CHB-MIT dataset. Experimental results demonstrate that the proposed approach yields high average segment-based seizure detection precision and accuracy rates for both datasets (IKCU: 98.99% PRE and 99.06% ACC; CHB-MIT: 99.81% PRE and 99.63% ACC). Additionally, SST-based CNN approach provides significantly higher segment-based seizure prediction performance with 98.54% PRE and 97.92% ACC than similar approaches presented in the literature using the CHB-MIT dataset.

NT-FDS-A Noise Tolerant Fall Detection System Using Deep Learning on Wearable Devices

Given the high prevalence and detrimental effects of unintentional falls in the elderly, fall detection has become a pertinent public concern. A Fall Detection System (FDS) gathers information from sensors to distinguish falls from routine activities in order to provide immediate medical assistance. Hence, the integrity of collected data becomes imperative. Presence of missing values in data, caused by unreliable data delivery, lossy sensors, local interference and synchronization disturbances and so forth, greatly hamper the credibility and usefulness of data making it unfit for reliable fall detection. This paper presents a noise tolerant FDS performing in presence of missing values in data. The work focuses on Deep Learning (DL) particularly Recurrent Neural Networks (RNNs) with an underlying Bidirectional Long Short-Term Memory (BiLSTM) stack to implement FDS based on wearable sensors. The proposed technique is evaluated on two publicly available datasets—SisFall and UP-Fall Detection. Our system produces an accuracy of 97.21% and 97.41%, sensitivity of 96.97% and 99.77% and specificity of 93.18% and 91.45% on SisFall and UP-Fall Detection respectively, thus outperforming the existing state of the art on these benchmark datasets. The resultant outcomes suggest that the ability of BiLSTM to retain long term dependencies from past and future make it an appropriate model choice to handle missing values for wearable fall detection systems.

Deep Convolutional Encoder-Decoder algorithm for MRI brain reconstruction

Compressed Sensing Magnetic Resonance Imaging (CS-MRI) could be considered a challenged task since it could be designed as an efficient technique for fast MRI acquisition which could be highly beneficial for several clinical routines. In fact, it could grant better scan quality by reducing motion artifacts amount as well as the contrast washout effect. It offers also the possibility to reduce the exploration cost and the patient's anxiety. Recently, Deep Learning Neuronal Network (DL) has been suggested in order to reconstruct MRI scans with conserving the structural details and improving parallel imaging-based fast MRI. In this paper, we propose Deep Convolutional Encoder-Decoder architecture for CS-MRI reconstruction. Such architecture bridges the gap between the non-learning techniques, using data from only one image, and approaches using large training data. The proposed approach is based on autoencoder architecture divided into two parts: an encoder and a decoder. The encoder as well as the decoder has essentially three convolutional blocks. The proposed architecture has been evaluated through two databases: Hammersmith dataset (for the normal scans) and MICCAI 2018 (for pathological MRI). Moreover, we extend our model to cope with noisy pathological MRI scans. The normalized mean square error (NMSE), the peak-to-noise ratio (PSNR), and the structural similarity index (SSIM) have been adopted as evaluation metrics in order to evaluate the proposed architecture performance and to make a comparative study with the state-of-the-art reconstruction algorithms. The higher PSNR and SSIM values as well as the lowest NMSE values could attest that the proposed architecture offers better reconstruction and preserves textural image details. Furthermore, the running time is about 0.8 s, which is suitable for real-time processing. Such results could encourage the neurologist to adopt it in their clinical routines. Graphical abstract.

Human Activity Recognition using Inertial, Physiological and Environmental Sensors: A Comprehensive Survey

In the last decade, Human Activity Recognition (HAR) has become a vibrant research area, especially due to the spread of electronic devices such as smartphones, smartwatches and video cameras present in our daily lives. In addition, the advance of deep learning and other machine learning algorithms has allowed researchers to use HAR in various domains including sports, health and well-being applications. For example, HAR is considered as one of the most promising assistive technology tools to support elderly's daily life by monitoring their cognitive and physical function through daily activities. This survey focuses on critical role of machine learning in developing HAR applications based on inertial sensors in conjunction with physiological and environmental sensors.

Deep learning-based classification of multi-categorical Alzheimer's disease data

It is urgent to find the appropriate technology for the early detection of Alzheimer's disease (AD) due to the unknown AD etiopathologies that bring about serious social problems. Early detection of mild cognitive impairment (MCI) has pivotal importance in delaying or preventing the AD onset. Herein, we utilize deep learning (DL) techniques for the purpose of multiclass classification between normal control, MCI, and AD subjects. We used multi-categorical data from the Alzheimer's Disease Neuroimaging Initiative (ADNI) including brain imaging measurements, cognitive test results, cerebrospinal fluid measures, ApoE4 status, and age. We achieved an overall accuracy of 87.197% for our artificial neural network classifier and a similar overall accuracy of 88.275% for our 1D convolutional neural network classifier. We conclude that DL-based techniques are powerful tools in analyzing ADNI data although further method refinements are needed.