Emotion recognition in EEG signals using deep learning methods: A review

Emotions are a critical aspect of daily life and serve a crucial role in human decision-making, planning, reasoning, and other mental states. As a result, they are considered a significant factor in human interactions. Human emotions can be identified through various sources, such as facial expressions, speech, behavior (gesture/position), or physiological signals. The use of physiological signals can enhance the objectivity and reliability of emotion detection. Compared with peripheral physiological signals, electroencephalogram (EEG) recordings are directly generated by the central nervous system and are closely related to human emotions. EEG signals have the great spatial resolution that facilitates the evaluation of brain functions, making them a popular modality in emotion recognition studies. Emotion recognition using EEG signals presents several challenges, including signal variability due to electrode positioning, individual differences in signal morphology, and lack of a universal standard for EEG signal processing. Moreover, identifying the appropriate features for emotion recognition from EEG data requires further research. Finally, there is a need to develop more robust artificial intelligence (AI) including conventional machine learning (ML) and deep learning (DL) methods to handle the complex and diverse EEG signals associated with emotional states. This paper examines the application of DL techniques in emotion recognition from EEG signals and provides a detailed discussion of relevant articles. The paper explores the significant challenges in emotion recognition using EEG signals, highlights the potential of DL techniques in addressing these challenges, and suggests the scope for future research in emotion recognition using DL techniques. The paper concludes with a summary of its findings.

COVID-19 radiograph prognosis using a deep CResNeXt network

COVID-19 has caused an epidemic in the entire world and it is caused by the novel virus SARS-COV-2. In severe conditions, this virus can cause a critical lung infection or viral pneumonia. To administer the correct treatment to patients, COVID-19 testing is important for diagnosing and determining patients who are infected with COVID-19, as opposed to those infected with other bacterial or viral infections. In this paper, a CResNeXt chest radiograph COVID-19 prediction model is proposed using residual network architecture. The advantage of the proposed model is that it requires lesser free hyper-parameters as compared to other residual networks. In addition, the training time per epochs of the model is very less compared to VGG19, ResNet-50, ResNeXt. The proposed CResNeXt model's binary classification (COVID-19 versus No-Finding) accuracy is observed to be 98.63% and 99.99% and multi-class classification (COVID-19, Pneumonia, and No-Finding) accuracy is observed to be 97.42% and 99.27% on the original and augmented datasets, respectively.

Identification of Clinical Features Associated with Mortality in COVID-19 Patients

Understanding clinical features and risk factors associated with COVID-19 mortality is needed to early identify critically ill patients, initiate treatments and prevent mortality. A retrospective study on COVID-19 patients referred to a tertiary hospital in Iran between March and November 2020 was conducted. COVID-19-related mortality and its association with clinical features including headache, chest pain, symptoms on computerized tomography (CT), hospitalization, time to infection, history of neurological disorders, having a single or multiple risk factors, fever, myalgia, dizziness, seizure, abdominal pain, nausea, vomiting, diarrhoea and anorexia were investigated. Based on the investigation outcome, decision tree and dimension reduction algorithms were used to identify the aforementioned risk factors. Of the 3008 patients (mean age 59.3 ± 18.7 years, 44% women) with COVID-19, 373 died. There was a significant association between COVID-19 mortality and old age, headache, chest pain, low respiratory rate, oxygen saturation < 93%, need for a mechanical ventilator, having symptoms on CT, hospitalization, time to infection, neurological disorders, cardiovascular diseases and having a risk factor or multiple risk factors. In contrast, there was no significant association between mortality and gender, fever, myalgia, dizziness, seizure, abdominal pain, nausea, vomiting, diarrhoea and anorexia. Our results might help identify early symptoms related to COVID-19 and better manage patients according to the extracted decision tree. The proposed ML models identified a number of clinical features and risk factors associated with mortality in COVID-19 patients. These models if implemented in a clinical setting might help to early identify patients needing medical attention and care. However, more studies are needed to confirm these findings.

Data augmentation based semi-supervised method to improve COVID-19 CT classification

The Coronavirus (COVID-19) outbreak of December 2019 has become a serious threat to people around the world, creating a health crisis that infected millions of lives, as well as destroying the global economy. Early detection and diagnosis are essential to prevent further transmission. The detection of COVID-19 computed tomography images is one of the important approaches to rapid diagnosis. Many different branches of deep learning methods have played an important role in this area, including transfer learning, contrastive learning, ensemble strategy, etc. However, these works require a large number of samples of expensive manual labels, so in order to save costs, scholars adopted semi-supervised learning that applies only a few labels to classify COVID-19 CT images. Nevertheless, the existing semi-supervised methods focus primarily on class imbalance and pseudo-label filtering rather than on pseudo-label generation. Accordingly, in this paper, we organized a semi-supervised classification framework based on data augmentation to classify the CT images of COVID-19. We revised the classic teacher-student framework and introduced the popular data augmentation method Mixup, which widened the distribution of high confidence to improve the accuracy of selected pseudo-labels and ultimately obtain a model with better performance. For the COVID-CT dataset, our method makes precision, F1 score, accuracy and specificity 21.04%, 12.95%, 17.13% and 38.29% higher than average values for other methods respectively, For the SARS-COV-2 dataset, these increases were 8.40%, 7.59%, 9.35% and 12.80% respectively. For the Harvard Dataverse dataset, growth was 17.64%, 18.89%, 19.81% and 20.20% respectively. The codes are available at https://github.com/YutingBai99/COVID-19-SSL.

Prognosis prediction in traumatic brain injury patients using machine learning algorithms

Predicting treatment outcomes in traumatic brain injury (TBI) patients is challenging worldwide. The present study aimed to achieve the most accurate machine learning (ML) algorithms to predict the outcomes of TBI treatment by evaluating demographic features, laboratory data, imaging indices, and clinical features. We used data from 3347 patients admitted to a tertiary trauma centre in Iran from 2016 to 2021. After the exclusion of incomplete data, 1653 patients remained. We used ML algorithms such as random forest (RF) and decision tree (DT) with ten-fold cross-validation to develop the best prediction model. Our findings reveal that among different variables included in this study, the motor component of the Glasgow coma scale, the condition of pupils, and the condition of cisterns were the most reliable features for predicting in-hospital mortality, while the patients' age takes the place of cisterns condition when considering the long-term survival of TBI patients. Also, we found that the RF algorithm is the best model to predict the short-term mortality of TBI patients. However, the generalized linear model (GLM) algorithm showed the best performance (with an accuracy rate of 82.03 ± 2.34) in predicting the long-term survival of patients. Our results showed that using appropriate markers and with further development, ML has the potential to predict TBI patients' survival in the short- and long-term.

Automatic diagnosis of severity of COVID-19 patients using an ensemble of transfer learning models with convolutional neural networks in CT images

Introduction: Quantification of lung involvement in COVID-19 using chest Computed tomography (CT) scan can help physicians to evaluate the progression of the disease or treatment response. This paper presents an automatic deep transfer learning ensemble based on pre-trained convolutional neural networks (CNNs) to determine the severity of COVID -19 as normal, mild, moderate, and severe based on the images of the lungs CT.

Material and methods: In this study, two different deep transfer learning strategies were used. In the first procedure, features were extracted from fifteen pre-trained CNNs architectures and then fed into a support vector machine (SVM) classifier. In the second procedure, the pre-trained CNNs were fine-tuned using the chest CT images, and then features were extracted for the purpose of classification by the softmax layer. Finally, an ensemble method was developed based on majority voting of the deep learning outputs to increase the performance of the recognition on each of the two strategies. A dataset of CT scans was collected and then labeled as normal (314), mild (262), moderate (72), and severe (35) for COVID-19 by the consensus of two highly qualified radiologists.

Results: The ensemble of five deep transfer learning outputs named EfficientNetB3, EfficientNetB4, InceptionV3, NasNetMobile, and ResNext50 in the second strategy has better results than the first strategy and also the individual deep transfer learning models in diagnosing the severity of COVID-19 with 85% accuracy.

Conclusions: Our proposed study is well suited for quantifying lung involvement of COVID-19 and can help physicians to monitor the progression of the disease.

LiteCovidNet: A lightweight deep neural network model for detection of COVID-19 using X-ray images

The syndrome called COVID-19 which was firstly spread in Wuhan, China has already been declared a globally "Pandemic." To stymie the further spread of the virus at an early stage, detection needs to be done. Artificial Intelligence-based deep learning models have gained much popularity in the detection of many diseases within the confines of biomedical sciences. In this paper, a deep neural network-based "LiteCovidNet" model is proposed that detects COVID-19 cases as the binary class (COVID-19, Normal) and the multi-class (COVID-19, Normal, Pneumonia) bifurcated based on chest X-ray images of the infected persons. An accuracy of 100% and 98.82% is achieved for binary and multi-class classification respectively which is competitive performance as compared to the other recent related studies. Hence, our methodology can be used by health professionals to validate the detection of COVID-19 infected patients at an early stage with convenient cost and better accuracy.

COVID-19 chest X-ray detection through blending ensemble of CNN snapshots

The novel COVID-19 pandemic, has effectively turned out to be one of the deadliest events in modern history, with unprecedented loss of human life, major economic and financial setbacks and has set the entire world back quite a few decades. However, detection of the COVID-19 virus has become increasingly difficult due to the mutating nature of the virus, and the rise in asymptomatic cases. To counteract this and contribute to the research efforts for a more accurate screening of COVID-19, we have planned this work. Here, we have proposed an ensemble methodology for deep learning models to solve the task of COVID-19 detection from chest X-rays (CXRs) to assist Computer-Aided Detection (CADe) for medical practitioners. We leverage the strategy of transfer learning for Convolutional Neural Networks (CNNs), widely adopted in recent literature, and further propose an efficient ensemble network for their combination. The DenseNet-201 architecture has been trained only once to generate multiple snapshots, offering diverse information about the extracted features from CXRs. We follow the strategy of decision-level fusion to combine the decision scores using the blending algorithm through a Random Forest (RF) meta-learner. Experimental results confirm the efficacy of the proposed ensemble method, as shown through impressive results upon two open access COVID-19 CXR datasets - the largest COVID-X dataset, as well as a smaller scale dataset. On the large COVID-X dataset, the proposed model has achieved an accuracy score of 94.55% and on the smaller dataset by Chowdhury et al., the proposed model has achieved a 98.13% accuracy score.

COVID-19 classification using chest X-ray images: A framework of CNN-LSTM and improved max value moth flame optimization

Coronavirus disease 2019 (COVID-19) is a highly contagious disease that has claimed the lives of millions of people worldwide in the last 2 years. Because of the disease's rapid spread, it is critical to diagnose it at an early stage in order to reduce the rate of spread. The images of the lungs are used to diagnose this infection. In the last 2 years, many studies have been introduced to help with the diagnosis of COVID-19 from chest X-Ray images. Because all researchers are looking for a quick method to diagnose this virus, deep learning-based computer controlled techniques are more suitable as a second opinion for radiologists. In this article, we look at the issue of multisource fusion and redundant features. We proposed a CNN-LSTM and improved max value features optimization framework for COVID-19 classification to address these issues. The original images are acquired and the contrast is increased using a combination of filtering algorithms in the proposed architecture. The dataset is then augmented to increase its size, which is then used to train two deep learning networks called Modified EfficientNet B0 and CNN-LSTM. Both networks are built from scratch and extract information from the deep layers. Following the extraction of features, the serial based maximum value fusion technique is proposed to combine the best information of both deep models. However, a few redundant information is also noted; therefore, an improved max value based moth flame optimization algorithm is proposed. Through this algorithm, the best features are selected and finally classified through machine learning classifiers. The experimental process was conducted on three publically available datasets and achieved improved accuracy than the existing techniques. Moreover, the classifiers based comparison is also conducted and the cubic support vector machine gives better accuracy.

Prediction and forecasting of worldwide corona virus (COVID-19) outbreak using time series and machine learning

How will the newly discovered coronavirus (COVID-19) affect the world and what will be its global impact? For answering this question, we will require a prediction of overall recoveries and fatalities, as well as a reliable prognosis of coronavirus cases. Predicting, however, requires an ample total of past data related to it. On any particular day, the prediction is unclear since events in the future rarely repeat themselves the way that they did in the past. Furthermore, forecasts and predictions are determined by the absolute interests, accuracy of the data, and prophesied variables. In addition, psychological factors play an enormous role in how people perceive and react to the danger from the disease and therefore the fear that it is going to affect them personally. This research paper advances an unbiased method for predicting the increase of the COVID-19 employing a simple, but powerful method to do so. Assumed that the data are accurate and reliable which the longer term will still follow an equivalent disease pattern, our projections intimate with a large association. Within the COVID-19 cases were documented, in contingency, there is a steady increase. The hazards are far away from symmetric, as underestimating a pandemic's spread and failing to do enough to prevent it is far a lot worse than overspending and being too cautious when it will not be needed. This paper illustrates the timeline of a live forecasting study with huge implied implications for devising and decision-making and gives unbiased predictions on COVID-19 confirmed cases, recovered cases, deaths, and ongoing cases are shown on a continental map using data science and machine learning (ML) approaches. Utilizing these ML-based techniques, the proposed system predicts the accurate COVID-19 cases and gives better performance.

Automated Multi-View Multi-Modal Assessment of COVID-19 Patients Using Reciprocal Attention and Biomedical Transform

Automated severity assessment of coronavirus disease 2019 (COVID-19) patients can help rationally allocate medical resources and improve patients' survival rates. The existing methods conduct severity assessment tasks mainly on a unitary modal and single view, which is appropriate to exclude potential interactive information. To tackle the problem, in this paper, we propose a multi-view multi-modal model to automatically assess the severity of COVID-19 patients based on deep learning. The proposed model receives multi-view ultrasound images and biomedical indices of patients and generates comprehensive features for assessment tasks. Also, we propose a reciprocal attention module to acquire the underlying interactions between multi-view ultrasound data. Moreover, we propose biomedical transform module to integrate biomedical data with ultrasound data to produce multi-modal features. The proposed model is trained and tested on compound datasets, and it yields 92.75% for accuracy and 80.95% for recall, which is the best performance compared to other state-of-the-art methods. Further ablation experiments and discussions conformably indicate the feasibility and advancement of the proposed model.

Factors associated with mortality in hospitalized cardiovascular disease patients infected with COVID-19

INTRODUCTION

To reduce mortality in hospitalized patients with COVID-19 and cardiovascular disease (CVD), it is necessary to understand the relationship between patient's symptoms, risk factors, and comorbidities with their mortality rate. To the best of our knowledge, this paper is the first which take into account the determinants like risk factors, symptoms, and comorbidities leading to mortality in CVD patients who are hospitalized with COVID-19.

METHODS

This study was conducted on 660 hospitalized patients with CVD and COVID-19 recruited between January 2020 and January 2021 in Iran. All patients were diagnosed with the previous history of CVD like angina, myocardial infarction, heart failure, cardiomyopathy, abnormal heart rhythms, and congenital heart disease before they were hospitalized for COVID-19. We collected data on patient's signs and symptoms, clinical and paraclinical examinations, and any underlying comorbidities. t test was used to determine the significant difference between the two deceased and alive groups. In addition, the relation between pairs of symptoms and pairs of comorbidities has been determined via correlation computation.

RESULTS

Our findings suggest that signs and symptoms such as fever, cough, myalgia, chest pain, chills, abdominal pain, nausea, vomiting, diarrhea, and anorexia had no impact on patients' mortality. There was a significant correlation between COVID-19 cardiovascular patients' mortality rate and symptoms such as headache, loss of consciousness (LOC), oxygen saturation less than 93%, and need for mechanical ventilation.

CONCLUSIONS

Our results might help physicians identify early symptoms, comorbidities, and risk factors related to mortality in CVD patients hospitalized for COVID-19.

Objective evaluation of deep uncertainty predictions for COVID-19 detection

Deep neural networks (DNNs) have been widely applied for detecting COVID-19 in medical images. Existing studies mainly apply transfer learning and other data representation strategies to generate accurate point estimates. The generalization power of these networks is always questionable due to being developed using small datasets and failing to report their predictive confidence. Quantifying uncertainties associated with DNN predictions is a prerequisite for their trusted deployment in medical settings. Here we apply and evaluate three uncertainty quantification techniques for COVID-19 detection using chest X-Ray (CXR) images. The novel concept of uncertainty confusion matrix is proposed and new performance metrics for the objective evaluation of uncertainty estimates are introduced. Through comprehensive experiments, it is shown that networks pertained on CXR images outperform networks pretrained on natural image datasets such as ImageNet. Qualitatively and quantitatively evaluations also reveal that the predictive uncertainty estimates are statistically higher for erroneous predictions than correct predictions. Accordingly, uncertainty quantification methods are capable of flagging risky predictions with high uncertainty estimates. We also observe that ensemble methods more reliably capture uncertainties during the inference. DNN-based solutions for COVID-19 detection have been mainly proposed without any principled mechanism for risk mitigation. Previous studies have mainly focused on on generating single-valued predictions using pretrained DNNs. In this paper, we comprehensively apply and comparatively evaluate three uncertainty quantification techniques for COVID-19 detection using chest X-Ray images. The novel concept of uncertainty confusion matrix is proposed and new performance metrics for the objective evaluation of uncertainty estimates are introduced for the first time. Using these new uncertainty performance metrics, we quantitatively demonstrate when we could trust DNN predictions for COVID-19 detection from chest X-rays. It is important to note the proposed novel uncertainty evaluation metrics are generic and could be applied for evaluation of probabilistic forecasts in all classification problems.

Application of artificial intelligence in wearable devices: Opportunities and challenges

BACKGROUND AND OBJECTIVES

Wearable technologies have added completely new and fast emerging tools to the popular field of personal gadgets. Aside from being fashionable and equipped with advanced hardware technologies such as communication modules and networking, wearable devices have the potential to fuel artificial intelligence (AI) methods with a wide range of valuable data.

METHODS

Various AI techniques such as supervised, unsupervised, semi-supervised and reinforcement learning (RL) have already been used to carry out various tasks. This paper reviews the recent applications of wearables that have leveraged AI to achieve their objectives.

RESULTS

Particular example applications of supervised and unsupervised learning for medical diagnosis are reviewed. Moreover, examples combining the internet of things, wearables, and RL are reviewed. Application examples of wearables will be also presented for specific domains such as medical, industrial, and sport. Medical applications include fitness, movement disorder, mental health, etc. Industrial applications include employee performance improvement with the aid of wearables. Sport applications are all about providing better user experience during workout sessions or professional gameplays.

CONCLUSION

The most important challenges regarding design and development of wearable devices and the computation burden of using AI methods are presented. Finally, future challenges and opportunities for wearable devices are presented.

Time series forecasting of new cases and new deaths rate for COVID-19 using deep learning methods

The first known case of Coronavirus disease 2019 (COVID-19) was identified in December 2019. It has spread worldwide, leading to an ongoing pandemic, imposed restrictions and costs to many countries. Predicting the number of new cases and deaths during this period can be a useful step in predicting the costs and facilities required in the future. The purpose of this study is to predict new cases and deaths rate one, three and seven-day ahead during the next 100 days. The motivation for predicting every n days (instead of just every day) is the investigation of the possibility of computational cost reduction and still achieving reasonable performance. Such a scenario may be encountered in real-time forecasting of time series. Six different deep learning methods are examined on the data adopted from the WHO website. Three methods are LSTM, Convolutional LSTM, and GRU. The bidirectional extension is then considered for each method to forecast the rate of new cases and new deaths in Australia and Iran countries. This study is novel as it carries out a comprehensive evaluation of the aforementioned three deep learning methods and their bidirectional extensions to perform prediction on COVID-19 new cases and new death rate time series. To the best of our knowledge, this is the first time that Bi-GRU and Bi-Conv-LSTM models are used for prediction on COVID-19 new cases and new deaths time series. The evaluation of the methods is presented in the form of graphs and Friedman statistical test. The results show that the bidirectional models have lower errors than other models. A several error evaluation metrics are presented to compare all models, and finally, the superiority of bidirectional methods is determined. This research could be useful for organisations working against COVID-19 and determining their long-term plans.