An improved SIFT algorithm for robust emotion recognition under various face poses and illuminations

A Student Facial Expression Recognition Model Based on Multi-Scale and Deep Fine-Grained Feature Attention Enhancement

In smart classroom environments, accurately recognizing students' facial expressions is crucial for teachers to efficiently assess students' learning states, timely adjust teaching strategies, and enhance teaching quality and effectiveness. In this paper, we propose a student facial expression recognition model based on multi-scale and deep fine-grained feature attention enhancement (SFER-MDFAE) to address the issues of inaccurate facial feature extraction and poor robustness of facial expression recognition in smart classroom scenarios. Firstly, we construct a novel multi-scale dual-pooling feature aggregation module to capture and fuse facial information at different scales, thereby obtaining a comprehensive representation of key facial features; secondly, we design a key region-oriented attention mechanism to focus more on the nuances of facial expressions, further enhancing the representation of multi-scale deep fine-grained feature; finally, the fusion of multi-scale and deep fine-grained attention-enhanced features is used to obtain richer and more accurate facial key information and realize accurate facial expression recognition. The experimental results demonstrate that the proposed SFER-MDFAE outperforms the existing state-of-the-art methods, achieving an accuracy of 76.18% on FER2013, 92.75% on FERPlus, 92.93% on RAF-DB, 67.86% on AffectNet, and 93.74% on the real smart classroom facial expression dataset (SCFED). These results validate the effectiveness of the proposed method.

Cross-subject emotion recognition using hierarchical feature optimization and support vector machine with multi-kernel collaboration

Objective. Due to individual differences, it is greatly challenging to realize the multiple types of emotion identification across subjects.Approach. In this research, a hierarchical feature optimization method is proposed in order to represent emotional states effectively based on peripheral physiological signals. Firstly, sparse learning combined with binary search is employed to achieve feature selection of single signals. Then an improved fast correlation-based filter is proposed to implement fusion optimization of multi-channel signal features. Aiming at overcoming the limitations of the support vector machine (SVM), which uses a single kernel function to make decisions, the multi-kernel function collaboration strategy is proposed to improve the classification performance of SVM.Main results. The effectiveness of the proposed method is verified on the DEAP dataset. Experimental results show that the proposed method presents a competitive performance for four cross-subject  types of emotion identification with an accuracy of 84% (group 1) and 85.07% (group 2). Significance. The proposed model with hierarchical feature optimization and SVM with multi-kernel function collaboration demonstrates superior emotion recognition accuracy compared to state-of-the-art techniques. In addition, the analysis based on DEAP dataset composition characteristics presents a novel perspective to explore the emotion recognition issue more objectively and comprehensively.

Classification of Contrasting Discrete Emotional States Indicated by EEG Based Graph Theoretical Network Measures

The present study shows new findings that reveal the high association between emotional arousal and neuro-functional brain connectivity measures. For this purpose, contrasting discrete emotional states (happiness vs sadness, amusement vs disgust, calmness vs excitement, calmness vs anger, fear vs anger) are classified by using Support Vector Machines (SVMs) driven by Graph Theoretical segregation (clustering coefficients, transitivity, modularity) and integration (global efficiency, local efficiency) measures of the brain network. Emotional EEG data mediated by short duration video film clips is downloaded from publicly available database called DREAMER. Pearson Correlation (PC) and Spearman Correlation have been examined to estimate statistical dependencies between relatively shorter (6 sec) and longer (12 sec) non-overlapped EEG segments across the cortex. Then the corresponding brain connectivity encoded as a graph is transformed into binary numbers with respect to two different thresholds (60%max and mean). Statistical differences between contrasting emotions are obtained by using both one-way Anova tests and step-wise logistic regression modelling in accordance with variables (dependency estimation, segment length, threshold, network measure). Combined integration measures provided the highest classification accuracies (CAs) (75.00% 80.65%) when PC is applied to longer segments in accordance with particular threshold as the mean. The segregation measures also provided useful CAs (74.13% 80.00%), while the combination of both measures did not. The results reveal that discrete emotional states are characterized by balanced network measures even if both segregation and integration measures vary depending on arousal scores of audio-visual stimuli due to neurotransmitter release during video watching.

Emotional Intervention and Education System Construction for Rural Children Based on Semantic Analysis

Objective

Under the background of the policy of caring for the healthy growth of left-behind children, the purpose of selecting the topic is to study some common negative emotional problems of left-behind children in rural areas, focusing on the guidance of negative emotions of left-behind children in rural areas. In emotional problems, we analyze and find out the reasons for these negative emotions through observation and research.

Method

In this paper, a platform for acquiring emotional semantic data of scene images in an open behavioral experimental environment is designed, which breaks the limitations of time and place, and thus acquires a large amount of emotional semantic data of scene images and then uses principal component analysis to evaluate the validity of the data analysis. Psychological testing was used to measure parent-child affinity, adversity beliefs, and positive/negative emotion scales, respectively, to examine children whose parents went out, children whose fathers went out, and non-left-behind children. The characteristics of parent-child affinity, adversity beliefs, and positive/negative emotions in three types of children were examined, and the direct predictive effects of parent-child affinity and adversity beliefs on the positive/negative emotions of the three types of children were examined. Results/Discussion. Adversity beliefs played a partial mediating role between children's parent-child bonding and positive emotions. The predictive effect of adversity beliefs on children's emotional adaptation differs by emotional type. The main effects of the left-behind category were significant for both positive and negative emotions. The gender main effect of negative emotion was significant, and the negative emotion level of girls was significantly higher than that of boys. The main effect of the left-behind category of adversity beliefs was significant, and the adversity belief levels of children whose parents went out to rural areas were significantly lower than those of children whose fathers went out and non-left-behind children. The negative emotions generated by left-behind children in rural areas are channeled, and to a certain extent, they are improved and alleviated. Through the emotional counseling and improvement of the rural left-behind children in the research site in the article, the service objects can have better emotions, promote mental health, make them happy and grow up healthily, and also provide a certain theory for the establishment of the local left-behind children care system.

A comprehensive survey on techniques to handle face identity threats: challenges and opportunities

The human face is considered the prime entity in recognizing a person's identity in our society. Henceforth, the importance of face recognition systems is growing higher for many applications. Facial recognition systems are in huge demand, next to fingerprint-based systems. Face-biometric has a highly dominant role in various applications such as border surveillance, forensic investigations, crime detection, access management systems, information security, and many more. Facial recognition systems deliver highly meticulous results in every of these application domains. However, the face identity threats are evenly growing at the same rate and posing severe concerns on the use of face-biometrics. This paper significantly explores all types of face recognition techniques, their accountable challenges, and threats to face-biometric-based identity recognition. This survey paper proposes a novel taxonomy to represent potential face identity threats. These threats are described, considering their impact on the facial recognition system. State-of-the-art approaches available in the literature are discussed here to mitigate the impact of the identified threats. This paper provides a comparative analysis of countermeasure techniques focusing on their performance on different face datasets for each identified threat. This paper also highlights the characteristics of the benchmark face datasets representing unconstrained scenarios. In addition, we also discuss research gaps and future opportunities to tackle the facial identity threats for the information of researchers and readers.

Aziz NA, Ibrahim SZ, Nawawi SW, Alelyani S, Mohana M, Chia Chun L. Evaluation of electrocardiogram: numerical vs. image data for emotion recognition system

Background: The electrocardiogram (ECG) is a physiological signal used to diagnose and monitor cardiovascular disease, usually using 2- D ECG. Numerous studies have proven that ECG can be used to detect human emotions using 1-D ECG; however, ECG is typically captured as 2-D images rather than as 1-D data. There is still no consensus on the effect of the ECG input format on the accuracy of the emotion recognition system (ERS). The ERS using 2-D ECG is still inadequately studied. Therefore, this study compared ERS performance using 1-D and 2-D ECG data to investigate the effect of the ECG input format on the ERS.

Methods: This study employed the DREAMER dataset, which contains 23 ECG recordings obtained during audio-visual emotional elicitation. Numerical data was converted to ECG images for the comparison. Numerous approaches were used to obtain ECG features. The Augsburg BioSignal Toolbox (AUBT) and the Toolbox for Emotional feature extraction from Physiological signals (TEAP) extracted features from numerical data. Meanwhile, features were extracted from image data using Oriented FAST and rotated BRIEF (ORB), Scale Invariant Feature Transform (SIFT), KAZE, Accelerated-KAZE (AKAZE), Binary Robust Invariant Scalable Keypoints (BRISK), and Histogram of Oriented Gradients (HOG). Dimension reduction was accomplished using linear discriminant analysis (LDA), and valence and arousal were classified using the Support Vector Machine (SVM).

Results: The experimental results show 1-D ECG-based ERS achieved 65.06% of accuracy and 75.63% of F1 score for valence, and 57.83% of accuracy and 44.44% of F1-score for arousal. For 2-D ECG-based ERS, the highest accuracy and F1-score for valence were 62.35% and 49.57%; whereas, the arousal was 59.64% and 59.71%.

Conclusions: The results indicate that both inputs work comparably well in classifying emotions, which demonstrates the potential of 1-D and 2-D as input modalities for the ERS.

Emotion Recognition Algorithm Application Financial Development and Economic Growth Status and Development Trend

Financial market and economic growth and development trends can be regarded as an extremely complex system, and the in-depth study and prediction of this complex system has always been the focus of attention of economists and other scholars. Emotion recognition algorithm is a pattern recognition technology that integrates a number of emerging science and technology, and has good non-linear system fitting capabilities. However, using emotion recognition algorithm models to analyze and predict financial market and economic growth and development trends can yield more accurate prediction results. This article first gives a detailed introduction to the existing financial development and economic growth status and development trend forecasting problems, and then gives a brief overview of the concept of emotion recognition algorithms. Then, it describes the emotion recognition methods, including statistical emotion recognition methods, mixed emotion recognition methods, and emotion recognition methods based on knowledge technology, and conducts in-depth research on the three algorithm models of statistical emotion recognition methods, they are the support vector machine algorithm model, the artificial neural network algorithm model, and the long and short-term memory network algorithm model. Finally, these three algorithm models are applied to the financial market and economic growth and development trend prediction experiments. Experimental results show that the average absolute error of the three algorithms is below 25, which verifies that the emotion recognition algorithm has good operability and feasibility for the prediction of financial market and economic growth and development trends.

A hybrid eye movement feature recognition of classroom students based on machine learning

Online classroom teaching is difficult to identify students’ learning status in real time. Therefore, we need to combine intelligent image recognition technology to analyze student status through eye movement features. This study solves the problem of inaccurate positioning of the initial position of the shape model in the process of eyelid matching through machine learning. Moreover, this study improves the algorithm and uses the AK-EYE model based on the combination of ASM algorithm and Kalman filtering to establish a local feature model for each feature point. According to the gray information in the normal direction of the feature point, the local gray information is modeled. After training through the sample set to obtain the state model, the target eye can be searched, and the pose parameters can be determined. Finally, this study designs a control experiment to analyze the performance of the model proposed in this study. The research shows that the algorithm proposed in this paper has a high recognition accuracy and has a practical basis, which can be used as one of the subsequent classroom teaching system algorithms.

The current challenges of automatic recognition of facial expressions: A systematic review

In recent years, due to its great economic and social potential, the recognition of facial expressions linked to emotions has become one of the most flourishing applications in the field of artificial intelligence, and has been the subject of many developments. However, despite significant progress, this field is still subject to many theoretical debates and technical challenges. It therefore seems important to make a general inventory of the different lines of research and to present a synthesis of recent results in this field. To this end, we have carried out a systematic review of the literature according to the guidelines of the PRISMA method. A search of 13 documentary databases identified a total of 220 references over the period 2014–2019. After a global presentation of the current systems and their performance, we grouped and analyzed the selected articles in the light of the main problems encountered in the field of automated facial expression recognition. The conclusion of this review highlights the strengths, limitations and main directions for future research in this field.