Spatial Attention-Based 3D Graph Convolutional Neural Network for Sign Language Recognition

Sign language is the main channel for hearing-impaired people to communicate with others. It is a visual language that conveys highly structured components of manual and non-manual parameters such that it needs a lot of effort to master by hearing people. Sign language recognition aims to facilitate this mastering difficulty and bridge the communication gap between hearing-impaired people and others. This study presents an efficient architecture for sign language recognition based on a convolutional graph neural network (GCN). The presented architecture consists of a few separable 3DGCN layers, which are enhanced by a spatial attention mechanism. The limited number of layers in the proposed architecture enables it to avoid the common over-smoothing problem in deep graph neural networks. Furthermore, the attention mechanism enhances the spatial context representation of the gestures. The proposed architecture is evaluated on different datasets and shows outstanding results.

A Multi-Branch Convolutional Neural Network with Squeeze-and-Excitation Attention Blocks for EEG-Based Motor Imagery Signals Classification

Electroencephalography-based motor imagery (EEG-MI) classification is a critical component of the brain-computer interface (BCI), which enables people with physical limitations to communicate with the outside world via assistive technology. Regrettably, EEG decoding is challenging because of the complexity, dynamic nature, and low signal-to-noise ratio of the EEG signal. Developing an end-to-end architecture capable of correctly extracting EEG data’s high-level features remains a difficulty. This study introduces a new model for decoding MI known as a Multi-Branch EEGNet with squeeze-and-excitation blocks (MBEEGSE). By clearly specifying channel interdependencies, a multi-branch CNN model with attention blocks is employed to adaptively change channel-wise feature responses. When compared to existing state-of-the-art EEG motor imagery classification models, the suggested model achieves good accuracy (82.87%) with reduced parameters in the BCI-IV2a motor imagery dataset and (96.15%) in the high gamma dataset.

Date fruit dataset for intelligent harvesting

The date palm is one of the most valuable fruit trees in the world. Most methods used for date fruit inspection, harvesting, grading, and classification are manual, which makes them ineffective in terms of both time and economy. Research on automated date fruit harvesting is limited as there is no public dataset for date fruits to aid in this. In this work, we present a comprehensive dataset for date fruits that can be used by the research community for multiple tasks including automated harvesting, visual yield estimation, and classification tasks. The dataset contains images of date fruit bunches of different date varieties, captured at different pre-maturity and maturity stages. These images cover multiple sets of variations such as multi-scale images, variable illumination, and different bagging states. We also marked date bunches for selected palms and measured the weights of the bunches, captured their images on a graph paper, and recorded 360° video of the palms. This dataset can help in advancing research and automating date palm agricultural applications, including robotic harvesting, fruit detection and classification, maturity analysis, and weight/yield estimation. The dataset is freely and publicly available for the research community in the IEEE DataPort repository [1] (https://doi.org/10.21227/x46j-sk98).