Segmentation and Morphology Computation of a Spiky Nanoparticle Using the Hourglass Neural Network

Morphological measurements of nanoparticles in electron microscopy images are tedious, laborious, and often succumb to human errors. Deep learning methods in artificial intelligence (AI) paved the way for automated image understanding. This work proposes a deep neural network (DNN) for the automated segmentation of a Au spiky nanoparticle (SNP) in electron microscopic images, and the network is trained with a spike-focused loss function. The segmented images are used for the growth measurement of the Au SNP. The auxiliary loss function captures the spikes of the nanoparticle, which prioritizes the detection of spikes in the border regions. The growth of the particles measured by the proposed DNN is as good as the measurement in manually segmented images of the particles. The proposed DNN composition with the training methodology meticulously segments the particle and consequently provides accurate morphological analysis. Furthermore, the proposed network is tested on an embedded system for integration with the microscope hardware for real-time morphological analysis.

Artificial Proprioceptive Reflex Warning Using EMG in Advanced Driving Assistance System

A frequent cause of auto accidents is disregarding the proximal traffic of an ego-vehicle during lane changing. Presumably, in a split-second-decision situation we may prevent an accident by predicting the intention of a driver before her action onset using the neural signals data, meanwhile building the perception of surroundings of a vehicle using optical sensors. The prediction of an intended action fused with the perception can generate an instantaneous signal that may replenish the driver's ignorance about the surroundings. This study examines electromyography (EMG) signals to predict intention of a driver along perception building stack of an autonomous driving system (ADS) in building an advanced driving assistant system (ADAS). EMG are classified into left-turn and right-turn intended actions and lanes and object detection with camera and Lidar are used to detect vehicles approaching from behind. A warning issued before the action onset, can alert a driver and may save her from a fatal accident. The use of neural signals for intended action prediction is a novel addition to camera, radar and Lidar based ADAS systems. Furthermore, the study demonstrates efficacy of the proposed idea with experiments designed to classify online and offline EMG data in real-world settings with computation time and the latency of communicated warnings.

Employing automatic content recognition for teaching methodology analysis in classroom videos

A teacher plays a pivotal role in grooming a society and paves way for its social and economic developments. Teaching is a dynamic role and demands continuous adaptation. A teacher adopts teaching techniques suitable for a certain discipline and a situation. A thorough, detailed, and impartial observation of a teacher is a desideratum for adaptation of an effective teaching methodology and it is a laborious exercise. An automatic strategy for analyzing a teacher’s teaching methodology in a classroom environment is suggested in this work. The proposed strategy recognizes a teacher’s actions in videos while he is delivering lectures. In this study, 3D CNN and Conv2DLSTM with time-distributed layers are used for experimentation. A range of actions are recognized for a complete classroom session during experimentation and the reported results are considered effective for analysis of a teacher’s teaching technique.