A new discriminative collaborative representation-based classification method via l2 regularizations

An elastic competitive and discriminative collaborative representation method for image classification

Collaborative representation-based (CR) methods have become prevalent for pattern classification tasks, achieving formidable performance. Theoretically, we expect the learned class-specific representation of the correct class to be discriminative against others, with the representation of the correct class contributing dominantly in CR. However, most existing CR methods focus on improving discrimination while having a limited impact on enhancing the representation contribution of the correct category. In this work, we propose a novel CR approach for image classification called the elastic competitive and discriminative collaborative representation-based classifier (ECDCRC) to simultaneously strengthen representation contribution and discrimination of the correct class. The ECDCRC objective function penalizes two key terms by fully incorporating label information. The competitive term integrates the nearest subspace representation with corresponding elastic factors into the model, allowing each class to have varying competition intensities based on similarity with the query sample. This enhances the representation contribution of the correct class in CR. To further improve discrimination, the discriminative term introduces an elastic factor as a weight in the model to represent the gap between the query sample and the representation of each class. Moreover, instead of focusing on representation coefficients, the designed ECDCRC weights associated with representation components directly relate to the representation of each class, enabling more direct and precise discrimination improvement. Concurrently, sparsity is also enhanced through the two terms, further boosting model performance. Additionally, we propose a robust ECDCRC (R-ECDCRC) to handle image classification with noise. Extensive experiments on seven public databases demonstrate the proposed method's superior performance over related state-of-the-art CR methods.

Smooth Group L1/2 Regularization for Pruning Convolutional Neural Networks

In this paper, a novel smooth group L1/2 (SGL1/2) regularization method is proposed for pruning hidden nodes of the fully connected layer in convolution neural networks. Usually, the selection of nodes and weights is based on experience, and the convolution filter is symmetric in the convolution neural network. The main contribution of SGL1/2 is to try to approximate the weights to 0 at the group level. Therefore, we will be able to prune the hidden node if the corresponding weights are all close to 0. Furthermore, the feasibility analysis of this new method is carried out under some reasonable assumptions due to the smooth function. The numerical results demonstrate the superiority of the SGL1/2 method with respect to sparsity, without damaging the classification performance.

A Spatial Adaptive Algorithm Framework for Building Pattern Recognition Using Graph Convolutional Networks

Graph learning methods, especially graph convolutional networks, have been investigated for their potential applicability in many fields of study based on topological data. Their topological data processing capabilities have proven to be powerful. However, the relationships among separate entities include not only topological adjacency, but also correlation in vision, for example, the spatial vector data of buildings. In this study, we propose a spatial adaptive algorithm framework with a data-driven design to accomplish building group division and building group pattern recognition tasks, which is not sensitive to the difference in the spatial distribution of the buildings in various geographical regions. In addition, the algorithm framework has a multi-stage design, and processes the building group data from whole to parts, since the objective is closely related to multi-object detection on topological data. By using the graph convolution method and a deep neural network (DNN), the multitask model in this study can learn human thoughts through supervised training, and the whole process only depends upon the descriptive vector data of buildings without any ancillary data for building group partition. Experiments confirmed that the method for expressing buildings and the effect of the algorithm framework proposed are satisfactory. In summary, using deep learning methods to complete the tasks of building group division and building group pattern recognition is potentially effective, and the algorithm framework is worth further research.