Semi-supervised regression using diffusion on graphs

Local Cross-Patch Activation From Multi-Direction for Weakly Supervised Object Localization

Weakly supervised object localization (WSOL) learns to localize objects using only image-level labels. Recently, some studies apply transformers in WSOL to capture the long-range feature dependency and alleviate the partial activation issue of CNN-based methods. However, existing transformer-based methods still face two challenges. The first challenge is the over-activation of backgrounds. Specifically, the object boundaries and background are often semantically similar, and localization models may misidentify the background as a part of objects. The second challenge is the incomplete activation of occluded objects, since transformer architecture makes it difficult to capture local features across patches due to ignoring semantic and spatial coherence. To address these issues, in this paper, we propose LCA-MD, a novel transformer-based WSOL method using local cross-patch activation from multi-direction, which can capture more details of local features while inhibiting the background over-activation. In LCA-MD, first, combining contrastive learning with the transformer, we propose a token feature contrast module (TCM) that can maximize the difference between foregrounds and backgrounds and further separate them more accurately. Second, we propose a semantic-spatial fusion module (SFM), which leverages multi-directional perception to capture the local cross-patch features and diffuse activation across occlusions. Experiment results on the CUB-200-2011 and ILSVRC datasets demonstrate that our LCA-MD is significantly superior and has achieved state-of-the-art results in WSOL. The project code is available at https://github.com/rjy-fighting/LCA-MD.

A robust semi-supervised regressor with correntropy-induced manifold regularization and adaptive graph

For semi-supervised regression tasks, most existing methods ignore the impact of noise. However, the data inevitably contain noise. Therefore, this study proposes a novel correntropy-induced semi-supervised regression (CSSR) method that mitigates the adverse effects of noise. To implement the robustness of CSSR, a novel correntropy-induced manifold regularization (CMR) and a correntropy-induced adaptive graph (CAG) are designed. Specifically, CMR is inspired by the principles of correntropy and aims to learn a graph representation, whereas CAG inherits the robust characteristics of the correntropy metric and adaptively constructs an adjacency matrix. Finally, by incorporating CMR, CAG, and the correntropy-induced loss seamlessly, CSSR demonstrates the ability to deliver promising joint performance. The final solution of CSSR is achieved through an iterative process. Moreover, we validated the convergence of CSSR through a combination of theoretical analyses and empirical experiments. The experimental evaluation encompassed three synthetic, 15 benchmark, and two image datasets. The findings demonstrate that CSSR surpasses similar methods in the realm of semi-supervised regression tasks, demonstrating its effectiveness and robustness.

Semi-Supervised Deep Learning-Based Multi-component Spectral Calibration Modeling for UV-vis and Near-Infrared Spectroscopy without Information Loss

Spectral analysis is an important method for characterizing and identifying chemical species. However, quantitative spectral analysis of multiple chemical properties in the real world has always been a challenging problem due to the strong correlation, massive noise, and serious information overlapping of the spectral features. Here, we present a new semi-supervised spectral calibration method based on information lossless decoupling of spectral features named NICEM. To realize the separation and extraction of key latent features, the method uses the flow-based model non-linear independent component estimation (NICE) to learn the sample distribution. The spectral data information is transformed into independent latent variables obeying Gaussian distribution by the reversible structure of deep network without information loss, so as to find the essential properties and realize the feature nonlinear decomposition. Moreover, the association between the input latent feature variables and attributes is evaluated by the maximum mutual information coefficient to eliminate the adverse effects of irrelevant information in the latent variable space and mine key information. Since the latent variables are independent in each dimension, the NICEM method is easier to establish an accurate semi-supervised multi-component calibration model even for high overlapping and complex spectral data. The applicability of the proposed spectral modeling method is demonstrated by using three ultraviolet-visible and near-infrared spectral data sets with 15 physical and chemical properties including diesel fuels, corn, and multi-metal ions solution. Results show that the proposed NICEM method has the highest determination coefficient (R2) and significantly improves extrapolation compared with the seven state-of-the-art methods. The proposed method is intuitive because it obviates complex feature engineering and prior knowledge and is a promising spectral calibration tool for quantitative analysis in other spectroscopy applications.