Pseudo distribution on unseen classes for generalized zero shot learning

Imaginary-Connected Embedding in Complex Space for Unseen Attribute-Object Discrimination

Compositional Zero-Shot Learning (CZSL) aims to recognize novel compositions of seen primitives. Prior studies have attempted to either learn primitives individually (non-connected) or establish dependencies among them in the composition (fully-connected). In contrast, human comprehension of composition diverges from the aforementioned methods as humans possess the ability to make composition-aware adaptation for these primitives, instead of inferring them rigidly through the aforementioned methods. However, developing a comprehension of compositions akin to human cognition proves challenging within the confines of real space. This arises from the limitation of real-space-based methods, which often categorize attributes, objects, and compositions using three independent measures, without establishing a direct dynamic connection. To tackle this challenge, we expand the CZSL distance metric scheme to encompass complex spaces to unify the independent measures, and we establish an imaginary-connected embedding in complex space to model human understanding of attributes. To achieve this representation, we introduce an innovative visual bias-based attribute extraction module that selectively extracts attributes based on object prototypes. As a result, we are able to incorporate phase information in training and inference, serving as a metric for attribute-object dependencies while preserving the independent acquisition of primitives. We evaluate the effectiveness of our proposed approach on three benchmark datasets, illustrating its superiority compared to baseline methods.

Concurrent control chart pattern recognition in manufacturing processes based on zero-shot learning

In real industrial settings, collecting and labeling concurrent abnormal control chart pattern (CCP) samples are challenging, thereby hindering the effectiveness of current CCP recognition (CCPR) methods. This paper introduces zero-shot learning into quality control, proposing an intelligent model for recognizing zero-shot concurrent CCPs (C-CCPs). A multiscale ordinal pattern (OP) feature considering data sequential relationship is proposed. Drawing from expert knowledge, an attribute description space (ADS) is established to infer from single CCPs to C-CCPs. An ADS is embedded between features and labels, and the attribute classifier associates the features and attributes of CCPs. Experimental results demonstrate an accuracy of 98.73 % for 11 unseen C-CCPs and an overall accuracy of 98.89 % for all 19 CCPs, without C-CCP samples in training. Compared with other features, the multiscale OP feature has the best recognition effect on unseen C-CCPs.

A Review of Generalized Zero-Shot Learning Methods

Generalized zero-shot learning (GZSL) aims to train a model for classifying data samples under the condition that some output classes are unknown during supervised learning. To address this challenging task, GZSL leverages semantic information of the seen (source) and unseen (target) classes to bridge the gap between both seen and unseen classes. Since its introduction, many GZSL models have been formulated. In this review paper, we present a comprehensive review on GZSL. First, we provide an overview of GZSL including the problems and challenges. Then, we introduce a hierarchical categorization for the GZSL methods and discuss the representative methods in each category. In addition, we discuss the available benchmark data sets and applications of GZSL, along with a discussion on the research gaps and directions for future investigations.

Dual discriminative auto-encoder network for zero shot image recognition

Zero Shot learning (ZSL) aims to use the information of seen classes to recognize unseen classes, which is achieved by transferring knowledge of the seen classes from the semantic embeddings. Since the domains of the seen and unseen classes do not overlap, most ZSL algorithms often suffer from domain shift problem. In this paper, we propose a Dual Discriminative Auto-encoder Network (DDANet), in which visual features and semantic attributes are self-encoded by using the high dimensional latent space instead of the feature space or the low dimensional semantic space. In the embedded latent space, the features are projected to both preserve their original semantic meanings and have discriminative characteristics, which are realized by applying dual semantic auto-encoder and discriminative feature embedding strategy. Moreover, the cross modal reconstruction is applied to obtain interactive information. Extensive experiments are conducted on four popular datasets and the results demonstrate the superiority of this method.