1
|
Zhang K, Xu G, Jin YK, Qi G, Yang X, Bai L. Palmprint recognition based on gating mechanism and adaptive feature fusion. Front Neurorobot 2023; 17:1203962. [PMID: 37304664 PMCID: PMC10251403 DOI: 10.3389/fnbot.2023.1203962] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/11/2023] [Accepted: 05/08/2023] [Indexed: 06/13/2023] Open
Abstract
As a type of biometric recognition, palmprint recognition uses unique discriminative features on the palm of a person to identify his/her identity. It has attracted much attention because of its advantages of contactlessness, stability, and security. Recently, many palmprint recognition methods based on convolutional neural networks (CNN) have been proposed in academia. Convolutional neural networks are limited by the size of the convolutional kernel and lack the ability to extract global information of palmprints. This paper proposes a framework based on the integration of CNN and Transformer-GLGAnet for palmprint recognition, which can take advantage of CNN's local information extraction and Transformer's global modeling capabilities. A gating mechanism and an adaptive feature fusion module are also designed for palmprint feature extraction. The gating mechanism filters features by a feature selection algorithm and the adaptive feature fusion module fuses them with the features extracted by the backbone network. Through extensive experiments on two datasets, the experimental results show that the recognition accuracy is 98.5% for 12,000 palmprints in the Tongji University dataset and 99.5% for 600 palmprints in the Hong Kong Polytechnic University dataset. This demonstrates that the proposed method outperforms existing methods in the correctness of both palmprint recognition tasks. The source codes will be available on https://github.com/Ywatery/GLnet.git.
Collapse
Affiliation(s)
- Kaibi Zhang
- School of Automation, Chongqing University of Posts and Telecommunications, Chongqing, China
| | - Guofeng Xu
- School of Automation, Chongqing University of Posts and Telecommunications, Chongqing, China
- Department of Integrated Chinese and Western Medicine, The Second Affiliated Hospital of Chongqing Medical University, Chongqing, China
| | - Ye Kelly Jin
- College of Business and Economics, California State University, Los Angeles, CA, United States
- Double Deuce Sports, Bowling Green, KY, United States
| | - Guanqiu Qi
- Computer Information Systems Department, State University of New York at Buffalo State, Buffalo, NY, United States
| | - Xun Yang
- China Merchants Chongqing Communications Research and Design Institute Co., Ltd., Chongqing, China
| | - Litao Bai
- Department of Integrated Chinese and Western Medicine, The Second Affiliated Hospital of Chongqing Medical University, Chongqing, China
| |
Collapse
|
2
|
Dong S, Du J, Jiao L, Wang F, Liu K, Teng Y, Wang R. Automatic Crop Pest Detection Oriented Multiscale Feature Fusion Approach. Insects 2022; 13:insects13060554. [PMID: 35735891 PMCID: PMC9225132 DOI: 10.3390/insects13060554] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 04/30/2022] [Revised: 06/14/2022] [Accepted: 06/16/2022] [Indexed: 02/04/2023]
Abstract
Specialized pest control for agriculture is a high-priority agricultural issue. There are multiple categories of tiny pests, which pose significant challenges to monitoring. Previous work mainly relied on manual monitoring of pests, which was labor-intensive and time-consuming. Recently, deep-learning-based pest detection methods have achieved remarkable improvements and can be used for automatic pest monitoring. However, there are two main obstacles in the task of pest detection. (1) Small pests often go undetected because much information is lost during the network training process. (2) The highly similar physical appearances of some categories of pests make it difficult to distinguish the specific categories for networks. To alleviate the above problems, we proposed the multi-category pest detection network (MCPD-net), which includes a multiscale feature pyramid network (MFPN) and a novel adaptive feature region proposal network (AFRPN). MFPN can fuse the pest information in multiscale features, which significantly improves detection accuracy. AFRPN solves the problem of anchor and feature misalignment during RPN iterating, especially for small pest objects. In extensive experiments on the multi-category pests dataset 2021 (MPD2021), the proposed method achieved 67.3% mean average precision (mAP) and 89.3% average recall (AR), outperforming other deep learning-based models.
Collapse
Affiliation(s)
- Shifeng Dong
- Institute of Intelligent Machines, Hefei Institutes of Physical Science, Chinese Academy of Sciences, Hefei 230031, China; (S.D.); (F.W.); (K.L.); (Y.T.); (R.W.)
- Science Island Branch of Graduate School, University of Science and Technology of China, Hefei 230026, China
| | - Jianming Du
- Institute of Intelligent Machines, Hefei Institutes of Physical Science, Chinese Academy of Sciences, Hefei 230031, China; (S.D.); (F.W.); (K.L.); (Y.T.); (R.W.)
- Correspondence: (J.D.); (L.J.)
| | - Lin Jiao
- Institute of Intelligent Machines, Hefei Institutes of Physical Science, Chinese Academy of Sciences, Hefei 230031, China; (S.D.); (F.W.); (K.L.); (Y.T.); (R.W.)
- School of Internet, Anhui Unviersity, Hefei 230039, China
- Correspondence: (J.D.); (L.J.)
| | - Fenmei Wang
- Institute of Intelligent Machines, Hefei Institutes of Physical Science, Chinese Academy of Sciences, Hefei 230031, China; (S.D.); (F.W.); (K.L.); (Y.T.); (R.W.)
- Science Island Branch of Graduate School, University of Science and Technology of China, Hefei 230026, China
| | - Kang Liu
- Institute of Intelligent Machines, Hefei Institutes of Physical Science, Chinese Academy of Sciences, Hefei 230031, China; (S.D.); (F.W.); (K.L.); (Y.T.); (R.W.)
- Science Island Branch of Graduate School, University of Science and Technology of China, Hefei 230026, China
| | - Yue Teng
- Institute of Intelligent Machines, Hefei Institutes of Physical Science, Chinese Academy of Sciences, Hefei 230031, China; (S.D.); (F.W.); (K.L.); (Y.T.); (R.W.)
- Science Island Branch of Graduate School, University of Science and Technology of China, Hefei 230026, China
| | - Rujing Wang
- Institute of Intelligent Machines, Hefei Institutes of Physical Science, Chinese Academy of Sciences, Hefei 230031, China; (S.D.); (F.W.); (K.L.); (Y.T.); (R.W.)
- Science Island Branch of Graduate School, University of Science and Technology of China, Hefei 230026, China
| |
Collapse
|
3
|
Zhou L, Wang H, Jin Y, Hu Z, Wei Q, Li J, Li J. Robust Visual Tracking Based on Adaptive Multi-Feature Fusion Using the Tracking Reliability Criterion. Sensors (Basel) 2020; 20:s20247165. [PMID: 33327523 PMCID: PMC7764914 DOI: 10.3390/s20247165] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 10/25/2020] [Revised: 12/08/2020] [Accepted: 12/12/2020] [Indexed: 11/16/2022]
Abstract
Multi-resolution feature fusion DCF (Discriminative Correlation Filter) methods have significantly advanced the object tracking performance. However, careless choice and fusion of sample features make the algorithm susceptible to interference, leading to tracking failure. Some trackers embed the re-detection module to remedy tracking failures, yet distinguishing ability and stability of the sample features are scarcely considered when training the detector, resulting in low effectiveness detection. Firstly, this paper proposes a criterion of feature tracking reliability and conduct a novel feature adaptive fusion framework. The feature tracking reliability criterion is proposed to evaluate the robustness and distinguishing ability of the sample features. Secondly, a re-detection module is proposed to further avoid tracking failures and increase the accuracy of target re-detection. The re-detection module consists of multiple SVM detectors trained by different sample features. When the tracking fails, the SVM detector trained by the most reliable sample feature will be activated to recover the target and adjust the target position. Finally, comparison experiments on OTB2015 and UAV123 databases demonstrate the accuracy and robustness of the proposed method.
Collapse
Affiliation(s)
- Lin Zhou
- School of Computer and Information Engineering, Henan University, Kaifeng 475004, China; (L.Z.); (Y.J.); (Z.H.); (Q.W.); (J.L.)
| | - Han Wang
- School of Computer and Information Engineering, Henan University, Kaifeng 475004, China; (L.Z.); (Y.J.); (Z.H.); (Q.W.); (J.L.)
- Correspondence:
| | - Yong Jin
- School of Computer and Information Engineering, Henan University, Kaifeng 475004, China; (L.Z.); (Y.J.); (Z.H.); (Q.W.); (J.L.)
| | - Zhentao Hu
- School of Computer and Information Engineering, Henan University, Kaifeng 475004, China; (L.Z.); (Y.J.); (Z.H.); (Q.W.); (J.L.)
| | - Qian Wei
- School of Computer and Information Engineering, Henan University, Kaifeng 475004, China; (L.Z.); (Y.J.); (Z.H.); (Q.W.); (J.L.)
| | - Junwei Li
- School of Computer and Information Engineering, Henan University, Kaifeng 475004, China; (L.Z.); (Y.J.); (Z.H.); (Q.W.); (J.L.)
| | - Jifang Li
- School of Electrical Engineering, North China University of Water Resources and Electric Power, Zhengzhou 450000, China;
| |
Collapse
|