1
|
Jing W, Lu L, Ou W. Semi-supervised non-negative matrix factorization with structure preserving for image clustering. Neural Netw 2025; 187:107340. [PMID: 40101552 DOI: 10.1016/j.neunet.2025.107340] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/23/2024] [Revised: 12/12/2024] [Accepted: 02/28/2025] [Indexed: 03/20/2025]
Abstract
Semi-supervised learning methods have wide applications thanks to the reasonable utilization for a part of label information of data. In recent years, non-negative matrix factorization (NMF) has received considerable attention because of its interpretability and practicality. Based on the advantages of semi-supervised learning and NMF, many semi-supervised NMF methods have been presented. However, these existing semi-supervised NMF methods construct a label matrix only containing elements 1 and 0 to represent the labeled data and further construct a label regularization, which neglects an intrinsic structure of NMF. To address the deficiency, in this paper, we propose a novel semi-supervised NMF method with structure preserving. Specifically, we first construct a new label matrix with weights and further construct a label constraint regularizer to both utilize the label information and maintain the intrinsic structure of NMF. Then, based on the label constraint regularizer, the basis images of labeled data are extracted for monitoring and modifying the basis images learning of all data by establishing a basis regularizer. Finally, incorporating the label constraint regularizer and the basis regularizer into NMF, we propose a new semi-supervised NMF method. To solve the optimization problem, a multiplicative updating algorithm is developed. The proposed method is applied to image clustering to test its performance. Experimental results on eight data sets demonstrate the effectiveness of the proposed method in contrast with state-of-the-art unsupervised and semi-supervised algorithms.
Collapse
Affiliation(s)
- Wenjing Jing
- School of Mathematical Sciences, Guizhou Normal University, Guiyang, 550025, People's Republic of China.
| | - Linzhang Lu
- School of Mathematical Sciences, Guizhou Normal University, Guiyang, 550025, People's Republic of China; School of Mathematical Sciences, Xiamen University, Xiamen, 361005, People's Republic of China.
| | - Weihua Ou
- School of Big Data and Computer Science, Guizhou Normal University, Guiyang, 550025, People's Republic of China.
| |
Collapse
|
2
|
Groma V, Madas B, Rauser F, Birschwilks M, Blume A, Real A, Murakas R, Michalik B, Paiva I, Sjømoen TM, Tkaczyk AH, Popic JM. Quantitative stakeholder-driven assessment of radiation protection issues via a PIANOFORTE online survey. RADIATION AND ENVIRONMENTAL BIOPHYSICS 2024; 63:307-322. [PMID: 39020222 PMCID: PMC11341616 DOI: 10.1007/s00411-024-01084-1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/28/2024] [Accepted: 07/07/2024] [Indexed: 07/19/2024]
Abstract
To enhance stakeholder engagement and foster the inclusion of interests of citizens in radiation protection research, a comprehensive online survey was developed within the framework of the European Partnership PIANOFORTE. This survey was performed in 2022 and presented an opportunity for a wide range of stakeholders to voice their opinions on research priorities in radiation protection for the foreseeable future. Simultaneously, it delved into pertinent issues surrounding general radiation protection. The PIANOFORTE e-survey was conducted in the English language, accommodating a diverse range of participants. Overall, 440 respondents provided their insights and feedback, representing a broad geographical reach encompassing 29 European countries, as well as Canada, China, Colombia, India, and the United States. To assess the outcomes, the Positive Matrix Factorization numerical model was applied, in addition to qualitative and quantitative assessment of individual responses, enabling the discernment of four distinct stakeholder groups with varying attitudes. While the questionnaire may not fully represent all stakeholders due to the limited respondent pool, it is noteworthy that approximately 70% of the participants were newcomers to comparable surveys, demonstrating a proactive attitude, a strong willingness to collaborate and the necessity to continuously engage with stakeholder groups. Among the individual respondents, distinct opinions emerged particularly regarding health effects of radiation exposure, medical use of radiation, radiation protection of workers and the public, as well as emergency and recovery preparedness and response. In cluster analysis, none of the identified groups had clear preferences concerning the prioritization of future radiation protection research topics.
Collapse
Affiliation(s)
- Veronika Groma
- Environmental Physics Department, HUN-REN Centre for Energy Research, Budapest, Hungary.
| | - Balázs Madas
- Environmental Physics Department, HUN-REN Centre for Energy Research, Budapest, Hungary.
| | | | | | - Andreas Blume
- Federal Office for Radiation Protection, BfS, Germany
| | - Almudena Real
- Research Centre on Energy, Environment and Technology, CIEMAT, Madrid, Spain
| | - Rein Murakas
- Faculty of Social Sciences, University of Tartu, Tartu, Estonia
- Faculty of Arts and Humanities, University of Tartu, Tartu, Estonia
- Rein Murakas Consulting, Tartu, Estonia
| | - Boguslaw Michalik
- Silesian Centre for Environmental Radioactivity, Central Mining Institute, Katowice, Poland
| | - Isabel Paiva
- Center for Nuclear Sciences and Technologies, Department of Nuclear Engineering and Sciences, Instituto Superior Técnico, University of Lisbon, Lisbon, Portugal
| | | | - Alan H Tkaczyk
- Institute of Technology, University of Tartu, Tartu, Estonia
| | | |
Collapse
|
3
|
Guan J, Chen B, Huang X. Community Detection via Autoencoder-Like Nonnegative Tensor Decomposition. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS 2024; 35:4179-4191. [PMID: 36170387 DOI: 10.1109/tnnls.2022.3201906] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/16/2023]
Abstract
Community detection aims at partitioning a network into several densely connected subgraphs. Recently, nonnegative matrix factorization (NMF) has been widely adopted in many successful community detection applications. However, most existing NMF-based community detection algorithms neglect the multihop network topology and the extreme sparsity of adjacency matrices. To resolve them, we propose a novel conception of adjacency tensor, which extends adjacency matrix to multihop cases. Then, we develop a novel tensor Tucker decomposition-based community detection method-autoencoder-like nonnegative tensor decomposition (ANTD), leveraging the constructed adjacency tensor. Distinct from simply applying tensor decomposition on the constructed adjacency tensor, which only works as a decoder, ANTD also introduces an encoder component to constitute an autoencoder-like architecture, which can further enhance the quality of the detected communities. We also develop an efficient alternative updating algorithm with convergence guarantee to optimize ANTD, and theoretically analyze the algorithm complexity. Moreover, we also study a graph regularized variant of ANTD. Extensive experiments on real-world benchmark networks by comparing 27 state-of-the-art methods, validate the effectiveness, efficiency, and robustness of our proposed methods.
Collapse
|
4
|
Luo X, Wang L, Hu P, Hu L. Predicting Protein-Protein Interactions Using Sequence and Network Information via Variational Graph Autoencoder. IEEE/ACM TRANSACTIONS ON COMPUTATIONAL BIOLOGY AND BIOINFORMATICS 2023; 20:3182-3194. [PMID: 37155405 DOI: 10.1109/tcbb.2023.3273567] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/10/2023]
Abstract
Protein-protein interactions (PPIs) play a critical role in the proteomics study, and a variety of computational algorithms have been developed to predict PPIs. Though effective, their performance is constrained by high false-positive and false-negative rates observed in PPI data. To overcome this problem, a novel PPI prediction algorithm, namely PASNVGA, is proposed in this work by combining the sequence and network information of proteins via variational graph autoencoder. To do so, PASNVGA first applies different strategies to extract the features of proteins from their sequence and network information, and obtains a more compact form of these features using principal component analysis. In addition, PASNVGA designs a scoring function to measure the higher-order connectivity between proteins and so as to obtain a higher-order adjacency matrix. With all these features and adjacency matrices, PASNVGA trains a variational graph autoencoder model to further learn the integrated embeddings of proteins. The prediction task is then completed by using a simple feedforward neural network. Extensive experiments have been conducted on five PPI datasets collected from different species. Compared with several state-of-the-art algorithms, PASNVGA has been demonstrated as a promising PPI prediction algorithm.
Collapse
|
5
|
Lu G, Leng C, Li B, Jiao L, Basu A. Robust dual-graph discriminative NMF for data classification. Knowl Based Syst 2023. [DOI: 10.1016/j.knosys.2023.110465] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 03/19/2023]
|
6
|
Chen D, Fang Z, Li S. A Novel BSO Algorithm for Three-Layer Neural Network Optimization Applied to UAV Edge Control. Neural Process Lett 2023. [DOI: 10.1007/s11063-023-11157-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/28/2023]
|
7
|
Liu M, Yang Z, Li L, Li Z, Xie S. Auto-weighted collective matrix factorization with graph dual regularization for multi-view clustering. Knowl Based Syst 2022. [DOI: 10.1016/j.knosys.2022.110145] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/27/2022]
|
8
|
Chen D, Li S. DRDNN: A robust model for time-variant nonlinear optimization under multiple equality and inequality constraints. Neurocomputing 2022. [DOI: 10.1016/j.neucom.2022.09.043] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/24/2022]
|
9
|
An elite approach for enhancement of LVRT in doubly fed induction generator (DFIG)-based wind energy conversion system (WECS): a FAMSANFIS approach. Soft comput 2022. [DOI: 10.1007/s00500-022-07419-8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/14/2022]
|
10
|
Fast multiplicative algorithms for symmetric nonnegative tensor factorization. Neurocomputing 2022. [DOI: 10.1016/j.neucom.2022.05.046] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/21/2022]
|
11
|
Wang C, Wang Z, Han F, Dong H, Liu H. A novel PID-like particle swarm optimizer: on terminal convergence analysis. COMPLEX INTELL SYST 2022. [DOI: 10.1007/s40747-021-00589-2] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/28/2022]
Abstract
AbstractIn this paper, a novel proportion-integral-derivative-like particle swarm optimization (PIDLPSO) algorithm is presented with improved terminal convergence of the particle dynamics. A derivative control term is introduced into the traditional particle swarm optimization (PSO) algorithm so as to alleviate the overshoot problem during the stage of the terminal convergence. The velocity of the particle is updated according to the past momentum, the present positions (including the personal best position and the global best position), and the future trend of the positions, thereby accelerating the terminal convergence and adjusting the search direction to jump out of the area around the local optima. By using a combination of the Routh stability criterion and the final value theorem of the Z-transformation, the convergence conditions are obtained for the developed PIDLPSO algorithm. Finally, the experiment results reveal the superiority of the designed PIDLPSO algorithm over several other state-of-the-art PSO variants in terms of the population diversity, searching ability and convergence rate.
Collapse
|
12
|
An improved generative adversarial network with modified loss function for crack detection in electromagnetic nondestructive testing. COMPLEX INTELL SYST 2022. [DOI: 10.1007/s40747-021-00477-9] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/20/2022]
Abstract
AbstractIn this paper, an improved generative adversarial network (GAN) is proposed for the crack detection problem in electromagnetic nondestructive testing (NDT). To enhance the contrast ratio of the generated image, two additional regulation terms are introduced in the loss function of the underlying GAN. By applying an appropriate threshold to the segmentation of the generated image, the real crack areas and the fake crack areas (which are affected by the noises) are accurately distinguished. Experiments are carried out to show the superiority of the improved GAN over the original one on crack detection tasks, where a real-world NDT dataset is exploited that consists of magnetic optical images obtained using the electromagnetic NDT technique.
Collapse
|
13
|
Li H, Qu J, Jiang X, Niu Y. A Correlation Analysis of Geomagnetic Field Characteristics in Geomagnetic Perceiving Navigation. Front Neurorobot 2021; 15:785563. [PMID: 35002669 PMCID: PMC8733244 DOI: 10.3389/fnbot.2021.785563] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/29/2021] [Accepted: 11/15/2021] [Indexed: 11/29/2022] Open
Abstract
It is well-known that geomagnetic fields have multiple components or parameters, and that these geomagnetic parameters are related to each other. In this paper, a parameter selection method is proposed, and this paper mainly discusses the correlation of geomagnetic field parameters for geomagnetic navigation technology. For the correlation analysis between geomagnetic parameters, the similarity calculation of the correlation coefficient is firstly introduced for geomagnetic navigation technology, and the grouped results are obtained by data analysis. At the same time, the search algorithm (Hex-path algorithm) is used to verify the correlation analysis results. The results show the same convergent state for the approximate correlation coefficient. In other words, the simulation results are in agreement with the similarity calculation results.
Collapse
Affiliation(s)
- Hong Li
- School of Automation, Xi'an University of Posts and Telecommunications, Xi'an, China
- Xi'an Key Laboratory of Advanced Control and Intelligent Process, School of Automation, Xi'an University of Posts and Telecommunications, Xi'an, China
| | - Junsuo Qu
- School of Automation, Xi'an University of Posts and Telecommunications, Xi'an, China
- Xi'an Key Laboratory of Advanced Control and Intelligent Process, School of Automation, Xi'an University of Posts and Telecommunications, Xi'an, China
| | - Xiangkui Jiang
- School of Automation, Xi'an University of Posts and Telecommunications, Xi'an, China
| | - Yun Niu
- School of Marine Science and Technology, Northwestern Polytechnical University, Xi'an, China
| |
Collapse
|
14
|
Tian L, Wang Z, Liu W, Cheng Y, Alsaadi FE, Liu X. Empower parameterized generative adversarial networks using a novel particle swarm optimizer: algorithms and applications. INT J MACH LEARN CYB 2021. [DOI: 10.1007/s13042-021-01440-3] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/29/2022]
Abstract
AbstractIn this paper, a novel parameterized generative adversarial network (GAN) is proposed where the parameters are introduced to enhance the performance of image segmentation. The developed algorithm is applied to the image-based crack detection problem on the thermal data obtained through the non-destructive testing process. A new regularization term, which contains three tunable hyperparameters, embedded into the objective function of the GAN in order to improve the contrast ratio of certain areas of the image so as to benefit the crack detection process. To automate the selection of the optimal hyperparameters of the GAN, a new particle swarm optimization (PSO) algorithm is put forward where a neighborhood-based velocity updating strategy is developed for the purpose of thoroughly exploring the problem space. The proposed PSO-based GAN algorithm is shown to 1) work well in detecting cracks on the thermal data generated by the eddy current pulsed thermography technique; and 2) outperforms other conventional GAN algorithms.
Collapse
|
15
|
Chen D, Cao X, Li S. A multi-constrained zeroing neural network for time-dependent nonlinear optimization with application to mobile robot tracking control. Neurocomputing 2021. [DOI: 10.1016/j.neucom.2021.06.089] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/21/2022]
|
16
|
Tian L, Wang Z, Liu W, Cheng Y, Alsaadi FE, Liu X. A New GAN-Based Approach to Data Augmentation and Image Segmentation for Crack Detection in Thermal Imaging Tests. Cognit Comput 2021. [DOI: 10.1007/s12559-021-09922-w] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/28/2022]
Abstract
AbstractAs a popular nondestructive testing (NDT) technique, thermal imaging test demonstrates competitive performance in crack detection, especially for detecting subsurface cracks. In thermal imaging test, the temperature of the crack area is higher than that of the non-crack area during the NDT process. By extracting the features of the thermal image sequences, the temperature curve of each spatial point is employed for crack detection. Nevertheless, the quality of thermal images is influenced by the noises due to the complex thermal environment in NDT. In this paper, a modified generative adversarial network (GAN) is employed to improve the image segmentation performance. To improve the feature extraction ability and alleviate the influence of noises, a penalty term is put forward in the loss function of the conventional GAN. A data preprocessing method is developed where the principle component analysis algorithm is adopted for feature extraction. The data argumentation technique is utilized to guarantee the quantity of the training samples. To validate its effectiveness in thermal imaging NDT, the modified GAN is applied to detect the cracks on the eddy current pulsed thermography NDT dataset.
Collapse
|