1
|
Zhong J, Cao W. Graph Geometric Algebra networks for graph representation learning. Sci Rep 2025; 15:170. [PMID: 39747327 PMCID: PMC11696881 DOI: 10.1038/s41598-024-84483-0] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/18/2024] [Accepted: 12/24/2024] [Indexed: 01/04/2025] Open
Abstract
Graph neural networks (GNNs) have emerged as a prominent approach for capturing graph topology and modeling vertex-to-vertex relationships. They have been widely used in pattern recognition tasks including node and graph label prediction. However, when dealing with graphs from non-Euclidean domains, the relationships, and interdependencies between objects become more complex. Existing GNNs face limitations in handling a large number of model parameters in such complex graphs. To address this, we propose the integration of Geometric Algebra into graph neural networks, enabling the generalization of GNNs within the geometric space to learn geometric embeddings for nodes and graphs. Our proposed Graph Geometric Algebra Network (GGAN) enhances correlations among nodes by leveraging relations within the Geometric Algebra space. This approach reduces model complexity and improves the learning of graph representations. Through extensive experiments on various benchmark datasets, we demonstrate that our models, utilizing the properties of Geometric Algebra operations, outperform state-of-the-art methods in graph classification and semi-supervised node classification tasks. Our theoretical findings are empirically validated, confirming that our model achieves state-of-the-art performance.
Collapse
Affiliation(s)
- Jianqi Zhong
- Guangdong Key Laboratory of Intelligent Information Processing, Shenzhen University, Shenzhen, 518060, China
- State Key Laboratory of Radio Frequency Heterogeneous Integration, Shenzhen University, Shenzhen, 518060, China
- College of Electronic and Information Engineering, Shenzhen University, Shenzhen, 518060, China
| | - Wenming Cao
- Guangdong Key Laboratory of Intelligent Information Processing, Shenzhen University, Shenzhen, 518060, China.
- State Key Laboratory of Radio Frequency Heterogeneous Integration, Shenzhen University, Shenzhen, 518060, China.
- College of Electronic and Information Engineering, Shenzhen University, Shenzhen, 518060, China.
| |
Collapse
|
2
|
Grattarola D, Zambon D, Bianchi FM, Alippi C. Understanding Pooling in Graph Neural Networks. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS 2024; 35:2708-2718. [PMID: 35862329 DOI: 10.1109/tnnls.2022.3190922] [Citation(s) in RCA: 8] [Impact Index Per Article: 8.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/15/2023]
Abstract
Many recent works in the field of graph machine learning have introduced pooling operators to reduce the size of graphs. In this article, we present an operational framework to unify this vast and diverse literature by describing pooling operators as the combination of three functions: selection, reduction, and connection (SRC). We then introduce a taxonomy of pooling operators, based on some of their key characteristics and implementation differences under the SRC framework. Finally, we propose three criteria to evaluate the performance of pooling operators and use them to investigate the behavior of different operators on a variety of tasks.
Collapse
|
3
|
Jin T, Liu J, Dai H, Li L, Liu F, Zhang Y. Ridge-Regression-Induced Robust Graph Relational Network. IEEE TRANSACTIONS ON CYBERNETICS 2023; 53:5631-5640. [PMID: 35427228 DOI: 10.1109/tcyb.2022.3163412] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/14/2023]
Abstract
Graph convolutional networks (GCNs) have attracted increasing research attention, which merits in its strong ability to handle graph data, such as the citation network or social network. Existing models typically use first-order neighborhood information to design specific convolution operations, which aggregate the features of all adjacent nodes. However, such models ignore the high-order spatial relationship among neighboring nodes in noisy data due to its modeling complexity. In this article, we propose a novel robust graph relational network to address this issue toward modeling high-order relationships in noisy data for graph convolution. Our key innovation lies in designing a generic relation network layer, which is used to infer the underlying relations among adjacent noisy nodes. Specifically, a fixed number of adjacent nodes for each node is chosen by solving the ridge regression problem, in which the regression coefficients are used to rank the adjacent nodes of each node in a graph. Furthermore, to mine the rich features, we extract high-order information from the nodes to significantly enhance the representation ability of the GCNs for extensive applications. We conduct extensive semisupervised node classification experiments on the noisy benchmark datasets, which clearly show that our model is superior to the existing methods and can achieve state-of-the-art performance.
Collapse
|
4
|
Huang C, Li M, Cao F, Fujita H, Li Z, Wu X. Are Graph Convolutional Networks With Random Weights Feasible? IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE 2023; 45:2751-2768. [PMID: 35704541 DOI: 10.1109/tpami.2022.3183143] [Citation(s) in RCA: 10] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/15/2023]
Abstract
Graph Convolutional Networks (GCNs), as a prominent example of graph neural networks, are receiving extensive attention for their powerful capability in learning node representations on graphs. There are various extensions, either in sampling and/or node feature aggregation, to further improve GCNs' performance, scalability and applicability in various domains. Still, there is room for further improvements on learning efficiency because performing batch gradient descent using the full dataset for every training iteration, as unavoidable for training (vanilla) GCNs, is not a viable option for large graphs. The good potential of random features in speeding up the training phase in large-scale problems motivates us to consider carefully whether GCNs with random weights are feasible. To investigate theoretically and empirically this issue, we propose a novel model termed Graph Convolutional Networks with Random Weights (GCN-RW) by revising the convolutional layer with random filters and simultaneously adjusting the learning objective with regularized least squares loss. Theoretical analyses on the model's approximation upper bound, structure complexity, stability and generalization, are provided with rigorous mathematical proofs. The effectiveness and efficiency of GCN-RW are verified on semi-supervised node classification task with several benchmark datasets. Experimental results demonstrate that, in comparison with some state-of-the-art approaches, GCN-RW can achieve better or matched accuracies with less training time cost.
Collapse
|
5
|
DPGNN: Dual-perception graph neural network for representation learning. Knowl Based Syst 2023. [DOI: 10.1016/j.knosys.2023.110377] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/27/2023]
|
6
|
Wang T, Yang J, Xiao Y, Wang J, Wang Y, Zeng X, Wang Y, Peng J. DFinder: a novel end-to-end graph embedding-based method to identify drug-food interactions. Bioinformatics 2022; 39:6965015. [PMID: 36579885 PMCID: PMC9828147 DOI: 10.1093/bioinformatics/btac837] [Citation(s) in RCA: 6] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/21/2022] [Revised: 11/07/2022] [Accepted: 12/28/2022] [Indexed: 12/30/2022] Open
Abstract
MOTIVATION Drug-food interactions (DFIs) occur when some constituents of food affect the bioaccessibility or efficacy of the drug by involving in drug pharmacodynamic and/or pharmacokinetic processes. Many computational methods have achieved remarkable results in link prediction tasks between biological entities, which show the potential of computational methods in discovering novel DFIs. However, there are few computational approaches that pay attention to DFI identification. This is mainly due to the lack of DFI data. In addition, food is generally made up of a variety of chemical substances. The complexity of food makes it difficult to generate accurate feature representations for food. Therefore, it is urgent to develop effective computational approaches for learning the food feature representation and predicting DFIs. RESULTS In this article, we first collect DFI data from DrugBank and PubMed, respectively, to construct two datasets, named DrugBank-DFI and PubMed-DFI. Based on these two datasets, two DFI networks are constructed. Then, we propose a novel end-to-end graph embedding-based method named DFinder to identify DFIs. DFinder combines node attribute features and topological structure features to learn the representations of drugs and food constituents. In topology space, we adopt a simplified graph convolution network-based method to learn the topological structure features. In feature space, we use a deep neural network to extract attribute features from the original node attributes. The evaluation results indicate that DFinder performs better than other baseline methods. AVAILABILITY AND IMPLEMENTATION The source code is available at https://github.com/23AIBox/23AIBox-DFinder. SUPPLEMENTARY INFORMATION Supplementary data are available at Bioinformatics online.
Collapse
Affiliation(s)
- Tao Wang
- School of Computer Science, Northwestern Polytechnical University, Xi’an 710072, China,Key Laboratory of Big Data Storage and Management, Northwestern Polytechnical University, Ministry of Industry and Information Technology, Xi’an 710072, China
| | - Jinjin Yang
- School of Computer Science, Northwestern Polytechnical University, Xi’an 710072, China,Key Laboratory of Big Data Storage and Management, Northwestern Polytechnical University, Ministry of Industry and Information Technology, Xi’an 710072, China
| | - Yifu Xiao
- School of Computer Science, Northwestern Polytechnical University, Xi’an 710072, China,Key Laboratory of Big Data Storage and Management, Northwestern Polytechnical University, Ministry of Industry and Information Technology, Xi’an 710072, China
| | - Jingru Wang
- School of Computer Science, Northwestern Polytechnical University, Xi’an 710072, China,Key Laboratory of Big Data Storage and Management, Northwestern Polytechnical University, Ministry of Industry and Information Technology, Xi’an 710072, China
| | - Yuxian Wang
- School of Computer Science, Northwestern Polytechnical University, Xi’an 710072, China,Key Laboratory of Big Data Storage and Management, Northwestern Polytechnical University, Ministry of Industry and Information Technology, Xi’an 710072, China
| | - Xi Zeng
- School of Computer Science, Northwestern Polytechnical University, Xi’an 710072, China,Key Laboratory of Big Data Storage and Management, Northwestern Polytechnical University, Ministry of Industry and Information Technology, Xi’an 710072, China
| | - Yongtian Wang
- School of Computer Science, Northwestern Polytechnical University, Xi’an 710072, China,Key Laboratory of Big Data Storage and Management, Northwestern Polytechnical University, Ministry of Industry and Information Technology, Xi’an 710072, China
| | | |
Collapse
|
7
|
Zhao Q, Zhang H, He M, Li W, Kang C, Han M. Graph pooling via Dual-view Multi-level Infomax. Knowl Based Syst 2022. [DOI: 10.1016/j.knosys.2022.110089] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/09/2022]
|
8
|
Industry classification based on supply chain network information using Graph Neural Networks. Appl Soft Comput 2022. [DOI: 10.1016/j.asoc.2022.109849] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/29/2022]
|
9
|
Multimodal heterogeneous graph attention network. Neural Comput Appl 2022. [DOI: 10.1007/s00521-022-07862-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/17/2022]
|
10
|
Gao Y, Tang Y, Zhang H, Yang Y, Dong T, Jia Q. Sex Differences of Cerebellum and Cerebrum: Evidence from Graph Convolutional Network. Interdiscip Sci 2022; 14:532-544. [PMID: 35103919 DOI: 10.1007/s12539-021-00498-5] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/10/2021] [Revised: 12/21/2021] [Accepted: 12/24/2021] [Indexed: 06/14/2023]
Abstract
This work aims to exploit a novel graph neural network to predict the sex of the brain topological network, and to find the sex differences in the cerebrum and cerebellum. A two-branch multi-scale graph convolutional network (TMGCN) is designed to analyze the sex differences of the brain. Two complementary templates are used to construct cerebrum and cerebellum networks, respectively, followed by a two-branch sub-network with multi-scale filters and a trainable weighted fusion strategy for the final prediction. Finally, a trainable graph topk-pooling layer is utilized in our model to visualize key brain regions relevant to the prediction. The proposed TMGCN achieves a prediction accuracy of 84.48%. In the cerebellum, the bilateral Crus I-II, lobule VI and VIIb, and the posterior vermis (VI-X) are discriminative for this task. As for the cerebrum, the discriminative brain regions consist of the bilateral inferior temporal gyrus, the bilateral fusiform gyrus, the bilateral parahippocampal gyrus, the bilateral cingulate gyrus, the bilateral medial ventral occipital cortex, the bilateral lateral occipital cortex, the bilateral amygdala, and the bilateral hippocampus. This study tackles the sex prediction problem from a more comprehensive view, and may provide the resting-state fMRI evidence for further study of sex differences in the cerebellum and cerebrum.
Collapse
Affiliation(s)
- Yang Gao
- School of Computer Science and Engineering, Central South University, Changsha, China
| | - Yan Tang
- School of Computer Science and Engineering, Central South University, Changsha, China.
| | - Hao Zhang
- School of Computer Science and Engineering, Central South University, Changsha, China.
| | - Yuan Yang
- Stephenson School of Biomedical Engineering, The University of Oklahoma, Tulsa, USA
| | - Tingting Dong
- School of Computer Science and Engineering, Central South University, Changsha, China
| | - Qiaolan Jia
- School of Computer Science and Engineering, Central South University, Changsha, China
| |
Collapse
|
11
|
Chen X, Zhou F, Trajcevski G, Bonsangue M. Multi-view learning with distinguishable feature fusion for rumor detection. Knowl Based Syst 2022. [DOI: 10.1016/j.knosys.2021.108085] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/15/2022]
|
12
|
Han Z, Huang Q, Zhang J, Huang C, Wang H, Huang X. GA-GWNN: Detecting anomalies of online learners by granular computing and graph wavelet convolutional neural network. APPL INTELL 2022. [DOI: 10.1007/s10489-022-03337-2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/02/2022]
|
13
|
Local2Global: Unsupervised multi-view deep graph representation learning with Nearest Neighbor Constraint. Knowl Based Syst 2021. [DOI: 10.1016/j.knosys.2021.107439] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/19/2022]
|
14
|
Wu L, Wang D, Song K, Feng S, Zhang Y, Yu G. Dual-view hypergraph neural networks for attributed graph learning. Knowl Based Syst 2021. [DOI: 10.1016/j.knosys.2021.107185] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/21/2022]
|
15
|
Graph classification based on skeleton and component features. Knowl Based Syst 2021. [DOI: 10.1016/j.knosys.2021.107301] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/22/2022]
|
16
|
Liu W, Gong M, Tang Z. ETINE: Enhanced Textual Information Network Embedding. Knowl Based Syst 2021. [DOI: 10.1016/j.knosys.2021.106917] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/25/2022]
|
17
|
Park C, Han J, Yu H. Deep multiplex graph infomax: Attentive multiplex network embedding using global information. Knowl Based Syst 2020. [DOI: 10.1016/j.knosys.2020.105861] [Citation(s) in RCA: 17] [Impact Index Per Article: 3.4] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/30/2022]
|