1
|
Zhang W, Braden BB, Miranda G, Shu K, Wang S, Liu H, Wang Y. Integrating Multimodal and Longitudinal Neuroimaging Data with Multi-Source Network Representation Learning. Neuroinformatics 2021; 20:301-316. [PMID: 33978926 PMCID: PMC8586043 DOI: 10.1007/s12021-021-09523-w] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 03/31/2021] [Indexed: 11/29/2022]
Abstract
Uncovering the complex network of the brain is of great interest to the field of neuroimaging. Mining from these rich datasets, scientists try to unveil the fundamental biological mechanisms in the human brain. However, neuroimaging data collected for constructing brain networks is generally costly, and thus extracting useful information from a limited sample size of brain networks is demanding. Currently, there are two common trends in neuroimaging data collection that could be exploited to gain more information: 1) multimodal data, and 2) longitudinal data. It has been shown that these two types of data provide complementary information. Nonetheless, it is challenging to learn brain network representations that can simultaneously capture network properties from multimodal as well as longitudinal datasets. Here we propose a general fusion framework for multi-source learning of brain networks - multimodal brain network fusion with longitudinal coupling (MMLC). In our framework, three layers of information are considered, including cross-sectional similarity, multimodal coupling, and longitudinal consistency. Specifically, we jointly factorize multimodal networks and construct a rotation-based constraint to couple network variance across time. We also adopt the consensus factorization as the group consistent pattern. Using two publicly available brain imaging datasets, we demonstrate that MMLC may better predict psychometric scores than some other state-of-the-art brain network representation learning algorithms. Additionally, the discovered significant brain regions are synergistic with previous literature. Our new approach may boost statistical power and sheds new light on neuroimaging network biomarkers for future psychometric prediction research by integrating longitudinal and multimodal neuroimaging data.
Collapse
Affiliation(s)
- Wen Zhang
- School of Computing, Informatics, and Decision Systems Engineering, Arizona State University, P.O. Box 878809, Tempe, AZ, 85287, USA
| | - B Blair Braden
- College of Health Solutions, Arizona State University, Tempe, AZ, USA
| | - Gustavo Miranda
- School of Computing, Informatics, and Decision Systems Engineering, Arizona State University, P.O. Box 878809, Tempe, AZ, 85287, USA
| | - Kai Shu
- Department of Computer Science, Illinois Institute of Technology, 10 W. 31st Street Room 226D, Chicago, IL, 60616, USA
| | - Suhang Wang
- College of Information Sciences and Technology, Penn State University, E397 Westgate Building, University Park, PA, 16802, USA
| | - Huan Liu
- School of Computing, Informatics, and Decision Systems Engineering, Arizona State University, P.O. Box 878809, Tempe, AZ, 85287, USA
| | - Yalin Wang
- School of Computing, Informatics, and Decision Systems Engineering, Arizona State University, P.O. Box 878809, Tempe, AZ, 85287, USA.
| |
Collapse
|
2
|
Chen J, Han G, Cai H, Yang D, Laurienti PJ, Styner M, Wu G. Learning Common Harmonic Waves on Stiefel Manifold - A New Mathematical Approach for Brain Network Analyses. IEEE TRANSACTIONS ON MEDICAL IMAGING 2021; 40:419-430. [PMID: 33021935 PMCID: PMC7838011 DOI: 10.1109/tmi.2020.3029063] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/04/2023]
Abstract
Converging evidence shows that disease-relevant brain alterations do not appear in random brain locations, instead, their spatial patterns follow large-scale brain networks. In this context, a powerful network analysis approach with a mathematical foundation is indispensable to understand the mechanisms of neuropathological events as they spread through the brain. Indeed, the topology of each brain network is governed by its native harmonic waves, which are a set of orthogonal bases derived from the Eigen-system of the underlying Laplacian matrix. To that end, we propose a novel connectome harmonic analysis framework that provides enhanced mathematical insights by detecting frequency-based alterations relevant to brain disorders. The backbone of our framework is a novel manifold algebra appropriate for inference across harmonic waves. This algebra overcomes the limitations of using classic Euclidean operations on irregular data structures. The individual harmonic differences are measured by a set of common harmonic waves learned from a population of individual Eigen-systems, where each native Eigen-system is regarded as a sample drawn from the Stiefel manifold. Specifically, a manifold optimization scheme is tailored to find the common harmonic waves, which reside at the center of the Stiefel manifold. To that end, the common harmonic waves constitute a new set of neurobiological bases to understand disease progression. Each harmonic wave exhibits a unique propagation pattern of neuropathological burden spreading across brain networks. The statistical power of our novel connectome harmonic analysis approach is evaluated by identifying frequency-based alterations relevant to Alzheimer's disease, where our learning-based manifold approach discovers more significant and reproducible network dysfunction patterns than Euclidean methods.
Collapse
|
3
|
Gao Z, Wang X, Sun S, Wu D, Bai J, Yin Y, Liu X, Zhang H, de Albuquerque VHC. Learning physical properties in complex visual scenes: An intelligent machine for perceiving blood flow dynamics from static CT angiography imaging. Neural Netw 2020; 123:82-93. [DOI: 10.1016/j.neunet.2019.11.017] [Citation(s) in RCA: 47] [Impact Index Per Article: 9.4] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/26/2019] [Revised: 10/22/2019] [Accepted: 11/19/2019] [Indexed: 02/06/2023]
|
4
|
Zhang W, Shu K, Wang S, Liu H, Wang Y. Multimodal Fusion of Brain Networks with Longitudinal Couplings. MEDICAL IMAGE COMPUTING AND COMPUTER-ASSISTED INTERVENTION : MICCAI ... INTERNATIONAL CONFERENCE ON MEDICAL IMAGE COMPUTING AND COMPUTER-ASSISTED INTERVENTION 2018; 11072:3-11. [PMID: 30272058 DOI: 10.1007/978-3-030-00931-1_1] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Subscribe] [Scholar Register] [Indexed: 12/12/2022]
Abstract
In recent years, brain network analysis has attracted considerable interests in the field of neuroimaging analysis. It plays a vital role in understanding biologically fundamental mechanisms of human brains. As the upward trend of multi-source in neuroimaging data collection, effective learning from the different types of data sources, e.g. multimodal and longitudinal data, is much in demand. In this paper, we propose a general coupling framework, the multimodal neuroimaging network fusion with longitudinal couplings (MMLC), to learn the latent representations of brain networks. Specifically, we jointly factorize multimodal networks, assuming a linear relationship to couple network variance across time. Experimental results on two large datasets demonstrate the effectiveness of the proposed framework. The new approach integrates information from longitudinal, multimodal neuroimaging data and boosts statistical power to predict psychometric evaluation measures.
Collapse
Affiliation(s)
- Wen Zhang
- School of Computing, Informatics and Decision Systems Engineering, Arizona State University, Tempe, AZ, USA
| | - Kai Shu
- School of Computing, Informatics and Decision Systems Engineering, Arizona State University, Tempe, AZ, USA
| | - Suhang Wang
- School of Computing, Informatics and Decision Systems Engineering, Arizona State University, Tempe, AZ, USA
| | - Huan Liu
- School of Computing, Informatics and Decision Systems Engineering, Arizona State University, Tempe, AZ, USA
| | - Yalin Wang
- School of Computing, Informatics and Decision Systems Engineering, Arizona State University, Tempe, AZ, USA
| |
Collapse
|