1
|
Khalid MU, Nauman MM, AlSagri HS, Bin Pg Hj Petra PMI. Simultaneously capturing excessive variations and smooth dynamics of the underlying neural activity using spatiotemporal basis expansion and multisubject fMRI data. Sci Rep 2025; 15:13638. [PMID: 40254632 PMCID: PMC12010007 DOI: 10.1038/s41598-025-97651-7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/11/2024] [Accepted: 04/07/2025] [Indexed: 04/22/2025] Open
Abstract
In the last decade, dictionary learning (DL) has gained popularity over independent component analysis (ICA) within the blind source separation (BSS) framework for functional magnetic resonance imaging (fMRI) signals. Despite its rising popularity, a primary challenge in DL remains model fitting. It is susceptible to overfitting because the conventional loss function strives to correspond too closely to the training data. However, in the case of multi-subject (MS) analysis, it becomes imperative to overfit in order to acquire the source diversities across different brains. In this paper, an attempt has been made to resolve this predicament by concurrently preserving and mitigating the effect of high variance. A novel algorithm named joint analysis and synthesis DL (JASDL) has been proposed that simultaneously learns the overfitted trends to retain the data-centric cross-subject diversities and wellfitted trends by adequately regularizing the model complexity. This fusion was achieved by benefiting from modeling each subject's data in terms of both spatiotemporal (ST) prior information (PI) and MS-ST components. The PI consisted of biological priors derived from neuroscience knowledge, such as brain network templates, and mathematical priors derived from basis functions, such as three-dimensional (3D) cubic basis splines (B-splines). In contrast, MS-ST components were estimated using the computationally most parsimonious sparse ST blind source separation (ssBSS) method. Using the proposed analysis/synthesis cost function that exploits tri and quad-factorization for matrix approximation, the JASDL algorithm can model temporal smoothness and spatial reduction of false positives while retaining MS variations. Its efficacy was evaluated by comparing it with existing DL techniques using both experimental and synthetic fMRI datasets. Overall, the mean of correlation and F-score was found to be [Formula: see text] higher for the JASDL synthesis dictionary than the state-of-the-art subject-wise sequential DL (swsDL).
Collapse
Affiliation(s)
- Muhammad Usman Khalid
- College of Computer and Information Sciences, Imam Mohammad Ibn Saud Islamic University, 11564, Riyadh, Saudi Arabia
| | - Malik Muhammad Nauman
- Faculty of Integrated Technologies, Universiti Brunei Darussalam, Bandar Seri Begawan, BE1410, Brunei.
| | - Hatoon S AlSagri
- College of Computer and Information Sciences, Imam Mohammad Ibn Saud Islamic University, 11564, Riyadh, Saudi Arabia
| | | |
Collapse
|
2
|
Zhang W, Cohen A, McCrea M, Mukherjee P, Wang Y. Deep linear matrix approximate reconstruction with integrated BOLD signal denoising reveals reproducible hierarchical brain connectivity networks from multiband multi-echo fMRI. Front Neurosci 2025; 19:1577029. [PMID: 40309655 PMCID: PMC12040835 DOI: 10.3389/fnins.2025.1577029] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/14/2025] [Accepted: 03/31/2025] [Indexed: 05/02/2025] Open
Abstract
The hierarchical modular functional structure in the human brain has not been adequately depicted by conventional functional magnetic resonance imaging (fMRI) acquisition techniques and traditional functional connectivity reconstruction methods. Fortunately, rapid advancements in fMRI scanning techniques and deep learning methods open a novel frontier to map the spatial hierarchy within Brain Connectivity Networks (BCNs). The novel multiband multi-echo (MBME) fMRI technique has increased spatiotemporal resolution and peak functional sensitivity, while the advanced deep linear model (multilayer-stacked) named DEep Linear Matrix Approximate Reconstruction (DELMAR) enables the identification of hierarchical features without extensive hyperparameter tuning. We incorporate a multi-echo blood oxygenation level-dependent (BOLD) signal and DELMAR for denoising in its first layer, thereby eliminating the need for a separate multi-echo independent component analysis (ME-ICA) denoising step. Our results demonstrate that the DELMAR/Denoising/Mapping strategy produces more accurate and reproducible hierarchical BCNs than traditional ME-ICA denoising followed by DELMAR. Additionally, we showcase that MBME fMRI outperforms multiband (MB) fMRI in terms of hierarchical BCN mapping accuracy and precision. These reproducible spatial hierarchies in BCNs have significant potential for developing improved fMRI diagnostic and prognostic biomarkers of functional connectivity across a wide range of neurological and psychiatric disorders.
Collapse
Affiliation(s)
- Wei Zhang
- School of Computer and Cyber Sciences, Augusta University, Augusta, GA, United States
- Transdisciplinary Research Initiative in Inflammaging and Brain Aging, Augusta University, Augusta, GA, United States
| | - Alexander Cohen
- Department of Radiology, Medical College of Wisconsin, Milwaukee, WI, United States
| | - Michael McCrea
- Department of Neurosurgery, Medical College of Wisconsin, Milwaukee, WI, United States
| | - Pratik Mukherjee
- Department of Radiology and Biomedical Imaging, University of California, San Francisco, San Francisco, CA, United States
- Department of Bioengineering and Therapeutic Sciences, University of California, San Francisco, San Francisco, CA, United States
| | - Yang Wang
- Department of Radiology, Medical College of Wisconsin, Milwaukee, WI, United States
| |
Collapse
|
3
|
Liu Y, Ge E, Kang Z, Qiang N, Liu T, Ge B. Spatial-temporal convolutional attention for discovering and characterizing functional brain networks in task fMRI. Neuroimage 2024; 287:120519. [PMID: 38280690 DOI: 10.1016/j.neuroimage.2024.120519] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/24/2023] [Revised: 01/11/2024] [Accepted: 01/15/2024] [Indexed: 01/29/2024] Open
Abstract
Functional brain networks (FBNs) are spatial patterns of brain function that play a critical role in understanding human brain function. There are many proposed methods for mapping the spatial patterns of brain function, however they oversimplify the underlying assumptions of brain function and have various limitations such as linearity and independence. Additionally, current methods fail to account for the dynamic nature of FBNs, which limits their effectiveness in accurately characterizing these networks. To address these limitations, we present a novel deep learning and spatial-wise attention based model called Spatial-Temporal Convolutional Attention (STCA) to accurately model dynamic FBNs. Specifically, we train STCA in a self-supervised manner by utilizing a Convolutional Autoencoder to guide the STCA module in assigning higher attention weights to regions of functional activity. To validate the reliability of the results, we evaluate our approach on the HCP-task motor behavior dataset, the experimental results demonstrate that the STCA derived FBNs have higher spatial similarity with the templates and that the spatial similarity between the templates and the FBNs derived by STCA fluctuates with the task design over time, suggesting that STCA can reflect the dynamic changes of brain function, providing a powerful tool to better understand human brain function. Code is available at https://github.com/SNNUBIAI/STCAE.
Collapse
Affiliation(s)
- Yiheng Liu
- School of Physics & Information Technology, Shaanxi Normal University, Xi'an, China
| | - Enjie Ge
- School of Physics & Information Technology, Shaanxi Normal University, Xi'an, China
| | - Zili Kang
- School of Physics & Information Technology, Shaanxi Normal University, Xi'an, China
| | - Ning Qiang
- School of Physics & Information Technology, Shaanxi Normal University, Xi'an, China
| | - Tianming Liu
- School of Computing, University of Georgia, GA, USA
| | - Bao Ge
- School of Physics & Information Technology, Shaanxi Normal University, Xi'an, China.
| |
Collapse
|
4
|
Khalid MU, Nauman MM. A novel subject-wise dictionary learning approach using multi-subject fMRI spatial and temporal components. Sci Rep 2023; 13:20201. [PMID: 37980391 PMCID: PMC10657419 DOI: 10.1038/s41598-023-47420-1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/27/2023] [Accepted: 11/13/2023] [Indexed: 11/20/2023] Open
Abstract
The conventional dictionary learning (DL) algorithms aim to adapt the dictionary/sparse code to individual functional magnetic resonance imaging (fMRI) data. Thus, lacking the capability to consolidate the spatiotemporal diversities offered by other subjects. Considering that subject-wise (sw) data matrix can be decomposed into the sparse linear combination of multi-subject (MS) time courses and MS spatial maps, two new algorithms, sw sequential DL (swsDL) and sw block DL (swbDL), have been proposed. They are based on the novel framework, defined by the mixing model, where base matrices prepared by operating a computationally fast sparse spatiotemporal blind source separation method over multiple subjects are employed to adapt the mixing matrices to sw training data. They solve the optimization models formulated using [Formula: see text]/[Formula: see text]-norm penalization/constraints through dictionary/sparse code pair update and alternating minimization approach. They are unique because no existing sparse DL method can incorporate MS spatiotemporal components while updating sw atoms/sparse codes, which can eventually be assembled using neuroscience knowledge to extract group-level dynamics. Various fMRI datasets are used to evaluate and compare the performance of the proposed algorithms with existing state-of-the-art algorithms. Specifically, overall, a [Formula: see text] increase in the mean correlation value and [Formula: see text] reduction in the mean computation time exhibited by swsDL and swbDL, respectively, over the adaptive consistent sequential dictionary algorithm.
Collapse
Affiliation(s)
- Muhammad Usman Khalid
- College of Computer and Information Sciences, Imam Mohammad Ibn Saud Islamic University, 11564, Riyadh, Saudi Arabia
| | - Malik Muhammad Nauman
- Faculty of Integrated Technologies, Universiti Brunei Darussalam, Bandar Seri Begawan, BE1410, Brunei.
| |
Collapse
|
5
|
Ghosal N, Basu S, Bhaumik D. Detection of sparse differential dependent functional brain connectivity. Stat Med 2023; 42:4664-4680. [PMID: 37647942 DOI: 10.1002/sim.9882] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/19/2022] [Revised: 06/26/2023] [Accepted: 08/14/2023] [Indexed: 09/01/2023]
Abstract
Functional brain connectivity analysis is an increasingly important technique in neuroscience, psychiatry, and autism research. Functional connectivity can be measured by considering co-activation of brain regions in resting-state functional magnetic resonance imaging (rs-fMRI). We propose a novel Bayesian model to detect differential connections in cross-correlated functional connectivity between region of interest (ROI) pairs. The proposed sparse clustered neighborhood model induces a lower-dimensional sparsity and clustering based on a nonparametric Bayesian approach to model sparse differentially connected ROI pairs. Second, it induces a structured dependence model for modeling potential dependence among ROI pairs. We demonstrate Bayesian inference and performance of the proposed model in simulation studies and compare with a standard model. We utilize the proposed model to contrast functional connectivities between participants with autism spectrum disorder and neurotypical participants using cross-correlated rs-fMRI data from four sites of the Autism Brain Image Data Exchange.
Collapse
Affiliation(s)
- Nairita Ghosal
- Biostatistics and Research Decision Sciences, Merck & Co., Inc., Rahway, New Jersey, USA
| | - Sanjb Basu
- Division of Epidemiology and Biostatistics, University of Illinois Chicago, Chicago, Illinois, USA
| | - Dulal Bhaumik
- Division of Epidemiology and Biostatistics, University of Illinois Chicago, Chicago, Illinois, USA
- Department of Psychiatry, University of Illinois Chicago, Chicago, Illinois, USA
| |
Collapse
|
6
|
Zhao L, Wu Z, Dai H, Liu Z, Hu X, Zhang T, Zhu D, Liu T. A generic framework for embedding human brain function with temporally correlated autoencoder. Med Image Anal 2023; 89:102892. [PMID: 37482031 DOI: 10.1016/j.media.2023.102892] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/19/2022] [Revised: 03/19/2023] [Accepted: 07/06/2023] [Indexed: 07/25/2023]
Abstract
Learning an effective and compact representation of human brain function from high-dimensional fMRI data is crucial for studying the brain's functional organization. Traditional representation methods such as independent component analysis (ICA) and sparse dictionary learning (SDL) mainly rely on matrix decomposition which represents the brain function as spatial brain networks and the corresponding temporal patterns. The correspondence of those brain networks across individuals are built by viewing them as one-hot vectors and then performing the matching. However, those one-hot vectors do not encode the regularity and/or variability of different brains very well, and thus are limited in effectively representing the functional brain activities across individuals and among different time points. To address this problem, in this paper, we formulate the human brain functional representation as an embedding problem, and propose a novel embedding framework based on the Transformer model to encode the brain function in a compact, stereotyped and comparable latent space where the brain activities are represented as dense embedding vectors. We evaluate the proposed embedding framework on the publicly available Human Connectome Project (HCP) task fMRI dataset. The experiments on brain state prediction task indicate the effectiveness and generalizability of the learned embedding. We also explore the interpretability of the learned embedding from both spatial and temporal perspective. In general, our approach provides novel insights on representing the regularity and variability of human brain function in a general, comparable, and stereotyped latent space.
Collapse
Affiliation(s)
- Lin Zhao
- School of Computing, The University of Georgia, Athens 30602, USA
| | - Zihao Wu
- School of Computing, The University of Georgia, Athens 30602, USA
| | - Haixing Dai
- School of Computing, The University of Georgia, Athens 30602, USA
| | - Zhengliang Liu
- School of Computing, The University of Georgia, Athens 30602, USA
| | - Xintao Hu
- School of Automation, Northwestern Polytechnical University, Xi'an 710072, China
| | - Tuo Zhang
- School of Automation, Northwestern Polytechnical University, Xi'an 710072, China
| | - Dajiang Zhu
- Department of Computer Science and Engineering, The University of Texas at Arlington, Arlington 76019, USA.
| | - Tianming Liu
- School of Computing, The University of Georgia, Athens 30602, USA.
| |
Collapse
|
7
|
Hou XW, Wang Y, Ke C, Pan CW. Metabolomics facilitates the discovery of metabolic profiles and pathways for myopia: A systematic review. Eye (Lond) 2023; 37:670-677. [PMID: 35322213 PMCID: PMC9998863 DOI: 10.1038/s41433-022-02019-0] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/19/2021] [Revised: 02/16/2022] [Accepted: 03/09/2022] [Indexed: 11/08/2022] Open
Abstract
BACKGROUND Myopia is one of the major eye disorders and the global burden is increasing rapidly. Our purpose is to systematically summarize potential metabolic biomarkers and pathways in myopia to facilitate the understanding of disease mechanisms as well as the discovery of novel therapeutic measures. METHODS Myopia-related metabolomics studies were searched in electronic databases of PubMed and Web of Science until June 2021. Information regarding clinical and demographic characteristics of included studies and metabolomics findings were extracted. Myopia-related metabolic pathways were analysed for differential metabolic profiles, and the quality of included studies was assessed based on the QUADOMICS tool. Pathway analyses of differential metabolites were performed using bioinformatics tools and online software such as the Metaboanalyst 5.0. RESULTS The myopia-related metabolomics studies included in this study consisted of seven human and two animal studies. The results of the study quality assessment showed that studies were all phase I studies and all met the evaluation criteria of 70% or more. The myopia-control serum study identified 23 differential metabolites with the Sphingolipid metabolism pathway beings enriched. The high myopia-cataract aqueous humour study identified 40 differential metabolites with the Arginine biosynthesis pathway being enriched. The high myopia-control serum study identified 43 differential metabolites and 4 pathways were significantly associated with metabolites including Citrate cycle; Alanine, aspartate and glutamate metabolism; Glyoxylate and dicarboxylate metabolism; Biosynthesis of unsaturated fatty acids (all P value < 0.05). CONCLUSIONS This study summarizes potential metabolic biomarkers and pathways in myopia, providing new clues to elucidate disease mechanisms.
Collapse
Affiliation(s)
- Xiao-Wen Hou
- School of Public Health, Medical College of Soochow University, Suzhou, China
| | - Ying Wang
- School of Public Health, Medical College of Soochow University, Suzhou, China
| | - Chaofu Ke
- School of Public Health, Medical College of Soochow University, Suzhou, China
| | - Chen-Wei Pan
- School of Public Health, Medical College of Soochow University, Suzhou, China.
| |
Collapse
|
8
|
Jiang X, Yan J, Zhao Y, Jiang M, Chen Y, Zhou J, Xiao Z, Wang Z, Zhang R, Becker B, Zhu D, Kendrick KM, Liu T. Characterizing functional brain networks via Spatio-Temporal Attention 4D Convolutional Neural Networks (STA-4DCNNs). Neural Netw 2023; 158:99-110. [PMID: 36446159 DOI: 10.1016/j.neunet.2022.11.004] [Citation(s) in RCA: 14] [Impact Index Per Article: 7.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/23/2022] [Revised: 08/17/2022] [Accepted: 11/03/2022] [Indexed: 11/11/2022]
Abstract
Characterizing individualized spatio-temporal patterns of functional brain networks (FBNs) via functional magnetic resonance imaging (fMRI) provides a foundation for understanding complex brain function. Although previous studies have achieved promising performances based on either shallow or deep learning models, there is still much space to improve the accuracy of spatio-temporal pattern characterization of FBNs by optimally integrating the four-dimensional (4D) features of fMRI. In this study, we introduce a novel Spatio-Temporal Attention 4D Convolutional Neural Network (STA-4DCNN) model to characterize individualized spatio-temporal patterns of FBNs. Particularly, STA-4DCNN is composed of two subnetworks, in which the first Spatial Attention 4D CNN (SA-4DCNN) models the spatio-temporal features of 4D fMRI data and then characterizes the spatial pattern of FBNs, and the second Temporal Guided Attention Network (T-GANet) further characterizes the temporal pattern of FBNs under the guidance of the spatial pattern together with 4D fMRI data. We evaluate the proposed STA-4DCNN on seven different task fMRI and one resting state fMRI datasets from the publicly released Human Connectome Project. The experimental results demonstrate that STA-4DCNN has superior ability and generalizability in characterizing individualized spatio-temporal patterns of FBNs when compared to other state-of-the-art models. We further apply STA-4DCNN on another independent ABIDE I resting state fMRI dataset including both autism spectrum disorder (ASD) and typical developing (TD) subjects, and successfully identify abnormal spatio-temporal patterns of FBNs in ASD compared to TD. In general, STA-4DCNN provides a powerful tool for FBN characterization and for clinical applications on brain disease characterization at the individual level.
Collapse
Affiliation(s)
- Xi Jiang
- The Clinical Hospital of Chengdu Brain Science Institute, MOE Key Lab for Neuroinformation, School of Life Science and Technology, University of Electronic Science and Technology of China, Chengdu, China
| | - Jiadong Yan
- The Clinical Hospital of Chengdu Brain Science Institute, MOE Key Lab for Neuroinformation, School of Life Science and Technology, University of Electronic Science and Technology of China, Chengdu, China
| | - Yu Zhao
- Syngo Innovation, Siemens Healthineers, Malvern, PA 19355, USA
| | - Mingxin Jiang
- The Clinical Hospital of Chengdu Brain Science Institute, MOE Key Lab for Neuroinformation, School of Life Science and Technology, University of Electronic Science and Technology of China, Chengdu, China
| | - Yuzhong Chen
- The Clinical Hospital of Chengdu Brain Science Institute, MOE Key Lab for Neuroinformation, School of Life Science and Technology, University of Electronic Science and Technology of China, Chengdu, China
| | - Jingchao Zhou
- The Clinical Hospital of Chengdu Brain Science Institute, MOE Key Lab for Neuroinformation, School of Life Science and Technology, University of Electronic Science and Technology of China, Chengdu, China
| | - Zhenxiang Xiao
- The Clinical Hospital of Chengdu Brain Science Institute, MOE Key Lab for Neuroinformation, School of Life Science and Technology, University of Electronic Science and Technology of China, Chengdu, China
| | - Zifan Wang
- The Clinical Hospital of Chengdu Brain Science Institute, MOE Key Lab for Neuroinformation, School of Life Science and Technology, University of Electronic Science and Technology of China, Chengdu, China
| | - Rong Zhang
- Neuroscience Research Institute, Key Laboratory for Neuroscience, Ministry of Education of China, China; Key Laboratory for Neuroscience, National Committee of Health and Family Planning of China, China; Department of Neurobiology, School of Basic Medical Sciences, Peking University, Beijing, China
| | - Benjamin Becker
- The Clinical Hospital of Chengdu Brain Science Institute, MOE Key Lab for Neuroinformation, School of Life Science and Technology, University of Electronic Science and Technology of China, Chengdu, China
| | - Dajiang Zhu
- Department of Computer Science and Engineering, The University of Texas at Arlington, Arlington, TX 76019, USA
| | - Keith M Kendrick
- The Clinical Hospital of Chengdu Brain Science Institute, MOE Key Lab for Neuroinformation, School of Life Science and Technology, University of Electronic Science and Technology of China, Chengdu, China.
| | - Tianming Liu
- Cortical Architecture Imaging and Discovery Lab, Department of Computer Science and Bioimaging Research Center, The University of Georgia, Athens, USA.
| |
Collapse
|
9
|
Bolt T, Nomi JS, Bzdok D, Salas JA, Chang C, Thomas Yeo BT, Uddin LQ, Keilholz SD. A parsimonious description of global functional brain organization in three spatiotemporal patterns. Nat Neurosci 2022; 25:1093-1103. [PMID: 35902649 DOI: 10.1038/s41593-022-01118-1] [Citation(s) in RCA: 69] [Impact Index Per Article: 23.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/25/2021] [Accepted: 06/13/2022] [Indexed: 12/15/2022]
Abstract
Resting-state functional magnetic resonance imaging (MRI) has yielded seemingly disparate insights into large-scale organization of the human brain. The brain's large-scale organization can be divided into two broad categories: zero-lag representations of functional connectivity structure and time-lag representations of traveling wave or propagation structure. In this study, we sought to unify observed phenomena across these two categories in the form of three low-frequency spatiotemporal patterns composed of a mixture of standing and traveling wave dynamics. We showed that a range of empirical phenomena, including functional connectivity gradients, the task-positive/task-negative anti-correlation pattern, the global signal, time-lag propagation patterns, the quasiperiodic pattern and the functional connectome network structure, are manifestations of these three spatiotemporal patterns. These patterns account for much of the global spatial structure that underlies functional connectivity analyses and unifies phenomena in resting-state functional MRI previously thought distinct.
Collapse
Affiliation(s)
- Taylor Bolt
- Emory University/Georgia Institute of Technology, Atlanta, GA, USA. .,Department of Psychiatry and Biobehavioral Sciences, University of California, Los Angeles, Los Angeles, CA, USA.
| | - Jason S Nomi
- Department of Psychiatry and Biobehavioral Sciences, University of California, Los Angeles, Los Angeles, CA, USA
| | - Danilo Bzdok
- The Neuro (Montreal Neurological Institute), McGill University & Mila - Quebec Artificial Intelligence Institute, Montreal, QC, Canada
| | - Jorge A Salas
- Departments of Electrical and Computer Engineering, Computer Science, and Biomedical Engineering, Vanderbilt University, Nashville, TN, USA
| | - Catie Chang
- Departments of Electrical and Computer Engineering, Computer Science, and Biomedical Engineering, Vanderbilt University, Nashville, TN, USA
| | - B T Thomas Yeo
- Department of Electrical & Computer Engineering, Centre for Translational MR Research, Centre for Sleep & Cognition, N.1 Institute for Health and Institute for Digital Medicine, National University of Singapore, Singapore, Singapore
| | - Lucina Q Uddin
- Department of Psychiatry and Biobehavioral Sciences, University of California, Los Angeles, Los Angeles, CA, USA
| | | |
Collapse
|
10
|
Yan J, Chen Y, Xiao Z, Zhang S, Jiang M, Wang T, Zhang T, Lv J, Becker B, Zhang R, Zhu D, Han J, Yao D, Kendrick KM, Liu T, Jiang X. Modeling spatio-temporal patterns of holistic functional brain networks via multi-head guided attention graph neural networks (Multi-Head GAGNNs). Med Image Anal 2022; 80:102518. [PMID: 35749981 DOI: 10.1016/j.media.2022.102518] [Citation(s) in RCA: 11] [Impact Index Per Article: 3.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/26/2021] [Revised: 04/01/2022] [Accepted: 06/14/2022] [Indexed: 10/18/2022]
Abstract
Mounting evidence has demonstrated that complex brain function processes are realized by the interaction of holistic functional brain networks which are spatially distributed across specific brain regions in a temporally dynamic fashion. Therefore, modeling spatio-temporal patterns of holistic functional brain networks plays an important role in understanding brain function. Compared to traditional modeling methods such as principal component analysis, independent component analysis, and sparse coding, superior performance has been achieved by recent deep learning methodologies. However, there are still two limitations of existing deep learning approaches for functional brain network modeling. They either (1) merely modeled a single targeted network and ignored holistic ones at one time, or (2) underutilized both spatial and temporal features of fMRI during network modeling, and the spatial/temporal accuracy was thus not warranted. To address these limitations, we proposed a novel Multi-Head Guided Attention Graph Neural Network (Multi-Head GAGNN) to simultaneously model both spatial and temporal patterns of holistic functional brain networks. Specifically, a spatial Multi-Head Attention Graph U-Net was first adopted to model the spatial patterns of multiple brain networks, and a temporal Multi-Head Guided Attention Network was then introduced to model the corresponding temporal patterns under the guidance of modeled spatial patterns. Based on seven task fMRI datasets from the public Human Connectome Project and resting state fMRI datasets from the public Autism Brain Imaging Data Exchange I of 1448 subjects, the proposed Multi-Head GAGNN showed superior ability and generalizability in modeling both spatial and temporal patterns of holistic functional brain networks in individual brains compared to other state-of-the-art (SOTA) models. Furthermore, the modeled spatio-temporal patterns of functional brain networks via the proposed Multi-Head GAGNN can better predict the individual cognitive behavioral measures compared to the other SOTA models. This study provided a novel and powerful tool for brain function modeling as well as for understanding the brain-cognitive behavior associations.
Collapse
Affiliation(s)
- Jiadong Yan
- The Clinical Hospital of Chengdu Brain Science Institute, MOE Key Lab for Neuroinformation, School of Life Science and Technology, University of Electronic Science and Technology of China, #2006, Xiyuan Avenue, Chengdu, Sichuan 611731, China
| | - Yuzhong Chen
- The Clinical Hospital of Chengdu Brain Science Institute, MOE Key Lab for Neuroinformation, School of Life Science and Technology, University of Electronic Science and Technology of China, #2006, Xiyuan Avenue, Chengdu, Sichuan 611731, China
| | - Zhenxiang Xiao
- The Clinical Hospital of Chengdu Brain Science Institute, MOE Key Lab for Neuroinformation, School of Life Science and Technology, University of Electronic Science and Technology of China, #2006, Xiyuan Avenue, Chengdu, Sichuan 611731, China
| | - Shu Zhang
- Center for Brain and Brain-Inspired Computing Research, School of Computer Science, Northwestern Polytechnical University, Xi'an, China
| | - Mingxin Jiang
- The Clinical Hospital of Chengdu Brain Science Institute, MOE Key Lab for Neuroinformation, School of Life Science and Technology, University of Electronic Science and Technology of China, #2006, Xiyuan Avenue, Chengdu, Sichuan 611731, China
| | - Tianqi Wang
- The Clinical Hospital of Chengdu Brain Science Institute, MOE Key Lab for Neuroinformation, School of Life Science and Technology, University of Electronic Science and Technology of China, #2006, Xiyuan Avenue, Chengdu, Sichuan 611731, China
| | - Tuo Zhang
- School of Automation, Northwestern Polytechnical University, Xi'an, China
| | - Jinglei Lv
- School of Biomedical Engineering & Brain and Mind Centre, The University of Sydney, Camperdown, NSW, Australia
| | - Benjamin Becker
- The Clinical Hospital of Chengdu Brain Science Institute, MOE Key Lab for Neuroinformation, School of Life Science and Technology, University of Electronic Science and Technology of China, #2006, Xiyuan Avenue, Chengdu, Sichuan 611731, China
| | - Rong Zhang
- Neuroscience Research Institute, Key Laboratory for Neuroscience, Ministry of Education of China; Key Laboratory for Neuroscience, National Committee of Health and Family Planning of China; and Department of neurobiology, School of Basic Medical Sciences, Peking University, Beijing, China
| | - Dajiang Zhu
- Department of Computer Science and Engineering, The University of Texas at Arlington, Arlington, TX 76019, United States
| | - Junwei Han
- School of Automation, Northwestern Polytechnical University, Xi'an, China
| | - Dezhong Yao
- The Clinical Hospital of Chengdu Brain Science Institute, MOE Key Lab for Neuroinformation, School of Life Science and Technology, University of Electronic Science and Technology of China, #2006, Xiyuan Avenue, Chengdu, Sichuan 611731, China; Research Unit of NeuroInformation, Chinese Academy of Medical Sciences, 2019RU035, Chengdu 611731, China
| | - Keith M Kendrick
- The Clinical Hospital of Chengdu Brain Science Institute, MOE Key Lab for Neuroinformation, School of Life Science and Technology, University of Electronic Science and Technology of China, #2006, Xiyuan Avenue, Chengdu, Sichuan 611731, China
| | - Tianming Liu
- Cortical Architecture Imaging and Discovery Lab, Department of Computer Science and Bioimaging Research Center, the University of Georgia, Athens, United States
| | - Xi Jiang
- The Clinical Hospital of Chengdu Brain Science Institute, MOE Key Lab for Neuroinformation, School of Life Science and Technology, University of Electronic Science and Technology of China, #2006, Xiyuan Avenue, Chengdu, Sichuan 611731, China.
| |
Collapse
|
11
|
Karakasis PA, Liavas AP, Sidiropoulos ND, Simos PG, Papadaki E. Multisubject Task-Related fMRI Data Processing via a Two-Stage Generalized Canonical Correlation Analysis. IEEE TRANSACTIONS ON IMAGE PROCESSING : A PUBLICATION OF THE IEEE SIGNAL PROCESSING SOCIETY 2022; 31:4011-4022. [PMID: 35588408 DOI: 10.1109/tip.2022.3159125] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/15/2023]
Abstract
Functional magnetic resonance imaging (fMRI) is one of the most popular methods for studying the human brain. Task-related fMRI data processing aims to determine which brain areas are activated when a specific task is performed and is usually based on the Blood Oxygen Level Dependent (BOLD) signal. The background BOLD signal also reflects systematic fluctuations in regional brain activity which are attributed to the existence of resting-state brain networks. We propose a new fMRI data generating model which takes into consideration the existence of common task-related and resting-state components. We first estimate the common task-related temporal component, via two successive stages of generalized canonical correlation analysis and, then, we estimate the common task-related spatial component, leading to a task-related activation map. The experimental tests of our method with synthetic data reveal that we are able to obtain very accurate temporal and spatial estimates even at very low Signal to Noise Ratio (SNR), which is usually the case in fMRI data processing. The tests with real-world fMRI data show significant advantages over standard procedures based on General Linear Models (GLMs).
Collapse
|
12
|
Costantini I, Deriche R, Deslauriers-Gauthier S. An Anisotropic 4D Filtering Approach to Recover Brain Activation From Paradigm-Free Functional MRI Data. FRONTIERS IN NEUROIMAGING 2022; 1:815423. [PMID: 37555185 PMCID: PMC10406250 DOI: 10.3389/fnimg.2022.815423] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 11/15/2021] [Accepted: 02/11/2022] [Indexed: 08/10/2023]
Abstract
CONTEXT Functional Magnetic Resonance Imaging (fMRI) is a non-invasive imaging technique that provides an indirect view into brain activity via the blood oxygen level dependent (BOLD) response. In particular, resting-state fMRI poses challenges to the recovery of brain activity without prior knowledge on the experimental paradigm, as it is the case for task fMRI. Conventional methods to infer brain activity from the fMRI signals, for example, the general linear model (GLM), require the knowledge of the experimental paradigm to define regressors and estimate the contribution of each voxel's time course to the task. To overcome this limitation, approaches to deconvolve the BOLD response and recover the underlying neural activations without a priori information on the task have been proposed. State-of-the-art techniques, and in particular the total activation (TA), formulate the deconvolution as an optimization problem with decoupled spatial and temporal regularization and an optimization strategy that alternates between the constraints. APPROACH In this work, we propose a paradigm-free regularization algorithm named Anisotropic 4D-fMRI (A4D-fMRI) that is applied on the 4D fMRI image, acting simultaneously in the 3D space and 1D time dimensions. Based on the idea that large image variations should be preserved as they occur during brain activations, whereas small variations considered as noise should be removed, the A4D-fMRI applies an anisotropic regularization, thus recovering the location and the duration of brain activations. RESULTS Using the experimental paradigm as ground truth, the A4D-fMRI is validated on synthetic and real task-fMRI data from 51 subjects, and its performance is compared to the TA. Results show higher correlations of the recovered time courses with the ground truth compared to the TA and lower computational times. In addition, we show that the A4D-fMRI recovers activity that agrees with the GLM, without requiring or using any knowledge of the experimental paradigm.
Collapse
|
13
|
Shahhosseini Y, Miranda MF. Functional Connectivity Methods and Their Applications in fMRI Data. ENTROPY 2022; 24:e24030390. [PMID: 35327901 PMCID: PMC8946919 DOI: 10.3390/e24030390] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 01/15/2022] [Revised: 02/23/2022] [Accepted: 03/08/2022] [Indexed: 02/01/2023]
Abstract
The availability of powerful non-invasive neuroimaging techniques has given rise to various studies that aim to map the human brain. These studies focus on not only finding brain activation signatures but also on understanding the overall organization of functional communication in the brain network. Based on the principle that distinct brain regions are functionally connected and continuously share information with each other, various approaches to finding these functional networks have been proposed in the literature. In this paper, we present an overview of the most common methods to estimate and characterize functional connectivity in fMRI data. We illustrate these methodologies with resting-state functional MRI data from the Human Connectome Project, providing details of their implementation and insights on the interpretations of the results. We aim to guide researchers that are new to the field of neuroimaging by providing the necessary tools to estimate and characterize brain circuitry.
Collapse
|
14
|
Zhang H, Zeng W, Deng J, Shi Y, Zhao L, Li Y. Brain Relatively Inert Network: Taking Adult Attention Deficit Hyperactivity Disorder as an Example. Front Neurosci 2021; 15:771947. [PMID: 34924940 PMCID: PMC8678527 DOI: 10.3389/fnins.2021.771947] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/07/2021] [Accepted: 11/05/2021] [Indexed: 11/13/2022] Open
Abstract
Resting-state functional MRI (rs-fMRI) has been increasingly applied in the research of brain cognitive science and psychiatric diseases. However, previous studies only focused on specific activation areas of the brain, and there are few studies on the inactivation areas. This may overlook much information that explains the brain's cognitive function. In this paper, we propose a relatively inert network (RIN) and try to explore its important role in understanding the cognitive mechanism of the brain and the study of mental diseases, using adult attention deficit hyperactivity disorder (ADHD) as an example. Here, we utilize methods based on group independent component analysis (GICA) and t-test to identify RIN and calculate its corresponding time series. Through experiments, alterations in the RIN and the corresponding activation network (AN) in adult ADHD patients are observed. And compared with those in the left brain, the activation changes in the right brain are greater. Further, when the RIN functional connectivity is introduced as a feature to classify adult ADHD patients from healthy controls (HCs), the classification accuracy rate is 12% higher than that of the original functional connectivity feature. This was also verified by testing on an independent public dataset. These findings confirm that the RIN of the brain contains much information that will probably be neglected. Moreover, this research provides an effective new means of exploring the information integration between brain regions and the diagnosis of mental illness.
Collapse
Affiliation(s)
- Hua Zhang
- Lab of Digital Image and Intelligent Computation, Shanghai Maritime University, Shanghai, China
| | - Weiming Zeng
- Lab of Digital Image and Intelligent Computation, Shanghai Maritime University, Shanghai, China
| | - Jin Deng
- College of Mathematics and Informatics, South China Agricultural University, Guangzhou, China
| | - Yuhu Shi
- Lab of Digital Image and Intelligent Computation, Shanghai Maritime University, Shanghai, China
| | - Le Zhao
- Lab of Digital Image and Intelligent Computation, Shanghai Maritime University, Shanghai, China
| | - Ying Li
- Lab of Digital Image and Intelligent Computation, Shanghai Maritime University, Shanghai, China
| |
Collapse
|
15
|
Wang L, Li K, Hu XP. Graph convolutional network for fMRI analysis based on connectivity neighborhood. Netw Neurosci 2021; 5:83-95. [PMID: 33688607 PMCID: PMC7935029 DOI: 10.1162/netn_a_00171] [Citation(s) in RCA: 21] [Impact Index Per Article: 5.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/14/2020] [Accepted: 09/24/2020] [Indexed: 11/04/2022] Open
Abstract
There have been successful applications of deep learning to functional magnetic resonance imaging (fMRI), where fMRI data were mostly considered to be structured grids, and spatial features from Euclidean neighbors were usually extracted by the convolutional neural networks (CNNs) in the computer vision field. Recently, CNN has been extended to graph data and demonstrated superior performance. Here, we define graphs based on functional connectivity and present a connectivity-based graph convolutional network (cGCN) architecture for fMRI analysis. Such an approach allows us to extract spatial features from connectomic neighborhoods rather than from Euclidean ones, consistent with the functional organization of the brain. To evaluate the performance of cGCN, we applied it to two scenarios with resting-state fMRI data. One is individual identification of healthy participants and the other is classification of autistic patients from normal controls. Our results indicate that cGCN can effectively capture functional connectivity features in fMRI analysis for relevant applications.
Collapse
Affiliation(s)
- Lebo Wang
- Department of Electrical and Computer Engineering, University of California, Riverside, Riverside, CA, USA
| | - Kaiming Li
- Department of Bioengineering, University of California, Riverside, Riverside, CA, USA
| | - Xiaoping P. Hu
- Department of Electrical and Computer Engineering, University of California, Riverside, Riverside, CA, USA
- Department of Bioengineering, University of California, Riverside, Riverside, CA, USA
| |
Collapse
|
16
|
Cui Y, Zhao S, Chen Y, Han J, Guo L, Xie L, Liu T. Modeling Brain Diverse and Complex Hemodynamic Response Patterns via Deep Recurrent Autoencoder. IEEE Trans Cogn Dev Syst 2020. [DOI: 10.1109/tcds.2019.2949195] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
|
17
|
Classification of Alzheimer's Disease and Mild Cognitive Impairment Based on Cortical and Subcortical Features from MRI T1 Brain Images Utilizing Four Different Types of Datasets. JOURNAL OF HEALTHCARE ENGINEERING 2020; 2020:3743171. [PMID: 32952988 PMCID: PMC7482016 DOI: 10.1155/2020/3743171] [Citation(s) in RCA: 9] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 11/09/2019] [Revised: 07/09/2020] [Accepted: 07/14/2020] [Indexed: 01/18/2023]
Abstract
Alzheimer's disease (AD) is one of the most common neurodegenerative illnesses (dementia) among the elderly. Recently, researchers have developed a new method for the instinctive analysis of AD based on machine learning and its subfield, deep learning. Recent state-of-the-art techniques consider multimodal diagnosis, which has been shown to achieve high accuracy compared to a unimodal prognosis. Furthermore, many studies have used structural magnetic resonance imaging (MRI) to measure brain volumes and the volume of subregions, as well as to search for diffuse changes in white/gray matter in the brain. In this study, T1-weighted structural MRI was used for the early classification of AD. MRI results in high-intensity visible features, making preprocessing and segmentation easy. To use this image modality, we acquired four types of datasets from each dataset's server. In this work, we downloaded 326 subjects from the National Research Center for Dementia homepage, 123 subjects from the Alzheimer's Disease Neuroimaging Initiative (ADNI) homepage, 121 subjects from the Alzheimer's Disease Repository Without Borders homepage, and 131 subjects from the National Alzheimer's Coordinating Center homepage. In our experiment, we used the multiatlas label propagation with expectation–maximization-based refinement segmentation method. We segmented the images into 138 anatomical morphometry images (in which 40 features belonged to subcortical volumes and the remaining 98 features belonged to cortical thickness). The entire dataset was split into a 70 : 30 (training and testing) ratio before classifying the data. A principal component analysis was used for dimensionality reduction. Then, the support vector machine radial basis function classifier was used for classification between two groups—AD versus health control (HC) and early mild cognitive impairment (MCI) (EMCI) versus late MCI (LMCI). The proposed method performed very well for all four types of dataset. For instance, for the AD versus HC group, the classifier achieved an area under curve (AUC) of more than 89% for each dataset. For the EMCI versus LMCI group, the classifier achieved an AUC of more than 80% for every dataset. Moreover, we also calculated Cohen kappa and Jaccard index statistical values for all datasets to evaluate the classification reliability. Finally, we compared our results with those of recently published state-of-the-art methods.
Collapse
|
18
|
PENG PENG, JU YONGFENG, ZHANG YIPU, WANG KAIMING, JIANG SUYING, WANG YUPING. Sparse representation and dictionary learning model incorporating group sparsity and incoherence to extract abnormal brain regions associated with schizophrenia. IEEE ACCESS : PRACTICAL INNOVATIONS, OPEN SOLUTIONS 2020; 8:104396-104406. [PMID: 33747675 PMCID: PMC7971409 DOI: 10.1109/access.2020.2999513] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/12/2023]
Abstract
Schizophrenia is a complex mental illness, the mechanism of which is currently unclear. Using sparse representation and dictionary learning (SDL) model to analyze functional magnetic resonance imaging (fMRI) dataset of schizophrenia is currently a popular method for exploring the mechanism of the disease. The SDL method decomposed the fMRI data into a sparse coding matrix X and a dictionary matrix D. However, these traditional methods overlooked group structure information in X and the coherence between the atoms in D. To address this problem, we propose a new SDL model incorporating group sparsity and incoherence, namely GS2ISDL to detect abnormal brain regions. Specifically, GS2ISDL uses the group structure information that defined by AAL anatomical template from fMRI dataset as priori to achieve inter-group sparsity in X. At the same time, L 1 - norm is enforced on X to achieve intra-group sparsity. In addition, our algorithm also imposes incoherent constraint on the dictionary matrix D to reduce the coherence between the atoms in D, which can ensure the uniqueness of X and the discriminability of the atoms. To validate our proposed model GS2ISDL, we compared it with both IK-SVD and SDL algorithm for analyzing fMRI dataset collected by Mind Clinical Imaging Consortium (MCIC). The results show that the accuracy, sensitivity, recall and MCC values of GS2ISDL are 93.75%, 95.23%, 80.50% and 88.19%, respectively, which outperforms both IK-SVD and SDL. The ROIs extracted by GS2ISDL model (such as Precentral gyrus, Hippocampus and Caudate nucleus, etc.) are further verified by the literature review on schizophrenia studies, which have significant biological significance.
Collapse
Affiliation(s)
- PENG PENG
- The school of Electronics and Control Engineering, Chang’an University, Xi’an, Shaanxi, 710049, China
| | - YONGFENG JU
- The school of Electronics and Control Engineering, Chang’an University, Xi’an, Shaanxi, 710049, China
| | - YIPU ZHANG
- The school of Electronics and Control Engineering, Chang’an University, Xi’an, Shaanxi, 710049, China
| | - KAIMING WANG
- The school of Science, Chang’an University, Xi’an, Shaanxi, 710049, China
| | - SUYING JIANG
- The school of Information Engineering, Chang’an University, Xi’an, Shaanxi, 710049, China
| | - YUPING WANG
- Department of Biomedical Engineering, Tulane University, New Orleans, LA, 70118, USA
| |
Collapse
|
19
|
Zhang W, Zhao S, Hu X, Dong Q, Huang H, Zhang S, Zhao Y, Dai H, Ge F, Guo L, Liu T. Hierarchical Organization of Functional Brain Networks Revealed by Hybrid Spatiotemporal Deep Learning. Brain Connect 2020; 10:72-82. [PMID: 32056450 DOI: 10.1089/brain.2019.0701] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/17/2023] Open
Abstract
Hierarchical organization of brain function has been an established concept in the neuroscience field for a long time, however, it has been rarely demonstrated how such hierarchical macroscale functional networks are actually organized in the human brain. In this study, to answer this question, we propose a novel methodology to provide an evidence of hierarchical organization of functional brain networks. This article introduces the hybrid spatiotemporal deep learning (HSDL), by jointly using deep belief networks (DBNs) and deep least absolute shrinkage and selection operator (LASSO) to reveal the temporal hierarchical features and spatial hierarchical maps of brain networks based on the Human Connectome Project 900 functional magnetic resonance imaging (fMRI) data sets. Briefly, the key idea of HSDL is to extract the weights between two adjacent layers of DBNs, which are then treated as the hierarchical dictionaries for deep LASSO to identify the corresponding hierarchical spatial maps. Our results demonstrate that both spatial and temporal aspects of dozens of functional networks exhibit multiscale properties that can be well characterized and interpreted based on existing computational tools and neuroscience knowledge. Our proposed novel hybrid deep model is used to provide the first insightful opportunity to reveal the potential hierarchical organization of time series and functional brain networks, using task-based fMRI signals of human brain.
Collapse
Affiliation(s)
- Wei Zhang
- Cortical Architecture Imaging and Discovery Lab, Department of Computer Science and Bioimaging Research Center, The University of Georgia, Athens, Georgia
| | - Shijie Zhao
- School of Automation, Northwestern Polytechnical University, Xi'an, P.R. China
| | - Xintao Hu
- School of Automation, Northwestern Polytechnical University, Xi'an, P.R. China
| | - Qinglin Dong
- Cortical Architecture Imaging and Discovery Lab, Department of Computer Science and Bioimaging Research Center, The University of Georgia, Athens, Georgia
| | - Heng Huang
- School of Automation, Northwestern Polytechnical University, Xi'an, P.R. China
| | - Shu Zhang
- Cortical Architecture Imaging and Discovery Lab, Department of Computer Science and Bioimaging Research Center, The University of Georgia, Athens, Georgia
| | - Yu Zhao
- Cortical Architecture Imaging and Discovery Lab, Department of Computer Science and Bioimaging Research Center, The University of Georgia, Athens, Georgia
| | - Haixing Dai
- Cortical Architecture Imaging and Discovery Lab, Department of Computer Science and Bioimaging Research Center, The University of Georgia, Athens, Georgia
| | - Fangfei Ge
- Cortical Architecture Imaging and Discovery Lab, Department of Computer Science and Bioimaging Research Center, The University of Georgia, Athens, Georgia
| | - Lei Guo
- School of Automation, Northwestern Polytechnical University, Xi'an, P.R. China
| | - Tianming Liu
- Cortical Architecture Imaging and Discovery Lab, Department of Computer Science and Bioimaging Research Center, The University of Georgia, Athens, Georgia
| |
Collapse
|
20
|
Cui Y, Zhao S, Wang H, Xie L, Chen Y, Han J, Guo L, Zhou F, Liu T. Identifying Brain Networks at Multiple Time Scales via Deep Recurrent Neural Network. IEEE J Biomed Health Inform 2019; 23:2515-2525. [PMID: 30475739 PMCID: PMC6914656 DOI: 10.1109/jbhi.2018.2882885] [Citation(s) in RCA: 11] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/07/2023]
Abstract
For decades, task functional magnetic resonance imaging has been a powerful noninvasive tool to explore the organizational architecture of human brain function. Researchers have developed a variety of brain network analysis methods for task fMRI data, including the general linear model, independent component analysis, and sparse representation methods. However, these shallow models are limited in faithful reconstruction and modeling of the hierarchical and temporal structures of brain networks, as demonstrated in more and more studies. Recently, recurrent neural networks (RNNs) exhibit great ability of modeling hierarchical and temporal dependence features in the machine learning field, which might be suitable for task fMRI data modeling. To explore such possible advantages of RNNs for task fMRI data, we propose a novel framework of a deep recurrent neural network (DRNN) to model the functional brain networks from task fMRI data. Experimental results on the motor task fMRI data of Human Connectome Project 900 subjects release demonstrated that the proposed DRNN can not only faithfully reconstruct functional brain networks, but also identify more meaningful brain networks with multiple time scales which are overlooked by traditional shallow models. In general, this work provides an effective and powerful approach to identifying functional brain networks at multiple time scales from task fMRI data.
Collapse
Affiliation(s)
- Yan Cui
- College of Biomedical Engineering & Instrument Science, Zhejiang University, Hangzhou, 310027, China
| | - Shijie Zhao
- School of Automation, Northwestern Polytechnical University, Xi’an, 710072, China
| | - Han Wang
- College of Biomedical Engineering & Instrument Science, Zhejiang University, Hangzhou, 310027, China
| | - Li Xie
- College of Biomedical Engineering & Instrument Science, and the State Key Laboratory of Industrial Control Technology, Zhejiang University, Hangzhou, 310027, China
| | - Yaowu Chen
- College of Biomedical Engineering & Instrument Science, and Zhejiang Provincial Key Laboratory for Network Multimedia Technologies, Zhejiang University, Hangzhou, 310027, China
| | - Junwei Han
- School of Automation, Northwestern Polytechnical University, Xi’an, 710072, China
| | - Lei Guo
- School of Automation, Northwestern Polytechnical University, Xi’an, 710072, China
| | - Fan Zhou
- College of Biomedical Engineering & Instrument Science, Zhejiang University, and the Zhejiang University Embedded System Engineering Research Center, Ministry of Education of China, Hangzhou, 310027, China
| | - Tianming Liu
- Cortical Architecture Imaging and Discovery Lab, Department of Computer Science and Bioimaging Research Center, The University of Georgia, Athens, GA, 30602, USA
| |
Collapse
|
21
|
Gupta Y, Lee KH, Choi KY, Lee JJ, Kim BC, Kwon GR. Early diagnosis of Alzheimer's disease using combined features from voxel-based morphometry and cortical, subcortical, and hippocampus regions of MRI T1 brain images. PLoS One 2019; 14:e0222446. [PMID: 31584953 PMCID: PMC6777799 DOI: 10.1371/journal.pone.0222446] [Citation(s) in RCA: 31] [Impact Index Per Article: 5.2] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/16/2019] [Accepted: 08/30/2019] [Indexed: 11/28/2022] Open
Abstract
In recent years, several high-dimensional, accurate, and effective classification methods have been proposed for the automatic discrimination of the subject between Alzheimer's disease (AD) or its prodromal phase {i.e., mild cognitive impairment (MCI)} and healthy control (HC) persons based on T1-weighted structural magnetic resonance imaging (sMRI). These methods emphasis only on using the individual feature from sMRI images for the classification of AD, MCI, and HC subjects and their achieved classification accuracy is low. However, latest multimodal studies have shown that combining multiple features from different sMRI analysis techniques can improve the classification accuracy for these types of subjects. In this paper, we propose a novel classification technique that precisely distinguishes individuals with AD, aAD (stable MCI, who had not converted to AD within a 36-month time period), and mAD (MCI caused by AD, who had converted to AD within a 36-month time period) from HC individuals. The proposed method combines three different features extracted from structural MR (sMR) images using voxel-based morphometry (VBM), hippocampal volume (HV), and cortical and subcortical segmented region techniques. Three classification experiments were performed (AD vs. HC, aAD vs. mAD, and HC vs. mAD) with 326 subjects (171 elderly controls and 81 AD, 35 aAD, and 39 mAD patients). For the development and validation of the proposed classification method, we acquired the sMR images from the dataset of the National Research Center for Dementia (NRCD). A five-fold cross-validation technique was applied to find the optimal hyperparameters for the classifier, and the classification performance was compared by using three well-known classifiers: K-nearest neighbor, support vector machine, and random forest. Overall, the proposed model with the SVM classifier achieved the best performance on the NRCD dataset. For the individual feature, the VBM technique provided the best results followed by the HV technique. However, the use of combined features improved the classification accuracy and predictive power for the early classification of AD compared to the use of individual features. The most stable and reliable classification results were achieved when combining all extracted features. Additionally, to analyze the efficiency of the proposed model, we used the Alzheimer's Disease Neuroimaging Initiative (ADNI) dataset to compare the classification performance of the proposed model with those of several state-of-the-art methods.
Collapse
Affiliation(s)
- Yubraj Gupta
- School of Information Communication Engineering, Chosun University, Gwangju, Republic of Korea
- National Research Center for Dementia, Chosun University, Gwangju, Republic of Korea
| | - Kun Ho Lee
- National Research Center for Dementia, Chosun University, Gwangju, Republic of Korea
- Department of Biomedical Science, College of Natural Sciences, Chosun University, Gwangju, Republic of Korea
| | - Kyu Yeong Choi
- National Research Center for Dementia, Chosun University, Gwangju, Republic of Korea
| | - Jang Jae Lee
- National Research Center for Dementia, Chosun University, Gwangju, Republic of Korea
| | - Byeong Chae Kim
- National Research Center for Dementia, Chosun University, Gwangju, Republic of Korea
- Department of Neurology, Chonnam National University Medical School, Gwangju, Republic of Korea
| | - Goo Rak Kwon
- School of Information Communication Engineering, Chosun University, Gwangju, Republic of Korea
- National Research Center for Dementia, Chosun University, Gwangju, Republic of Korea
| | | | | |
Collapse
|
22
|
Qadar MA, Aïssa-El-Bey A, Seghouane AK. Two dimensional CCA via penalized matrix decomposition for structure preserved fMRI data analysis. DIGITAL SIGNAL PROCESSING 2019; 92:36-46. [DOI: 10.1016/j.dsp.2019.04.010] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 09/02/2023]
|
23
|
Sidhu G. Locally Linear Embedding and fMRI Feature Selection in Psychiatric Classification. IEEE JOURNAL OF TRANSLATIONAL ENGINEERING IN HEALTH AND MEDICINE 2019; 7:2200211. [PMID: 31497410 PMCID: PMC6726465 DOI: 10.1109/jtehm.2019.2936348] [Citation(s) in RCA: 13] [Impact Index Per Article: 2.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 03/10/2019] [Revised: 07/12/2019] [Accepted: 08/15/2019] [Indexed: 01/29/2023]
Abstract
BACKGROUND Functional magnetic resonance imaging (fMRI) provides non-invasive measures of neuronal activity using an endogenous Blood Oxygenation-Level Dependent (BOLD) contrast. This article introduces a nonlinear dimensionality reduction (Locally Linear Embedding) to extract informative measures of the underlying neuronal activity from BOLD time-series. The method is validated using the Leave-One-Out-Cross-Validation (LOOCV) accuracy of classifying psychiatric diagnoses using resting-state and task-related fMRI. METHODS Locally Linear Embedding of BOLD time-series (into each voxel's respective tensor) was used to optimise feature selection. This uses Gauß' Principle of Least Constraint to conserve quantities over both space and time. This conservation was assessed using LOOCV to greedily select time points in an incremental fashion on training data that was categorised in terms of psychiatric diagnoses. FINDINGS The embedded fMRI gave highly diagnostic performances (> 80%) on eleven publicly-available datasets containing healthy controls and patients with either Schizophrenia, Attention-Deficit Hyperactivity Disorder (ADHD), or Autism Spectrum Disorder (ASD). Furthermore, unlike the original fMRI data before or after using Principal Component Analysis (PCA) for artefact reduction, the embedded fMRI furnished significantly better than chance classification (defined as the majority class proportion) on ten of eleven datasets. INTERPRETATION Locally Linear Embedding appears to be a useful feature extraction procedure that retains important information about patterns of brain activity distinguishing among psychiatric cohorts.
Collapse
Affiliation(s)
- Gagan Sidhu
- Department of Computing Science1-337 Athabasca HallUniversity of AlbertaEdmontonABT6G 2E8Canada
| |
Collapse
|
24
|
Seghouane AK, Shokouhi N, Koch I. Sparse Principal Component Analysis With Preserved Sparsity Pattern. IEEE TRANSACTIONS ON IMAGE PROCESSING : A PUBLICATION OF THE IEEE SIGNAL PROCESSING SOCIETY 2019; 28:3274-3285. [PMID: 30703025 DOI: 10.1109/tip.2019.2895464] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/09/2023]
Abstract
Principal component analysis (PCA) is widely used for feature extraction and dimension reduction in pattern recognition and data analysis. Despite its popularity, the reduced dimension obtained from the PCA is difficult to interpret due to the dense structure of principal loading vectors. To address this issue, several methods have been proposed for sparse PCA, all of which estimate loading vectors with few non-zero elements. However, when more than one principal component is estimated, the associated loading vectors do not possess the same sparsity pattern. Therefore, it becomes difficult to determine a small subset of variables from the original feature space that have the highest contribution in the principal components. To address this issue, an adaptive block sparse PCA method is proposed. The proposed method is guaranteed to obtain the same sparsity pattern across all principal components. Experiments show that applying the proposed sparse PCA method can help improve the performance of feature selection for image processing applications. We further demonstrate that our proposed sparse PCA method can be used to improve the performance of blind source separation for functional magnetic resonance imaging data.
Collapse
|
25
|
Makkie M, Li X, Quinn S, Lin B, Ye J, Mon G, Liu T. A Distributed Computing Platform for fMRI Big Data Analytics. IEEE TRANSACTIONS ON BIG DATA 2019; 5:109-119. [PMID: 31240237 PMCID: PMC6592627 DOI: 10.1109/tbdata.2018.2811508] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/09/2023]
Abstract
Since the BRAIN Initiative and Human Brain Project began, a few efforts have been made to address the computational challenges of neuroscience Big Data. The promises of these two projects were to model the complex interaction of brain and behavior and to understand and diagnose brain diseases by collecting and analyzing large quanitites of data. Archiving, analyzing, and sharing the growing neuroimaging datasets posed major challenges. New computational methods and technologies have emerged in the domain of Big Data but have not been fully adapted for use in neuroimaging. In this work, we introduce the current challenges of neuroimaging in a big data context. We review our efforts toward creating a data management system to organize the large-scale fMRI datasets, and present our novel algorithms/methods for the distributed fMRI data processing that employs Hadoop and Spark. Finally, we demonstrate the significant performance gains of our algorithms/methods to perform distributed dictionary learning.
Collapse
Affiliation(s)
- Milad Makkie
- Department of Computer Science, University of Georgia, Athens, GA 30602
| | - Xiang Li
- Clincial Data Science Center, Massachusetts General Hospital, Harvard Medical School, Boston, MA, 02114
| | - Shannon Quinn
- Department of Computer Science, University of Georgia, Athens, GA 30602
| | - Binbin Lin
- Department of Computational Medicine and Bioinformatics, University of Michigan, Ann Arbor, Ml 48109
| | - Jieping Ye
- Department of Computational Medicine and Bioinformatics, University of Michigan, Ann Arbor, Ml 48109
| | - Geoffrey Mon
- Department of Computer Science, University of Georgia, Athens, GA 30602
| | - Tianming Liu
- Department of Computer Science, University of Georgia, Athens, GA 30602
| |
Collapse
|
26
|
Chén OY, Crainiceanu C, Ogburn EL, Caffo BS, Wager TD, Lindquist MA. High-dimensional multivariate mediation with application to neuroimaging data. Biostatistics 2019. [PMID: 28637279 DOI: 10.1093/biostatistics/kxx027] [Citation(s) in RCA: 64] [Impact Index Per Article: 10.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/01/2023] Open
Abstract
Mediation analysis is an important tool in the behavioral sciences for investigating the role of intermediate variables that lie in the path between a treatment and an outcome variable. The influence of the intermediate variable on the outcome is often explored using a linear structural equation model (LSEM), with model coefficients interpreted as possible effects. While there has been significant research on the topic, little work has been done when the intermediate variable (mediator) is a high-dimensional vector. In this work, we introduce a novel method for identifying potential mediators in this setting called the directions of mediation (DMs). DMs linearly combine potential mediators into a smaller number of orthogonal components, with components ranked based on the proportion of the LSEM likelihood each accounts for. This method is well suited for cases when many potential mediators are measured. Examples of high-dimensional potential mediators are brain images composed of hundreds of thousands of voxels, genetic variation measured at millions of single nucleotide polymorphisms (SNPs), or vectors of thousands of variables in large-scale epidemiological studies. We demonstrate the method using a functional magnetic resonance imaging study of thermal pain where we are interested in determining which brain locations mediate the relationship between the application of a thermal stimulus and self-reported pain.
Collapse
Affiliation(s)
- Oliver Y Chén
- Department of Biostatistics, Johns Hopkins University, USA
| | | | | | - Brian S Caffo
- Department of Biostatistics, Johns Hopkins University, USA
| | - Tor D Wager
- Department of Psychology and Neuroscience, University of Colorado Boulder, 345 UCB, Boulder, CO 80309-0345, USA
| | - Martin A Lindquist
- Department of Biostatistics, Johns Hopkins University, 615 N Wolfe St, Baltimore, MD 21205, USA
| |
Collapse
|
27
|
Forouzannezhad P, Abbaspour A, Fang C, Cabrerizo M, Loewenstein D, Duara R, Adjouadi M. A survey on applications and analysis methods of functional magnetic resonance imaging for Alzheimer’s disease. J Neurosci Methods 2019; 317:121-140. [DOI: 10.1016/j.jneumeth.2018.12.012] [Citation(s) in RCA: 11] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/25/2018] [Revised: 12/04/2018] [Accepted: 12/17/2018] [Indexed: 12/23/2022]
|
28
|
Abstract
OBJECTIVE Canonical correlation analysis (CCA) is a data-driven method that has been successfully used in functional magnetic resonance imaging (fMRI) data analysis. Standard CCA extracts meaningful information from a pair of data sets by seeking pairs of linear combinations from two sets of variables with maximum pairwise correlation. So far, however, this method has been used without incorporating prior information available for fMRI data. In this paper, we address this issue by proposing a new CCA method named pCCA (for projection CCA). METHODS The proposed method is obtained by projection onto a set of basis vectors that better characterize temporal information in the fMRI data set. A methodology is presented to describe the basis selection process using discrete cosine transform (DCT) basis functions. Employing DCT guides the estimated canonical variates, yielding a more computationally efficient CCA procedure. RESULTS The performance gain of the proposed pCCA algorithm over standard and regularized CCA is illustrated on both simulated and real fMRI datasets from resting state, block paradigm task-related and event-related experiments. The results have shown that the proposed pCCA successfully extracts latent components from the task as well as resting-state datasets with increased specificity of the activated voxels. CONCLUSION In addition to offering a new CCA approach, when applied on fMRI data, the proposed algorithm adapts to variations of brain activity patterns and reveals the functionally connected brain regions. SIGNIFICANCE The proposed method can be seen as a regularized CCA method where regularization is introduced via basis expansion, which has the advantage of enforcing smoothness on canonical components.
Collapse
|
29
|
Alzheimer's Disease Diagnosis Based on Cortical and Subcortical Features. JOURNAL OF HEALTHCARE ENGINEERING 2019; 2019:2492719. [PMID: 30944718 PMCID: PMC6421724 DOI: 10.1155/2019/2492719] [Citation(s) in RCA: 16] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 07/19/2018] [Revised: 09/08/2018] [Accepted: 02/13/2019] [Indexed: 01/18/2023]
Abstract
Alzheimer's disease (AD) is a common neurodegenerative disease with an often seen prodromal mild cognitive impairment (MCI) phase, where memory loss is the main complaint progressively worsening with behavior issues and poor self-care. However, not all patients clinically diagnosed with MCI progress to the AD. Currently, several high-dimensional classification techniques have been developed to automatically distinguish among AD, MCI, and healthy control (HC) patients based on T1-weighted MRI. However, these method features are based on wavelets, contourlets, gray-level co-occurrence matrix, etc., rather than using clinical features which helps doctors to understand the pathological mechanism of the AD. In this study, a new approach is proposed using cortical thickness and subcortical volume for distinguishing binary and tertiary classification of the National Research Center for Dementia dataset (NRCD), which consists of 326 subjects. Five classification experiments are performed: binary classification, i.e., AD vs HC, HC vs mAD (MCI due to the AD), and mAD vs aAD (asymptomatic AD), and tertiary classification, i.e., AD vs HC vs mAD and AD vs HC vs aAD using cortical and subcortical features. Datasets were divided in a 70/30 ratio, and later, 70% were used for training and the remaining 30% were used to get an unbiased estimation performance of the suggested methods. For dimensionality reduction purpose, principal component analysis (PCA) was used. After that, the output of PCA was passed to various types of classifiers, namely, softmax, support vector machine (SVM), k-nearest neighbors, and naïve Bayes (NB) to check the performance of the model. Experiments on the NRCD dataset demonstrated that the softmax classifier is best suited for the AD vs HC classification with an F1 score of 99.06, whereas for other groups, the SVM classifier is best suited for the HC vs mAD, mAD vs aAD, and AD vs HC vs mAD classifications with the F1 scores being 99.51, 97.5, and 99.99, respectively. In addition, for the AD vs HC vs aAD classification, NB performed well with an F1 score of 95.88. In addition, to check our proposed model efficiency, we have also used the OASIS dataset for comparing with 9 state-of-the-art methods.
Collapse
|
30
|
Nazari A, Alavimajd H, Shakeri N, Bakhshandeh M, Faghihzadeh E, Marzbani H. Prediction of Brain Connectivity Map in Resting-State fMRI Data Using Shrinkage Estimator. Basic Clin Neurosci 2019; 10:147-156. [PMID: 31031901 PMCID: PMC6484194 DOI: 10.32598/bcn.9.10.140] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/07/2017] [Revised: 11/10/2017] [Accepted: 02/27/2018] [Indexed: 11/24/2022] Open
Abstract
Introduction: In recent years, brain functional connectivity studies are extended using the advanced statistical methods. Functional connectivity is identified by synchronous activation in a spatially distinct region of the brain in resting-state functional Magnetic Resonance Imaging (MRI) data. For this purpose there are several methods such as seed-based correlation analysis based on temporal correlation between different Regions of Interests (ROIs) or between brain’s voxels of prior seed. Methods: In the current study, test-retest Resting State functional MRI (rs-fMRI) data of 21 healthy subjects were analyzed to predict second replication connectivity map using first replication data. A potential estimator is “raw estimator” that uses the first replication data from each subject to predict the second replication connectivity map of the same subject. The second estimator, “mean estimator” uses the average of all sample subjects' connectivity to estimate the correlation map. Shrinkage estimator is made by shrinking raw estimator towards the average connectivity map of all subjects' first replicate. Prediction performance of the second replication correlation map is evaluated by Mean Squared Error (MSE) criteria. Results: By the employment of seed-based correlation analysis and choosing precentral gyrus as the ROI over 21 subjects in the study, on average MSE for raw, mean and shrinkage estimator were 0.2169, 0.1118, and 0.1103, respectively. Also, percent reduction of MSE for shrinkage and mean estimator in comparison with raw estimator is 49.14 and 48.45, respectively. Conclusion: Shrinkage approach has the positive effect on the prediction of functional connectivity. When data has a large between session variability, prediction of connectivity map can be improved by shrinking towards population mean.
Collapse
Affiliation(s)
- Atiye Nazari
- Department of Biostatistics, Faculty of Allied Medical Sciences, Shahid Beheshti University of Medical Sciences, Tehran, Iran
| | - Hamid Alavimajd
- Department of Biostatistics, Faculty of Allied Medical Sciences, Shahid Beheshti University of Medical Sciences, Tehran, Iran
| | - Nezhat Shakeri
- Department of Biostatistics, Faculty of Allied Medical Sciences, Shahid Beheshti University of Medical Sciences, Tehran, Iran
| | - Mohsen Bakhshandeh
- Department of Radiology Technology, Faculty of Allied Medical Sciences, Shahid Beheshti University of Medical Sciences, Tehran, Iran
| | - Elham Faghihzadeh
- Department of Biostatistics, Faculty of Allied Medical Sciences, Shahid Beheshti University of Medical Sciences, Tehran, Iran
| | - Hengameh Marzbani
- Department of Biomedical Engineering and Medical Physics, School of Medicine, Tehran University of Medical Sciences, Tehran, Iran.,Neural Engineering Research Center, Noorafshar Hospital, Tehran, Iran
| |
Collapse
|
31
|
Makkie M, Huang H, Zhao Y, Vasilakos AV, Liu T. Fast and scalable distributed deep convolutional autoencoder for fMRI big data analytics. Neurocomputing 2019; 325:20-30. [PMID: 31354187 PMCID: PMC6660166 DOI: 10.1016/j.neucom.2018.09.066] [Citation(s) in RCA: 12] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/20/2023]
Abstract
In recent years, analyzing task-based fMRI (tfMRI) data has become an essential tool for understanding brain function and networks. However, due to the sheer size of tfMRI data, its intrinsic complex structure, and lack of ground truth of underlying neural activities, modeling tfMRI data is hard and challenging. Previously proposed data modeling methods including Independent Component Analysis (ICA) and Sparse Dictionary Learning only provided shallow models based on blind source separation under the strong assumption that original fMRI signals could be linearly decomposed into time series components with corresponding spatial maps. Given the Convolutional Neural Network (CNN) successes in learning hierarchical abstractions from low-level data such as tfMRI time series, in this work we propose a novel scalable distributed deep CNN autoencoder model and apply it for fMRI big data analysis. This model aims to both learn the complex hierarchical structures of the tfMRI big data and to leverage the processing power of multiple GPUs in a distributed fashion. To deploy such a model, we have created an enhanced processing pipeline on the top of Apache Spark and Tensorflow, leveraging from a large cluster of GPU nodes over cloud. Experimental results from applying the model on the Human Connectome Project (HCP) data show that the proposed model is efficient and scalable toward tfMRI big data modeling and analytics, thus enabling data-driven extraction of hierarchical neuroscientific information from massive fMRI big data.
Collapse
Affiliation(s)
- Milad Makkie
- Computer Science Department, University of Georgia, Athens, GA, United States
| | - Heng Huang
- School of Automation, Northwestern Polytechnical University, Xi’an, China
| | - Yu Zhao
- Computer Science Department, University of Georgia, Athens, GA, United States
| | | | - Tianming Liu
- Computer Science Department, University of Georgia, Athens, GA, United States
| |
Collapse
|
32
|
Seghouane AK, Iqbal A. The adaptive block sparse PCA and its application to multi-subject FMRI data analysis using sparse mCCA. SIGNAL PROCESSING 2018; 153:311-320. [DOI: 10.1016/j.sigpro.2018.07.021] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 09/02/2023]
|
33
|
Iqbal A, Seghouane AK. A dictionary learning algorithm for multi-subject fMRI analysis based on a hybrid concatenation scheme. DIGITAL SIGNAL PROCESSING 2018; 83:249-260. [DOI: 10.1016/j.dsp.2018.09.007] [Citation(s) in RCA: 6] [Impact Index Per Article: 0.9] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 09/02/2023]
|
34
|
Iqbal A, Seghouane AK, Adali T. Shared and Subject-Specific Dictionary Learning (ShSSDL) Algorithm for Multisubject fMRI Data Analysis. IEEE Trans Biomed Eng 2018; 65:2519-2528. [DOI: 10.1109/tbme.2018.2806958] [Citation(s) in RCA: 17] [Impact Index Per Article: 2.4] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/07/2022]
|
35
|
Qadar MA, Seghouane AK. PCCA: A Projection CCA Method for Effective FMRI Data Analysis. 2018 25TH IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP) 2018. [DOI: 10.1109/icip.2018.8451695] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 09/01/2023]
|
36
|
Kiortsis DN, Spyridonos P, Margariti PN, Xydis V, Alexiou G, Astrakas LG, Argyropoulou MI. Brain activation during repeated imagining of chocolate consumption: a functional magnetic resonance imaging study. Hormones (Athens) 2018; 17:367-371. [PMID: 30105568 DOI: 10.1007/s42000-018-0053-1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 07/23/2018] [Accepted: 07/31/2018] [Indexed: 10/28/2022]
Abstract
OBJECTIVE To assess brain activation during mental visualization of eating chocolate. DESIGN Twenty-one subjects were included. FMRI was acquired with a single-shot, multislice, gradient echo-planar sequence, while subjects were performing two specific imaginary tasks. RESULTS Activation of motor-associated brain areas was observed during both mental visualization tasks. Increased activation of the right dorsolateral prefrontal cortex, the thalamus, the postcentral gyrus and the left anterior cingulate cortex, and the precuneus was observed during imagining eating chocolate. CONCLUSIONS Repeated imagination of chocolate consumption results in activation of brain areas associated with hedonic effects of food and satiety and inhibition of orexigenic areas.
Collapse
Affiliation(s)
- Dimitrios N Kiortsis
- Department of Nuclear Medicine, Medical School, University of Ioannina, Ioannina, Greece
| | - Panagiota Spyridonos
- Department of Medical Physics, Medical School, University of Ioannina, Ioannina, Greece
| | | | - Vassileios Xydis
- Department of Radiology, Medical School, University of Ioannina, Ioannina, Greece
| | - George Alexiou
- Department of Neurosurgery, Medical School, University of Ioannina, PO BOX 103, Neohoropoulo, 45500, Ioannina, Greece.
| | - Loukas G Astrakas
- Department of Medical Physics, Medical School, University of Ioannina, Ioannina, Greece
| | - Maria I Argyropoulou
- Department of Radiology, Medical School, University of Ioannina, Ioannina, Greece
| |
Collapse
|
37
|
Jiang X, Zhao L, Liu H, Guo L, Kendrick KM, Liu T. A Cortical Folding Pattern-Guided Model of Intrinsic Functional Brain Networks in Emotion Processing. Front Neurosci 2018; 12:575. [PMID: 30186102 PMCID: PMC6110906 DOI: 10.3389/fnins.2018.00575] [Citation(s) in RCA: 17] [Impact Index Per Article: 2.4] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/05/2018] [Accepted: 07/30/2018] [Indexed: 01/21/2023] Open
Abstract
There have been increasing studies demonstrating that emotion processing in humans is realized by the interaction within or among the large-scale intrinsic functional brain networks. Identifying those meaningful intrinsic functional networks based on task-based functional magnetic resonance imaging (task fMRI) with specific emotional stimuli and responses, and exploring the underlying functional working mechanisms of interregional neural communication within the intrinsic functional networks are thus of great importance to understand the neural basis of emotion processing. In this paper, we propose a novel cortical folding pattern-guided model of intrinsic networks in emotion processing: gyri serve as global functional connection centers that perform interregional neural communication among distinct regions via long distance dense axonal fibers, and sulci serve as local functional units that directly communicate with neighboring gyri via short distance fibers and indirectly communicate with other distinct regions via the neighboring gyri. We test the proposed model by adopting a computational framework of dictionary learning and sparse representation of emotion task fMRI data of 68 subjects in the publicly released Human Connectome Project. The proposed model provides novel insights of functional mechanisms in emotion processing.
Collapse
Affiliation(s)
- Xi Jiang
- The Clinical Hospital of Chengdu Brain Science Institute, MOE Key Lab for Neuroinformation, School of Life Science and Technology, University of Electronic Science and Technology of China, Chengdu, China
| | - Lin Zhao
- School of Automation, Northwestern Polytechnical University, Xi'an, China
| | - Huan Liu
- School of Automation, Northwestern Polytechnical University, Xi'an, China
| | - Lei Guo
- School of Automation, Northwestern Polytechnical University, Xi'an, China
| | - Keith M. Kendrick
- The Clinical Hospital of Chengdu Brain Science Institute, MOE Key Lab for Neuroinformation, School of Life Science and Technology, University of Electronic Science and Technology of China, Chengdu, China
| | - Tianming Liu
- Department of Computer Science and Bioimaging Research Center, University of Georgia, Athens, GA, United States
| |
Collapse
|
38
|
Chen Y, Härdle WK, He Q, Majer P. Risk related brain regions detection and individual risk classification with 3D image FPCA. STATISTICS & RISK MODELING 2018. [DOI: 10.1515/strm-2017-0011] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/15/2022]
Abstract
Abstract
Understanding how people make decisions from risky choices has attracted increasing attention of researchers in economics, psychology and neuroscience. While economists try to evaluate individual’s risk preference through mathematical modeling, neuroscientists answer the question by exploring the neural activities of the brain. We propose a model-free method, 3-dimensional image functional principal component analysis (3DIF), to provide a connection between active risk related brain region detection and individual’s risk preference. The 3DIF methodology is directly applicable to 3-dimensional image data without artificial vectorization or mapping and simultaneously guarantees the contiguity of risk related brain regions rather than discrete voxels. Simulation study evidences an accurate and reasonable region detection using the 3DIF method. In real data analysis, five important risk related brain regions are detected, including parietal cortex (PC), ventrolateral prefrontal cortex (VLPFC), lateral orbifrontal cortex (lOFC), anterior insula (aINS) and dorsolateral prefrontal cortex (DLPFC), while the alternative methods only identify limited risk related regions. Moreover, the 3DIF method is useful for extraction of subjective specific signature scores that carry explanatory power for individual’s risk attitude. In particular, the 3DIF method perfectly classifies both strongly and weakly risk averse subjects for in-sample analysis. In out-of-sample experiment, it achieves 73 -88 overall accuracy, among which 90 -100 strongly risk averse subjects and 49 -71 weakly risk averse subjects are correctly classified with leave-k-out cross validations.
Collapse
Affiliation(s)
- Ying Chen
- Department of Mathematics , National University of Singapore , Singapore , Singapore ; and Department of Statistics and Applied Probability, National University of Singapore, Singapore; and Risk Management Institute, National University of Singapore, Singapore
| | - Wolfgang K. Härdle
- Ladislaus von Bortkiewicz Chair of Statistics , C.A.S.E. Center for Applied Statistics & Economics , Humboldt-Universität zu Berlin , Berlin , Germany ; and Sim Kee Boon Institute (SKBI) for Financial Economics at Singapore Management University, Singapore
| | - Qiang He
- Department of Statistics and Applied Probability , National University of Singapore , Singapore , Singapore
| | - Piotr Majer
- Ladislaus von Bortkiewicz Chair of Statistics , C.A.S.E. Center for Applied Statistics & Economics , Humboldt-Universität zu Berlin , Berlin , Germany
| |
Collapse
|
39
|
Hu X, Huang H, Peng B, Han J, Liu N, Lv J, Guo L, Guo C, Liu T. Latent source mining in FMRI via restricted Boltzmann machine. Hum Brain Mapp 2018; 39:2368-2380. [PMID: 29457314 PMCID: PMC6866484 DOI: 10.1002/hbm.24005] [Citation(s) in RCA: 32] [Impact Index Per Article: 4.6] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/14/2017] [Revised: 01/21/2018] [Accepted: 02/05/2018] [Indexed: 12/21/2022] Open
Abstract
Blind source separation (BSS) is commonly used in functional magnetic resonance imaging (fMRI) data analysis. Recently, BSS models based on restricted Boltzmann machine (RBM), one of the building blocks of deep learning models, have been shown to improve brain network identification compared to conventional single matrix factorization models such as independent component analysis (ICA). These models, however, trained RBM on fMRI volumes, and are hence challenged by model complexity and limited training set. In this article, we propose to apply RBM to fMRI time courses instead of volumes for BSS. The proposed method not only interprets fMRI time courses explicitly to take advantages of deep learning models in latent feature learning but also substantially reduces model complexity and increases the scale of training set to improve training efficiency. Our experimental results based on Human Connectome Project (HCP) datasets demonstrated the superiority of the proposed method over ICA and the one that applied RBM to fMRI volumes in identifying task-related components, resulted in more accurate and specific representations of task-related activations. Moreover, our method separated out components representing intermixed effects between task events, which could reflect inherent interactions among functionally connected brain regions. Our study demonstrates the value of RBM in mining complex structures embedded in large-scale fMRI data and its potential as a building block for deeper models in fMRI data analysis.
Collapse
Affiliation(s)
- Xintao Hu
- School of AutomationNorthwestern Polytechnical UniversityXi'anChina
| | - Heng Huang
- School of AutomationNorthwestern Polytechnical UniversityXi'anChina
| | - Bo Peng
- School of AutomationNorthwestern Polytechnical UniversityXi'anChina
| | - Junwei Han
- School of AutomationNorthwestern Polytechnical UniversityXi'anChina
| | - Nian Liu
- School of AutomationNorthwestern Polytechnical UniversityXi'anChina
| | - Jinglei Lv
- School of AutomationNorthwestern Polytechnical UniversityXi'anChina
- Cortical Architecture Imaging and Discovery Lab, Department of Computer Science and Bioimaging Research CenterThe University of GeorgiaAthensGeorgia
| | - Lei Guo
- School of AutomationNorthwestern Polytechnical UniversityXi'anChina
| | - Christine Guo
- QIMR Berghofer Medical Research InstituteHerstonQueenslandAustralia
| | - Tianming Liu
- Cortical Architecture Imaging and Discovery Lab, Department of Computer Science and Bioimaging Research CenterThe University of GeorgiaAthensGeorgia
| |
Collapse
|
40
|
Ge B, Li X, Jiang X, Sun Y, Liu T. A Dictionary Learning Approach for Signal Sampling in Task-Based fMRI for Reduction of Big Data. Front Neuroinform 2018; 12:17. [PMID: 29706880 PMCID: PMC5906552 DOI: 10.3389/fninf.2018.00017] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/10/2017] [Accepted: 03/26/2018] [Indexed: 01/17/2023] Open
Abstract
The exponential growth of fMRI big data offers researchers an unprecedented opportunity to explore functional brain networks. However, this opportunity has not been fully explored yet due to the lack of effective and efficient tools for handling such fMRI big data. One major challenge is that computing capabilities still lag behind the growth of large-scale fMRI databases, e.g., it takes many days to perform dictionary learning and sparse coding of whole-brain fMRI data for an fMRI database of average size. Therefore, how to reduce the data size but without losing important information becomes a more and more pressing issue. To address this problem, we propose a signal sampling approach for significant fMRI data reduction before performing structurally-guided dictionary learning and sparse coding of whole brain's fMRI data. We compared the proposed structurally guided sampling method with no sampling, random sampling and uniform sampling schemes, and experiments on the Human Connectome Project (HCP) task fMRI data demonstrated that the proposed method can achieve more than 15 times speed-up without sacrificing the accuracy in identifying task-evoked functional brain networks.
Collapse
Affiliation(s)
- Bao Ge
- Key Laboratory of Modern Teaching Technology, Ministry of Education, Xi'an, China.,School of Physics and Information Technology, Shaanxi Normal University, Xi'an, China
| | - Xiang Li
- Cortical Architecture Imaging and Discovery Lab, Department of Computer Science and Bioimaging Research Center, University of Georgia, Athens, GA, United States
| | - Xi Jiang
- The Clinical Hospital of Chengdu Brain Science Institute, MOE Key Lab for Neuroinformation, School of Life Science and Technology, University of Electronic Science and Technology of China, Chengdu, China
| | - Yifei Sun
- School of Physics and Information Technology, Shaanxi Normal University, Xi'an, China
| | - Tianming Liu
- Cortical Architecture Imaging and Discovery Lab, Department of Computer Science and Bioimaging Research Center, University of Georgia, Athens, GA, United States
| |
Collapse
|
41
|
Jagtap J, Sharma G, Parchur AK, Gogineni V, Bergom C, White S, Flister MJ, Joshi A. Methods for detecting host genetic modifiers of tumor vascular function using dynamic near-infrared fluorescence imaging. BIOMEDICAL OPTICS EXPRESS 2018; 9:543-556. [PMID: 29552392 PMCID: PMC5854057 DOI: 10.1364/boe.9.000543] [Citation(s) in RCA: 11] [Impact Index Per Article: 1.6] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 10/18/2017] [Revised: 12/07/2017] [Accepted: 01/03/2018] [Indexed: 05/06/2023]
Abstract
Vascular supply is a critical component of the tumor microenvironment (TME) and is essential for tumor growth and metastasis, yet the endogenous genetic modifiers that impact vascular function in the TME are largely unknown. To identify the host TME modifiers of tumor vascular function, we combined a novel genetic mapping strategy [Consomic Xenograft Model] with near-infrared (NIR) fluorescence imaging and multiparametric analysis of pharmacokinetic modeling. To detect vascular flow, an intensified cooled camera based dynamic NIR imaging system with 785 nm laser diode based excitation was used to image the whole-body fluorescence emission of intravenously injected indocyanine green dye. Principal component analysis was used to extract the spatial segmentation information for the lungs, liver, and tumor regions-of-interest. Vascular function was then quantified by pK modeling of the imaging data, which revealed significantly altered tissue perfusion and vascular permeability that were caused by host genetic modifiers in the TME. Collectively, these data demonstrate that NIR fluorescent imaging can be used as a non-invasive means for characterizing host TME modifiers of vascular function that have been linked with tumor risk, progression, and response to therapy.
Collapse
Affiliation(s)
- Jaidip Jagtap
- Department of Biomedical Engineering, Medical College of Wisconsin, Milwaukee, WI 53226, USA
| | - Gayatri Sharma
- Department of Biomedical Engineering, Medical College of Wisconsin, Milwaukee, WI 53226, USA
| | - Abdul K. Parchur
- Department of Biomedical Engineering, Medical College of Wisconsin, Milwaukee, WI 53226, USA
| | | | - Carmen Bergom
- Department of Radiation Oncology, Medical College of Wisconsin, Milwaukee, WI 53226, USA
| | - Sarah White
- Department of Radiology, Medical College of Wisconsin, Milwaukee, WI 53226, USA
| | - Michael J. Flister
- Department of Physiology, Medical College of Wisconsin, Milwaukee, WI 53226, USA
| | - Amit Joshi
- Department of Biomedical Engineering, Medical College of Wisconsin, Milwaukee, WI 53226, USA
- Department of Radiology, Medical College of Wisconsin, Milwaukee, WI 53226, USA
| |
Collapse
|
42
|
Zhang W, Jiang X, Zhang S, Howell BR, Zhao Y, Zhang T, Guo L, Sanchez MM, Hu X, Liu T. Connectome-scale functional intrinsic connectivity networks in macaques. Neuroscience 2017; 364:1-14. [PMID: 28842187 DOI: 10.1016/j.neuroscience.2017.08.022] [Citation(s) in RCA: 14] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/16/2017] [Revised: 08/10/2017] [Accepted: 08/11/2017] [Indexed: 01/06/2023]
Abstract
There have been extensive studies of intrinsic connectivity networks (ICNs) in the human brains using resting-state functional magnetic resonance imaging (fMRI) in the literature. However, the functional organization of ICNs in macaque brains has been less explored so far, despite growing interests in the field. In this work, we propose a computational framework to identify connectome-scale group-wise consistent ICNs in macaques via sparse representation of whole-brain resting-state fMRI data. Experimental results demonstrate that 70 group-wise consistent ICNs are successfully identified in macaque brains via the proposed framework. These 70 ICNs are interpreted based on two publicly available parcellation maps of macaque brains and our work significantly expand currently known macaque ICNs already reported in the literature. In general, this set of connectome-scale group-wise consistent ICNs can potentially benefit a variety of studies in the neuroscience and brain-mapping fields, and they provide a foundation to better understand brain evolution in the future.
Collapse
Affiliation(s)
- Wei Zhang
- Cortical Architecture Imaging and Discovery Lab, Department of Computer Science and Bioimaging Research Center, The University of Georgia, Athens, GA, USA
| | - Xi Jiang
- Cortical Architecture Imaging and Discovery Lab, Department of Computer Science and Bioimaging Research Center, The University of Georgia, Athens, GA, USA
| | - Shu Zhang
- Cortical Architecture Imaging and Discovery Lab, Department of Computer Science and Bioimaging Research Center, The University of Georgia, Athens, GA, USA
| | - Brittany R Howell
- Department of Psychiatry & Behavioral Sciences, Emory University School of Medicine, Atlanta, GA, USA; Yerkes National Primate Research Center, Emory University, Atlanta, GA, USA; Institute of Child Development, University of Minnesota, Minneapolis, MN, USA
| | - Yu Zhao
- Cortical Architecture Imaging and Discovery Lab, Department of Computer Science and Bioimaging Research Center, The University of Georgia, Athens, GA, USA
| | - Tuo Zhang
- School of Automation, Northwestern Polytechnical University, Xi'an, PR China; Cortical Architecture Imaging and Discovery Lab, Department of Computer Science and Bioimaging Research Center, The University of Georgia, Athens, GA, USA
| | - Lei Guo
- School of Automation, Northwestern Polytechnical University, Xi'an, PR China
| | - Mar M Sanchez
- Department of Psychiatry & Behavioral Sciences, Emory University School of Medicine, Atlanta, GA, USA; Yerkes National Primate Research Center, Emory University, Atlanta, GA, USA
| | - Xiaoping Hu
- Department of Bioengineering, UC Riverside, CA, USA
| | - Tianming Liu
- Cortical Architecture Imaging and Discovery Lab, Department of Computer Science and Bioimaging Research Center, The University of Georgia, Athens, GA, USA.
| |
Collapse
|
43
|
Twin SVM-Based Classification of Alzheimer's Disease Using Complex Dual-Tree Wavelet Principal Coefficients and LDA. JOURNAL OF HEALTHCARE ENGINEERING 2017; 2017:8750506. [PMID: 29065660 PMCID: PMC5576415 DOI: 10.1155/2017/8750506] [Citation(s) in RCA: 32] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 11/05/2016] [Revised: 02/22/2017] [Accepted: 04/27/2017] [Indexed: 11/17/2022]
Abstract
Alzheimer's disease (AD) is a leading cause of dementia, which causes serious health and socioeconomic problems. A progressive neurodegenerative disorder, Alzheimer's causes the structural change in the brain, thereby affecting behavior, cognition, emotions, and memory. Numerous multivariate analysis algorithms have been used for classifying AD, distinguishing it from healthy controls (HC). Efficient early classification of AD and mild cognitive impairment (MCI) from HC is imperative as early preventive care could help to mitigate risk factors. Magnetic resonance imaging (MRI), a noninvasive biomarker, displays morphometric differences and cerebral structural changes. A novel approach for distinguishing AD from HC using dual-tree complex wavelet transforms (DTCWT), principal coefficients from the transaxial slices of MRI images, linear discriminant analysis, and twin support vector machine is proposed here. The prediction accuracy of the proposed method yielded up to 92.65 ± 1.18 over the Alzheimer's Disease Neuroimaging Initiative (ADNI) dataset, with a specificity of 92.19 ± 1.56 and sensitivity of 93.11 ± 1.29, and 96.68 ± 1.44 over the Open Access Series of Imaging Studies (OASIS) dataset, with a sensitivity of 97.72 ± 2.34 and specificity of 95.61 ± 1.67. The accuracy, sensitivity, and specificity achieved using the proposed method are comparable or superior to those obtained by various conventional AD prediction methods.
Collapse
|
44
|
Zhao S, Han J, Hu X, Jiang X, Lv J, Zhang T, Zhang S, Guo L, Liu T. Extendable supervised dictionary learning for exploring diverse and concurrent brain activities in task-based fMRI. Brain Imaging Behav 2017; 12:743-757. [DOI: 10.1007/s11682-017-9733-8] [Citation(s) in RCA: 10] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/28/2022]
|
45
|
Seghouane AK, Iqbal A. Sequential Dictionary Learning From Correlated Data: Application to fMRI Data Analysis. IEEE TRANSACTIONS ON IMAGE PROCESSING : A PUBLICATION OF THE IEEE SIGNAL PROCESSING SOCIETY 2017; 26:3002-3015. [PMID: 28333636 DOI: 10.1109/tip.2017.2686014] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/06/2023]
Abstract
Sequential dictionary learning via the K-SVD algorithm has been revealed as a successful alternative to conventional data driven methods, such as independent component analysis for functional magnetic resonance imaging (fMRI) data analysis. fMRI data sets are however structured data matrices with notions of spatio-temporal correlation and temporal smoothness. This prior information has not been included in the K-SVD algorithm when applied to fMRI data analysis. In this paper, we propose three variants of the K-SVD algorithm dedicated to fMRI data analysis by accounting for this prior information. The proposed algorithms differ from the K-SVD in their sparse coding and dictionary update stages. The first two algorithms account for the known correlation structure in the fMRI data by using the squared Q, R-norm instead of the Frobenius norm for matrix approximation. The third and last algorithms account for both the known correlation structure in the fMRI data and the temporal smoothness. The temporal smoothness is incorporated in the dictionary update stage via regularization of the dictionary atoms obtained with penalization. The performance of the proposed dictionary learning algorithms is illustrated through simulations and applications on real fMRI data.
Collapse
|
46
|
Seghouane AK, Iqbal A, Desai N. BSmCCA: A block sparse multiple-set canonical correlation analysis algorithm for multi-subject fMRI data sets. 2017 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP) 2017. [DOI: 10.1109/icassp.2017.7953373] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 09/02/2023]
|
47
|
Coordination of Brain-Wide Activity Dynamics by Dopaminergic Neurons. Neuropsychopharmacology 2017; 42:615-627. [PMID: 27515791 PMCID: PMC5240174 DOI: 10.1038/npp.2016.151] [Citation(s) in RCA: 54] [Impact Index Per Article: 6.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 05/10/2016] [Revised: 07/15/2016] [Accepted: 07/26/2016] [Indexed: 01/21/2023]
Abstract
Several neuropsychiatric conditions, such as addiction and schizophrenia, may arise in part from dysregulated activity of ventral tegmental area dopaminergic (THVTA) neurons, as well as from more global maladaptation in neurocircuit function. However, whether THVTA activity affects large-scale brain-wide function remains unknown. Here we selectively activated THVTA neurons in transgenic rats and measured resulting changes in whole-brain activity using stimulus-evoked functional magnetic resonance imaging. Applying a standard generalized linear model analysis approach, our results indicate that selective optogenetic stimulation of THVTA neurons enhanced cerebral blood volume signals in striatal target regions in a dopamine receptor-dependent manner. However, brain-wide voxel-based principal component analysis of the same data set revealed that dopaminergic modulation activates several additional anatomically distinct regions throughout the brain, not typically associated with dopamine release events. Furthermore, explicit pairing of THVTA neuronal activation with a forepaw stimulus of a particular frequency expanded the sensory representation of that stimulus, not exclusively within the somatosensory cortices, but brain-wide. These data suggest that modulation of THVTA neurons can impact brain dynamics across many distributed anatomically distinct regions, even those that receive little to no direct THVTA input.
Collapse
|
48
|
Geha P, Cecchi G, Todd Constable R, Abdallah C, Small DM. Reorganization of brain connectivity in obesity. Hum Brain Mapp 2016; 38:1403-1420. [PMID: 27859973 DOI: 10.1002/hbm.23462] [Citation(s) in RCA: 63] [Impact Index Per Article: 7.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/09/2016] [Revised: 10/27/2016] [Accepted: 11/01/2016] [Indexed: 12/24/2022] Open
Abstract
Global brain connectivity (GBC) identifies regions of the brain, termed "hubs," which are densely connected and metabolically costly, and have a wide influence on brain function. Since obesity is associated with central and peripheral metabolic dysfunction we sought to determine if GBC is altered in obesity. Two independent fMRI data sets were subjected to GBC analyses. The first data set was acquired while participants (n = 15 healthy weight and 15 obese) tasted milkshake and the second with participants at rest (n = 33 healthy weight and 28 obese). In the resting state and during milkshake consumption GBC is consistently decreased in the ventromedial and ventrolateral prefrontal cortex, insula and caudate nucleus, and increased in brain regions belonging to the dorsal attention network including premotor areas, superior parietal lobule, and visual cortex. During milkshake consumption, but not at rest, additional decreases in GBC are observed in feeding-related circuitry including the insula, amygdala, anterior hippocampus, hypothalamus, midbrain, brainstem and somatomotor cortex. Additionally, GBC differences were not accounted for by age. These results demonstrate that obesity is associated with decreased GBC in prefrontal and feeding circuits and increased GBC in the dorsal attention network. We therefore conclude that global brain organization is altered in obesity to favor networks important for external orientation over those monitoring homeostatic state and guiding feeding decisions. Furthermore, since prefrontal decreases are also observed at rest in obese individuals future work should evaluate whether these changes are associated with neurocognitive impairments frequently observed in obesity and diabetes. Hum Brain Mapp 38:1403-1420, 2017. © 2016 Wiley Periodicals, Inc.
Collapse
Affiliation(s)
- Paul Geha
- Department of Psychiatry, Yale University School of Medicine, New Haven, Connecticut.,The John B. Pierce Laboratory, New Haven, Connecticut
| | | | - R Todd Constable
- Diagnostic Radiology, Yale University School of Medicine, New Haven, Connecticut
| | - Chadi Abdallah
- Department of Psychiatry, Yale University School of Medicine, New Haven, Connecticut
| | - Dana M Small
- Department of Psychiatry, Yale University School of Medicine, New Haven, Connecticut.,The John B. Pierce Laboratory, New Haven, Connecticut.,Department of Psychology, Yale University, New Haven, Connecticut
| |
Collapse
|
49
|
Filkowski MM, Haas BW. Rethinking the Use of Neutral Faces as a Baseline in fMRI Neuroimaging Studies of Axis-I Psychiatric Disorders. J Neuroimaging 2016; 27:281-291. [PMID: 27805291 DOI: 10.1111/jon.12403] [Citation(s) in RCA: 32] [Impact Index Per Article: 3.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/01/2016] [Accepted: 09/30/2016] [Indexed: 11/29/2022] Open
Abstract
Major Axis-I disorders including major depressive disorder (MDD), bipolar disorder (BD), anxiety disorder, and schizophrenia are associated with a host of aberrations in the way social stimuli are processed. Face perception tasks are often used in neuroimaging research of emotion processing in both healthy and patient populations, and to date, there exists a mounting body of evidence, both behavioral and within the brain, indicating that emotional faces compared to neutral faces are processed abnormally by those with Axis-I disorders relative to healthy control (HC) groups. The use of neutral faces as a "baseline control condition" is predicated on the assumption that neutral faces are processed in the same way HCs and individuals with major Axis-I disorders. In this paper, existing fMRI studies examining the way neutral faces are processed in groups with Axis-I disorders involving socioaffective perception are reviewed. In reviewing available studies, a consistent pattern of results demonstrated that these disorders are associated with abnormal frontolimbic activity in response to neutral faces and in particular within the amygdala and prefrontal regions such as the dorsolateral prefrontal cortex (DLPFC) and anterior cingulate cortex (ACC) compared to HC groups. Specifically, increased amygdala activation was consistently reported in response to neutral faces in anxiety disorders and schizophrenia. Abnormal medial PFC activity was reported in patients with MDD, and patients with BD exhibit decreased activity in the DLPFC and ACC relative to HCs. In addition, specific suggestions to overcome these obstacles with new research and additional analyses are discussed.
Collapse
Affiliation(s)
- Megan M Filkowski
- Behavioral and Brain Sciences Program, Department of Psychology, University of Georgia, 125 Baldwin Street, Athens, GA
| | - Brian W Haas
- Behavioral and Brain Sciences Program, Department of Psychology, University of Georgia, 125 Baldwin Street, Athens, GA
| |
Collapse
|
50
|
Silva RF, Plis SM, Sui J, Pattichis MS, Adalı T, Calhoun VD. Blind Source Separation for Unimodal and Multimodal Brain Networks: A Unifying Framework for Subspace Modeling. IEEE JOURNAL OF SELECTED TOPICS IN SIGNAL PROCESSING 2016; 10:1134-1149. [PMID: 28461840 PMCID: PMC5409135 DOI: 10.1109/jstsp.2016.2594945] [Citation(s) in RCA: 14] [Impact Index Per Article: 1.6] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/13/2023]
Abstract
In the past decade, numerous advances in the study of the human brain were fostered by successful applications of blind source separation (BSS) methods to a wide range of imaging modalities. The main focus has been on extracting "networks" represented as the underlying latent sources. While the broad success in learning latent representations from multiple datasets has promoted the wide presence of BSS in modern neuroscience, it also introduced a wide variety of objective functions, underlying graphical structures, and parameter constraints for each method. Such diversity, combined with a host of datatype-specific know-how, can cause a sense of disorder and confusion, hampering a practitioner's judgment and impeding further development. We organize the diverse landscape of BSS models by exposing its key features and combining them to establish a novel unifying view of the area. In the process, we unveil important connections among models according to their properties and subspace structures. Consequently, a high-level descriptive structure is exposed, ultimately helping practitioners select the right model for their applications. Equipped with that knowledge, we review the current state of BSS applications to neuroimaging. The gained insight into model connections elicits a broader sense of generalization, highlighting several directions for model development. In light of that, we discuss emerging multi-dataset multidimensional (MDM) models and summarize their benefits for the study of the healthy brain and disease-related changes.
Collapse
Affiliation(s)
- Rogers F. Silva
- Dept. of ECE at The University of New Mexico, NM USA
- The Mind Research Network, LBERI, Albuquerque, New Mexico USA
| | - Sergey M. Plis
- The Mind Research Network, LBERI, Albuquerque, New Mexico USA
| | - Jing Sui
- Brainnetome Center & NLPR, Institute of Automation, Chinese Academy of Sciences, Beijing China
- The Mind Research Network, LBERI, Albuquerque, New Mexico USA
| | | | - Tülay Adalı
- Dept. of CSEE, University of Maryland Baltimore County, Baltimore, Maryland USA
| | - Vince D. Calhoun
- Dept. of ECE at The University of New Mexico, NM USAThe Mind Research Network, LBERI, Albuquerque, New Mexico USA
| |
Collapse
|