1
|
Bao R, Song Y, Bates SV, Weiss RJ, Foster AN, Jaimes C, Sotardi S, Zhang Y, Hirschtick RL, Grant PE, Ou Y. BOston Neonatal Brain Injury Data for Hypoxic Ischemic Encephalopathy (BONBID-HIE): I. MRI and Lesion Labeling. Sci Data 2025; 12:53. [PMID: 39799120 PMCID: PMC11724925 DOI: 10.1038/s41597-024-03986-7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/31/2024] [Accepted: 09/02/2024] [Indexed: 01/15/2025] Open
Abstract
Hypoxic ischemic encephalopathy (HIE) is a brain injury that occurs in 1 ~ 5/1000 term neonates. Accurate identification and segmentation of HIE-related lesions in neonatal brain magnetic resonance images (MRIs) is the first step toward identifying high-risk patients, understanding neurological symptoms, evaluating treatment effects, and predicting outcomes. We release the first public dataset containing neonatal brain diffusion MRI and expert annotation of lesions from 133 patients diagnosed with HIE. HIE-related lesions in brain MRI are often diffuse (i.e., multi-focal), and small (over half the patients in our data having lesions occupying <1% of the brain volume (including ventricles)). Segmentation for HIE MRI data is remarkably different from, and arguably more challenging than, other segmentation tasks such as brain tumors with focal and relatively large lesions. We hope that this dataset can help fuel the development of MRI lesion segmentation methods for HIE and small diffuse lesions in general.
Collapse
Affiliation(s)
- Rina Bao
- Boston Children's Hospital, Boston, MA, USA.
- Harvard Medical School, Boston, MA, USA.
| | | | - Sara V Bates
- Harvard Medical School, Boston, MA, USA
- Massachusetts General Hospital, Boston, MA, USA
| | | | | | - Camilo Jaimes
- Harvard Medical School, Boston, MA, USA
- Massachusetts General Hospital, Boston, MA, USA
| | | | - Yue Zhang
- Boston Children's Hospital, Boston, MA, USA
| | - Randy L Hirschtick
- Harvard Medical School, Boston, MA, USA
- Massachusetts General Hospital, Boston, MA, USA
| | - P Ellen Grant
- Boston Children's Hospital, Boston, MA, USA
- Harvard Medical School, Boston, MA, USA
| | - Yangming Ou
- Boston Children's Hospital, Boston, MA, USA.
- Harvard Medical School, Boston, MA, USA.
| |
Collapse
|
2
|
Hussain MA, LaMay D, Grant E, Ou Y. Deep learning of structural MRI predicts fluid, crystallized, and general intelligence. Sci Rep 2024; 14:27935. [PMID: 39537706 PMCID: PMC11561325 DOI: 10.1038/s41598-024-78157-0] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/10/2024] [Accepted: 10/29/2024] [Indexed: 11/16/2024] Open
Abstract
Can brain structure predict human intelligence? T1-weighted structural brain magnetic resonance images (sMRI) have been correlated with intelligence. However, the population-level association does not fully account for individual variability in intelligence. To address this, studies have emerged recently to predict individual subject's intelligence or neurocognitive scores. However, they are mostly on predicting fluid intelligence (the ability to solve new problems). Studies are lacking to predict crystallized intelligence (the ability to accumulate knowledge) or general intelligence (fluid and crystallized intelligence combined). This study tests whether deep learning of sMRI can predict an individual subject's verbal, comprehensive, and full-scale intelligence quotients (VIQ, PIQ, and FSIQ), which reflect fluid and crystallized intelligence. We performed a comprehensive set of 432 experiments, using different input image channels, six deep learning models, and two outcome settings, in 850 healthy and autistic subjects 6-64 years of age. Our findings indicate a statistically significant potential of T1-weighted sMRI in predicting intelligence, with a Pearson correlation exceeding 0.21 (p < 0.001). Interestingly, we observed that an increase in the complexity of deep learning models does not necessarily translate to higher accuracy in intelligence prediction. The interpretations of our 2D and 3D CNNs, based on GradCAM, align well with the Parieto-Frontal Integration Theory (P-FIT), reinforcing the theory's suggestion that human intelligence is a result of interactions among various brain regions, including the occipital, temporal, parietal, and frontal lobes. These promising results invite further studies and open new questions in the field.
Collapse
Affiliation(s)
- Mohammad Arafat Hussain
- Department of Pediatrics, Boston Children's Hospital, Harvard Medical School, 401 Park Drive, Boston, MA, 02115, USA
| | - Danielle LaMay
- Department of Pediatrics, Boston Children's Hospital, Harvard Medical School, 401 Park Drive, Boston, MA, 02115, USA
- Khoury College of Computer and Information Science, Northeastern University, 360 Huntington Ave, Boston, MA, 02115, USA
| | - Ellen Grant
- Department of Pediatrics, Boston Children's Hospital, Harvard Medical School, 401 Park Drive, Boston, MA, 02115, USA
- Department of Radiology, Harvard Medical School, 401 Park Drive, Boston, MA, 02115, USA
| | - Yangming Ou
- Department of Pediatrics, Boston Children's Hospital, Harvard Medical School, 401 Park Drive, Boston, MA, 02115, USA.
- Department of Radiology, Harvard Medical School, 401 Park Drive, Boston, MA, 02115, USA.
- Computational Health Informatics Program, Boston Children's Hospital, Harvard Medical School, 401 Park Drive, Boston, MA, 02115, USA.
| |
Collapse
|
3
|
Wajid B, Jamil M, Awan FG, Anwar F, Anwar A. aXonica: A support package for MRI based Neuroimaging. BIOTECHNOLOGY NOTES (AMSTERDAM, NETHERLANDS) 2024; 5:120-136. [PMID: 39416698 PMCID: PMC11446389 DOI: 10.1016/j.biotno.2024.08.001] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 03/20/2024] [Revised: 08/04/2024] [Accepted: 08/08/2024] [Indexed: 10/19/2024]
Abstract
Magnetic Resonance Imaging (MRI) assists in studying the nervous system. MRI scans undergo significant processing before presenting the final images to medical practitioners. These processes are executed with ease due to excellent software pipelines. However, establishing software workstations is non-trivial and requires researchers in life sciences to be comfortable in downloading, installing, and scripting software that is non-user-friendly and may lack basic GUI. As researchers struggle with these skills, there is a dire need to develop software packages that can automatically install software pipelines speeding up building software workstations and laboratories. Previous solutions include NeuroDebian, BIDS Apps, Flywheel, QMENTA, Boutiques, Brainlife and Neurodesk. Overall, all these solutions complement each other. NeuroDebian covers neuroscience and has a wider scope, providing only 51 tools for MRI. Whereas, BIDS Apps is committed to the BIDS format, covering only 45 software related to MRI. Boutiques is more flexible, facilitating its pipelines to be easily installed as separate containers, validated, published, and executed. Whereas, both Flywheel and Qmenta are propriety, leaving four for users looking for 'free for use' tools, i.e., NeuroDebian, Brainlife, Neurodesk, and BIDS Apps. This paper presents an extensive survey of 317 tools published in MRI-based neuroimaging in the last ten years, along with 'aXonica,' an MRI-based neuroimaging support package that is unbiased towards any formatting standards and provides 130 applications, more than that of NeuroDebian (51), BIDS App (45), Flywheel (70), and Neurodesk (85). Using a technology stack that employs GUI as the front-end and shell scripted back-end, aXonica provides (i) 130 tools that span the entire MRI-based neuroimaging analysis, and allow the user to (ii) select the software of their choice, (iii) automatically resolve individual dependencies and (iv) installs them. Hence, aXonica can serve as an important resource for researchers and teachers working in the field of MRI-based Neuroimaging to (a) develop software workstations, and/or (b) install newer tools in their existing workstations.
Collapse
Affiliation(s)
- Bilal Wajid
- Dhanani School of Science and Engineering, Habib University, Karachi, Pakistan
- Muhammad Ibn Musa Al-Khwarizmi Research & Development Division, Sabz-Qalam, Lahore, Pakistan
| | - Momina Jamil
- Muhammad Ibn Musa Al-Khwarizmi Research & Development Division, Sabz-Qalam, Lahore, Pakistan
| | - Fahim Gohar Awan
- Department of Electrical Engineering, University of Engineering & Technology, Lahore, Pakistan
| | - Faria Anwar
- Out Patient Department, Mayo Hospital, Lahore, Pakistan
| | - Ali Anwar
- Department of Computer Science, University of Minnesota, Minneapolis, USA
| |
Collapse
|
4
|
Wilke M. A three-step, "brute-force" approach toward optimized affine spatial normalization. Front Comput Neurosci 2024; 18:1367148. [PMID: 39040884 PMCID: PMC11260722 DOI: 10.3389/fncom.2024.1367148] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/08/2024] [Accepted: 06/18/2024] [Indexed: 07/24/2024] Open
Abstract
The first step in spatial normalization of magnetic resonance (MR) images commonly is an affine transformation, which may be vulnerable to image imperfections (such as inhomogeneities or "unusual" heads). Additionally, common software solutions use internal starting estimates to allow for a more efficient computation, which may pose a problem in datasets not conforming to these assumptions (such as those from children). In this technical note, three main questions were addressed: one, does the affine spatial normalization step implemented in SPM12 benefit from an initial inhomogeneity correction. Two, does using a complexity-reduced image version improve robustness when matching "unusual" images. And three, can a blind "brute-force" application of a wide range of parameter combinations improve the affine fit for unusual datasets in particular. A large database of 2081 image datasets was used, covering the full age range from birth to old age. All analyses were performed in Matlab. Results demonstrate that an initial removal of image inhomogeneities improved the affine fit particularly when more inhomogeneity was present. Further, using a complexity-reduced input image also improved the affine fit and was beneficial in younger children in particular. Finally, blindly exploring a very wide parameter space resulted in a better fit for the vast majority of subjects, but again particularly so in infants and young children. In summary, the suggested modifications were shown to improve the affine transformation in the large majority of datasets in general, and in children in particular. The changes can easily be implemented into SPM12.
Collapse
Affiliation(s)
- Marko Wilke
- Department of Pediatric Neurology and Developmental Medicine, Children’s Hospital, University of Tübingen, Tübingen, Germany
- Experimental Pediatric Neuroimaging, Children’s Hospital and Department of Neuroradiology, University of Tübingen, Tübingen, Germany
| |
Collapse
|
5
|
Yanzhen M, Song C, Wanping L, Zufang Y, Wang A. Exploring approaches to tackle cross-domain challenges in brain medical image segmentation: a systematic review. Front Neurosci 2024; 18:1401329. [PMID: 38948927 PMCID: PMC11211279 DOI: 10.3389/fnins.2024.1401329] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/15/2024] [Accepted: 05/28/2024] [Indexed: 07/02/2024] Open
Abstract
Introduction Brain medical image segmentation is a critical task in medical image processing, playing a significant role in the prediction and diagnosis of diseases such as stroke, Alzheimer's disease, and brain tumors. However, substantial distribution discrepancies among datasets from different sources arise due to the large inter-site discrepancy among different scanners, imaging protocols, and populations. This leads to cross-domain problems in practical applications. In recent years, numerous studies have been conducted to address the cross-domain problem in brain image segmentation. Methods This review adheres to the standards of the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) for data processing and analysis. We retrieved relevant papers from PubMed, Web of Science, and IEEE databases from January 2018 to December 2023, extracting information about the medical domain, imaging modalities, methods for addressing cross-domain issues, experimental designs, and datasets from the selected papers. Moreover, we compared the performance of methods in stroke lesion segmentation, white matter segmentation and brain tumor segmentation. Results A total of 71 studies were included and analyzed in this review. The methods for tackling the cross-domain problem include Transfer Learning, Normalization, Unsupervised Learning, Transformer models, and Convolutional Neural Networks (CNNs). On the ATLAS dataset, domain-adaptive methods showed an overall improvement of ~3 percent in stroke lesion segmentation tasks compared to non-adaptive methods. However, given the diversity of datasets and experimental methodologies in current studies based on the methods for white matter segmentation tasks in MICCAI 2017 and those for brain tumor segmentation tasks in BraTS, it is challenging to intuitively compare the strengths and weaknesses of these methods. Conclusion Although various techniques have been applied to address the cross-domain problem in brain image segmentation, there is currently a lack of unified dataset collections and experimental standards. For instance, many studies are still based on n-fold cross-validation, while methods directly based on cross-validation across sites or datasets are relatively scarce. Furthermore, due to the diverse types of medical images in the field of brain segmentation, it is not straightforward to make simple and intuitive comparisons of performance. These challenges need to be addressed in future research.
Collapse
Affiliation(s)
- Ming Yanzhen
- School of Artificial Intelligence Academy, Wuhan Technology and Business University, Wuhan, Hubei, China
- Institute of Information and Intelligent Engineering Applications, Wuhan Technology and Business University, Wuhan, Hubei, China
| | - Chen Song
- Wuhan Dobest Information Technology Co., Ltd, Hubei, China
| | - Li Wanping
- School of Artificial Intelligence Academy, Wuhan Technology and Business University, Wuhan, Hubei, China
- Institute of Information and Intelligent Engineering Applications, Wuhan Technology and Business University, Wuhan, Hubei, China
| | - Yang Zufang
- School of Artificial Intelligence Academy, Wuhan Technology and Business University, Wuhan, Hubei, China
- Institute of Information and Intelligent Engineering Applications, Wuhan Technology and Business University, Wuhan, Hubei, China
| | - Alan Wang
- Auckland Bioengineering Institute, The University of Auckland, Auckland, New Zealand
- Medical Imaging Research Center, Faculty of Medical and Health Sciences, The University of Auckland, Auckland, New Zealand
- Centre for Co-Created Ageing Research, The University of Auckland, Auckland, New Zealand
- Centre for Brain Research, The University of Auckland, Auckland, New Zealand
| |
Collapse
|
6
|
Seoni S, Shahini A, Meiburger KM, Marzola F, Rotunno G, Acharya UR, Molinari F, Salvi M. All you need is data preparation: A systematic review of image harmonization techniques in Multi-center/device studies for medical support systems. COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE 2024; 250:108200. [PMID: 38677080 DOI: 10.1016/j.cmpb.2024.108200] [Citation(s) in RCA: 18] [Impact Index Per Article: 18.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/27/2024] [Revised: 04/20/2024] [Accepted: 04/22/2024] [Indexed: 04/29/2024]
Abstract
BACKGROUND AND OBJECTIVES Artificial intelligence (AI) models trained on multi-centric and multi-device studies can provide more robust insights and research findings compared to single-center studies. However, variability in acquisition protocols and equipment can introduce inconsistencies that hamper the effective pooling of multi-source datasets. This systematic review evaluates strategies for image harmonization, which standardizes appearances to enable reliable AI analysis of multi-source medical imaging. METHODS A literature search using PRISMA guidelines was conducted to identify relevant papers published between 2013 and 2023 analyzing multi-centric and multi-device medical imaging studies that utilized image harmonization approaches. RESULTS Common image harmonization techniques included grayscale normalization (improving classification accuracy by up to 24.42 %), resampling (increasing the percentage of robust radiomics features from 59.5 % to 89.25 %), and color normalization (enhancing AUC by up to 0.25 in external test sets). Initially, mathematical and statistical methods dominated, but machine and deep learning adoption has risen recently. Color imaging modalities like digital pathology and dermatology have remained prominent application areas, though harmonization efforts have expanded to diverse fields including radiology, nuclear medicine, and ultrasound imaging. In all the modalities covered by this review, image harmonization improved AI performance, with increasing of up to 24.42 % in classification accuracy and 47 % in segmentation Dice scores. CONCLUSIONS Continued progress in image harmonization represents a promising strategy for advancing healthcare by enabling large-scale, reliable analysis of integrated multi-source datasets using AI. Standardizing imaging data across clinical settings can help realize personalized, evidence-based care supported by data-driven technologies while mitigating biases associated with specific populations or acquisition protocols.
Collapse
Affiliation(s)
- Silvia Seoni
- Biolab, PolitoBIOMedLab, Department of Electronics and Telecommunications, Politecnico di Torino, Turin, Italy
| | - Alen Shahini
- Biolab, PolitoBIOMedLab, Department of Electronics and Telecommunications, Politecnico di Torino, Turin, Italy
| | - Kristen M Meiburger
- Biolab, PolitoBIOMedLab, Department of Electronics and Telecommunications, Politecnico di Torino, Turin, Italy
| | - Francesco Marzola
- Biolab, PolitoBIOMedLab, Department of Electronics and Telecommunications, Politecnico di Torino, Turin, Italy
| | - Giulia Rotunno
- Biolab, PolitoBIOMedLab, Department of Electronics and Telecommunications, Politecnico di Torino, Turin, Italy
| | - U Rajendra Acharya
- School of Mathematics, Physics and Computing, University of Southern Queensland, Springfield, Australia; Centre for Health Research, University of Southern Queensland, Australia
| | - Filippo Molinari
- Biolab, PolitoBIOMedLab, Department of Electronics and Telecommunications, Politecnico di Torino, Turin, Italy
| | - Massimo Salvi
- Biolab, PolitoBIOMedLab, Department of Electronics and Telecommunications, Politecnico di Torino, Turin, Italy.
| |
Collapse
|
7
|
Lyons-Ruth K, Li FH, Khoury JE, Ahtam B, Sisitsky M, Ou Y, Enlow MB, Grant E. Maternal Childhood Abuse Versus Neglect Associated with Differential Patterns of Infant Brain Development. Res Child Adolesc Psychopathol 2023; 51:1919-1932. [PMID: 37160577 PMCID: PMC10661793 DOI: 10.1007/s10802-023-01041-4] [Citation(s) in RCA: 9] [Impact Index Per Article: 4.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 02/09/2023] [Indexed: 05/11/2023]
Abstract
Severity of maternal childhood maltreatment has been associated with lower infant grey matter volume and amygdala volume during the first two years of life. A developing literature argues that effects of threat (abuse) and of deprivation (neglect) should be assessed separately because these distinct aspects of adversity may have different impacts on developmental outcomes. However, distinct effects of threat versus deprivation have not been assessed in relation to intergenerational effects of child maltreatment. The objective of this study was to separately assess the links of maternal childhood abuse and neglect with infant grey matter volume (GMV), white matter volume (WMV), amygdala and hippocampal volume. Participants included 57 mother-infant dyads. Mothers were assessed for childhood abuse and neglect using the Adverse Childhood Experiences (ACE) questionnaire in a sample enriched for childhood maltreatment. Between 4 and 24 months (M age = 12.28 months, SD = 5.99), under natural sleep, infants completed an MRI using a 3.0 T Siemens scanner. GMV, WMV, amygdala and hippocampal volumes were extracted via automated segmentation. Maternal history of neglect, but not abuse, was associated with lower infant GMV. Maternal history of abuse, but not neglect, interacted with age such that abuse was associated with smaller infant amygdala volume at older ages. Results are consistent with a threat versus deprivation framework, in which threat impacts limbic regions central to the stress response, whereas deprivation impacts areas more central to cognitive function. Further studies are needed to identify mechanisms contributing to these differential intergenerational associations of threat versus deprivation.
Collapse
Affiliation(s)
- Karlen Lyons-Ruth
- Department of Psychiatry, Harvard Medical School, Cambridge Hospital, 1493 Cambridge St., Cambridge, MA, USA.
| | - Frances Haofei Li
- Department of Psychiatry, Harvard Medical School, Cambridge Hospital, 1493 Cambridge St., Cambridge, MA, USA
| | - Jennifer E Khoury
- Department of Psychiatry, Harvard Medical School, Cambridge Hospital, 1493 Cambridge St., Cambridge, MA, USA
- Department of Psychology, Mount Saint Vincent University, Halifax, NS, Canada
| | - Banu Ahtam
- Department of Pediatrics, Harvard Medical School, Boston Children's Hospital, Boston, MA, USA
| | - Michaela Sisitsky
- Department of Pediatrics, Harvard Medical School, Boston Children's Hospital, Boston, MA, USA
| | - Yangming Ou
- Department of Pediatrics, Harvard Medical School, Boston Children's Hospital, Boston, MA, USA
| | - Michelle Bosquet Enlow
- Department of Psychiatry, Harvard Medical School, Boston Children's Hospital, Boston, MA, USA
| | - Ellen Grant
- Department of Pediatrics, Harvard Medical School, Boston Children's Hospital, Boston, MA, USA
| |
Collapse
|
8
|
Khoury JE, Ahtam B, Ou Y, Jenkins E, Klengel T, Enlow MB, Grant E, Lyons-Ruth K. Linking maternal disrupted interaction and infant limbic volumes: The role of infant cortisol output. Psychoneuroendocrinology 2023; 158:106379. [PMID: 37683305 DOI: 10.1016/j.psyneuen.2023.106379] [Citation(s) in RCA: 5] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 03/06/2023] [Revised: 08/22/2023] [Accepted: 08/29/2023] [Indexed: 09/10/2023]
Abstract
Despite a large animal literature documenting the role of low maternal nurturance and elevated glucocorticoid production on offspring limbic development, these pathways have not yet been assessed during human infancy. Informed by animal models, the present study examined whether 1) maternal disrupted interaction is related to infant cortisol levels, 2) infant cortisol levels are associated with infant limbic volumes, and 3) infant cortisol levels mediate associations between maternal disrupted interaction and infant limbic volumes. Participants included 57 mother-infant dyads. Infant saliva was measured at one time point before and two time points after the Still-Face Paradigm (SFP) at age 4 months. Five aspects of maternal disrupted interaction were coded during the SFP reunion episode. Between 4 and 25 months (M age = 11.74 months, SD = 6.12), under natural sleep, infants completed an MRI. Amygdala and hippocampal volumes were calculated via automated segmentation. Results indicated that 1) maternal disrupted interaction, and specifically disoriented interaction, with the infant was associated with higher infant salivary cortisol (AUCg) levels during the SFP, 2) higher infant AUCg was related to enlarged bilateral amygdala and hippocampal volumes, and 3) infant AUCg mediated the relation between maternal disrupted interaction and infant amygdala and hippocampal volumes. Findings are consistent with controlled animal studies and provide evidence of a link between increased cortisol levels and enlarged limbic volumes in human infants. Results further suggest that established interventions to decrease maternal disrupted interaction could impact both infant cortisol levels and infant limbic volumes.
Collapse
Affiliation(s)
| | - Banu Ahtam
- Fetal-Neonatal Neuroimaging & Developmental Science Center, Division of Newborn Medicine, Department of Pediatrics, Boston Children's Hospital, Harvard Medical School, United States
| | - Yangming Ou
- Fetal-Neonatal Neuroimaging & Developmental Science Center, Division of Newborn Medicine, Department of Pediatrics, Boston Children's Hospital, Harvard Medical School, United States; Department of Radiology, Boston Children's Hospital, Harvard Medical School, United States
| | | | - Torsten Klengel
- Department of Psychiatry, McLean Hospital, Harvard Medical School, United States
| | - Michelle Bosquet Enlow
- Department of Psychiatry and Behavioral Sciences, Boston Children's Hospital, Department of Psychiatry, Harvard Medical School, United States
| | - Ellen Grant
- Fetal-Neonatal Neuroimaging & Developmental Science Center, Division of Newborn Medicine, Department of Pediatrics, Boston Children's Hospital, Harvard Medical School, United States
| | - Karlen Lyons-Ruth
- Department of Psychiatry, Cambridge Hospital, Harvard Medical School, United States
| |
Collapse
|
9
|
Rydelius A, Bengzon J, Engelholm S, Kinhult S, Englund E, Nilsson M, Lätt J, Lampinen B, Sundgren PC. Predictive value of diffusion MRI-based parametric response mapping for prognosis and treatment response in glioblastoma. Magn Reson Imaging 2023; 104:88-96. [PMID: 37734574 DOI: 10.1016/j.mri.2023.09.005] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/29/2023] [Revised: 09/15/2023] [Accepted: 09/17/2023] [Indexed: 09/23/2023]
Abstract
BACKGROUND Early detection of treatment response is important for the management of patients with malignant brain tumors such as glioblastoma to assure good quality of life in relation to therapeutic efficacy. AIM To investigate whether parametric response mapping (PRM) with diffusion MRI may provide prognostic information at an early stage of standard therapy for glioblastoma. MATERIALS AND METHODS This prospective study included 31 patients newly diagnosed with glioblastoma WHO grade IV, planned for primary standard postoperative treatment with radiotherapy 60Gy/30 fractions with concomitant and adjuvant Temozolomide. MRI follow-up including diffusion and perfusion weighting was performed at 3 T at start of postoperative chemoradiotherapy, three weeks into treatment, and then regularly until twelve months postoperatively. Regional mean diffusivity (MD) changes were analyzed voxel-wise using the PRM method (MD-PRM). At eight and twelve months postoperatively, after completion of standard treatment, patients were classified using conventional MRI and clinical evaluation as either having stable disease (SD, including partial response) or progressive disease (PD). It was assessed whether MD-PRM differed between patients having SD versus PD and whether it predicted the risk of disease progression (progression-free survival, PFS) or death (overall survival, OS). A subgroup analysis was performed that compared MD-PRM between SD and PD in patients only undergoing diagnostic biopsy. MGMT-promotor methylation status (O6-methylguanine-DNA methyltransferase) was registered and analyzed with respect to PFS, OS and MD-PRM. RESULTS Of the 31 patients analyzed: 21 were operated by resection and ten by diagnostic biopsy. At eight months, 19 patients had SD and twelve had PD. At twelve months, ten patients had SD and 20 had PD, out of which ten were deceased within twelve months and one was deceased without known tumor progression. Median PFS was nine months, and median OS was 17 months. Eleven patients had methylated MGMT-promotor, 16 were MGMT unmethylated, and four had unknown MGMT-status. MD-PRM did not significantly predict patients having SD versus PD neither at eight nor at twelve months. Patients with an above median MD-PRM reduction had a slightly longer PFS (P = 0.015) in Kaplan-Maier analysis, as well as a non-significantly longer OS (P = 0.099). In the subgroup of patients only undergoing biopsy, total MD-PRM change at three weeks was generally higher for patients with SD than for patients with PD at eight months, although no tests were performed. MGMT status strongly predicted both PFS and OS but not MD-PRM change. CONCLUSION MD-PRM at three weeks was not demonstrated to be predictive of treatment response, disease progression, or survival. Preliminary results suggested a higher predictive value in non-resected patients, although this needs to be evaluated in future studies.
Collapse
Affiliation(s)
- A Rydelius
- Department of Clinical Sciences Lund, Division of Neurology, Lund University, Skane University Hospital, Lund, Sweden; Department of Clinical Sciences Lund, Division of Diagnostic Radiology, Lund University, Skane University Hospital, Lund, Sweden.
| | - J Bengzon
- Department of Clinical Sciences Lund, Division of Neurosurgery, Lund University, Skane University Hospital, Lund, Sweden
| | - S Engelholm
- Department of Clinical Sciences Lund, Division of Oncology, Lund University, Skane University Hospital, Lund, Sweden
| | - S Kinhult
- Department of Clinical Sciences Lund, Division of Oncology, Lund University, Skane University Hospital, Lund, Sweden
| | - E Englund
- Department of Clinical Sciences Lund, Division of Pathology, Lund University, Clinical Genetics, Pathology and Molecular Diagnostics, Medical Service, Lund, Skane University Hospital, Lund, Sweden
| | - M Nilsson
- Department of Clinical Sciences Lund, Division of Diagnostic Radiology, Lund University, Skane University Hospital, Lund, Sweden
| | - J Lätt
- Department for Medical Imaging and Physiology, Skåne University Hospital, Lund, Sweden
| | - B Lampinen
- Department of Clinical Sciences Lund, Division of Diagnostic Radiology, Lund University, Skane University Hospital, Lund, Sweden
| | - P C Sundgren
- Department of Clinical Sciences Lund, Division of Diagnostic Radiology, Lund University, Skane University Hospital, Lund, Sweden; Department for Medical Imaging and Physiology, Skåne University Hospital, Lund, Sweden; Lund University, BioImaging Centre (LBIC), Lund University, Lund, Sweden; Department of Radiology, University of Michigan, Ann Arbor, MI, USA
| |
Collapse
|
10
|
He S, Guan Y, Cheng CH, Moore TL, Luebke JI, Killiany RJ, Rosene DL, Koo BB, Ou Y. Human-to-monkey transfer learning identifies the frontal white matter as a key determinant for predicting monkey brain age. Front Aging Neurosci 2023; 15:1249415. [PMID: 38020785 PMCID: PMC10646581 DOI: 10.3389/fnagi.2023.1249415] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/28/2023] [Accepted: 10/10/2023] [Indexed: 12/01/2023] Open
Abstract
The application of artificial intelligence (AI) to summarize a whole-brain magnetic resonance image (MRI) into an effective "brain age" metric can provide a holistic, individualized, and objective view of how the brain interacts with various factors (e.g., genetics and lifestyle) during aging. Brain age predictions using deep learning (DL) have been widely used to quantify the developmental status of human brains, but their wider application to serve biomedical purposes is under criticism for requiring large samples and complicated interpretability. Animal models, i.e., rhesus monkeys, have offered a unique lens to understand the human brain - being a species in which aging patterns are similar, for which environmental and lifestyle factors are more readily controlled. However, applying DL methods in animal models suffers from data insufficiency as the availability of animal brain MRIs is limited compared to many thousands of human MRIs. We showed that transfer learning can mitigate the sample size problem, where transferring the pre-trained AI models from 8,859 human brain MRIs improved monkey brain age estimation accuracy and stability. The highest accuracy and stability occurred when transferring the 3D ResNet [mean absolute error (MAE) = 1.83 years] and the 2D global-local transformer (MAE = 1.92 years) models. Our models identified the frontal white matter as the most important feature for monkey brain age predictions, which is consistent with previous histological findings. This first DL-based, anatomically interpretable, and adaptive brain age estimator could broaden the application of AI techniques to various animal or disease samples and widen opportunities for research in non-human primate brains across the lifespan.
Collapse
Affiliation(s)
- Sheng He
- Harvard Medical School, Boston Children's Hospital, Boston, MA, United States
| | - Yi Guan
- Department of Anatomy & Neurobiology, Boston University Chobanian and Avedisian School of Medicine, Boston, MA, United States
| | - Chia Hsin Cheng
- Department of Anatomy & Neurobiology, Boston University Chobanian and Avedisian School of Medicine, Boston, MA, United States
| | - Tara L. Moore
- Department of Anatomy & Neurobiology, Boston University Chobanian and Avedisian School of Medicine, Boston, MA, United States
| | - Jennifer I. Luebke
- Department of Anatomy & Neurobiology, Boston University Chobanian and Avedisian School of Medicine, Boston, MA, United States
| | - Ronald J. Killiany
- Department of Anatomy & Neurobiology, Boston University Chobanian and Avedisian School of Medicine, Boston, MA, United States
| | - Douglas L. Rosene
- Department of Anatomy & Neurobiology, Boston University Chobanian and Avedisian School of Medicine, Boston, MA, United States
| | - Bang-Bon Koo
- Department of Anatomy & Neurobiology, Boston University Chobanian and Avedisian School of Medicine, Boston, MA, United States
| | - Yangming Ou
- Department of Anatomy & Neurobiology, Boston University Chobanian and Avedisian School of Medicine, Boston, MA, United States
| |
Collapse
|
11
|
Lyons‐Ruth K, Ahtam B, Li FH, Dickerman S, Khoury JE, Sisitsky M, Ou Y, Bosquet Enlow M, Teicher MH, Grant PE. Negative versus withdrawn maternal behavior: Differential associations with infant gray and white matter during the first 2 years of life. Hum Brain Mapp 2023; 44:4572-4589. [PMID: 37417795 PMCID: PMC10365238 DOI: 10.1002/hbm.26401] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/20/2022] [Revised: 05/30/2023] [Accepted: 06/09/2023] [Indexed: 07/08/2023] Open
Abstract
Distinct neural effects of threat versus deprivation emerge by childhood, but little data are available in infancy. Withdrawn versus negative parenting may represent dimensionalized indices of early deprivation versus early threat, but no studies have assessed neural correlates of withdrawn versus negative parenting in infancy. The objective of this study was to separately assess the links of maternal withdrawal and maternal negative/inappropriate interaction with infant gray matter volume (GMV), white matter volume (WMV), amygdala, and hippocampal volume. Participants included 57 mother-infant dyads. Withdrawn and negative/inappropriate aspects of maternal behavior were coded from the Still-Face Paradigm at four months infant age. Between 4 and 24 months (M age = 12.28 months, SD = 5.99), during natural sleep, infants completed an MRI using a 3.0 T Siemens scanner. GMV, WMV, amygdala, and hippocampal volumes were extracted via automated segmentation. Diffusion weighted imaging volumetric data were also generated for major white matter tracts. Maternal withdrawal was associated with lower infant GMV. Negative/inappropriate interaction was associated with lower overall WMV. Age did not moderate these effects. Maternal withdrawal was further associated with reduced right hippocampal volume at older ages. Exploratory analyses of white matter tracts found that negative/inappropriate maternal behavior was specifically associated with reduced volume in the ventral language network. Results suggest that quality of day-to-day parenting is related to infant brain volumes during the first two years of life, with distinct aspects of interaction associated with distinct neural effects.
Collapse
Affiliation(s)
- Karlen Lyons‐Ruth
- Department of PsychiatryCambridge Hospital, Harvard Medical SchoolCambridgeMassachusettsUSA
| | - Banu Ahtam
- Fetal‐Neonatal Neuroimaging & Developmental Science Center, Division of Newborn Medicine, Department of Pediatrics, Boston Children's HospitalHarvard Medical SchoolBostonMassachusettsUSA
| | - Frances Haofei Li
- Department of PsychiatryCambridge Hospital, Harvard Medical SchoolCambridgeMassachusettsUSA
| | - Sarah Dickerman
- Department of Psychiatry, Boston Children's HospitalHarvard Medical SchoolBostonMassachusettsUSA
| | - Jennifer E. Khoury
- Department of PsychiatryCambridge Hospital, Harvard Medical SchoolCambridgeMassachusettsUSA
- Present address:
Department of PsychologyMount Saint Vincent UniversityHalifaxNova ScotiaCanada
| | - Michaela Sisitsky
- Fetal‐Neonatal Neuroimaging & Developmental Science Center, Division of Newborn Medicine, Department of Pediatrics, Boston Children's HospitalHarvard Medical SchoolBostonMassachusettsUSA
| | - Yangming Ou
- Fetal‐Neonatal Neuroimaging & Developmental Science Center, Division of Newborn Medicine, Department of Pediatrics, Boston Children's HospitalHarvard Medical SchoolBostonMassachusettsUSA
- Department of Radiology, Boston Children's HospitalHarvard Medical SchoolBostonMassachusettsUSA
| | - Michelle Bosquet Enlow
- Department of PsychiatryCambridge Hospital, Harvard Medical SchoolCambridgeMassachusettsUSA
- Department of Psychiatry, Boston Children's HospitalHarvard Medical SchoolBostonMassachusettsUSA
| | - Martin H. Teicher
- Department of PsychiatryMcLean Hospital, Harvard Medical SchoolBelmontMassachusettsUSA
| | - P. Ellen Grant
- Fetal‐Neonatal Neuroimaging & Developmental Science Center, Division of Newborn Medicine, Department of Pediatrics, Boston Children's HospitalHarvard Medical SchoolBostonMassachusettsUSA
| |
Collapse
|
12
|
Bao R, Song Y, Bates SV, Weiss RJ, Foster AN, Cobos CJ, Sotardi S, Zhang Y, Gollub RL, Grant PE, Ou Y. BOston Neonatal Brain Injury Dataset for Hypoxic Ischemic Encephalopathy (BONBID-HIE): Part I. MRI and Manual Lesion Annotation. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2023:2023.06.30.546841. [PMID: 37461570 PMCID: PMC10350009 DOI: 10.1101/2023.06.30.546841] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Indexed: 07/25/2023]
Abstract
Hypoxic ischemic encephalopathy (HIE) is a brain injury that occurs in 1 ~ 5/1000 term neonates. Accurate identification and segmentation of HIE-related lesions in neonatal brain magnetic resonance images (MRIs) is the first step toward predicting prognosis, identifying high-risk patients, and evaluating treatment effects. It will lead to a more accurate estimation of prognosis, a better understanding of neurological symptoms, and a timely prediction of response to therapy. We release the first public dataset containing neonatal brain diffusion MRI and expert annotation of lesions from 133 patients diagnosed with HIE. HIE-related lesions in brain MRI are often diffuse (i.e., multi-focal), and small (over half the patients in our data having lesions occupying <1% of brain volume). Segmentation for HIE MRI data is remarkably different from, and arguably more challenging than, other segmentation tasks such as brain tumors with focal and relatively large lesions. We hope that this dataset can help fuel the development of MRI lesion segmentation methods for HIE and small diffuse lesions in general.
Collapse
Affiliation(s)
- Rina Bao
- Boston Children’s Hospital, Boston, MA, USA
- Harvard Medical School, Boston, MA, USA
| | | | | | | | - Anna N. Foster
- Boston Children’s Hospital, Boston, MA, USA
- Massachusetts General Hospital, Boston, MA, USA
| | | | | | - Yue Zhang
- Boston Children’s Hospital, Boston, MA, USA
| | - Randy L. Gollub
- Athinoula A. Martinos Center for Biomedical Imaging, Massachusetts General Hospital, Charlestown, MA, USA
- Department of Psychiatry, Massachusetts General Hospital, Boston, MA, USA
| | - P. Ellen Grant
- Boston Children’s Hospital, Boston, MA, USA
- Harvard Medical School, Boston, MA, USA
| | - Yangming Ou
- Boston Children’s Hospital, Boston, MA, USA
- Harvard Medical School, Boston, MA, USA
| |
Collapse
|
13
|
Maternal Childhood Maltreatment Is Associated With Lower Infant Gray Matter Volume and Amygdala Volume During the First Two Years of Life. BIOLOGICAL PSYCHIATRY GLOBAL OPEN SCIENCE 2022; 2:440-449. [PMID: 36324649 PMCID: PMC9616256 DOI: 10.1016/j.bpsgos.2021.09.005] [Citation(s) in RCA: 11] [Impact Index Per Article: 3.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/07/2021] [Revised: 08/24/2021] [Accepted: 09/17/2021] [Indexed: 01/11/2023] Open
Abstract
Background Childhood maltreatment affects approximately 25% of the world's population. Importantly, the children of mothers who have been maltreated are at increased risk of behavioral problems. Thus, one important priority is to identify child neurobiological processes associated with maternal childhood maltreatment (MCM) that might contribute to such intergenerational transmission. This study assessed the impact of MCM on infant gray and white matter volumes and infant amygdala and hippocampal volumes during the first 2 years of life. Methods Fifty-seven mothers with 4-month-old infants were assessed for MCM, using both the brief Adverse Childhood Experiences screening questionnaire and the more detailed Maltreatment and Abuse Chronology of Exposure scale. A total of 58% had experienced childhood maltreatment. Between 4 and 24 months (age in months: mean = 12.28, SD = 5.99), under natural sleep, infants completed a magnetic resonance imaging scan using a 3T Siemens scanner. Total brain volume, gray matter volume, white matter volume, and amygdala and hippocampal volumes were extracted via automated segmentation. Results MCM on the Adverse Childhood Experiences and Maltreatment and Abuse Chronology of Exposure scales were associated with lower infant total brain volume and gray matter volume, with no moderation by infant age. However, infant age moderated the association between MCM and right amygdala volume, such that MCM was associated with lower volume at older ages. Conclusions MCM is associated with alterations in infant brain volumes, calling for further identification of the prenatal and postnatal mechanisms contributing to such intergenerational transmission. Furthermore, the brief Adverse Childhood Experiences questionnaire predicted these alterations, suggesting the potential utility of early screening for infant risk.
Collapse
|
14
|
He S, Feng Y, Grant PE, Ou Y. Deep Relation Learning for Regression and Its Application to Brain Age Estimation. IEEE TRANSACTIONS ON MEDICAL IMAGING 2022; 41:2304-2317. [PMID: 35320092 PMCID: PMC9782832 DOI: 10.1109/tmi.2022.3161739] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/14/2023]
Abstract
Most deep learning models for temporal regression directly output the estimation based on single input images, ignoring the relationships between different images. In this paper, we propose deep relation learning for regression, aiming to learn different relations between a pair of input images. Four non-linear relations are considered: "cumulative relation," "relative relation," "maximal relation" and "minimal relation." These four relations are learned simultaneously from one deep neural network which has two parts: feature extraction and relation regression. We use an efficient convolutional neural network to extract deep features from the pair of input images and apply a Transformer for relation learning. The proposed method is evaluated on a merged dataset with 6,049 subjects with ages of 0-97 years using 5-fold cross-validation for the task of brain age estimation. The experimental results have shown that the proposed method achieved a mean absolute error (MAE) of 2.38 years, which is lower than the MAEs of 8 other state-of-the-art algorithms with statistical significance (p<0.05) in paired T-test (two-side).
Collapse
|
15
|
Hobday H, Cole JH, Stanyard RA, Daws RE, Giampietro V, O'Daly O, Leech R, Váša F. Tissue volume estimation and age prediction using rapid structural brain scans. Sci Rep 2022; 12:12005. [PMID: 35835813 PMCID: PMC9283414 DOI: 10.1038/s41598-022-14904-5] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/01/2022] [Accepted: 06/14/2022] [Indexed: 11/30/2022] Open
Abstract
The multicontrast EPImix sequence generates six contrasts, including a T1-weighted scan, in ~1 min. EPImix shows comparable diagnostic performance to conventional scans under qualitative clinical evaluation, and similarities in simple quantitative measures including contrast intensity. However, EPImix scans have not yet been compared to standard MRI scans using established quantitative measures. In this study, we compared conventional and EPImix-derived T1-weighted scans of 64 healthy participants using tissue volume estimates and predicted brain-age. All scans were pre-processed using the SPM12 DARTEL pipeline, generating measures of grey matter, white matter and cerebrospinal fluid volume. Brain-age was predicted using brainageR, a Gaussian Processes Regression model previously trained on a large sample of standard T1-weighted scans. Estimates of both global and voxel-wise tissue volume showed significantly similar results between standard and EPImix-derived T1-weighted scans. Brain-age estimates from both sequences were significantly correlated, although EPImix T1-weighted scans showed a systematic offset in predictions of chronological age. Supplementary analyses suggest that this is likely caused by the reduced field of view of EPImix scans, and the use of a brain-age model trained using conventional T1-weighted scans. However, this systematic error can be corrected using additional regression of T1-predicted brain-age onto EPImix-predicted brain-age. Finally, retest EPImix scans acquired for 10 participants demonstrated high test-retest reliability in all evaluated quantitative measurements. Quantitative analysis of EPImix scans has potential to reduce scanning time, increasing participant comfort and reducing cost, as well as to support automation of scanning, utilising active learning for faster and individually-tailored (neuro)imaging.
Collapse
Affiliation(s)
- Harriet Hobday
- Department of Neuroimaging, Institute of Psychiatry, Psychology and Neuroscience, King's College London, London, UK
| | - James H Cole
- Department of Computer Science, Centre for Medical Image Computing, University College London, London, UK
- Dementia Research Centre, Institute of Neurology, University College London, London, UK
| | - Ryan A Stanyard
- Department of Forensic and Developmental Sciences, Institute of Psychiatry, Psychology and Neuroscience, King's College London, London, UK
- Centre for the Developing Brain, School of Biomedical Engineering and Imaging Sciences, King's College London, London, UK
| | - Richard E Daws
- Department of Neuroimaging, Institute of Psychiatry, Psychology and Neuroscience, King's College London, London, UK
| | - Vincent Giampietro
- Department of Neuroimaging, Institute of Psychiatry, Psychology and Neuroscience, King's College London, London, UK
| | - Owen O'Daly
- Department of Neuroimaging, Institute of Psychiatry, Psychology and Neuroscience, King's College London, London, UK
| | - Robert Leech
- Department of Neuroimaging, Institute of Psychiatry, Psychology and Neuroscience, King's College London, London, UK
| | - František Váša
- Department of Neuroimaging, Institute of Psychiatry, Psychology and Neuroscience, King's College London, London, UK.
| |
Collapse
|
16
|
Zamani J, Sadr A, Javadi AH. Comparison of cortical and subcortical structural segmentation methods in Alzheimer's disease: A statistical approach. J Clin Neurosci 2022; 99:99-108. [PMID: 35278936 DOI: 10.1016/j.jocn.2022.03.004] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/01/2021] [Revised: 02/13/2022] [Accepted: 03/02/2022] [Indexed: 11/18/2022]
Abstract
BACKGROUND Automated segmentation methods are developed to help with the segmentation of different brain areas. However, their reliability has yet to be fully investigated. To have a more comprehensive understanding of the distribution of changes in Alzheimer's disease (AD), as well as investigating the reliability of different segmentation methods, in this study we compared volumes of cortical and subcortical brain segments, using HIPS, volBrain, CAT and BrainSuite automated segmentation methods between AD, mild cognitive impairment (MCI) and healthy controls (HC). METHODS A total of 182 MRI images were taken from the minimal interval resonance imaging in Alzheimer's disease (MIRIAD; 22 AD and 22 HC) and the Alzheimer's disease neuroimaging initiative database (ADNI; 43 AD, 50 MCI and 45 HC) datasets. Statistical methods were used to compare different groups as well as the correlation between different methods. RESULTS The two methods of volBrain and CAT showed a strong correlation (p's < 0.035 Bonferroni corrected for multiple comparisons). The two methods, however, showed no significant correlation with BrainSuite (p's > 0.820 Bonferroni corrected). Furthermore, BrainSuite did not follow the same trend as the other three methods and only HIPS, volBrain and CAT showed strong conformity with the past literature with strong correlation with mini mental state examination (MMSE) scores. CONCLUSION Our results showed that automated segmentation methods HIPS, volBrain and CAT can be used in the classification of HC, AD and MCI. This is an indication that such methods can be used to inform researchers and clinicians of underlying mechanisms and progression of AD.
Collapse
Affiliation(s)
- Jafar Zamani
- School of Electrical Engineering, Iran University of Science and Technology, Tehran, Iran
| | - Ali Sadr
- School of Electrical Engineering, Iran University of Science and Technology, Tehran, Iran.
| | - Amir-Homayoun Javadi
- School of Psychology, University of Kent, Canterbury, UK; School of Rehabilitation, Tehran University of Medical Sciences, Tehran, Iran.
| |
Collapse
|
17
|
Vedmurthy P, Pinto ALR, Lin DDM, Comi AM, Ou Y. Study protocol: retrospectively mining multisite clinical data to presymptomatically predict seizure onset for individual patients with Sturge-Weber. BMJ Open 2022; 12:e053103. [PMID: 35121603 PMCID: PMC8819809 DOI: 10.1136/bmjopen-2021-053103] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 05/05/2021] [Accepted: 01/13/2022] [Indexed: 11/11/2022] Open
Abstract
INTRODUCTION Secondary analysis of hospital-hosted clinical data can save time and cost compared with prospective clinical trials for neuroimaging biomarker development. We present such a study for Sturge-Weber syndrome (SWS), a rare neurovascular disorder that affects 1 in 20 000-50 000 newborns. Children with SWS are at risk for developing neurocognitive deficit by school age. A critical period for early intervention is before 2 years of age, but early diagnostic and prognostic biomarkers are lacking. We aim to retrospectively mine clinical data for SWS at two national centres to develop presymptomatic biomarkers. METHODS AND ANALYSIS We will retrospectively collect clinical, MRI and neurocognitive outcome data for patients with SWS who underwent brain MRI before 2 years of age at two national SWS care centres. Expert review of clinical records and MRI quality control will be used to refine the cohort. The merged multisite data will be used to develop algorithms for abnormality detection, lesion-symptom mapping to identify neural substrate and machine learning to predict individual outcomes (presence or absence of seizures) by 2 years of age. Presymptomatic treatment in 0-2 years and before seizure onset may delay or prevent the onset of seizures by 2 years of age, and thereby improve neurocognitive outcomes. The proposed work, if successful, will be one of the largest and most comprehensive multisite databases for the presymptomatic phase of this rare disease. ETHICS AND DISSEMINATION This study involves human participants and was approved by Boston Children's Hospital Institutional Review Board: IRB-P00014482 and IRB-P00025916 Johns Hopkins School of Medicine Institutional Review Board: NA_00043846. Participants gave informed consent to participate in the study before taking part. The Institutional Review Boards at Kennedy Krieger Institute and Boston Children's Hospital approval have been obtained at each site to retrospectively study this data. Results will be disseminated by presentations, publication and sharing of algorithms generated.
Collapse
Affiliation(s)
- Pooja Vedmurthy
- Department of Neurology and Developmental Medicine, Hugo Moser Research Institute, Baltimore, Maryland, USA
- Department of Neurology and Pediatrics, Kennedy Krieger Institute, Baltimore, MD, USA
| | - Anna L R Pinto
- Department of Neurology, Division of Epilepsy, Harvard Medical School, Boston, Massachusetts, USA
| | - Doris D M Lin
- Neuroradiology, Johns Hopkins School of Medicine, Baltimore, Maryland, USA
| | - Anne M Comi
- Department of Neurology and Developmental Medicine, Hugo Moser Research Institute, Baltimore, Maryland, USA
- Department of Neurology and Pediatrics, Kennedy Krieger Institute, Baltimore, MD, USA
- Department of Neurology and Pediatrics, Johns Hopkins School of Medicine, Baltimore, Maryland, USA
| | - Yangming Ou
- Fetal-Neonatal Neuroimaging and Developmental Science Center, Boston Children's Hospital, Boston, Massachusetts, USA
- Computational Health Informatics Program, Boston Children's Hospital, Boston, Massachusetts, USA
- Department of Radiology, Boston Children's Hospital; Harvard Medical School, Boston, MA, USA
| |
Collapse
|
18
|
Zamani J, Sadr A, Javadi AH. Diagnosis of early mild cognitive impairment using a multiobjective optimization algorithm based on T1-MRI data. Sci Rep 2022; 12:1020. [PMID: 35046444 PMCID: PMC8770462 DOI: 10.1038/s41598-022-04943-3] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/12/2021] [Accepted: 01/04/2022] [Indexed: 12/03/2022] Open
Abstract
Alzheimer's disease (AD) is the most prevalent form of dementia. The accurate diagnosis of AD, especially in the early phases is very important for timely intervention. It has been suggested that brain atrophy, as measured with structural magnetic resonance imaging (sMRI), can be an efficacy marker of neurodegeneration. While classification methods have been successful in diagnosis of AD, the performance of such methods have been very poor in diagnosis of those in early stages of mild cognitive impairment (EMCI). Therefore, in this study we investigated whether optimisation based on evolutionary algorithms (EA) can be an effective tool in diagnosis of EMCI as compared to cognitively normal participants (CNs). Structural MRI data for patients with EMCI (n = 54) and CN participants (n = 56) was extracted from Alzheimer's disease Neuroimaging Initiative (ADNI). Using three automatic brain segmentation methods, we extracted volumetric parameters as input to the optimisation algorithms. Our method achieved classification accuracy of greater than 93%. This accuracy level is higher than the previously suggested methods of classification of CN and EMCI using a single- or multiple modalities of imaging data. Our results show that with an effective optimisation method, a single modality of biomarkers can be enough to achieve a high classification accuracy.
Collapse
Affiliation(s)
- Jafar Zamani
- School of Electrical Engineering, Iran University of Science and Technology, Narmak, Tehran, Iran
| | - Ali Sadr
- School of Electrical Engineering, Iran University of Science and Technology, Narmak, Tehran, Iran.
| | - Amir-Homayoun Javadi
- School of Psychology, Keynes College, University of Kent, Canterbury, UK.
- School of Rehabilitation, Tehran University of Medical Sciences, Tehran, Iran.
| |
Collapse
|
19
|
He S, Grant PE, Ou Y. Global-Local Transformer for Brain Age Estimation. IEEE TRANSACTIONS ON MEDICAL IMAGING 2022; 41:213-224. [PMID: 34460370 PMCID: PMC9746186 DOI: 10.1109/tmi.2021.3108910] [Citation(s) in RCA: 62] [Impact Index Per Article: 20.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/13/2023]
Abstract
Deep learning can provide rapid brain age estimation based on brain magnetic resonance imaging (MRI). However, most studies use one neural network to extract the global information from the whole input image, ignoring the local fine-grained details. In this paper, we propose a global-local transformer, which consists of a global-pathway to extract the global-context information from the whole input image and a local-pathway to extract the local fine-grained details from local patches. The fine-grained information from the local patches are fused with the global-context information by the attention mechanism, inspired by the transformer, to estimate the brain age. We evaluate the proposed method on 8 public datasets with 8,379 healthy brain MRIs with the age range of 0-97 years. 6 datasets are used for cross-validation and 2 datasets are used for evaluating the generality. Comparing with other state-of-the-art methods, the proposed global-local transformer reduces the mean absolute error of the estimated ages to 2.70 years and increases the correlation coefficient of the estimated age and the chronological age to 0.9853. In addition, our proposed method provides regional information of which local patches are most informative for brain age estimation. Our source code is available on: https://github.com/shengfly/global-local-transformer.
Collapse
|
20
|
He S, Pereira D, David Perez J, Gollub RL, Murphy SN, Prabhu S, Pienaar R, Robertson RL, Ellen Grant P, Ou Y. Multi-channel attention-fusion neural network for brain age estimation: Accuracy, generality, and interpretation with 16,705 healthy MRIs across lifespan. Med Image Anal 2021; 72:102091. [PMID: 34038818 PMCID: PMC8316301 DOI: 10.1016/j.media.2021.102091] [Citation(s) in RCA: 32] [Impact Index Per Article: 8.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/19/2020] [Revised: 03/10/2021] [Accepted: 04/14/2021] [Indexed: 12/31/2022]
Abstract
Brain age estimated by machine learning from T1-weighted magnetic resonance images (T1w MRIs) can reveal how brain disorders alter brain aging and can help in the early detection of such disorders. A fundamental step is to build an accurate age estimator from healthy brain MRIs. We focus on this step, and propose a framework to improve the accuracy, generality, and interpretation of age estimation in healthy brain MRIs. For accuracy, we used one of the largest sample sizes (N = 16,705). For each subject, our proposed algorithm first explicitly splits the T1w image, which has been commonly treated as a single-channel 3D image in other studies, into two 3D image channels representing contrast and morphometry information. We further proposed a "fusion-with-attention" deep learning convolutional neural network (FiA-Net) to learn how to best fuse the contrast and morphometry image channels. FiA-Net recognizes varying contributions across image channels at different brain anatomy and different feature layers. In contrast, multi-channel fusion does not exist for brain age estimation, and is mostly attention-free in other medical image analysis tasks (e.g., image synthesis, or segmentation), where treating channels equally may not be optimal. For generality, we used lifespan data 0-97 years of age for real-world utility; and we thoroughly tested FiA-Net for multi-site and multi-scanner generality by two phases of cross-validations in discovery and replication data, compared to most other studies with only one phase of cross-validation. For interpretation, we directly measured each artificial neuron's correlation with the chronological age, compared to other studies looking at the saliency of features where salient features may or may not predict age. Overall, FiA-Net achieved a mean absolute error (MAE) of 3.00 years and Pearson correlation r=0.9840 with known chronological ages in healthy brain MRIs 0-97 years of age, comparing favorably with state-of-the-art algorithms and studies for accuracy and generality across sites and datasets. We also provided interpretations on how different artificial neurons and real neuroanatomy contribute to the age estimation.
Collapse
Affiliation(s)
- Sheng He
- Boston Children's Hospital and Harvard Medical School, 300 Longwood Ave., Boston, MA, USA
| | - Diana Pereira
- Boston Children's Hospital and Harvard Medical School, 300 Longwood Ave., Boston, MA, USA
| | - Juan David Perez
- Boston Children's Hospital and Harvard Medical School, 300 Longwood Ave., Boston, MA, USA
| | - Randy L Gollub
- Massachusetts General Hospital and Harvard Medical School, 55 Fruit St., Boston, MA, USA
| | - Shawn N Murphy
- Massachusetts General Hospital and Harvard Medical School, 55 Fruit St., Boston, MA, USA
| | - Sanjay Prabhu
- Boston Children's Hospital and Harvard Medical School, 300 Longwood Ave., Boston, MA, USA
| | - Rudolph Pienaar
- Boston Children's Hospital and Harvard Medical School, 300 Longwood Ave., Boston, MA, USA
| | - Richard L Robertson
- Boston Children's Hospital and Harvard Medical School, 300 Longwood Ave., Boston, MA, USA
| | - P Ellen Grant
- Boston Children's Hospital and Harvard Medical School, 300 Longwood Ave., Boston, MA, USA
| | - Yangming Ou
- Boston Children's Hospital and Harvard Medical School, 300 Longwood Ave., Boston, MA, USA.
| |
Collapse
|
21
|
Sotardi S, Gollub RL, Bates SV, Weiss R, Murphy SN, Grant PE, Ou Y. Voxelwise and Regional Brain Apparent Diffusion Coefficient Changes on MRI from Birth to 6 Years of Age. Radiology 2020; 298:415-424. [PMID: 33289612 DOI: 10.1148/radiol.2020202279] [Citation(s) in RCA: 21] [Impact Index Per Article: 4.2] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/11/2022]
Abstract
Background A framework for understanding rapid diffusion changes from 0 to 6 years of age is important in the detection of neurodevelopmental disorders. Purpose To quantify patterns of normal apparent diffusion coefficient (ADC) development from 0 to 6 years of age. Materials and Methods Previously constructed age-specific ADC atlases from 201 healthy full-term children (108 male; age range, 0-6 years) with MRI scans acquired from 2006 to 2013 at one large academic hospital were analyzed to quantify four patterns: ADC trajectory, rate of ADC change, age of ADC maturation, and hemispheric asymmetries of maturation ages. Patterns were quantified in whole-brain, segmented regional, and voxelwise levels by fitting a two-term exponential model. Hemispheric asymmetries in ADC maturation ages were assessed using t tests with Bonferroni correction. Results The posterior limb of the internal capsule (mean ADC: left hemisphere, 1.18 ×103μm2/sec; right hemisphere, 1.17 ×103μm2/sec), anterior limb of the internal capsule (left, 1.11 ×103μm2/sec; right, 1.09 ×103μm2/sec), vermis (1.26 ×103μm2/sec), thalami (left, 1.17 ×103μm2/sec; right, 1.15 ×103μm2/sec), and basal ganglia (left, 1.26 ×103μm2/sec; right, 1.23 ×103μm2/sec) demonstrate low initial ADC values, indicating an earlier prenatal time course of development. ADC maturation was completed between 1.3 and 2.4 years of age, depending on the region. The vermis and left thalamus matured earliest (1.3 years). The frontolateral gray matter matured latest (right, 2.3 years; left, 2.4 years). ADC maturation occurred earlier in the left hemisphere (P < .001) in several regions, including the frontal (mean ± standard deviation) (left, 2.16 years ± 0.29; right, 2.19 years ± 0.31), temporal (left, 1.93 years ± 0.22; right, 1.99 years ± 0.22), and parietal (left, 1.92 years ± 0.30; right, 2.03 years ± 0.28) white matter. Maturation occurred earlier in the right hemisphere (P < .001) in several regions, including the thalami (left, 1.63 years ± 0.32; right, 1.45 years ± 0.33), basal ganglia (left, 1.79 years ± 0.31; right, 1.70 years ± 0.37), and hippocampi (left, 1.93 years ± 0.34; right, 1.78 years ± 0.33). Conclusion Normative apparent diffusion coefficient developmental patterns on diffusion-weighted MRI scans were quantified in children aged 0 to 6 years. This work provides knowledge about early brain development and may guide the detection of abnormal patterns of maturation. © RSNA, 2020 Online supplemental material is available for this article. See also the editorial by Rollins in this issue.
Collapse
Affiliation(s)
- Susan Sotardi
- From the Departments of Radiology (S.S.) and Psychiatry (R.L.G.), Athinoula A. Martinos Center for Biomedical Imaging (R.L.G.), Division of Newborn Medicine, Department of Pediatrics (S.V.B., R.W.), and Laboratory of Computer Science (S.N.M.), Massachusetts General Hospital, Harvard Medical School, Boston, Mass; Department of Radiology, Children's Hospital of Philadelphia, Philadelphia, Pa (S.S.); and Fetal-Neonatal Neuroimaging and Developmental Science Center (P.E.G., Y.O.), Computational Health Informatics Program (Y.O.), Boston Children's Hospital, Harvard Medical School, 300 Longwood Ave, Boston, MA 02115
| | - Randy L Gollub
- From the Departments of Radiology (S.S.) and Psychiatry (R.L.G.), Athinoula A. Martinos Center for Biomedical Imaging (R.L.G.), Division of Newborn Medicine, Department of Pediatrics (S.V.B., R.W.), and Laboratory of Computer Science (S.N.M.), Massachusetts General Hospital, Harvard Medical School, Boston, Mass; Department of Radiology, Children's Hospital of Philadelphia, Philadelphia, Pa (S.S.); and Fetal-Neonatal Neuroimaging and Developmental Science Center (P.E.G., Y.O.), Computational Health Informatics Program (Y.O.), Boston Children's Hospital, Harvard Medical School, 300 Longwood Ave, Boston, MA 02115
| | - Sara V Bates
- From the Departments of Radiology (S.S.) and Psychiatry (R.L.G.), Athinoula A. Martinos Center for Biomedical Imaging (R.L.G.), Division of Newborn Medicine, Department of Pediatrics (S.V.B., R.W.), and Laboratory of Computer Science (S.N.M.), Massachusetts General Hospital, Harvard Medical School, Boston, Mass; Department of Radiology, Children's Hospital of Philadelphia, Philadelphia, Pa (S.S.); and Fetal-Neonatal Neuroimaging and Developmental Science Center (P.E.G., Y.O.), Computational Health Informatics Program (Y.O.), Boston Children's Hospital, Harvard Medical School, 300 Longwood Ave, Boston, MA 02115
| | - Rebecca Weiss
- From the Departments of Radiology (S.S.) and Psychiatry (R.L.G.), Athinoula A. Martinos Center for Biomedical Imaging (R.L.G.), Division of Newborn Medicine, Department of Pediatrics (S.V.B., R.W.), and Laboratory of Computer Science (S.N.M.), Massachusetts General Hospital, Harvard Medical School, Boston, Mass; Department of Radiology, Children's Hospital of Philadelphia, Philadelphia, Pa (S.S.); and Fetal-Neonatal Neuroimaging and Developmental Science Center (P.E.G., Y.O.), Computational Health Informatics Program (Y.O.), Boston Children's Hospital, Harvard Medical School, 300 Longwood Ave, Boston, MA 02115
| | - Shawn N Murphy
- From the Departments of Radiology (S.S.) and Psychiatry (R.L.G.), Athinoula A. Martinos Center for Biomedical Imaging (R.L.G.), Division of Newborn Medicine, Department of Pediatrics (S.V.B., R.W.), and Laboratory of Computer Science (S.N.M.), Massachusetts General Hospital, Harvard Medical School, Boston, Mass; Department of Radiology, Children's Hospital of Philadelphia, Philadelphia, Pa (S.S.); and Fetal-Neonatal Neuroimaging and Developmental Science Center (P.E.G., Y.O.), Computational Health Informatics Program (Y.O.), Boston Children's Hospital, Harvard Medical School, 300 Longwood Ave, Boston, MA 02115
| | - P Ellen Grant
- From the Departments of Radiology (S.S.) and Psychiatry (R.L.G.), Athinoula A. Martinos Center for Biomedical Imaging (R.L.G.), Division of Newborn Medicine, Department of Pediatrics (S.V.B., R.W.), and Laboratory of Computer Science (S.N.M.), Massachusetts General Hospital, Harvard Medical School, Boston, Mass; Department of Radiology, Children's Hospital of Philadelphia, Philadelphia, Pa (S.S.); and Fetal-Neonatal Neuroimaging and Developmental Science Center (P.E.G., Y.O.), Computational Health Informatics Program (Y.O.), Boston Children's Hospital, Harvard Medical School, 300 Longwood Ave, Boston, MA 02115
| | - Yangming Ou
- From the Departments of Radiology (S.S.) and Psychiatry (R.L.G.), Athinoula A. Martinos Center for Biomedical Imaging (R.L.G.), Division of Newborn Medicine, Department of Pediatrics (S.V.B., R.W.), and Laboratory of Computer Science (S.N.M.), Massachusetts General Hospital, Harvard Medical School, Boston, Mass; Department of Radiology, Children's Hospital of Philadelphia, Philadelphia, Pa (S.S.); and Fetal-Neonatal Neuroimaging and Developmental Science Center (P.E.G., Y.O.), Computational Health Informatics Program (Y.O.), Boston Children's Hospital, Harvard Medical School, 300 Longwood Ave, Boston, MA 02115
| |
Collapse
|
22
|
Morton SU, Vyas R, Gagoski B, Vu C, Litt J, Larsen RJ, Kuchan MJ, Lasekan JB, Sutton BP, Grant PE, Ou Y. Maternal Dietary Intake of Omega-3 Fatty Acids Correlates Positively with Regional Brain Volumes in 1-Month-Old Term Infants. Cereb Cortex 2020; 30:2057-2069. [PMID: 31711132 PMCID: PMC8355466 DOI: 10.1093/cercor/bhz222] [Citation(s) in RCA: 20] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/20/2019] [Revised: 07/31/2019] [Accepted: 08/22/2019] [Indexed: 01/05/2023] Open
Abstract
Maternal nutrition is an important factor for infant neurodevelopment. However, prior magnetic resonance imaging (MRI) studies on maternal nutrients and infant brain have focused mostly on preterm infants or on few specific nutrients and few specific brain regions. We present a first study in term-born infants, comprehensively correlating 73 maternal nutrients with infant brain morphometry at the regional (61 regions) and voxel (over 300 000 voxel) levels. Both maternal nutrition intake diaries and infant MRI were collected at 1 month of life (0.9 ± 0.5 months) for 92 term-born infants (among them, 54 infants were purely breastfed and 19 were breastfed most of the time). Intake of nutrients was assessed via standardized food frequency questionnaire. No nutrient was significantly correlated with any of the volumes of the 61 autosegmented brain regions. However, increased volumes within subregions of the frontal cortex and corpus callosum at the voxel level were positively correlated with maternal intake of omega-3 fatty acids, retinol (vitamin A) and vitamin B12, both with and without correction for postmenstrual age and sex (P < 0.05, q < 0.05 after false discovery rate correction). Omega-3 fatty acids remained significantly correlated with infant brain volumes after subsetting to the 54 infants who were exclusively breastfed, but retinol and vitamin B12 did not. This provides an impetus for future larger studies to better characterize the effect size of dietary variation and correlation with neurodevelopmental outcomes, which can lead to improved nutritional guidance during pregnancy and lactation.
Collapse
Affiliation(s)
- Sarah U Morton
- Division of Newborn Medicine, Boston Children’s Hospital, Boston, MA 02115, USA
| | - Rutvi Vyas
- Division of Newborn Medicine, Boston Children’s Hospital, Boston, MA 02115, USA
- Fetal-Neonatal Neuroimaging and Developmental Science Center, Boston Children’s Hospital, Boston, MA 02115, USA
| | - Borjan Gagoski
- Fetal-Neonatal Neuroimaging and Developmental Science Center, Boston Children’s Hospital, Boston, MA 02115, USA
- Department of Radiology, Boston Children’s Hospital, Boston, MA 02115, USA
| | - Catherine Vu
- Fetal-Neonatal Neuroimaging and Developmental Science Center, Boston Children’s Hospital, Boston, MA 02115, USA
| | - Jonathan Litt
- Department of Neonatology, Beth Israel Deaconess Medical Center, Boston, MA 02115, USA
| | - Ryan J Larsen
- Beckman Institute, University of Illinois at Urbana—Champaign, Urbana, IL 61801, USA
| | | | | | - Brad P Sutton
- Beckman Institute, University of Illinois at Urbana—Champaign, Urbana, IL 61801, USA
- Department of Bioengineering, University of Illinois at Urbana—Champaign, Urbana, IL 61801, USA
| | - P Ellen Grant
- Division of Newborn Medicine, Boston Children’s Hospital, Boston, MA 02115, USA
- Fetal-Neonatal Neuroimaging and Developmental Science Center, Boston Children’s Hospital, Boston, MA 02115, USA
- Department of Radiology, Boston Children’s Hospital, Boston, MA 02115, USA
| | - Yangming Ou
- Division of Newborn Medicine, Boston Children’s Hospital, Boston, MA 02115, USA
- Fetal-Neonatal Neuroimaging and Developmental Science Center, Boston Children’s Hospital, Boston, MA 02115, USA
- Department of Radiology, Boston Children’s Hospital, Boston, MA 02115, USA
| |
Collapse
|
23
|
Weiss RJ, Bates SV, Song Y, Zhang Y, Herzberg EM, Chen YC, Gong M, Chien I, Zhang L, Murphy SN, Gollub RL, Grant PE, Ou Y. Mining multi-site clinical data to develop machine learning MRI biomarkers: application to neonatal hypoxic ischemic encephalopathy. J Transl Med 2019; 17:385. [PMID: 31752923 PMCID: PMC6873573 DOI: 10.1186/s12967-019-2119-5] [Citation(s) in RCA: 11] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/24/2019] [Accepted: 10/31/2019] [Indexed: 12/13/2022] Open
Abstract
BACKGROUND Secondary and retrospective use of hospital-hosted clinical data provides a time- and cost-efficient alternative to prospective clinical trials for biomarker development. This study aims to create a retrospective clinical dataset of Magnetic Resonance Images (MRI) and clinical records of neonatal hypoxic ischemic encephalopathy (HIE), from which clinically-relevant analytic algorithms can be developed for MRI-based HIE lesion detection and outcome prediction. METHODS This retrospective study will use clinical registries and big data informatics tools to build a multi-site dataset that contains structural and diffusion MRI, clinical information including hospital course, short-term outcomes (during infancy), and long-term outcomes (~ 2 years of age) for at least 300 patients from multiple hospitals. DISCUSSION Within machine learning frameworks, we will test whether the quantified deviation from our recently-developed normative brain atlases can detect abnormal regions and predict outcomes for individual patients as accurately as, or even more accurately, than human experts. Trial Registration Not applicable. This study protocol mines existing clinical data thus does not meet the ICMJE definition of a clinical trial that requires registration.
Collapse
Affiliation(s)
- Rebecca J Weiss
- Division of Newborn Medicine, Department of Pediatrics, Massachusetts General Hospital, Harvard Medical School, Boston, MA, 02114, USA
| | - Sara V Bates
- Division of Newborn Medicine, Department of Pediatrics, Massachusetts General Hospital, Harvard Medical School, Boston, MA, 02114, USA
| | - Ya'nan Song
- Fetal Neonatal Neuroimaging and Developmental Science Center (FNNDSC), Boston Children's Hospital, Harvard Medical School, 401 Park Drive, Landmark Center 7022, Boston, MA, 02115, USA
| | - Yue Zhang
- Fetal Neonatal Neuroimaging and Developmental Science Center (FNNDSC), Boston Children's Hospital, Harvard Medical School, 401 Park Drive, Landmark Center 7022, Boston, MA, 02115, USA
| | - Emily M Herzberg
- Division of Newborn Medicine, Department of Pediatrics, Massachusetts General Hospital, Harvard Medical School, Boston, MA, 02114, USA
| | - Yih-Chieh Chen
- Division of Newborn Medicine, Department of Pediatrics, Massachusetts General Hospital, Harvard Medical School, Boston, MA, 02114, USA
| | - Maryann Gong
- Computer Science & Artificial Intelligence Lab (CSAIL), Massachusetts Institute of Technology, Cambridge, MA, 02139, USA
| | - Isabel Chien
- Computer Science & Artificial Intelligence Lab (CSAIL), Massachusetts Institute of Technology, Cambridge, MA, 02139, USA
| | - Lily Zhang
- Computer Science & Artificial Intelligence Lab (CSAIL), Massachusetts Institute of Technology, Cambridge, MA, 02139, USA
| | - Shawn N Murphy
- Laboratory of Computer Science, Massachusetts General Hospital, Harvard Medical School, Boston, MA, 02114, USA
| | - Randy L Gollub
- Department of Psychiatry and Department of Radiology, Massachusetts General Hospital, Harvard Medical School, Boston, MA, 02114, USA
| | - P Ellen Grant
- Fetal Neonatal Neuroimaging and Developmental Science Center (FNNDSC), Boston Children's Hospital, Harvard Medical School, 401 Park Drive, Landmark Center 7022, Boston, MA, 02115, USA.
- Neuroradiology Division, Department of Radiology, Boston Children's Hospital, Harvard Medical School, Boston, MA, 02115, USA.
| | - Yangming Ou
- Fetal Neonatal Neuroimaging and Developmental Science Center (FNNDSC), Boston Children's Hospital, Harvard Medical School, 401 Park Drive, Landmark Center 7022, Boston, MA, 02115, USA.
- Neuroradiology Division, Department of Radiology, Boston Children's Hospital, Harvard Medical School, Boston, MA, 02115, USA.
- Computational Health Informatics Program (CHIP), Boston Children's Hospital, Harvard Medical School, Boston, MA, 02115, USA.
| |
Collapse
|
24
|
Machado I, Toews M, George E, Unadkat P, Essayed W, Luo J, Teodoro P, Carvalho H, Martins J, Golland P, Pieper S, Frisken S, Golby A, Wells Iii W, Ou Y. Deformable MRI-Ultrasound registration using correlation-based attribute matching for brain shift correction: Accuracy and generality in multi-site data. Neuroimage 2019; 202:116094. [PMID: 31446127 PMCID: PMC6819249 DOI: 10.1016/j.neuroimage.2019.116094] [Citation(s) in RCA: 13] [Impact Index Per Article: 2.2] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/10/2019] [Revised: 07/18/2019] [Accepted: 08/09/2019] [Indexed: 11/16/2022] Open
Abstract
Intraoperative tissue deformation, known as brain shift, decreases the benefit of using preoperative images to guide neurosurgery. Non-rigid registration of preoperative magnetic resonance (MR) to intraoperative ultrasound (iUS) has been proposed as a means to compensate for brain shift. We focus on the initial registration from MR to predurotomy iUS. We present a method that builds on previous work to address the need for accuracy and generality of MR-iUS registration algorithms in multi-site clinical data. High-dimensional texture attributes were used instead of image intensities for image registration and the standard difference-based attribute matching was replaced with correlation-based attribute matching. A strategy that deals explicitly with the large field-of-view mismatch between MR and iUS images was proposed. Key parameters were optimized across independent MR-iUS brain tumor datasets acquired at 3 institutions, with a total of 43 tumor patients and 758 reference landmarks for evaluating the accuracy of the proposed algorithm. Despite differences in imaging protocols, patient demographics and landmark distributions, the algorithm is able to reduce landmark errors prior to registration in three data sets (5.37±4.27, 4.18±1.97 and 6.18±3.38 mm, respectively) to a consistently low level (2.28±0.71, 2.08±0.37 and 2.24±0.78 mm, respectively). This algorithm was tested against 15 other algorithms and it is competitive with the state-of-the-art on multiple datasets. We show that the algorithm has one of the lowest errors in all datasets (accuracy), and this is achieved while sticking to a fixed set of parameters for multi-site data (generality). In contrast, other algorithms/tools of similar performance need per-dataset parameter tuning (high accuracy but lower generality), and those that stick to fixed parameters have larger errors or inconsistent performance (generality but not the top accuracy). Landmark errors were further characterized according to brain regions and tumor types, a topic so far missing in the literature.
Collapse
Affiliation(s)
- Inês Machado
- Department of Radiology, Brigham and Women's Hospital, Harvard Medical School, Boston, MA, USA; Department of Mechanical Engineering, Instituto Superior Técnico, Universidade de Lisboa, Lisbon, Portugal.
| | - Matthew Toews
- Department of Systems Engineering, École de Technologie Supérieure, Montreal, Canada
| | - Elizabeth George
- Department of Radiology, Brigham and Women's Hospital, Harvard Medical School, Boston, MA, USA
| | - Prashin Unadkat
- Department of Neurosurgery, Brigham and Women's Hospital, Harvard Medical School, Boston, MA, USA
| | - Walid Essayed
- Department of Neurosurgery, Brigham and Women's Hospital, Harvard Medical School, Boston, MA, USA
| | - Jie Luo
- Graduate School of Frontier Sciences, University of Tokyo, Tokyo, Japan
| | - Pedro Teodoro
- Escola Superior Náutica Infante D. Henrique, Lisbon, Portugal
| | - Herculano Carvalho
- Department of Neurosurgery, Hospital de Santa Maria, CHLN, Lisbon, Portugal
| | - Jorge Martins
- Department of Mechanical Engineering, Instituto Superior Técnico, Universidade de Lisboa, Lisbon, Portugal
| | - Polina Golland
- Computer Science and Artificial Intelligence Laboratory, MIT, Cambridge, MA, USA
| | - Steve Pieper
- Department of Radiology, Brigham and Women's Hospital, Harvard Medical School, Boston, MA, USA; Isomics, Inc., Cambridge, MA, USA
| | - Sarah Frisken
- Department of Radiology, Brigham and Women's Hospital, Harvard Medical School, Boston, MA, USA
| | - Alexandra Golby
- Department of Neurosurgery, Brigham and Women's Hospital, Harvard Medical School, Boston, MA, USA
| | - William Wells Iii
- Department of Radiology, Brigham and Women's Hospital, Harvard Medical School, Boston, MA, USA; Computer Science and Artificial Intelligence Laboratory, MIT, Cambridge, MA, USA
| | - Yangming Ou
- Department of Pediatrics and Radiology, Boston Children's Hospital, Harvard Medical School, Boston, MA, USA.
| |
Collapse
|