Comparison of multiple tractography methods for reconstruction of the retinogeniculate visual pathway using diffusion MRI

Tractography-based automated identification of the retinogeniculate visual pathway with novel microstructure-informed supervised contrastive learning

The retinogeniculate visual pathway (RGVP) is responsible for carrying visual information from the retina to the lateral geniculate nucleus. Identification and visualization of the RGVP are important in studying the anatomy of the visual system and can inform the treatment of related brain diseases. Diffusion MRI (dMRI) tractography is an advanced imaging method that uniquely enables in vivo mapping of the 3D trajectory of the RGVP. Currently, identification of the RGVP from tractography data relies on expert (manual) selection of tractography streamlines, which is time-consuming, has high clinical and expert labor costs, and is affected by inter-observer variability. In this paper, we present a novel deep learning framework, DeepRGVP , to enable fast and accurate identification of the RGVP from dMRI tractography data. We design a novel microstructure-informed supervised contrastive learning method that leverages both streamline label and tissue microstructure information to determine positive and negative pairs. We propose a simple and successful streamline-level data augmentation method to address highly imbalanced training data, where the number of RGVP streamlines is much lower than that of non-RGVP streamlines. We perform comparisons with several state-of-the-art deep learning methods that were designed for tractography parcellation, and we show superior RGVP identification results using DeepRGVP. In addition, we demonstrate a good generalizability of DeepRGVP to dMRI tractography data from neurosurgical patients with pituitary tumors and we show DeepRGVP can successfully identify RGVPs despite the effect of lesions affecting the RGVPs. Overall, our study shows the high potential of using deep learning to automatically identify the RGVP.

Reconstructing the somatotopic organization of the corticospinal tract remains a challenge for modern tractography methods

The corticospinal tract (CST) is a critically important white matter fiber tract in the human brain that enables control of voluntary movements of the body. The CST exhibits a somatotopic organization, which means that the motor neurons that control specific body parts are arranged in order within the CST. Diffusion magnetic resonance imaging (MRI) tractography is increasingly used to study the anatomy of the CST. However, despite many advances in tractography algorithms over the past decade, modern, state-of-the-art methods still face challenges. In this study, we compare the performance of six widely used tractography methods for reconstructing the CST and its somatotopic organization. These methods include constrained spherical deconvolution (CSD) based probabilistic (iFOD1) and deterministic (SD-Stream) methods, unscented Kalman filter (UKF) tractography methods including multi-fiber (UKF2T) and single-fiber (UKF1T) models, the generalized q-sampling imaging (GQI) based deterministic tractography method, and the TractSeg method. We investigate CST somatotopy by dividing the CST into four subdivisions per hemisphere that originate in the leg, trunk, hand, and face areas of the primary motor cortex. A quantitative and visual comparison is performed using diffusion MRI data (N = 100 subjects) from the Human Connectome Project. Quantitative evaluations include the reconstruction rate of the eight anatomical subdivisions, the percentage of streamlines in each subdivision, and the coverage of the white matter-gray matter (WM-GM) interface. CST somatotopy is further evaluated by comparing the percentage of streamlines in each subdivision to the cortical volumes for the leg, trunk, hand, and face areas. Overall, UKF2T has the highest reconstruction rate and cortical coverage. It is the only method with a significant positive correlation between the percentage of streamlines in each subdivision and the volume of the corresponding motor cortex. However, our experimental results show that all compared tractography methods are biased toward generating many trunk streamlines (ranging from 35.10% to 71.66% of total streamlines across methods). Furthermore, the coverage of the WM-GM interface in the largest motor area (face) is generally low (under 40%) for all compared tractography methods. Different tractography methods give conflicting results regarding the percentage of streamlines in each subdivision and the volume of the corresponding motor cortex, indicating that there is generally no clear relationship, and that reconstruction of CST somatotopy is still a large challenge. Overall, we conclude that while current tractography methods have made progress toward the well-known challenge of improving the reconstruction of the lateral projections of the CST, the overall problem of performing a comprehensive CST reconstruction, including clinically important projections in the lateral (hand and face areas) and medial portions (leg area), remains an important challenge for diffusion MRI tractography.

Methods of diffusion MRI tractography for localization of the anterior optic pathway: A systematic review of validated methods

The anterior optic pathway (AOP) is a system of three structures (optic nerves, optic chiasma, and optic tracts) that convey visual stimuli from the retina to the lateral geniculate nuclei. A successful reconstruction of the AOP using tractography could be helpful in several clinical scenarios, from presurgical planning and neuronavigation of sellar and parasellar surgery to monitoring the stage of fiber degeneration both in acute (e.g., traumatic optic neuropathy) or chronic conditions that affect AOP structures (e.g., amblyopia, glaucoma, demyelinating disorders or genetic optic nerve atrophies). However, its peculiar anatomy and course, as well as its surroundings, pose a serious challenge to obtaining successful tractographic reconstructions. Several AOP tractography strategies have been adopted but no standard procedure has been agreed upon. We performed a systematic review of the literature according to the Preferred Reporting Items for Systematic Reviews and Meta-analyses (PRISMA) 2020 guidelines in order to find the combinations of acquisition and reconstruction parameters that have been performed previously and have provided the highest rate of successful reconstruction of the AOP, in order to promote their routine implementation in clinical practice. For this purpose, we reviewed data regarding how the process of anatomical validation of the tractographies was performed. The Cochrane Handbook for Systematic Reviews of Interventions was used to assess the risk of bias and thus the study quality We identified thirty-nine studies that met our inclusion criteria, and only five were considered at low risk of bias and achieved over 80% of successful reconstructions. We found a high degree of heterogeneity in the acquisition and analysis parameters used to perform AOP tractography and different combinations of them can achieve satisfactory levels of anterior optic tractographic reconstruction both in real-life research and clinical scenarios. One thousand s/mm2 was the most frequently used b value, while both deterministic and probabilistic tractography algorithms performed morphological reconstruction of the tract satisfactorily, although probabilistic algorithms estimated a more realistic percentage of crossing fibers (45.6%) in healthy subjects. A wide heterogeneity was also found regarding the method used to assess the anatomical fidelity of the AOP reconstructions. Three main strategies can be found: direct visual direct visual assessment of the tractography superimposed to a conventional MR image, surgical evaluation, and computational methods. Because the latter is less dependent on a priori knowledge of the anatomy by the operator, computational methods of validation of the anatomy should be considered whenever possible.

A unified global tractography framework for automatic visual pathway reconstruction

The human visual pathway starts from the retina, passes through the retinogeniculate visual pathway, the optic radiation, and finally connects to the primary visual cortex. Diffusion MRI tractography is the only technology that can noninvasively reconstruct the visual pathway. However, complete and accurate visual pathway reconstruction is challenging because of the skull base environment and complex fiber geometries. Specifically, the optic nerve within the complex skull base environment can cause abnormal diffusion signals. The crossing and fanning fibers at the optic chiasm, and a sharp turn of Meyer's loop at the optic radiation, contribute to complex fiber geometries of the visual pathway. A fiber trajectory distribution (FTD) function-based tractography method of our previous work and several high sensitivity tractography methods can reveal these complex fiber geometries, but are accompanied by false-positive fibers. Thus, the related studies of the visual pathway mostly applied the expert region of interest selection strategy. However, interobserver variability is an issue in reconstructing an accurate visual pathway. In this paper, we propose a unified global tractography framework to automatically reconstruct the visual pathway. We first extend the FTD function to a high-order streamline differential equation for global trajectory estimation. At the global level, the tractography process is simplified as the estimation of global trajectory distribution coefficients by minimizing the cost between trajectory distribution and the selected directions under the prior guidance by introducing the tractography template as anatomic priors. Furthermore, we use a deep learning-based method and tractography template prior information to automatically generate the mask for tractography. The experimental results demonstrate that our proposed method can successfully reconstruct the visual pathway with high accuracy.

Fiber-specific white matter alterations in Parkinson's disease patients with freezing of gait

Freezing of gait (FOG) is a gait disorder that usually occurs in advanced stages of Parkinson's disease (PD). Understanding the underlying mechanism of FOG is important for treatment and prevention. Previous studies have investigated white matter (WM) structure to explore the pathology of FOG. However, the pathology is still unclear, possibly due to the methodological limitation in identifying specific fiber tracts. This study aimed to investigate tract-specific WM structural changes in FOG patients and their relationships with clinical characteristics. We enrolled 19 PD patients with FOG (PD-FOG), 19 without FOG (PD-woFOG) and 21 controls. Fixel-based analysis is a novel framework to avoid the effect of crossing fibers, which provides the metrics to assess WM morphology. By combining a method for segmenting fibers, we identified abnormalities in the specific fiber tracts. Compared to PD-woFOG, PD-FOG showed significant increased fiber-bundle cross-section (FC) in the corpus callosum (CC), fornix (FX), inferior longitudinal fasciculus (ILF), striato-premotor (ST_PREM), superior thalamic radiation (STR), thalamo-premotor (T_PREM), increased fiber density and cross-section (FDC) in the STR, and decreased fiber density (FD) in the CC and ILF. Additionally, the ILF was correlated with motor, cognition and memory, the CC was correlated with anxiety, and the T_PREM was also correlated with cognition. In conclusion, in addition to impairments of WM found in PD-FOG, we found enhancements in WM, which may imply compensatory mechanisms. Furthermore, multiple fiber tracts were correlated with clinical characteristics, especially the ILF, validating the involvement of transmission circuits of multiple distinct information in mechanisms of FOG.

Computational approaches for the reconstruction of optic nerve fibers along the visual pathway from medical images: a comprehensive review

Optic never fibers in the visual pathway play significant roles in vision formation. Damages of optic nerve fibers are biomarkers for the diagnosis of various ophthalmological and neurological diseases; also, there is a need to prevent the optic nerve fibers from getting damaged in neurosurgery and radiation therapy. Reconstruction of optic nerve fibers from medical images can facilitate all these clinical applications. Although many computational methods are developed for the reconstruction of optic nerve fibers, a comprehensive review of these methods is still lacking. This paper described both the two strategies for optic nerve fiber reconstruction applied in existing studies, i.e., image segmentation and fiber tracking. In comparison to image segmentation, fiber tracking can delineate more detailed structures of optic nerve fibers. For each strategy, both conventional and AI-based approaches were introduced, and the latter usually demonstrates better performance than the former. From the review, we concluded that AI-based methods are the trend for optic nerve fiber reconstruction and some new techniques like generative AI can help address the current challenges in optic nerve fiber reconstruction.

CNTSeg: A multimodal deep-learning-based network for cranial nerves tract segmentation

The segmentation of cranial nerves (CNs) tracts based on diffusion magnetic resonance imaging (dMRI) provides a valuable quantitative tool for the analysis of the morphology and course of individual CNs. Tractography-based approaches can describe and analyze the anatomical area of CNs by selecting the reference streamlines in combination with ROIs-based (regions-of-interests) or clustering-based. However, due to the slender structure of CNs and the complex anatomical environment, single-modality data based on dMRI cannot provide a complete and accurate description, resulting in low accuracy or even failure of current algorithms in performing individualized CNs segmentation. In this work, we propose a novel multimodal deep-learning-based multi-class network for automated cranial nerves tract segmentation without using tractography, ROI placement or clustering, called CNTSeg. Specifically, we introduced T1w images, fractional anisotropy (FA) images, and fiber orientation distribution function (fODF) peaks into the training data set, and design the back-end fusion module which uses the complementary information of the interphase feature fusion to improve the segmentation performance. CNTSeg has achieved the segmentation of 5 pairs of CNs (i.e. optic nerve CN II, oculomotor nerve CN III, trigeminal nerve CN V, and facial-vestibulocochlear nerve CN VII/VIII). Extensive comparisons and ablation experiments show promising results and are anatomically convincing even for difficult tracts. The code will be openly available at https://github.com/IPIS-XieLei/CNTSeg.

Visualization of human optic nerve by diffusion tensor mapping and degree of neuropathy

Diffusion-weighted magnetic resonance imaging of the human optic nerve and tract is technically difficult because of its small size, the inherent strong signal generated by the surrounding fat and the cerebrospinal fluid, and due to eddy current-induced distortions and subject movement artifacts. The effects of the bone canal through which the optic nerve passes, and the proximity of blood vessels, muscles and tendons are generally unknown. Also, the limited technical capabilities of the scanners and the minimization of acquisition times result in poor quality diffusion-weighted images. It is challenging for current tractography methods to accurately track optic pathway fibers that correspond to known anatomy. Despite these technical limitations and low image resolution, here we show how to visualize the optic nerve and tract and quantify nerve atrophy. Our visualization method based on the analysis of the diffusion tensor shows marked differences between a healthy male subject and a male subject with progressive optic nerve neuropathy. These differences coincide with diffusion scalar metrics and are not visible on standard morphological images. A quantification of the degree of optic nerve atrophy in a systematic way is provided and it is tested on 9 subjects from the Human Connectome Project.

Multishell Diffusion MR Tractography Yields Morphological and Microstructural Information of the Anterior Optic Pathway: A Proof-of-Concept Study in Patients with Leber’s Hereditary Optic Neuropathy

Tractography based on multishell diffusion-weighted magnetic resonance imaging (DWI) can be used to estimate the course of myelinated white matter tracts and nerves, yielding valuable information regarding normal anatomy and variability. DWI is sensitive to the local tissue microstructure, so tractography can be used to estimate tissue properties within nerve tracts at a resolution of millimeters. This study aimed to test the applicability of the method using a disease with a well-established pattern of myelinated nerve involvement. Eight patients with LHON and 13 age-matched healthy controls underwent tractography of the anterior optic pathway. Diffusion parameters were compared between groups, and for the patient group correlated with clinical/ophthalmological parameters. Tractography established the course of the anterior optic pathway in both patients and controls. Localized changes in fractional anisotropy were observed, and related to estimates of different tissue compartments within the nerve and tract. The proportion of different compartments correlated with markers of disease severity. The method described allows both anatomical localization and tissue characterization in vivo, permitting both visualization of variation at the individual level and statistical inference at the group level. It provides a valuable adjunct to ex vivo anatomical and histological study of normal variation and disease processes.

Automation of Cranial Nerve Tractography by Filtering Tractograms for Skull Base Surgery

Fiber tractography enables the in vivo reconstruction of white matter fibers in 3 dimensions using data collected by diffusion tensor imaging, thereby helping to understand functional neuroanatomy. In a pre-operative context, it provides essential information on the trajectory of fiber bundles of medical interest, such as cranial nerves. However, the optimization of tractography parameters is a time-consuming process and requires expert neuroanatomical knowledge, making the use of tractography difficult in clinical routine. Tractogram filtering is a method used to isolate the most relevant fibers. In this work, we propose to use filtering as a post-processing of tractography to avoid the manual optimization of tracking parameters and therefore making a step forward automation of tractography. To question the feasibility of automated tractography of cranial nerves, we perform an analysis of main cranial nerves on a series of patients with skull base tumors. A quantitative evaluation of the filtering performance of two state-of-the-art and a new entropy-based methods is carried out on the basis of reference tractograms produced by experts. Our approach proves to be more stable in the selection of the optimal filtering threshold and turns out to be interesting in terms of computational time complexity.

Advanced Diffusion MRI of the Visual System in Glaucoma: From Experimental Animal Models to Humans

Simple Summary

This review summarizes current applications of advanced diffusion magnetic resonance imaging (MRI) throughout the glaucomatous visual system, focusing on the eye, optic nerve, optic tract, subcortical visual brain nuclei, optic radiations, and visual cortex. Glaucoma continues to be the leading cause of irreversible blindness worldwide and often remains undetected until later disease stages. The development of non-invasive methods for early detection of visual pathway integrity could pave the way for timely intervention and targeted treatment strategies. Principles of diffusion have been integrated with MRI protocols to produce a diffusion-weighted imaging modality for studying changes to tissue microstructures by quantifying the movement of water molecules in vivo. The development and applications of diffusion MRI in ophthalmology have allowed a better understanding of neural pathway changes in glaucoma. The feasibility of translating diffusion MRI techniques to assess both humans and experimental animal models of glaucoma and other optic neuropathies or neurodegenerative diseases is discussed. Recent research focuses on overcoming limitations in imaging quality, acquisition times, and biological interpretation suggest that diffusion MRI can provide an important tool for the non-invasive evaluation of glaucomatous changes in the visual system.

Abstract

Glaucoma is a group of ophthalmologic conditions characterized by progressive retinal ganglion cell death, optic nerve degeneration, and irreversible vision loss. While intraocular pressure is the only clinically modifiable risk factor, glaucoma may continue to progress at controlled intraocular pressure, indicating other major factors in contributing to the disease mechanisms. Recent studies demonstrated the feasibility of advanced diffusion magnetic resonance imaging (dMRI) in visualizing the microstructural integrity of the visual system, opening new possibilities for non-invasive characterization of glaucomatous brain changes for guiding earlier and targeted intervention besides intraocular pressure lowering. In this review, we discuss dMRI methods currently used in visual system investigations, focusing on the eye, optic nerve, optic tract, subcortical visual brain nuclei, optic radiations, and visual cortex. We evaluate how conventional diffusion tensor imaging, higher-order diffusion kurtosis imaging, and other extended dMRI techniques can assess the neuronal and glial integrity of the visual system in both humans and experimental animal models of glaucoma, among other optic neuropathies or neurodegenerative diseases. We also compare the pros and cons of these methods against other imaging modalities. A growing body of dMRI research indicates that this modality holds promise in characterizing early glaucomatous changes in the visual system, determining the disease severity, and identifying potential neurotherapeutic targets, offering more options to slow glaucoma progression and to reduce the prevalence of this world’s leading cause of irreversible but preventable blindness.

Automatic oculomotor nerve identification based on data‐driven fiber clustering

The oculomotor nerve (OCN) is the main motor nerve innervating eye muscles and can be involved in multiple flammatory, compressive, or pathologies. The diffusion magnetic resonance imaging (dMRI) tractography is now widely used to describe the trajectory of the OCN. However, the complex cranial structure leads to difficulties in fiber orientation distribution (FOD) modeling, fiber tracking, and region of interest (ROI) selection. Currently, the identification of OCN relies on expert manual operation, resulting in challenges, such as the carries high clinical, time‐consuming, and labor costs. Thus, we propose a method that can automatically identify OCN from dMRI tractography. First, we choose the multi‐shell multi‐tissue constraint spherical deconvolution (MSMT‐CSD) FOD estimation model and deterministic tractography to describe the 3D trajectory of the OCN. Then, we rely on the well‐established computational pipeline and anatomical expertise to create a data‐driven OCN tractography atlas from 40 HCP data. We identify six clusters belonging to the OCN from the atlas, including the structures of three kinds of positional relationships (pass between, pass through, and go around) with the red nuclei and two kinds of positional relationships with medial longitudinal fasciculus. Finally, we apply the proposed OCN atlas to identify the OCN automatically from 40 new HCP subjects and two patients with brainstem cavernous malformation. In terms of spatial overlap and visualization, experiment results show that the automatically and manually identified OCN fibers are consistent. Our proposed OCN atlas provides an effective tool for identifying OCN by avoiding the traditional selection strategy of ROIs.

Predictive Radiation Oncology - A New NCI-DOE Scientific Space and Community

With a widely attended virtual kickoff event on January 29, 2021, the National Cancer Institute (NCI) and the Department of Energy (DOE) launched a series of 4 interactive, interdisciplinary workshops-and a final concluding "World Café" on March 29, 2021-focused on advancing computational approaches for predictive oncology in the clinical and research domains of radiation oncology. These events reflect 3,870 human hours of virtual engagement with representation from 8 DOE national laboratories and the Frederick National Laboratory for Cancer Research (FNL), 4 research institutes, 5 cancer centers, 17 medical schools and teaching hospitals, 5 companies, 5 federal agencies, 3 research centers, and 27 universities. Here we summarize the workshops by first describing the background for the workshops. Participants identified twelve key questions-and collaborative parallel ideas-as the focus of work going forward to advance the field. These were then used to define short-term and longer-term "Blue Sky" goals. In addition, the group determined key success factors for predictive oncology in the context of radiation oncology, if not the future of all of medicine. These are: cross-discipline collaboration, targeted talent development, development of mechanistic mathematical and computational models and tools, and access to high-quality multiscale data that bridges mechanisms to phenotype. The workshop participants reported feeling energized and highly motivated to pursue next steps together to address the unmet needs in radiation oncology specifically and in cancer research generally and that NCI and DOE project goals align at the convergence of radiation therapy and advanced computing.

Comparison of multiple tractography methods for reconstruction of the retinogeniculate visual pathway using diffusion MRI

The retinogeniculate visual pathway (RGVP) conveys visual information from the retina to the lateral geniculate nucleus. The RGVP has four subdivisions, including two decussating and two nondecussating pathways that cannot be identified on conventional structural magnetic resonance imaging (MRI). Diffusion MRI tractography has the potential to trace these subdivisions and is increasingly used to study the RGVP. However, it is not yet known which fiber tracking strategy is most suitable for RGVP reconstruction. In this study, four tractography methods are compared, including constrained spherical deconvolution (CSD) based probabilistic (iFOD1) and deterministic (SD‐Stream) methods, and multi‐fiber (UKF‐2T) and single‐fiber (UKF‐1T) unscented Kalman filter (UKF) methods. Experiments use diffusion MRI data from 57 subjects in the Human Connectome Project. The RGVP is identified using regions of interest created by two clinical experts. Quantitative anatomical measurements and expert anatomical judgment are used to assess the advantages and limitations of the four tractography methods. Overall, we conclude that UKF‐2T and iFOD1 produce the best RGVP reconstruction results. The iFOD1 method can better quantitatively estimate the percentage of decussating fibers, while the UKF‐2T method produces reconstructed RGVPs that are judged to better correspond to the known anatomy and have the highest spatial overlap across subjects. Overall, we find that it is challenging for current tractography methods to both accurately track RGVP fibers that correspond to known anatomy and produce an approximately correct percentage of decussating fibers. We suggest that future algorithm development for RGVP tractography should take consideration of both of these two points.