Automated olfactory bulb segmentation on high resolutional T2-weighted MRI

Versatile MRI acquisition and processing protocol for population-based neuroimaging

Neuroimaging has an essential role in studies of brain health and of cerebrovascular and neurodegenerative diseases, requiring the availability of versatile magnetic resonance imaging (MRI) acquisition and processing protocols. We designed and developed a multipurpose high-resolution MRI protocol for large-scale and long-term population neuroimaging studies that includes structural, diffusion-weighted and functional MRI modalities. This modular protocol takes almost 1 h of scan time and is, apart from a concluding abdominal scan, entirely dedicated to the brain. The protocol links the acquisition of an extensive set of MRI contrasts directly to the corresponding fully automated data processing pipelines and to the required quality assurance of the MRI data and of the image-derived phenotypes. Since its successful implementation in the population-based Rhineland Study (ongoing, currently more than 11,000 participants, target participant number of 20,000), the proposed MRI protocol has proved suitable for epidemiological and clinical cross-sectional and longitudinal studies, including multisite studies. The approach requires expertise in magnetic resonance image acquisition, in computer science for the data management and the execution of processing pipelines, and in brain anatomy for the quality assessment of the MRI data. The protocol takes ~1 h of MRI acquisition and ~20 h of data processing to complete for a single dataset, but parallelization over multiple datasets using high-performance computing resources reduces the processing time. By making the protocol, MRI sequences and pipelines available, we aim to contribute to better comparability, interoperability and reusability of large-scale neuroimaging data.

Hypothalamic volume is associated with age, sex and cognitive function across lifespan: a comparative analysis of two large population-based cohort studies

BACKGROUND

Emerging findings indicate that the hypothalamus, the body's principal homeostatic centre, plays a crucial role in modulating cognition, but comprehensive population-based studies are lacking.

METHODS

We used cross-sectional data from the Rhineland Study (N = 5812, 55.2 ± 13.6 years, 58% women) and the UK Biobank Imaging Study (UKB) (N = 45,076, 64.2 ± 7.7 years, 53% women), two large-scale population-based cohort studies. Volumes of hypothalamic structures were obtained from 3T structural magnetic resonance images through an automatic parcellation procedure (FastSurfer-HypVINN). The standardised cognitive domain scores were derived from extensive neuropsychological test batteries. We employed multivariable linear regression to assess associations of hypothalamic volumes with age, sex and cognitive performance.

FINDINGS

In older individuals, volumes of total, anterior and posterior hypothalamus, and mammillary bodies were smaller, while those of medial hypothalamus and tuberal region were larger. Larger medial hypothalamus volume was related to higher cortisol levels in older individuals, providing functional validation. Volumes of all hypothalamic structures were larger in men compared to women. In both sexes, larger volumes of total, anterior and posterior hypothalamus, and mammillary bodies were associated with better domain-specific cognitive performance, whereas larger volumes of medial hypothalamus and tuberal region were associated with worse domain-specific cognitive performance.

INTERPRETATION

We found strong age and sex effects on hypothalamic structures, as well as robust associations between these structures and domain-specific cognitive functions. Overall, these findings thus implicate specific hypothalamic subregions as potential therapeutic targets against age-associated cognitive decline.

FUNDING

Institutional funds, Federal Ministry of Education and Research of Germany, Alzheimer's Association.

Reduced olfactory bulb volume accompanies olfactory dysfunction after mild SARS-CoV-2 infection

Despite its high prevalence, the determinants of smelling impairment in COVID-19 remain not fully understood. In this work, we aimed to examine the association between olfactory bulb volume and the clinical trajectory of COVID-19-related smelling impairment in a large-scale magnetic resonance imaging (MRI) analysis. Data of non-vaccinated COVID-19 convalescents recruited within the framework of the prospective Hamburg City Health Study COVID Program between March and December 2020 were analyzed. At baseline, 233 participants underwent MRI and neuropsychological testing as well as a structured questionnaire for olfactory function. Between March and April 2022, olfactory function was assessed at follow-up including quantitative olfactometric testing with Sniffin' Sticks. This study included 233 individuals recovered from mainly mild to moderate SARS-CoV-2 infections. Longitudinal assessment demonstrated a declining prevalence of self-reported olfactory dysfunction from 67.1% at acute infection, 21.0% at baseline examination and 17.5% at follow-up. Participants with post-acute self-reported olfactory dysfunction had a significantly lower olfactory bulb volume at baseline than normally smelling individuals. Olfactory bulb volume at baseline predicted olfactometric scores at follow-up. Performance in neuropsychological testing was not significantly associated with the olfactory bulb volume. Our work demonstrates an association of long-term self-reported smelling dysfunction and olfactory bulb integrity in a sample of individuals recovered from mainly mild to moderate COVID-19. Collectively, our results highlight olfactory bulb volume as a surrogate marker that may inform diagnosis and guide rehabilitation strategies in COVID-19.

Is Attention all You Need in Medical Image Analysis? A Review

Medical imaging is a key component in clinical diagnosis, treatment planning and clinical trial design, accounting for almost 90% of all healthcare data. CNNs achieved performance gains in medical image analysis (MIA) over the last years. CNNs can efficiently model local pixel interactions and be trained on small-scale MI data. Despite their important advances, typical CNN have relatively limited capabilities in modelling "global" pixel interactions, which restricts their generalisation ability to understand out-of-distribution data with different "global" information. The recent progress of Artificial Intelligence gave rise to Transformers, which can learn global relationships from data. However, full Transformer models need to be trained on large-scale data and involve tremendous computational complexity. Attention and Transformer compartments ("Transf/Attention") which can well maintain properties for modelling global relationships, have been proposed as lighter alternatives of full Transformers. Recently, there is an increasing trend to co-pollinate complementary local-global properties from CNN and Transf/Attention architectures, which led to a new era of hybrid models. The past years have witnessed substantial growth in hybrid CNN-Transf/Attention models across diverse MIA problems. In this systematic review, we survey existing hybrid CNN-Transf/Attention models, review and unravel key architectural designs, analyse breakthroughs, and evaluate current and future opportunities as well as challenges. We also introduced an analysis framework on generalisation opportunities of scientific and clinical impact, based on which new data-driven domain generalisation and adaptation methods can be stimulated.

FastSurfer-HypVINN: Automated sub-segmentation of the hypothalamus and adjacent structures on high-resolutional brain MRI

The hypothalamus plays a crucial role in the regulation of a broad range of physiological, behavioral, and cognitive functions. However, despite its importance, only a few small-scale neuroimaging studies have investigated its substructures, likely due to the lack of fully automated segmentation tools to address scalability and reproducibility issues of manual segmentation. While the only previous attempt to automatically sub-segment the hypothalamus with a neural network showed promise for 1.0 mm isotropic T1-weighted (T1w) magnetic resonance imaging (MRI), there is a need for an automated tool to sub-segment also high-resolutional (HiRes) MR scans, as they are becoming widely available, and include structural detail also from multi-modal MRI. We, therefore, introduce a novel, fast, and fully automated deep-learning method named HypVINN for sub-segmentation of the hypothalamus and adjacent structures on 0.8 mm isotropic T1w and T2w brain MR images that is robust to missing modalities. We extensively validate our model with respect to segmentation accuracy, generalizability, in-session test-retest reliability, and sensitivity to replicate hypothalamic volume effects (e.g., sex differences). The proposed method exhibits high segmentation performance both for standalone T1w images as well as for T1w/T2w image pairs. Even with the additional capability to accept flexible inputs, our model matches or exceeds the performance of state-of-the-art methods with fixed inputs. We, further, demonstrate the generalizability of our method in experiments with 1.0 mm MR scans from both the Rhineland Study and the UK Biobank-an independent dataset never encountered during training with different acquisition parameters and demographics. Finally, HypVINN can perform the segmentation in less than a minute (graphical processing unit [GPU]) and will be available in the open source FastSurfer neuroimaging software suite, offering a validated, efficient, and scalable solution for evaluating imaging-derived phenotypes of the hypothalamus.

A Scoping Review of Artificial Intelligence Research in Rhinology

BACKGROUND

A considerable volume of possible applications of artificial intelligence (AI) in the field of rhinology exists, and research in the area is rapidly evolving.

OBJECTIVE

This scoping review aims to provide a brief overview of all current literature on AI in the field of rhinology. Further, it aims to highlight gaps in the literature for future rhinology researchers.

METHODS

OVID MEDLINE (1946-2022) and EMBASE (1974-2022) were searched from January 1, 2017 until May 14, 2022 to identify all relevant articles. The Preferred Reporting Items for Systematic Reviews and Meta-analyses Extension for Scoping Reviews checklist was used to guide the review.

RESULTS

A total of 2420 results were identified of which 62 met the eligibility criteria. A further 17 articles were included through bibliography searching, for a total of 79 articles on AI in rhinology. Each year resulted in an increase in the number of publications, from 3 articles published in 2017 to 31 articles published in 2021. Articles were produced by authors from 22 countries with a relative majority coming from the USA (19%), China (19%), and South Korea (13%). Articles were placed into 1 of 5 categories: phenotyping/endotyping (n = 12), radiological diagnostics (n = 42), prognostication (n = 10), non-radiological diagnostics (n = 7), surgical assessment/planning (n = 8). Diagnostic or prognostic utility of the AI algorithms were rated as excellent (n = 29), very good (n = 25), good (n = 7), sufficient (n = 1), bad (n = 2), or was not reported/not applicable (n = 15).

CONCLUSIONS

AI is experiencing an increasingly significant role in rhinology research. Articles are showing high rates of diagnostic accuracy and are being published at an almost exponential rate around the world. Utilizing AI in radiological diagnosis was the most published topic of research, however, AI in rhinology is still in its infancy and there are several topics yet to be thoroughly explored.

The potential for clinical application of automatic quantification of olfactory bulb volume in MRI scans using convolutional neural networks

The olfactory bulbs (OBs) play a key role in olfactory processing; their volume is important for diagnosis, prognosis and treatment of patients with olfactory loss. Until now, measurements of OB volumes have been limited to quantification of manually segmented OBs, which is a cumbersome task and makes evaluation of OB volumes in large scale clinical studies infeasible. Hence, the aim of this study was to evaluate the potential of our previously developed automatic OB segmentation method for application in clinical practice and to relate the results to clinical outcome measures. To evaluate utilization potential of the automatic segmentation method, three data sets containing MR scans of patients with olfactory loss were included. Dataset 1 (N = 66) and 3 (N = 181) were collected at the Smell and Taste Center in Ede (NL) on a 3 T scanner; dataset 2 (N = 42) was collected at the Smell and Taste Clinic in Dresden (DE) on a 1.5 T scanner. To define the reference standard, manual annotation of the OBs was performed in Dataset 1 and 2. OBs were segmented with a method that employs two consecutive convolutional neural networks (CNNs) that the first localize the OBs in an MRI scan and subsequently segment them. In Dataset 1 and 2, the method accurately segmented the OBs, resulting in a Dice coefficient above 0.7 and average symmetrical surface distance below 0.3 mm. Volumes determined from manual and automatic segmentations showed a strong correlation (Dataset 1: r = 0.79, p < 0.001; Dataset 2: r = 0.72, p = 0.004). In addition, the method was able to recognize the absence of an OB. In Dataset 3, OB volumes computed from automatic segmentations obtained with our method were related to clinical outcome measures, i.e. duration and etiology of olfactory loss, and olfactory ability. We found that OB volume was significantly related to age of the patient, duration and etiology of olfactory loss, and olfactory ability (F(5, 172) = 11.348, p < 0.001, R2 = 0.248). In conclusion, the results demonstrate that automatic segmentation of the OBs and subsequent computation of their volumes in MRI scans can be performed accurately and can be applied in clinical and research population studies. Automatic evaluation may lead to more insight in the role of OB volume in diagnosis, prognosis and treatment of olfactory loss.

Automatic Segmentation of the Olfactory Bulb

The olfactory bulb (OB) has an essential role in the human olfactory pathway. A change in olfactory function is associated with a change of OB volume. It has been shown to predict the prognosis of olfactory loss and its volume is a biomarker for various neurodegenerative diseases, such as Alzheimer’s disease. Thus far, obtaining an OB volume for research purposes has been performed by manual segmentation alone; a very time-consuming and highly rater-biased process. As such, this process dramatically reduces the ability to produce fair and reliable comparisons between studies, as well as the processing of large datasets. Our study aims to solve this by proposing a novel methodological framework for the unbiased measurement of OB volume. In this paper, we present a fully automated tool that successfully performs such a task, accurately and quickly. In order to develop a stable and versatile algorithm and to train the neural network, we used four datasets consisting of whole-brain T1 and high-resolution T2 MRI scans, as well as the corresponding clinical information of the subject’s smelling ability. One dataset contained data of patients suffering from anosmia or hyposmia (N = 79), and the other three datasets contained data of healthy controls (N = 91). First, the manual segmentation labels of the OBs were created by two experienced raters, independently and blinded. The algorithm consisted of the following four different steps: (1) multimodal data co-registration of whole-brain T1 images and T2 images, (2) template-based localization of OBs, (3) bounding box construction, and lastly, (4) segmentation of the OB using a 3D-U-Net. The results from the automated segmentation algorithm were tested on previously unseen data, achieving a mean dice coefficient (DC) of 0.77 ± 0.05, which is remarkably convergent with the inter-rater DC of 0.79 ± 0.08 estimated for the same cohort. Additionally, the symmetric surface distance (ASSD) was 0.43 ± 0.10. Furthermore, the segmentations produced using our algorithm were manually rated by an independent blinded rater and have reached an equivalent rating score of 5.95 ± 0.87 compared to a rating score of 6.23 ± 0.87 for the first rater’s segmentation and 5.92 ± 0.81 for the second rater’s manual segmentation. Taken together, these results support the success of our tool in producing automatic fast (3–5 min per subject) and reliable segmentations of the OB, with virtually matching accuracy with the current gold standard technique for OB segmentation. In conclusion, we present a newly developed ready-to-use tool that can perform the segmentation of OBs based on multimodal data consisting of T1 whole-brain images and T2 coronal high-resolution images. The accuracy of the segmentations predicted by the algorithm matches the manual segmentations made by two well-experienced raters. This method holds potential for immediate implementation in clinical practice. Furthermore, its ability to perform quick and accurate processing of large datasets may provide a valuable contribution to advancing our knowledge of the olfactory system, in health and disease. Specifically, our framework may integrate the use of olfactory bulb volume (OBV) measurements for the diagnosis and treatment of olfactory loss and improve the prognosis and treatment options of olfactory dysfunctions.