Deep Learning Automation of Kidney, Liver, and Spleen Segmentation for Organ Volume Measurements in Autosomal Dominant Polycystic Kidney Disease

SwinDAF3D: Pyramid Swin Transformers with Deep Attentive Features for Automated Finger Joint Segmentation in 3D Ultrasound Images for Rheumatoid Arthritis Assessment

Rheumatoid arthritis (RA) is a chronic autoimmune disease that can cause severe joint damage and functional impairment. Ultrasound imaging has shown promise in providing real-time assessment of synovium inflammation associated with the early stages of RA. Accurate segmentation of the synovium region and quantification of inflammation-specific imaging biomarkers are crucial for assessing and grading RA. However, automatic segmentation of the synovium in 3D ultrasound is challenging due to ambiguous boundaries, variability in synovium shape, and inhomogeneous intensity distribution. In this work, we introduce a novel network architecture, Swin Transformers with Deep Attentive Features for 3D segmentation (SwinDAF3D), which integrates Swin Transformers into a Deep Attentive Features framework. The developed architecture leverages the hierarchical structure and shifted windows of Swin Transformers to capture rich, multi-scale and attentive contextual information, improving the modeling of long-range dependencies and spatial hierarchies in 3D ultrasound images. In a six-fold cross-validation study with 3D ultrasound images of RA patients' finger joints (n = 72), our SwinDAF3D model achieved the highest performance with a Dice Score (DSC) of 0.838 ± 0.013, an Intersection over Union (IoU) of 0.719 ± 0.019, and Surface Dice Score (SDSC) of 0.852 ± 0.020, compared to 3D UNet (DSC: 0.742 ± 0.025; IoU: 0.589 ± 0.031; SDSC: 0.661 ± 0.029), DAF3D (DSC: 0.813 ± 0.017; IoU: 0.689 ± 0.022; SDSC: 0.817 ± 0.013), Swin UNETR (DSC: 0.808 ± 0.025; IoU: 0.678 ± 0.032; SDSC: 0.822 ± 0.039), UNETR++ (DSC: 0.810 ± 0.014; IoU: 0.684 ± 0.018; SDSC: 0.829 ± 0.027) and TransUNet (DSC: 0.818 ± 0.013; IoU: 0.692 ± 0.017; SDSC: 0.815 ± 0.016) models. This ablation study demonstrates the effectiveness of combining a Swin Transformers feature pyramid with a deep attention mechanism, improving the segmentation accuracy of the synovium in 3D ultrasound. This advancement shows great promise in enabling more efficient and standardized RA screening using ultrasound imaging.

Automated liver and spleen segmentation for MR elastography maps using U-Nets

To compare pretrained and trained U-Nets for liver and spleen segmentation in multifrequency magnetic resonance elastography (MRE) magnitude images for automated quantification of shear wave speed (SWS). Seventy-two healthy participants (34 ± 11 years; BMI, 23 ± 2 kg/m2; 51 men) underwent multifrequency MRE at 1.5T or 3T. Volumes of interest (VOIs) of liver and spleen were generated from MRE magnitude images with mixed T2-T2* image contrast and then transferred to SWS maps. Pretrained and trained 2D and 3D U-Nets were compared with ground truth values obtained by manual segmentation using correlation analysis, intraclass correlation coefficients (ICCs), and Dice scores. For both VOI and SWS values, pairwise comparison revealed no statistically significant difference between ground truth and pretrained and trained U-Nets (all p ≥ 0.95). There was a strong positive correlation for SWS between ground truth and U-Nets with R = 0.99 for liver and R = 0.81-0.84 for spleen. ICC was 0.99 for liver and 0.90-0.92 for spleen, indicating excellent agreement for liver and good agreement for spleen for all U-Nets investigated. Dice scores showed excellent segmentation performance for all networks with the 2D U-Net achieving slightly higher values for the liver (0.95) and spleen (0.90), though the differences between the three tested U-Nets were minimal. The excellent performance we found for automated liver and spleen segmentation when applying 2D and 3D U-Nets to MRE magnitude images suggests that fully automated quantification of MRE parameters within anatomical regions is feasible by leveraging the previously unexploited anatomical information conveyed in MRE magnitude images.

Model-Assisted Spleen Contouring for Assessing Splenomegaly in Myelofibrosis: A Fast and Reproducible Approach to Evaluate Progression and Treatment Response

Background/Objectives: Accurate and reproducible spleen volume measurements are essential for assessing treatment response and disease progression in myelofibrosis. This study evaluates techniques for measuring spleen volume on abdominal MRI. Methods: In 20 patients with bone marrow biopsy-proven myelofibrosis, 5 observers independently measured spleen volume on 3 abdominal MRI pulse sequences, 3D-spoiled gradient echo T1, axial single-shot fast spin echo (SSFSE) T2, and coronal SSFSE T2, using ellipsoidal approximation, manual contouring, and 3D nnU-Net model-assisted contouring comparing coefficients of variation. Changes in spleen volume were compared to all information to assess which measurement technique tracked disease progression with the greatest accuracy. Results: The coefficient of variation in spleen volume measurements averaging over 3 sequences was significantly lower for model-assisted contouring, 1.6% and manual contouring, 3.5%, compared to ellipsoidal estimation from 3 dimensions measured on axial and coronal T2 images, 15, p < 0.001. In 4 subjects with divergent treatment response predictions, model-assisted contouring was consistent with all information while ellipsoidal estimation was not. Manual contouring tracked similarly to model-assisted contouring but required more operator time. Conclusions: Model-assisted segmentations provide efficient and more reproducible spleen volume measurements compared to estimates of spleen volume from ellipsoidal approximations and improve objective determinations of clinical trial enrollment eligibility based upon spleen volume as well as assessments of treatment response.

Multiscale and multimodal evaluation of autosomal dominant polycystic kidney disease development

Autosomal Dominant Polycystic Kidney Disease (ADPKD) is the most prevalent kidney genetic disorder, producing structural abnormalities and impaired function. This research investigates its evolution on mouse models, utilizing a combination of histology imaging, Computed Tomography (CT) and Magnetic Resonance Imaging (MRI) to evaluate its progression thoroughly. ADPKD has been induced in mice via PKD2 gene knockout, followed by image acquisition at different stages. Histology data provides two-dimensional details, like the cystic area ratio, whereas CT and MRI facilitate three-dimensional temporal monitoring. Our approach allows to quantify the affected tissue at different disease stages through multiple quantitative metrics. A pivotal point is shown at approximately ten weeks after induction, marked by a swift acceleration in disease advancement, and leading to a notable increase in cyst formation. This multimodal strategy augments our comprehension of ADPKD dynamics and suggests the possibility of employing higher-resolution imaging in the future for more accurate volumetric analyses.

Improved predictions of total kidney volume growth rate in ADPKD using two-parameter least squares fitting

Mayo Imaging Classification (MIC) for predicting future kidney growth in autosomal dominant polycystic kidney disease (ADPKD) patients is calculated from a single MRI/CT scan assuming exponential kidney volume growth and height-adjusted total kidney volume at birth to be 150 mL/m. However, when multiple scans are available, how this information should be combined to improve prediction accuracy is unclear. Herein, we studied ADPKD subjects ( n = 36 ) with 8+ years imaging follow-up (mean = 11 years) to establish ground truth kidney growth trajectory. MIC annual kidney growth rate predictions were compared to ground truth as well as 1- and 2-parameter least squares fitting. The annualized mean absolute error in MIC for predicting total kidney volume growth rate was 2.1 % ± 2 % compared to 1.1 % ± 1 % ( p = 0.002 ) for a 2-parameter fit to the same exponential growth curve used for MIC when 4 measurements were available or 1.4 % ± 1 % ( p = 0.01 ) with 3 measurements averaging together with MIC. On univariate analysis, male sex ( p = 0.05 ) and PKD2 mutation ( p = 0.04 ) were associated with poorer MIC performance. In ADPKD patients with 3 or more CT/MRI scans, 2-parameter least squares fitting predicted kidney volume growth rate better than MIC, especially in males and with PKD2 mutations where MIC was less accurate.

Dynamic parametric MRI and deep learning: Unveiling renal pathophysiology through accurate kidney size quantification

Renal pathologies often manifest as alterations in kidney size, providing a valuable avenue for employing dynamic parametric MRI as a means to derive kidney size measurements for the diagnosis, treatment, and monitoring of renal disease. Furthermore, this approach holds significant potential in supporting MRI data-driven preclinical investigations into the intricate mechanisms underlying renal pathophysiology. The integration of deep learning algorithms is crucial in achieving rapid and precise segmentation of the kidney from temporally resolved parametric MRI, facilitating the use of kidney size as a meaningful (pre)clinical biomarker for renal disease. To explore this potential, we employed dynamic parametric T2 mapping of the kidney in rats in conjunction with a custom-tailored deep dilated U-Net (DDU-Net) architecture. The architecture was trained, validated, and tested on manually segmented ground truth kidney data, with benchmarking against an analytical segmentation model and a self-configuring no new U-Net. Subsequently, we applied our approach to in vivo longitudinal MRI data, incorporating interventions that emulate clinically relevant scenarios in rats. Our approach achieved high performance metrics, including a Dice coefficient of 0.98, coefficient of determination of 0.92, and a mean absolute percentage error of 1.1% compared with ground truth. The DDU-Net enabled automated and accurate quantification of acute changes in kidney size, such as aortic occlusion (-8% ± 1%), venous occlusion (5% ± 1%), furosemide administration (2% ± 1%), hypoxemia (-2% ± 1%), and contrast agent-induced acute kidney injury (11% ± 1%). This approach can potentially be instrumental for the development of dynamic parametric MRI-based tools for kidney disorders, offering unparalleled insights into renal pathophysiology.

Test Retest Reproducibility of Organ Volume Measurements in ADPKD Using 3D Multimodality Deep Learning

RATIONALE AND OBJECTIVES

Following autosomal dominant polycystic kidney disease (ADPKD) progression by measuring organ volumes requires low measurement variability. The objective of this study is to reduce organ volume measurement variability on MRI of ADPKD patients by utilizing all pulse sequences to obtain multiple measurements which allows outlier analysis to find errors and averaging to reduce variability.

MATERIALS AND METHODS

In order to make measurements on multiple pulse sequences practical, a 3D multi-modality multi-class segmentation model based on nnU-net was trained/validated using T1, T2, SSFP, DWI and CT from 413 subjects. Reproducibility was assessed with test-re-test methodology on ADPKD subjects (n = 19) scanned twice within a 3-week interval correcting outliers and averaging the measurements across all sequences. Absolute percent differences in organ volumes were compared to paired students t-test.

RESULTS

Dice similarlity coefficient > 97%, Jaccard Index > 0.94, mean surface distance < 1 mm and mean Hausdorff Distance < 2 cm for all three organs and all five sequences were found on internal (n = 25), external (n = 37) and test-re-test reproducibility assessment (38 scans in 19 subjects). When averaging volumes measured from five MRI sequences, the model automatically segmented kidneys with test-re-test reproducibility (percent absolute difference between exam 1 and exam 2) of 1.3% which was better than all five expert observers. It reliably stratified ADPKD into Mayo Imaging Classification (area under the curve=100%) compared to radiologist.

CONCLUSION

3D deep learning measures organ volumes on five MRI sequences leveraging the power of outlier analysis and averaging to achieve 1.3% total kidney test-re-test reproducibility.

Convolutional neural network-based kidney volume estimation from low-dose unenhanced computed tomography scans

PURPOSE

Kidney volume is important in the management of renal diseases. Unfortunately, the currently available, semi-automated kidney volume determination is time-consuming and prone to errors. Recent advances in its automation are promising but mostly require contrast-enhanced computed tomography (CT) scans. This study aimed at establishing an automated estimation of kidney volume in non-contrast, low-dose CT scans of patients with suspected urolithiasis.

METHODS

The kidney segmentation process was automated with 2D Convolutional Neural Network (CNN) models trained on manually segmented 2D transverse images extracted from low-dose, unenhanced CT scans of 210 patients. The models' segmentation accuracy was assessed using Dice Similarity Coefficient (DSC), for the overlap with manually-generated masks on a set of images not used in the training. Next, the models were applied to 22 previously unseen cases to segment kidney regions. The volume of each kidney was calculated from the product of voxel number and their volume in each segmented mask. Kidney volume results were then validated against results semi-automatically obtained by radiologists.

RESULTS

The CNN-enabled kidney volume estimation took a mean of 32 s for both kidneys in a CT scan with an average of 1026 slices. The DSC was 0.91 and 0.86 and for left and right kidneys, respectively. Inter-rater variability had consistencies of ICC = 0.89 (right), 0.92 (left), and absolute agreements of ICC = 0.89 (right), 0.93 (left) between the CNN-enabled and semi-automated volume estimations.

CONCLUSION

In our work, we demonstrated that CNN-enabled kidney volume estimation is feasible and highly reproducible in low-dose, non-enhanced CT scans. Automatic segmentation can thereby quantitatively enhance radiological reports.

The utility of automatic segmentation of kidney MRI in chronic kidney disease using a 3D convolutional neural network

We developed a 3D convolutional neural network (CNN)-based automatic kidney segmentation method for patients with chronic kidney disease (CKD) using MRI Dixon-based T1-weighted in-phase (IP)/opposed-phase (OP)/water-only (WO) images. The dataset comprised 100 participants with renal dysfunction (RD; eGFR < 45 mL/min/1.73 m2) and 70 without (non-RD; eGFR ≥ 45 mL/min/1.73 m2). The model was applied to the right, left, and both kidneys; it was first evaluated on the non-RD group data and subsequently on the combined data of the RD and non-RD groups. For bilateral kidney segmentation of the non-RD group, the best performance was obtained when using IP image, with a Dice score of 0.902 ± 0.034, average surface distance of 1.46 ± 0.75 mm, and a difference of - 27 ± 21 mL between ground-truth and automatically computed volume. Slightly worse results were obtained for the combined data of the RD and non-RD groups and for unilateral kidney segmentation, particularly when segmenting the right kidney from the OP images. Our 3D CNN-assisted automatic segmentation tools can be utilized in future studies on total kidney volume measurements and various image analyses of a large number of patients with CKD.

Size Matters: How to Characterize ADPKD Severity by Measuring Total Kidney Volume

Following patients with Autosomal Dominant Polycystic Kidney Disease (ADPKD) has been challenging because serum biomarkers such as creatinine often remain normal until relatively late in the disease [...].

Automatic segmentation of large-scale CT image datasets for detailed body composition analysis

BACKGROUND

Body composition (BC) is an important factor in determining the risk of type 2-diabetes and cardiovascular disease. Computed tomography (CT) is a useful imaging technique for studying BC, however manual segmentation of CT images is time-consuming and subjective. The purpose of this study is to develop and evaluate fully automated segmentation techniques applicable to a 3-slice CT imaging protocol, consisting of single slices at the level of the liver, abdomen, and thigh, allowing detailed analysis of numerous tissues and organs.

METHODS

The study used more than 4000 CT subjects acquired from the large-scale SCAPIS and IGT cohort to train and evaluate four convolutional neural network based architectures: ResUNET, UNET++, Ghost-UNET, and the proposed Ghost-UNET++. The segmentation techniques were developed and evaluated for automated segmentation of the liver, spleen, skeletal muscle, bone marrow, cortical bone, and various adipose tissue depots, including visceral (VAT), intraperitoneal (IPAT), retroperitoneal (RPAT), subcutaneous (SAT), deep (DSAT), and superficial SAT (SSAT), as well as intermuscular adipose tissue (IMAT). The models were trained and validated for each target using tenfold cross-validation and test sets.

RESULTS

The Dice scores on cross validation in SCAPIS were: ResUNET 0.964 (0.909-0.996), UNET++ 0.981 (0.927-0.996), Ghost-UNET 0.961 (0.904-0.991), and Ghost-UNET++ 0.968 (0.910-0.994). All four models showed relatively strong results, however UNET++ had the best performance overall. Ghost-UNET++ performed competitively compared to UNET++ and showed a more computationally efficient approach.

CONCLUSION

Fully automated segmentation techniques can be successfully applied to a 3-slice CT imaging protocol to analyze multiple tissues and organs related to BC. The overall best performance was achieved by UNET++, against which Ghost-UNET++ showed competitive results based on a more computationally efficient approach. The use of fully automated segmentation methods can reduce analysis time and provide objective results in large-scale studies of BC.

Eldar Y. A Deep-Learning Approach to Spleen Volume Estimation in Patients with Gaucher Disease

The enlargement of the liver and spleen (hepatosplenomegaly) is a common manifestation of Gaucher disease (GD). An accurate estimation of the liver and spleen volumes in patients with GD, using imaging tools such as magnetic resonance imaging (MRI), is crucial for the baseline assessment and monitoring of the response to treatment. A commonly used method in clinical practice to estimate the spleen volume is the employment of a formula that uses the measurements of the craniocaudal length, diameter, and thickness of the spleen in MRI. However, the inaccuracy of this formula is significant, which, in turn, emphasizes the need for a more precise and reliable alternative. To this end, we employed deep-learning techniques, to achieve a more accurate spleen segmentation and, subsequently, calculate the resulting spleen volume with higher accuracy on a testing set cohort of 20 patients with GD. Our results indicate that the mean error obtained using the deep-learning approach to spleen volume estimation is 3.6 ± 2.7%, which is significantly lower than the common formula approach, which resulted in a mean error of 13.9 ± 9.6%. These findings suggest that the integration of deep-learning methods into the clinical routine practice for spleen volume calculation could lead to improved diagnostic and monitoring outcomes.

Clinical Quality Control of MRI Total Kidney Volume Measurements in Autosomal Dominant Polycystic Kidney Disease

Total kidney volume measured on MRI is an important biomarker for assessing the progression of autosomal dominant polycystic kidney disease and response to treatment. However, we have noticed that there can be substantial differences in the kidney volume measurements obtained from the various pulse sequences commonly included in an MRI exam. Here we examine kidney volume measurement variability among five commonly acquired MRI pulse sequences in abdominal MRI exams in 105 patients with ADPKD. Right and left kidney volumes were independently measured by three expert observers using model-assisted segmentation for axial T2, coronal T2, axial single-shot fast spin echo (SSFP), coronal SSFP, and axial 3D T1 images obtained on a single MRI from ADPKD patients. Outlier measurements were analyzed for data acquisition errors. Most of the outlier values (88%) were due to breathing during scanning causing slice misregistration with gaps or duplication of imaging slices (n = 35), slice misregistration from using multiple breath holds during acquisition (n = 25), composing of two overlapping acquisitions (n = 17), or kidneys not entirely within the field of view (n = 4). After excluding outlier measurements, the coefficient of variation among the five measurements decreased from 4.6% pre to 3.2%. Compared to the average of all sequences without errors, TKV measured on axial and coronal T2 weighted imaging were 1.2% and 1.8% greater, axial SSFP was 0.4% greater, coronal SSFP was 1.7% lower and axial T1 was 1.5% lower than the mean, indicating intrinsic measurement biases related to the different MRI contrast mechanisms. In conclusion, MRI data acquisition errors are common but can be identified using outlier analysis and excluded to improve organ volume measurement consistency. Bias toward larger volume measurements on T2 sequences and smaller volumes on axial T1 sequences can also be mitigated by averaging data from all error-free sequences acquired.

Current progress in artificial intelligence-assisted medical image analysis for chronic kidney disease: A literature review

Chronic kidney disease (CKD) causes irreversible damage to kidney structure and function. Arising from various etiologies, risk factors for CKD include hypertension and diabetes. With a progressively increasing global prevalence, CKD is an important public health problem worldwide. Medical imaging has become an important diagnostic tool for CKD through the non-invasive identification of macroscopic renal structural abnormalities. Artificial intelligence (AI)-assisted medical imaging techniques aid clinicians in the analysis of characteristics that cannot be easily discriminated by the naked eye, providing valuable information for the identification and management of CKD. Recent studies have demonstrated the effectiveness of AI-assisted medical image analysis as a clinical support tool using radiomics- and deep learning-based AI algorithms for improving the early detection, pathological assessment, and prognostic evaluation of various forms of CKD, including autosomal dominant polycystic kidney disease. Herein, we provide an overview of the potential roles of AI-assisted medical image analysis for the diagnosis and management of CKD.

Feasibility of artificial intelligence-based decision supporting system in tolvaptan prescription for autosomal dominant polycystic kidney disease

PURPOSE

Total kidney volume (TKV) measurement is crucial for selecting treatment candidates in autosomal dominant polycystic kidney disease (ADPKD). We developed and investigated the performance of fully-automated 3D-volumetry model and applied it to software as a service (SaaS) for clinical support on tolvaptan prescription in ADPKD patients.

MATERIALS AND METHODS

Computed tomography scans of ADPKD patients taken between January 2000 and June 2022 were acquired from seven institutions. The quality of the images was manually reviewed in advance. The acquired dataset was split into training, validation, and test datasets at a ratio of 8.5:1:0.5. Convolutional, neural network-based automatic segmentation model was trained to obtain 3D segment mask for TKV measurement. The algorithm consisted of three steps: data preprocessing, ADPKD area extraction, and post-processing. After performance validation with the Dice score, 3D-volumetry model was applied to SaaS which is based on Mayo imaging classification for ADPKD.

RESULTS

A total of 753 cases with 95,117 slices were included. The differences between the ground-truth ADPKD kidney mask and the predicted ADPKD kidney mask were negligible, with intersection over union >0.95. The post-process filter successfully removed false alarms. The test-set performance was homogeneously equal and the Dice score of the model was 0.971; after post-processing, it improved to 0.979. The SaaS calculated TKV from uploaded Digital Imaging and Communications in Medicine images and classified patients according to height-adjusted TKV for age.

CONCLUSIONS

Our artificial intelligence-3D volumetry model exhibited effective, feasible, and non-inferior performance compared with that of human experts and successfully predicted the rapid ADPKD progressor.