Dose independent characterization of renal stones by means of dual energy computed tomography and machine learning: an ex-vivo study

Surgical Artificial Intelligence: Endourology

Endourology is ripe with information that includes patient factors, laboratory tests, outcomes, and visual data, which is becoming increasingly complex to assess. Artificial intelligence (AI) has the potential to explore and define these relationships; however, humans might not be involved in the input, analysis, or even determining the methods of analysis. Herein, the authors present the current state of AI in endourology and highlight the need for urologists to share their proposed AI solutions for reproducibility outside of their institutions and prepare themselves to properly critique this new technology.

Dual-energy CT revisited: a focused review of clinical use cases

BACKGROUND

 Dual-energy CT (DECT) has been available for more than 15 years and has undergone continuous technical development and refinement. Recently, the first photon-counting CT scanner became clinically available and has the potential to further expand the possibilities of spectral imaging. Numerous studies on DECT have been published since its creation, highlighting the clinical applications of the various reconstructions enabled by DECT.

METHODS

 The aim of this focused review is to succinctly summarize basic principles and available technical concepts of DECT and to discuss established applications relevant to the daily clinical routine.

RESULTS/CONCLUSION

 DECT is instrumental for a broad variety of clinical use cases. While some DECT applications can enhance day-to-day clinical practice, others are still subject to broad-scale validation and should therefore be handled with restraint in the clinical routine.

KEY POINTS

  · Virtual monoenergetic images, virtual unenhanced images, and iodine maps are the most well-investigated and relevant dual-energy CT reconstructions for clinical application.. · Low-keV virtual monoenergetic images (VMIs) yield superior image and iodine contrast, which can be leveraged for improved vessel assessment and lesion conspicuity, or to reduce contrast media or radiation dose. VMIs at intermediate energies can serve as a replacement for conventional grey-scale images. VMIs at high keV enable efficient artifact reduction, which can be further optimized in combination with dedicated metal artifact reduction algorithms.. · Iodine maps and virtual unenhanced images can improve lesion detection in oncologic imaging and enable lesion assessment in monophasic CT examinations, which may allow a reduction of correlative and follow-up imaging..

Dual-energy CT kidney stone characterization-can diagnostic accuracy be achieved at low radiation dose?

OBJECTIVES

To assess the accuracy of low-dose dual-energy computed tomography (DECT) to differentiate uric acid from non-uric acid kidney stones in two generations of dual-source DECT with stone composition analysis as the reference standard.

METHODS

Patients who received a low-dose unenhanced DECT for the detection or follow-up of urolithiasis and stone extraction with stone composition analysis between January 2020 and January 2022 were retrospectively included. Collected stones were characterized using X-ray diffraction. Size, volume, CT attenuation, and stone characterization were assessed using DECT post-processing software. Characterization as uric acid or non-uric acid stones was compared to stone composition analysis as the reference standard. Sensitivity, specificity, and accuracy of stone classification were computed. Dose length product (DLP) and effective dose served as radiation dose estimates.

RESULTS

A total of 227 stones in 203 patients were analyzed. Stone composition analysis identified 15 uric acid and 212 non-uric acid stones. Mean size and volume were 4.7 mm × 2.8 mm and 114 mm3, respectively. CT attenuation of uric acid stones was significantly lower as compared to non-uric acid stones (p < 0.001). Two hundred twenty-five of 227 kidney stones were correctly classified by DECT. Pooled sensitivity, specificity, and accuracy were 1.0 (95%CI: 0.97, 1.00), 0.93 (95%CI: 0.68, 1.00), and 0.99 (95%CI: 0.97, 1.00), respectively. Eighty-two of 84 stones with a diameter of  ≤ 3 mm were correctly classified. Mean DLP was 162 ± 57 mGy*cm and effective dose was 2.43 ± 0.86 mSv.

CONCLUSIONS

Low-dose dual-source DECT demonstrated high accuracy to discriminate uric acid from non-uric acid stones even at small stone sizes.

KEY POINTS

• Two hundred twenty-five of 227 stones were correctly classified as uric acid vs. non-uric acid stones by low-dose dual-energy CT with stone composition analysis as the reference standard. • Pooled sensitivity, specificity, and accuracy for stone characterization were 1.0, 0.93, and 0.99, respectively. • Low-dose dual-energy CT for stone characterization was feasible in the majority of small stones  < 3 mm.

Transforming urinary stone disease management by artificial intelligence-based methods: A comprehensive review

Objective

To provide a comprehensive review on the existing research and evidence regarding artificial intelligence (AI) applications in the assessment and management of urinary stone disease.

Methods

A comprehensive literature review was performed using PubMed, Scopus, and Google Scholar databases to identify publications about innovative concepts or supporting applications of AI in the improvement of every medical procedure relating to stone disease. The terms ''endourology'', ''artificial intelligence'', ''machine learning'', and ''urolithiasis'' were used for searching eligible reports, while review articles, articles referring to automated procedures without AI application, and editorial comments were excluded from the final set of publications. The search was conducted from January 2000 to September 2023 and included manuscripts in the English language.

Results

A total of 69 studies were identified. The main subjects were related to the detection of urinary stones, the prediction of the outcome of conservative or operative management, the optimization of operative procedures, and the elucidation of the relation of urinary stone chemistry with various factors.

Conclusion

AI represents a useful tool that provides urologists with numerous amenities, which explains the fact that it has gained ground in the pursuit of stone disease management perfection. The effectiveness of diagnosis and therapy can be increased by using it as an alternative or adjunct to the already existing data. However, little is known concerning the potential of this vast field. Electronic patient records, containing big data, offer AI the opportunity to develop and analyze more precise and efficient diagnostic and treatment algorithms. Nevertheless, the existing applications are not generalizable in real-life practice, and high-quality studies are needed to establish the integration of AI in the management of urinary stone disease.

The technological future of percutaneous nephrolithotomy: a Young Academic Urologists Endourology and Urolithiasis Working Group update

PURPOSE OF REVIEW

With advancements in surgical technology along with procedural techniques, this article throws light on the latest developments and applications of artificial intelligence (AI), extended reality, 3D (three-dimensional) printing and robotics in percutaneous nephrolithotomy (PCNL).

RECENT FINDINGS

This review highlights the applications of AI in PCNL over the past 2 years. Mostly studies have been reported on development of machine learning (ML) based predicting models and identification of stone composition using deep learning convolutional neural network (DL-CNN). But owing to the complexity of the models and lack of generalizability, it is still not incorporated in the routine clinical practice. Extended reality based simulation and training models have enabled trainees to enhance their skills and shorten the learning curve. Similar advantages have been reported with the use of 3D printed models when used to train young and novice endourologists to improve their skills in percutaneous access (PCA). Applications of robotics in PCNL look promising but are still in nascent stages.

SUMMARY

Future research on PCNL should focus more on generalizability and adaptability of technological advancements in terms of training and improvement of patient outcomes.

Theranostic roles of machine learning in clinical management of kidney stone disease

Kidney stone disease (KSD) is a common illness caused by deposition of solid minerals formed inside the kidney. The disease prevalence varies, based on sociodemographic, lifestyle, dietary, genetic, gender, age, environmental and climatic factors, but has been continuously increasing worldwide. KSD is a highly recurrent disease, and the recurrence rate is about 11% within two years after the stone removal. Recently, machine learning has been widely used for KSD detection, stone type prediction, determination of appropriate treatment modality and prediction of therapeutic outcome. This review provides a brief overview of KSD and discusses how machine learning can be applied to diagnostics, therapeutics and prognostics in clinical management of KSD for better therapeutic outcome.

Clinical Applications of Machine Learning for Urolithiasis and Benign Prostatic Hyperplasia: A Systematic Review

INTRODUCTION

Previous systematic reviews related to machine learning (ML) in urology often overlooked the literature related to endourology. Therefore, we aim to conduct a more focused systematic review examining the use of ML algorithms for benign prostatic hyperplasia (BPH) or urolithiasis. In addition, we are the first group to evaluate these articles using the STREAM-URO framework.

METHODS

Searches of MEDLINE, Embase, and the Cochrane CENTRAL databases were conducted from inception through July 12, 2021. Keywords included those related to ML, endourology, urolithiasis, and BPH. Two reviewers screened the citations that were eligible for title, abstract and full-text screening, with conflicts resolved by a third reviewer. Two reviewers extracted information from the studies, with discrepancies resolved by a third reviewer. The data collected was then qualitatively synthesized by consensus. Two reviewers evaluated each article according to the STREAM-URO checklist with discrepancies resolved by a third reviewer.

RESULTS

After identifying 459 unique citations, 63 articles were retained for data extraction. Most articles consisted of tabular (n=32) and computer vision (n=23) tasks. The two most common problem types were classification (n=40) and regression (n=12). In general, most studies utilized neural networks as their ML algorithm (n=36). Among the 63 studies retrieved, 58 were related to urolithiasis and five focused on BPH. The urolithiasis studies were designed for outcome prediction (n=20), stone classification (n=18), diagnostics (n=17), and therapeutics (n=3). The BPH studies were designed for outcome prediction (n=2), diagnostics (n=2), and therapeutics (n=1). On average, the urolithiasis and BPH articles met 13.8 (SD 2.6), and 13.4 (4.1) of the 26 STREAM-URO framework criteria, respectively.

CONCLUSIONS

The majority of the retrieved studies successfully helped with outcome prediction, diagnostics, and therapeutics for both urolithiasis and BPH. While ML shows great promise in improving patient care, it is important to adhere to the recently developed STREAM-URO framework to ensure the development of high-quality ML studies.

Machine Learning for Renal Pathologies: An Updated Survey

Within the literature concerning modern machine learning techniques applied to the medical field, there is a growing interest in the application of these technologies to the nephrological area, especially regarding the study of renal pathologies, because they are very common and widespread in our society, afflicting a high percentage of the population and leading to various complications, up to death in some cases. For these reasons, the authors have considered it appropriate to collect, using one of the major bibliographic databases available, and analyze the studies carried out until February 2022 on the use of machine learning techniques in the nephrological field, grouping them according to the addressed pathologies: renal masses, acute kidney injury, chronic kidney disease, kidney stone, glomerular disease, kidney transplant, and others less widespread. Of a total of 224 studies, 59 were analyzed according to inclusion and exclusion criteria in this review, considering the method used and the type of data available. Based on the study conducted, it is possible to see a growing trend and interest in the use of machine learning applications in nephrology, becoming an additional tool for physicians, which can enable them to make more accurate and faster diagnoses, although there remains a major limitation given the difficulty in creating public databases that can be used by the scientific community to corroborate and eventually make a positive contribution in this area.

An improved iterative neural network for high-quality image-domain material decomposition in dual-energy CT

PURPOSE

Dual-energy computed tomography (DECT) has been widely used in many applications that need material decomposition. Image-domain methods directly decompose material images from high- and low-energy attenuation images, and thus, are susceptible to noise and artifacts on attenuation images. The purpose of this study is to develop an improved iterative neural network (INN) for high-quality image-domain material decomposition in DECT, and to study its properties.

METHODS

We propose a new INN architecture for DECT material decomposition. The proposed INN architecture uses distinct cross-material convolutional neural network (CNN) in image refining modules, and uses image decomposition physics in image reconstruction modules. The distinct cross-material CNN refiners incorporate distinct encoding-decoding filters and cross-material model that captures correlations between different materials. We study the distinct cross-material CNN refiner with patch-based reformulation and tight-frame condition.

RESULTS

Numerical experiments with extended cardiac-torso phantom and clinical data show that the proposed INN significantly improves the image quality over several image-domain material decomposition methods, including a conventional model-based image decomposition (MBID) method using an edge-preserving regularizer, a recent MBID method using pre-learned material-wise sparsifying transforms, and a noniterative deep CNN method. Our study with patch-based reformulations reveals that learned filters of distinct cross-material CNN refiners can approximately satisfy the tight-frame condition.

CONCLUSIONS

The proposed INN architecture achieves high-quality material decompositions using iteration-wise refiners that exploit cross-material properties between different material images with distinct encoding-decoding filters. Our tight-frame study implies that cross-material CNN refiners in the proposed INN architecture are useful for noise suppression and signal restoration. This article is protected by copyright. All rights reserved.

Machine Learning Prediction of Kidney Stone Composition Using Electronic Health Record-Derived Features

Objectives: To assess the accuracy of machine learning models in predicting kidney stone composition using variables extracted from the electronic health record (EHR). Materials and Methods: We identified kidney stone patients (n = 1296) with both stone composition and 24-hour (24H) urine testing. We trained machine learning models (XGBoost [XG] and logistic regression [LR]) to predict stone composition using 24H urine data and EHR-derived demographic and comorbidity data. Models predicted either binary (calcium vs noncalcium stone) or multiclass (calcium oxalate, uric acid, hydroxyapatite, or other) stone types. We evaluated performance using area under the receiver operating curve (ROC-AUC) and accuracy and identified predictors for each task. Results: For discriminating binary stone composition, XG outperformed LR with higher accuracy (91% vs 71%) with ROC-AUC of 0.80 for both models. Top predictors used by these models were supersaturations of uric acid and calcium phosphate, and urinary ammonium. For multiclass classification, LR outperformed XG with higher accuracy (0.64 vs 0.56) and ROC-AUC (0.79 vs 0.59), and urine pH had the highest predictive utility. Overall, 24H urine analyte data contributed more to the models' predictions of stone composition than EHR-derived variables. Conclusion: Machine learning models can predict calcium stone composition. LR outperforms XG in multiclass stone classification. Demographic and comorbidity data are predictive of stone composition; however, including 24H urine data improves performance. Further optimization of performance could lead to earlier directed medical therapy for kidney stone patients.

Artificial Intelligence Applications in Urology: Reporting Standards to Achieve Fluency for Urologists

The growth and adoption of artificial intelligence has led to impressive results in urology. As artificial intelligence grows more ubiquitous, it is important to establish artificial intelligence literacy in the workforce. To this end, we present a narrative review of the literature of artificial intelligence and machine learning in urology and propose a checklist of reporting standards to improve readability and evaluate the current state of the literature. The listed article demonstrated heterogeneous reporting of methodologies and outcomes, limiting generalizability of research. We hope that this review serves as a foundation for future evaluation of medical research in artificial intelligence.

Artificial intelligence in endourology: emerging technology for individualized care

PURPOSE OF REVIEW

Artificial intelligence in medicine has allowed for efficient processing of large datasets to perform cognitive tasks that facilitate clinical decision-making, and it is an emerging area of research. This review aims to highlight the most pertinent and recent research in artificial intelligence in endourology, where it has been used to optimize stone diagnosis, support decision-making regarding management, predict stone recurrence, and provide new tools for bioinformatics research within endourology.

RECENT FINDINGS

Artificial neural networks (ANN) and machine learning approaches have demonstrated high accuracy in predicting stone diagnoses, stone composition, and outcomes of spontaneous stone passage, shockwave lithotripsy (SWL), or percutaneous nephrolithotomy (PCNL); some of these models outperform more traditional predictive models and existing nomograms. In addition, these approaches have been used to predict stone recurrence, quality of life scores, and provide novel methods of mining the electronic medical record for research.

SUMMARY

Artificial intelligence can be used to enhance existing approaches to stone diagnosis, management, and prevention to provide a more individualized approach to endourologic care. Moreover, it may support an emerging area of bioinformatics research within endourology. However, despite high accuracy, many of the published algorithms lack external validity and require further study before they are more widely adopted.

The Ascent of Artificial Intelligence in Endourology: a Systematic Review Over the Last 2 Decades

Purpose of Review

To highlight and review the application of artificial intelligence (AI) in kidney stone disease (KSD) for diagnostics, predicting procedural outcomes, stone passage, and recurrence rates. The systematic review was performed according to the Preferred Reporting Items for Systematic Reviews and Meta-analyses (PRISMA) checklist.

Recent Findings

This review discusses the newer advancements in AI-driven management strategies, which holds great promise to provide an essential step for personalized patient care and improved decision making. AI has been used in all areas of KSD including diagnosis, for predicting treatment suitability and success, basic science, quality of life (QOL), and recurrence of stone disease. However, it is still a research-based tool and is not used universally in clinical practice. This could be due to a lack of data infrastructure needed to train the algorithms, wider applicability in all groups of patients, complexity of its use and cost involved with it.

Summary

The constantly evolving literature and future research should focus more on QOL and the cost of KSD treatment and develop evidence-based AI algorithms that can be used universally, to guide urologists in the management of stone disease.

Value of artificial intelligence model based on unenhanced computed tomography of urinary tract for preoperative prediction of calcium oxalate monohydrate stones in vivo

Background

Urolithiasis is a global disease with a high incidence and recurrence rate, and stone composition is closely related to the choice of treatment and preventive measures. Calcium oxalate monohydrate (COM) is the most common in clinical practice, which is hard and difficult to fragment. Preoperative identification of its components and selection of effective surgical methods can reduce the risk of patients having a second operation. Methods that can be used for stone composition analysis include infrared spectroscopy, X-ray diffraction, and polarized light microscopy, but they are all performed on stone specimens in vitro after surgery. This study aimed to design and develop an artificial intelligence (AI) model based on unenhanced computed tomography (CT) images of the urinary tract, and to investigate the predictive ability of the model for COM stones in vivo preoperatively, so as to provide surgeons with more accurate diagnostic information.

Methods

Preoperative unenhanced CT images of patients with urinary calculi whose components were determined by infrared spectroscopy in a single center were retrospectively analyzed, including 337 cases of COM stones and 170 of non-COM stones. All images were manually segmented and the image features were extracted, and randomly divided into the training and testing sets in a ratio of 7:3. The least absolute shrinkage and selection operation algorithm (LASSO) was used to construct the AI model, and classification of the training and testing sets was carried out.

Results

A total of 1,218 radiomics imaging features were extracted, and 8 features with non-zero coefficients were finally obtained. The sensitivity, specificity and accuracy of the AI model were 90.5%, 84.3% and 88.5% for the training set, and 90.1%, 84.3% and 88.3% for the testing set. The area under the curve was 0.935 for the training set and 0.933 for the testing set.

Conclusions

The AI model based on unenhanced CT images of the urinary tract can predict COM and non-COM stones in vivo preoperatively, and the model has high sensitivity, specificity and accuracy.

Single-energy CT predicts uric acid stones with accuracy comparable to dual-energy CT-prospective validation of a quantitative method

OBJECTIVES

To prospectively validate three quantitative single-energy CT (SE-CT) methods for classifying uric acid (UA) and non-uric acid (non-UA) stones.

METHODS

Between September 2018 and September 2019, 116 study participants were prospectively included in the study if they had at least one 3-20-mm urinary stone on an initial urinary tract SE-CT scan. An additional dual-energy CT (DE-CT) scan was performed, limited to the stone of interest. Additionally, to include a sufficient number of UA stones, eight participants with confirmed UA stone on DE-CT were retrospectively included. The SE-CT stone features used in the prediction models were (1) maximum attenuation (maxHU) and (2) the peak point Laplacian (ppLapl) calculated at the position in the stone with maxHU. Two prediction models were previously published methods (ppLapl-maxHU and maxHU) and the third was derived from the previous results based on the k-nearest neighbors (kNN) algorithm (kNN-ppLapl-maxHU). The three methods were evaluated on this new independent stone dataset. The reference standard was the CT vendor's DE-CT application for kidney stones.

RESULTS

Altogether 124 participants (59 ± 14 years, 91 men) with 106 non-UA and 37 UA stones were evaluated. For classification of UA and non-UA stones, the sensitivity, specificity, and accuracy were 100% (37/37), 97% (103/106), and 98% (140/143), respectively, for kNN-ppLapl-maxHU; 95% (35/37), 98% (104/106), and 97% (139/143) for ppLapl-maxHU; and 92% (34/37), 94% (100/106), and 94% (134/143) for maxHU.

CONCLUSION

A quantitative SE-CT method (kNN-ppLapl-maxHU) can classify UA stones with accuracy comparable to DE-CT.

KEY POINTS

• Single-energy CT is the first-line diagnostic tool for suspected renal colic. • A single-energy CT method based on the internal urinary stone attenuation distribution can classify urinary stones into uric acid and non-uric acid stones with high accuracy. • This immensely increases the availability of in vivo stone analysis.