Diagnostic performance of endoscopic ultrasound-artificial intelligence using deep learning analysis of gallbladder polypoid lesions

Advances and current research status of early diagnosis for gallbladder cancer

Gallbladder cancer (GBC) is the most common malignant tumor in the biliary system, characterized by high malignancy, aggressiveness, and poor prognosis. Early diagnosis holds paramount importance in ameliorating therapeutic outcomes. Presently, the clinical diagnosis of GBC primarily relies on clinical-radiological-pathological approach. However, there remains a potential for missed diagnosis and misdiagnose in the realm of clinical practice. We firstly analyzed the blood-based biomarkers, such as carcinoembryonic antigen and carbohydrate antigen 19-9. Subsequently, we evaluated the diagnostic performance of various imaging modalities, including ultrasound (US), endoscopic ultrasound (EUS), computed tomography (CT), magnetic resonance imaging (MRI), positron emission tomography/computed tomography (PET/CT) and pathological examination, emphasizing their strengths and limitations in detecting early-stage GBC. Furthermore, we explored the potential of emerging technologies, particularly artificial intelligence (AI) and liquid biopsy, to revolutionize GBC diagnosis. AI algorithms have demonstrated improved image analysis capabilities, while liquid biopsy offers the promise of non-invasive and real-time monitoring. However, the translation of these advancements into clinical practice necessitates further validation and standardization. The review highlighted the advantages and limitations of current diagnostic approaches and underscored the need for innovative strategies to enhance diagnostic accuracy of GBC. In addition, we emphasized the importance of multidisciplinary collaboration to improve early diagnosis of GBC and ultimately patient outcomes. This review endeavoured to impart fresh perspectives and insights into the early diagnosis of GBC.

WFUMB Commentary Paper on Artificial intelligence in Medical Ultrasound Imaging

Artificial intelligence (AI) is defined as the theory and development of computer systems able to perform tasks normally associated with human intelligence. At present, AI has been widely used in a variety of ultrasound tasks, including in point-of-care ultrasound, echocardiography, and various diseases of different organs. However, the characteristics of ultrasound, compared to other imaging modalities, such as computed tomography (CT) and magnetic resonance imaging (MRI), poses significant additional challenges to AI. Application of AI can not only reduce variability during ultrasound image acquisition, but can standardize these interpretations and identify patterns that escape the human eye and brain. These advances have enabled greater innovations in ultrasound AI applications that can be applied to a variety of clinical settings and disease states. Therefore, The World Federation of Ultrasound in Medicine and Biology (WFUMB) is addressing the topic with a brief and practical overview of current and potential future AI applications in medical ultrasound, as well as discuss some current limitations and future challenges to AI implementation.

GBCHV an advanced deep learning anatomy aware model for accurate classification of gallbladder cancer utilizing ultrasound images

This study introduces a novel deep learning approach aimed at accurately classifying Gallbladder Cancer (GBC) into benign, malignant, and normal categories using ultrasound images from the challenging GBC USG (GBCU) dataset. The proposed methodology enhances image quality and specifies gallbladder wall boundaries by employing sophisticated image processing techniques like median filtering and contrast-limited adaptive histogram equalization. Unlike traditional convolutional neural networks, which struggle with complex spatial patterns, the proposed transformer-based model, GBC Horizontal-Vertical Transformer (GBCHV), incorporates a GBCHV-Trans block with self-attention mechanisms. In order to make the model anatomy-aware, the square-shaped input patches of the transformer are transformed into horizontal and vertical strips to obtain distinctive spatial relationships within gallbladder tissues. The novelty of this model lies in its anatomy-aware mechanism, which employs horizontal-vertical strip transformations to depict spatial relationships and complex anatomical features of the gallbladder more accurately. The proposed model achieved an overall diagnostic accuracy of 96.21% by performing an ablation study. A performance comparison between the proposed model and seven transfer learning models is further conducted, where the proposed model consistently outperformed the transfer learning models, showcasing its superior accuracy and robustness. Moreover, the decision-making process of the proposed model is further explained visually through the utilization of Gradient-weighted Class Activation Mapping (Grad-CAM). With the integration of advanced deep learning and image processing techniques, the GBCHV-Trans model offers a promising solution for precise and early-stage classification of GBC, surpassing conventional methods with superior accuracy and diagnostic efficacy.

Detection of Gallbladder Disease Types Using a Feature Engineering-Based Developed CBIR System

Background/Objectives: Early detection and diagnosis are important when treating gallbladder (GB) diseases. Poorer clinical outcomes and increased patient symptoms may result from any error or delay in diagnosis. Many signs and symptoms, especially those related to GB diseases with similar symptoms, may be unclear. Therefore, highly qualified medical professionals should interpret and understand ultrasound images. Considering that diagnosis via ultrasound imaging can be time- and labor-consuming, it may be challenging to finance and benefit from this service in remote locations. Methods: Today, artificial intelligence (AI) techniques ranging from machine learning (ML) to deep learning (DL), especially in large datasets, can help analysts using Content-Based Image Retrieval (CBIR) systems with the early diagnosis, treatment, and recognition of diseases, and then provide effective methods for a medical diagnosis. Results: The developed model is compared with two different textural and six different Convolutional Neural Network (CNN) models accepted in the literature-the developed model combines features obtained from three different pre-trained architectures for feature extraction. The cosine method was preferred as the similarity measurement metric. Conclusions: Our proposed CBIR model achieved successful results from six other different models. The AP value obtained in the proposed model is 0.94. This value shows that our CBIR-based model can be used to detect GB diseases.

Computer-aided cholelithiasis diagnosis using explainable convolutional neural network

Accurate and precise identification of cholelithiasis is essential for saving the lives of millions of people worldwide. Although several computer-aided cholelithiasis diagnosis approaches have been introduced in the literature, their use is limited because Convolutional Neural Network (CNN) models are black box in nature. Therefore, a novel approach for cholelithiasis classification using custom CNN with post-hoc model explanation is proposed. This paper presents multiple contributions. First, a custom CNN architecture is proposed to classify and predict cholelithiasis from ultrasound image. Second, a modified deep convolutional generative adversarial network is proposed to produce synthetic ultrasound images for better model generalization. Third, a hybrid visual explanation method is proposed by combining gradient-weighted class activation with local interpretable model agnostic explanation to generate a visual explanation using a heatmap. Fourth, an exhaustive performance analysis of the proposed approach on ultrasound images collected from three different Indian hospitals is presented to showcase its efficacy for computer-aided cholelithiasis diagnosis. Fifth, a team of radiologists evaluates and validates the prediction and respective visual explanations made using the proposed approach. The results reveal that the proposed cholelithiasis classification approach beats the performance of state-of-the-art pre-trained CNN and Vision Transformer models. The heatmap generated through the proposed hybrid explanation method offers detailed visual explanations to enhance transparency and trustworthiness in the medical domain.

Integrating artificial intelligence with endoscopic ultrasound in the early detection of bilio-pancreatic lesions: Current advances and future prospects

The integration of Artificial Intelligence (AI) in endoscopic ultrasound (EUS) represents a transformative advancement in the early detection and management of biliopancreatic lesions. This review highlights the current state of AI-enhanced EUS (AI-EUS) for diagnosing solid and cystic pancreatic lesions, as well as biliary diseases. AI-driven models, including machine learning (ML) and deep learning (DL), have shown significant improvements in diagnostic accuracy, particularly in distinguishing pancreatic ductal adenocarcinoma (PDAC) from benign conditions and in the characterization of pancreatic cystic neoplasms. Advanced algorithms, such as convolutional neural networks (CNNs), enable precise image analysis, real-time lesion classification, and integration with clinical and genomic data for personalized care. In biliary diseases, AI-assisted systems enhance bile duct visualization and streamline diagnostic workflows, minimizing operator dependency. Emerging applications, such as AI-guided EUS fine-needle aspiration (FNA) and biopsy (FNB), improve diagnostic yields while reducing errors. Despite these advancements, challenges remain, including data standardization, model interpretability, and ethical concerns regarding data privacy. Future developments aim to integrate multimodal imaging, real-time procedural support, and predictive analytics to further refine the diagnostic and therapeutic potential of AI-EUS. AI-driven innovation in EUS stands poised to revolutionize pancreatico-biliary diagnostics, facilitating earlier detection, enhancing precision, and paving the way for personalized medicine in gastrointestinal oncology and beyond.

Impact of Artificial Intelligence on Pancreaticobiliary Endoscopy

Pancreaticobiliary diseases can lead to significant morbidity and their diagnoses rely on imaging and endoscopy which are dependent on operator expertise. Artificial intelligence (AI) has seen a rapid uptake in the field of luminal endoscopy, such as polyp detection during colonoscopy. However, its use for pancreaticobiliary endoscopic modalities such as endoscopic ultrasound (EUS) and cholangioscopy remains scarce, with only few studies available. In this review, we delve into the current evidence, benefits, limitations, and future scope of AI technologies in pancreaticobiliary endoscopy.

TransEBUS: The interpretation of endobronchial ultrasound image using hybrid transformer for differentiating malignant and benign mediastinal lesions

The purpose of this study is to establish a deep learning automatic assistance diagnosis system for benign and malignant classification of mediastinal lesions in endobronchial ultrasound (EBUS) images. EBUS images are in the form of video and contain multiple imaging modes. Different imaging modes and different frames can reflect the different characteristics of lesions. Compared with previous studies, the proposed model can efficiently extract and integrate the spatiotemporal relationships between different modes and does not require manual selection of representative frames. In recent years, Vision Transformer has received much attention in the field of computer vision. Combined with convolutional neural networks, hybrid transformers can also perform well on small datasets. This study designed a novel deep learning architecture based on hybrid transformer called TransEBUS. By adding learnable parameters in the temporal dimension, TransEBUS was able to extract spatiotemporal features from insufficient data. In addition, we designed a two-stream module to integrate information from three different imaging modes of EBUS. Furthermore, we applied contrastive learning when training TransEBUS, enabling it to learn discriminative representation of benign and malignant mediastinal lesions. The results show that TransEBUS achieved a diagnostic accuracy of 82% and an area under the curve of 0.8812 in the test dataset, outperforming other methods. It also shows that several models can improve performance by incorporating two-stream module. Our proposed system has shown its potential to help physicians distinguishing benign and malignant mediastinal lesions, thereby ensuring the accuracy of EBUS examination.

Endoscopic diagnosis and management of gallbladder carcinoma in minimally invasive era: New needs, new models

Gallbladder cancer (GBC) is a rare and lethal malignancy; however, it represents the most common type of biliary tract cancer. Patients with GBC are often diagnosed at an advanced stage, thus, unfortunately, losing the opportunity for curative surgical intervention. This situation leads to lower quality of life and higher mortality rates. In recent years, the rapid development of endoscopic equipment and techniques has provided new avenues and possibilities for the early and minimally invasive diagnosis and treatment of GBC. This editorial comments on the article by Pavlidis et al. Building upon their work, we explore the new needs and corresponding models for managing GBC from the endoscopic diagnosis and treatment perspective.

Current and Emerging Applications of Artificial Intelligence (AI) in the Management of Pancreatobiliary (PB) disorders

PURPOSE OF REVIEW: In this review, we aim to summarize the existing literature and future directions on the use of artificial intelligence (AI) for the diagnosis and treatment of PB (pancreaticobiliary) disorders. RECENT FINDINGS: AI models have been developed to aid in the diagnosis and management of PB disorders such as pancreatic adenocarcinoma (PDAC), pancreatic neuroendocrine tumors (pNETs), acute pancreatitis, chronic pancreatitis, autoimmune pancreatitis, choledocholithiasis, indeterminate biliary strictures, cholangiocarcinoma and endoscopic procedures such as ERCP, EUS, and cholangioscopy. Recent studies have integrated radiological, endoscopic and pathological data to develop models to aid in better detection and prognostication of these disorders. AI is an indispensable proponent in the future practice of medicine. It has been extensively studied and approved for use in the detection of colonic polyps. AI models based on clinical, laboratory, and radiomics have been developed to aid in the diagnosis and management of various PB disorders and its application is ever expanding. Despite promising results, these AI-based models need further external validation to be clinically applicable.

Artificial intelligence in pancreaticobiliary endoscopy: Current applications and future directions

Pancreaticobiliary endoscopy is an essential tool for diagnosing and treating pancreaticobiliary diseases. However, it does not fully meet clinical needs, which presents challenges such as significant difficulty in operation and risks of missed diagnosis or misdiagnosis. In recent years, artificial intelligence (AI) has enhanced the diagnostic and treatment efficiency and quality of pancreaticobiliary endoscopy. Diagnosis and differential diagnosis based on endoscopic ultrasound (EUS) images, pathology of EUS-guided fine-needle aspiration or biopsy, need for endoscopic retrograde cholangiopancreatography (ERCP) and assessment of operational difficulty, postoperative complications and prediction of patient prognosis, and real-time procedure guidance. This review provides an overview of AI applications in pancreaticobiliary endoscopy and proposes future development directions in aspects such as data quality and algorithmic interpretability, aiming to provide new insights for the integration of AI technology with pancreaticobiliary endoscopy.

A deep learning model based on contrast-enhanced computed tomography for differential diagnosis of gallbladder carcinoma

BACKGROUND

Gallbladder carcinoma (GBC) is highly malignant, and its early diagnosis remains difficult. This study aimed to develop a deep learning model based on contrast-enhanced computed tomography (CT) images to assist radiologists in identifying GBC.

METHODS

We retrospectively enrolled 278 patients with gallbladder lesions (> 10 mm) who underwent contrast-enhanced CT and cholecystectomy and divided them into the training (n = 194) and validation (n = 84) datasets. The deep learning model was developed based on ResNet50 network. Radiomics and clinical models were built based on support vector machine (SVM) method. We comprehensively compared the performance of deep learning, radiomics, clinical models, and three radiologists.

RESULTS

Three radiomics features including LoG_3.0 gray-level size zone matrix zone variance, HHL first-order kurtosis, and LHL gray-level co-occurrence matrix dependence variance were significantly different between benign gallbladder lesions and GBC, and were selected for developing radiomics model. Multivariate regression analysis revealed that age ≥ 65 years [odds ratios (OR) = 4.4, 95% confidence interval (CI): 2.1-9.1, P < 0.001], lesion size (OR = 2.6, 95% CI: 1.6-4.1, P < 0.001), and CA-19-9 > 37 U/mL (OR = 4.0, 95% CI: 1.6-10.0, P = 0.003) were significant clinical risk factors of GBC. The deep learning model achieved the area under the receiver operating characteristic curve (AUC) values of 0.864 (95% CI: 0.814-0.915) and 0.857 (95% CI: 0.773-0.942) in the training and validation datasets, which were comparable with radiomics, clinical models and three radiologists. The sensitivity of deep learning model was the highest both in the training [90% (95% CI: 82%-96%)] and validation [85% (95% CI: 68%-95%)] datasets.

CONCLUSIONS

The deep learning model may be a useful tool for radiologists to distinguish between GBC and benign gallbladder lesions.

Advancements in Cholelithiasis Diagnosis: A Systematic Review of Machine Learning Applications in Imaging Analysis

Gallstone disease is a common condition affecting a substantial number of individuals globally. The risk factors for gallstones include obesity, rapid weight loss, diabetes, and genetic predisposition. Gallstones can lead to serious complications such as calculous cholecystitis, cholangitis, biliary pancreatitis, and an increased risk for gallbladder (GB) cancer. Abdominal ultrasound (US) is the primary diagnostic method due to its affordability and high sensitivity, while computed tomography (CT) and magnetic resonance cholangiopancreatography (MRCP) offer higher sensitivity and specificity. This review assesses the diagnostic accuracy of machine learning (ML) technologies in detecting gallstones. This systematic review followed the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines for reporting systematic reviews and meta-analyses. An electronic search was conducted in PubMed, Cochrane Library, Scopus, and Embase, covering literature up to April 2024, focusing on human studies, and including all relevant keywords. Various Boolean operators and Medical Subject Heading (MeSH) terms were used. Additionally, reference lists were manually screened. The review included all study designs and performance indicators but excluded studies not involving artificial intelligence (AI)/ML algorithms, non-imaging diagnostic modalities, microscopic images, other diseases, editorials, commentaries, reviews, and studies with incomplete data. Data extraction covered study characteristics, imaging modalities, ML architectures, training/testing/validation, performance metrics, reference standards, and reported advantages and drawbacks of the diagnostic models. The electronic search yielded 1,002 records, of which 34 underwent full-text screening, resulting in the inclusion of seven studies. An additional study identified through citation searching brought the total to eight articles. Most studies employed a retrospective cross-sectional design, except for one prospective study. Imaging modalities included ultrasonography (four studies), computed tomography (three studies), and magnetic resonance cholangiopancreatography (one study). Patient numbers ranged from 60 to 2,386, and image numbers ranged from 60 to 17,560 images included in the training, validation, and testing of the diagnostic models. All studies utilized neural networks, predominantly convolutional neural networks (CNNs). Expert radiologists served as the reference standard for image labelling, and model performances were compared against human doctors or other algorithms. Performance indicators such as sensitivity, specificity, positive predictive value (PPV), and negative predictive value (NPV) were commonly used. In conclusion, while the reviewed machine learning models show promising performance in diagnosing gallstones, significant work remains to be done to ensure their reliability and generalizability across diverse clinical settings. The potential for these models to improve diagnostic accuracy and efficiency is evident, but the careful consideration of their limitations and rigorous validation are essential steps toward their successful integration into clinical practice.

Deep-learning enabled ultrasound based detection of gallbladder cancer in northern India: a prospective diagnostic study

Background

Gallbladder cancer (GBC) is highly aggressive. Diagnosis of GBC is challenging as benign gallbladder lesions can have similar imaging features. We aim to develop and validate a deep learning (DL) model for the automatic detection of GBC at abdominal ultrasound (US) and compare its diagnostic performance with that of radiologists.

Methods

In this prospective study, a multiscale, second-order pooling-based DL classifier model was trained (training and validation cohorts) using the US data of patients with gallbladder lesions acquired between August 2019 and June 2021 at the Postgraduate Institute of Medical Education and research, a tertiary care hospital in North India. The performance of the DL model to detect GBC was evaluated in a temporally independent test cohort (July 2021-September 2022) and was compared with that of two radiologists.

Findings

The study included 233 patients in the training set (mean age, 48 ± (2SD) 23 years; 142 women), 59 patients in the validation set (mean age, 51.4 ± 19.2 years; 38 women), and 273 patients in the test set (mean age, 50.4 ± 22.1 years; 177 women). In the test set, the DL model had sensitivity, specificity, and area under the receiver operating characteristic curve (AUC) of 92.3% (95% CI, 88.1-95.6), 74.4% (95% CI, 65.3-79.9), and 0.887 (95% CI, 0.844-0.930), respectively for detecting GBC which was comparable to both the radiologists. The DL-based approach showed high sensitivity (89.8-93%) and AUC (0.810-0.890) for detecting GBC in the presence of stones, contracted gallbladders, lesion size <10 mm, and neck lesions, which was comparable to both the radiologists (p = 0.052-0.738 for sensitivity and p = 0.061-0.745 for AUC). The sensitivity for DL-based detection of mural thickening type of GBC was significantly greater than one of the radiologists (87.8% vs. 72.8%, p = 0.012), despite a reduced specificity.

Interpretation

The DL-based approach demonstrated diagnostic performance comparable to experienced radiologists in detecting GBC using US. However, multicentre studies are warranted to explore the potential of DL-based diagnosis of GBC fully.

Funding

None.

Current status of artificial intelligence analysis for the treatment of pancreaticobiliary diseases using endoscopic ultrasonography and endoscopic retrograde cholangiopancreatography

Pancreatic and biliary diseases encompass a range of conditions requiring accurate diagnosis for appropriate treatment strategies. This diagnosis relies heavily on imaging techniques like endoscopic ultrasonography and endoscopic retrograde cholangiopancreatography. Artificial intelligence (AI), including machine learning and deep learning, is becoming integral in medical imaging and diagnostics, such as the detection of colorectal polyps. AI shows great potential in diagnosing pancreatobiliary diseases. Unlike machine learning, which requires feature extraction and selection, deep learning can utilize images directly as input. Accurate evaluation of AI performance is a complex task due to varied terminologies, evaluation methods, and development stages. Essential aspects of AI evaluation involve defining the AI's purpose, choosing appropriate gold standards, deciding on the validation phase, and selecting reliable validation methods. AI, particularly deep learning, is increasingly employed in endoscopic ultrasonography and endoscopic retrograde cholangiopancreatography diagnostics, achieving high accuracy levels in detecting and classifying various pancreatobiliary diseases. The AI often performs better than doctors, even in tasks like differentiating benign from malignant pancreatic tumors, cysts, and subepithelial lesions, identifying gallbladder lesions, assessing endoscopic retrograde cholangiopancreatography difficulty, and evaluating the biliary strictures. The potential for AI in diagnosing pancreatobiliary diseases, especially where other modalities have limitations, is considerable. However, a crucial constraint is the need for extensive, high-quality annotated data for AI training. Future advances in AI, such as large language models, promise further applications in the medical field.

Artificial intelligence: Applications in critical care gastroenterology

Gastrointestinal (GI) complications frequently necessitate intensive care unit (ICU) admission. Additionally, critically ill patients also develop GI complications requiring further diagnostic and therapeutic interventions. However, these patients form a vulnerable group, who are at risk for developing side effects and complications. Every effort must be made to reduce invasiveness and ensure safety of interventions in ICU patients. Artificial intelligence (AI) is a rapidly evolving technology with several potential applications in healthcare settings. ICUs produce a large amount of data, which may be employed for creation of AI algorithms, and provide a lucrative opportunity for application of AI. However, the current role of AI in these patients remains limited due to lack of large-scale trials comparing the efficacy of AI with the accepted standards of care.

The application of artificial intelligence in EUS

Artificial intelligence (AI) is an epoch-making technology, among which the 2 most advanced parts are machine learning and deep learning algorithms that have been further developed by machine learning, and it has been partially applied to assist EUS diagnosis. AI-assisted EUS diagnosis has been reported to have great value in the diagnosis of pancreatic tumors and chronic pancreatitis, gastrointestinal stromal tumors, esophageal early cancer, biliary tract, and liver lesions. The application of AI in EUS diagnosis still has some urgent problems to be solved. First, the development of sensitive AI diagnostic tools requires a large amount of high-quality training data. Second, there is overfitting and bias in the current AI algorithms, leading to poor diagnostic reliability. Third, the value of AI still needs to be determined in prospective studies. Fourth, the ethical risks of AI need to be considered and avoided.

Recent Advances in Endoscopic Ultrasound for Gallbladder Disease Diagnosis

Gallbladder (GB) disease is classified into two broad categories: GB wall-thickening and protuberant lesions, which include various lesions, such as adenomyomatosis, cholecystitis, GB polyps, and GB carcinoma. This review summarizes recent advances in the differential diagnosis of GB lesions, focusing primarily on endoscopic ultrasound (EUS) and related technologies. Fundamental B-mode EUS and contrast-enhanced harmonic EUS (CH-EUS) have been reported to be useful for the diagnosis of GB diseases because they can evaluate the thickening of the GB wall and protuberant lesions in detail. We also outline the current status of EUS-guided fine-needle aspiration (EUS-FNA) for GB lesions, as there have been scattered reports on EUS-FNA in recent years. Furthermore, artificial intelligence (AI) technologies, ranging from machine learning to deep learning, have become popular in healthcare for disease diagnosis, drug discovery, drug development, and patient risk identification. In this review, we outline the current status of AI in the diagnosis of GB.

Using deep learning models in magnetic resonance cholangiopancreatography images to diagnose common bile duct stones

BACKGROUNDS AND AIMS

Magnetic resonance cholangiopancreatography (MRCP) plays a significant role in diagnosing common bile duct stones (CBDS). Currently, there are no studies to detect CBDS by using the deep learning (DL) model in MRCP. This study aimed to use the DL model You Only Look Once version 5 (YOLOv5) to diagnose CBDS in MRCP images and verify its validity compared to the accuracy of radiologists.

METHODS

By collecting the thick-slab MRCP images of patients diagnosed with CBDS, 4 submodels of YOLOv5 were used to train and validate the performance. Precision, recall rate, and mean average precision (mAP) were used to evaluate model performance. Analyze possible reasons that may affect detection accuracy by validating MRCP images in 63 CBDS patients and comparing them with radiologist detection accuracy. Calculate the correctness of YOLOv5 for detecting one CBDS and multiple CBDS separately.

RESULTS

The precision of YOLOv5l (0.970) was higher than that of YOLOv5x (0.909), YOLOv5m (0.874), and YOLOv5s (0.939). The mAP did not differ significantly between the 4 submodels, with the following results: YOLOv5l (0.942), YOLOv5x (0.947), YOLO5s (0.927), and YOLOv5m (0.946). However, in terms of training time, YOLOv5s was the fastest (4.8 h), detecting CBDS in only 7.2 milliseconds per image. In 63 patients the YOLOv5l model detected CBDS with an accuracy of 90.5% compared to 92.1% for radiologists, analyzing the difference between the positive group successfully identified and the unidentified negative group not. The incorporated variables include common bile duct diameter > 1 cm (p = .560), combined gallbladder stones (p = .706), maximum stone diameter (p = .057), combined cholangitis (p = .846), and combined pancreatitis (p = .656), and the number of CBDS (p = .415). When only one CBDS was present, the accuracy rate reached 94%. When multiple CBDSs were present, the recognition rate dropped to 70%.

CONCLUSION

YOLOv5l is the model with the best results and is almost as accurate as the radiologist's detection of CBDS and is also capable of detecting the number of CBDS. Although the accuracy of the test gradually decreases as the number of stones increases, it can still be useful for the clinician's initial diagnosis.

Deep learning nomogram for preoperative distinction between Xanthogranulomatous cholecystitis and gallbladder carcinoma: A novel approach for surgical decision

The distinction between Xanthogranulomatous Cholecystitis (XGC) and Gallbladder Carcinoma (GBC) is challenging due to their similar imaging features. This study aimed to differentiate between XGC and GBC using a deep learning nomogram model built from contrast enhanced computed tomography (CT) scans. 297 patients were included with confirmed XGC (94) and GBC (203) as the training and internal validation cohort from 2017 to 2021. The deep learning model Resnet-18 with Fourier transformation named FCovResnet18, shows most impressive potential in distinguishing XGC from GBC using 3-phase merged images. The accuracy, precision and area under the curve (AUC) of the model were then calculated. An additional cohort of 74 patients consisting of 22 XGC and 52 GBC patients was enrolled from two subsidiary hospitals as the external validation cohort. The accuracy, precision and AUC achieve 0.98, 0.99, 1.00 in the internal validation cohort and 0.89, 0.92, 0.92 in external validation cohort. A nomogram model combining clinical characteristics and deep learning prediction score showed improved predicting value. Altogether, FCovResnet18 nomogram has demonstrated its ability to effectively differentiate XGC from GBC preoperatively, which significantly aid surgeons in making informed and accurate surgical decisions for XGC and GBC patients.

Analysis of ultrasonographic images using a deep learning-based model as ancillary diagnostic tool for diagnosing gallbladder polyps

BACKGROUND

Accurately diagnosing gallbladder polyps (GBPs) is important to avoid misdiagnosis and overtreatment.

AIMS

To evaluate the efficacy of a deep learning model and the accuracy of a computer-aided diagnosis by physicians for diagnosing GBPs.

METHODS

This retrospective cohort study was conducted from January 2006 to September 2021, and 3,754 images from 263 patients were analyzed. The outcome of this study was the efficacy of the developed deep learning model in discriminating neoplastic GBPs (NGBPs) from non-NGBPs and to evaluate the accuracy of a computer-aided diagnosis with that made by physicians.

RESULTS

The efficacy of discriminating NGBPs from non- NGBPs using deep learning was 0.944 (accuracy, 0.858; sensitivity, 0.856; specificity, 0.861). The accuracy of an unassisted diagnosis of GBP was 0.634, and that of a computer-aided diagnosis was 0.785 (p<0.001). There were no significant differences in the accuracy of a computer-aided diagnosis between experienced (0.835) and inexperienced (0.772) physicians (p = 0.251). A computer-aided diagnosis significantly assisted inexperienced physicians (0.772 vs. 0.614; p < 0.001) but not experienced physicians.

CONCLUSIONS

Deep learning-based models discriminate NGBPs from non- NGBPs with excellent accuracy. As ancillary diagnostic tools, they may assist inexperienced physicians in improving their diagnostic accuracy.

A Bayesian network model to predict neoplastic risk for patients with gallbladder polyps larger than 10 mm based on preoperative ultrasound features

BACKGROUND

Polyp size of 10 mm is insufficient to discriminate neoplastic and non-neoplastic risk in patients with gallbladder polyps (GPs). The aim of the study is to develop a Bayesian network (BN) prediction model to identify neoplastic polyps and create more precise criteria for surgical indications in patients with GPs lager than 10 mm based on preoperative ultrasound features.

METHODS

A BN prediction model was established and validated based on the independent risk variables using data from 759 patients with GPs who underwent cholecystectomy from January 2015 to August 2022 at 11 tertiary hospitals in China. The area under receiver operating characteristic curves (AUCs) were used to evaluate the predictive ability of the BN model and current guidelines, and Delong test was used to compare the AUCs.

RESULTS

The mean values of polyp cross-sectional area (CSA), long, and short diameter of neoplastic polyps were higher than those of non-neoplastic polyps (P < 0.0001). Independent neoplastic risk factors for GPs included single polyp, polyp CSA ≥ 85 mm ², fundus with broad base, and medium echogenicity. The accuracy of the BN model established based on the above independent variables was 81.88% and 82.35% in the training and testing sets, respectively. Delong test also showed that the AUCs of the BN model was better than that of JSHBPS, ESGAR, US-reported, and CCBS in training and testing sets, respectively (P < 0.05).

CONCLUSION

A Bayesian network model was accurate and practical for predicting neoplastic risk in patients with gallbladder polyps larger than 10 mm based on preoperative ultrasound features.

RadFormer: Transformers with global-local attention for interpretable and accurate Gallbladder Cancer detection

We propose a novel deep neural network architecture to learn interpretable representation for medical image analysis. Our architecture generates a global attention for region of interest, and then learns bag of words style deep feature embeddings with local attention. The global, and local feature maps are combined using a contemporary transformer architecture for highly accurate Gallbladder Cancer (GBC) detection from Ultrasound (USG) images. Our experiments indicate that the detection accuracy of our model beats even human radiologists, and advocates its use as the second reader for GBC diagnosis. Bag of words embeddings allow our model to be probed for generating interpretable explanations for GBC detection consistent with the ones reported in medical literature. We show that the proposed model not only helps understand decisions of neural network models but also aids in discovery of new visual features relevant to the diagnosis of GBC. Source-code is available at https://github.com/sbasu276/RadFormer.

Artificial intelligence in gastroenterology: A narrative review

Artificial intelligence (AI) is a complex concept, broadly defined in medicine as the development of computer systems to perform tasks that require human intelligence. It has the capacity to revolutionize medicine by increasing efficiency, expediting data and image analysis and identifying patterns, trends and associations in large datasets. Within gastroenterology, recent research efforts have focused on using AI in esophagogastroduodenoscopy, wireless capsule endoscopy (WCE) and colonoscopy to assist in diagnosis, disease monitoring, lesion detection and therapeutic intervention. The main objective of this narrative review is to provide a comprehensive overview of the research being performed within gastroenterology on AI in esophagogastroduodenoscopy, WCE and colonoscopy.

Differential diagnoses of gallbladder tumors using CT-based deep learning

Background

The differential diagnosis between gallbladder cancer (GBC) and xanthogranulomatous cholecystitis (XGC) remains quite challenging, and can possibly lead to improper surgery. This study aimed to distinguish between XGC and GBC by combining computed tomography (CT) images and deep learning (DL) to maximize the therapeutic success of surgery.

Methods

We collected a dataset, including preoperative CT images, from 28 cases of GBC and 21 XGC patients undergoing surgery at our facility. It was subdivided into training and validation (n = 40), and test (n = 9) datasets. We built a CT patch-based discriminating model using a residual convolutional neural network and employed 5-fold cross-validation. The discriminating performance of the model was analyzed in the test dataset.

Results

Of the 40 patients in the training dataset, GBC and XGC were observed in 21 (52.5%), and 19 (47.5%) patients, respectively. A total of 61 126 patches were extracted from the 40 patients. In the validation dataset, the average sensitivity, specificity, and accuracy were 98.8%, 98.0%, and 98.5%, respectively. Furthermore, the area under the receiver operating characteristic curve (AUC) was 0.9985. In the test dataset, which included 11 738 patches, the discriminating accuracy for GBC patients after neoadjuvant chemotherapy (NAC) (n = 3) was insufficient (61.8%). However, the discriminating model demonstrated high accuracy (98.2%) and AUC (0.9893) for cases other than those receiving NAC.

Conclusion

Our CT-based DL model exhibited high discriminating performance in patients with GBC and XGC. Our study proposes a novel concept for selecting the appropriate procedure and avoiding unnecessary invasive measures.

Artificial intelligence in the endoscopic approach of biliary tract diseases: A current review

In recent years there have been major developments in the field of artificial intelligence. The different areas of medicine have taken advantage of this tool to make various diagnostic and therapeutic methods more effective, safe, and user-friendly. In this way, artificial intelligence has been an increasingly present reality in medicine. In the field of Gastroenterology, the main application has been in the detection and characterization of colonic polyps, but an increasing number of studies have been published on the application of deep learning systems in other pathologies of the gastrointestinal tract. Evidence of the application of artificial intelligence in the assessment of biliary tract is still scarce. Some studies support the usefulness of these systems in the investigation and treatment of choledocholithiasis, demonstrating that they have the potential to be integrated into clinical practice and endoscopic procedures, such as endoscopic retrograde cholangiopancreatography. Its application in cholangioscopy for the investigation of undetermined biliary strictures also seems to be promising. Assessing the bile duct through endoscopic ultrasound can be challenging, especially for less experienced operators, thus becoming an area of potential interest for artificial intelligence. In this review, we summarize the state of the art of artificial intelligence in the endoscopic diagnosis and treatment of biliary diseases.

Application and prospect of artificial intelligence in digestive endoscopy

INTRODUCTION

With the progress of science and technology, artificial intelligence represented by deep learning has gradually begun to be applied in the medical field. Artificial intelligence has been applied to benign gastrointestinal lesions, tumors, early cancer, inflammatory bowel disease, gallbladder, pancreas, and other diseases. This review summarizes the latest research results on artificial intelligence in digestive endoscopy and discusses the prospect of artificial intelligence in digestive system diseases.

AREAS COVERED

We retrieved relevant documents on artificial intelligence in digestive tract diseases from PubMed and Medline. This review elaborates on the knowledge of computer-aided diagnosis in digestive endoscopy.

EXPERT OPINION

Artificial intelligence significantly improves diagnostic accuracy, reduces physicians' workload, and provides a shred of evidence for clinical diagnosis and treatment. Shortly, artificial intelligence will have high application value in the field of medicine.

Diagnosing gangrenous cholecystitis on computed tomography using deep learning: A preliminary study

Aim

To compare deep learning and experienced physicians in diagnosing gangrenous cholecystitis using computed tomography images and explore the feasibility of diagnostic assistance for acute cholecystitis requiring emergency surgery.

Methods

This retrospective study included 25 patients with pathologically confirmed gangrenous cholecystitis and 129 patients with noncomplicated acute cholecystitis who underwent computed tomography between 2016 and 2021 at two institutions. All available computed tomography images at the time of the initial diagnosis were used for the analysis. A deep learning model based on a convolutional neural network was trained using 1,517 images of 112 patients (18 patients with gangrenous cholecystitis and 94 patients with acute cholecystitis) and tested with 68 images of 42 patients (seven patients with gangrenous cholecystitis and 35 patients with acute cholecystitis). Three blinded, experienced physicians independently interpreted the test images. The sensitivity, specificity, accuracy, and area under the receiver operating characteristic curve were compared between the convolutional neural network and the reviewers.

Results

The convolutional neural network (sensitivity, 0.70; 95% confidence interval [CI], 0.44–0.87, specificity, 0.93; 95% CI, 0.88–0.96, accuracy, 0.89; 95% CI, 0.81–0.95, area under the receiver operating characteristic curve, 0.84; 95% CI, 0.68–1.00) had achieved a better diagnostic performance than the reviewers (ex. sensitivity, 0.55; 95% CI, 0.30–0.77, specificity, 0.67; 95% CI, 0.62–0.71, accuracy, 0.65; 95% CI, 0.57–0.72, area under the receiver operating characteristic curve, 0.63; 95% CI, 0.44–0.82; P = 0.048 for area under the receiver operating characteristic curve versus convolutional neural network).

Conclusions

Deep learning had a better diagnostic performance than experienced reviewers in diagnosing gangrenous cholecystitis and has potential applicability for assisting in identifying indications for emergency surgery in the future.