Automatic Pancreatic Cyst Lesion Segmentation on EUS Images Using a Deep-Learning Approach

Enhancing detection of various pancreatic lesions on endoscopic ultrasound through artificial intelligence: a basis for computer-aided detection systems

BACKGROUND AND AIM

Endoscopic ultrasound (EUS) is the most sensitive method for evaluation of pancreatic lesions but is limited by significant operator dependency. Artificial intelligence (AI), in the form of computer-aided detection (CADe) systems, has shown potential in increasing accuracy and bridging operator dependency in several endoscopic domains. However, the complexity of integrating AI into EUS is far more challenging. This aims to develop and test the basis for a CADe system for real-time detection and segmentation of all pancreatic lesions.

METHODS

In this single-center study EUS studies of pancreatic findings were included. Lesions were outlined by two expert (>5 years performing EUS) endoscopists, and the two leading types of models were benchmarked. The models' performance was evaluated through per-pixel intersection over union (IoU).

RESULTS

A total of 1497 EUS images from 165 patients were evaluated. The dataset included malignancies, neuroendocrine tumors, benign cysts, chronic and acute pancreatitis, normal fatty pancreas, and benign lesions. The best model demonstrated detection and segmentation on the test set with a mean IoU of 0.73, achieving a PPV, NPV, total accuracy, and ROC of 0.82, 0.96, 0.95, and 0.95, respectively. The algorithm is adaptable for real-time processing.

CONCLUSIONS

We developed and tested deep learning models for real-time detection and segmentation of pancreatic lesions during EUS with promising results. This constitutes the basis for a CADe system for EUS, which could be valuable in future detection and evaluation of pancreatic lesions. Further studies for validation and generalization are underway.

Advances for Managing Pancreatic Cystic Lesions: Integrating Imaging and AI Innovations

Pancreatic cystic lesions (PCLs) represent a spectrum of non-neoplasms and neoplasms with varying malignant potential, posing significant challenges in diagnosis and management. While some PCLs are precursors to pancreatic cancer, others remain benign, necessitating accurate differentiation for optimal patient care. Conventional approaches to PCL management rely heavily on radiographic imaging, and endoscopic ultrasound (EUS) guided fine-needle aspiration (FNA), coupled with clinical and biochemical data. However, the observer-dependent nature of image interpretation and the complex morphology of PCLs can lead to diagnostic uncertainty and variability in patient management strategies. This review critically evaluates current PCL diagnosis and surveillance practices, showing features of the different lesions and highlighting the potential limitations of conventional methods. We then explore the potential of artificial intelligence (AI) to transform PCL management. AI-driven strategies, including deep learning algorithms for automated pancreas and lesion segmentation, and radiomics for analyzing heterogeneity, can improve diagnostic accuracy and risk stratification. These advanced techniques can provide more objective and reproducible assessments, aiding clinicians in decision-making regarding follow-up intervals and surgical interventions. Early results suggest that AI-driven methods can significantly improve patient outcomes by enabling earlier detection of high-risk lesions and reducing unnecessary procedures for benign cysts. Finally, this review emphasizes that AI-driven approaches could potentially reshape the landscape of PCL management, ultimately leading to improved pancreatic cancer prevention.

Enhancing physician support in pancreatic cancer diagnosis: New M-F-RCNN artificial intelligence model using endoscopic ultrasound

Background and study aims Endoscopic ultrasound (EUS) is vital for early pancreatic cancer diagnosis. Advances in artificial intelligence (AI), especially deep learning, have improved medical image analysis. We developed and validated the Modified Faster R-CNN (M-F-RCNN), an AI algorithm using EUS images to assist in diagnosing pancreatic cancer. Methods We collected EUS images from 155 patients across three endoscopy centers from July 2022 to July 2023. M-F-RCNN development involved enhancing feature information through data preprocessing and utilizing an improved Faster R-CNN model to identify cancerous regions. Its diagnostic capabilities were validated against an external set of 1,000 EUS images. In addition, five EUS doctors participated in a study comparing the M-F-RCNN model's performance with that of human experts, assessing diagnostic skill improvements with AI assistance. Results Internally, the M-F-RCNN model surpassed traditional algorithms with an average precision of 97.35%, accuracy of 96.49%, and recall rate of 5.44%. In external validation, its sensitivity, specificity, and accuracy were 91.7%, 91.5%, and 91.6%, respectively, outperforming non-expert physicians. The model also significantly enhanced the diagnostic skills of doctors. Conclusions: The M-F-RCNN model shows exceptional performance in diagnosing pancreatic cancer via EUS images, greatly improving diagnostic accuracy and efficiency, thus enhancing physician proficiency and reducing diagnostic errors.

Artificial Intelligence in Pancreatic Image Analysis: A Review

Pancreatic cancer is a highly lethal disease with a poor prognosis. Its early diagnosis and accurate treatment mainly rely on medical imaging, so accurate medical image analysis is especially vital for pancreatic cancer patients. However, medical image analysis of pancreatic cancer is facing challenges due to ambiguous symptoms, high misdiagnosis rates, and significant financial costs. Artificial intelligence (AI) offers a promising solution by relieving medical personnel's workload, improving clinical decision-making, and reducing patient costs. This study focuses on AI applications such as segmentation, classification, object detection, and prognosis prediction across five types of medical imaging: CT, MRI, EUS, PET, and pathological images, as well as integrating these imaging modalities to boost diagnostic accuracy and treatment efficiency. In addition, this study discusses current hot topics and future directions aimed at overcoming the challenges in AI-enabled automated pancreatic cancer diagnosis algorithms.

Automatically Detecting Pancreatic Cysts in Autosomal Dominant Polycystic Kidney Disease on MRI Using Deep Learning

BACKGROUND

Pancreatic cysts in autosomal dominant polycystic kidney disease (ADPKD) correlate with PKD2 mutations, which have a different phenotype than PKD1 mutations. However, pancreatic cysts are commonly overlooked by radiologists. Here, we automate the detection of pancreatic cysts on abdominal MRI in ADPKD.

METHODS

Eight nnU-Net-based segmentation models with 2D or 3D configuration and various loss functions were trained on positive-only or positive-and-negative datasets, comprising axial and coronal T2-weighted MR images from 254 scans on 146 ADPKD patients with pancreatic cysts labeled independently by two radiologists. Model performance was evaluated on test subjects unseen in training, comprising 40 internal, 40 external, and 23 test-retest reproducibility ADPKD patients.

RESULTS

Two radiologists agreed on 52% of cysts labeled on training data, and 33%/25% on internal/external test datasets. The 2D model with a loss of combined dice similarity coefficient and cross-entropy trained with the dataset with both positive and negative cases produced an optimal dice score of 0.7 ± 0.5/0.8 ± 0.4 at the voxel level on internal/external validation and was thus used as the best-performing model. In the test-retest, the optimal model showed superior reproducibility (83% agreement between scan A and B) in segmenting pancreatic cysts compared to six expert observers (77% agreement). In the internal/external validation, the optimal model showed high specificity of 94%/100% but limited sensitivity of 20%/24%.

CONCLUSIONS

Labeling pancreatic cysts on T2 images of the abdomen in patients with ADPKD is challenging, deep learning can help the automated detection of pancreatic cysts, and further image quality improvement is warranted.

Application of artificial intelligence in pancreas endoscopic ultrasound imaging- A systematic review

The pancreas is a vital organ in digestive system which has significant health implications. It is imperative to evaluate and identify malignant pancreatic lesions promptly in light of the high mortality rate linked to such malignancies. Endoscopic Ultrasound (EUS) is a non-invasive precise technique to detect pancreas disorders, but it is highly operator dependent. Artificial intelligence (AI), including traditional machine learning (ML) and deep learning (DL) techniques can play a pivotal role to enhancing the performance of EUS regardless of operator. AI performs a critical function in the detection, classification, and segmentation of medical images. The utilization of AI-assisted systems has improved the accuracy and productivity of pancreatic analysis, including the detection of diverse pancreatic disorders (e.g., pancreatitis, masses, and cysts) as well as landmarks and parenchyma. This systematic review examines the rapidly developing domain of AI-assisted system in EUS of the pancreas. Its objective is to present a thorough study of the present research status and developments in this area. This paper explores the significant challenges of AI-assisted system in pancreas EUS imaging, highlights the potential of AI techniques in addressing these challenges, and suggests the scope for future research in domain of AI-assisted EUS systems.

MC3DU-Net: a multisequence cascaded pipeline for the detection and segmentation of pancreatic cysts in MRI

PURPOSE

Radiological detection and follow-up of pancreatic cysts in multisequence MRI studies are required to assess the likelihood of their malignancy and to determine their treatment. The evaluation requires expertise and has not been automated. This paper presents MC3DU-Net, a novel multisequence cascaded pipeline for the detection and segmentation of pancreatic cysts in MRI studies consisting of coronal MRCP and axial TSE MRI sequences.

METHODS

MC3DU-Net leverages the information in both sequences by computing a pancreas Region of Interest (ROI) segmentation in the TSE MRI scan, transferring it to MRCP scan, and then detecting and segmenting the cysts in the ROI of the MRCP scan. Both the voxel-level ROI of the pancreas and the segmentation of the cysts are performed with 3D U-Nets trained with Hard Negative Patch Mining, a new technique for class imbalance correction and for the reduction in false positives.

RESULTS

MC3DU-Net was evaluated on a dataset of 158 MRI patient studies with a training/validation/testing split of 118/17/23. Ground truth segmentations of a total of 840 cysts were manually obtained by expert clinicians. MC3DU-Net achieves a mean recall of 0.80 ± 0.19, a mean precision of 0.75 ± 0.26, a mean Dice score of 0.80 ± 0.19 and a mean ASSD of 0.60 ± 0.53 for pancreatic cysts of diameter > 5 mm, which is the clinically relevant endpoint.

CONCLUSION

MC3DU-Net is the first fully automatic method for detection and segmentation of pancreatic cysts in MRI. Automatic detection and segmentation of pancreatic cysts in MRI can be performed accurately and reliably. It may provide a method for precise disease evaluation and may serve as a second expert reader.

Applications and Prospects of Artificial Intelligence-Assisted Endoscopic Ultrasound in Digestive System Diseases

Endoscopic ultrasound (EUS) has emerged as a widely utilized tool in the diagnosis of digestive diseases. In recent years, the potential of artificial intelligence (AI) in healthcare has been gradually recognized, and its superiority in the field of EUS is becoming apparent. Machine learning (ML) and deep learning (DL) are the two main AI algorithms. This paper aims to outline the applications and prospects of artificial intelligence-assisted endoscopic ultrasound (EUS-AI) in digestive diseases over the past decade. The results demonstrated that EUS-AI has shown superiority or at least equivalence to traditional methods in the diagnosis, prognosis, and quality control of subepithelial lesions, early esophageal cancer, early gastric cancer, and pancreatic diseases including pancreatic cystic lesions, autoimmune pancreatitis, and pancreatic cancer. The implementation of EUS-AI has opened up new avenues for individualized precision medicine and has introduced novel diagnostic and treatment approaches for digestive diseases.

Diagnostic value of deep learning-assisted endoscopic ultrasound for pancreatic tumors: a systematic review and meta-analysis

Background and aims

Endoscopic ultrasonography (EUS) is commonly utilized in the diagnosis of pancreatic tumors, although as this modality relies primarily on the practitioner's visual judgment, it is prone to result in a missed diagnosis or misdiagnosis due to inexperience, fatigue, or distraction. Deep learning (DL) techniques, which can be used to automatically extract detailed imaging features from images, have been increasingly beneficial in the field of medical image-based assisted diagnosis. The present systematic review included a meta-analysis aimed at evaluating the accuracy of DL-assisted EUS for the diagnosis of pancreatic tumors diagnosis.

Methods

We performed a comprehensive search for all studies relevant to EUS and DL in the following four databases, from their inception through February 2023: PubMed, Embase, Web of Science, and the Cochrane Library. Target studies were strictly screened based on specific inclusion and exclusion criteria, after which we performed a meta-analysis using Stata 16.0 to assess the diagnostic ability of DL and compare it with that of EUS practitioners. Any sources of heterogeneity were explored using subgroup and meta-regression analyses.

Results

A total of 10 studies, involving 3,529 patients and 34,773 training images, were included in the present meta-analysis. The pooled sensitivity was 93% (95% confidence interval [CI], 87-96%), the pooled specificity was 95% (95% CI, 89-98%), and the area under the summary receiver operating characteristic curve (AUC) was 0.98 (95% CI, 0.96-0.99).

Conclusion

DL-assisted EUS has a high accuracy and clinical applicability for diagnosing pancreatic tumors.

Systematic review registration

https://www.crd.york.ac.uk/prospero/display_record.php?ID=CRD42023391853, identifier CRD42023391853.

Deep learning for pancreatic diseases based on endoscopic ultrasound: A systematic review

BACKGROUND AND AIMS

Endoscopic ultrasonography (EUS) is one of the main examinations in pancreatic diseases. A series of the studies reported the application of deep learning (DL)-assisted EUS in the diagnosis of pancreatic diseases. This systematic review is to evaluate the role of DL algorithms in assisting EUS diagnosis of pancreatic diseases.

METHODS

Literature search were conducted in PubMed and Semantic Scholar databases. Studies that developed DL models for pancreatic diseases based on EUS were eligible for inclusion. This review was conducted in accordance with the Preferred Reporting Items for Systematic Reviews and Meta-Analyses guidelines and quality assessment of the included studies was performed according to the IJMEDI checklist.

RESULTS

A total of 23 studies were enrolled into this systematic review, which could be categorized into three groups according to computer vision tasks: classification, detection and segmentation. Seventeen studies focused on the classification task, among which five studies developed simple neural network (NN) models while twelve studies constructed convolutional NN (CNN) models. Three studies were concerned the detection task and five studies were the segmentation task, all based on CNN architectures. All models presented in the studies performed well based on EUS images, videos or voice. According to the IJMEDI checklist, six studies were recognized as high-grade quality, with scores beyond 35 points.

CONCLUSIONS

DL algorithms show great potential in EUS images/videos/voice for pancreatic diseases. However, there is room for improvement such as sample sizes, multi-center cooperation, data preprocessing, model interpretability, and code sharing.

Contrast Enhanced EUS for Predicting Solid Pancreatic Neuroendocrine Tumor Grade and Aggressiveness

Pancreatic neuroendocrine tumor (PNET) behavior assessment is a daily challenge for physicians. Modern PNET management varies from a watch-and-wait strategy to surgery depending on tumor aggressiveness. Therefore, the aggressiveness definition plays a pivotal role in the PNET work-up. The aggressiveness of PNETs is mainly based on the dimensions and histological grading, with sometimes a lack of specificity and sensibility. In the last twenty years, EUS has become a cornerstone in the diagnostic phase of PNET management for its high diagnostic yield and the possibility of obtaining a histological specimen. The number of EUS applications in the PNET work-up has been rapidly increasing with new and powerful possibilities. The application of contrast has led to an important step in PNET detection; in recent years, it has been gaining interesting applications in aggressiveness assessment. In this review, we underline the latest experiences and opportunities in the behavior assessment of PNETs using contact-enhanced EUS and contested enhanced harmonic EUS with a particular focus on the future application and possibility that these techniques could provide.

Semantic Segmentation of Pancreatic Cancer in Endoscopic Ultrasound Images Using Deep Learning Approach

Endoscopic ultrasonography (EUS) plays an important role in diagnosing pancreatic cancer. Surgical therapy is critical to pancreatic cancer survival and can be planned properly, with the characteristics of the target cancer determined. The physical characteristics of the pancreatic cancer, such as size, location, and shape, can be determined by semantic segmentation of EUS images. This study proposes a deep learning approach for the segmentation of pancreatic cancer in EUS images. EUS images were acquired from 150 patients diagnosed with pancreatic cancer. A network with deep attention features (DAF-Net) is proposed for pancreatic cancer segmentation using EUS images. The performance of the deep learning models (U-Net, Attention U-Net, and DAF-Net) was evaluated by 5-fold cross-validation. For the evaluation metrics, the Dice similarity coefficient (DSC), intersection over union (IoU), receiver operating characteristic (ROC) curve, and area under the curve (AUC) were chosen. Statistical analysis was performed for different stages and locations of the cancer. DAF-Net demonstrated superior segmentation performance for the DSC, IoU, AUC, sensitivity, specificity, and precision with scores of 82.8%, 72.3%, 92.7%, 89.0%, 98.1%, and 85.1%, respectively. The proposed deep learning approach can provide accurate segmentation of pancreatic cancer in EUS images and can effectively assist in the planning of surgical therapies.

Automated Recognition of Cancer Tissues through Deep Learning Framework from the Photoacoustic Specimen

The fast advancement of biomedical research technology has expanded and enhanced the spectrum of diagnostic instruments. Various research groups have found optical imaging, ultrasonic imaging, and magnetic resonance imaging to create multifunctional devices that are critical for biomedical activities. Multispectral photoacoustic imaging that integrates the ideas of optical and ultrasonic technologies is one of the most essential instruments. At the same time, early cancer identification is becoming increasingly important in order to minimize fatality. Deep learning (DL) techniques have recently advanced to the point where they can be used to diagnose and classify cancer using biological images. This paper describes a hybrid optimization method that combines in-depth transfer learning-based cancer detection with multispectral photoacoustic imaging. The goal of the PS-ACO-RNN approach is to use ultrasound images to detect and classify the presence of cancer. Bilateral filtration (BF) is often used as a noise removal approach in image processing. In addition, lightweight LEDNet models are used to separate the biological images. A feature extractor with particle swarm with ant colony optimization (PS-ACO) paradigm can also be used. Finally, biological images assign appropriate class labels using a recurrent neural network (RNN) model. The effectiveness of the PS-ACO-RNN technique is verified using a benchmark database, and test results show that the PS-ACO-RNN approach works better than current approaches.

Application of Artificial Intelligence in the Management of Pancreatic Cystic Lesions

The rate of incidentally detected pancreatic cystic lesions (PCLs) has increased over the past decade and was recently reported at 8%. These lesions pose a unique challenge, as each subtype of PCL carries a different risk of malignant transformation, ranging from 0% (pancreatic pseudocyst) to 34–68% (main duct intraductal papillary mucinous neoplasm). It is imperative to correctly risk-stratify the malignant potential of these lesions in order to provide the correct care course for the patient, ranging from monitoring to surgical intervention. Even with the multiplicity of guidelines (i.e., the American Gastroenterology Association guidelines and Fukuoka/International Consensus guidelines) and multitude of diagnostic information, risk stratification of PCLs falls short. Studies have reported that 25–64% of patients undergoing PCL resection have pancreatic cysts with no malignant potential, and up to 78% of mucin-producing cysts resected harbor no malignant potential on pathological evaluation. Clinicians are now incorporating artificial intelligence technology to aid in the management of these difficult lesions. This review article focuses on advancements in artificial intelligence within digital pathomics, radiomics, and genomics as they apply to the diagnosis and risk stratification of PCLs.