A deep learning model using hyperspectral image for EUS-FNA cytology diagnosis in pancreatic ductal adenocarcinoma

Unlocking the Potential of AI in EUS and ERCP: A Narrative Review for Pancreaticobiliary Disease

Artificial Intelligence (AI) is transforming pancreaticobiliary endoscopy by enhancing diagnostic accuracy, procedural efficiency, and clinical outcomes. This narrative review explores AI's applications in endoscopic ultrasound (EUS) and endoscopic retrograde cholangiopancreatography (ERCP), emphasizing its potential to address diagnostic and therapeutic challenges in pancreaticobiliary diseases. In EUS, AI improves pancreatic mass differentiation, malignancy prediction, and landmark recognition, demonstrating high diagnostic accuracy and outperforming traditional guidelines. In ERCP, AI facilitates precise biliary stricture identification, optimizes procedural techniques, and supports decision-making through real-time data integration, improving ampulla recognition and predicting cannulation difficulty. Additionally, predictive analytics help mitigate complications like post-ERCP pancreatitis. The future of AI in pancreaticobiliary endoscopy lies in multimodal data fusion, integrating imaging, genomic, and molecular data to enable personalized medicine. However, challenges such as data quality, external validation, clinician training, and ethical concerns-like data privacy and algorithmic bias-must be addressed to ensure safe implementation. By overcoming these challenges, AI has the potential to redefine pancreaticobiliary healthcare, improving diagnostic accuracy, therapeutic outcomes, and personalized care.

A semi-supervised convolutional neural network for diagnosis of pancreatic ductal adenocarcinoma based on EUS-FNA cytological images

BACKGROUND

The cytological diagnostic process of EUS-FNA smears is time-consuming and manpower-intensive, and the conclusion could be subjective and controversial. Moreover, the relative lack of cytopathologists has limited the widespread implementation of Rapid on-site evaluation (ROSE) presently. Therefore, this study aimed to establish an AI system for the detection of pancreatic ductal adenocarcinoma (PDAC) based on EUS-FNA cytological images.

METHODS

We collected 3213 unified magnification images of pancreatic cell clusters from 210 pancreatic mass patients who underwent EUS-FNA in four hospitals. A semi-supervised CNN (SSCNN) system was developed to distinguish PDAC from Non-PDAC. The internal and external verifications were adopted and the diagnostic accuracy was compared between different seniorities of cytopathologists. 33 images of "Atypical" diagnosed by expert cytopathologists were selected to analyze the consistency between the system and definitive diagnosis.

RESULTS

The segmentation indicators Mean Intersection over Union (mIou), precision, recall and F1-score of SSCNN in internal and external testing sets were 88.3%, 93.21%,94.24%, 93.68% and 87.75%, 93.81%, 93.14%, 93.48% successively. The PDAC classification indicators of the SSCNN model including area under the ROC curve (AUC), accuracy, sensitivity, specificity, PPV and NPV in the internal testing set were 0.97%, 0.95%, 0.94%, 0.97%, 0.98%, 0.91% respectively, and 0.99%, 0.94%, 0.94%, 0.95%, 0.99%, 0.75% correspondingly in the external testing set. The diagnostic accuracy of senior, intermediate and junior cytopathologists was 95.00%, 88.33% and 76.67% under the binary diagnostic criteria of PDAC and non-PDAC. In comparison, the accuracy of the SSCNN system was 90.00% in the dataset of man-machine competition. The accuracy of the SSCNN model was highly consistent with senior cytopathologists (Kappa = 0.853, P = 0.001). The accuracy, sensitivity and specificity of the system in the classification of "atypical" cases were 78.79%, 84.20% and 71.43% respectively.

CONCLUSION

Not merely tremendous preparatory work was drastically reduced, the semi-supervised CNN model could effectively identify PDAC cell clusters in EUS-FNA cytological smears which achieved analogically diagnostic capability compared with senior cytopathologists, and showed outstanding performance in assisting to categorize "atypical" cases where manual diagnosis is controversial.

TRIAL REGISTRATION

This study was registered on clinicaltrials.gov, and its unique Protocol ID was PJ-2018-12-17.

Artificial Intelligence in Pancreatic Imaging: A Systematic Review

The rising incidence of pancreatic diseases, including acute and chronic pancreatitis and various pancreatic neoplasms, poses a significant global health challenge. Pancreatic ductal adenocarcinoma (PDAC) for example, has a high mortality rate due to late-stage diagnosis and its inaccessible location. Advances in imaging technologies, though improving diagnostic capabilities, still necessitate biopsy confirmation. Artificial intelligence, particularly machine learning and deep learning, has emerged as a revolutionary force in healthcare, enhancing diagnostic precision and personalizing treatment. This narrative review explores Artificial intelligence's role in pancreatic imaging, its technological advancements, clinical applications, and associated challenges. Following the PRISMA-DTA guidelines, a comprehensive search of databases including PubMed, Scopus, and Cochrane Library was conducted, focusing on Artificial intelligence, machine learning, deep learning, and radiomics in pancreatic imaging. Articles involving human subjects, written in English, and published up to March 31, 2024, were included. The review process involved title and abstract screening, followed by full-text review and refinement based on relevance and novelty. Recent Artificial intelligence advancements have shown promise in detecting and diagnosing pancreatic diseases. Deep learning techniques, particularly convolutional neural networks (CNNs), have been effective in detecting and segmenting pancreatic tissues as well as differentiating between benign and malignant lesions. Deep learning algorithms have also been used to predict survival time, recurrence risk, and therapy response in pancreatic cancer patients. Radiomics approaches, extracting quantitative features from imaging modalities such as CT, MRI, and endoscopic ultrasound, have enhanced the accuracy of these deep learning models. Despite the potential of Artificial intelligence in pancreatic imaging, challenges such as legal and ethical considerations, algorithm transparency, and data security remain. This review underscores the transformative potential of Artificial intelligence in enhancing the diagnosis and treatment of pancreatic diseases, ultimately aiming to improve patient outcomes and survival rates.

Applications of Artificial Intelligence in Gastrointestinal Endoscopic Ultrasound: Current Developments, Limitations and Future Directions

Endoscopic ultrasound (EUS) effectively diagnoses malignant and pre-malignant gastrointestinal lesions. In the past few years, artificial intelligence (AI) has shown promising results in enhancing EUS sensitivity and accuracy, particularly for subepithelial lesions (SELs) like gastrointestinal stromal tumors (GISTs). Furthermore, AI models have shown high accuracy in predicting malignancy in gastric GISTs and distinguishing between benign and malignant intraductal papillary mucinous neoplasms (IPMNs). The utility of AI has also been applied to existing and emerging technologies involved in the performance and evaluation of EUS-guided biopsies. These advancements may improve training in EUS, allowing trainees to focus on technical skills and image interpretation. This review evaluates the current state of AI in EUS, covering imaging diagnosis, EUS-guided biopsies, and training advancements. It discusses early feasibility studies and recent developments, while also addressing the limitations and challenges. This article aims to review AI applications to EUS and its applications in clinical practice while addressing pitfalls and challenges.

Artificial Intelligence Applications in Cytopathology: Current State of the Art

The practice of cytopathology has been significantly refined in recent years, largely through the creation of consensus rule sets for the diagnosis of particular specimens (Bethesda, Milan, Paris, and so forth). In general, these diagnostic systems have focused on reducing intraobserver variance, removing nebulous/redundant categories, reducing the use of "atypical" diagnoses, and promoting the use of quantitative scoring systems while providing a uniform language to communicate these results. Computational pathology is a natural offshoot of this process in that it promises 100% reproducible diagnoses rendered by quantitative processes that are free from many of the biases of human practitioners.

Artificial intelligence in pancreaticobiliary endoscopy: Current applications and future directions

Pancreaticobiliary endoscopy is an essential tool for diagnosing and treating pancreaticobiliary diseases. However, it does not fully meet clinical needs, which presents challenges such as significant difficulty in operation and risks of missed diagnosis or misdiagnosis. In recent years, artificial intelligence (AI) has enhanced the diagnostic and treatment efficiency and quality of pancreaticobiliary endoscopy. Diagnosis and differential diagnosis based on endoscopic ultrasound (EUS) images, pathology of EUS-guided fine-needle aspiration or biopsy, need for endoscopic retrograde cholangiopancreatography (ERCP) and assessment of operational difficulty, postoperative complications and prediction of patient prognosis, and real-time procedure guidance. This review provides an overview of AI applications in pancreaticobiliary endoscopy and proposes future development directions in aspects such as data quality and algorithmic interpretability, aiming to provide new insights for the integration of AI technology with pancreaticobiliary endoscopy.

Investigation of the usefulness of a bile duct biopsy and bile cytology using a hyperspectral camera and machine learning

To improve the efficiency of pathological diagnoses, the development of automatic pathological diagnostic systems using artificial intelligence (AI) is progressing; however, problems include the low interpretability of AI technology and the need for large amounts of data. We herein report the usefulness of a general-purpose method that combines a hyperspectral camera with machine learning. As a result of analyzing bile duct biopsy and bile cytology specimens, which are especially difficult to determine as benign or malignant, using multiple machine learning models, both were able to identify benign or malignant cells with an accuracy rate of more than 80% (93.3% for bile duct biopsy specimens and 83.2% for bile cytology specimens). This method has the potential to contribute to the diagnosis and treatment of bile duct cancer and is expected to be widely applied and utilized in general pathological diagnoses.

Artificial Intelligence in Endoscopic Ultrasonography-Guided Fine-Needle Aspiration/Biopsy (EUS-FNA/B) for Solid Pancreatic Lesions: Opportunities and Challenges

Solid pancreatic lesions (SPLs) encompass a variety of benign and malignant diseases and accurate diagnosis is crucial for guiding appropriate treatment decisions. Endoscopic ultrasonography-guided fine-needle aspiration/biopsy (EUS-FNA/B) serves as a front-line diagnostic tool for pancreatic mass lesions and is widely used in clinical practice. Artificial intelligence (AI) is a mathematical technique that automates the learning and recognition of data patterns. Its strong self-learning ability and unbiased nature have led to its gradual adoption in the medical field. In this paper, we describe the fundamentals of AI and provide a summary of reports on AI in EUS-FNA/B to help endoscopists understand and realize its potential in improving pathological diagnosis and guiding targeted EUS-FNA/B. However, AI models have limitations and shortages that need to be addressed before clinical use. Furthermore, as most AI studies are retrospective, large-scale prospective clinical trials are necessary to evaluate their clinical usefulness accurately. Although AI in EUS-FNA/B is still in its infancy, the constant input of clinical data and the advancements in computer technology are expected to make computer-aided diagnosis and treatment more feasible.