1
|
Gomes RSA, de Oliveira GHP, de Moura DTH, Kotinda APST, Matsubayashi CO, Hirsch BS, Veras MDO, Ribeiro Jordão Sasso JG, Trasolini RP, Bernardo WM, de Moura EGH. Endoscopic ultrasound artificial intelligence-assisted for prediction of gastrointestinal stromal tumors diagnosis: A systematic review and meta-analysis. World J Gastrointest Endosc 2023; 15:528-539. [PMID: 37663113 PMCID: PMC10473903 DOI: 10.4253/wjge.v15.i8.528] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 03/16/2023] [Revised: 06/15/2023] [Accepted: 07/24/2023] [Indexed: 08/10/2023] Open
Abstract
BACKGROUND Subepithelial lesions (SELs) are gastrointestinal tumors with heterogeneous malignant potential. Endoscopic ultrasonography (EUS) is the leading method for evaluation, but without histopathological analysis, precise differentiation of SEL risk is limited. Artificial intelligence (AI) is a promising aid for the diagnosis of gastrointestinal lesions in the absence of histopathology. AIM To determine the diagnostic accuracy of AI-assisted EUS in diagnosing SELs, especially lesions originating from the muscularis propria layer. METHODS Electronic databases including PubMed, EMBASE, and Cochrane Library were searched. Patients of any sex and > 18 years, with SELs assessed by EUS AI-assisted, with previous histopathological diagnosis, and presented sufficient data values which were extracted to construct a 2 × 2 table. The reference standard was histopathology. The primary outcome was the accuracy of AI for gastrointestinal stromal tumor (GIST). Secondary outcomes were AI-assisted EUS diagnosis for GIST vs gastrointestinal leiomyoma (GIL), the diagnostic performance of experienced endoscopists for GIST, and GIST vs GIL. Pooled sensitivity, specificity, positive, and negative predictive values were calculated. The corresponding summary receiver operating characteristic curve and post-test probability were also analyzed. RESULTS Eight retrospective studies with a total of 2355 patients and 44154 images were included in this meta-analysis. The AI-assisted EUS for GIST diagnosis showed a sensitivity of 92% [95% confidence interval (CI): 0.89-0.95; P < 0.01), specificity of 80% (95%CI: 0.75-0.85; P < 0.01), and area under the curve (AUC) of 0.949. For diagnosis of GIST vs GIL by AI-assisted EUS, specificity was 90% (95%CI: 0.88-0.95; P = 0.02) and AUC of 0.966. The experienced endoscopists' values were sensitivity of 72% (95%CI: 0.67-0.76; P < 0.01), specificity of 70% (95%CI: 0.64-0.76; P < 0.01), and AUC of 0.777 for GIST. Evaluating GIST vs GIL, the experts achieved a sensitivity of 73% (95%CI: 0.65-0.80; P < 0.01) and an AUC of 0.819. CONCLUSION AI-assisted EUS has high diagnostic accuracy for fourth-layer SELs, especially for GIST, demonstrating superiority compared to experienced endoscopists' and improving their diagnostic performance in the absence of invasive procedures.
Collapse
Affiliation(s)
- Rômulo Sérgio Araújo Gomes
- Department of Gastroenterology, Hospital das Clínicas da Faculdade de Medicina da Universidade de São Paulo, São Paulo 05403-010, Brazil
| | | | - Diogo Turiani Hourneaux de Moura
- Department of Gastroenterology, Hospital das Clínicas da Faculdade de Medicina da Universidade de São Paulo, São Paulo 05403-010, Brazil
| | - Ana Paula Samy Tanaka Kotinda
- Department of Gastroenterology, Hospital das Clínicas da Faculdade de Medicina da Universidade de São Paulo, São Paulo 05403-010, Brazil
| | - Carolina Ogawa Matsubayashi
- Department of Gastroenterology, Hospital das Clínicas da Faculdade de Medicina da Universidade de São Paulo, São Paulo 05403-010, Brazil
| | - Bruno Salomão Hirsch
- Department of Gastroenterology, Hospital das Clínicas da Faculdade de Medicina da Universidade de São Paulo, São Paulo 05403-010, Brazil
| | - Matheus de Oliveira Veras
- Department of Gastroenterology, Hospital das Clínicas da Faculdade de Medicina da Universidade de São Paulo, São Paulo 05403-010, Brazil
| | | | - Roberto Paolo Trasolini
- Division of Hepatology and Endoscopy, Department of Gastroenterology, Harvard Medical School, Brigham and Women’s Hospital, Boston, MA 02115, United States
| | - Wanderley Marques Bernardo
- Department of Gastroenterology, Hospital das Clínicas da Faculdade de Medicina da Universidade de São Paulo, São Paulo 05403-010, Brazil
| | | |
Collapse
|
2
|
Zhang B, Zhu F, Li P, Zhu J. Artificial intelligence-assisted endoscopic ultrasound in the diagnosis of gastrointestinal stromal tumors: a meta-analysis. Surg Endosc 2023; 37:1649-1657. [PMID: 36100781 DOI: 10.1007/s00464-022-09597-w] [Citation(s) in RCA: 15] [Impact Index Per Article: 7.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/19/2022] [Accepted: 08/25/2022] [Indexed: 10/14/2022]
Abstract
BACKGROUND AND AIMS Endoscopic ultrasonography (EUS) is useful for the diagnosis of gastrointestinal stromal tumors (GISTs), but is limited by subjective interpretation. Studies on artificial intelligence (AI)-assisted diagnosis are under development. Here, we used a meta-analysis to evaluate the diagnostic performance of AI in the diagnosis of GISTs using EUS images. METHODS PubMed, Ovid Medline, Embase, Web of science, and the Cochrane Library databases were searched for studies based on the EUS using AI for the diagnosis of GISTs, and a meta-analysis was performed to examine the accuracy. RESULTS Overall, 7 studies were included in our meta-analysis. A total of 2431 patients containing more than 36,186 images were used as the overall dataset, of which 480 patients were used for the final testing. The pooled sensitivity, specificity, positive, and negative likelihood ratio (LR) of AI-assisted EUS for differentiating GISTs from other submucosal tumors (SMTs) were 0.92 (95% confidence interval [CI] 0.89-0.95), 0.82 (95% CI 0.75-0.87), 4.55 (95% CI 2.64-7.84), and 0.12 (95% CI 0.07-0.20), respectively. The summary diagnostic odds ratio (DOR) and the area under the curve were 64.70 (95% CI 23.83-175.69) and 0.950 (Q* = 0.891). CONCLUSIONS AI-assisted EUS showed high accuracy for the automatic endoscopic diagnosis of GISTs, which could be used as a valuable complementary method for the differentiation of SMTs in the future.
Collapse
Affiliation(s)
- Binglan Zhang
- Department of Gastroenterology, The First Affiliated Hospital of Chongqing Medical University, Chongqing, 400016, China
| | - Fuping Zhu
- Department of General Surgery, The Ninth People's Hospital of Chongqing, Chongqing, 400700, China
| | - Pan Li
- Department of Gastroenterology, The First Affiliated Hospital of Chongqing Medical University, Chongqing, 400016, China
| | - Jing Zhu
- Department of Oncology, The First Affiliated Hospital of Chongqing Medical University, Chongqing, 400016, China.
| |
Collapse
|
3
|
Pantelis AG, Panagopoulou PA, Lapatsanis DP. Artificial Intelligence and Machine Learning in the Diagnosis and Management of Gastroenteropancreatic Neuroendocrine Neoplasms-A Scoping Review. Diagnostics (Basel) 2022; 12:874. [PMID: 35453922 PMCID: PMC9027316 DOI: 10.3390/diagnostics12040874] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/27/2022] [Revised: 03/27/2022] [Accepted: 03/29/2022] [Indexed: 12/21/2022] Open
Abstract
Neuroendocrine neoplasms (NENs) and tumors (NETs) are rare neoplasms that may affect any part of the gastrointestinal system. In this scoping review, we attempt to map existing evidence on the role of artificial intelligence, machine learning and deep learning in the diagnosis and management of NENs of the gastrointestinal system. After implementation of inclusion and exclusion criteria, we retrieved 44 studies with 53 outcome analyses. We then classified the papers according to the type of studied NET (26 Pan-NETs, 59.1%; 3 metastatic liver NETs (6.8%), 2 small intestinal NETs, 4.5%; colorectal, rectal, non-specified gastroenteropancreatic and non-specified gastrointestinal NETs had from 1 study each, 2.3%). The most frequently used AI algorithms were Supporting Vector Classification/Machine (14 analyses, 29.8%), Convolutional Neural Network and Random Forest (10 analyses each, 21.3%), Random Forest (9 analyses, 19.1%), Logistic Regression (8 analyses, 17.0%), and Decision Tree (6 analyses, 12.8%). There was high heterogeneity on the description of the prediction model, structure of datasets, and performance metrics, whereas the majority of studies did not report any external validation set. Future studies should aim at incorporating a uniform structure in accordance with existing guidelines for purposes of reproducibility and research quality, which are prerequisites for integration into clinical practice.
Collapse
Affiliation(s)
- Athanasios G. Pantelis
- 4th Department of Surgery, Evaggelismos General Hospital of Athens, 10676 Athens, Greece;
| | | | - Dimitris P. Lapatsanis
- 4th Department of Surgery, Evaggelismos General Hospital of Athens, 10676 Athens, Greece;
| |
Collapse
|
4
|
Goto O, Kaise M, Iwakiri K. Advancements in the Diagnosis of Gastric Subepithelial Tumors. Gut Liver 2021; 16:321-330. [PMID: 34456187 PMCID: PMC9099397 DOI: 10.5009/gnl210242] [Citation(s) in RCA: 16] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 05/28/2021] [Revised: 06/29/2021] [Accepted: 07/06/2021] [Indexed: 11/04/2022] Open
Abstract
A diagnosis of subepithelial tumors (SETs) is sometimes difficult due to the existence of overlying mucosa on the lesions, which hampers optical diagnosis by conventional endoscopy and tissue sampling with standard biopsy forceps. Imaging modalities, by using computed tomography and endoscopic ultrasonography (EUS) are mandatory to noninvasively collect the target's information and to opt candidates for further evaluation. Particularly, EUS is an indispensable diagnostic modality for assessing the lesions precisely and evaluating the possibility of malignancy. The diagnostic ability of EUS appears increased by the combined use of contrast-enhancement or elastography. Histology is the gold standard for obtaining the final diagnosis. Tissue sampling requires special techniques to break the mucosal barrier. Although EUS-guided fine-needle aspiration (EUS-FNA) is commonly applied, mucosal cutting biopsy and mucosal incision-assisted biopsy are comparable methods to definitively obtain tissues from the exposed surface of lesions and seem more useful than EUS-FNA for small SETs. Recent advancements in artificial intelligence (AI) have a potential to drastically change the diagnostic strategy for SETs. Development and establishment of noninvasive methods including AI-assisted diagnosis are expected to provide an alternative to invasive, histological diagnosis.
Collapse
Affiliation(s)
- Osamu Goto
- Department of Gastroenterology, Graduate School of Medicine, Nippon Medical School, Tokyo, Japan
| | - Mitsuru Kaise
- Department of Gastroenterology, Graduate School of Medicine, Nippon Medical School, Tokyo, Japan
| | - Katsuhiko Iwakiri
- Department of Gastroenterology, Graduate School of Medicine, Nippon Medical School, Tokyo, Japan
| |
Collapse
|
5
|
Lee MW, Kim GH. Diagnosing Gastric Mesenchymal Tumors by Digital Endoscopic Ultrasonography Image Analysis. Clin Endosc 2021; 54:324-328. [PMID: 32549523 PMCID: PMC8182255 DOI: 10.5946/ce.2020.061] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 03/01/2020] [Revised: 04/02/2020] [Accepted: 04/02/2020] [Indexed: 12/13/2022] Open
Abstract
Gastric mesenchymal tumors (GMTs) are incidentally discovered in national gastric screening programs in Korea. Endoscopic ultrasonography (EUS) is the most useful diagnostic modality for evaluating GMTs. The differentiation of gastrointestinal stromal tumors from benign mesenchymal tumors, such as schwannomas or leiomyomas, is important to ensure appropriate clinical management. However, this is difficult and operator dependent because of the subjective interpretation of EUS images. Digital image analysis computes the distribution and spatial variation of pixels using texture analysis to extract useful data, enabling the objective analysis of EUS images and decreasing interobserver and intraobserver agreement in EUS image interpretation. This review aimed to summarize the usefulness and future of digital EUS image analysis for GMTs based on published reports and our experience.
Collapse
Affiliation(s)
- Moon Won Lee
- Department of Internal Medicine, Pusan National University School of Medicine and Biomedical Research Institute, Pusan National University Hospital, Busan, Korea
| | - Gwang Ha Kim
- Department of Internal Medicine, Pusan National University School of Medicine and Biomedical Research Institute, Pusan National University Hospital, Busan, Korea
| |
Collapse
|
6
|
Momeni-Boroujeni A, Yousefi E, Somma J. Computer-assisted cytologic diagnosis in pancreatic FNA: An application of neural networks to image analysis. Cancer Cytopathol 2017; 125:926-933. [PMID: 28885766 DOI: 10.1002/cncy.21915] [Citation(s) in RCA: 32] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/12/2017] [Revised: 08/05/2017] [Accepted: 08/07/2017] [Indexed: 12/14/2022]
Abstract
BACKGROUND Fine-needle aspiration (FNA) biopsy is an accurate method for the diagnosis of solid pancreatic masses. However, a significant number of cases still pose a diagnostic challenge. The authors have attempted to design a computer model to aid in the diagnosis of these biopsies. METHODS Images were captured of cell clusters on ThinPrep slides from 75 pancreatic FNA cases (20 malignant, 24 benign, and 31 atypical). A K-means clustering algorithm was used to segment the cell clusters into separable regions of interest before extracting features similar to those used for cytomorphologic assessment. A multilayer perceptron neural network (MNN) was trained and then tested for its ability to distinguish benign from malignant cases. RESULTS A total of 277 images of cell clusters were obtained. K-means clustering identified 68,301 possible regions of interest overall. Features such as contour, perimeter, and area were found to be significantly different between malignant and benign images (P <.05). The MNN was 100% accurate for benign and malignant categories. The model's predictions from the atypical data set were 77% accurate. CONCLUSIONS The results of the current study demonstrate that computer models can be used successfully to distinguish benign from malignant pancreatic cytology. The fact that the model can categorize atypical cases into benign or malignant with 77% accuracy highlights the great potential of this technology. Although further study is warranted to validate its clinical applications in pancreatic and perhaps other areas of cytology as well, the potential for improved patient outcomes using MNN for image analysis in pathology is significant. Cancer Cytopathol 2017;125:926-33. © 2017 American Cancer Society.
Collapse
Affiliation(s)
| | - Elham Yousefi
- Department of Pathology, SUNY Downstate Medical Center, Brooklyn, New York
| | - Jonathan Somma
- Department of Pathology, SUNY Downstate Medical Center, Brooklyn, New York
| |
Collapse
|
7
|
Alic L, Niessen WJ, Veenland JF. Quantification of heterogeneity as a biomarker in tumor imaging: a systematic review. PLoS One 2014; 9:e110300. [PMID: 25330171 PMCID: PMC4203782 DOI: 10.1371/journal.pone.0110300] [Citation(s) in RCA: 110] [Impact Index Per Article: 10.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/26/2014] [Accepted: 09/15/2014] [Indexed: 12/14/2022] Open
Abstract
BACKGROUND Many techniques are proposed for the quantification of tumor heterogeneity as an imaging biomarker for differentiation between tumor types, tumor grading, response monitoring and outcome prediction. However, in clinical practice these methods are barely used. This study evaluates the reported performance of the described methods and identifies barriers to their implementation in clinical practice. METHODOLOGY The Ovid, Embase, and Cochrane Central databases were searched up to 20 September 2013. Heterogeneity analysis methods were classified into four categories, i.e., non-spatial methods (NSM), spatial grey level methods (SGLM), fractal analysis (FA) methods, and filters and transforms (F&T). The performance of the different methods was compared. PRINCIPAL FINDINGS Of the 7351 potentially relevant publications, 209 were included. Of these studies, 58% reported the use of NSM, 49% SGLM, 10% FA, and 28% F&T. Differentiation between tumor types, tumor grading and/or outcome prediction was the goal in 87% of the studies. Overall, the reported area under the curve (AUC) ranged from 0.5 to 1 (median 0.87). No relation was found between the performance and the quantification methods used, or between the performance and the imaging modality. A negative correlation was found between the tumor-feature ratio and the AUC, which is presumably caused by overfitting in small datasets. Cross-validation was reported in 63% of the classification studies. Retrospective analyses were conducted in 57% of the studies without a clear description. CONCLUSIONS In a research setting, heterogeneity quantification methods can differentiate between tumor types, grade tumors, and predict outcome and monitor treatment effects. To translate these methods to clinical practice, more prospective studies are required that use external datasets for validation: these datasets should be made available to the community to facilitate the development of new and improved methods.
Collapse
Affiliation(s)
- Lejla Alic
- Biomedical Imaging Group Rotterdam, Department of Radiology and Medical Informatics, Erasmus Medical Center Rotterdam, Rotterdam, The Netherlands
- Department of Intelligent Imaging, Netherlands Organization for Applied Scientific Research (TNO), The Hague, The Netherlands
| | - Wiro J. Niessen
- Biomedical Imaging Group Rotterdam, Department of Radiology and Medical Informatics, Erasmus Medical Center Rotterdam, Rotterdam, The Netherlands
- Imaging Physics, Faculty of Applied Sciences, Delft University of Technology, Delft, The Netherlands
| | - Jifke F. Veenland
- Biomedical Imaging Group Rotterdam, Department of Radiology and Medical Informatics, Erasmus Medical Center Rotterdam, Rotterdam, The Netherlands
| |
Collapse
|
8
|
Kim GH, Kim KB, Lee SH, Jeon HK, Park DY, Jeon TY, Kim DH, Song GA. Digital image analysis of endoscopic ultrasonography is helpful in diagnosing gastric mesenchymal tumors. BMC Gastroenterol 2014; 14:7. [PMID: 24400772 PMCID: PMC3890630 DOI: 10.1186/1471-230x-14-7] [Citation(s) in RCA: 25] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 02/20/2013] [Accepted: 01/03/2014] [Indexed: 12/31/2022] Open
Abstract
BACKGROUND Endoscopic ultrasonography (EUS) is a valuable imaging tool for evaluating subepithelial lesions in the stomach. However, there are few studies on differentiation between gastrointestinal stromal tumors (GISTs) and benign mesenchymal tumors, such as leiomyoma or schwannoma, with the use of EUS. In addition, there are limitations in the analysis of the characteristic features of such tumors due to poor interobserver agreement as a result of subjective interpretation of EUS images. Therefore, the aim of this study was to evaluate the role of digital image analysis in distinguishing the features of GISTs from those of benign mesenchymal tumors on EUS. METHODS We enrolled 65 patients with histopathologically proven gastric GIST, leiomyoma or schwannoma on surgically resected specimens who underwent EUS examination at our endoscopic unit from January 2007 to September 2010. After standardization of the EUS images, brightness values including the mean (Tmean), indicative of echogenicity, and the standard deviation (TSD), indicative of heterogeneity, in the tumors were analyzed. RESULTS The Tmean and TSD were significantly higher in GIST than in leiomyoma and schwannoma (p < 0.001). However, there was no significant difference in the Tmean or TSD between benign and malignant GISTs. The sensitivity and specificity were almost optimized for differentiating GIST from leiomyoma or schwannoma when the critical values of Tmean and TSD were 65 and 75, respectively. The presence of at least 1 of these 2 findings in a given tumor resulted in a sensitivity of 94%, specificity of 80%, positive predictive value of 94%, negative predictive value of 80%, and accuracy of 90.8% for predicting GIST. CONCLUSIONS Digital image analysis provides objective information on EUS images; thus, it can be useful in diagnosing gastric mesenchymal tumors.
Collapse
Affiliation(s)
- Gwang Ha Kim
- Department of Internal Medicine, Pusan National University School of Medicine and Biomedical Research Institute, Pusan National University Hospital, Busan, Korea
| | - Kwang Baek Kim
- Division of Computer Engineering, Silla University, Busan, Korea
| | - Seung Hyun Lee
- Department of Internal Medicine, Pusan National University School of Medicine and Biomedical Research Institute, Pusan National University Hospital, Busan, Korea
| | - Hye Kyung Jeon
- Department of Internal Medicine, Pusan National University School of Medicine and Biomedical Research Institute, Pusan National University Hospital, Busan, Korea
| | - Do Youn Park
- Department of Pathology, Pusan National University School of Medicine, Busan, Korea
| | - Tae Yong Jeon
- Department of Surgery, Pusan National University School of Medicine, Busan, Korea
| | - Dae Hwan Kim
- Department of Surgery, Pusan National University School of Medicine, Busan, Korea
| | - Geun Am Song
- Department of Internal Medicine, Pusan National University School of Medicine and Biomedical Research Institute, Pusan National University Hospital, Busan, Korea
| |
Collapse
|
9
|
Fusaroli P, Saftoiu A, Mancino MG, Caletti G, Eloubeidi MA. Techniques of image enhancement in EUS (with videos). Gastrointest Endosc 2011; 74:645-655. [PMID: 21679945 DOI: 10.1016/j.gie.2011.03.1246] [Citation(s) in RCA: 40] [Impact Index Per Article: 2.9] [Reference Citation Analysis] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 02/07/2011] [Accepted: 03/25/2011] [Indexed: 02/08/2023]
Affiliation(s)
- Pietro Fusaroli
- Department of Clinical Medicine, Gastroenterology Unit, University of Bologna/Hospital of Imola, Bologna, Italy
| | | | | | | | | |
Collapse
|