Real-Time Use of Artificial Intelligence in Identification of Diminutive Polyps During Colonoscopy: A Prospective Study

Role of Artificial Intelligence Applications in Real-Life Clinical Practice: Systematic Review

BACKGROUND

Artificial intelligence (AI) applications are growing at an unprecedented pace in health care, including disease diagnosis, triage or screening, risk analysis, surgical operations, and so forth. Despite a great deal of research in the development and validation of health care AI, only few applications have been actually implemented at the frontlines of clinical practice.

OBJECTIVE

The objective of this study was to systematically review AI applications that have been implemented in real-life clinical practice.

METHODS

We conducted a literature search in PubMed, Embase, Cochrane Central, and CINAHL to identify relevant articles published between January 2010 and May 2020. We also hand searched premier computer science journals and conferences as well as registered clinical trials. Studies were included if they reported AI applications that had been implemented in real-world clinical settings.

RESULTS

We identified 51 relevant studies that reported the implementation and evaluation of AI applications in clinical practice, of which 13 adopted a randomized controlled trial design and eight adopted an experimental design. The AI applications targeted various clinical tasks, such as screening or triage (n=16), disease diagnosis (n=16), risk analysis (n=14), and treatment (n=7). The most commonly addressed diseases and conditions were sepsis (n=6), breast cancer (n=5), diabetic retinopathy (n=4), and polyp and adenoma (n=4). Regarding the evaluation outcomes, we found that 26 studies examined the performance of AI applications in clinical settings, 33 studies examined the effect of AI applications on clinician outcomes, 14 studies examined the effect on patient outcomes, and one study examined the economic impact associated with AI implementation.

CONCLUSIONS

This review indicates that research on the clinical implementation of AI applications is still at an early stage despite the great potential. More research needs to assess the benefits and challenges associated with clinical AI applications through a more rigorous methodology.

A review of water exchange and artificial intelligence in improving adenoma detection

Water exchange (WE) and artificial intelligence (AI) have made critical advances during the past decade. WE significantly increases adenoma detection and AI holds the potential to help endoscopists detect more polyps and adenomas. We performed an electronic literature search on PubMed using the following keywords: water-assisted and water exchange colonoscopy, adenoma and polyp detection, artificial intelligence, deep learning, neural networks, and computer-aided colonoscopy. We reviewed relevant articles published in English from 2010 to May 2020. Additional articles were searched manually from the reference lists of the publications reviewed. We discussed recent advances in both WE and AI, including their advantages and limitations. AI may mitigate operator-dependent factors that limit the potential of WE. By increasing bowel cleanliness and improving visualization, WE may provide the platform to optimize the performance of AI for colonoscopies. The strengths of WE and AI may complement each other in spite of their weaknesses to maximize adenoma detection.

Usefulness of mean number of adenomas per positive screenee for identifying meticulous endoscopists among those who achieve acceptable adenoma detection rates

BACKGROUND

Adenoma detection rate (ADR) is a quality indicator for colonoscopy. However, many missed adenomas have subsequently been identified after colonoscopies performed by endoscopists with ADR ≥ 25 %. Adenomas per positive participant (APP; mean number of adenomas detected by an endoscopist among screenees with positive findings) correlates well inversely with adenoma miss rate. This study aimed to evaluate whether APP added additional information on the detection rate for advanced adenomas (AADR) and proximal adenomas (pADR) and among endoscopists with acceptable ADRs (≥ 25 %).

METHODS

A total of 47 endoscopists performed 7339 screening colonoscopies that were retrospectively reviewed. Using a cutoff APP value of 2.0, endoscopist performance was classified as high or low APP. Endoscopist ADRs were also classified as acceptable (25 % - 29 %), high standard (30 % - 39 %) and aspirational (≥ 40 %). Generalized linear models were used to assess the relationship between AADR or pADR, and ADR and APP, after adjusting for potential confounders.

RESULTS

After adjusting for endoscopist performance and patient characteristics, endoscopists with high APP had a significant 2.1 percentage point increase in AADR (95 %CI 0.3 to 3.9; P = 0.02) and a 2.1 percentage point increase in pADR (95 %CI - 0.8 to 5.1; P = 0.15) compared to endoscopists with low APP. In total, 11 (24 %), 18 (38 %), and 18 (38 %) endoscopists were classified as having acceptable, high standard, and aspirational ADRs, respectively. APP values higher than the cutoff were found in 18 %, 44 %, and 72 % of endoscopists with acceptable, high standard, and aspirational ADRs, respectively (P = 0.02).

CONCLUSION

APP is helpful for identifying more meticulous endoscopists who can detect a greater number of advanced adenomas. Endoscopists who achieved an only acceptable ADR had the lowest APP.

Development of a computer-aided detection system for colonoscopy and a publicly accessible large colonoscopy video database (with video)

BACKGROUND AND AIMS

Artificial intelligence (AI)-assisted polyp detection systems for colonoscopic use are currently attracting attention because they may reduce the possibility of missed adenomas. However, few systems have the necessary regulatory approval for use in clinical practice. We aimed to develop an AI-assisted polyp detection system and to validate its performance using a large colonoscopy video database designed to be publicly accessible.

METHODS

To develop the deep learning-based AI system, 56,668 independent colonoscopy images were obtained from 5 centers for use as training images. To validate the trained AI system, consecutive colonoscopy videos taken at a university hospital between October 2018 and January 2019 were searched to construct a database containing polyps with unbiased variance. All images were annotated by endoscopists according to the presence or absence of polyps and the polyps' locations with bounding boxes.

RESULTS

A total of 1405 videos acquired during the study period were identified for the validation database, 797 of which contained at least 1 polyp. Of these, 100 videos containing 100 independent polyps and 13 videos negative for polyps were randomly extracted, resulting in 152,560 frames (49,799 positive frames and 102,761 negative frames) for the database. The AI showed 90.5% sensitivity and 93.7% specificity for frame-based analysis. The per-polyp sensitivities for all, diminutive, protruded, and flat polyps were 98.0%, 98.3%, 98.5%, and 97.0%, respectively.

CONCLUSIONS

Our trained AI system was validated with a new large publicly accessible colonoscopy database and could identify colorectal lesions with high sensitivity and specificity. (Clinical trial registration number: UMIN 000037064.).

Validation of the European Laryngological Society classification of glottic vascular changes as seen by narrow band imaging in the optical biopsy setting

Purpose

In 2016, the European Laryngological Society (ELS) proposed a classification for vascular changes occurring in glottic lesions as visible by narrow band imaging (NBI), based on the dichotomic distinction between longitudinal vessels (not suspicious) and perpendicular ones (suspicious). The aim of our study was to validate this classification assessing the interobserver agreement and diagnostic test performance in detecting the final histopathology.

Methods

A retrospective study was carried out by reviewing clinical charts, preoperative videos, and final pathologic diagnosis of patients submitted to transoral microsurgery for laryngeal lesions in two Italian referral centers. In each institution, two physicians, independently re-assessed each case applying the ELS classification.

Results

The cohort was composed of 707 patients. The pathologic report showed benign lesions in 208 (29.5%) cases, papillomatosis in 34 (4.8%), squamous intraepithelial neoplasia (SIN) up to carcinoma in situ in 200 (28.2%), and squamous cell carcinoma (SCC) in 265 (37.5%). The interobserver agreement was extremely high in both institutions (k = 0.954, p < 0.001 and k = 0.880, p < 0.001). Considering the diagnostic performance for identification of at least SIN or SCC, the sensitivity was 0.804 and 0.902, the specificity 0.793 and 0.581, the positive predictive value 0.882 and 0.564, and the negative predictive value 0.678 and 0.908, respectively.

Conclusion

The ELS classification for NBI vascular changes of glottic lesions is a highly reliable tool whose systematic use allows a better diagnostic evaluation of suspicious laryngeal lesions, reliably distinguishing benign ones from those with a diagnosis of papillomatosis, SIN or SCC, thus paving the way towards confirmation of the optical biopsy concept.

A hierarchical deep learning approach with transparency and interpretability based on small samples for glaucoma diagnosis

The application of deep learning algorithms for medical diagnosis in the real world faces challenges with transparency and interpretability. The labeling of large-scale samples leads to costly investment in developing deep learning algorithms. The application of human prior knowledge is an effective way to solve these problems. Previously, we developed a deep learning system for glaucoma diagnosis based on a large number of samples that had high sensitivity and specificity. However, it is a black box and the specific analytic methods cannot be elucidated. Here, we establish a hierarchical deep learning system based on a small number of samples that comprehensively simulates the diagnostic thinking of human experts. This system can extract the anatomical characteristics of the fundus images, including the optic disc, optic cup, and appearance of the retinal nerve fiber layer to realize automatic diagnosis of glaucoma. In addition, this system is transparent and interpretable, and the intermediate process of prediction can be visualized. Applying this system to three validation datasets of fundus images, we demonstrate performance comparable to that of human experts in diagnosing glaucoma. Moreover, it markedly improves the diagnostic accuracy of ophthalmologists. This system may expedite the screening and diagnosis of glaucoma, resulting in improved clinical outcomes.

Real-Time Polyp Detection, Localization and Segmentation in Colonoscopy Using Deep Learning

Computer-aided detection, localisation, and segmentation methods can help improve colonoscopy procedures. Even though many methods have been built to tackle automatic detection and segmentation of polyps, benchmarking of state-of-the-art methods still remains an open problem. This is due to the increasing number of researched computer vision methods that can be applied to polyp datasets. Benchmarking of novel methods can provide a direction to the development of automated polyp detection and segmentation tasks. Furthermore, it ensures that the produced results in the community are reproducible and provide a fair comparison of developed methods. In this paper, we benchmark several recent state-of-the-art methods using Kvasir-SEG, an open-access dataset of colonoscopy images for polyp detection, localisation, and segmentation evaluating both method accuracy and speed. Whilst, most methods in literature have competitive performance over accuracy, we show that the proposed ColonSegNet achieved a better trade-off between an average precision of 0.8000 and mean IoU of 0.8100, and the fastest speed of 180 frames per second for the detection and localisation task. Likewise, the proposed ColonSegNet achieved a competitive dice coefficient of 0.8206 and the best average speed of 182.38 frames per second for the segmentation task. Our comprehensive comparison with various state-of-the-art methods reveals the importance of benchmarking the deep learning methods for automated real-time polyp identification and delineations that can potentially transform current clinical practices and minimise miss-detection rates.

Preoperative identification of microvascular invasion in hepatocellular carcinoma by XGBoost and deep learning

PURPOSE

Microvascular invasion (MVI) is a valuable predictor of survival in hepatocellular carcinoma (HCC) patients. This study developed predictive models using eXtreme Gradient Boosting (XGBoost) and deep learning based on CT images to predict MVI preoperatively.

METHODS

In total, 405 patients were included. A total of 7302 radiomic features and 17 radiological features were extracted by a radiomics feature extraction package and radiologists, respectively. We developed a XGBoost model based on radiomics features, radiological features and clinical variables and a three-dimensional convolutional neural network (3D-CNN) to predict MVI status. Next, we compared the efficacy of the two models.

RESULTS

Of the 405 patients, 220 (54.3%) were MVI positive, and 185 (45.7%) were MVI negative. The areas under the receiver operating characteristic curves (AUROCs) of the Radiomics-Radiological-Clinical (RRC) Model and 3D-CNN Model in the training set were 0.952 (95% confidence interval (CI) 0.923-0.973) and 0.980 (95% CI 0.959-0.993), respectively (p = 0.14). The AUROCs of the RRC Model and 3D-CNN Model in the validation set were 0.887 (95% CI 0.797-0.947) and 0.906 (95% CI 0.821-0.960), respectively (p = 0.83). Based on the MVI status predicted by the RRC and 3D-CNN Models, the mean recurrence-free survival (RFS) was significantly better in the predicted MVI-negative group than that in the predicted MVI-positive group (RRC Model: 69.95 vs. 24.80 months, p < 0.001; 3D-CNN Model: 64.06 vs. 31.05 months, p = 0.027).

CONCLUSION

The RRC Model and 3D-CNN models showed considerable efficacy in identifying MVI preoperatively. These machine learning models may facilitate decision-making in HCC treatment but requires further validation.

Artificial intelligence in the diagnosis and management of hepatocellular carcinoma

Despite recent improvements in therapeutic interventions, hepatocellular carcinoma is still associated with a poor prognosis in patients with an advanced disease at diagnosis. Recently, significant progress has been made in image recognition through advances in the field of artificial intelligence (AI) (or machine learning), especially deep learning. AI is a multidisciplinary field that draws on the fields of computer science and mathematics for developing and implementing computer algorithms capable of maximizing the predictive accuracy from static or dynamic data sources using analytic or probabilistic models. Because of the multifactorial and complex nature of liver diseases, the machine learning approach to integrate multiple factors would appear to be an advantageous approach to improve the likelihood of making a precise diagnosis and predicting the response of treatment and prognosis of liver diseases. In this review, we attempted to summarize the potential use of AI in the diagnosis and management of liver diseases, especially hepatocellular carcinoma.

Opening the black box of AI-Medicine

One of the biggest challenges of utilizing artificial intelligence (AI) in medicine is that physicians are reluctant to trust and adopt something that they do not fully understand and regarded as a "black box." Machine Learning (ML) can assist in reading radiological, endoscopic and histological pictures, suggesting diagnosis and predict disease outcome, and even recommending therapy and surgical decisions. However, clinical adoption of these AI tools has been slow because of a lack of trust. Besides clinician's doubt, patients lacking confidence with AI-powered technologies also hamper development. While they may accept the reality that human errors can occur, little tolerance of machine error is anticipated. In order to implement AI medicine successfully, interpretability of ML algorithm needs to improve. Opening the black box in AI medicine needs to take a stepwise approach. Small steps of biological explanation and clinical experience in ML algorithm can help to build trust and acceptance. AI software developers will have to clearly demonstrate that when the ML technologies are integrated into the clinical decision-making process, they can actually help to improve clinical outcome. Enhancing interpretability of ML algorithm is a crucial step in adopting AI in medicine.

Real-time artificial intelligence-based histologic classification of colorectal polyps with augmented visualization

BACKGROUND AND AIMS

Artificial intelligence (AI)-based computer-aided diagnostic (CADx) algorithms are a promising approach for real-time histology (RTH) of colonic polyps. Our aim is to present a novel in situ CADx approach that seeks to increase transparency and interpretability of results by generating an intuitive augmented visualization of the model's predicted histology over the polyp surface.

METHODS

We developed a deep learning model using semantic segmentation to delineate polyp boundaries and a deep learning model to classify subregions within the segmented polyp. These subregions were classified independently and were subsequently aggregated to generate a histology map of the polyp's surface. We used 740 high-magnification narrow-band images from 607 polyps in 286 patients and over 65,000 subregions to train and validate the model.

RESULTS

The model achieved a sensitivity of .96, specificity of .84, negative predictive value (NPV) of .91, and high-confidence rate (HCR) of .88, distinguishing 171 neoplastic polyps from 83 non-neoplastic polyps of all sizes. Among 93 neoplastic and 75 non-neoplastic polyps ≤5 mm, the model achieved a sensitivity of .95, specificity of .84, NPV of .91, and HCR of .86.

CONCLUSIONS

The CADx model is capable of accurately distinguishing neoplastic from non-neoplastic polyps and provides a histology map of the spatial distribution of localized histologic predictions along the delineated polyp surface. This capability may improve interpretability and transparency of AI-based RTH and offer intuitive, accurate, and user-friendly guidance in real time for the clinical management and documentation of optical histology results.

[Application of artificial intelligence for detection and classification of colon polyps]

Colorectal cancer is one of the most common cancers worldwide, and colonoscopy has proven to be a preferable modality for screening and surveillance of colorectal cancer. This review discusses the clinical application of artificial intelligence (AI) and computer-aided diagnosis for automated colonoscopic detection and diagnosis of colorectal polyps for better understanding of the application of AI-based computer-aided diagnosis systems especially in terms of machine learning, deep learning and convolutional neural network for screening and surveillance of colorectal cancer.

Application of Deep Learning for Diagnosing, Classifying, and Treating Age-Related Macular Degeneration

Age-related macular degeneration (AMD) affects nearly 200 million people and is the third leading cause of irreversible vision loss worldwide. Deep learning, a branch of artificial intelligence that can learn image recognition based on pre-existing datasets, creates an opportunity for more accurate and efficient diagnosis, classification, and treatment of AMD on both individual and population levels. Current algorithms based on fundus photography and optical coherence tomography imaging have already achieved diagnostic accuracy levels comparable to human graders. This accuracy can be further increased when deep learning algorithms are simultaneously applied to multiple diagnostic imaging modalities. Combined with advances in telemedicine and imaging technology, deep learning can enable large populations of patients to be screened than would otherwise be possible and allow ophthalmologists to focus on seeing those patients who are in need of treatment, thus reducing the number of patients with significant visual impairment from AMD.

Colorectal polyp characterization with standard endoscopy: Will Artificial Intelligence succeed where human eyes failed?

The American Society for Gastrointestinal Endoscopy (ASGE) has proposed the "resect-and-discard" and "diagnose-and-leave" strategies for diminutive colorectal polyps to reduce the costs of unnecessary polyp resection and pathology evaluation. However, the diagnostic thresholds set by these guidelines are not always met in community practice. To overcome this sub-optimal performance, artificial intelligence (AI) has been applied to the field of endoscopy. The incorporation of deep learning algorithms with AI models resulted in highly accurate systems that match the expert endoscopists' optical biopsy and exceed the ASGE recommended thresholds. Recent studies have demonstrated that the integration of AI in clinical practice results in significant improvement in endoscopists' diagnostic accuracy while reducing the time to make a diagnosis. Yet, several points need to be addressed before AI models can be successfully implemented in clinical practice. In this review, we summarize the recent literature on the application of AI for characterization of colorectal polyps, and review the current limitation and future directions for this field.

Comparison of diagnostic performance between convolutional neural networks and human endoscopists for diagnosis of colorectal polyp: A systematic review and meta-analysis

Prospective randomized trials and observational studies have revealed that early detection, classification, and removal of neoplastic colorectal polyp (CP) significantly improve the prevention of colorectal cancer (CRC). The current effectiveness of the diagnostic performance of colonoscopy remains unsatisfactory with unstable accuracy. The convolutional neural networks (CNN) system based on artificial intelligence (AI) technology has demonstrated its potential to help endoscopists in increasing diagnostic accuracy. Nonetheless, several limitations of the CNN system and controversies exist on whether it provides a better diagnostic performance compared to human endoscopists. Therefore, this study sought to address this issue. Online databases (PubMed, Web of Science, Cochrane Library, and EMBASE) were used to search for studies conducted up to April 2020. Besides, the quality assessment of diagnostic accuracy scale-2 (QUADAS-2) was used to evaluate the quality of the enrolled studies. Moreover, publication bias was determined using the Deeks' funnel plot. In total, 13 studies were enrolled for this meta-analysis (ranged between 2016 and 2020). Consequently, the CNN system had a satisfactory diagnostic performance in the field of CP detection (sensitivity: 0.848 [95% CI: 0.692-0.932]; specificity: 0.965 [95% CI: 0.946-0.977]; and AUC: 0.98 [95% CI: 0.96-0.99]) and CP classification (sensitivity: 0.943 [95% CI: 0.927-0.955]; specificity: 0.894 [95% CI: 0.631-0.977]; and AUC: 0.95 [95% CI: 0.93-0.97]). In comparison with human endoscopists, the CNN system was comparable to the expert but significantly better than the non-expert in the field of CP classification (CNN vs. expert: RDOR: 1.03, P = 0.9654; non-expert vs. expert: RDOR: 0.29, P = 0.0559; non-expert vs. CNN: 0.18, P = 0.0342). Therefore, the CNN system exhibited a satisfactory diagnostic performance for CP and could be used as a potential clinical diagnostic tool during colonoscopy.

A novel machine learning-based algorithm to identify and classify lesions and anatomical landmarks in colonoscopy images

OBJECTIVES

Computer-aided diagnosis (CAD)-based artificial intelligence (AI) has been shown to be highly accurate for detecting and characterizing colon polyps. However, the application of AI to identify normal colon landmarks and differentiate multiple colon diseases has not yet been established. We aimed to develop a convolutional neural network (CNN)-based algorithm (GUTAID) to recognize different colon lesions and anatomical landmarks.

METHODS

Colonoscopic images were obtained to train and validate the AI classifiers. An independent dataset was collected for verification. The architecture of GUTAID contains two major sub-models: the Normal, Polyp, Diverticulum, Cecum and CAncer (NPDCCA) and Narrow-Band Imaging for Adenomatous/Hyperplastic polyps (NBI-AH) models. The development of GUTAID was based on the 16-layer Visual Geometry Group (VGG16) architecture and implemented on Google Cloud Platform.

RESULTS

In total, 7838 colonoscopy images were used for developing and validating the AI model. An additional 1273 images were independently applied to verify the GUTAID. The accuracy for GUTAID in detecting various colon lesions/landmarks is 93.3% for polyps, 93.9% for diverticula, 91.7% for cecum, 97.5% for cancer, and 83.5% for adenomatous/hyperplastic polyps.

CONCLUSIONS

A CNN-based algorithm (GUTAID) to identify colonic abnormalities and landmarks was successfully established with high accuracy. This GUTAID system can further characterize polyps for optical diagnosis. We demonstrated that AI classification methodology is feasible to identify multiple and different colon diseases.

Overcoming barriers to implementation of artificial intelligence in gastroenterology

Artificial intelligence is poised to revolutionize the field of medicine, however significant questions must be answered prior to its implementation on a regular basis. Many artificial intelligence algorithms remain limited by isolated datasets which may cause selection bias and truncated learning for the program. While a central database may solve this issue, several barriers such as security, patient consent, and management structure prevent this from being implemented. An additional barrier to daily use is device approval by the Food and Drug Administration. In order for this to occur, clinical studies must address new endpoints, including and beyond the traditional bio- and medical statistics. These must showcase artificial intelligence's benefit and answer key questions, including challenges posed in the field of medical ethics.

Clinically Available Optical Imaging Technologies in Endoscopic Lesion Detection: Current Status and Future Perspective

Endoscopic optical imaging technologies for the detection and evaluation of dysplasia and early cancer have made great strides in recent decades. With the capacity of in vivo early detection of subtle lesions, they allow modern endoscopists to provide accurate and effective optical diagnosis in real time. This review mainly analyzes the current status of clinically available endoscopic optical imaging techniques, with emphasis on the latest updates of existing techniques. We summarize current coverage of these technologies in major hospital departments such as gastroenterology, urology, gynecology, otolaryngology, pneumology, and laparoscopic surgery. In order to promote a broader understanding, we further cover the underlying principles of these technologies and analyze their performance. Moreover, we provide a brief overview of future perspectives in related technologies, such as computer-assisted diagnosis (CAD) algorithms dealing with exploring endoscopic video data. We believe all these efforts will benefit the healthcare of the community, help endoscopists improve the accuracy of diagnosis, and relieve patients' suffering.

Application of Artificial Intelligence in Gastrointestinal Endoscopy

Artificial intelligence (AI), also known as computer-aided diagnosis, is a technology that enables machines to process information and functions at or above human level and has great potential in gastrointestinal endoscopy applications. At present, the research on medical image recognition usually adopts the deep-learning algorithm based on the convolutional neural network. AI has been used in gastrointestinal endoscopy including esophagogastroduodenoscopy, capsule endoscopy, colonoscopy, etc. AI can help endoscopic physicians improve the diagnosis rate of various lesions, reduce the rate of missed diagnosis, improve the quality of endoscopy, assess the severity of the disease, and improve the efficiency of endoscopy. The diversity, susceptibility, and imaging specificity of gastrointestinal endoscopic images are all difficulties and challenges on the road to intelligence. We need more large-scale, high-quality, multicenter prospective studies to explore the clinical applicability of AI, and ethical issues need to be taken into account.

Automated and real-time validation of gastroesophageal varices under esophagogastroduodenoscopy using a deep convolutional neural network: a multicenter retrospective study (with video)

BACKGROUND AND AIMS

Rupture of gastroesophageal varices is the most common fatal adverse event of cirrhosis. EGD is considered the criterion standard for diagnosis and risk stratification of gastroesophageal variceal bleeding. The aim of this study was to train and validate a real-time deep convolutional neural network (DCNN) system, named ENDOANGEL, for diagnosing gastroesophageal varices and predicting the risk of rupture.

METHODS

After training with 8566 images of endoscopic gastroesophageal varices from 3021 patients and 6152 images of normal esophagus/stomach from 3168 patients, ENDOANGEL was also tested with independent images and videos. It was also compared with endoscopists in several aspects.

RESULTS

ENDOANGEL, in contrast with endoscopists, displayed higher accuracy of 97.00% and 92.00% in terms of detecting esophageal varices (EVs) and gastric varices (GVs) in an image contest (97.00% vs 93.94% , P < .01; 92.00% vs 84.43%, P < .05). It also surpassed endoscopists for red color signs of EVs and red spots of GVs (84.21% vs 73.45%, P < .01; 85.26% vs 77.52%, P < .05). Moreover, ENDOANGEL achieved comparable performance in the determination of size, form, color, and bleeding signs. ENDOANGEL also had good performance in making treatment suggestions. With regard to predicting risk factors in multicenter videos, ENDOANGEL showed great stability.

CONCLUSIONS

Our data suggest that DCNNs were precise in detecting both EVs and GVs and performed excellently in uncovering the endoscopic risk factors of gastroesophageal variceal bleeding. Thus, the application of DCNNs will assist endoscopists in evaluating gastroesophageal varices more objectively and precisely. (Clinical trial registration number: ChiCTR1900023970.).

Application of artificial intelligence in gastroenterology: Potential role in clinical practice

Artificial intelligence (AI) based on deep learning boosted medical research in the past years and is expected to enormously change the style of health care in many aspects in the foreseeable future. Nowadays, there are exploding volumes of healthcare-related data being generated daily. Because of its time-sensitive characteristics, being able to process large amounts of data in real-time fashion is crucial in healthcare settings. In gastroenterology practice, AI can manage and interpret the sheer amount of data with different formats coming from a myriad of sources, including currently used endoscopic or imaging devices, digital record systems, and electronic health records, or from other sources such as governmental databases, social media, or wearable devices over a long period. Traditional gastroenterology is nowadays beginning to transform to a new personalized, predictive, and preventive paradigm. Evidence-based practices and recent studies are coming out every day, and big data-based approaches and the progress in basic sciences and its emerging applications are now becoming the indispensable part of precision medicine. In gastroenterology, AI can be applied in disease diagnosis, treatment guidance, outcome prediction, and reducing workload of the healthcare staff. As the healthcare community begins to embrace AI technology, how to seamlessly construct an interoperable platform to accommodate data with high variety and veracity with high velocity and implement AI in the clinical workflow would be the future challenges.

Comparative study on artificial intelligence systems for detecting early esophageal squamous cell carcinoma between narrow-band and white-light imaging

BACKGROUND

Non-magnifying endoscopy with narrow-band imaging (NM-NBI) has been frequently used in routine screening of esophagus squamous cell carcinoma (ESCC). The performance of NBI for screening of early ESCC is, however, significantly affected by operator experience. Artificial intelligence may be a unique approach to compensate for the lack of operator experience.

AIM

To construct a computer-aided detection (CAD) system for application in NM-NBI to identify early ESCC and to compare it with our previously reported CAD system with endoscopic white-light imaging (WLI).

METHODS

A total of 2167 abnormal NM-NBI images of early ESCC and 2568 normal images were collected from three institutions (Zhongshan Hospital of Fudan University, Xuhui Hospital, and Kiang Wu Hospital) as the training dataset, and 316 pairs of images, each pair including images obtained by WLI and NBI (same part), were collected for validation. Twenty endoscopists participated in this study to review the validation images with or without the assistance of the CAD systems. The diagnostic results of the two CAD systems and improvement in diagnostic efficacy of endoscopists were compared in terms of sensitivity, specificity, accuracy, positive predictive value, and negative predictive value.

RESULTS

The area under receiver operating characteristic curve for CAD-NBI was 0.9761. For the validation dataset, the sensitivity, specificity, accuracy, positive predictive value, and negative predictive value of CAD-NBI were 91.0%, 96.7%, 94.3%, 95.3%, and 93.6%, respectively, while those of CAD-WLI were 98.5%, 83.1%, 89.5%, 80.8%, and 98.7%, respectively. CAD-NBI showed superior accuracy and specificity than CAD-WLI (P = 0.028 and P ≤ 0.001, respectively), while CAD-WLI had higher sensitivity than CAD-NBI (P = 0.006). By using both CAD-WLI and CAD-NBI, the endoscopists could improve their diagnostic efficacy to the highest level, with accuracy, sensitivity, and specificity of 94.9%, 92.4%, and 96.7%, respectively.

CONCLUSION

The CAD-NBI system for screening early ESCC has higher accuracy and specificity than CAD-WLI. Endoscopists can achieve the best diagnostic efficacy using both CAD-WLI and CAD-NBI.

Detecting early gastric cancer: Comparison between the diagnostic ability of convolutional neural networks and endoscopists

OBJECTIVES

Detecting early gastric cancer is difficult, and it may even be overlooked by experienced endoscopists. Recently, artificial intelligence based on deep learning through convolutional neural networks (CNNs) has enabled significant advancements in the field of gastroenterology. However, it remains unclear whether a CNN can outperform endoscopists. In this study, we evaluated whether the performance of a CNN in detecting early gastric cancer is better than that of endoscopists.

METHODS

The CNN was constructed using 13,584 endoscopic images from 2639 lesions of gastric cancer. Subsequently, its diagnostic ability was compared to that of 67 endoscopists using an independent test dataset (2940 images from 140 cases).

RESULTS

The average diagnostic time for analyzing 2940 test endoscopic images by the CNN and endoscopists were 45.5 ± 1.8 s and 173.0 ± 66.0 min, respectively. The sensitivity, specificity, and positive and negative predictive values for the CNN were 58.4%, 87.3%, 26.0%, and 96.5%, respectively. These values for the 67 endoscopists were 31.9%, 97.2%, 46.2%, and 94.9%, respectively. The CNN had a significantly higher sensitivity than the endoscopists (by 26.5%; 95% confidence interval, 14.9-32.5%).

CONCLUSION

The CNN detected more early gastric cancer cases in a shorter time than the endoscopists. The CNN needs further training to achieve higher diagnostic accuracy. However, a diagnostic support tool for gastric cancer using a CNN will be realized in the near future.

Potentials of AI in medical image analysis in Gastroenterology and Hepatology

With the advancement of artificial intelligence (AI) technology, it comes in a big wave carrying possibly huge impact in the field of medicine. Gastroenterology and hepatology, being a specialty relying much on diagnostic imaging, endoscopy, and histopathology, AI technology has promised improving the quality and consistency of care to the patients. In this review, we will elucidate the development of machine learning methods, especially the visual representation mechanism in deep learning on recognition tasks. Various AI-image analysis applications in endoscopy, radiology, and pathology are covered in gastroenterology and hepatology and reveal the enormous potentials for AI in assisting diagnosis, prognosis, and treatment. We also discuss the promises as well as pitfalls for AI in medical image analysis and pointing out future research directions.

Artificial Intelligence in Colorectal Polyp Detection and Characterization

BACKGROUND

Over the past 20 years, the advancement of artificial intelligence (AI) and deep learning (DL) has allowed for fast sorting and analysis of large sets of data. In the field of gastroenterology, colorectal screening procedures produces an abundance of data through video and imaging. With AI and DL, this information can be used to create systems where automatic polyp detection and characterization is possible. Convoluted Neural Networks (CNNs) have proven to be an effective way to increase polyp detection and ultimately adenoma detection rates. Different methods of polyp characterization of being hyperplastic vs. adenomatous or non-neoplastic vs. neoplastic has also been investigated showing promising results.

FINDINGS

The rate of missed polyps on colonoscopy can be as high as 25%. At the beginning of the 2000s, hand-crafted machine learning (ML) algorithms were created and trained retrospectively on colonoscopy images and videos, achieving high sensitivity, specificity, and accuracy of over 90% in many of the studies. Over time, the advancement of DL and CNNs has allowed algorithms to be trained on non-medical images and applied retrospectively to colonoscopy videos and images with similar results. Within the past few years, these algorithms have been applied in real-time colonoscopies and has shown mixed results, one showing no difference while others showing increased polyp detection.Various methods of polyp characterization have also been investigated. Through AI, DL, and CNNs polyps can be identified has hyperplastic/adenomatous or non-neoplastic/neoplastic with high sensitivity, specificity, and accuracy. One of the research areas in polyp characterization is how to capture the polyp image. This paper looks at different modalities of characterizing polyps such as magnifying narrow band imaging (NBI), endocytoscopy, laser-induced florescent spectroscopy, auto-florescent endoscopy, and white-light endoscopy.

CONCLUSIONS

Overall, much progress has been made in automatic detection and characterization of polyps in real time. Barring ethical or mass adoption setbacks, it is inevitable that AI will be involved in the field of GI, especially in colorectal polyp detection and identification.

Current status and future perspective on artificial intelligence for lower endoscopy

The global incidence and mortality rate of colorectal cancer remains high. Colonoscopy is regarded as the gold standard examination for detecting and eradicating neoplastic lesions. However, there are some uncertainties in colonoscopy practice that are related to limitations in human performance. First, approximately one-fourth of colorectal neoplasms are missed on a single colonoscopy. Second, it is still difficult for non-experts to perform adequately regarding optical biopsy. Third, recording of some quality indicators (e.g. cecal intubation, bowel preparation, and withdrawal speed) which are related to adenoma detection rate, is sometimes incomplete. With recent improvements in machine learning techniques and advances in computer performance, artificial intelligence-assisted computer-aided diagnosis is being increasingly utilized by endoscopists. In particular, the emergence of deep-learning, data-driven machine learning techniques have made the development of computer-aided systems easier than that of conventional machine learning techniques, the former currently being considered the standard artificial intelligence engine of computer-aided diagnosis by colonoscopy. To date, computer-aided detection systems seem to have improved the rate of detection of neoplasms. Additionally, computer-aided characterization systems may have the potential to improve diagnostic accuracy in real-time clinical practice. Furthermore, some artificial intelligence-assisted systems that aim to improve the quality of colonoscopy have been reported. The implementation of computer-aided system clinical practice may provide additional benefits such as helping in educational poorly performing endoscopists and supporting real-time clinical decision-making. In this review, we have focused on computer-aided diagnosis during colonoscopy reported by gastroenterologists and discussed its status, limitations, and future prospects.

Artificial intelligence in inflammatory bowel disease endoscopy: current landscape and the road ahead

Inflammatory bowel disease is a complex chronic inflammatory disorder with challenges in diagnosis, choosing appropriate therapy, determining individual responsiveness, and prediction of future disease course to guide appropriate management. Artificial intelligence has been examined in the field of inflammatory bowel disease endoscopy with promising data in different domains of inflammatory bowel disease, including diagnosis, assessment of mucosal activity, and prediction of recurrence and complications. Artificial intelligence use during endoscopy could be a step toward precision medicine in inflammatory bowel disease care pathways. We reviewed available data on use of artificial intelligence for diagnosis of inflammatory bowel disease, grading of severity, prediction of recurrence, and dysplasia detection. We examined the potential role of artificial intelligence enhanced endoscopy in various aspects of inflammatory bowel disease care and future perspectives in this review.

Technology Can Augment, but Not Replace, Critical Human Skills Needed for Patient Care

The practice of medicine is changing rapidly as a consequence of electronic health record adoption, new technologies for patient care, disruptive innovations that breakdown professional hierarchies, and evolving societal norms. Collectively, these have resulted in the modification of the physician's role as the gatekeeper for health care, increased shift-based care, and amplified interprofessional team-based care. Technological innovations present opportunities as well as challenges. Artificial intelligence, which has great potential, has already transformed some tasks, particularly those involving image interpretation. Ubiquitous access to information via the Internet by physicians and patients alike presents benefits as well as drawbacks: patients and providers have ready access to virtually all of human knowledge, but some websites are contaminated with misinformation and many people have difficulty differentiating between solid, evidence-based data and untruths. The role of the future physician will shift as complexity in health care increases and as artificial intelligence and other technologies advance. These technological advances demand new skills of physicians; memory and knowledge accumulation will diminish in importance while information management skills will become more important. In parallel, medical educators must enhance their teaching and assessment of critical human skills (e.g., clear communication, empathy) in the delivery of patient care. The authors emphasize the enduring role of critical human skills in safe and effective patient care even as medical practice is increasingly guided by artificial intelligence and related technology, and they suggest new and longitudinal ways of assessing essential noncognitive skills to meet the demands of the future. The authors envision practical and achievable benefits accruing to patients and providers if practitioners leverage technological advancements to facilitate the development of their critical human skills.

Artificial intelligence in colonoscopy - Now on the market. What's next?

Adoption of artificial intelligence (AI) in clinical medicine is revolutionizing daily practice. In the field of colonoscopy, major endoscopy manufacturers have already launched their own AI products on the market with regulatory approval in Europe and Asia. This commercialization is strongly supported by positive evidence that has been recently established through rigorously designed prospective trials and randomized controlled trials. According to some of the trials, AI tools possibly increase the adenoma detection rate by roughly 50% and contribute to a 7-20% reduction of colonoscopy-related costs. Given that reliable evidence is emerging, together with active commercialization, this seems to be a good time for us to review and discuss the current status of AI in colonoscopy from a clinical perspective. In this review, we introduce the advantages and possible drawbacks of AI tools and explore their future potential including the possibility of obtaining reimbursement.

Artificial Intelligence-Assisted Colonoscopy for Detection of Colon Polyps: a Prospective, Randomized Cohort Study

BACKGROUND AND AIMS

Improving the rate of polyp detection is an important measure to prevent colorectal cancer (CRC). Real-time automatic polyp detection systems, through deep learning methods, can learn and perform specific endoscopic tasks previously performed by endoscopists. The purpose of this study was to explore whether a high-performance, real-time automatic polyp detection system could improve the polyp detection rate (PDR) in the actual clinical environment.

METHODS

The selected patients underwent same-day, back-to-back colonoscopies in a random order, with either traditional colonoscopy or artificial intelligence (AI)-assisted colonoscopy performed first by different experienced endoscopists (> 3000 colonoscopies). The primary outcome was the PDR. It was registered with clinicaltrials.gov . (NCT047126265).

RESULTS

In this study, we randomized 150 patients. The AI system significantly increased the PDR (34.0% vs 38.7%, p < 0.001). In addition, AI-assisted colonoscopy increased the detection of polyps smaller than 6 mm (69 vs 91, p < 0.001), but no difference was found with regard to larger lesions.

CONCLUSIONS

A real-time automatic polyp detection system can increase the PDR, primarily for diminutive polyps. However, a larger sample size is still needed in the follow-up study to further verify this conclusion.

TRIAL REGISTRATION

clinicaltrials.gov Identifier: NCT047126265.

Performance of artificial intelligence in colonoscopy for adenoma and polyp detection: a systematic review and meta-analysis

BACKGROUND AND AIMS

One-fourth of colorectal neoplasia are missed at screening colonoscopy, representing the main cause of interval colorectal cancer. Deep learning systems with real-time computer-aided polyp detection (CADe) showed high accuracy in artificial settings, and preliminary randomized controlled trials (RCTs) reported favorable outcomes in the clinical setting. The aim of this meta-analysis was to summarize available RCTs on the performance of CADe systems in colorectal neoplasia detection.

METHODS

We searched MEDLINE, EMBASE, and Cochrane Central databases until March 2020 for RCTs reporting diagnostic accuracy of CADe systems in the detection of colorectal neoplasia. The primary outcome was pooled adenoma detection rate (ADR), and secondary outcomes were adenoma per colonoscopy (APC) according to size, morphology, and location; advanced APC; polyp detection rate; polyps per colonoscopy; and sessile serrated lesions per colonoscopy. We calculated risk ratios (RRs), performed subgroup and sensitivity analyses, and assessed heterogeneity and publication bias.

RESULTS

Overall, 5 randomized controlled trials (4354 patients) were included in the final analysis. Pooled ADR was significantly higher in the CADe group than in the control group (791/2163 [36.6%] vs 558/2191 [25.2%]; RR, 1.44; 95% confidence interval [CI], 1.27-1.62; P < .01; I2 = 42%). APC was also higher in the CADe group compared with control (1249/2163 [.58] vs 779/2191 [.36]; RR, 1.70; 95% CI, 1.53-1.89; P < .01; I2 = 33%). APC was higher for ≤5-mm (RR, 1.69; 95% CI, 1.48-1.84), 6- to 9-mm (RR, 1.44; 95% CI, 1.19-1.75), and ≥10-mm adenomas (RR, 1.46; 95% CI, 1.04-2.06) and for proximal (RR, 1.59; 95% CI, 1.34-1.88), distal (RR, 1.68; 95% CI, 1.50-1.88), flat (RR, 1.78; 95% CI, 1.47-2.15), and polypoid morphology (RR, 1.54; 95% CI, 1.40-1.68). Regarding histology, CADe resulted in a higher sessile serrated lesion per colonoscopy (RR, 1.52; 95% CI, 1.14-2.02), whereas a nonsignificant trend for advanced ADR was found (RR, 1.35; 95% CI, .74-2.47; P = .33; I2 = 69%). Level of evidence for RCTs was graded as moderate.

CONCLUSIONS

According to available evidence, the incorporation of artificial intelligence as aid for detection of colorectal neoplasia results in a significant increase in the detection of colorectal neoplasia, and such effect is independent from main adenoma characteristics.

The Role of Artificial Intelligence in Endoscopic Ultrasound for Pancreatic Disorders

The use of artificial intelligence (AI) in various medical imaging applications has expanded remarkably, and several reports have focused on endoscopic ultrasound (EUS) images of the pancreas. This review briefly summarizes each report in order to help endoscopists better understand and utilize the potential of this rapidly developing AI, after a description of the fundamentals of the AI involved, as is necessary for understanding each study. At first, conventional computer-aided diagnosis (CAD) was used, which extracts and selects features from imaging data using various methods and introduces them into machine learning algorithms as inputs. Deep learning-based CAD utilizing convolutional neural networks has been used; in these approaches, the images themselves are used as inputs, and more information can be analyzed in less time and with higher accuracy. In the field of EUS imaging, although AI is still in its infancy, further research and development of AI applications is expected to contribute to the role of optical biopsy as an alternative to EUS-guided tissue sampling while also improving diagnostic accuracy through double reading with humans and contributing to EUS education.

Colorectal polyp characterization with endocytoscopy: Ready for widespread implementation with artificial intelligence?

Endocytoscopy provides an in-vivo visualization of nuclei and micro-vessels at the cellular level in real-time, facilitating so-called "optical biopsy" or "virtual histology" of colorectal polyps/neoplasms. This functionality is enabled by 520-fold magnification power with endocytoscopy and recent breakthroughs in artificial intelligence (AI) allowing a great advance in endocytoscopic imaging; interpretation of images is now fully supported by AI tool which outputs predictions of polyp histopathology during colonoscopy. The advantage of the use of AI during optical biopsy can be appreciated especially by non-expert endoscopists who to increase performance. This paper provides an overview of the latest evidence on colorectal polyp characterization with endocytoscopy combined with AI and identify the barriers to its widespread implementation.

Impact of artificial intelligence on colorectal polyp detection

Since colonoscopy and polypectomy were introduced, Colorectal Cancer (CRC) incidence and mortality decreased significantly. Although we have entered the era of quality measurement and improvement, literature shows that a considerable amount of colorectal neoplasia is still missed by colonoscopists up to 25%, leading to an high rate of interval colorectal cancer that account for nearly 10% of all diagnosed CRC. Two main reasons have been recognised: recognition failure and mucosal exposure. For this purpose, Artificial Intelligence (AI) systems have been recently developed that identify a "hot" area during the endoscopic examination. In retrospective studies, where the systems are tested with a batch of unknown images, deep learning systems have shown very good performances, with high levels of accuracy. Of course, this setting may not reflect actual clinical practice where different pitfalls can occur, like suboptimal bowel preparation or poor examination technique. For this reason, a number of randomised clinical trials have recently been published where AI was tested in real time during endoscopic examinations. We present here an overview on recent literature addressing the performance of Computer Assisted Detection (CADe) of colorectal polyps in colonoscopy.

Second-Generation Digital Health Platforms: Placing the Patient at the Center and Focusing on Clinical Outcomes

Artificial intelligence (AI) digital health systems have drawn much attention over the last decade. However, their implementation into medical practice occurs at a much slower pace than expected. This paper reviews some of the achievements of first-generation AI systems, and the barriers facing their implementation into medical practice. The development of second-generation AI systems is discussed with a focus on overcoming some of these obstacles. Second-generation systems are aimed at focusing on a single subject and on improving patients' clinical outcomes. A personalized closed-loop system designed to improve end-organ function and the patient's response to chronic therapies is presented. The system introduces a platform which implements a personalized therapeutic regimen and introduces quantifiable individualized-variability patterns into its algorithm. The platform is designed to achieve a clinically meaningful endpoint by ensuring that chronic therapies will have sustainable effect while overcoming compensatory mechanisms associated with disease progression and drug resistance. Second-generation systems are expected to assist patients and providers in adopting and implementing of these systems into everyday care.

NBI utility in oncologic surgery: An organ by organ review

The main aims of the oncologic surgeon should be an early tumor diagnosis, complete surgical resection, and a careful post-treatment follow-up to ensure a prompt diagnosis of recurrence. Radiologic and endoscopic methods have been traditionally used for these purposes, but their accuracy might sometimes be suboptimal. Technological improvements could help the clinician during the diagnostic and therapeutic management of tumors. Narrow band imaging (NBI) belongs to optical image techniques, and uses light characteristics to enhance tissue vascularization. Because neoangiogenesis is a fundamental step during carcinogenesis, NBI could be useful in the diagnostic and therapeutic workup of tumors. Since its introduction in 2001, NBI use has rapidly spread in different oncologic specialties with clear advantages. There is an active interest in this topic as demonstrated by the thriving literature. It is unavoidable for clinicians to gain in-depth knowledge about the application of NBI to their specific field, losing the overall view on the topic. However, by looking at other fields of application, clinicians could find ideas to improve NBI use in their own specialty. The aim of this review is to summarize the existing literature on NBI use in oncology, with the aim of providing the state of the art: we present an overview on NBI fields of application, results, and possible future improvements in the different specialties.

Artificial intelligence in gastrointestinal endoscopy

BACKGROUND AND AIMS

Artificial intelligence (AI)-based applications have transformed several industries and are widely used in various consumer products and services. In medicine, AI is primarily being used for image classification and natural language processing and has great potential to affect image-based specialties such as radiology, pathology, and gastroenterology (GE). This document reviews the reported applications of AI in GE, focusing on endoscopic image analysis.

METHODS

The MEDLINE database was searched through May 2020 for relevant articles by using key words such as machine learning, deep learning, artificial intelligence, computer-aided diagnosis, convolutional neural networks, GI endoscopy, and endoscopic image analysis. References and citations of the retrieved articles were also evaluated to identify pertinent studies. The manuscript was drafted by 2 authors and reviewed in person by members of the American Society for Gastrointestinal Endoscopy Technology Committee and subsequently by the American Society for Gastrointestinal Endoscopy Governing Board.

RESULTS

Deep learning techniques such as convolutional neural networks have been used in several areas of GI endoscopy, including colorectal polyp detection and classification, analysis of endoscopic images for diagnosis of Helicobacter pylori infection, detection and depth assessment of early gastric cancer, dysplasia in Barrett's esophagus, and detection of various abnormalities in wireless capsule endoscopy images.

CONCLUSIONS

The implementation of AI technologies across multiple GI endoscopic applications has the potential to transform clinical practice favorably and improve the efficiency and accuracy of current diagnostic methods.

Efficacy of endoscopic ultrasound with artificial intelligence for the diagnosis of gastrointestinal stromal tumors

BACKGROUND

Although endoscopic ultrasound (EUS) is reported to be suitable for determining the layer from which subepithelial lesions (SELs) originate, it is difficult to distinguish gastrointestinal stromal tumor (GIST) from non-GIST using only EUS images. If artificial intelligence (AI) can be used for the diagnosis of SELs, it should provide several benefits, including objectivity, simplicity, and quickness. In this pilot study, we propose an AI diagnostic system for SELs and evaluate its efficacy.

METHODS

Thirty sets each of EUS images with SELs ≥ 20 mm or < 20 mm were prepared for diagnosis by an EUS diagnostic system with AI (EUS-AI) and three EUS experts. The EUS-AI and EUS experts diagnosed the SELs using solely the EUS images. The concordance rates of the EUS-AI and EUS experts' diagnoses were compared with the pathological findings of the SELs.

RESULTS

The accuracy, sensitivity, and specificity for SELs < 20 mm were 86.3, 86.3, and 62.5%, respectively for the EUS-AI, and 73.3, 68.2, and 87.5%, respectively, for the EUS experts. In contrast, accuracy, sensitivity, and specificity for SELs ≥ 20 mm were 90.0, 91.7, and 83.3%, respectively, for the EUS-AI, and 53.3, 50.0, and 83.3%, respectively, for the EUS experts. The area under the curve for the diagnostic yield of the EUS-AI for SELs ≥ 20 mm (0.965) was significantly higher than that (0.684) of the EUS experts (P = 0.007).

CONCLUSION

EUS-AI had a good diagnostic yield for SELs ≥ 20 mm. EUS-AI has potential as a good option for the diagnosis of SELs.

Deployment of artificial intelligence for radiographic diagnosis of COVID-19 pneumonia in the emergency department

OBJECTIVE

The coronavirus disease 2019 pandemic has inspired new innovations in diagnosing, treating, and dispositioning patients during high census conditions with constrained resources. Our objective is to describe first experiences of physician interaction with a novel artificial intelligence (AI) algorithm designed to enhance physician abilities to identify ground-glass opacities and consolidation on chest radiographs.

METHODS

During the first wave of the pandemic, we deployed a previously developed and validated deep-learning AI algorithm for assisted interpretation of chest radiographs for use by physicians at an academic health system in Southern California. The algorithm overlays radiographs with "heat" maps that indicate pneumonia probability alongside standard chest radiographs at the point of care. Physicians were surveyed in real time regarding ease of use and impact on clinical decisionmaking.

RESULTS

Of the 5125 total visits and 1960 chest radiographs obtained in the emergency department (ED) during the study period, 1855 were analyzed by the algorithm. Among these, emergency physicians were surveyed for their experiences on 202 radiographs. Overall, 86% either strongly agreed or somewhat agreed that the intervention was easy to use in their workflow. Of the respondents, 20% reported that the algorithm impacted clinical decisionmaking.

CONCLUSIONS

To our knowledge, this is the first published literature evaluating the impact of medical imaging AI on clinical decisionmaking in the emergency department setting. Urgent deployment of a previously validated AI algorithm clinically was easy to use and was found to have an impact on clinical decision making during the predicted surge period of a global pandemic.

Artificial intelligence: A new budding star in gastric cancer

The pursuit of health has always been the driving force for the advancement of human society, and social development will be profoundly affected by every breakthrough in the medical industry. With the arrival of the information technology revolution era, artificial intelligence (AI) technology has been rapidly developed. AI has been combined with medicine but it has been less studied with gastric cancer (GC). AI is a new budding star in GC, and its contribution to GC is mainly focused on diagnosis and treatment. For early GC, AI’s impact is not only reflected in its high accuracy but also its ability to quickly train primary doctors, improve the diagnosis rate of early GC, and reduce missed cases. At the same time, it will also reduce the possibility of missed diagnosis of advanced GC in cardia. Furthermore, it is used to assist imaging doctors to determine the location of lymph nodes and, more importantly, it can more effectively judge the lymph node metastasis of GC, which is conducive to the prognosis of patients. In surgical treatment of GC, it also has great potential. Robotic surgery is the latest technology in GC surgery. It is a bright star for minimally invasive treatment of GC, and together with laparoscopic surgery, it has become a common treatment for GC. Through machine learning, robotic systems can reduce operator errors and trauma of patients, and can predict the prognosis of GC patients. Throughout the centuries of development of surgery, the history gradually changes from traumatic to minimally invasive. In the future, AI will help GC patients reduce surgical trauma and further improve the efficiency of minimally invasive treatment of GC.

Artificial intelligence in gastrointestinal endoscopy: general overview

Artificial intelligence (AI) is now a trendy subject in clinical medicine and especially in gastrointestinal (GI) endoscopy. AI has the potential to improve the quality of GI endoscopy at all levels. It will compensate for humans' errors and limited capabilities by bringing more accuracy, consistency, and higher speed, making endoscopic procedures more efficient and of higher quality. AI showed great results in diagnostic and therapeutic endoscopy in all parts of the GI tract. More studies are still needed before the introduction of this new technology in our daily practice and clinical guidelines. Furthermore, ethical clearance and new legislations might be needed. In conclusion, the introduction of AI will be a big breakthrough in the field of GI endoscopy in the upcoming years. It has the potential to bring major improvements to GI endoscopy at all levels.

Randomised comparison of postpolypectomy surveillance intervals following a two-round baseline colonoscopy: the Japan Polyp Study Workgroup

OBJECTIVE

To assess whether follow-up colonoscopy after polypectomy at 3 years only, or at 1 and 3 years would effectively detect advanced neoplasia (AN), including nonpolypoid colorectal neoplasms (NP-CRNs).

DESIGN

A prospective multicentre randomised controlled trial was conducted in 11 Japanese institutions. The enrolled participants underwent a two-round baseline colonoscopy (interval: 1 year) to remove all neoplastic lesions. Subsequently, they were randomly assigned to undergo follow-up colonoscopy at 1 and 3 years (2-examination group) or at 3 years only (1-examination group). The incidence of AN, defined as lesions with low-grade dysplasia ≥10 mm, high-grade dysplasia or invasive cancer, at follow-up colonoscopy was evaluated.

RESULTS

A total of 3926 patients were enrolled in this study. The mean age was 57.3 (range: 40-69) years, and 2440 (62%) were male. Of these, 2166 patients were assigned to two groups (2-examination: 1087, 1-examination: 1079). Overall, we detected 29 AN in 28 patients at follow-up colonoscopy in both groups. On per-protocol analysis (701 in 2-examination vs 763 in 1-examination group), the incidence of AN was similar between the two groups (1.7% vs 2.1%, p=0.599). The results of the non-inferiority test were significant (p=0.017 in per-protocol, p=0.001 in intention-to-treat analysis). NP-CRNs composed of dominantly of the detected AN (62%, 18/29), and most of them were classified into laterally spreading tumour non-granular type (83%, 15/18).

CONCLUSION

After a two-round baseline colonoscopy, follow-up colonoscopy at 3 years detected AN, including NP-CRNs, as effectively as follow-up colonoscopies performed after 1 and 3 years.

Artificial Intelligence in Health Care: Current Applications and Issues

In recent years, artificial intelligence (AI) technologies have greatly advanced and become a reality in many areas of our daily lives. In the health care field, numerous efforts are being made to implement the AI technology for practical medical treatments. With the rapid developments in machine learning algorithms and improvements in hardware performances, the AI technology is expected to play an important role in effectively analyzing and utilizing extensive amounts of health and medical data. However, the AI technology has various unique characteristics that are different from the existing health care technologies. Subsequently, there are a number of areas that need to be supplemented within the current health care system for the AI to be utilized more effectively and frequently in health care. In addition, the number of medical practitioners and public that accept AI in the health care is still low; moreover, there are various concerns regarding the safety and reliability of AI technology implementations. Therefore, this paper aims to introduce the current research and application status of AI technology in health care and discuss the issues that need to be resolved.