An automatic bleeding detection scheme in wireless capsule endoscopy based on histogram of an RGB-indexed image

Computer-Aided Bleeding Detection Algorithms for Capsule Endoscopy: A Systematic Review

Capsule endoscopy (CE) is a widely used medical imaging tool for the diagnosis of gastrointestinal tract abnormalities like bleeding. However, CE captures a huge number of image frames, constituting a time-consuming and tedious task for medical experts to manually inspect. To address this issue, researchers have focused on computer-aided bleeding detection systems to automatically identify bleeding in real time. This paper presents a systematic review of the available state-of-the-art computer-aided bleeding detection algorithms for capsule endoscopy. The review was carried out by searching five different repositories (Scopus, PubMed, IEEE Xplore, ACM Digital Library, and ScienceDirect) for all original publications on computer-aided bleeding detection published between 2001 and 2023. The Preferred Reporting Items for Systematic Review and Meta-Analyses (PRISMA) methodology was used to perform the review, and 147 full texts of scientific papers were reviewed. The contributions of this paper are: (I) a taxonomy for computer-aided bleeding detection algorithms for capsule endoscopy is identified; (II) the available state-of-the-art computer-aided bleeding detection algorithms, including various color spaces (RGB, HSV, etc.), feature extraction techniques, and classifiers, are discussed; and (III) the most effective algorithms for practical use are identified. Finally, the paper is concluded by providing future direction for computer-aided bleeding detection research.

Artificial Intelligence and Capsule Endoscopy: Automatic Detection of Small Bowel Blood Content Using a Convolutional Neural Network

Introduction

Capsule endoscopy has revolutionized the management of patients with obscure gastrointestinal bleeding. Nevertheless, reading capsule endoscopy images is time-consuming and prone to overlooking significant lesions, thus limiting its diagnostic yield. We aimed to create a deep learning algorithm for automatic detection of blood and hematic residues in the enteric lumen in capsule endoscopy exams.

Methods

A convolutional neural network was developed based on a total pool of 22,095 capsule endoscopy images (13,510 images containing luminal blood and 8,585 of normal mucosa or other findings). A training dataset comprising 80% of the total pool of images was defined. The performance of the network was compared to a consensus classification provided by 2 specialists in capsule endoscopy. Subsequently, we evaluated the performance of the network using an independent validation dataset (20% of total image pool), calculating its sensitivity, specificity, accuracy, and precision.

Results

Our convolutional neural network detected blood and hematic residues in the small bowel lumen with an accuracy and precision of 98.5 and 98.7%, respectively. The sensitivity and specificity were 98.6 and 98.9%, respectively. The analysis of the testing dataset was completed in 24 s (approximately 184 frames/s).

Discussion/Conclusion

We have developed an artificial intelligence tool capable of effectively detecting luminal blood. The development of these tools may enhance the diagnostic accuracy of capsule endoscopy when evaluating patients presenting with obscure small bowel bleeding.

Recent Applications of Artificial Intelligence in detection of Gastrointestinal, Hepatic and Pancreatic Diseases

There is substantial progress in artificial intelligence (AI) algorithms and their medical sciences applications in the last two decades. AI-assisted programs have already been established for remotely health monitoring using sensors and smartphones. A variety of AI-based prediction models available for the gastrointestinal inflammatory, non-malignant diseases, and bowel bleeding using wireless capsule endoscopy, electronic medical records for hepatitis-associated fibrosis, pancreatic carcinoma using endoscopic ultrasounds. AI-based models may be of immense help for healthcare professionals in the identification, analysis, and decision support using endoscopic images to establish prognosis and risk assessment of patient's treatment using multiple factors. Although enough randomized clinical trials are warranted to establish the efficacy of AI-algorithms assisted and non-AI based treatments before approval of such techniques from medical regulatory authorities. In this article, available AI approaches and AI-based prediction models for detecting gastrointestinal, hepatic, and pancreatic diseases are reviewed. The limitation of AI techniques in such disease prognosis, risk assessment, and decision support are discussed.

Artificial intelligence and capsule endoscopy: unravelling the future

The applicability of artificial intelligence (AI) in gastroenterology is a hot topic because of its disruptive nature. Capsule endoscopy plays an important role in several areas of digestive pathology, namely in the investigation of obscure hemorrhagic lesions and the management of inflammatory bowel disease. Therefore, there is growing interest in the use of AI in capsule endoscopy. Several studies have demonstrated the enormous potential of using convolutional neural networks in various areas of capsule endoscopy. The exponential development of the usefulness of AI in capsule endoscopy requires consideration of its medium- and long-term impact on clinical practice. Indeed, the advent of deep learning in the field of capsule endoscopy, with its evolutionary character, could lead to a paradigm shift in clinical activity in this setting. In this review, we aim to illustrate the state of the art of AI in the field of capsule endoscopy.

Diagnosis and Management of Non-Variceal Gastrointestinal Hemorrhage: A Review of Current Guidelines and Future Perspectives

Non-variceal gastrointestinal bleeding (GIB) is a significant cause of mortality and morbidity worldwide which is encountered in the ambulatory and hospital settings. Hemorrhage form the gastrointestinal (GI) tract is categorized as upper GIB, small bowel bleeding (also formerly referred to as obscure GIB) or lower GIB. Although the etiologies of GIB are variable, a strong, consistent risk factor is use of non-steroidal anti-inflammatory drugs. Advances in the endoscopic diagnosis and treatment of GIB have led to improved outcomes. We present an updated review of the current practices regarding the diagnosis and management of non-variceal GIB, and possible future directions.

An Automatic Bleeding Frame and Region Detection Scheme for Wireless Capsule Endoscopy Videos Based on Interplane Intensity Variation Profile in Normalized RGB Color Space

Wireless capsule endoscopy (WCE) is an effective video technology to diagnose gastrointestinal (GI) disease, such as bleeding. In order to avoid conventional tedious and risky manual review process of long duration WCE videos, automatic bleeding detection schemes are getting importance. In this paper, to investigate bleeding, the analysis of WCE images is carried out in normalized RGB color space as human perception of bleeding is associated with different shades of red. In the proposed method, at first, from the WCE image frame, an efficient region of interest (ROI) is extracted based on interplane intensity variation profile in normalized RGB space. Next, from the extracted ROI, the variation in the normalized green plane is presented with the help of histogram. Features are extracted from the proposed normalized green plane histograms. For classification purpose, the K-nearest neighbors classifier is employed. Moreover, bleeding zones in a bleeding image are extracted utilizing some morphological operations. For performance evaluation, 2300 WCE images obtained from 30 publicly available WCE videos are used in a tenfold cross-validation scheme and the proposed method outperforms the reported four existing methods having an accuracy of 97.86%, a sensitivity of 95.20%, and a specificity of 98.32%.

CHOBS: Color Histogram of Block Statistics for Automatic Bleeding Detection in Wireless Capsule Endoscopy Video

Wireless capsule endoscopy (WCE) is the most advanced technology to visualize whole gastrointestinal (GI) tract in a non-invasive way. But the major disadvantage here, it takes long reviewing time, which is very laborious as continuous manual intervention is necessary. In order to reduce the burden of the clinician, in this paper, an automatic bleeding detection method for WCE video is proposed based on the color histogram of block statistics, namely CHOBS. A single pixel in WCE image may be distorted due to the capsule motion in the GI tract. Instead of considering individual pixel values, a block surrounding to that individual pixel is chosen for extracting local statistical features. By combining local block features of three different color planes of RGB color space, an index value is defined. A color histogram, which is extracted from those index values, provides distinguishable color texture feature. A feature reduction technique utilizing color histogram pattern and principal component analysis is proposed, which can drastically reduce the feature dimension. For bleeding zone detection, blocks are classified using extracted local features that do not incorporate any computational burden for feature extraction. From extensive experimentation on several WCE videos and 2300 images, which are collected from a publicly available database, a very satisfactory bleeding frame and zone detection performance is achieved in comparison to that obtained by some of the existing methods. In the case of bleeding frame detection, the accuracy, sensitivity, and specificity obtained from proposed method are 97.85%, 99.47%, and 99.15%, respectively, and in the case of bleeding zone detection, 95.75% of precision is achieved. The proposed method offers not only low feature dimension but also highly satisfactory bleeding detection performance, which even can effectively detect bleeding frame and zone in a continuous WCE video data.

Saliency-Based Bleeding Localization for Wireless Capsule Endoscopy Diagnosis

Stomach bleeding is a kind of gastrointestinal disease which can be diagnosed noninvasively by wireless capsule endoscopy (WCE). However, it requires much time for physicians to scan large amount of WCE images. Alternatively, computer-assisted bleeding localization systems are developed where color, edge, and intensity features are defined to distinguish lesions from normal tissues. This paper proposes a saliency-based localization system where three saliency maps are computed: phase congruency-based edge saliency map derived from Log-Gabor filter bands, intensity histogram-guided intensity saliency map, and red proportion-based saliency map. Fusing the three maps together, the proposed system can detect bleeding regions by thresholding the fused saliency map. Results demonstrate the accuracy of 98.97% for our system to mark bleeding regions.

A Therapeutic Wireless Capsule for Treatment of Gastrointestinal Haemorrhage by Balloon Tamponade Effect

OBJECTIVE

Wireless capsule endoscope (WCE) is a revolutionary approach to diagnose small bowel pathologies. Currently available WCEs are mostly passive devices with image capturing function only, while on-going efforts have been placed on robotizing WCEs or to enhance them with therapeutic functions. In this paper, the authors present a novel inflatable WCE for haemostasis in the gastrointestinal (GI) tracts by balloon tamponade effect.

METHODS

The proposed wireless capsule consists of a balloon that can be inflated using the endothermic reaction of acid and base. When the balloon reached a precalculated pressure level, it is able to stop at a bleeding site in the bowel, and achieve haemostasis by tamponade effect. The prototype is 14 mm in diameter, with three sections of 13, 35, and 12 mm in length, respectively. The three sections are linked together with flexible joints and enclosed in a silicone balloon. The prototypes were tested in ex vivo porcine intestine models.

RESULTS

In the ten ex vivo trials conducted, the inflatable wireless capsule achieved average balloon pressure of 46.0 mmHg and withstood average maximum longitudinal pulling force at 1.46 N. An in vivo study was carried out as a proof-of-concept for treating bleeding in a porcine model. The proposed inflatable WCE succeeded in the animal test by controlling haemostasis within 5 min. No rebleeding was observed in the next 20 min.

CONCLUSION

The results suggested that the inflatable capsule with a real-time bleeding detection algorithm can be implemented. Moreover, the proposed inflatable WCE prototype can achieve haemorrhage control in the lower GI.

SIGNIFICANCE

To our best knowledge, this is the first study that demonstrated the potential to treat GI haemorrhage by an inflatable WCE. The proposed capsule enables the development of a closed-loop system based on a body sensor network to provide early treatment of GI bleeding for p-medicine.