1
|
Nam JH, Oh DJ, Lee S, Song HJ, Lim YJ. Development and Verification of a Deep Learning Algorithm to Evaluate Small-Bowel Preparation Quality. Diagnostics (Basel) 2021; 11:diagnostics11061127. [PMID: 34203093 PMCID: PMC8234509 DOI: 10.3390/diagnostics11061127] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/14/2021] [Revised: 06/03/2021] [Accepted: 06/19/2021] [Indexed: 01/31/2023] Open
Abstract
Capsule endoscopy (CE) quality control requires an objective scoring system to evaluate the preparation of the small bowel (SB). We propose a deep learning algorithm to calculate SB cleansing scores and verify the algorithm’s performance. A 5-point scoring system based on clarity of mucosal visualization was used to develop the deep learning algorithm (400,000 frames; 280,000 for training and 120,000 for testing). External validation was performed using additional CE cases (n = 50), and average cleansing scores (1.0 to 5.0) calculated using the algorithm were compared to clinical grades (A to C) assigned by clinicians. Test results obtained using 120,000 frames exhibited 93% accuracy. The separate CE case exhibited substantial agreement between the deep learning algorithm scores and clinicians’ assessments (Cohen’s kappa: 0.672). In the external validation, the cleansing score decreased with worsening clinical grade (scores of 3.9, 3.2, and 2.5 for grades A, B, and C, respectively, p < 0.001). Receiver operating characteristic curve analysis revealed that a cleansing score cut-off of 2.95 indicated clinically adequate preparation. This algorithm provides an objective and automated cleansing score for evaluating SB preparation for CE. The results of this study will serve as clinical evidence supporting the practical use of deep learning algorithms for evaluating SB preparation quality.
Collapse
Affiliation(s)
- Ji Hyung Nam
- Division of Gastroenterology, Department of Internal Medicine, Dongguk University Ilsan Hospital, Dongguk University College of Medicine, Goyang 10326, Korea; (J.H.N.); (D.J.O.); (S.L.)
| | - Dong Jun Oh
- Division of Gastroenterology, Department of Internal Medicine, Dongguk University Ilsan Hospital, Dongguk University College of Medicine, Goyang 10326, Korea; (J.H.N.); (D.J.O.); (S.L.)
| | - Sumin Lee
- Division of Gastroenterology, Department of Internal Medicine, Dongguk University Ilsan Hospital, Dongguk University College of Medicine, Goyang 10326, Korea; (J.H.N.); (D.J.O.); (S.L.)
| | - Hyun Joo Song
- Division of Gastroenterology, Department of Internal Medicine, Jeju National University School of Medicine, Jeju 63241, Korea;
| | - Yun Jeong Lim
- Division of Gastroenterology, Department of Internal Medicine, Dongguk University Ilsan Hospital, Dongguk University College of Medicine, Goyang 10326, Korea; (J.H.N.); (D.J.O.); (S.L.)
- Correspondence: ; Tel.: +82-31-961-7133
| |
Collapse
|
2
|
Shah N, Chen C, Montano N, Cave D, Siegel R, Gentile NT, Limkakeng AT, Kumar AB, Ma Y, Meltzer AC. Video capsule endoscopy for upper gastrointestinal hemorrhage in the emergency department: A systematic review and meta-analysis. Am J Emerg Med 2020; 38:1245-1252. [PMID: 32229221 DOI: 10.1016/j.ajem.2020.03.008] [Citation(s) in RCA: 10] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/19/2019] [Revised: 03/06/2020] [Accepted: 03/08/2020] [Indexed: 12/22/2022] Open
Abstract
OBJECTIVE The assessment of the severity of upper gastrointestinal hemorrhage in emergency department (ED) patients is difficult to assess with commonly available diagnostic tools. Small studies have shown that video capsule endoscopy (VCE) is a promising risk-stratification method and may be better than current clinical decision rules such as the Rockall score and the Glasgow Blatchford score. This review aims to assess the accuracy of VCE to detect active upper gastrointestinal hemorrhage compared to a reference standard. METHODS The PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) methodology was used to perform a review of studies that have measured the diagnostic accuracy of VCE. Studies were included if they measured ED use of VCE for upper GI hemorrhage as compared to a reference standard of an esophagogastroduodenoscopy (EGD). A meta-analysis was performed on select patients using a fixed effects and random-effects model to determine the primary outcome of diagnostic test accuracy. RESULTS 40 studies were screened for eligibility and five studies representing 193 patients met the inclusion and exclusion criteria. All patients received both a VCE and an EGD. The sensitivity and specificity of VCE were 0.724 and 0.748, respectively. The diagnostic odds ratio was 6.29 (95% CI: 3.23-12.25) and the summary receiver operating characteristic curve was 0.782. CONCLUSIONS VCE demonstrated high accuracy for detecting upper GI hemorrhage in this meta-analysis of existing studies. In light of the potential advantages of VCE in the ED, further research is warranted to further establish its role.
Collapse
Affiliation(s)
- Nidhi Shah
- The George Washington University School of Medicine and Health Sciences, Department of Emergency Medicine, The Department of Emergency Medicine, 2120 L Street NW, Suite 450, Washington, DC 20037, USA.
| | - Chen Chen
- The George Washington University, Milken Institute School of Public Health, Department of Epidemiology and Biostatistics, 950 New Hampshire Ave NW, 5th Floor, Washington, DC 20052, USA.
| | - Nataly Montano
- The George Washington University School of Medicine and Health Sciences, Department of Emergency Medicine, The Department of Emergency Medicine, 2120 L Street NW, Suite 450, Washington, DC 20037, USA.
| | - David Cave
- University of Massachusetts, UMass Memorial Medical Center, University Campus, 55 Lake Avenue North, Worcester, MA 01655, USA
| | - Rebecca Siegel
- The George Washington University School of Medicine and Health Sciences, Department of Emergency Medicine, The Department of Emergency Medicine, 2120 L Street NW, Suite 450, Washington, DC 20037, USA
| | - Nina T Gentile
- Department of Emergency Medicine, Lewis Katz School of Medicine at Temple University, Medicine Education and Research Building (MERB), 3500 N. Broad Street, Philadelphia, PA 19140, USA.
| | - Alexander T Limkakeng
- Division of Emergency Medicine, Duke University School of Medicine, 2301 Erwin Road, Box 3096, Durham, NC 27710, USA.
| | - Anita B Kumar
- The George Washington University School of Medicine and Health Sciences, Department of Medicine, Division of Gastroenterology, The Department of Emergency Medicine, 2120 L Street NW, Suite 450, Washington, DC 20037, USA.
| | - Yan Ma
- The George Washington University, Milken Institute School of Public Health, Department of Epidemiology and Biostatistics, 950 New Hampshire Ave NW, 5th Floor, Washington, DC 20052, USA.
| | - Andrew C Meltzer
- The George Washington University School of Medicine and Health Sciences, Department of Emergency Medicine, The Department of Emergency Medicine, 2120 L Street NW, Suite 450, Washington, DC 20037, USA.
| |
Collapse
|
3
|
Affiliation(s)
- Xi Jiang
- National Clinical Research Center for Digestive Diseases, Department of Gastroenterology, Changhai Hospital, Second Military Medical University, Shanghai, China
| | - Jun Pan
- National Clinical Research Center for Digestive Diseases, Department of Gastroenterology, Changhai Hospital, Second Military Medical University, Shanghai, China
| | - Zhao-Shen Li
- National Clinical Research Center for Digestive Diseases, Department of Gastroenterology, Changhai Hospital, Second Military Medical University, Shanghai, China
| | - Zhuan Liao
- National Clinical Research Center for Digestive Diseases, Department of Gastroenterology, Changhai Hospital, Second Military Medical University, Shanghai, China
| |
Collapse
|