1
|
Zou PY, Zhu JR, Zhao Z, Mei H, Zhao JT, Sun WJ, Wang GH, Chen DF, Fan LL, Lan CH. Development and application of an artificial intelligence-assisted endoscopy system for diagnosis of Helicobacter pylori infection: a multicenter randomized controlled study. BMC Gastroenterol 2024; 24:335. [PMID: 39350033 PMCID: PMC11440712 DOI: 10.1186/s12876-024-03389-3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 12/13/2023] [Accepted: 08/27/2024] [Indexed: 10/04/2024] Open
Abstract
BACKGROUND The early diagnosis and treatment of Heliobacter pylori (H.pylori) gastrointestinal infection provide significant benefits to patients. We constructed a convolutional neural network (CNN) model based on an endoscopic system to diagnose H. pylori infection, and then examined the potential benefit of this model to endoscopists in their diagnosis of H. pylori infection. MATERIALS AND METHODS A CNN neural network system for endoscopic diagnosis of H.pylori infection was established by collecting 7377 endoscopic images from 639 patients. The accuracy, sensitivity, and specificity were determined. Then, a randomized controlled study was used to compare the accuracy of diagnosis of H. pylori infection by endoscopists who were assisted or unassisted by this CNN model. RESULTS The deep CNN model for diagnosis of H. pylori infection had an accuracy of 89.6%, a sensitivity of 90.9%, and a specificity of 88.9%. Relative to the group of endoscopists unassisted by AI, the AI-assisted group had better accuracy (92.8% [194/209; 95%CI: 89.3%, 96.4%] vs. 75.6% [158/209; 95%CI: 69.7%, 81.5%]), sensitivity (91.8% [67/73; 95%CI: 85.3%, 98.2%] vs. 78.6% [44/56; 95%CI: 67.5%, 89.7%]), and specificity (93.4% [127/136; 95%CI: 89.2%, 97.6%] vs. 74.5% [114/153; 95%CI: 67.5%, 81.5%]). All of these differences were statistically significant (P < 0.05). CONCLUSION Our AI-assisted system for diagnosis of H. pylori infection has significant ability for diagnostic, and can improve the accuracy of endoscopists in gastroscopic diagnosis. TRIAL REGISTRATION This study was approved by the Ethics Committee of Daping Hospital (10/07/2020) (No.89,2020) and was registered with the Chinese Clinical Trial Registration Center (02/09/2020) ( www.chictr.org.cn ; registration number: ChiCTR2000037801).
Collapse
Affiliation(s)
- Pei-Ying Zou
- Department of Gastroenterology, Chongqing Key Laboratory of Digestive, Malignancies, Daping Hospital, Army Medical University, Third Military Medical University), 10 Changjiang Branch Road, Chongqing, 400000, China
| | - Jian-Ru Zhu
- Department of Gastroenterology, Chongqing Key Laboratory of Digestive, Malignancies, Daping Hospital, Army Medical University, Third Military Medical University), 10 Changjiang Branch Road, Chongqing, 400000, China
| | - Zhe Zhao
- Department of Gastroenterology, Chongqing Key Laboratory of Digestive, Malignancies, Daping Hospital, Army Medical University, Third Military Medical University), 10 Changjiang Branch Road, Chongqing, 400000, China
| | - Hao Mei
- Department of Gastroenterology, Chongqing Key Laboratory of Digestive, Malignancies, Daping Hospital, Army Medical University, Third Military Medical University), 10 Changjiang Branch Road, Chongqing, 400000, China
| | - Jing-Tao Zhao
- Department of Gastroenterology, Chongqing Key Laboratory of Digestive, Malignancies, Daping Hospital, Army Medical University, Third Military Medical University), 10 Changjiang Branch Road, Chongqing, 400000, China
| | - Wen-Jing Sun
- Chongqing 13, People's Hospital, Chongqing, China
| | | | - Dong-Feng Chen
- Department of Gastroenterology, Chongqing Key Laboratory of Digestive, Malignancies, Daping Hospital, Army Medical University, Third Military Medical University), 10 Changjiang Branch Road, Chongqing, 400000, China
| | - Li-Lin Fan
- Chongqing Jiulongpo District Second People's Hospital, Chongqing, China
| | - Chun-Hui Lan
- Department of Gastroenterology, Chongqing Key Laboratory of Digestive, Malignancies, Daping Hospital, Army Medical University, Third Military Medical University), 10 Changjiang Branch Road, Chongqing, 400000, China.
| |
Collapse
|
2
|
Zha Y, Xue C, Liu Y, Ni J, De La Fuente JM, Cui D. Artificial intelligence in theranostics of gastric cancer, a review. MEDICAL REVIEW (2021) 2023; 3:214-229. [PMID: 37789960 PMCID: PMC10542883 DOI: 10.1515/mr-2022-0042] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 12/04/2022] [Accepted: 04/26/2023] [Indexed: 10/05/2023]
Abstract
Gastric cancer (GC) is one of the commonest cancers with high morbidity and mortality in the world. How to realize precise diagnosis and therapy of GC owns great clinical requirement. In recent years, artificial intelligence (AI) has been actively explored to apply to early diagnosis and treatment and prognosis of gastric carcinoma. Herein, we review recent advance of AI in early screening, diagnosis, therapy and prognosis of stomach carcinoma. Especially AI combined with breath screening early GC system improved 97.4 % of early GC diagnosis ratio, AI model on stomach cancer diagnosis system of saliva biomarkers obtained an overall accuracy of 97.18 %, specificity of 97.44 %, and sensitivity of 96.88 %. We also discuss concept, issues, approaches and challenges of AI applied in stomach cancer. This review provides a comprehensive view and roadmap for readers working in this field, with the aim of pushing application of AI in theranostics of stomach cancer to increase the early discovery ratio and curative ratio of GC patients.
Collapse
Affiliation(s)
- Yiqian Zha
- Institute of Nano Biomedicine and Engineering, Shanghai Engineering Research Center for Intelligent Diagnosis and Treatment Instrument, School of Sensing Science and Engineering, Shanghai Jiao Tong University, Shanghai, China
- National Engineering Research Center for Nanotechnology, Shanghai, China
| | - Cuili Xue
- Institute of Nano Biomedicine and Engineering, Shanghai Engineering Research Center for Intelligent Diagnosis and Treatment Instrument, School of Sensing Science and Engineering, Shanghai Jiao Tong University, Shanghai, China
- National Engineering Research Center for Nanotechnology, Shanghai, China
| | - Yanlei Liu
- Institute of Nano Biomedicine and Engineering, Shanghai Engineering Research Center for Intelligent Diagnosis and Treatment Instrument, School of Sensing Science and Engineering, Shanghai Jiao Tong University, Shanghai, China
- National Engineering Research Center for Nanotechnology, Shanghai, China
| | - Jian Ni
- Institute of Nano Biomedicine and Engineering, Shanghai Engineering Research Center for Intelligent Diagnosis and Treatment Instrument, School of Sensing Science and Engineering, Shanghai Jiao Tong University, Shanghai, China
- National Engineering Research Center for Nanotechnology, Shanghai, China
| | | | - Daxiang Cui
- Institute of Nano Biomedicine and Engineering, Shanghai Engineering Research Center for Intelligent Diagnosis and Treatment Instrument, School of Sensing Science and Engineering, Shanghai Jiao Tong University, Shanghai, China
- National Engineering Research Center for Nanotechnology, Shanghai, China
| |
Collapse
|
3
|
Jhang JY, Tsai YC, Hsu TC, Huang CR, Cheng HC, Sheu BS. Gastric Section Correlation Network for Gastric Precancerous Lesion Diagnosis. IEEE OPEN JOURNAL OF ENGINEERING IN MEDICINE AND BIOLOGY 2023; 5:434-442. [PMID: 38899022 PMCID: PMC11186652 DOI: 10.1109/ojemb.2023.3277219] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/03/2023] [Revised: 03/24/2023] [Accepted: 05/10/2023] [Indexed: 06/21/2024] Open
Abstract
Goal: Diagnosing the corpus-predominant gastritis index (CGI) which is an early precancerous lesion in the stomach has been shown its effectiveness in identifying high gastric cancer risk patients for preventive healthcare. However, invasive biopsies and time-consuming pathological analysis are required for the CGI diagnosis. Methods: We propose a novel gastric section correlation network (GSCNet) for the CGI diagnosis from endoscopic images of three dominant gastric sections, the antrum, body and cardia. The proposed network consists of two dominant modules including the scaling feature fusion module and section correlation module. The front one aims to extract scaling fusion features which can effectively represent the mucosa under variant viewing angles and scale changes for each gastric section. The latter one aims to apply the medical prior knowledge with three section correlation losses to model the correlations of different gastric sections for the CGI diagnosis. Results: The proposed method outperforms competing deep learning methods and achieves high testing accuracy, sensitivity, and specificity of 0.957, 0.938 and 0.962, respectively. Conclusions: The proposed method is the first method to identify high gastric cancer risk patients with CGI from endoscopic images without invasive biopsies and time-consuming pathological analysis.
Collapse
Affiliation(s)
- Jyun-Yao Jhang
- Department of Computer Science and EngineeringNational Chung Hsing UniversityTaichung402Taiwan
| | - Yu-Ching Tsai
- Department of Internal MedicineTainan Hospital, Ministry of Health and WelfareTainan701Taiwan
- Department of Internal Medicine, National Cheng Kung University Hospital, College of MedicineNational Cheng Kung UniversityTainan701Taiwan
| | - Tzu-Chun Hsu
- Department of Computer Science and EngineeringNational Chung Hsing UniversityTaichung402Taiwan
| | - Chun-Rong Huang
- Cross College Elite Program, and Academy of Innovative Semiconductor and Sustainable ManufacturingNational Cheng Kung UniversityTainan701Taiwan
- Department of Computer Science and EngineeringNational Chung Hsing UniversityTaichung402Taiwan
| | - Hsiu-Chi Cheng
- Department of Internal Medicine, Institute of Clinical Medicine and Molecular MedicineNational Cheng Kung UniversityTainan701Taiwan
- Department of Internal MedicineTainan Hospital, Ministry of Health and WelfareTainan701Taiwan
| | - Bor-Shyang Sheu
- Institute of Clinical Medicine and Department of Internal Medicine, National Cheng Kung University HospitalNational Cheng Kung UniversityTainan701Taiwan
| |
Collapse
|
4
|
Yacob YM, Alquran H, Mustafa WA, Alsalatie M, Sakim HAM, Lola MS. H. pylori Related Atrophic Gastritis Detection Using Enhanced Convolution Neural Network (CNN) Learner. Diagnostics (Basel) 2023; 13:diagnostics13030336. [PMID: 36766441 PMCID: PMC9914156 DOI: 10.3390/diagnostics13030336] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/21/2022] [Revised: 01/09/2023] [Accepted: 01/12/2023] [Indexed: 01/19/2023] Open
Abstract
Atrophic gastritis (AG) is commonly caused by the infection of the Helicobacter pylori (H. pylori) bacteria. If untreated, AG may develop into a chronic condition leading to gastric cancer, which is deemed to be the third primary cause of cancer-related deaths worldwide. Precursory detection of AG is crucial to avoid such cases. This work focuses on H. pylori-associated infection located at the gastric antrum, where the classification is of binary classes of normal versus atrophic gastritis. Existing work developed the Deep Convolution Neural Network (DCNN) of GoogLeNet with 22 layers of the pre-trained model. Another study employed GoogLeNet based on the Inception Module, fast and robust fuzzy C-means (FRFCM), and simple linear iterative clustering (SLIC) superpixel algorithms to identify gastric disease. GoogLeNet with Caffe framework and ResNet-50 are machine learners that detect H. pylori infection. Nonetheless, the accuracy may become abundant as the network depth increases. An upgrade to the current standards method is highly anticipated to avoid untreated and inaccurate diagnoses that may lead to chronic AG. The proposed work incorporates improved techniques revolving within DCNN with pooling as pre-trained models and channel shuffle to assist streams of information across feature channels to ease the training of networks for deeper CNN. In addition, Canonical Correlation Analysis (CCA) feature fusion method and ReliefF feature selection approaches are intended to revamp the combined techniques. CCA models the relationship between the two data sets of significant features generated by pre-trained ShuffleNet. ReliefF reduces and selects essential features from CCA and is classified using the Generalized Additive Model (GAM). It is believed the extended work is justified with a 98.2% testing accuracy reading, thus providing an accurate diagnosis of normal versus atrophic gastritis.
Collapse
Affiliation(s)
- Yasmin Mohd Yacob
- Faculty of Electronic Engineering & Technology, Pauh Putra Campus, Universiti Malaysia Perlis (UniMAP), Arau 02600, Perlis, Malaysia
- Centre of Excellence for Advanced Computing, Pauh Putra Campus, Universiti Malaysia Perlis (UniMAP), Arau 02600, Perlis, Malaysia
| | - Hiam Alquran
- Department of Biomedical Systems and Informatics Engineering, Yarmouk University, Irbid 21163, Jordan
- Department of Biomedical Engineering, Jordan University of Science and Technology, Irbid 22110, Jordan
| | - Wan Azani Mustafa
- Centre of Excellence for Advanced Computing, Pauh Putra Campus, Universiti Malaysia Perlis (UniMAP), Arau 02600, Perlis, Malaysia
- Faculty of Electrical Engineering & Technology, Pauh Putra Campus, Universiti Malaysia Perlis (UniMAP), Arau 02600, Perlis, Malaysia
- Correspondence:
| | - Mohammed Alsalatie
- King Hussein Medical Center, Royal Jordanian Medical Service, The Institute of Biomedical Technology, Amman 11855, Jordan
| | - Harsa Amylia Mat Sakim
- School of Electrical and Electronic Engineering, Engineering Campus, Universiti Sains Malaysia, Nibong Tebal 11800, Penang, Malaysia
| | - Muhamad Safiih Lola
- Faculty of Ocean Engineering Technology and Informatics, Universiti Malaysia Terengganu, Kuala Terengganu 21030, Terengganu, Malaysia
| |
Collapse
|
5
|
Luo Q, Yang H, Hu B. Application of artificial intelligence in the endoscopic diagnosis of early gastric cancer, atrophic gastritis, and Helicobacter pylori infection. J Dig Dis 2022; 23:666-674. [PMID: 36661411 DOI: 10.1111/1751-2980.13154] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 08/12/2022] [Revised: 01/04/2023] [Accepted: 01/17/2023] [Indexed: 01/21/2023]
Abstract
Gastric cancer (GC) is one of the most serious health problems worldwide. Chronic atrophic gastritis (CAG) is most commonly caused by Helicobacter pylori (H. pylori) infection. Currently, endoscopic detection of early gastric cancer (EGC) and CAG remains challenging for endoscopists, and the diagnostic accuracy of H. pylori infection by endoscopy is approximately 70%. Artificial intelligence (AI) can assist endoscopic diagnosis including detection, prediction of depth of invasion, boundary delineation, and anatomical location of EGC, and has achievable diagnostic ability even comparable to experienced endoscopists. In this review we summarized various AI-assisted systems in the diagnosis of EGC, CAG, and H. pylori infection.
Collapse
Affiliation(s)
- Qi Luo
- Department of Gastroenterology, West China Hospital, Sichuan University, Chengdu, Sichuan Province, China
| | - Hang Yang
- Department of Gastroenterology, West China Hospital, Sichuan University, Chengdu, Sichuan Province, China
| | - Bing Hu
- Department of Gastroenterology, West China Hospital, Sichuan University, Chengdu, Sichuan Province, China
| |
Collapse
|
6
|
Dilaghi E, Lahner E, Annibale B, Esposito G. Systematic review and meta-analysis: Artificial intelligence for the diagnosis of gastric precancerous lesions and Helicobacter pylori infection. Dig Liver Dis 2022; 54:1630-1638. [PMID: 35382973 DOI: 10.1016/j.dld.2022.03.007] [Citation(s) in RCA: 13] [Impact Index Per Article: 4.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 01/29/2022] [Revised: 03/12/2022] [Accepted: 03/16/2022] [Indexed: 02/08/2023]
Abstract
BACKGROUND The endoscopic diagnosis of Helicobacter-pylori(H.pylori) infection and gastric precancerous lesions(GPL), namely atrophic-gastritis and intestinal-metaplasia, still remains challenging. Artificial intelligence(AI) may represent a powerful resource for the endoscopic recognition of these conditions. AIMS To explore the diagnostic performance(DP) of AI in the diagnosis of GPL and H.pylori infection. METHODS A systematic-review was performed by two independent authors up to September 2021. Inclusion criteria were studies focusing on the DP of AI-system in the diagnosis of GPL and H.pylori infection. The pooled accuracy of studies included was reported. RESULTS Overall, 128 studies were found (PubMed-Embase-Cochrane Library) and four and nine studies were finally included regarding GPL and H.pylori infection, respectively. The pooled-accuracy(random effects model) was 90.3%(95%CI 84.3-94.9) and 79.6%(95%CI 66.7-90.0) with a significant heterogeneity[I2=90.4%(95%CI 78.5-95.7);I2=97.9%(97.2-98.6)] for GPL and H.pylori infection, respectively. The Begg's-test showed a significant publication-bias(p = 0.0371) only among studies regarding H.pylori infection. The pooled-accuracy(random-effects-model) was similar considering only studies using CNN-model for the diagnosis of H.pylori infection: 74.1%[(95%CI 51.6-91.3);I2=98.9%(95%CI 98.5-99.3)], Begg's-test(p = 0.1416) did not show publication-bias. CONCLUSION AI-system seems to be a good resource for an easier diagnosis of GPL and H.pylori infection, showing a pooled-diagnostic-accuracy of 90% and 80%, respectively. However, considering the high heterogeneity, these promising data need an external validation by randomized control trials and prospective real-time studies.
Collapse
Affiliation(s)
- E Dilaghi
- Department of Medical-Surgical Sciences and Translational Medicine, Sant'Andrea Hospital, Sapienza University of Rome, Via di Grottarossa, Roma 1035 - 00189, Italy
| | - E Lahner
- Department of Medical-Surgical Sciences and Translational Medicine, Sant'Andrea Hospital, Sapienza University of Rome, Via di Grottarossa, Roma 1035 - 00189, Italy
| | - B Annibale
- Department of Medical-Surgical Sciences and Translational Medicine, Sant'Andrea Hospital, Sapienza University of Rome, Via di Grottarossa, Roma 1035 - 00189, Italy
| | - G Esposito
- Department of Medical-Surgical Sciences and Translational Medicine, Sant'Andrea Hospital, Sapienza University of Rome, Via di Grottarossa, Roma 1035 - 00189, Italy.
| |
Collapse
|
7
|
Mărginean CO, Meliț LE, Săsăran MO. Traditional and Modern Diagnostic Approaches in Diagnosing Pediatric Helicobacter pylori Infection. CHILDREN 2022; 9:children9070994. [PMID: 35883980 PMCID: PMC9316053 DOI: 10.3390/children9070994] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Subscribe] [Scholar Register] [Received: 06/05/2022] [Revised: 06/24/2022] [Accepted: 06/29/2022] [Indexed: 01/10/2023]
Abstract
Helicobacter pylori (H. pylori) is the most common bacterial infection worldwide, is usually acquired during childhood and is related to gastric carcinogenesis during adulthood. Therefore, its early proper diagnosis and subsequent successful eradication represent the cornerstones of gastric cancer prevention. The aim of this narrative review was to assess traditional and modern diagnostic methods in terms of H. pylori diagnosis. Several invasive and non-invasive methods were described, each with its pros and cons. The invasive diagnostic methods comprise endoscopy with biopsy, rapid urease tests, histopathological exams, cultures and biopsy-based molecular tests. Among these, probably the most available, accurate and cost-effective test remains histology, albeit molecular tests definitely remain the most accurate despite their high costs. The non-invasive tests consist of urea breath tests, serology, stool antigens and non-invasive molecular tests. Urea breath tests and stool antigens are the most useful in clinical practice both for the diagnosis of H. pylori infection and for monitoring the eradication of this infection after therapy. The challenges related to accurate diagnosis lead to a choice that must be based on H. pylori virulence, environmental factors and host peculiarities.
Collapse
Affiliation(s)
- Cristina Oana Mărginean
- Department of Pediatrics I, George Emil Palade University of Medicine, Pharmacy, Science, and Technology of Târgu Mureș, Gheorghe Marinescu Street No. 38, 540136 Targu Mures, Romania;
| | - Lorena Elena Meliț
- Department of Pediatrics I, George Emil Palade University of Medicine, Pharmacy, Science, and Technology of Târgu Mureș, Gheorghe Marinescu Street No. 38, 540136 Targu Mures, Romania;
- Correspondence:
| | - Maria Oana Săsăran
- Department of Pediatrics III, George Emil Palade University of Medicine, Pharmacy, Science, and Technology of Târgu Mureș, Gheorghe Marinescu Street No. 38, 540136 Targu Mures, Romania;
| |
Collapse
|
8
|
Nien CM, Yang EH, Chang WL, Cheng HC, Huang CR. Criss-Cross Attention Based Multi-level Fusion Network for Gastric Intestinal Metaplasia Segmentation. LECTURE NOTES IN COMPUTER SCIENCE 2022:13-23. [DOI: 10.1007/978-3-031-21083-9_2] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 01/06/2025]
|
9
|
Visaggi P, de Bortoli N, Barberio B, Savarino V, Oleas R, Rosi EM, Marchi S, Ribolsi M, Savarino E. Artificial Intelligence in the Diagnosis of Upper Gastrointestinal Diseases. J Clin Gastroenterol 2022; 56:23-35. [PMID: 34739406 PMCID: PMC9988236 DOI: 10.1097/mcg.0000000000001629] [Citation(s) in RCA: 16] [Impact Index Per Article: 5.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 12/13/2022]
Abstract
Artificial intelligence (AI) has enormous potential to support clinical routine workflows and therefore is gaining increasing popularity among medical professionals. In the field of gastroenterology, investigations on AI and computer-aided diagnosis (CAD) systems have mainly focused on the lower gastrointestinal (GI) tract. However, numerous CAD tools have been tested also in upper GI disorders showing encouraging results. The main application of AI in the upper GI tract is endoscopy; however, the need to analyze increasing loads of numerical and categorical data in short times has pushed researchers to investigate applications of AI systems in other upper GI settings, including gastroesophageal reflux disease, eosinophilic esophagitis, and motility disorders. AI and CAD systems will be increasingly incorporated into daily clinical practice in the coming years, thus at least basic notions will be soon required among physicians. For noninsiders, the working principles and potential of AI may be as fascinating as obscure. Accordingly, we reviewed systematic reviews, meta-analyses, randomized controlled trials, and original research articles regarding the performance of AI in the diagnosis of both malignant and benign esophageal and gastric diseases, also discussing essential characteristics of AI.
Collapse
Affiliation(s)
- Pierfrancesco Visaggi
- Gastroenterology Unit, Department of Translational Research and New Technologies in Medicine and Surgery, University of Pisa, Pisa
| | - Nicola de Bortoli
- Gastroenterology Unit, Department of Translational Research and New Technologies in Medicine and Surgery, University of Pisa, Pisa
| | - Brigida Barberio
- Department of Surgery, Oncology, and Gastroenterology, Division of Gastroenterology, University of Padua, Padua
| | - Vincenzo Savarino
- Gastroenterology Unit, Department of Internal Medicine, University of Genoa, Genoa
| | - Roberto Oleas
- Ecuadorean Institute of Digestive Diseases, Guayaquil, Ecuador
| | - Emma M. Rosi
- Gastroenterology Unit, Department of Translational Research and New Technologies in Medicine and Surgery, University of Pisa, Pisa
| | - Santino Marchi
- Gastroenterology Unit, Department of Translational Research and New Technologies in Medicine and Surgery, University of Pisa, Pisa
| | - Mentore Ribolsi
- Department of Digestive Diseases, Campus Bio Medico University of Rome, Roma, Italy
| | - Edoardo Savarino
- Department of Surgery, Oncology, and Gastroenterology, Division of Gastroenterology, University of Padua, Padua
| |
Collapse
|
10
|
Bang CS. Artificial Intelligence in the Analysis of Upper Gastrointestinal Disorders. THE KOREAN JOURNAL OF HELICOBACTER AND UPPER GASTROINTESTINAL RESEARCH 2021. [DOI: 10.7704/kjhugr.2021.0030] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/17/2022]
Abstract
In the past, conventional machine learning was applied to analyze tabulated medical data while deep learning was applied to study afflictions such as gastrointestinal disorders. Neural networks were used to detect, classify, and delineate various images of lesions because the local feature selection and optimization of the deep learning model enabled accurate image analysis. With the accumulation of medical records, the evolution of computational power and graphics processing units, and the widespread use of open-source libraries in large-scale machine learning processes, medical artificial intelligence (AI) is overcoming its limitations. While early studies prioritized the automatic diagnosis of cancer or pre-cancerous lesions, the current expanded scope of AI includes benign lesions, quality control, and machine learning analysis of big data. However, the limited commercialization of medical AI and the need to justify its application in each field of research are restricting factors. Modeling assumes that observations follow certain statistical rules, and external validation checks whether assumption is correct or generalizable. Therefore, unused data are essential in the training or internal testing process to validate the performance of the established AI models. This article summarizes the studies on the application of AI models in upper gastrointestinal disorders. The current limitations and the perspectives on future development have also been discussed.
Collapse
|
11
|
Pecere S, Milluzzo SM, Esposito G, Dilaghi E, Telese A, Eusebi LH. Applications of Artificial Intelligence for the Diagnosis of Gastrointestinal Diseases. Diagnostics (Basel) 2021; 11:diagnostics11091575. [PMID: 34573917 PMCID: PMC8469485 DOI: 10.3390/diagnostics11091575] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/15/2021] [Revised: 08/20/2021] [Accepted: 08/23/2021] [Indexed: 12/16/2022] Open
Abstract
The development of convolutional neural networks has achieved impressive advances of machine learning in recent years, leading to an increasing use of artificial intelligence (AI) in the field of gastrointestinal (GI) diseases. AI networks have been trained to differentiate benign from malignant lesions, analyze endoscopic and radiological GI images, and assess histological diagnoses, obtaining excellent results and high overall diagnostic accuracy. Nevertheless, there data are lacking on side effects of AI in the gastroenterology field, and high-quality studies comparing the performance of AI networks to health care professionals are still limited. Thus, large, controlled trials in real-time clinical settings are warranted to assess the role of AI in daily clinical practice. This narrative review gives an overview of some of the most relevant potential applications of AI for gastrointestinal diseases, highlighting advantages and main limitations and providing considerations for future development.
Collapse
Affiliation(s)
- Silvia Pecere
- Digestive Endoscopy Unit, Fondazione Policlinico Universitario A. Gemelli IRCCS, Università Cattolica del Sacro Cuore, 00135 Rome, Italy;
- Center for Endoscopic Research Therapeutics and Training (CERTT), Catholic University, 00168 Rome, Italy
- Correspondence: (S.P.); (L.H.E.)
| | - Sebastian Manuel Milluzzo
- Digestive Endoscopy Unit, Fondazione Policlinico Universitario A. Gemelli IRCCS, Università Cattolica del Sacro Cuore, 00135 Rome, Italy;
- Fondazione Poliambulanza Istituto Ospedaliero, 25121 Brescia, Italy
| | - Gianluca Esposito
- Department of Medical-Surgical Sciences and Translational Medicine, Sant’Andrea Hospital, Sapienza University of Rome, 00168 Rome, Italy; (G.E.); (E.D.)
| | - Emanuele Dilaghi
- Department of Medical-Surgical Sciences and Translational Medicine, Sant’Andrea Hospital, Sapienza University of Rome, 00168 Rome, Italy; (G.E.); (E.D.)
| | - Andrea Telese
- Department of Gastroenterology, University College London Hospital (UCLH), London NW1 2AF, UK;
| | - Leonardo Henry Eusebi
- Division of Gastroenterology and Endoscopy, IRCCS Azienda Ospedaliero-Universitaria di Bologna, 40121 Bologna, Italy
- Department of Medical and Surgical Sciences, University of Bologna, 40121 Bologna, Italy
- Correspondence: (S.P.); (L.H.E.)
| |
Collapse
|
12
|
Lu YF, Lyu B. Current situation and prospect of artificial intelligence application in endoscopic diagnosis of Helicobacter pylori infection. Artif Intell Gastrointest Endosc 2021; 2:50-62. [DOI: 10.37126/aige.v2.i3.50] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 05/02/2021] [Revised: 06/01/2021] [Accepted: 06/18/2021] [Indexed: 02/06/2023] Open
Abstract
With the appearance and prevalence of deep learning, artificial intelligence (AI) has been broadly studied and made great progress in various fields of medicine, including gastroenterology. Helicobacter pylori (H. pylori), closely associated with various digestive and extradigestive diseases, has a high infection rate worldwide. Endoscopic surveillance can evaluate H. pylori infection situations and predict the risk of gastric cancer, but there is no objective diagnostic criteria to eliminate the differences between operators. The computer-aided diagnosis system based on AI technology has demonstrated excellent performance for the diagnosis of H. pylori infection, which is superior to novice endoscopists and similar to skilled. Compared with the visual diagnosis of H. pylori infection by endoscopists, AI possesses voluminous advantages: High accuracy, high efficiency, high quality control, high objectivity, and high-effect teaching. This review summarizes the previous and recent studies on AI-assisted diagnosis of H. pylori infection, points out the limitations, and puts forward prospect for future research.
Collapse
Affiliation(s)
- Yi-Fan Lu
- Department of Gastroenterology, The First Affiliated Hospital of Zhejiang Chinese Medical University, Hangzhou 310006, Zhejiang Province, China
| | - Bin Lyu
- Department of Gastroenterology, The First Affiliated Hospital of Zhejiang Chinese Medical University, Hangzhou 310006, Zhejiang Province, China
| |
Collapse
|
13
|
Lin TH, Jhang JY, Huang CR, Tsai YC, Cheng HC, Sheu BS. Deep Ensemble Feature Network for Gastric Section Classification. IEEE J Biomed Health Inform 2021; 25:77-87. [PMID: 32750926 DOI: 10.1109/jbhi.2020.2999731] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/10/2022]
Abstract
In this paper, we propose a novel deep ensemble feature (DEF) network to classify gastric sections from endoscopic images. Different from recent deep ensemble learning methods, which need to train deep features and classifiers individually to obtain fused classification results, the proposed method can simultaneously learn the deep ensemble feature from arbitrary number of convolutional neural networks (CNNs) and the decision classifier in an end-to-end trainable manner. It comprises two sub networks, the ensemble feature network and the decision network. The former sub network learns the deep ensemble feature from multiple CNNs to represent endoscopic images. The latter sub network learns to obtain the classification labels by using the deep ensemble feature. Both sub networks are optimized based on the proposed ensemble feature loss and the decision loss which guide the learning of deep features and decisions. As shown in the experimental results, the proposed method outperforms the state-of-the-art deep learning, ensemble learning, and deep ensemble learning methods.
Collapse
|
14
|
Bang CS, Lee JJ, Baik GH. Artificial Intelligence for the Prediction of Helicobacter Pylori Infection in Endoscopic Images: Systematic Review and Meta-Analysis Of Diagnostic Test Accuracy. J Med Internet Res 2020; 22:e21983. [PMID: 32936088 PMCID: PMC7527948 DOI: 10.2196/21983] [Citation(s) in RCA: 61] [Impact Index Per Article: 12.2] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/30/2020] [Revised: 08/02/2020] [Accepted: 08/03/2020] [Indexed: 02/05/2023] Open
Abstract
BACKGROUND Helicobacter pylori plays a central role in the development of gastric cancer, and prediction of H pylori infection by visual inspection of the gastric mucosa is an important function of endoscopy. However, there are currently no established methods of optical diagnosis of H pylori infection using endoscopic images. Definitive diagnosis requires endoscopic biopsy. Artificial intelligence (AI) has been increasingly adopted in clinical practice, especially for image recognition and classification. OBJECTIVE This study aimed to evaluate the diagnostic test accuracy of AI for the prediction of H pylori infection using endoscopic images. METHODS Two independent evaluators searched core databases. The inclusion criteria included studies with endoscopic images of H pylori infection and with application of AI for the prediction of H pylori infection presenting diagnostic performance. Systematic review and diagnostic test accuracy meta-analysis were performed. RESULTS Ultimately, 8 studies were identified. Pooled sensitivity, specificity, diagnostic odds ratio, and area under the curve of AI for the prediction of H pylori infection were 0.87 (95% CI 0.72-0.94), 0.86 (95% CI 0.77-0.92), 40 (95% CI 15-112), and 0.92 (95% CI 0.90-0.94), respectively, in the 1719 patients (385 patients with H pylori infection vs 1334 controls). Meta-regression showed methodological quality and included the number of patients in each study for the purpose of heterogeneity. There was no evidence of publication bias. The accuracy of the AI algorithm reached 82% for discrimination between noninfected images and posteradication images. CONCLUSIONS An AI algorithm is a reliable tool for endoscopic diagnosis of H pylori infection. The limitations of lacking external validation performance and being conducted only in Asia should be overcome. TRIAL REGISTRATION PROSPERO CRD42020175957; https://www.crd.york.ac.uk/prospero/display_record.php?RecordID=175957.
Collapse
Affiliation(s)
- Chang Seok Bang
- Department of Internal Medicine, Hallym University College of Medicine, Chuncheon, Republic of Korea
- Institute for Liver and Digestive Diseases, Hallym University, Chuncheon, Republic of Korea
- Institute of New Frontier Research, Hallym University College of Medicine, Chuncheon, Republic of Korea
- Division of Big Data and Artificial Intelligence, Chuncheon Sacred Heart Hospital, Chuncheon, Republic of Korea
| | - Jae Jun Lee
- Institute of New Frontier Research, Hallym University College of Medicine, Chuncheon, Republic of Korea
- Division of Big Data and Artificial Intelligence, Chuncheon Sacred Heart Hospital, Chuncheon, Republic of Korea
- Department of Anesthesiology and Pain Medicine, Hallym University College of Medicine, Chuncheon, Republic of Korea
| | - Gwang Ho Baik
- Department of Internal Medicine, Hallym University College of Medicine, Chuncheon, Republic of Korea
- Institute for Liver and Digestive Diseases, Hallym University, Chuncheon, Republic of Korea
| |
Collapse
|
15
|
Ali H, Sharif M, Yasmin M, Rehmani MH, Riaz F. A survey of feature extraction and fusion of deep learning for detection of abnormalities in video endoscopy of gastrointestinal-tract. Artif Intell Rev 2019. [DOI: 10.1007/s10462-019-09743-2] [Citation(s) in RCA: 16] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/11/2022]
|
16
|
Ishihara K, Ogawa T, Haseyama M. Helicobacter Pylori infection detection from gastric X-ray images based on feature fusion and decision fusion. Comput Biol Med 2017; 84:69-78. [PMID: 28346875 DOI: 10.1016/j.compbiomed.2017.03.007] [Citation(s) in RCA: 7] [Impact Index Per Article: 0.9] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/30/2016] [Revised: 03/07/2017] [Accepted: 03/08/2017] [Indexed: 12/18/2022]
Abstract
In this paper, a fully automatic method for detection of Helicobacter pylori (H. pylori) infection is presented with the aim of constructing a computer-aided diagnosis (CAD) system. In order to realize a CAD system with good performance for detection of H. pylori infection, we focus on the following characteristic of stomach X-ray examination. The accuracy of X-ray examination differs depending on the symptom of H. pylori infection that is focused on and the position from which X-ray images are taken. Therefore, doctors have to comprehensively assess the symptoms and positions. In order to introduce the idea of doctors' assessment into the CAD system, we newly propose a method for detection of H. pylori infection based on the combined use of feature fusion and decision fusion. As a feature fusion scheme, we adopt Multiple Kernel Learning (MKL). Since MKL can combine several features with determination of their weights, it can represent the differences in symptoms. By constructing an MKL classifier for each position, we can obtain several detection results. Furthermore, we introduce confidence-based decision fusion, which can consider the relationship between the classifier's performance and the detection results. Consequently, accurate detection of H. pylori infection becomes possible by the proposed method. Experimental results obtained by applying the proposed method to real X-ray images show that our method has good performance, close to the results of detection by specialists, and indicate that the realization of a CAD system for determining the risk of H. pylori infection is possible.
Collapse
Affiliation(s)
- Kenta Ishihara
- Graduate School of Information Science and Technology, Hokkaido University, Kita-14, Nishi-9, Sapporo-shi 060-0814, Japan.
| | - Takahiro Ogawa
- Graduate School of Information Science and Technology, Hokkaido University, Kita-14, Nishi-9, Sapporo-shi 060-0814, Japan.
| | - Miki Haseyama
- Graduate School of Information Science and Technology, Hokkaido University, Kita-14, Nishi-9, Sapporo-shi 060-0814, Japan.
| |
Collapse
|
17
|
Wang S, Cong Y, Fan H, Liu L, Li X, Yang Y, Tang Y, Zhao H, Yu H. Computer-Aided Endoscopic Diagnosis Without Human-Specific Labeling. IEEE Trans Biomed Eng 2016; 63:2347-2358. [DOI: 10.1109/tbme.2016.2530141] [Citation(s) in RCA: 20] [Impact Index Per Article: 2.2] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/09/2022]
|
18
|
Yacob YM, Mat Sakim HA, Mat Isa NA, Sobri Z. Discretized data pattern in endoscopic gastritis images using Dynamic Window and Pairwise Gini Criterion. ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. ANNUAL INTERNATIONAL CONFERENCE 2015; 2013:6095-8. [PMID: 24111130 DOI: 10.1109/embc.2013.6610943] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/10/2022]
Abstract
Curent standard clinical procedure for gastritis is via endoscopy by performing an invasive procedure. The procedure takes tissue samples from patient's antrum and diagnoses based on pathological evaluation. Several non-invasive computer-aided visualization studies have been conducted to perform feature extraction from the endoscopic gastritis images. Based on an extensive literature search, studies to extract data patterns from the images has never been conducted. Discretization or data pattern extraction is one of the data pre-processing technique that promotes classification. However, data pre-processing is often overlooked by many researchers because it takes up time from the overall classification process. Thus, data pre-processing studies offer faster pre-processing time and compromise with the error rate. Trade-off has been a prolonged issue in discretization studies. Often discretization time is reduced, and the error rate is compromised. However, the proposed discretization algorithm implemented on extracted features from gastritis images has reduced not only the discretization time but also the error rate. As a result of discretization process, it generates good generalization of the data patterns to the endoscopic gastritis extracted features. Thus, determining discretized data patterns from the extracted endoscopic gastritis images may improve the overall classification process in terms of accuracy and learning time.
Collapse
|
19
|
Wang S, Cong Y, Cao J, Yang Y, Tang Y, Zhao H, Yu H. Scalable gastroscopic video summarization via similar-inhibition dictionary selection. Artif Intell Med 2015; 66:1-13. [PMID: 26363682 DOI: 10.1016/j.artmed.2015.08.006] [Citation(s) in RCA: 9] [Impact Index Per Article: 0.9] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/07/2015] [Revised: 06/19/2015] [Accepted: 08/07/2015] [Indexed: 12/22/2022]
Abstract
OBJECTIVE This paper aims at developing an automated gastroscopic video summarization algorithm to assist clinicians to more effectively go through the abnormal contents of the video. METHODS AND MATERIALS To select the most representative frames from the original video sequence, we formulate the problem of gastroscopic video summarization as a dictionary selection issue. Different from the traditional dictionary selection methods, which take into account only the number and reconstruction ability of selected key frames, our model introduces the similar-inhibition constraint to reinforce the diversity of selected key frames. We calculate the attention cost by merging both gaze and content change into a prior cue to help select the frames with more high-level semantic information. Moreover, we adopt an image quality evaluation process to eliminate the interference of the poor quality images and a segmentation process to reduce the computational complexity. RESULTS For experiments, we build a new gastroscopic video dataset captured from 30 volunteers with more than 400k images and compare our method with the state-of-the-arts using the content consistency, index consistency and content-index consistency with the ground truth. Compared with all competitors, our method obtains the best results in 23 of 30 videos evaluated based on content consistency, 24 of 30 videos evaluated based on index consistency and all videos evaluated based on content-index consistency. CONCLUSIONS For gastroscopic video summarization, we propose an automated annotation method via similar-inhibition dictionary selection. Our model can achieve better performance compared with other state-of-the-art models and supplies more suitable key frames for diagnosis. The developed algorithm can be automatically adapted to various real applications, such as the training of young clinicians, computer-aided diagnosis or medical report generation.
Collapse
Affiliation(s)
- Shuai Wang
- State Key Laboratory of Robotics, Shenyang Institute of Automation, Chinese Academy of Sciences, Nanta Street 114, Shenyang 110016, China; University of Chinese Academy of Sciences, No. 19A Yuquan Road, Beijing 100049, China.
| | - Yang Cong
- State Key Laboratory of Robotics, Shenyang Institute of Automation, Chinese Academy of Sciences, Nanta Street 114, Shenyang 110016, China
| | - Jun Cao
- Department of Computer Science, Arizona State University, 1711 South Rural Road, Tempe, AZ 85287, USA
| | - Yunsheng Yang
- Department of Gastroenterology and Hepatology, Chinese PLA General Hospital, 28 Fuxing Road, Beijing 100000, China
| | - Yandong Tang
- State Key Laboratory of Robotics, Shenyang Institute of Automation, Chinese Academy of Sciences, Nanta Street 114, Shenyang 110016, China
| | - Huaici Zhao
- Key Laboratory of Image Understanding and Computer Vision, Shenyang Institute of Automation, Chinese Academy of Sciences, Nanta Street 114, Shenyang 110016, China
| | - Haibin Yu
- Key Laboratory of Networked Control Systems, Shenyang Institute of Automation, Chinese Academy of Sciences, Nanta Street 114, Shenyang 110016, China
| |
Collapse
|
20
|
Huang CR, Chen YT, Chen WY, Cheng HC, Sheu BS. Gastroesophageal Reflux Disease Diagnosis Using Hierarchical Heterogeneous Descriptor Fusion Support Vector Machine. IEEE Trans Biomed Eng 2015; 63:588-99. [PMID: 26276981 DOI: 10.1109/tbme.2015.2466460] [Citation(s) in RCA: 12] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/10/2022]
Abstract
A new computer-aided diagnosis method is proposed to diagnose the gastroesophageal reflux disease (GERD) from endoscopic images of the esophageal-gastric junction. To avoid the interferences of different endoscope devices and automatic camera white balance adjustment, heterogeneous descriptors computed from heterogeneous color models are used to represent endoscopic images. Instead of concatenating these descriptors to a super vector, a hierarchical heterogeneous descriptor fusion support vector machine (HHDF-SVM) framework is proposed to simultaneously apply heterogeneous descriptors for GERD diagnosis and overcome the curse of dimensionality problem. During validation, heterogeneous descriptors are extracted from test endoscopic images at first. The classification result is obtained by using HHDF-SVM with heterogeneous descriptors. As shown in the experiments, our method can automatically diagnose GERD without any manual selection of region of interest and achieve better accuracy compared to states-of-the-art methods.
Collapse
|
21
|
Liedlgruber M, Uhl A. Computer-aided decision support systems for endoscopy in the gastrointestinal tract: a review. IEEE Rev Biomed Eng 2012; 4:73-88. [PMID: 22273792 DOI: 10.1109/rbme.2011.2175445] [Citation(s) in RCA: 88] [Impact Index Per Article: 6.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/13/2022]
Abstract
Today, medical endoscopy is a widely used procedure to inspect the inner cavities of the human body. The advent of endoscopic imaging techniques-allowing the acquisition of images or videos-created the possibility for the development of the whole new branch of computer-aided decision support systems. Such systems aim at helping physicians to identify possibly malignant abnormalities more accurately. At the beginning of this paper, we give a brief introduction to the history of endoscopy, followed by introducing the main types of endoscopes which emerged so far (flexible endoscope, wireless capsule endoscope, and confocal laser endomicroscope). We then give a brief introduction to computer-aided decision support systems specifically targeted at endoscopy in the gastrointestinal tract. Then we present general facts and figures concerning computer-aided decision support systems and summarize work specifically targeted at computer-aided decision support in the gastrointestinal tract. This summary is followed by a discussion of some common issues concerning the approaches reviewed and suggestions of possible ways to resolve them.
Collapse
|
22
|
Qi N, Zhang Z, Xiang Y, Harrington PDB. Locally linear embedding method for dimensionality reduction of tissue sections of endometrial carcinoma by near infrared spectroscopy. Anal Chim Acta 2012; 724:12-9. [DOI: 10.1016/j.aca.2012.02.040] [Citation(s) in RCA: 14] [Impact Index Per Article: 1.1] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/21/2011] [Revised: 02/21/2012] [Accepted: 02/22/2012] [Indexed: 10/28/2022]
|
23
|
Chang CY, chung PC, Hong YC, Tseng CH. A Neural Network for Thyroid Segmentation and Volume Estimation in CT Images. IEEE COMPUT INTELL M 2011. [DOI: 10.1109/mci.2011.942756] [Citation(s) in RCA: 25] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/05/2022]
|
24
|
Misselwitz B, Strittmatter G, Periaswamy B, Schlumberger MC, Rout S, Horvath P, Kozak K, Hardt WD. Enhanced CellClassifier: a multi-class classification tool for microscopy images. BMC Bioinformatics 2010; 11:30. [PMID: 20074370 PMCID: PMC2821321 DOI: 10.1186/1471-2105-11-30] [Citation(s) in RCA: 57] [Impact Index Per Article: 3.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/11/2009] [Accepted: 01/14/2010] [Indexed: 11/10/2022] Open
Abstract
BACKGROUND Light microscopy is of central importance in cell biology. The recent introduction of automated high content screening has expanded this technology towards automation of experiments and performing large scale perturbation assays. Nevertheless, evaluation of microscopy data continues to be a bottleneck in many projects. Currently, among open source software, CellProfiler and its extension Analyst are widely used in automated image processing. Even though revolutionizing image analysis in current biology, some routine and many advanced tasks are either not supported or require programming skills of the researcher. This represents a significant obstacle in many biology laboratories. RESULTS We have developed a tool, Enhanced CellClassifier, which circumvents this obstacle. Enhanced CellClassifier starts from images analyzed by CellProfiler, and allows multi-class classification using a Support Vector Machine algorithm. Training of objects can be done by clicking directly "on the microscopy image" in several intuitive training modes. Many routine tasks like out-of focus exclusion and well summary are also supported. Classification results can be integrated with other object measurements including inter-object relationships. This makes a detailed interpretation of the image possible, allowing the differentiation of many complex phenotypes. For the generation of the output, image, well and plate data are dynamically extracted and summarized. The output can be generated as graphs, Excel-files, images with projections of the final analysis and exported as variables. CONCLUSION Here we describe Enhanced CellClassifier which allows multiple class classification, elucidating complex phenotypes. Our tool is designed for the biologist who wants both, simple and flexible analysis of images without requiring programming skills. This should facilitate the implementation of automated high-content screening.
Collapse
|