1
|
Ahmed S, Raza B, Hussain L, Aldweesh A, Omar A, Khan MS, Eldin ET, Nadim MA. The Deep Learning ResNet101 and Ensemble XGBoost Algorithm with Hyperparameters Optimization Accurately Predict the Lung Cancer. APPLIED ARTIFICIAL INTELLIGENCE 2023; 37. [DOI: 10.1080/08839514.2023.2166222] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/18/2022] [Accepted: 01/04/2023] [Indexed: 01/14/2025]
Affiliation(s)
- Saghir Ahmed
- Department of Computer Science, COMSATS University, Islamabad Capital Territory, Pakistan
| | - Basit Raza
- Department of Computer Science, COMSATS University, Islamabad Capital Territory, Pakistan
| | - Lal Hussain
- Department of Computer Science & IT, The University of Azad Jammu and Kashmir, Athmuqam, Azad Kashmir, Pakistan
- Department of Computer Science & IT, The University of Azad Jammu and Kashmir, Azad Kashmir, Pakistan
| | - Amjad Aldweesh
- College of Computer science and information technology, Shaqra University, Shaqra, Saudi Arabia
| | - Abdulfattah Omar
- Department of English, College of Science & Humanities, Prince Sattam Bin Abdulaziz University, Al-Kharj, Saudi Arabia
| | | | - Elsayed Tag Eldin
- Faculty of Engineering and Technology, Future University in Egypt, New Cairo, Egypt
| | | |
Collapse
|
2
|
Jing Y, Li C, Du T, Jiang T, Sun H, Yang J, Shi L, Gao M, Grzegorzek M, Li X. A comprehensive survey of intestine histopathological image analysis using machine vision approaches. Comput Biol Med 2023; 165:107388. [PMID: 37696178 DOI: 10.1016/j.compbiomed.2023.107388] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/08/2023] [Revised: 08/06/2023] [Accepted: 08/25/2023] [Indexed: 09/13/2023]
Abstract
Colorectal Cancer (CRC) is currently one of the most common and deadly cancers. CRC is the third most common malignancy and the fourth leading cause of cancer death worldwide. It ranks as the second most frequent cause of cancer-related deaths in the United States and other developed countries. Histopathological images contain sufficient phenotypic information, they play an indispensable role in the diagnosis and treatment of CRC. In order to improve the objectivity and diagnostic efficiency for image analysis of intestinal histopathology, Computer-aided Diagnosis (CAD) methods based on machine learning (ML) are widely applied in image analysis of intestinal histopathology. In this investigation, we conduct a comprehensive study on recent ML-based methods for image analysis of intestinal histopathology. First, we discuss commonly used datasets from basic research studies with knowledge of intestinal histopathology relevant to medicine. Second, we introduce traditional ML methods commonly used in intestinal histopathology, as well as deep learning (DL) methods. Then, we provide a comprehensive review of the recent developments in ML methods for segmentation, classification, detection, and recognition, among others, for histopathological images of the intestine. Finally, the existing methods have been studied, and the application prospects of these methods in this field are given.
Collapse
Affiliation(s)
- Yujie Jing
- Microscopic Image and Medical Image Analysis Group, College of Medicine and Biological Information Engineering, Northeastern University, China; Key Laboratory of Intelligent Computing in Medical Image, Ministry of Education, Northeastern University, Shenyang, Liaoning, China
| | - Chen Li
- Microscopic Image and Medical Image Analysis Group, College of Medicine and Biological Information Engineering, Northeastern University, China; Key Laboratory of Intelligent Computing in Medical Image, Ministry of Education, Northeastern University, Shenyang, Liaoning, China.
| | - Tianming Du
- Microscopic Image and Medical Image Analysis Group, College of Medicine and Biological Information Engineering, Northeastern University, China; Key Laboratory of Intelligent Computing in Medical Image, Ministry of Education, Northeastern University, Shenyang, Liaoning, China
| | - Tao Jiang
- School of Intelligent Medicine, Chengdu University of Traditional Chinese Medicine, Chengdu, China; International Joint Institute of Robotics and Intelligent Systems, Chengdu University of Information Technology, Chengdu, China
| | - Hongzan Sun
- Shengjing Hospital of China Medical University, Shenyang, China
| | - Jinzhu Yang
- Key Laboratory of Intelligent Computing in Medical Image, Ministry of Education, Northeastern University, Shenyang, Liaoning, China
| | - Liyu Shi
- Microscopic Image and Medical Image Analysis Group, College of Medicine and Biological Information Engineering, Northeastern University, China; Key Laboratory of Intelligent Computing in Medical Image, Ministry of Education, Northeastern University, Shenyang, Liaoning, China
| | - Minghe Gao
- Microscopic Image and Medical Image Analysis Group, College of Medicine and Biological Information Engineering, Northeastern University, China; Key Laboratory of Intelligent Computing in Medical Image, Ministry of Education, Northeastern University, Shenyang, Liaoning, China
| | - Marcin Grzegorzek
- Institute for Medical Informatics, University of Luebeck, Luebeck, Germany; Department of Knowledge Engineering, University of Economics in Katowice, Katowice, Poland
| | - Xiaoyan Li
- Cancer Hospital of China Medical University, Liaoning Cancer Hospital, Shenyang, China.
| |
Collapse
|
3
|
Zhang S, Wu J, Shi E, Yu S, Gao Y, Li LC, Kuo LR, Pomeroy MJ, Liang ZJ. MM-GLCM-CNN: A multi-scale and multi-level based GLCM-CNN for polyp classification. Comput Med Imaging Graph 2023; 108:102257. [PMID: 37301171 DOI: 10.1016/j.compmedimag.2023.102257] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/07/2023] [Revised: 05/04/2023] [Accepted: 05/30/2023] [Indexed: 06/12/2023]
Abstract
Distinguishing malignant from benign lesions has significant clinical impacts on both early detection and optimal management of those early detections. Convolutional neural network (CNN) has shown great potential in medical imaging applications due to its powerful feature learning capability. However, it is very challenging to obtain pathological ground truth, addition to collected in vivo medical images, to construct objective training labels for feature learning, leading to the difficulty of performing lesion diagnosis. This is contrary to the requirement that CNN algorithms need a large number of datasets for the training. To explore the ability to learn features from small pathologically-proven datasets for differentiation of malignant from benign polyps, we propose a Multi-scale and Multi-level based Gray-level Co-occurrence Matrix CNN (MM-GLCM-CNN). Specifically, instead of inputting the lesions' medical images, the GLCM, which characterizes the lesion heterogeneity in terms of image texture characteristics, is fed into the MM-GLCN-CNN model for the training. This aims to improve feature extraction by introducing multi-scale and multi-level analysis into the construction of lesion texture characteristic descriptors (LTCDs). To learn and fuse multiple sets of LTCDs from small datasets for lesion diagnosis, we further propose an adaptive multi-input CNN learning framework. Furthermore, an Adaptive Weight Network is used to highlight important information and suppress redundant information after the fusion of the LTCDs. We evaluated the performance of MM-GLCM-CNN by the area under the receiver operating characteristic curve (AUC) merit on small private lesion datasets of colon polyps. The AUC score reaches 93.99% with a gain of 1.49% over current state-of-the-art lesion classification methods on the same dataset. This gain indicates the importance of incorporating lesion characteristic heterogeneity for the prediction of lesion malignancy using small pathologically-proven datasets.
Collapse
Affiliation(s)
- Shu Zhang
- Center for Brain and Brain-Inspired Computing Research, School of Computer Science, Northwestern Polytechnical University, Xi'an 710000, China.
| | - Jinru Wu
- Center for Brain and Brain-Inspired Computing Research, School of Computer Science, Northwestern Polytechnical University, Xi'an 710000, China
| | - Enze Shi
- Center for Brain and Brain-Inspired Computing Research, School of Computer Science, Northwestern Polytechnical University, Xi'an 710000, China
| | - Sigang Yu
- Center for Brain and Brain-Inspired Computing Research, School of Computer Science, Northwestern Polytechnical University, Xi'an 710000, China
| | - Yongfeng Gao
- Department of Radiology, Stony Brook University, Stony Brook, NY 11794, USA
| | - Lihong Connie Li
- Department of Engineering & Environmental Science, City University of New York, Staten Island, NY 10314, USA
| | - Licheng Ryan Kuo
- Department of Radiology, Stony Brook University, Stony Brook, NY 11794, USA; Department of Biomedical Engineering, Stony Brook University, Stony Brook, NY 11794, USA
| | - Marc Jason Pomeroy
- Department of Radiology, Stony Brook University, Stony Brook, NY 11794, USA; Department of Biomedical Engineering, Stony Brook University, Stony Brook, NY 11794, USA
| | - Zhengrong Jerome Liang
- Department of Radiology, Stony Brook University, Stony Brook, NY 11794, USA; Department of Biomedical Engineering, Stony Brook University, Stony Brook, NY 11794, USA
| |
Collapse
|
4
|
Mohamed AAA, Hançerlioğullari A, Rahebi J, Ray MK, Roy S. Colon Disease Diagnosis with Convolutional Neural Network and Grasshopper Optimization Algorithm. Diagnostics (Basel) 2023; 13:diagnostics13101728. [PMID: 37238212 DOI: 10.3390/diagnostics13101728] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/21/2023] [Revised: 05/10/2023] [Accepted: 05/11/2023] [Indexed: 05/28/2023] Open
Abstract
This paper presents a robust colon cancer diagnosis method based on the feature selection method. The proposed method for colon disease diagnosis can be divided into three steps. In the first step, the images' features were extracted based on the convolutional neural network. Squeezenet, Resnet-50, AlexNet, and GoogleNet were used for the convolutional neural network. The extracted features are huge, and the number of features cannot be appropriate for training the system. For this reason, the metaheuristic method is used in the second step to reduce the number of features. This research uses the grasshopper optimization algorithm to select the best features from the feature data. Finally, using machine learning methods, colon disease diagnosis was found to be accurate and successful. Two classification methods are applied for the evaluation of the proposed method. These methods include the decision tree and the support vector machine. The sensitivity, specificity, accuracy, and F1Score have been used to evaluate the proposed method. For Squeezenet based on the support vector machine, we obtained results of 99.34%, 99.41%, 99.12%, 98.91% and 98.94% for sensitivity, specificity, accuracy, precision, and F1Score, respectively. In the end, we compared the suggested recognition method's performance to the performances of other methods, including 9-layer CNN, random forest, 7-layer CNN, and DropBlock. We demonstrated that our solution outperformed the others.
Collapse
Affiliation(s)
- Amna Ali A Mohamed
- Department of Material Science and Engineering, University of Kastamonu, Kastamonu 37150, Turkey
| | | | - Javad Rahebi
- Department of Software Engineering, Istanbul Topkapi University, Istanbul 34087, Turkey
| | - Mayukh K Ray
- Department of Physics, Amity Institute of Applied Sciences, Amity University, Kolkata 700135, India
| | - Sudipta Roy
- Artificial Intelligence & Data Science, Jio Institute, Navi Mumbai 410206, India
| |
Collapse
|
5
|
Tharwat M, Sakr NA, El-Sappagh S, Soliman H, Kwak KS, Elmogy M. Colon Cancer Diagnosis Based on Machine Learning and Deep Learning: Modalities and Analysis Techniques. SENSORS (BASEL, SWITZERLAND) 2022; 22:9250. [PMID: 36501951 PMCID: PMC9739266 DOI: 10.3390/s22239250] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 10/24/2022] [Accepted: 11/24/2022] [Indexed: 06/17/2023]
Abstract
The treatment and diagnosis of colon cancer are considered to be social and economic challenges due to the high mortality rates. Every year, around the world, almost half a million people contract cancer, including colon cancer. Determining the grade of colon cancer mainly depends on analyzing the gland's structure by tissue region, which has led to the existence of various tests for screening that can be utilized to investigate polyp images and colorectal cancer. This article presents a comprehensive survey on the diagnosis of colon cancer. This covers many aspects related to colon cancer, such as its symptoms and grades as well as the available imaging modalities (particularly, histopathology images used for analysis) in addition to common diagnosis systems. Furthermore, the most widely used datasets and performance evaluation metrics are discussed. We provide a comprehensive review of the current studies on colon cancer, classified into deep-learning (DL) and machine-learning (ML) techniques, and we identify their main strengths and limitations. These techniques provide extensive support for identifying the early stages of cancer that lead to early treatment of the disease and produce a lower mortality rate compared with the rate produced after symptoms develop. In addition, these methods can help to prevent colorectal cancer from progressing through the removal of pre-malignant polyps, which can be achieved using screening tests to make the disease easier to diagnose. Finally, the existing challenges and future research directions that open the way for future work in this field are presented.
Collapse
Affiliation(s)
- Mai Tharwat
- Information Technology Department, Faculty of Computers and Information, Mansoura University, Mansoura 35516, Egypt
| | - Nehal A. Sakr
- Information Technology Department, Faculty of Computers and Information, Mansoura University, Mansoura 35516, Egypt
| | - Shaker El-Sappagh
- Information Systems Department, Faculty of Computers and Artificial Intelligence, Benha University, Benha 13512, Egypt
- Faculty of Computer Science and Engineering, Galala University, Suez 435611, Egypt
| | - Hassan Soliman
- Information Technology Department, Faculty of Computers and Information, Mansoura University, Mansoura 35516, Egypt
| | - Kyung-Sup Kwak
- Department of Information and Communication Engineering, Inha University, Incheon 22212, Republic of Korea
| | - Mohammed Elmogy
- Information Technology Department, Faculty of Computers and Information, Mansoura University, Mansoura 35516, Egypt
| |
Collapse
|
6
|
Lung Cancer Prediction Using Robust Machine Learning and Image Enhancement Methods on Extracted Gray-Level Co-Occurrence Matrix Features. APPLIED SCIENCES-BASEL 2022. [DOI: 10.3390/app12136517] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 01/27/2023]
Abstract
In the present era, cancer is the leading cause of demise in both men and women worldwide, with low survival rates due to inefficient diagnostic techniques. Recently, researchers have been devising methods to improve prediction performance. In medical image processing, image enhancement can further improve prediction performance. This study aimed to improve lung cancer image quality by utilizing and employing various image enhancement methods, such as image adjustment, gamma correction, contrast stretching, thresholding, and histogram equalization methods. We extracted the gray-level co-occurrence matrix (GLCM) features on enhancement images, and applied and optimized vigorous machine learning classification algorithms, such as the decision tree (DT), naïve Bayes, support vector machine (SVM) with Gaussian, radial base function (RBF), and polynomial. Without the image enhancement method, the highest performance was obtained using SVM, polynomial, and RBF, with accuracy of (99.89%). The image enhancement methods, such as image adjustment, contrast stretching at threshold (0.02, 0.98), and gamma correction at gamma value of 0.9, improved the prediction performance of our analysis on 945 images provided by the Lung Cancer Alliance MRI dataset, which yielded 100% accuracy and 1.00 of AUC using SVM, RBF, and polynomial kernels. The results revealed that the proposed methodology can be very helpful to improve the lung cancer prediction for further diagnosis and prognosis by expert radiologists to decrease the mortality rate.
Collapse
|
7
|
Cao W, Pomeroy MJ, Liang Z, Abbasi AF, Pickhardt PJ, Lu H. Vector textures derived from higher order derivative domains for classification of colorectal polyps. Vis Comput Ind Biomed Art 2022; 5:16. [PMID: 35699865 PMCID: PMC9198194 DOI: 10.1186/s42492-022-00108-1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/08/2021] [Accepted: 03/22/2022] [Indexed: 11/10/2022] Open
Abstract
Textures have become widely adopted as an essential tool for lesion detection and classification through analysis of the lesion heterogeneities. In this study, higher order derivative images are being employed to combat the challenge of the poor contrast across similar tissue types among certain imaging modalities. To make good use of the derivative information, a novel concept of vector texture is firstly introduced to construct and extract several types of polyp descriptors. Two widely used differential operators, i.e., the gradient operator and Hessian operator, are utilized to generate the first and second order derivative images. These derivative volumetric images are used to produce two angle-based and two vector-based (including both angle and magnitude) textures. Next, a vector-based co-occurrence matrix is proposed to extract texture features which are fed to a random forest classifier to perform polyp classifications. To evaluate the performance of our method, experiments are implemented over a private colorectal polyp dataset obtained from computed tomographic colonography. We compare our method with four existing state-of-the-art methods and find that our method can outperform those competing methods over 4%-13% evaluated by the area under the receiver operating characteristics curves.
Collapse
Affiliation(s)
- Weiguo Cao
- Department of Radiology, State University of New York at Stony Brook, Stony Brook, NY 11794, USA
| | - Marc J Pomeroy
- Department of Radiology, State University of New York at Stony Brook, Stony Brook, NY 11794, USA.,Department of Biomedical Engineering, State University of New York at Stony Brook, Stony Brook, NY 11794, USA
| | - Zhengrong Liang
- Department of Radiology, State University of New York at Stony Brook, Stony Brook, NY 11794, USA. .,Department of Biomedical Engineering, State University of New York at Stony Brook, Stony Brook, NY 11794, USA.
| | - Almas F Abbasi
- Department of Radiology, State University of New York at Stony Brook, Stony Brook, NY 11794, USA
| | - Perry J Pickhardt
- Department of Radiology, University of Wisconsin Medical School, Madison, WI 53705, USA
| | - Hongbing Lu
- Department of Biomedical Engineering, the Fourth Medical University, Xi'an, 710032, Shaanxi, China
| |
Collapse
|
8
|
Pourakbari R, Yousefi M, Khalilzadeh B, Irani-nezhad MH, Khataee A, Aghebati-Maleki L, Soleimanian A, Kamrani A, Chakari-Khiavi F, Abolhasan R, Motallebnezhad M, Jadidi-Niaragh F, Yousefi B, Kafil HS, Hojjat-Farsangi M, Rashidi MR. Early stage evaluation of colon cancer using tungsten disulfide quantum dots and bacteriophage nano-biocomposite as an efficient electrochemical platform. Cancer Nanotechnol 2022. [DOI: 10.1186/s12645-022-00113-2] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/10/2022] Open
Abstract
Abstract
Background
Recently, biosensors have become popular analytical tools for small analytes due to their high sensitivity and wide analytical range. In the present work, development of a novel biosensing method based on tungsten disulfide quantum dots (WS2 QDs)-Au for rapidly and selectively detecting c-Met protein is introduced. As a proof of concept, M13 bacteriophage-based biosensors were used for the electrochemical detection of c-Met protein as a colon cancer biomarker.
Method
The M13 bacteriophage (virus), as the biorecognition element, was immobilized on glassy carbon electrodes which were modified by WS2 QDs-functionalized gold nanoparticles. The stepwise presence of the WS2 QDs, gold nanoparticles, and immobilized phage on glassy carbon electrodes were confirmed by scanning electron microscope (SEM) and square wave voltammetry (SWV) technique.
Results
The designed biosensor was applied to measure the amount of c-Met protein in standard solutions, and consequently the desirable detection limit of 1 pg was obtained. Finally, as a proof of concept, the developed platform was used for the evaluation of c-Met protein in serum samples of colon cancer-suffering patients and the results were compared with the results of the common Elisa kit.
Conclusions
As an interesting part of this study, some concentrations of the c-Met protein in colon cancer serum samples which could not be determined by Elisa, were easily analyzed by the developed bioassay system. The developed bioassay system has great potential to application in biomedical laboratories.
Graphical Abstract
Collapse
|
9
|
Huang YJ, Dou Q, Wang ZX, Liu LZ, Jin Y, Li CF, Wang L, Chen H, Xu RH. 3-D RoI-Aware U-Net for Accurate and Efficient Colorectal Tumor Segmentation. IEEE TRANSACTIONS ON CYBERNETICS 2021; 51:5397-5408. [PMID: 32248143 DOI: 10.1109/tcyb.2020.2980145] [Citation(s) in RCA: 25] [Impact Index Per Article: 6.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/11/2023]
Abstract
Segmentation of colorectal cancerous regions from 3-D magnetic resonance (MR) images is a crucial procedure for radiotherapy. Automatic delineation from 3-D whole volumes is in urgent demand yet very challenging. Drawbacks of existing deep-learning-based methods for this task are two-fold: 1) extensive graphics processing unit (GPU) memory footprint of 3-D tensor limits the trainable volume size, shrinks effective receptive field, and therefore, degrades speed and segmentation performance and 2) in-region segmentation methods supported by region-of-interest (RoI) detection are either blind to global contexts, detail richness compromising, or too expensive for 3-D tasks. To tackle these drawbacks, we propose a novel encoder-decoder-based framework for 3-D whole volume segmentation, referred to as 3-D RoI-aware U-Net (3-D RU-Net). 3-D RU-Net fully utilizes the global contexts covering large effective receptive fields. Specifically, the proposed model consists of a global image encoder for global understanding-based RoI localization, and a local region decoder that operates on pyramid-shaped in-region global features, which is GPU memory efficient and thereby enables training and prediction with large 3-D whole volumes. To facilitate the global-to-local learning procedure and enhance contour detail richness, we designed a dice-based multitask hybrid loss function. The efficiency of the proposed framework enables an extensive model ensemble for further performance gain at acceptable extra computational costs. Over a dataset of 64 T2-weighted MR images, the experimental results of four-fold cross-validation show that our method achieved 75.5% dice similarity coefficient (DSC) in 0.61 s per volume on a GPU, which significantly outperforms competing methods in terms of accuracy and efficiency. The code is publicly available.
Collapse
|
10
|
Al-Rajab M, Lu J, Xu Q. A framework model using multifilter feature selection to enhance colon cancer classification. PLoS One 2021; 16:e0249094. [PMID: 33861766 PMCID: PMC8691854 DOI: 10.1371/journal.pone.0249094] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/16/2020] [Accepted: 03/11/2021] [Indexed: 11/18/2022] Open
Abstract
Gene expression profiles can be utilized in the diagnosis of critical diseases such as cancer. The selection of biomarker genes from these profiles is significant and crucial for cancer detection. This paper presents a framework proposing a two-stage multifilter hybrid model of feature selection for colon cancer classification. Colon cancer is being extremely common nowadays among other types of cancer. There is a need to find fast and an accurate method to detect the tissues, and enhance the diagnostic process and the drug discovery. This paper reports on a study whose objective has been to improve the diagnosis of cancer of the colon through a two-stage, multifilter model of feature selection. The model described deals with feature selection using a combination of Information Gain and a Genetic Algorithm. The next stage is to filter and rank the genes identified through this method using the minimum Redundancy Maximum Relevance (mRMR) technique. The final phase is to further analyze the data using correlated machine learning algorithms. This two-stage approach, which involves the selection of genes before classification techniques are used, improves success rates for the identification of cancer cells. It is found that Decision Tree, K-Nearest Neighbor, and Naïve Bayes classifiers had showed promising accurate results using the developed hybrid framework model. It is concluded that the performance of our proposed method has achieved a higher accuracy in comparison with the existing methods reported in the literatures. This study can be used as a clue to enhance treatment and drug discovery for the colon cancer cure.
Collapse
Affiliation(s)
- Murad Al-Rajab
- School of Computing and Engineering, University of
Huddersfield, Huddersfield, United Kingdom
| | - Joan Lu
- School of Computing and Engineering, University of
Huddersfield, Huddersfield, United Kingdom
| | - Qiang Xu
- School of Computing and Engineering, University of
Huddersfield, Huddersfield, United Kingdom
| |
Collapse
|
11
|
Naz J, Sharif M, Yasmin M, Raza M, Khan MA. Detection and Classification of Gastrointestinal Diseases using Machine Learning. Curr Med Imaging 2021; 17:479-490. [PMID: 32988355 DOI: 10.2174/1573405616666200928144626] [Citation(s) in RCA: 12] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/12/2020] [Revised: 07/07/2020] [Accepted: 07/23/2020] [Indexed: 12/22/2022]
Abstract
BACKGROUND Traditional endoscopy is an invasive and painful method of examining the gastrointestinal tract (GIT) not supported by physicians and patients. To handle this issue, video endoscopy (VE) or wireless capsule endoscopy (WCE) is recommended and utilized for GIT examination. Furthermore, manual assessment of captured images is not possible for an expert physician because it's a time taking task to analyze thousands of images thoroughly. Hence, there comes the need for a Computer-Aided-Diagnosis (CAD) method to help doctors analyze images. Many researchers have proposed techniques for automated recognition and classification of abnormality in captured images. METHODS In this article, existing methods for automated classification, segmentation and detection of several GI diseases are discussed. Paper gives a comprehensive detail about these state-of-theart methods. Furthermore, literature is divided into several subsections based on preprocessing techniques, segmentation techniques, handcrafted features based techniques and deep learning based techniques. Finally, issues, challenges and limitations are also undertaken. RESULTS A comparative analysis of different approaches for the detection and classification of GI infections. CONCLUSION This comprehensive review article combines information related to a number of GI diseases diagnosis methods at one place. This article will facilitate the researchers to develop new algorithms and approaches for early detection of GI diseases detection with more promising results as compared to the existing ones of literature.
Collapse
Affiliation(s)
- Javeria Naz
- Department of Computer Science, COMSATS University Islamabad, Wah Campus, Pakistan
| | - Muhammad Sharif
- Department of Computer Science, COMSATS University Islamabad, Wah Campus, Pakistan
| | - Mussarat Yasmin
- Department of Computer Science, COMSATS University Islamabad, Wah Campus, Pakistan
| | - Mudassar Raza
- Department of Computer Science, COMSATS University Islamabad, Wah Campus, Pakistan
| | | |
Collapse
|
12
|
Manni F, Fonolla R, der Sommen FV, Zinger S, Shan C, Kho E, de Koning SB, Ruers T, de With PHN. Hyperspectral imaging for colon cancer classification in surgical specimens: towards optical biopsy during image-guided surgery. ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. ANNUAL INTERNATIONAL CONFERENCE 2020; 2020:1169-1173. [PMID: 33018195 DOI: 10.1109/embc44109.2020.9176543] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/10/2022]
Abstract
The main curative treatment for localized colon cancer is surgical resection. However when tumor residuals are left positive margins are found during the histological examinations and additional treatment is needed to inhibit recurrence. Hyperspectral imaging (HSI) can offer non-invasive surgical guidance with the potential of optimizing the surgical effectiveness. In this paper we investigate the capability of HSI for automated colon cancer detection in six ex-vivo specimens employing a spectral-spatial patch-based classification approach. The results demonstrate the feasibility in assessing the benign and malignant boundaries of the lesion with a sensitivity of 0.88 and specificity of 0.78. The results are compared with the state-of-the-art deep learning based approaches. The method with a new hybrid CNN outperforms the state-of the-art approaches (0.74 vs. 0.82 AUC). This study paves the way for further investigation towards improving surgical outcomes with HSI.
Collapse
|
13
|
Tan J, Gao Y, Liang Z, Cao W, Pomeroy MJ, Huo Y, Li L, Barish MA, Abbasi AF, Pickhardt PJ. 3D-GLCM CNN: A 3-Dimensional Gray-Level Co-Occurrence Matrix-Based CNN Model for Polyp Classification via CT Colonography. IEEE TRANSACTIONS ON MEDICAL IMAGING 2020; 39:2013-2024. [PMID: 31899419 PMCID: PMC7269812 DOI: 10.1109/tmi.2019.2963177] [Citation(s) in RCA: 47] [Impact Index Per Article: 9.4] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/27/2023]
Abstract
Accurately classifying colorectal polyps, or differentiating malignant from benign ones, has a significant clinical impact on early detection and identifying optimal treatment of colorectal cancer. Convolution neural network (CNN) has shown great potential in recognizing different objects (e.g. human faces) from multiple slice (or color) images, a task similar to the polyp differentiation, given a large learning database. This study explores the potential of CNN learning from multiple slice (or feature) images to differentiate malignant from benign polyps from a relatively small database with pathological ground truth, including 32 malignant and 31 benign polyps represented by volumetric computed tomographic (CT) images. The feature image in this investigation is the gray-level co-occurrence matrix (GLCM). For each volumetric polyp, there are 13 GLCMs, computed from each of the 13 directions through the polyp volume. For comparison purpose, the CNN learning is also applied to the multi-slice CT images of the volumetric polyps. The comparison study is further extended to include Random Forest (RF) classification of the Haralick texture features (derived from the GLCMs). From the relatively small database, this study achieved scores of 0.91/0.93 (two-fold/leave-one-out evaluations) AUC (area under curve of the receiver operating characteristics) by using the CNN on the GLCMs, while the RF reached 0.84/0.86 AUC on the Haralick features and the CNN rendered 0.79/0.80 AUC on the multiple-slice CT images. The presented CNN learning from the GLCMs can relieve the challenge associated with relatively small database, improve the classification performance over the CNN on the raw CT images and the RF on the Haralick features, and have the potential to perform the clinical task of differentiating malignant from benign polyps with pathological ground truth.
Collapse
|
14
|
Cao W, Liang Z, Pomeroy MJ, Ng K, Zhang S, Gao Y, Pickhardt PJ, Barish MA, Abbasi AF, Lu H. Multilayer feature selection method for polyp classification via computed tomographic colonography. J Med Imaging (Bellingham) 2020; 6:044503. [PMID: 32280727 DOI: 10.1117/1.jmi.6.4.044503] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/08/2019] [Accepted: 12/05/2019] [Indexed: 01/22/2023] Open
Abstract
Polyp classification is a feature selection and clustering process. Picking the most effective features from multiple polyp descriptors without redundant information is a great challenge in this procedure. We propose a multilayer feature selection method to construct an optimized descriptor for polyp classification with a feature-grouping strategy in a hierarchical framework. First, the proposed method makes good use of image metrics, such as intensity, gradient, and curvature, to divide their corresponding polyp descriptors into several feature groups, which are the preliminary units of this method. Then each preliminary unit generates two ranked descriptors, i.e., their optimized variable groups (OVGs) and preliminary classification measurements. Next, a feature dividing-merging (FDM) algorithm is designed to perform feature merging operation hierarchically and iteratively. Unlike traditional feature selection methods, the proposed FDM algorithm includes two steps for feature dividing and feature merging. At each layer, feature dividing selects the OVG with the highest area under the receiver operating characteristic curve (AUC) as the baseline while other descriptors are treated as its complements. In the fusion step, the FDM merges some variables with gains into the baseline from the complementary descriptors iteratively on every layer until the final descriptor is obtained. This proposed model (including the forward step algorithm and the FDM algorithm) is a greedy method that guarantees clustering monotonicity of all OVGs from the bottom to the top layer. In our experiments, all the selected results from each layer are reported by both graphical illustration and data analysis. Performance of the proposed method is compared to five existing classification methods by a polyp database of 63 samples with pathological reports. The experimental results show that our proposed method outperforms other methods by 4% to 23% gains in terms of AUC scores.
Collapse
Affiliation(s)
- Weiguo Cao
- State University of New York, Department of Radiology, Stony Brook, New York, United States
| | - Zhengrong Liang
- State University of New York, Department of Radiology, Stony Brook, New York, United States.,State University of New York, Department of Biomedical Engineering, Stony Brook, New York, United States.,State University of New York, Department of Electrical and Computer Engineering, Stony Brook, New York, United States
| | - Marc J Pomeroy
- State University of New York, Department of Radiology, Stony Brook, New York, United States.,State University of New York, Department of Biomedical Engineering, Stony Brook, New York, United States
| | - Kenneth Ng
- State University of New York, Department of Electrical and Computer Engineering, Stony Brook, New York, United States
| | - Shu Zhang
- State University of New York, Department of Radiology, Stony Brook, New York, United States
| | - Yongfeng Gao
- State University of New York, Department of Radiology, Stony Brook, New York, United States
| | - Perry J Pickhardt
- University of Wisconsin Medical School, Department of Radiology, Madison, Wisconsin, United States
| | - Matthew A Barish
- State University of New York, Department of Radiology, Stony Brook, New York, United States
| | - Almas F Abbasi
- State University of New York, Department of Radiology, Stony Brook, New York, United States
| | - Hongbing Lu
- The Fourth Medical University, Department of of Biomedical Engineering, Xi'an, China
| |
Collapse
|
15
|
Cao W, Pomeroy MJ, Gao Y, Barish MA, Abbasi AF, Pickhardt PJ, Liang Z. Multi-scale characterizations of colon polyps via computed tomographic colonography. Vis Comput Ind Biomed Art 2019; 2:25. [PMID: 32240410 PMCID: PMC7099560 DOI: 10.1186/s42492-019-0032-7] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/26/2019] [Accepted: 11/12/2019] [Indexed: 01/28/2023] Open
Abstract
Texture features have played an essential role in the field of medical imaging for computer-aided diagnosis. The gray-level co-occurrence matrix (GLCM)-based texture descriptor has emerged to become one of the most successful feature sets for these applications. This study aims to increase the potential of these features by introducing multi-scale analysis into the construction of GLCM texture descriptor. In this study, we first introduce a new parameter - stride, to explore the definition of GLCM. Then we propose three multi-scaling GLCM models according to its three parameters, (1) learning model by multiple displacements, (2) learning model by multiple strides (LMS), and (3) learning model by multiple angles. These models increase the texture information by introducing more texture patterns and mitigate direction sparsity and dense sampling problems presented in the traditional Haralick model. To further analyze the three parameters, we test the three models by performing classification on a dataset of 63 large polyp masses obtained from computed tomography colonoscopy consisting of 32 adenocarcinomas and 31 benign adenomas. Finally, the proposed methods are compared to several typical GLCM-texture descriptors and one deep learning model. LMS obtains the highest performance and enhances the prediction power to 0.9450 with standard deviation 0.0285 by area under the curve of receiver operating characteristics score which is a significant improvement.
Collapse
Affiliation(s)
- Weiguo Cao
- The Department of Radiology, Stony Brook University, Stony Brook, NY, 11794, USA
| | - Marc J Pomeroy
- The Departments of Radiology and Biomedical Engineering, Stony Brook University, Stony Brook, NY, 11794, USA
| | - Yongfeng Gao
- The Department of Radiology, Stony Brook University, Stony Brook, NY, 11794, USA
| | - Matthew A Barish
- The Department of Radiology, Stony Brook University, Stony Brook, NY, 11794, USA
| | - Almas F Abbasi
- The Department of Radiology, Stony Brook University, Stony Brook, NY, 11794, USA
| | - Perry J Pickhardt
- The Department of Radiology, School of Medicine, University of Wisconsin, Madison, WI, 53792, USA
| | - Zhengrong Liang
- The Departments of Radiology and Biomedical Engineering, Stony Brook University, Stony Brook, NY, 11794, USA.
| |
Collapse
|
16
|
Baltussen EJM, Sterenborg HJCM, Ruers TJM, Dashtbozorg B. Optimizing algorithm development for tissue classification in colorectal cancer based on diffuse reflectance spectra. BIOMEDICAL OPTICS EXPRESS 2019; 10:6096-6113. [PMID: 31853388 PMCID: PMC6913395 DOI: 10.1364/boe.10.006096] [Citation(s) in RCA: 14] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 09/03/2019] [Revised: 10/11/2019] [Accepted: 10/31/2019] [Indexed: 06/01/2023]
Abstract
Diffuse reflectance spectroscopy can be used in colorectal cancer surgery for tissue classification. The main challenge in the classification task is to separate healthy colorectal wall from tumor tissue. In this study, four normalization techniques, four feature extraction methods and five classifiers are applied to nine datasets, to obtain the optimal method to separate spectra measured on healthy colorectal wall from spectra measured on tumor tissue. All results are compared to the use of the entire non-normalized spectra. It is found that the most optimal classification approach is to apply a feature extraction method on non-normalized spectra combined with support vector machine or neural network classifier.
Collapse
Affiliation(s)
- Elisabeth J. M. Baltussen
- Department of Surgery, Antoni van Leeuwenhoek Hospital – The Netherlands Cancer Institute, Plesmanlaan 121, 1066CX Amsterdam, The Netherlands
| | - Henricus J. C. M. Sterenborg
- Department of Surgery, Antoni van Leeuwenhoek Hospital – The Netherlands Cancer Institute, Plesmanlaan 121, 1066CX Amsterdam, The Netherlands
- Department of Biomedical Engineering and Physics, Amsterdam University Medical Center, Meibergdreef 9, 1105 AZ Amsterdam, The Netherlands
| | - Theo J. M. Ruers
- Department of Surgery, Antoni van Leeuwenhoek Hospital – The Netherlands Cancer Institute, Plesmanlaan 121, 1066CX Amsterdam, The Netherlands
- Faculty of Science and Technology, University of Twente, Drienerlolaan 5, 7522 NB Enschede, The Netherlands
| | - Behdad Dashtbozorg
- Department of Surgery, Antoni van Leeuwenhoek Hospital – The Netherlands Cancer Institute, Plesmanlaan 121, 1066CX Amsterdam, The Netherlands
- Department of Biomedical Engineering, Eindhoven University of Technology, 5600 MB Eindhoven, The Netherlands
| |
Collapse
|
17
|
Correlating Changes in the Epithelial Gland Tissue With Advancing Colorectal Cancer Histologic Grade, Using IHC Stained for AIB1 Expression Biopsy Material. Appl Immunohistochem Mol Morphol 2019; 27:749-757. [DOI: 10.1097/pai.0000000000000691] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/23/2022]
|
18
|
Rathore S, Iftikhar MA, Chaddad A, Niazi T, Karasic T, Bilello M. Segmentation and Grade Prediction of Colon Cancer Digital Pathology Images Across Multiple Institutions. Cancers (Basel) 2019; 11:cancers11111700. [PMID: 31683818 PMCID: PMC6896042 DOI: 10.3390/cancers11111700] [Citation(s) in RCA: 18] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/06/2019] [Revised: 10/03/2019] [Accepted: 10/17/2019] [Indexed: 12/11/2022] Open
Abstract
Distinguishing benign from malignant disease is a primary challenge for colon histopathologists. Current clinical methods rely on qualitative visual analysis of features such as glandular architecture and size that exist on a continuum from benign to malignant. Consequently, discordance between histopathologists is common. To provide more reliable analysis of colon specimens, we propose an end-to-end computational pathology pipeline that encompasses gland segmentation, cancer detection, and then further breaking down the malignant samples into different cancer grades. We propose a multi-step gland segmentation method, which models tissue components as ellipsoids. For cancer detection/grading, we encode cellular morphology, spatial architectural patterns of glands, and texture by extracting multi-scale features: (i) Gland-based: extracted from individual glands, (ii) local-patch-based: computed from randomly-selected image patches, and (iii) image-based: extracted from images, and employ a hierarchical ensemble-classification method. Using two datasets (Rawalpindi Medical College (RMC), n = 174 and gland segmentation (GlaS), n = 165) with three cancer grades, our method reliably delineated gland regions (RMC = 87.5%, GlaS = 88.4%), detected the presence of malignancy (RMC = 97.6%, GlaS = 98.3%), and predicted tumor grade (RMC = 98.6%, GlaS = 98.6%). Training the model using one dataset and testing it on the other showed strong concordance in cancer detection (Train RMC – Test GlaS = 94.5%, Train GlaS – Test RMC = 93.7%) and grading (Train RMC – Test GlaS = 95%, Train GlaS – Test RMC = 95%) suggesting that the model will be applicable across institutions. With further prospective validation, the techniques demonstrated here may provide a reproducible and easily accessible method to standardize analysis of colon cancer specimens.
Collapse
Affiliation(s)
- Saima Rathore
- Center for Biomedical Image Computing and Analytics, University of Pennsylvania, Philadelphia, PA 19104, USA.
- Department of Radiology, Perelman School of Medicine, University of Pennsylvania, Philadelphia, PA 19104, USA.
| | - Muhammad Aksam Iftikhar
- Department of Computer Science, COMSATS University Islamabad, Lahore Campus, Lahore 54000, Pakistan.
| | - Ahmad Chaddad
- Division of Radiation Oncology, Department of Oncology, McGill University, Montreal, QC H3S 1Y9, Canada.
| | - Tamim Niazi
- Division of Radiation Oncology, Department of Oncology, McGill University, Montreal, QC H3S 1Y9, Canada.
| | - Thomas Karasic
- Department of Medicine, Division of Hematology/Oncology, University of Pennsylvania, Philadelphia, PA 19104, USA.
| | - Michel Bilello
- Center for Biomedical Image Computing and Analytics, University of Pennsylvania, Philadelphia, PA 19104, USA.
- Department of Radiology, Perelman School of Medicine, University of Pennsylvania, Philadelphia, PA 19104, USA.
| |
Collapse
|
19
|
An Enhancement of Computer Aided Approach for Colon Cancer Detection in WCE Images Using ROI Based Color Histogram and SVM2. J Med Syst 2019; 43:29. [DOI: 10.1007/s10916-018-1153-9] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/31/2018] [Accepted: 12/25/2018] [Indexed: 12/28/2022]
|
20
|
Baltussen EJM, Kok END, Brouwer de Koning SG, Sanders J, Aalbers AGJ, Kok NFM, Beets GL, Flohil CC, Bruin SC, Kuhlmann KFD, Sterenborg HJCM, Ruers TJM. Hyperspectral imaging for tissue classification, a way toward smart laparoscopic colorectal surgery. JOURNAL OF BIOMEDICAL OPTICS 2019; 24:1-9. [PMID: 30701726 PMCID: PMC6985687 DOI: 10.1117/1.jbo.24.1.016002] [Citation(s) in RCA: 61] [Impact Index Per Article: 10.2] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 09/17/2018] [Accepted: 01/11/2019] [Indexed: 05/07/2023]
Abstract
In the last decades, laparoscopic surgery has become the gold standard in patients with colorectal cancer. To overcome the drawback of reduced tactile feedback, real-time tissue classification could be of great benefit. In this ex vivo study, hyperspectral imaging (HSI) was used to distinguish tumor tissue from healthy surrounding tissue. A sample of fat, healthy colorectal wall, and tumor tissue was collected per patient and imaged using two hyperspectral cameras, covering the wavelength range from 400 to 1700 nm. The data were randomly divided into a training (75%) and test (25%) set. After feature reduction, a quadratic classifier and support vector machine were used to distinguish the three tissue types. Tissue samples of 32 patients were imaged using both hyperspectral cameras. The accuracy to distinguish the three tissue types using both hyperspectral cameras was 0.88 (STD = 0.13) on the test dataset. When the accuracy was determined per patient, a mean accuracy of 0.93 (STD = 0.12) was obtained on the test dataset. This study shows the potential of using HSI in colorectal cancer surgery for fast tissue classification, which could improve clinical outcome. Future research should be focused on imaging entire colon/rectum specimen and the translation of the technique to an intraoperative setting.
Collapse
Affiliation(s)
- Elisabeth J. M. Baltussen
- Antoni van Leeuwenhoek Hospital, The Netherlands Cancer Institute, Department of Surgery, Amsterdam, The Netherlands
- Address all correspondence to Elisabeth J. M. Baltussen, E-mail:
| | - Esther N. D. Kok
- Antoni van Leeuwenhoek Hospital, The Netherlands Cancer Institute, Department of Surgery, Amsterdam, The Netherlands
| | - Susan G. Brouwer de Koning
- Antoni van Leeuwenhoek Hospital, The Netherlands Cancer Institute, Department of Surgery, Amsterdam, The Netherlands
| | - Joyce Sanders
- Antoni van Leeuwenhoek Hospital, The Netherlands Cancer Institute, Department of Pathology, Amsterdam, The Netherlands
| | - Arend G. J. Aalbers
- Antoni van Leeuwenhoek Hospital, The Netherlands Cancer Institute, Department of Surgery, Amsterdam, The Netherlands
| | - Niels F. M. Kok
- Antoni van Leeuwenhoek Hospital, The Netherlands Cancer Institute, Department of Surgery, Amsterdam, The Netherlands
| | - Geerard L. Beets
- Antoni van Leeuwenhoek Hospital, The Netherlands Cancer Institute, Department of Surgery, Amsterdam, The Netherlands
| | - Claudie C. Flohil
- Slotervaart Medical Centre, Department of Pathology, Amsterdam, The Netherlands
| | - Sjoerd C. Bruin
- Slotervaart Medical Centre, Department of Surgery, Amsterdam, The Netherlands
| | - Koert F. D. Kuhlmann
- Antoni van Leeuwenhoek Hospital, The Netherlands Cancer Institute, Department of Surgery, Amsterdam, The Netherlands
| | - Henricus J. C. M. Sterenborg
- Antoni van Leeuwenhoek Hospital, The Netherlands Cancer Institute, Department of Surgery, Amsterdam, The Netherlands
- Amsterdam University Medical Centre, University of Amsterdam, Department of Biomedical Engineering and Physics, Amsterdam, The Netherlands
| | - Theo J. M. Ruers
- Antoni van Leeuwenhoek Hospital, The Netherlands Cancer Institute, Department of Surgery, Amsterdam, The Netherlands
- Technical University Twente, MIRA Institute, Enschede, The Netherlands
| |
Collapse
|
21
|
Bhandari S, Choudannavar S, Avery ER, Sahay P, Pradhan P. Detection of colon cancer stages via fractal dimension analysis of optical transmission imaging of tissue microarrays (TMA). Biomed Phys Eng Express 2018. [DOI: 10.1088/2057-1976/aae1c9] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.1] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/13/2022]
|
22
|
Chaddad A, Daniel P, Niazi T. Radiomics Evaluation of Histological Heterogeneity Using Multiscale Textures Derived From 3D Wavelet Transformation of Multispectral Images. Front Oncol 2018; 8:96. [PMID: 29670857 PMCID: PMC5893871 DOI: 10.3389/fonc.2018.00096] [Citation(s) in RCA: 31] [Impact Index Per Article: 4.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/12/2017] [Accepted: 03/19/2018] [Indexed: 12/18/2022] Open
Abstract
Purpose Colorectal cancer (CRC) is markedly heterogeneous and develops progressively toward malignancy through several stages which include stroma (ST), benign hyperplasia (BH), intraepithelial neoplasia (IN) or precursor cancerous lesion, and carcinoma (CA). Identification of the malignancy stage of CRC pathology tissues (PT) allows the most appropriate therapeutic intervention. Methods This study investigates multiscale texture features extracted from CRC pathology sections using 3D wavelet transform (3D-WT) filter. Multiscale features were extracted from digital whole slide images of 39 patients that were segmented in a pre-processing step using an active contour model. The capacity for multiscale texture to compare and classify between PTs was investigated using ANOVA significance test and random forest classifier models, respectively. Results 12 significant features derived from the multiscale texture (i.e., variance, entropy, and energy) were found to discriminate between CRC grades at a significance value of p < 0.01 after correction. Combining multiscale texture features lead to a better predictive capacity compared to prediction models based on individual scale features with an average (±SD) classification accuracy of 93.33 (±3.52)%, sensitivity of 88.33 (± 4.12)%, and specificity of 96.89 (± 3.88)%. Entropy was found to be the best classifier feature across all the PT grades with an average of the area under the curve (AUC) value of 91.17, 94.21, 97.70, 100% for ST, BH, IN, and CA, respectively. Conclusion Our results suggest that multiscale texture features based on 3D-WT are sensitive enough to discriminate between CRC grades with the entropy feature, the best predictor of pathology grade.
Collapse
Affiliation(s)
- Ahmad Chaddad
- Division of Radiation Oncology, McGill University, Montreal, QC, Canada
| | - Paul Daniel
- Division of Radiation Oncology, McGill University, Montreal, QC, Canada
| | - Tamim Niazi
- Division of Radiation Oncology, McGill University, Montreal, QC, Canada
| |
Collapse
|
23
|
Banwari A, Sengar N, Dutta MK. Image Processing Based Colorectal Cancer Detection in Histopathological Images. INTERNATIONAL JOURNAL OF E-HEALTH AND MEDICAL COMMUNICATIONS 2018. [DOI: 10.4018/ijehmc.2018040101] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/09/2022]
Abstract
The article proposes an image processing-based automatic methodology for early diagnosis of colorectal cancer. In pathology, staining and sectioning of tissues are routinely used as a primary technique to detect cancer. In this methodology, the colorectal gland tissues are segmented by using adaptive threshold method. Also, it includes an analysis of geometrical features of colorectal tissues as well as it does classification of cancerous cells which classify the cancerous and non-cancerous cell efficiently. The classification is based on discriminatory geometrical features which gives good result. Unlike existing methods, it quantifies lumen and epithelial cells only in the ROI, which makes this method computationally efficient. Automatic supervised classification is accomplished on the extracted discriminatory features using support vector machine classifier. The proposed methodology segments and classifies the cancerous / non-cancerous region with an accuracy of 93.74%. The proposed method is also computationally fast which makes it suitable for real time applications.
Collapse
|
24
|
Automatic classification of colorectal and prostatic histologic tumor images using multiscale multispectral local binary pattern texture features and stacked generalization. Neurocomputing 2018. [DOI: 10.1016/j.neucom.2017.05.010] [Citation(s) in RCA: 21] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/04/2023]
|
25
|
Texture Analysis of Abnormal Cell Images for Predicting the Continuum of Colorectal Cancer. Anal Cell Pathol (Amst) 2017; 2017:8428102. [PMID: 28331793 PMCID: PMC5282460 DOI: 10.1155/2017/8428102] [Citation(s) in RCA: 10] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/14/2015] [Accepted: 08/20/2015] [Indexed: 11/17/2022] Open
Abstract
Abnormal cell (ABC) is a markedly heterogeneous tissue area and can be categorized into three main types: benign hyperplasia (BH), carcinoma (Ca), and intraepithelial neoplasia (IN) or precursor cancerous lesion. In this study, the goal is to determine and characterize the continuum of colorectal cancer by using a 3D-texture approach. ABC was segmented in preprocessing step using an active contour segmentation technique. Cell types were analyzed based on textural features extracted from the gray level cooccurrence matrices (GLCMs). Significant texture features were selected using an analysis of variance (ANOVA) of ABC with a p value cutoff of p < 0.01. Features selected were reduced with a principal component analysis (PCA), which accounted for 97% of the cumulative variance from significant features. The simulation results identified 158 significant features based on ANOVA from a total of 624 texture features extracted from GLCMs. Performance metrics of ABC discrimination based on significant texture features showed 92.59% classification accuracy, 100% sensitivity, and 94.44% specificity. These findings suggest that texture features extracted from GLCMs are sensitive enough to discriminate between the ABC types and offer the opportunity to predict cell characteristics of colorectal cancer.
Collapse
|
26
|
Rathore S, Iftikhar MA. CBISC: A Novel Approach for Colon Biopsy Image Segmentation and Classification. ARABIAN JOURNAL FOR SCIENCE AND ENGINEERING 2016. [DOI: 10.1007/s13369-016-2187-2] [Citation(s) in RCA: 7] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/29/2022]
|
27
|
Akutekwe A, Seker H, Yang S. In silico discovery of significant pathways in colorectal cancer metastasis using a two-stage optimisation approach. IET Syst Biol 2015; 9:294-302. [PMID: 26577164 PMCID: PMC8687187 DOI: 10.1049/iet-syb.2015.0031] [Citation(s) in RCA: 10] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/24/2015] [Revised: 06/30/2015] [Accepted: 07/08/2015] [Indexed: 11/19/2022] Open
Abstract
Accurate and reliable modelling of protein-protein interaction networks for complex diseases such as colorectal cancer can help better understand mechanism of diseases and potentially discover new drugs. Different machine learning methods such as empirical mode decomposition combined with least square support vector machine, and discrete Fourier transform have been widely utilised as a classifier and for automatic discovery of biomarkers for the diagnosis of the disease. The existing methods are, however, less efficient as they tend to ignore interaction with the classifier. In this study, the authors propose a two-stage optimisation approach to effectively select biomarkers and discover interactions among them. At the first stage, particle swarm optimisation (PSO) and differential evolution (DE) are used to optimise parameters of support vector machine recursive feature elimination algorithm, and dynamic Bayesian network is then used to predict temporal relationship between biomarkers across two time points. Results show that 18 and 25 biomarkers selected by PSO and DE-based approach, respectively, yields the same accuracy of 97.3% and F1-score of 97.7 and 97.6%, respectively. The stratified analysis reveals that Alpha-2-HS-glycoprotein was a dominant hub gene with multiple interactions to other genes including Fibrinogen alpha chain, which is also a potential biomarker for colorectal cancer.
Collapse
Affiliation(s)
- Arinze Akutekwe
- Department of Computer Science and Digital Technologies, Bio-Health Informatics Research Group, University of Northumbria at Newcastle, Newcastle upon Tyne NE1 8ST, UK.
| | - Huseyin Seker
- Department of Computer Science and Digital Technologies, Bio-Health Informatics Research Group, University of Northumbria at Newcastle, Newcastle upon Tyne NE1 8ST, UK
| | - Shengxiang Yang
- School of Computer Science and Informatics, Centre for Computational Intelligence, De Montfort University, Leicester LE1 9BH, UK
| |
Collapse
|
28
|
Rathore S, Hussain M, Aksam Iftikhar M, Jalil A. Novel structural descriptors for automated colon cancer detection and grading. COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE 2015; 121:92-108. [PMID: 26094859 DOI: 10.1016/j.cmpb.2015.05.008] [Citation(s) in RCA: 12] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 12/26/2014] [Revised: 05/25/2015] [Accepted: 05/27/2015] [Indexed: 06/04/2023]
Abstract
The histopathological examination of tissue specimens is necessary for the diagnosis and grading of colon cancer. However, the process is subjective and leads to significant inter/intra observer variation in diagnosis as it mainly relies on the visual assessment of histopathologists. Therefore, a reliable computer-aided technique, which can automatically classify normal and malignant colon samples, and determine grades of malignant samples, is required. In this paper, we propose a novel colon cancer diagnostic (CCD) system, which initially classifies colon biopsy images into normal and malignant classes, and then automatically determines the grades of colon cancer for malignant images. To this end, various novel structural descriptors, which mathematically model and quantify the variation among the structure of normal colon tissues and malignant tissues of various cancer grades, have been employed. Radial basis function (RBF) kernel of support vector machines (SVM) has been employed as classifier in order to classify/grade colon samples based on these descriptors. The proposed system has been tested on 92 malignant and 82 normal colon biopsy images. The classification performance has been measured in terms of various performance measures, and quite promising performance has been observed. Compared with previous techniques, the proposed system has demonstrated better cancer detection (classification accuracy=95.40%) and grading (classification accuracy=93.47%) capability. Therefore, the proposed CCD system can provide a reliable second opinion to the histopathologists.
Collapse
Affiliation(s)
- Saima Rathore
- DCIS, Pakistan Institute of Engineering and Applied Sciences, Islamabad, Pakistan; DCS&IT, University of Azad Jammu and Kashmir, Muzaffarabad, Azad Kashmir, Pakistan.
| | - Mutawarra Hussain
- DCIS, Pakistan Institute of Engineering and Applied Sciences, Islamabad, Pakistan
| | - Muhammad Aksam Iftikhar
- DCIS, Pakistan Institute of Engineering and Applied Sciences, Islamabad, Pakistan; Comsats Institute of Information Technology, Lahore, Pakistan
| | - Abdul Jalil
- DCIS, Pakistan Institute of Engineering and Applied Sciences, Islamabad, Pakistan
| |
Collapse
|
29
|
Peyret R, Bouridane A, Al-Maadeed SA, Kunhoth S, Khelifi F. Texture analysis for colorectal tumour biopsies using multispectral imagery. ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. ANNUAL INTERNATIONAL CONFERENCE 2015; 2015:7218-7221. [PMID: 26737957 DOI: 10.1109/embc.2015.7320057] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/05/2023]
Abstract
Colorectal cancer is one of the most common cancers in the world. As part of its diagnosis, a histological analysis is often run on biopsy samples. Multispecral imagery taken from cancer tissues can be useful to capture more meaningful features. However, the resulting data is usually very large having a large number of varying feature types. This papers aims to investigate and compare the performances of multispectral imagery taken from colorectal biopsies using different techniques for texture feature extraction inclduing local binary patterns, Haraclick features and local intensity order patterns. Various classifiers such as Support Vector Machine and Random Forest are also investigated. The results show the superiority of multispectral imaging over the classical panchromatic approach. In the multispectral imagery's analysis, the local binary patterns combined with Support Vector Machine classifier gives very good results achieving an accuracy of 91.3%.
Collapse
|
30
|
Nakane K, Takiyama A, Mori S, Matsuura N. Homology-based method for detecting regions of interest in colonic digital images. Diagn Pathol 2015; 10:36. [PMID: 25907563 PMCID: PMC4448533 DOI: 10.1186/s13000-015-0244-x] [Citation(s) in RCA: 16] [Impact Index Per Article: 1.6] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/24/2014] [Accepted: 03/04/2015] [Indexed: 11/10/2022] Open
Abstract
Background A region of interest (ROI) is a part of tissue that contains important information for diagnosis. To use many image analysis methods efficiently, a technique that would allow for ROI identification is required. For the colon, ROIs are characterized by areas of stronger color intensity of hematoxylin. Since malignant tumors grow in the innermost layer, most ROIs will be located in the colonic mucosa and will be an accumulation of tumor cells and/or integrated cells with distorted architecture. Methods Using homology theory, our group proposed a method to estimate the contact degree of elements in a unit area of tissue. Homology is a concept that is used in many branches of algebra and topology, and it can quantify the contact degree. Due to the lack of contact inhibition of cancer cells, an area with unusual contact degree is expected to be a potential ROI. Results The current work verifies the accuracy of this method against the results of pathological diagnosis, based on 1825 colonic images provided by the Osaka Medical Center for Cancer and Cardiovascular Diseases. Although we have many false positives and there is a possibility of missing undifferentiated types of cancer, this system is very effective for detecting ROIs. Conclusions The mathematical system proposed by our group successfully detects ROIs and is a potentially useful tool for differentiating tumor areas in microscopic examination very quickly. Because we use only the information from low-power field images, there is room for further improvement. This system could be used to screen for not only colon cancer but other cancers as well. More sophisticated and more efficient automated pathological diagnosis systems can be developed by integrating various techniques available today. Virtual Slide The virtual slide(s) for this article can be found here: http://www.diagnosticpathology.diagnomx.eu/vs/7129390011429407.
Collapse
Affiliation(s)
- Kazuaki Nakane
- Department of Molecular Pathology, Osaka University Graduate School of Medicine and Health Science, 1-7 Yamadaoka, Suita, Osaka, 565-0871, Japan.
| | - Akihiro Takiyama
- Department of Cancer Pathology, Hokkaido University Graduate School of Medicine, Nishi 7 kita 15 Kita ward, Sapporo, Hokkaido, 060-8638, Japan.
| | - Seiji Mori
- Department of Molecular Pathology, Osaka University Graduate School of Medicine and Health Science, 1-7 Yamadaoka, Suita, Osaka, 565-0871, Japan.
| | - Nariaki Matsuura
- Department of Molecular Pathology, Osaka University Graduate School of Medicine and Health Science, 1-7 Yamadaoka, Suita, Osaka, 565-0871, Japan.
| |
Collapse
|
31
|
Rathore S, Hussain M, Khan A. Automated colon cancer detection using hybrid of novel geometric features and some traditional features. Comput Biol Med 2015; 65:279-96. [PMID: 25819060 DOI: 10.1016/j.compbiomed.2015.03.004] [Citation(s) in RCA: 27] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/31/2014] [Revised: 03/05/2015] [Accepted: 03/06/2015] [Indexed: 11/24/2022]
Abstract
Automatic classification of colon into normal and malignant classes is complex due to numerous factors including similar colors in different biological constituents of histopathological imagery. Therefore, such techniques, which exploit the textural and geometric properties of constituents of colon tissues, are desired. In this paper, a novel feature extraction strategy that mathematically models the geometric characteristics of constituents of colon tissues is proposed. In this study, we also show that the hybrid feature space encompassing diverse knowledge about the tissues׳ characteristics is quite promising for classification of colon biopsy images. This paper thus presents a hybrid feature space based colon classification (HFS-CC) technique, which utilizes hybrid features for differentiating normal and malignant colon samples. The hybrid feature space is formed to provide the classifier different types of discriminative features such as features having rich information about geometric structure and image texture. Along with the proposed geometric features, a few conventional features such as morphological, texture, scale invariant feature transform (SIFT), and elliptic Fourier descriptors (EFDs) are also used to develop a hybrid feature set. The SIFT features are reduced using minimum redundancy and maximum relevancy (mRMR). Various kernels of support vector machines (SVM) are employed as classifiers, and their performance is analyzed on 174 colon biopsy images. The proposed geometric features have achieved an accuracy of 92.62%, thereby showing their effectiveness. Moreover, the proposed HFS-CC technique achieves 98.07% testing and 99.18% training accuracy. The better performance of HFS-CC is largely due to the discerning ability of the proposed geometric features and the developed hybrid feature space.
Collapse
Affiliation(s)
- Saima Rathore
- DCIS, Pakistan Institute of Engineering and Applied Sciences, Islamabad, Pakistan; DCS&IT, University of Azad Jammu and Kashmir, Muzaffarabad, Azad Kashmir.
| | - Mutawarra Hussain
- DCIS, Pakistan Institute of Engineering and Applied Sciences, Islamabad, Pakistan
| | - Asifullah Khan
- DCIS, Pakistan Institute of Engineering and Applied Sciences, Islamabad, Pakistan
| |
Collapse
|
32
|
Rathore S, Hussain M, Khan A. GECC: Gene Expression Based Ensemble Classification of Colon Samples. IEEE/ACM TRANSACTIONS ON COMPUTATIONAL BIOLOGY AND BIOINFORMATICS 2014; 11:1131-1145. [PMID: 26357050 DOI: 10.1109/tcbb.2014.2344655] [Citation(s) in RCA: 13] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/05/2023]
Abstract
Gene expression deviates from its normal composition in case a patient has cancer. This variation can be used as an effective tool to find cancer. In this study, we propose a novel gene expressions based colon classification scheme (GECC) that exploits the variations in gene expressions for classifying colon gene samples into normal and malignant classes. Novelty of GECC is in two complementary ways. First, to cater overwhelmingly larger size of gene based data sets, various feature extraction strategies, like, chi-square, F-Score, principal component analysis (PCA) and minimum redundancy and maximum relevancy (mRMR) have been employed, which select discriminative genes amongst a set of genes. Second, a majority voting based ensemble of support vector machine (SVM) has been proposed to classify the given gene based samples. Previously, individual SVM models have been used for colon classification, however, their performance is limited. In this research study, we propose an SVM-ensemble based new approach for gene based classification of colon, wherein the individual SVM models are constructed through the learning of different SVM kernels, like, linear, polynomial, radial basis function (RBF), and sigmoid. The predicted results of individual models are combined through majority voting. In this way, the combined decision space becomes more discriminative. The proposed technique has been tested on four colon, and several other binary-class gene expression data sets, and improved performance has been achieved compared to previously reported gene based colon cancer detection techniques. The computational time required for the training and testing of 208 × 5,851 data set has been 591.01 and 0.019 s, respectively.
Collapse
|
33
|
Rathore S, Hussain M, Aksam Iftikhar M, Jalil A. Ensemble classification of colon biopsy images based on information rich hybrid features. Comput Biol Med 2014; 47:76-92. [PMID: 24561346 DOI: 10.1016/j.compbiomed.2013.12.010] [Citation(s) in RCA: 35] [Impact Index Per Article: 3.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/22/2013] [Revised: 12/20/2013] [Accepted: 12/23/2013] [Indexed: 10/25/2022]
Abstract
In recent years, classification of colon biopsy images has become an active research area. Traditionally, colon cancer is diagnosed using microscopic analysis. However, the process is subjective and leads to considerable inter/intra observer variation. Therefore, reliable computer-aided colon cancer detection techniques are in high demand. In this paper, we propose a colon biopsy image classification system, called CBIC, which benefits from discriminatory capabilities of information rich hybrid feature spaces, and performance enhancement based on ensemble classification methodology. Normal and malignant colon biopsy images differ with each other in terms of the color distribution of different biological constituents. The colors of different constituents are sharp in normal images, whereas the colors diffuse with each other in malignant images. In order to exploit this variation, two feature types, namely color components based statistical moments (CCSM) and Haralick features have been proposed, which are color components based variants of their traditional counterparts. Moreover, in normal colon biopsy images, epithelial cells possess sharp and well-defined edges. Histogram of oriented gradients (HOG) based features have been employed to exploit this information. Different combinations of hybrid features have been constructed from HOG, CCSM, and Haralick features. The minimum Redundancy Maximum Relevance (mRMR) feature selection method has been employed to select meaningful features from individual and hybrid feature sets. Finally, an ensemble classifier based on majority voting has been proposed, which classifies colon biopsy images using the selected features. Linear, RBF, and sigmoid SVM have been employed as base classifiers. The proposed system has been tested on 174 colon biopsy images, and improved performance (=98.85%) has been observed compared to previously reported studies. Additionally, the use of mRMR method has been justified by comparing the performance of CBIC on original and reduced feature sets.
Collapse
Affiliation(s)
- Saima Rathore
- Department of Computer & Information Sciences, PIEAS, Pakistan Institute of Engineering and Applied Sciences, P.O. Nilore, Islamabad.
| | - Mutawarra Hussain
- Department of Computer & Information Sciences, PIEAS, Pakistan Institute of Engineering and Applied Sciences, P.O. Nilore, Islamabad
| | - Muhammad Aksam Iftikhar
- Department of Computer & Information Sciences, PIEAS, Pakistan Institute of Engineering and Applied Sciences, P.O. Nilore, Islamabad
| | - Abdul Jalil
- Department of Computer & Information Sciences, PIEAS, Pakistan Institute of Engineering and Applied Sciences, P.O. Nilore, Islamabad
| |
Collapse
|