101
|
Ardakani AA, Mohammadzadeh A, Yaghoubi N, Ghaemmaghami Z, Reiazi R, Jafari AH, Hekmat S, Shiran MB, Bitarafan-Rajabi A. Predictive quantitative sonographic features on classification of hot and cold thyroid nodules. Eur J Radiol 2018; 101:170-177. [PMID: 29571793 DOI: 10.1016/j.ejrad.2018.02.010] [Citation(s) in RCA: 11] [Impact Index Per Article: 1.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/12/2018] [Revised: 02/04/2018] [Accepted: 02/09/2018] [Indexed: 02/01/2023]
Abstract
PURPOSE This study investigated the potentiality of ultrasound imaging to classify hot and cold thyroid nodules on the basis of textural and morphological analysis. METHODS In this research, 42 hypo (hot) and 42 hyper-function (cold) thyroid nodules were evaluated through the proposed method of computer aided diagnosis (CAD) system. To discover the difference between hot and cold nodules, 49 sonographic features (9 morphological, 40 textural) were extracted. A support vector machine classifier was utilized for the classification of LNs based on their extracted features. RESULTS In the training set data, a combination of morphological and textural features represented the best performance with area under the receiver operating characteristic curve (AUC) of 0.992. Upon testing the data set, the proposed model could classify the hot and cold thyroid nodules with an AUC of 0.948. CONCLUSIONS CAD method based on textural and morphological features is capable of distinguishing between hot from cold nodules via 2-Dimensional sonography. Therefore, it can be used as a supplementary technique in daily clinical practices to improve the radiologists' understanding of conventional ultrasound imaging for nodules characterization.
Collapse
Affiliation(s)
- Ali Abbasian Ardakani
- Department of Medical Physics, School of Medicine, Iran University of Medical Sciences, Tehran, Iran
| | - Ali Mohammadzadeh
- Department of Radiology, Rajaei Cardiovascular, Medical and Research Center, Iran University of Medical Sciences, Tehran, Iran
| | - Nahid Yaghoubi
- Department of Nuclear Medicine, Rajaei Cardiovascular, Medical and Research Center, Iran University of Medical Sciences, Tehran, Iran
| | - Zahra Ghaemmaghami
- Rajaei Cardiovascular, Medical and Research Center, Iran University of Medical Sciences, Tehran, Iran
| | - Reza Reiazi
- Department of Medical Physics, School of Medicine, Iran University of Medical Sciences, Tehran, Iran; Medical Image and Signal Processing Research Core, Iran University of Medical Sciences, Tehran, Iran
| | - Amir Homayoun Jafari
- Department of Medical Physics & Biomedical Engineering, School of Medicine, Tehran University of Medical Sciences, Tehran, Iran
| | - Sepideh Hekmat
- Department of Nuclear Medicine, School of Medicine, Hasheminejad Hospital, Iran University of Medical Sciences, Tehran, Iran
| | - Mohammad Bagher Shiran
- Department of Medical Physics, School of Medicine, Iran University of Medical Sciences, Tehran, Iran.
| | - Ahmad Bitarafan-Rajabi
- Department of Medical Physics, School of Medicine, Iran University of Medical Sciences, Tehran, Iran; Department of Nuclear Medicine, Rajaei Cardiovascular, Medical and Research Center, Iran University of Medical Sciences, Tehran, Iran.
| |
Collapse
|
102
|
Gong J, Liu JY, Sun XW, Zheng B, Nie SD. Computer-aided diagnosis of lung cancer: the effect of training data sets on classification accuracy of lung nodules. ACTA ACUST UNITED AC 2018; 63:035036. [DOI: 10.1088/1361-6560/aaa610] [Citation(s) in RCA: 28] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/10/2023]
|
103
|
Silva M, Milanese G, Seletti V, Ariani A, Sverzellati N. Pulmonary quantitative CT imaging in focal and diffuse disease: current research and clinical applications. Br J Radiol 2018; 91:20170644. [PMID: 29172671 PMCID: PMC5965469 DOI: 10.1259/bjr.20170644] [Citation(s) in RCA: 31] [Impact Index Per Article: 4.4] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/29/2017] [Revised: 11/14/2017] [Accepted: 11/23/2017] [Indexed: 12/14/2022] Open
Abstract
The frenetic development of imaging technology-both hardware and software-provides exceptional potential for investigation of the lung. In the last two decades, CT was exploited for detailed characterization of pulmonary structures and description of respiratory disease. The introduction of volumetric acquisition allowed increasingly sophisticated analysis of CT data by means of computerized algorithm, namely quantitative CT (QCT). Hundreds of thousands of CTs have been analysed for characterization of focal and diffuse disease of the lung. Several QCT metrics were developed and tested against clinical, functional and prognostic descriptors. Computer-aided detection of nodules, textural analysis of focal lesions, densitometric analysis and airway segmentation in obstructive pulmonary disease and textural analysis in interstitial lung disease are the major chapters of this discipline. The validation of QCT metrics for specific clinical and investigational needs prompted the translation of such metrics from research field to patient care. The present review summarizes the state of the art of QCT in both focal and diffuse lung disease, including a dedicated discussion about application of QCT metrics as parameters for clinical care and outcomes in clinical trials.
Collapse
Affiliation(s)
- Mario Silva
- Department of Medicine and Surgery (DiMeC), Section of Radiology, Unit of Surgical Sciences, University of Parma, Parma, Italy
| | - Gianluca Milanese
- Department of Medicine and Surgery (DiMeC), Section of Radiology, Unit of Surgical Sciences, University of Parma, Parma, Italy
| | - Valeria Seletti
- Department of Medicine and Surgery (DiMeC), Section of Radiology, Unit of Surgical Sciences, University of Parma, Parma, Italy
| | - Alarico Ariani
- Department of Medicine, Internal Medicine and Rheumatology Unit, University Hospital of Parma, Parma, Italy
| | - Nicola Sverzellati
- Department of Medicine and Surgery (DiMeC), Section of Radiology, Unit of Surgical Sciences, University of Parma, Parma, Italy
| |
Collapse
|
104
|
Fetit AE, Novak J, Rodriguez D, Auer DP, Clark CA, Grundy RG, Peet AC, Arvanitis TN. Radiomics in paediatric neuro-oncology: A multicentre study on MRI texture analysis. NMR IN BIOMEDICINE 2018; 31:e3781. [PMID: 29073725 DOI: 10.1002/nbm.3781] [Citation(s) in RCA: 34] [Impact Index Per Article: 4.9] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/05/2017] [Revised: 07/08/2017] [Accepted: 07/10/2017] [Indexed: 06/07/2023]
Abstract
Brain tumours are the most common solid cancers in children in the UK and are the most common cause of cancer deaths in this age group. Despite current advances in MRI, non-invasive diagnosis of paediatric brain tumours has yet to find its way into routine clinical practice. Radiomics, the high-throughput extraction and analysis of quantitative image features (e.g. texture), offers potential solutions for tumour characterization and decision support. In the search for diagnostic oncological markers, the primary aim of this work was to study the application of MRI texture analysis (TA) for the classification of paediatric brain tumours. A multicentre study was carried out, within a supervised classification framework, on clinical MR images, and a support vector machine (SVM) was trained with 3D textural attributes obtained from conventional MRI. To determine the cross-centre transferability of TA, an assessment of how SVM performs on unseen datasets was carried out through rigorous pairwise testing. The study also investigated the nature of features that are most likely to train classifiers that can generalize well with the data. Finally, the issue of class imbalance, which arises due to some tumour types being more common than others, was explored. For each of the tests carried out through pairwise testing, the optimal area under the receiver operating characteristic curve ranged between 76% and 86%, suggesting that the model was able to capture transferable tumour information. Feature selection results suggest that similar aspects of tumour texture are enhanced by MR images obtained at different hospitals. Our results also suggest that the availability of equally represented classes has enabled SVM to better characterize the data points. The findings of the study presented here support the use of 3D TA on conventional MR images to aid diagnostic classification of paediatric brain tumours.
Collapse
Affiliation(s)
- Ahmed E Fetit
- Institute of Digital Healthcare, WMG, University of Warwick, Coventry, UK
- Birmingham Children's Hospital NHS Foundation Trust, Birmingham, UK
| | - Jan Novak
- Birmingham Children's Hospital NHS Foundation Trust, Birmingham, UK
- Institute of Cancer and Genomic Sciences, University of Birmingham, Birmingham, UK
| | | | - Dorothee P Auer
- University of Nottingham, Nottingham, UK
- University Hospital Nottingham, Nottingham, UK
| | | | - Richard G Grundy
- University of Nottingham, Nottingham, UK
- University Hospital Nottingham, Nottingham, UK
| | - Andrew C Peet
- Birmingham Children's Hospital NHS Foundation Trust, Birmingham, UK
- Institute of Cancer and Genomic Sciences, University of Birmingham, Birmingham, UK
| | - Theodoros N Arvanitis
- Institute of Digital Healthcare, WMG, University of Warwick, Coventry, UK
- Birmingham Children's Hospital NHS Foundation Trust, Birmingham, UK
- Institute of Cancer and Genomic Sciences, University of Birmingham, Birmingham, UK
| |
Collapse
|
105
|
Arulmurugan R, Anandakumar H. Early Detection of Lung Cancer Using Wavelet Feature Descriptor and Feed Forward Back Propagation Neural Networks Classifier. COMPUTATIONAL VISION AND BIO INSPIRED COMPUTING 2018. [DOI: 10.1007/978-3-319-71767-8_9] [Citation(s) in RCA: 134] [Impact Index Per Article: 19.1] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/13/2022]
|
106
|
Promoting Collaborations Between Radiologists and Scientists. Acad Radiol 2018; 25:9-17. [PMID: 28844844 DOI: 10.1016/j.acra.2017.05.020] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/31/2017] [Revised: 04/30/2017] [Accepted: 05/02/2017] [Indexed: 12/17/2022]
Abstract
Radiology as a discipline thrives on the dynamic interplay between technological and clinical advances. Progress in almost all facets of the imaging sciences is highly dependent on complex tools sourced from physics, engineering, biology, and the clinical sciences to obtain, process, and view imaging studies. The application of these tools, however, requires broad and deep medical knowledge about disease pathophysiology and its relationship with medical imaging. This relationship between clinical medicine and imaging technology, nurtured and fostered over the past 75 years, has cultivated extraordinarily rich collaborative opportunities between basic scientists, engineers, and physicians. In this review, we attempt to provide a framework to identify both currently successful collaborative ventures and future opportunities for scientific partnership. This invited review is a product of a special working group within the Association of University Radiologists-Radiology Research Alliance.
Collapse
|
107
|
Mayo RC, Leung J. Artificial intelligence and deep learning - Radiology's next frontier? Clin Imaging 2017; 49:87-88. [PMID: 29161580 DOI: 10.1016/j.clinimag.2017.11.007] [Citation(s) in RCA: 66] [Impact Index Per Article: 8.3] [Reference Citation Analysis] [Abstract] [Key Words] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/28/2017] [Revised: 11/02/2017] [Accepted: 11/09/2017] [Indexed: 10/18/2022]
Abstract
Tracing the use of computers in the radiology department from administrative functions through image acquisition, storage, and reporting, to early attempts at improved diagnosis, we begin to imagine possible new frontiers for their use in exam interpretation. Given their initially slow but ultimately substantial progress in the noninterpretive areas, we are left desiring and even expecting more in the interpretation realm. New technological advances may provide the next wave of progress and radiologists should be early adopters. Several potential applications are discussed and hopefully will serve to inspire future progress.
Collapse
Affiliation(s)
- Ray Cody Mayo
- The University of Texas MD Anderson Cancer Center, 1515 Holcombe Blvd., Unit 1350, Houston, TX 77030, United States.
| | - Jessica Leung
- The University of Texas MD Anderson Cancer Center, 1515 Holcombe Blvd., Unit 1350, Houston, TX 77030, United States
| |
Collapse
|
108
|
A fully automatic end-to-end method for content-based image retrieval of CT scans with similar liver lesion annotations. Int J Comput Assist Radiol Surg 2017; 13:165-174. [PMID: 29147954 DOI: 10.1007/s11548-017-1687-1] [Citation(s) in RCA: 6] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/09/2017] [Accepted: 11/06/2017] [Indexed: 10/18/2022]
Abstract
PURPOSE The goal of medical content-based image retrieval (M-CBIR) is to assist radiologists in the decision-making process by retrieving medical cases similar to a given image. One of the key interests of radiologists is lesions and their annotations, since the patient treatment depends on the lesion diagnosis. Therefore, a key feature of M-CBIR systems is the retrieval of scans with the most similar lesion annotations. To be of value, M-CBIR systems should be fully automatic to handle large case databases. METHODS We present a fully automatic end-to-end method for the retrieval of CT scans with similar liver lesion annotations. The input is a database of abdominal CT scans labeled with liver lesions, a query CT scan, and optionally one radiologist-specified lesion annotation of interest. The output is an ordered list of the database CT scans with the most similar liver lesion annotations. The method starts by automatically segmenting the liver in the scan. It then extracts a histogram-based features vector from the segmented region, learns the features' relative importance, and ranks the database scans according to the relative importance measure. The main advantages of our method are that it fully automates the end-to-end querying process, that it uses simple and efficient techniques that are scalable to large datasets, and that it produces quality retrieval results using an unannotated CT scan. RESULTS Our experimental results on 9 CT queries on a dataset of 41 volumetric CT scans from the 2014 Image CLEF Liver Annotation Task yield an average retrieval accuracy (Normalized Discounted Cumulative Gain index) of 0.77 and 0.84 without/with annotation, respectively. CONCLUSIONS Fully automatic end-to-end retrieval of similar cases based on image information alone, rather that on disease diagnosis, may help radiologists to better diagnose liver lesions.
Collapse
|
109
|
Liang L, Liu M, Martin C, Elefteriades JA, Sun W. A machine learning approach to investigate the relationship between shape features and numerically predicted risk of ascending aortic aneurysm. Biomech Model Mechanobiol 2017; 16:1519-1533. [PMID: 28386685 PMCID: PMC5630492 DOI: 10.1007/s10237-017-0903-9] [Citation(s) in RCA: 83] [Impact Index Per Article: 10.4] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/14/2016] [Accepted: 03/27/2017] [Indexed: 02/07/2023]
Abstract
Geometric features of the aorta are linked to patient risk of rupture in the clinical decision to electively repair an ascending aortic aneurysm (AsAA). Previous approaches have focused on relationship between intuitive geometric features (e.g., diameter and curvature) and wall stress. This work investigates the feasibility of a machine learning approach to establish the linkages between shape features and FEA-predicted AsAA rupture risk, and it may serve as a faster surrogate for FEA associated with long simulation time and numerical convergence issues. This method consists of four main steps: (1) constructing a statistical shape model (SSM) from clinical 3D CT images of AsAA patients; (2) generating a dataset of representative aneurysm shapes and obtaining FEA-predicted risk scores defined as systolic pressure divided by rupture pressure (rupture is determined by a threshold criterion); (3) establishing relationship between shape features and risk by using classifiers and regressors; and (4) evaluating such relationship in cross-validation. The results show that SSM parameters can be used as strong shape features to make predictions of risk scores consistent with FEA, which lead to an average risk classification accuracy of 95.58% by using support vector machine and an average regression error of 0.0332 by using support vector regression, while intuitive geometric features have relatively weak performance. Compared to FEA, this machine learning approach is magnitudes faster. In our future studies, material properties and inhomogeneous thickness will be incorporated into the models and learning algorithms, which may lead to a practical system for clinical applications.
Collapse
Affiliation(s)
- Liang Liang
- Tissue Mechanics Laboratory, The Wallace H. Coulter Department of Biomedical Engineering, Georgia Institute of Technology and Emory University, Technology Enterprise Park, Room 206 387 Technology Circle, Atlanta, GA, 30313-2412, USA
| | - Minliang Liu
- Tissue Mechanics Laboratory, The Wallace H. Coulter Department of Biomedical Engineering, Georgia Institute of Technology and Emory University, Technology Enterprise Park, Room 206 387 Technology Circle, Atlanta, GA, 30313-2412, USA
| | - Caitlin Martin
- Tissue Mechanics Laboratory, The Wallace H. Coulter Department of Biomedical Engineering, Georgia Institute of Technology and Emory University, Technology Enterprise Park, Room 206 387 Technology Circle, Atlanta, GA, 30313-2412, USA
| | - John A Elefteriades
- Aortic Institute of Yale-New Haven Hospital, Yale University, New Haven, CT, USA
| | - Wei Sun
- Tissue Mechanics Laboratory, The Wallace H. Coulter Department of Biomedical Engineering, Georgia Institute of Technology and Emory University, Technology Enterprise Park, Room 206 387 Technology Circle, Atlanta, GA, 30313-2412, USA.
| |
Collapse
|
110
|
Kooi T, Karssemeijer N. Classifying symmetrical differences and temporal change for the detection of malignant masses in mammography using deep neural networks. J Med Imaging (Bellingham) 2017; 4:044501. [PMID: 29021992 PMCID: PMC5633751 DOI: 10.1117/1.jmi.4.4.044501] [Citation(s) in RCA: 31] [Impact Index Per Article: 3.9] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/21/2017] [Accepted: 09/12/2017] [Indexed: 01/27/2023] Open
Abstract
We investigate the addition of symmetry and temporal context information to a deep convolutional neural network (CNN) with the purpose of detecting malignant soft tissue lesions in mammography. We employ a simple linear mapping that takes the location of a mass candidate and maps it to either the contralateral or prior mammogram, and regions of interest (ROIs) are extracted around each location. Two different architectures are subsequently explored: (1) a fusion model employing two datastreams where both ROIs are fed to the network during training and testing and (2) a stagewise approach where a single ROI CNN is trained on the primary image and subsequently used as a feature extractor for both primary and contralateral or prior ROIs. A "shallow" gradient boosted tree classifier is then trained on the concatenation of these features and used to classify the joint representation. The baseline yielded an AUC of 0.87 with confidence interval [0.853, 0.893]. For the analysis of symmetrical differences, the first architecture where both primary and contralateral patches are presented during training obtained an AUC of 0.895 with confidence interval [0.877, 0.913], and the second architecture where a new classifier is retrained on the concatenation an AUC of 0.88 with confidence interval [0.859, 0.9]. We found a significant difference between the first architecture and the baseline at high specificity with [Formula: see text]. When using the same architectures to analyze temporal change, we yielded an AUC of 0.884 with confidence interval [0.865, 0.902] for the first architecture and an AUC of 0.879 with confidence interval [0.858, 0.898] in the second setting. Although improvements for temporal analysis were consistent, they were not found to be significant. The results show our proposed method is promising and we suspect performance can greatly be improved when more temporal data become available.
Collapse
Affiliation(s)
- Thijs Kooi
- RadboudUMC Nijmegen, Diagnostic Image Analysis Group, Department of Radiology and Nuclear Medicine, Nijmegen, The Netherlands
| | - Nico Karssemeijer
- RadboudUMC Nijmegen, Diagnostic Image Analysis Group, Department of Radiology and Nuclear Medicine, Nijmegen, The Netherlands
| |
Collapse
|
111
|
Han S, Kang HK, Jeong JY, Park MH, Kim W, Bang WC, Seong YK. A deep learning framework for supporting the classification of breast lesions in ultrasound images. Phys Med Biol 2017; 62:7714-7728. [PMID: 28753132 DOI: 10.1088/1361-6560/aa82ec] [Citation(s) in RCA: 188] [Impact Index Per Article: 23.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/24/2022]
Abstract
In this research, we exploited the deep learning framework to differentiate the distinctive types of lesions and nodules in breast acquired with ultrasound imaging. A biopsy-proven benchmarking dataset was built from 5151 patients cases containing a total of 7408 ultrasound breast images, representative of semi-automatically segmented lesions associated with masses. The dataset comprised 4254 benign and 3154 malignant lesions. The developed method includes histogram equalization, image cropping and margin augmentation. The GoogLeNet convolutionary neural network was trained to the database to differentiate benign and malignant tumors. The networks were trained on the data with augmentation and the data without augmentation. Both of them showed an area under the curve of over 0.9. The networks showed an accuracy of about 0.9 (90%), a sensitivity of 0.86 and a specificity of 0.96. Although target regions of interest (ROIs) were selected by radiologists, meaning that radiologists still have to point out the location of the ROI, the classification of malignant lesions showed promising results. If this method is used by radiologists in clinical situations it can classify malignant lesions in a short time and support the diagnosis of radiologists in discriminating malignant lesions. Therefore, the proposed method can work in tandem with human radiologists to improve performance, which is a fundamental purpose of computer-aided diagnosis.
Collapse
Affiliation(s)
- Seokmin Han
- Korea National University of Transportation, Uiwang-si, Kyunggi-do, Republic of Korea
| | | | | | | | | | | | | |
Collapse
|
112
|
Nakao T, Hanaoka S, Nomura Y, Sato I, Nemoto M, Miki S, Maeda E, Yoshikawa T, Hayashi N, Abe O. Deep neural network-based computer-assisted detection of cerebral aneurysms in MR angiography. J Magn Reson Imaging 2017; 47:948-953. [PMID: 28836310 DOI: 10.1002/jmri.25842] [Citation(s) in RCA: 109] [Impact Index Per Article: 13.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/12/2017] [Accepted: 08/04/2017] [Indexed: 12/13/2022] Open
Abstract
BACKGROUND The usefulness of computer-assisted detection (CAD) for detecting cerebral aneurysms has been reported; therefore, the improved performance of CAD will help to detect cerebral aneurysms. PURPOSE To develop a CAD system for intracranial aneurysms on unenhanced magnetic resonance angiography (MRA) images based on a deep convolutional neural network (CNN) and a maximum intensity projection (MIP) algorithm, and to demonstrate the usefulness of the system by training and evaluating it using a large dataset. STUDY TYPE Retrospective study. SUBJECTS There were 450 cases with intracranial aneurysms. The diagnoses of brain aneurysms were made on the basis of MRA, which was performed as part of a brain screening program. FIELD STRENGTH/SEQUENCE Noncontrast-enhanced 3D time-of-flight (TOF) MRA on 3T MR scanners. ASSESSMENT In our CAD, we used a CNN classifier that predicts whether each voxel is inside or outside aneurysms by inputting MIP images generated from a volume of interest (VOI) around the voxel. The CNN was trained in advance using manually inputted labels. We evaluated our method using 450 cases with intracranial aneurysms, 300 of which were used for training, 50 for parameter tuning, and 100 for the final evaluation. STATISTICAL TESTS Free-response receiver operating characteristic (FROC) analysis. RESULTS Our CAD system detected 94.2% (98/104) of aneurysms with 2.9 false positives per case (FPs/case). At a sensitivity of 70%, the number of FPs/case was 0.26. DATA CONCLUSION We showed that the combination of a CNN and an MIP algorithm is useful for the detection of intracranial aneurysms. LEVEL OF EVIDENCE 4 Technical Efficacy: Stage 1 J. Magn. Reson. Imaging 2018;47:948-953.
Collapse
Affiliation(s)
- Takahiro Nakao
- Radiology and Biomedical Engineering, Graduate School of Medicine, University of Tokyo, Tokyo, Japan
| | - Shouhei Hanaoka
- Department of Radiology, University of Tokyo Hospital, Tokyo, Japan
| | - Yukihiro Nomura
- Department of Computational Diagnostic Radiology and Preventive Medicine, University of Tokyo Hospital, Tokyo, Japan
| | - Issei Sato
- Department of Radiology, University of Tokyo Hospital, Tokyo, Japan.,Graduate School of Frontier Sciences, University of Tokyo, Tokyo, Japan
| | - Mitsutaka Nemoto
- Department of Computational Diagnostic Radiology and Preventive Medicine, University of Tokyo Hospital, Tokyo, Japan
| | - Soichiro Miki
- Department of Computational Diagnostic Radiology and Preventive Medicine, University of Tokyo Hospital, Tokyo, Japan
| | - Eriko Maeda
- Department of Computational Diagnostic Radiology and Preventive Medicine, University of Tokyo Hospital, Tokyo, Japan
| | - Takeharu Yoshikawa
- Department of Computational Diagnostic Radiology and Preventive Medicine, University of Tokyo Hospital, Tokyo, Japan
| | - Naoto Hayashi
- Department of Computational Diagnostic Radiology and Preventive Medicine, University of Tokyo Hospital, Tokyo, Japan
| | - Osamu Abe
- Radiology and Biomedical Engineering, Graduate School of Medicine, University of Tokyo, Tokyo, Japan.,Department of Radiology, University of Tokyo Hospital, Tokyo, Japan
| |
Collapse
|
113
|
Khajehnejad M, Saatlou FH, Mohammadzade H. Alzheimer's Disease Early Diagnosis Using Manifold-Based Semi-Supervised Learning. Brain Sci 2017; 7:E109. [PMID: 28825647 PMCID: PMC5575629 DOI: 10.3390/brainsci7080109] [Citation(s) in RCA: 17] [Impact Index Per Article: 2.1] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/18/2017] [Revised: 08/15/2017] [Accepted: 08/16/2017] [Indexed: 01/18/2023] Open
Abstract
Alzheimer's disease (AD) is currently ranked as the sixth leading cause of death in the United States and recent estimates indicate that the disorder may rank third, just behind heart disease and cancer, as a cause of death for older people. Clearly, predicting this disease in the early stages and preventing it from progressing is of great importance. The diagnosis of Alzheimer's disease (AD) requires a variety of medical tests, which leads to huge amounts of multivariate heterogeneous data. It can be difficult and exhausting to manually compare, visualize, and analyze this data due to the heterogeneous nature of medical tests; therefore, an efficient approach for accurate prediction of the condition of the brain through the classification of magnetic resonance imaging (MRI) images is greatly beneficial and yet very challenging. In this paper, a novel approach is proposed for the diagnosis of very early stages of AD through an efficient classification of brain MRI images, which uses label propagation in a manifold-based semi-supervised learning framework. We first apply voxel morphometry analysis to extract some of the most critical AD-related features of brain images from the original MRI volumes and also gray matter (GM) segmentation volumes. The features must capture the most discriminative properties that vary between a healthy and Alzheimer-affected brain. Next, we perform a principal component analysis (PCA)-based dimension reduction on the extracted features for faster yet sufficiently accurate analysis. To make the best use of the captured features, we present a hybrid manifold learning framework which embeds the feature vectors in a subspace. Next, using a small set of labeled training data, we apply a label propagation method in the created manifold space to predict the labels of the remaining images and classify them in the two groups of mild Alzheimer's and normal condition (MCI/NC). The accuracy of the classification using the proposed method is 93.86% for the Open Access Series of Imaging Studies (OASIS) database of MRI brain images, providing, compared to the best existing methods, a 3% lower error rate.
Collapse
Affiliation(s)
- Moein Khajehnejad
- Department of Electrical Engineering, Sharif University of Technology, Azadi Avenue, Tehran 145888-9694, Iran.
| | - Forough Habibollahi Saatlou
- Department of Electrical Engineering, Sharif University of Technology, Azadi Avenue, Tehran 145888-9694, Iran.
| | - Hoda Mohammadzade
- Department of Electrical Engineering, Sharif University of Technology, Azadi Avenue, Tehran 145888-9694, Iran.
| |
Collapse
|
114
|
Automated Segmentation of Light-Sheet Fluorescent Imaging to Characterize Experimental Doxorubicin-Induced Cardiac Injury and Repair. Sci Rep 2017; 7:8603. [PMID: 28819303 PMCID: PMC5561066 DOI: 10.1038/s41598-017-09152-x] [Citation(s) in RCA: 31] [Impact Index Per Article: 3.9] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/22/2017] [Accepted: 07/20/2017] [Indexed: 11/09/2022] Open
Abstract
This study sought to develop an automated segmentation approach based on histogram analysis of raw axial images acquired by light-sheet fluorescent imaging (LSFI) to establish rapid reconstruction of the 3-D zebrafish cardiac architecture in response to doxorubicin-induced injury and repair. Input images underwent a 4-step automated image segmentation process consisting of stationary noise removal, histogram equalization, adaptive thresholding, and image fusion followed by 3-D reconstruction. We applied this method to 3-month old zebrafish injected intraperitoneally with doxorubicin followed by LSFI at 3, 30, and 60 days post-injection. We observed an initial decrease in myocardial and endocardial cavity volumes at day 3, followed by ventricular remodeling at day 30, and recovery at day 60 (P < 0.05, n = 7-19). Doxorubicin-injected fish developed ventricular diastolic dysfunction and worsening global cardiac function evidenced by elevated E/A ratios and myocardial performance indexes quantified by pulsed-wave Doppler ultrasound at day 30, followed by normalization at day 60 (P < 0.05, n = 9-20). Treatment with the γ-secretase inhibitor, DAPT, to inhibit cleavage and release of Notch Intracellular Domain (NICD) blocked cardiac architectural regeneration and restoration of ventricular function at day 60 (P < 0.05, n = 6-14). Our approach provides a high-throughput model with translational implications for drug discovery and genetic modifiers of chemotherapy-induced cardiomyopathy.
Collapse
|
115
|
Quantitative computer-aided diagnostic algorithm for automated detection of peak lesion attenuation in differentiating clear cell from papillary and chromophobe renal cell carcinoma, oncocytoma, and fat-poor angiomyolipoma on multiphasic multidetector computed tomography. Abdom Radiol (NY) 2017; 42:1919-1928. [PMID: 28280876 DOI: 10.1007/s00261-017-1095-6] [Citation(s) in RCA: 28] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/19/2022]
Abstract
OBJECTIVE To evaluate the performance of a novel, quantitative computer-aided diagnostic (CAD) algorithm on four-phase multidetector computed tomography (MDCT) to detect peak lesion attenuation to enable differentiation of clear cell renal cell carcinoma (ccRCC) from chromophobe RCC (chRCC), papillary RCC (pRCC), oncocytoma, and fat-poor angiomyolipoma (fp-AML). MATERIALS AND METHODS We queried our clinical databases to obtain a cohort of histologically proven renal masses with preoperative MDCT with four phases [unenhanced (U), corticomedullary (CM), nephrographic (NP), and excretory (E)]. A whole lesion 3D contour was obtained in all four phases. The CAD algorithm determined a region of interest (ROI) of peak lesion attenuation within the 3D lesion contour. For comparison, a manual ROI was separately placed in the most enhancing portion of the lesion by visual inspection for a reference standard, and in uninvolved renal cortex. Relative lesion attenuation for both CAD and manual methods was obtained by normalizing the CAD peak lesion attenuation ROI (and the reference standard manually placed ROI) to uninvolved renal cortex with the formula [(peak lesion attenuation ROI - cortex ROI)/cortex ROI] × 100%. ROC analysis and area under the curve (AUC) were used to assess diagnostic performance. Bland-Altman analysis was used to compare peak ROI between CAD and manual method. RESULTS The study cohort comprised 200 patients with 200 unique renal masses: 106 (53%) ccRCC, 32 (16%) oncocytomas, 18 (9%) chRCCs, 34 (17%) pRCCs, and 10 (5%) fp-AMLs. In the CM phase, CAD-derived ROI enabled characterization of ccRCC from chRCC, pRCC, oncocytoma, and fp-AML with AUCs of 0.850 (95% CI 0.732-0.968), 0.959 (95% CI 0.930-0.989), 0.792 (95% CI 0.716-0.869), and 0.825 (95% CI 0.703-0.948), respectively. On Bland-Altman analysis, there was excellent agreement of CAD and manual methods with mean differences between 14 and 26 HU in each phase. CONCLUSION A novel, quantitative CAD algorithm enabled robust peak HU lesion detection and discrimination of ccRCC from other renal lesions with similar performance compared to the manual method.
Collapse
|
116
|
Maeda I, Kubota M, Ohta J, Shinno K, Tajima S, Ariizumi Y, Doi M, Oana Y, Kanemaki Y, Tsugawa K, Ueno T, Takagi M. Effectiveness of computer-aided diagnosis (CADx) of breast pathology using immunohistochemistry results of core needle biopsy samples for synaptophysin, oestrogen receptor and CK14/p63 for classification of epithelial proliferative lesions of the breast. J Clin Pathol 2017. [DOI: 10.1136/jclinpath-2017-204478] [Citation(s) in RCA: 6] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/03/2022]
Abstract
AimsThe aim of this study was to develop a computer-aided diagnosis (CADx) system for identifying breast pathology.MethodsTwo sets of 100 consecutive core needle biopsy (CNB) specimens were collected for test and validation studies. All 200 CNB specimens were stained with antibodies targeting oestrogen receptor (ER), synaptophysin and CK14/p63. All stained slides were scanned in a whole-slide imaging system and photographed. The photographs were analysed using software to identify the proportions of tumour cells that were positive and negative for each marker. In the test study, the cut-off values for synaptophysin (negative and positive) and CK14/p63 (negative and positive) were decided using receiver operating characteristic (ROC) analysis. For ER analysis, samples were divided into groups with <10% positive or >10% positive cells and decided using receiver operating characteristic (ROC) analysis. Finally, these two groups categorised as ER-low, ER-intermediate (non-low and non-high) and ER-high groups. In the validation study, the second set of immunohistochemical slides were analysed using these cut-off values.ResultsThe cut-off values for synaptophysin, <10% ER positive, >10% ER positive and CK14/p63 were 0.14%, 2.17%, 77.93% and 18.66%, respectively. The positive predictive value for malignancy (PPV) was 100% for synaptophysin-positive/ER-high/(CK14/p63)-any or synaptophysin-positive/ER-low/(CK14/p63)-any. The PPV was 25% for synaptophysin-positive/ER-intermediate/(CK14/p63)-positive. For synaptophysin-negative/(CK14/p63)-negative, the PPVs for ER-low, ER-intermediate and ER-high were 100%, 80.0% and 95.8%, respectively. The PPV was 4.5% for synaptophysin-negative/ER-intermediate/(CK14/p63)-positive.ConclusionThe CADx system was able to analyse sufficient data for all types of epithelial proliferative lesions of the breast including invasive breast cancer. This system may be useful for pathological diagnosis of breast CNB in routine investigations.
Collapse
|
117
|
Wivern: a Web-Based System Enabling Computer-Aided Diagnosis and Interdisciplinary Expert Collaboration for Vascular Research. J Med Biol Eng 2017. [DOI: 10.1007/s40846-017-0256-y] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/19/2022]
|
118
|
A review of lung cancer screening and the role of computer-aided detection. Clin Radiol 2017; 72:433-442. [DOI: 10.1016/j.crad.2017.01.002] [Citation(s) in RCA: 63] [Impact Index Per Article: 7.9] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/09/2016] [Revised: 12/14/2016] [Accepted: 01/04/2017] [Indexed: 12/26/2022]
|
119
|
Kim Y, Furlan A, Borhani AA, Bae KT. Computer-aided diagnosis program for classifying the risk of hepatocellular carcinoma on MR images following liver imaging reporting and data system (LI-RADS). J Magn Reson Imaging 2017; 47:710-722. [PMID: 28556283 DOI: 10.1002/jmri.25772] [Citation(s) in RCA: 9] [Impact Index Per Article: 1.1] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/28/2016] [Accepted: 05/08/2017] [Indexed: 12/14/2022] Open
Abstract
PURPOSE To develop and evaluate a computer-aided diagnosis (CAD) program for liver lesions on magnetic resonance (MR) images for classification of the risk of hepatocellular carcinoma (HCC) following the liver imaging reporting and data system (LI-RADS). MATERIALS AND METHODS Liver MR images from 41 patients with hyperenhancing liver lesions categorized as LR 3, 4, and 5 were evaluated by two radiologists. The major LI-RADS features of each index liver lesion were recorded, including size (maximum transverse diameter), presence of hyperenhancement, washout appearance, and capsule appearance. A CAD program was implemented to register MR images at different contrast-enhancement phases, segment liver lesions, extract lesion features, and classify lesions according to LI-RADS. The LI-RADS features quantified by CAD were compared with those assessed by radiologists using the intraclass correlation coefficient (ICC) and receiver operator curve (ROC) analyses. The LI-RADS categorization between CAD and radiologists was evaluated using the weighted Cohen's kappa coefficient. RESULTS The mean and standard deviation of the lesion diameters were 21 ± 11 mm (range, 7-70 mm) by radiologists and 22 ± 11 mm (range, 8-72 mm) by CAD (ICC, 0.96-0.97). The area under the curve (AUC) for the washout assessment by CAD was 0.79-0.93 with sensitivity 0.69-0.82 and specificity 0.79-1. The AUC for the capsule assessment by CAD was 0.79-0.9 with sensitivity 0.75-0.9 and specificity 0.82-0.96. The classifications by the radiologists and CAD coincided in 76-83% lesions (k = 0.57-0.71), while the agreements between radiologists were in 78% lesions (k = 0.59). CONCLUSION We developed a CAD program for liver lesions on MR images and showed a substantial agreement in the LI-RADS-based classification of the risk of HCCs between the CAD and radiologists. LEVEL OF EVIDENCE 1 Technical Efficacy: Stage 1 J. Magn. Reson. Imaging 2018;47:710-722.
Collapse
Affiliation(s)
- Youngwoo Kim
- Department of Radiology, University of Pittsburgh School of Medicine, Pittsburgh, Pennsylvania, USA
| | - Alessandro Furlan
- Department of Radiology, University of Pittsburgh School of Medicine, Pittsburgh, Pennsylvania, USA
| | - Amir A Borhani
- Department of Radiology, University of Pittsburgh School of Medicine, Pittsburgh, Pennsylvania, USA
| | - Kyongtae T Bae
- Department of Radiology, University of Pittsburgh School of Medicine, Pittsburgh, Pennsylvania, USA
| |
Collapse
|
120
|
Nemoto M, Hayashi N, Hanaoka S, Nomura Y, Miki S, Yoshikawa T. Feasibility Study of a Generalized Framework for Developing Computer-Aided Detection Systems-a New Paradigm. J Digit Imaging 2017; 30:629-639. [PMID: 28405834 DOI: 10.1007/s10278-017-9968-3] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/17/2022] Open
Abstract
We propose a generalized framework for developing computer-aided detection (CADe) systems whose characteristics depend only on those of the training dataset. The purpose of this study is to show the feasibility of the framework. Two different CADe systems were experimentally developed by a prototype of the framework, but with different training datasets. The CADe systems include four components; preprocessing, candidate area extraction, candidate detection, and candidate classification. Four pretrained algorithms with dedicated optimization/setting methods corresponding to the respective components were prepared in advance. The pretrained algorithms were sequentially trained in the order of processing of the components. In this study, two different datasets, brain MRA with cerebral aneurysms and chest CT with lung nodules, were collected to develop two different types of CADe systems in the framework. The performances of the developed CADe systems were evaluated by threefold cross-validation. The CADe systems for detecting cerebral aneurysms in brain MRAs and for detecting lung nodules in chest CTs were successfully developed using the respective datasets. The framework was shown to be feasible by the successful development of the two different types of CADe systems. The feasibility of this framework shows promise for a new paradigm in the development of CADe systems: development of CADe systems without any lesion specific algorithm designing.
Collapse
Affiliation(s)
- Mitsutaka Nemoto
- Department of Computational Diagnostic Radiology and Preventive Medicine, The University of Tokyo Hospital, 7-3-1 Hongo, Bunkyo-ku, Tokyo, 113-8655, Japan.
| | - Naoto Hayashi
- Department of Computational Diagnostic Radiology and Preventive Medicine, The University of Tokyo Hospital, 7-3-1 Hongo, Bunkyo-ku, Tokyo, 113-8655, Japan
| | - Shouhei Hanaoka
- Department of Radiology, The University of Tokyo Hospital, 7-3-1 Hongo, Bunkyo-ku, Tokyo, 113-8655, Japan
| | - Yukihiro Nomura
- Department of Computational Diagnostic Radiology and Preventive Medicine, The University of Tokyo Hospital, 7-3-1 Hongo, Bunkyo-ku, Tokyo, 113-8655, Japan
| | - Soichiro Miki
- Department of Computational Diagnostic Radiology and Preventive Medicine, The University of Tokyo Hospital, 7-3-1 Hongo, Bunkyo-ku, Tokyo, 113-8655, Japan
| | - Takeharu Yoshikawa
- Department of Computational Diagnostic Radiology and Preventive Medicine, The University of Tokyo Hospital, 7-3-1 Hongo, Bunkyo-ku, Tokyo, 113-8655, Japan
| |
Collapse
|
121
|
Horowitz TS. Prevalence in Visual Search: From the Clinic to the Lab and Back Again. JAPANESE PSYCHOLOGICAL RESEARCH 2017. [DOI: 10.1111/jpr.12153] [Citation(s) in RCA: 33] [Impact Index Per Article: 4.1] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/28/2022]
|
122
|
Vandenberghe ME, Scott MLJ, Scorer PW, Söderberg M, Balcerzak D, Barker C. Relevance of deep learning to facilitate the diagnosis of HER2 status in breast cancer. Sci Rep 2017; 7:45938. [PMID: 28378829 PMCID: PMC5380996 DOI: 10.1038/srep45938] [Citation(s) in RCA: 110] [Impact Index Per Article: 13.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/10/2017] [Accepted: 03/06/2017] [Indexed: 11/10/2022] Open
Abstract
Tissue biomarker scoring by pathologists is central to defining the appropriate therapy for patients with cancer. Yet, inter-pathologist variability in the interpretation of ambiguous cases can affect diagnostic accuracy. Modern artificial intelligence methods such as deep learning have the potential to supplement pathologist expertise to ensure constant diagnostic accuracy. We developed a computational approach based on deep learning that automatically scores HER2, a biomarker that defines patient eligibility for anti-HER2 targeted therapies in breast cancer. In a cohort of 71 breast tumour resection samples, automated scoring showed a concordance of 83% with a pathologist. The twelve discordant cases were then independently reviewed, leading to a modification of diagnosis from initial pathologist assessment for eight cases. Diagnostic discordance was found to be largely caused by perceptual differences in assessing HER2 expression due to high HER2 staining heterogeneity. This study provides evidence that deep learning aided diagnosis can facilitate clinical decision making in breast cancer by identifying cases at high risk of misdiagnosis.
Collapse
Affiliation(s)
- Michel E. Vandenberghe
- Personalised Healthcare & Biomarkers, IMED Biotech Unit, AstraZeneca, HODGKIN, C/o B310 Cambridge Science Park, Milton Road, Cambridge, CB4 0WG, United Kingdom
| | - Marietta L. J. Scott
- Personalised Healthcare & Biomarkers, IMED Biotech Unit, AstraZeneca, HODGKIN, C/o B310 Cambridge Science Park, Milton Road, Cambridge, CB4 0WG, United Kingdom
| | - Paul W. Scorer
- Personalised Healthcare & Biomarkers, IMED Biotech Unit, AstraZeneca, HODGKIN, C/o B310 Cambridge Science Park, Milton Road, Cambridge, CB4 0WG, United Kingdom
| | - Magnus Söderberg
- Pathology, Drug Safety & Metabolism, IMED Biotech Unit, AstraZeneca, Pepparedsleden 1, 431 50 Mölndal, Sweden
| | - Denis Balcerzak
- Personalised Healthcare & Biomarkers, IMED Biotech Unit, AstraZeneca, HODGKIN, C/o B310 Cambridge Science Park, Milton Road, Cambridge, CB4 0WG, United Kingdom
| | - Craig Barker
- Personalised Healthcare & Biomarkers, IMED Biotech Unit, AstraZeneca, HODGKIN, C/o B310 Cambridge Science Park, Milton Road, Cambridge, CB4 0WG, United Kingdom
| |
Collapse
|
123
|
Kooi T, van Ginneken B, Karssemeijer N, den Heeten A. Discriminating solitary cysts from soft tissue lesions in mammography using a pretrained deep convolutional neural network. Med Phys 2017; 44:1017-1027. [DOI: 10.1002/mp.12110] [Citation(s) in RCA: 72] [Impact Index Per Article: 9.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/23/2016] [Revised: 12/16/2016] [Accepted: 01/07/2017] [Indexed: 11/08/2022] Open
Affiliation(s)
- Thijs Kooi
- Department of Radiology and Nuclear Medicine; RadboudUMC; Geert Grooteplein Zuid 10 Nijmegen 6535 The Netherlands
| | - Bram van Ginneken
- Department of Radiology and Nuclear Medicine; RadboudUMC; Geert Grooteplein Zuid 10 Nijmegen 6535 The Netherlands
| | - Nico Karssemeijer
- Department of Radiology and Nuclear Medicine; RadboudUMC; Geert Grooteplein Zuid 10 Nijmegen 6535 The Netherlands
| | - Ard den Heeten
- Department of Radiology; Academic Medical Center Amsterdam; P.O. Box 22660 DD Amsterdam 1100 The Netherlands
| |
Collapse
|
124
|
Rossi F, Mokri SS, Abd. Rahni AA. Development of a semi-automated combined PET and CT lung lesion segmentation framework. MEDICAL IMAGING 2017: BIOMEDICAL APPLICATIONS IN MOLECULAR, STRUCTURAL, AND FUNCTIONAL IMAGING 2017. [DOI: 10.1117/12.2256808] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 09/02/2023]
|
125
|
Ohkubo M, Narita A, Wada S, Murao K, Matsumoto T. Technical Note: Image filtering to make computer-aided detection robust to image reconstruction kernel choice in lung cancer CT screening. Med Phys 2017; 43:4098. [PMID: 27370129 DOI: 10.1118/1.4953247] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/31/2022] Open
Abstract
PURPOSE In lung cancer computed tomography (CT) screening, the performance of a computer-aided detection (CAD) system depends on the selection of the image reconstruction kernel. To reduce this dependence on reconstruction kernels, the authors propose a novel application of an image filtering method previously proposed by their group. METHODS The proposed filtering process uses the ratio of modulation transfer functions (MTFs) of two reconstruction kernels as a filtering function in the spatial-frequency domain. This method is referred to as MTFratio filtering. Test image data were obtained from CT screening scans of 67 subjects who each had one nodule. Images were reconstructed using two kernels: fSTD (for standard lung imaging) and fSHARP (for sharp edge-enhancement lung imaging). The MTFratio filtering was implemented using the MTFs measured for those kernels and was applied to the reconstructed fSHARP images to obtain images that were similar to the fSTD images. A mean filter and a median filter were applied (separately) for comparison. All reconstructed and filtered images were processed using their prototype CAD system. RESULTS The MTFratio filtered images showed excellent agreement with the fSTD images. The standard deviation for the difference between these images was very small, ∼6.0 Hounsfield units (HU). However, the mean and median filtered images showed larger differences of ∼48.1 and ∼57.9 HU from the fSTD images, respectively. The free-response receiver operating characteristic (FROC) curve for the fSHARP images indicated poorer performance compared with the FROC curve for the fSTD images. The FROC curve for the MTFratio filtered images was equivalent to the curve for the fSTD images. However, this similarity was not achieved by using the mean filter or median filter. CONCLUSIONS The accuracy of MTFratio image filtering was verified and the method was demonstrated to be effective for reducing the kernel dependence of CAD performance.
Collapse
Affiliation(s)
- Masaki Ohkubo
- Graduate School of Health Sciences, Niigata University, Niigata 951-8518, Japan
| | - Akihiro Narita
- Graduate School of Health Sciences, Niigata University, Niigata 951-8518, Japan
| | - Shinichi Wada
- Graduate School of Health Sciences, Niigata University, Niigata 951-8518, Japan
| | | | | |
Collapse
|
126
|
van Ginneken B. Fifty years of computer analysis in chest imaging: rule-based, machine learning, deep learning. Radiol Phys Technol 2017; 10:23-32. [PMID: 28211015 PMCID: PMC5337239 DOI: 10.1007/s12194-017-0394-5] [Citation(s) in RCA: 87] [Impact Index Per Article: 10.9] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/08/2017] [Accepted: 02/08/2017] [Indexed: 02/06/2023]
Abstract
Half a century ago, the term "computer-aided diagnosis" (CAD) was introduced in the scientific literature. Pulmonary imaging, with chest radiography and computed tomography, has always been one of the focus areas in this field. In this study, I describe how machine learning became the dominant technology for tackling CAD in the lungs, generally producing better results than do classical rule-based approaches, and how the field is now rapidly changing: in the last few years, we have seen how even better results can be obtained with deep learning. The key differences among rule-based processing, machine learning, and deep learning are summarized and illustrated for various applications of CAD in the chest.
Collapse
Affiliation(s)
- Bram van Ginneken
- Diagnostic Image Analysis Group, Radboud University Medical Center, Nijmegen, The Netherlands.
| |
Collapse
|
127
|
Lee CS, Baughman DM, Lee AY. Deep learning is effective for the classification of OCT images of normal versus Age-related Macular Degeneration. Ophthalmol Retina 2017; 1:322-327. [PMID: 30693348 DOI: 10.1016/j.oret.2016.12.009] [Citation(s) in RCA: 319] [Impact Index Per Article: 39.9] [Reference Citation Analysis] [Abstract] [Grants] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/20/2022]
Abstract
Objective The advent of Electronic Medical Records (EMR) with large electronic imaging databases along with advances in deep neural networks with machine learning has provided a unique opportunity to achieve milestones in automated image analysis. Optical coherence tomography (OCT) is the most commonly obtained imaging modality in ophthalmology and represents a dense and rich dataset when combined with labels derived from the EMR. We sought to determine if deep learning could be utilized to distinguish normal OCT images from images from patients with Age-related Macular Degeneration (AMD). Design EMR and OCT database study. Subjects Normal and AMD patients who had a macular OCT. Methods Automated extraction of an OCT imaging database was performed and linked to clinical endpoints from the EMR. OCT macula scans were obtained by Heidelberg Spectralis, and each OCT scan was linked to EMR clinical endpoints extracted from EPIC. The central 11 images were selected from each OCT scan of two cohorts of patients: normal and AMD. Cross-validation was performed using a random subset of patients. Receiver operator curves (ROC) were constructed at an independent image level, macular OCT level, and patient level. Main outcome measure Area under the ROC. Results Of a recent extraction of 2.6 million OCT images linked to clinical datapoints from the EMR, 52,690 normal macular OCT images and 48,312 AMD macular OCT images were selected. A deep neural network was trained to categorize images as either normal or AMD. At the image level, we achieved an area under the ROC of 92.78% with an accuracy of 87.63%. At the macula level, we achieved an area under the ROC of 93.83% with an accuracy of 88.98%. At a patient level, we achieved an area under the ROC of 97.45% with an accuracy of 93.45%. Peak sensitivity and specificity with optimal cutoffs were 92.64% and 93.69% respectively. Conclusions Deep learning techniques achieve high accuracy and is effective as a new image classification technique. These findings have important implications in utilizing OCT in automated screening and the development of computer aided diagnosis tools in the future.
Collapse
Affiliation(s)
- Cecilia S Lee
- Department of Ophthalmology, University of Washington School of Medicine, Seattle WA
| | - Doug M Baughman
- Department of Ophthalmology, University of Washington School of Medicine, Seattle WA
| | - Aaron Y Lee
- Department of Ophthalmology, University of Washington School of Medicine, Seattle WA
| |
Collapse
|
128
|
Bharti P, Mittal D, Ananthasivan R. Computer-aided Characterization and Diagnosis of Diffuse Liver Diseases Based on Ultrasound Imaging: A Review. ULTRASONIC IMAGING 2017; 39:33-61. [PMID: 27097589 DOI: 10.1177/0161734616639875] [Citation(s) in RCA: 16] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/05/2023]
Abstract
Diffuse liver diseases, such as hepatitis, fatty liver, and cirrhosis, are becoming a leading cause of fatality and disability all over the world. Early detection and diagnosis of these diseases is extremely important to save lives and improve effectiveness of treatment. Ultrasound imaging, a noninvasive diagnostic technique, is the most commonly used modality for examining liver abnormalities. However, the accuracy of ultrasound-based diagnosis depends highly on expertise of radiologists. Computer-aided diagnosis systems based on ultrasound imaging assist in fast diagnosis, provide a reliable "second opinion" for experts, and act as an effective tool to measure response of treatment on patients undergoing clinical trials. In this review, we first describe appearance of liver abnormalities in ultrasound images and state the practical issues encountered in characterization of diffuse liver diseases that can be addressed by software algorithms. We then discuss computer-aided diagnosis in general with features and classifiers relevant to diffuse liver diseases. In later sections of this paper, we review the published studies and describe the key findings of those studies. A concise tabular summary comparing image database, features extraction, feature selection, and classification algorithms presented in the published studies is also exhibited. Finally, we conclude with a summary of key findings and directions for further improvements in the areas of accuracy and objectiveness of computer-aided diagnosis.
Collapse
Affiliation(s)
- Puja Bharti
- 1 Department of Electrical and Instrumentation Engineering, Thapar University, Patiala, India
| | - Deepti Mittal
- 1 Department of Electrical and Instrumentation Engineering, Thapar University, Patiala, India
| | | |
Collapse
|
129
|
Leggett CL, Wang KK. Computer-aided diagnosis in GI endoscopy: looking into the future. Gastrointest Endosc 2016; 84:842-844. [PMID: 27742045 DOI: 10.1016/j.gie.2016.07.045] [Citation(s) in RCA: 11] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 07/14/2016] [Accepted: 07/18/2016] [Indexed: 02/08/2023]
Affiliation(s)
- Cadman L Leggett
- Barrett's Esophagus Unit, Division of Gastroenterology and Hepatology, Mayo Clinic, Rochester, Minnesota, USA
| | - Kenneth K Wang
- Barrett's Esophagus Unit, Division of Gastroenterology and Hepatology, Mayo Clinic, Rochester, Minnesota, USA
| |
Collapse
|
130
|
Automatic Detection of Pectoral Muscle Region for Computer-Aided Diagnosis Using MIAS Mammograms. BIOMED RESEARCH INTERNATIONAL 2016; 2016:5967580. [PMID: 27847817 PMCID: PMC5099485 DOI: 10.1155/2016/5967580] [Citation(s) in RCA: 10] [Impact Index Per Article: 1.1] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 06/02/2016] [Revised: 08/17/2016] [Accepted: 09/27/2016] [Indexed: 11/18/2022]
Abstract
The computer-aided detection (CAD) systems have been developed to help radiologists with the early detection of breast cancer. This system provides objective and accurate information to reduce the misdiagnosis of the disease. In mammography, the pectoral muscle region is used as an index to compare the symmetry between the left and right images in the mediolateral oblique (MLO) view. The pectoral muscle segmentation is necessary for the detection of microcalcification or mass because the pectoral muscle has a similar pixel intensity as that of lesions, which affects the results of automatic detection. In this study, the mammographic image analysis society database (MIAS, 322 cases) was used for detecting the pectoral muscle segmentation. The pectoral muscle was detected by using the morphological method and the random sample consensus (RANSAC) algorithm. We evaluated the detected pectoral muscle region and compared the manual segmentation with the automatic segmentation. The results showed 92.2% accuracy. We expect that the proposed method improves the detection accuracy of breast cancer lesions using a CAD system.
Collapse
|
131
|
Cahan A, Cimino JJ. Improving precision medicine using individual patient data from trials. CMAJ 2016; 189:E204-E207. [PMID: 27573743 DOI: 10.1503/cmaj.160267] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/29/2022] Open
Affiliation(s)
- Amos Cahan
- IBM T.J. Watson Research Center (Cahan), Yorktown Heights, NY; National Library of Medicine (Cahan); National Institutes of Health Clinical Center (Cimino), Bethesda, Md.; Informatics Institute (Cimino), School of Medicine, University of Alabama at Birmingham, Birmingham, Ala.
| | - James J Cimino
- IBM T.J. Watson Research Center (Cahan), Yorktown Heights, NY; National Library of Medicine (Cahan); National Institutes of Health Clinical Center (Cimino), Bethesda, Md.; Informatics Institute (Cimino), School of Medicine, University of Alabama at Birmingham, Birmingham, Ala
| |
Collapse
|
132
|
Large scale deep learning for computer aided detection of mammographic lesions. Med Image Anal 2016; 35:303-312. [PMID: 27497072 DOI: 10.1016/j.media.2016.07.007] [Citation(s) in RCA: 451] [Impact Index Per Article: 50.1] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/11/2016] [Revised: 07/12/2016] [Accepted: 07/20/2016] [Indexed: 12/15/2022]
Abstract
Recent advances in machine learning yielded new techniques to train deep neural networks, which resulted in highly successful applications in many pattern recognition tasks such as object detection and speech recognition. In this paper we provide a head-to-head comparison between a state-of-the art in mammography CAD system, relying on a manually designed feature set and a Convolutional Neural Network (CNN), aiming for a system that can ultimately read mammograms independently. Both systems are trained on a large data set of around 45,000 images and results show the CNN outperforms the traditional CAD system at low sensitivity and performs comparable at high sensitivity. We subsequently investigate to what extent features such as location and patient information and commonly used manual features can still complement the network and see improvements at high specificity over the CNN especially with location and context features, which contain information not available to the CNN. Additionally, a reader study was performed, where the network was compared to certified screening radiologists on a patch level and we found no significant difference between the network and the readers.
Collapse
|
133
|
Setio AAA, Jacobs C, Gelderblom J, van Ginneken B. Automatic detection of large pulmonary solid nodules in thoracic CT images. Med Phys 2016; 42:5642-53. [PMID: 26429238 DOI: 10.1118/1.4929562] [Citation(s) in RCA: 63] [Impact Index Per Article: 7.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/21/2022] Open
Abstract
PURPOSE Current computer-aided detection (CAD) systems for pulmonary nodules in computed tomography (CT) scans have a good performance for relatively small nodules, but often fail to detect the much rarer larger nodules, which are more likely to be cancerous. We present a novel CAD system specifically designed to detect solid nodules larger than 10 mm. METHODS The proposed detection pipeline is initiated by a three-dimensional lung segmentation algorithm optimized to include large nodules attached to the pleural wall via morphological processing. An additional preprocessing is used to mask out structures outside the pleural space to ensure that pleural and parenchymal nodules have a similar appearance. Next, nodule candidates are obtained via a multistage process of thresholding and morphological operations, to detect both larger and smaller candidates. After segmenting each candidate, a set of 24 features based on intensity, shape, blobness, and spatial context are computed. A radial basis support vector machine (SVM) classifier was used to classify nodule candidates, and performance was evaluated using ten-fold cross-validation on the full publicly available lung image database consortium database. RESULTS The proposed CAD system reaches a sensitivity of 98.3% (234/238) and 94.1% (224/238) large nodules at an average of 4.0 and 1.0 false positives/scan, respectively. CONCLUSIONS The authors conclude that the proposed dedicated CAD system for large pulmonary nodules can identify the vast majority of highly suspicious lesions in thoracic CT scans with a small number of false positives.
Collapse
Affiliation(s)
- Arnaud A A Setio
- Diagnostic Image Analysis Group, Department of Radiology and Nuclear Medicine, Radboud University Medical Center, Nijmegen 6525 GA, The Netherlands
| | - Colin Jacobs
- Diagnostic Image Analysis Group, Department of Radiology and Nuclear Medicine, Radboud University Medical Center, Nijmegen 6525 GA, The Netherlands
| | - Jaap Gelderblom
- Diagnostic Image Analysis Group, Department of Radiology and Nuclear Medicine, Radboud University Medical Center, Nijmegen 6525 GA, The Netherlands
| | - Bram van Ginneken
- Diagnostic Image Analysis Group, Department of Radiology and Nuclear Medicine, Radboud University Medical Center, Nijmegen 6525 GA, The Netherlands and Fraunhofer MEVIS, Bremen 28359, Germany
| |
Collapse
|
134
|
Abstract
OBJECTIVE Automated analysis of abdominal CT has advanced markedly over just the last few years. Fully automated assessment of organs, lymph nodes, adipose tissue, muscle, bowel, spine, and tumors are some examples where tremendous progress has been made. Computer-aided detection of lesions has also improved dramatically. CONCLUSION This article reviews the progress and provides insights into what is in store in the near future for automated analysis for abdominal CT, ultimately leading to fully automated interpretation.
Collapse
|
135
|
Computer-Aided Diagnosis with Deep Learning Architecture: Applications to Breast Lesions in US Images and Pulmonary Nodules in CT Scans. Sci Rep 2016; 6:24454. [PMID: 27079888 PMCID: PMC4832199 DOI: 10.1038/srep24454] [Citation(s) in RCA: 306] [Impact Index Per Article: 34.0] [Reference Citation Analysis] [Abstract] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/19/2015] [Accepted: 03/30/2016] [Indexed: 01/02/2023] Open
Abstract
This paper performs a comprehensive study on the deep-learning-based computer-aided diagnosis (CADx) for the differential diagnosis of benign and malignant nodules/lesions by avoiding the potential errors caused by inaccurate image processing results (e.g., boundary segmentation), as well as the classification bias resulting from a less robust feature set, as involved in most conventional CADx algorithms. Specifically, the stacked denoising auto-encoder (SDAE) is exploited on the two CADx applications for the differentiation of breast ultrasound lesions and lung CT nodules. The SDAE architecture is well equipped with the automatic feature exploration mechanism and noise tolerance advantage, and hence may be suitable to deal with the intrinsically noisy property of medical image data from various imaging modalities. To show the outperformance of SDAE-based CADx over the conventional scheme, two latest conventional CADx algorithms are implemented for comparison. 10 times of 10-fold cross-validations are conducted to illustrate the efficacy of the SDAE-based CADx algorithm. The experimental results show the significant performance boost by the SDAE-based CADx algorithm over the two conventional methods, suggesting that deep learning techniques can potentially change the design paradigm of the CADx systems without the need of explicit design and selection of problem-oriented features.
Collapse
|
136
|
Sudarshan VK, Acharya UR, Ng EYK, Tan RS, Chou SM, Ghista DN. An integrated index for automated detection of infarcted myocardium from cross-sectional echocardiograms using texton-based features (Part 1). Comput Biol Med 2016; 71:231-40. [PMID: 26898671 DOI: 10.1016/j.compbiomed.2016.01.028] [Citation(s) in RCA: 13] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/04/2015] [Revised: 01/14/2016] [Accepted: 01/30/2016] [Indexed: 11/15/2022]
Abstract
Cross-sectional view echocardiography is an efficient non-invasive diagnostic tool for characterizing Myocardial Infarction (MI) and stages of expansion leading to heart failure. An automated computer-aided technique of cross-sectional echocardiography feature assessment can aid clinicians in early and more reliable detection of MI patients before subsequent catastrophic post-MI medical conditions. Therefore, this paper proposes a novel Myocardial Infarction Index (MII) to discriminate infarcted and normal myocardium using features extracted from apical cross-sectional views of echocardiograms. The cross-sectional view of normal and MI echocardiography images are represented as textons using Maximum Responses (MR8) filter banks. Fractal Dimension (FD), Higher-Order Statistics (HOS), Hu's moments, Gabor Transform features, Fuzzy Entropy (FEnt), Energy, Local binary Pattern (LBP), Renyi's Entropy (REnt), Shannon's Entropy (ShEnt), and Kapur's Entropy (KEnt) features are extracted from textons. These features are ranked using t-test and fuzzy Max-Relevancy and Min-Redundancy (mRMR) ranking methods. Then, combinations of highly ranked features are used in the formulation and development of an integrated MII. This calculated novel MII is used to accurately and quickly detect infarcted myocardium by using one numerical value. Also, the highly ranked features are subjected to classification using different classifiers for the characterization of normal and MI LV ultrasound images using a minimum number of features. Our current technique is able to characterize MI with an average accuracy of 94.37%, sensitivity of 91.25% and specificity of 97.50% with 8 apical four chambers view features extracted from only single frame per patient making this a more reliable and accurate classification.
Collapse
Affiliation(s)
- Vidya K Sudarshan
- School of Mechanical and Aerospace Engineering, Nanyang Technological University, Singapore; Department of Electronics and Computer Engineering, Ngee Ann Polytechnic, Singapore.
| | - U Rajendra Acharya
- Department of Electronics and Computer Engineering, Ngee Ann Polytechnic, Singapore; Department of Biomedical Engineering, Faculty of Engineering, University of Malaya, Malaysia
| | - E Y K Ng
- School of Mechanical and Aerospace Engineering, Nanyang Technological University, Singapore
| | - Ru San Tan
- Department of Cardiology, National Heart Centre, Singapore
| | - Siaw Meng Chou
- School of Mechanical and Aerospace Engineering, Nanyang Technological University, Singapore
| | | |
Collapse
|
137
|
Valente IRS, Cortez PC, Neto EC, Soares JM, de Albuquerque VHC, Tavares JMRS. Automatic 3D pulmonary nodule detection in CT images: A survey. COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE 2016; 124:91-107. [PMID: 26652979 DOI: 10.1016/j.cmpb.2015.10.006] [Citation(s) in RCA: 106] [Impact Index Per Article: 11.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/14/2015] [Revised: 09/01/2015] [Accepted: 10/03/2015] [Indexed: 06/05/2023]
Abstract
This work presents a systematic review of techniques for the 3D automatic detection of pulmonary nodules in computerized-tomography (CT) images. Its main goals are to analyze the latest technology being used for the development of computational diagnostic tools to assist in the acquisition, storage and, mainly, processing and analysis of the biomedical data. Also, this work identifies the progress made, so far, evaluates the challenges to be overcome and provides an analysis of future prospects. As far as the authors know, this is the first time that a review is devoted exclusively to automated 3D techniques for the detection of pulmonary nodules from lung CT images, which makes this work of noteworthy value. The research covered the published works in the Web of Science, PubMed, Science Direct and IEEEXplore up to December 2014. Each work found that referred to automated 3D segmentation of the lungs was individually analyzed to identify its objective, methodology and results. Based on the analysis of the selected works, several studies were seen to be useful for the construction of medical diagnostic aid tools. However, there are certain aspects that still require attention such as increasing algorithm sensitivity, reducing the number of false positives, improving and optimizing the algorithm detection of different kinds of nodules with different sizes and shapes and, finally, the ability to integrate with the Electronic Medical Record Systems and Picture Archiving and Communication Systems. Based on this analysis, we can say that further research is needed to develop current techniques and that new algorithms are needed to overcome the identified drawbacks.
Collapse
Affiliation(s)
- Igor Rafael S Valente
- Instituto Federal do Ceará, Campus Maracanaú, Av. Parque Central, S/N, Distrito Industrial I, 61939-140 Maracanaú, Ceará, Brazil; Universidade Federal do Ceará, Departamento de Engenharia de Teleinformática, Av. Mister Hull, S/N, Campus do Pici, 6005, 60455-760 Fortaleza, Ceará, Brazil
| | - Paulo César Cortez
- Universidade Federal do Ceará, Departamento de Engenharia de Teleinformática, Av. Mister Hull, S/N, Campus do Pici, 6005, 60455-760 Fortaleza, Ceará, Brazil
| | - Edson Cavalcanti Neto
- Universidade Federal do Ceará, Departamento de Engenharia de Teleinformática, Av. Mister Hull, S/N, Campus do Pici, 6005, 60455-760 Fortaleza, Ceará, Brazil
| | - José Marques Soares
- Universidade Federal do Ceará, Departamento de Engenharia de Teleinformática, Av. Mister Hull, S/N, Campus do Pici, 6005, 60455-760 Fortaleza, Ceará, Brazil
| | - Victor Hugo C de Albuquerque
- Programa de Pós-Graduacão em Informática Aplicada, Universidade de Fortaleza, Av. Washington Soares, 1321, Edson Queiroz, 60811341, CEP 608113-41 Fortaleza, Ceará, Brazil
| | - João Manuel R S Tavares
- Instituto de Ciência e Inovacão em Engenharia Mecânica e Engenharia Industrial, Departamento de Engenharia Mecânica, Faculdade de Engenharia, Universidade do Porto, Rua Dr. Roberto Frias, S/N, 4200-465 Porto, Portugal.
| |
Collapse
|
138
|
Hua KL, Hsu CH, Hidayati SC, Cheng WH, Chen YJ. Computer-aided classification of lung nodules on computed tomography images via deep learning technique. Onco Targets Ther 2015; 8:2015-22. [PMID: 26346558 PMCID: PMC4531007 DOI: 10.2147/ott.s80733] [Citation(s) in RCA: 123] [Impact Index Per Article: 12.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/24/2022] Open
Abstract
Lung cancer has a poor prognosis when not diagnosed early and unresectable lesions are present. The management of small lung nodules noted on computed tomography scan is controversial due to uncertain tumor characteristics. A conventional computer-aided diagnosis (CAD) scheme requires several image processing and pattern recognition steps to accomplish a quantitative tumor differentiation result. In such an ad hoc image analysis pipeline, every step depends heavily on the performance of the previous step. Accordingly, tuning of classification performance in a conventional CAD scheme is very complicated and arduous. Deep learning techniques, on the other hand, have the intrinsic advantage of an automatic exploitation feature and tuning of performance in a seamless fashion. In this study, we attempted to simplify the image analysis pipeline of conventional CAD with deep learning techniques. Specifically, we introduced models of a deep belief network and a convolutional neural network in the context of nodule classification in computed tomography images. Two baseline methods with feature computing steps were implemented for comparison. The experimental results suggest that deep learning methods could achieve better discriminative results and hold promise in the CAD application domain.
Collapse
Affiliation(s)
- Kai-Lung Hua
- Department of Computer Science and Information Engineering, National Taiwan University of Science and Technology, Taipei, Taiwan
| | - Che-Hao Hsu
- Department of Computer Science and Information Engineering, National Taiwan University of Science and Technology, Taipei, Taiwan
| | - Shintami Chusnul Hidayati
- Department of Computer Science and Information Engineering, National Taiwan University of Science and Technology, Taipei, Taiwan
| | - Wen-Huang Cheng
- Research Center for Information Technology Innovation, Academia Sinica, Taipei, Taiwan
| | - Yu-Jen Chen
- Department of Radiation Oncology, MacKay Memorial Hospital, Taipei, Taiwan
| |
Collapse
|
139
|
Computer-aided diagnosis of Myocardial Infarction using ultrasound images with DWT, GLCM and HOS methods: A comparative study. Comput Biol Med 2015; 62:86-93. [DOI: 10.1016/j.compbiomed.2015.03.033] [Citation(s) in RCA: 52] [Impact Index Per Article: 5.2] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/27/2014] [Revised: 03/19/2015] [Accepted: 03/31/2015] [Indexed: 11/23/2022]
|
140
|
Statistical shape model reconstruction with sparse anomalous deformations: Application to intervertebral disc herniation. Comput Med Imaging Graph 2015; 46 Pt 1:11-19. [PMID: 26060085 DOI: 10.1016/j.compmedimag.2015.05.002] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/19/2015] [Revised: 04/15/2015] [Accepted: 05/04/2015] [Indexed: 11/23/2022]
Abstract
Many medical image processing techniques rely on accurate shape modeling of anatomical features. The presence of shape abnormalities challenges traditional processing algorithms based on strong morphological priors. In this work, a sparse shape reconstruction from a statistical shape model is presented. It combines the advantages of traditional statistical shape models (defining a 'normal' shape space) and previously presented sparse shape composition (providing localized descriptors of anomalies). The algorithm was incorporated into our image segmentation and classification software. Evaluation was performed on simulated and clinical MRI data from 22 sciatica patients with intervertebral disc herniation, containing 35 herniated and 97 normal discs. Moderate to high correlation (R=0.73) was achieved between simulated and detected herniations. The sparse reconstruction provided novel quantitative features describing the herniation morphology and MRI signal appearance in three dimensions (3D). The proposed descriptors of local disc morphology resulted to the 3D segmentation accuracy of 1.07±1.00mm (mean absolute vertex-to-vertex mesh distance over the posterior disc region), and improved the intervertebral disc classification from 0.888 to 0.931 (area under receiver operating curve). The results show that the sparse shape reconstruction may improve computer-aided diagnosis of pathological conditions presenting local morphological alterations, as seen in intervertebral disc herniation.
Collapse
|
141
|
Automated system for lung nodules classification based on wavelet feature descriptor and support vector machine. Biomed Eng Online 2015; 14:9. [PMID: 25888834 PMCID: PMC4329222 DOI: 10.1186/s12938-015-0003-y] [Citation(s) in RCA: 58] [Impact Index Per Article: 5.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/09/2014] [Accepted: 01/23/2015] [Indexed: 11/10/2022] Open
Abstract
Background Lung cancer is a leading cause of death worldwide; it refers to the uncontrolled growth of abnormal cells in the lung. A computed tomography (CT) scan of the thorax is the most sensitive method for detecting cancerous lung nodules. A lung nodule is a round lesion which can be either non-cancerous or cancerous. In the CT, the lung cancer is observed as round white shadow nodules. The possibility to obtain a manually accurate interpretation from CT scans demands a big effort by the radiologist and might be a fatiguing process. Therefore, the design of a computer-aided diagnosis (CADx) system would be helpful as a second opinion tool. Methods The stages of the proposed CADx are: a supervised extraction of the region of interest to eliminate the shape differences among CT images. The Daubechies db1, db2, and db4 wavelet transforms are computed with one and two levels of decomposition. After that, 19 features are computed from each wavelet sub-band. Then, the sub-band and attribute selection is performed. As a result, 11 features are selected and combined in pairs as inputs to the support vector machine (SVM), which is used to distinguish CT images containing cancerous nodules from those not containing nodules. Results The clinical data set used for experiments consists of 45 CT scans from ELCAP and LIDC. For the training stage 61 CT images were used (36 with cancerous lung nodules and 25 without lung nodules). The system performance was tested with 45 CT scans (23 CT scans with lung nodules and 22 without nodules), different from that used for training. The results obtained show that the methodology successfully classifies cancerous nodules with a diameter from 2 mm to 30 mm. The total preciseness obtained was 82%; the sensitivity was 90.90%, whereas the specificity was 73.91%. Conclusions The CADx system presented is competitive with other literature systems in terms of sensitivity. The system reduces the complexity of classification by not performing the typical segmentation stage of most CADx systems. Additionally, the novelty of the algorithm is the use of a wavelet feature descriptor.
Collapse
|
142
|
Abstract
CLINICAL/METHODICAL ISSUE Lung cancer is the most frequent cause of tumor-associated death and only has a good prognosis if detected at a very early tumor stage. METHODICAL INNOVATIONS For the first time the American National Lung Screening Trial (NLST) could prove that low-dose computed tomography (CT) screening is able to reduce lung cancer mortality by 20 %. PERFORMANCE To date, however, three much smaller and therefore statistically underpowered European trials could not confirm the positive results of the NLST. The results of the largest European trial NELSON are expected within the next 2 years. In addition, there are a number of open or not yet satisfactorily answered questions, such as the definition of the appropriate screening population, the management of nodules detected by screening, the effects of over-diagnosis and the risk of cumulative radiation exposure. PRACTICAL RECOMMENDATIONS The success of the NLST prompted several predominantly American professional societies to issue a positive recommendation about the implementation of lung cancer screening in a population at risk. However, potentially conflicting results of European studies and a number of not yet optimized issues justify caution and call for a pooled analysis of European studies in order to provide statistically sound results and to ensure a high efficiency of screening with respect to the radiation applied, mental and physical patient burden and, last but not least, the financial efforts.
Collapse
|
143
|
Breuninger M, van Ginneken B, Philipsen RHHM, Mhimbira F, Hella JJ, Lwilla F, van den Hombergh J, Ross A, Jugheli L, Wagner D, Reither K. Diagnostic accuracy of computer-aided detection of pulmonary tuberculosis in chest radiographs: a validation study from sub-Saharan Africa. PLoS One 2014; 9:e106381. [PMID: 25192172 PMCID: PMC4156349 DOI: 10.1371/journal.pone.0106381] [Citation(s) in RCA: 56] [Impact Index Per Article: 5.1] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/19/2014] [Accepted: 08/06/2014] [Indexed: 11/21/2022] Open
Abstract
Background Chest radiography to diagnose and screen for pulmonary tuberculosis has limitations, especially due to inter-reader variability. Automating the interpretation has the potential to overcome this drawback and to deliver objective and reproducible results. The CAD4TB software is a computer-aided detection system that has shown promising preliminary findings. Evaluation studies in different settings are needed to assess diagnostic accuracy and practicability of use. Methods CAD4TB was evaluated on chest radiographs of patients with symptoms suggestive of pulmonary tuberculosis enrolled in two cohort studies in Tanzania. All patients were characterized by sputum smear microscopy and culture including subsequent antigen or molecular confirmation of Mycobacterium tuberculosis (M.tb) to determine the reference standard. Chest radiographs were read by the software and two human readers, one expert reader and one clinical officer. The sensitivity and specificity of CAD4TB was depicted using receiver operating characteristic (ROC) curves, the area under the curve calculated and the performance of the software compared to the results of human readers. Results Of 861 study participants, 194 (23%) were culture-positive for M.tb. The area under the ROC curve of CAD4TB for the detection of culture-positive pulmonary tuberculosis was 0.84 (95% CI 0.80–0.88). CAD4TB was significantly more accurate for the discrimination of smear-positive cases against non TB patients than for smear-negative cases (p-value<0.01). It differentiated better between TB cases and non TB patients among HIV-negative compared to HIV-positive individuals (p<0.01). CAD4TB significantly outperformed the clinical officer, but did not reach the accuracy of the expert reader (p = 0.02), for a tuberculosis specific reading threshold. Conclusion CAD4TB accurately distinguished between the chest radiographs of culture-positive TB cases and controls. Further studies on cost-effectiveness, operational and ethical aspects should determine its place in diagnostic and screening algorithms.
Collapse
Affiliation(s)
- Marianne Breuninger
- Swiss Tropical and Public Health Institute, Basel, Switzerland
- Ifakara Health Institute, Bagamoyo, United Republic of Tanzania
- Center for Infectious Diseases and Travel Medicine, University Hospital Freiburg, Freiburg, Germany
- * E-mail:
| | - Bram van Ginneken
- Diagnostic Image Analysis Group, Radboud University Medical Center, Nijmegen, The Netherlands
| | - Rick H. H. M. Philipsen
- Diagnostic Image Analysis Group, Radboud University Medical Center, Nijmegen, The Netherlands
| | | | - Jerry J. Hella
- Ifakara Health Institute, Bagamoyo, United Republic of Tanzania
| | - Fred Lwilla
- Ifakara Health Institute, Bagamoyo, United Republic of Tanzania
| | | | - Amanda Ross
- Swiss Tropical and Public Health Institute, Basel, Switzerland
- University of Basel, Basel, Switzerland
| | - Levan Jugheli
- Swiss Tropical and Public Health Institute, Basel, Switzerland
- Ifakara Health Institute, Bagamoyo, United Republic of Tanzania
- University of Basel, Basel, Switzerland
| | - Dirk Wagner
- Center for Infectious Diseases and Travel Medicine, University Hospital Freiburg, Freiburg, Germany
| | - Klaus Reither
- Swiss Tropical and Public Health Institute, Basel, Switzerland
- Ifakara Health Institute, Bagamoyo, United Republic of Tanzania
- University of Basel, Basel, Switzerland
| |
Collapse
|
144
|
Depeursinge A, Kurtz C, Beaulieu CF, Napel S, Rubin DL. Predicting visual semantic descriptive terms from radiological image data: preliminary results with liver lesions in CT. IEEE TRANSACTIONS ON MEDICAL IMAGING 2014; 33:1669-76. [PMID: 24808406 PMCID: PMC4129229 DOI: 10.1109/tmi.2014.2321347] [Citation(s) in RCA: 25] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/03/2023]
Abstract
We describe a framework to model visual semantics of liver lesions in CT images in order to predict the visual semantic terms (VST) reported by radiologists in describing these lesions. Computational models of VST are learned from image data using linear combinations of high-order steerable Riesz wavelets and support vector machines (SVM). In a first step, these models are used to predict the presence of each semantic term that describes liver lesions. In a second step, the distances between all VST models are calculated to establish a nonhierarchical computationally-derived ontology of VST containing inter-term synonymy and complementarity. A preliminary evaluation of the proposed framework was carried out using 74 liver lesions annotated with a set of 18 VSTs from the RadLex ontology. A leave-one-patient-out cross-validation resulted in an average area under the ROC curve of 0.853 for predicting the presence of each VST. The proposed framework is expected to foster human-computer synergies for the interpretation of radiological images while using rotation-covariant computational models of VSTs to 1) quantify their local likelihood and 2) explicitly link them with pixel-based image content in the context of a given imaging domain.
Collapse
Affiliation(s)
- Adrien Depeursinge
- Department of Radiology of the School of Medicine, Stanford University, CA, USA
| | - Camille Kurtz
- Department of Radiology of the School of Medicine, Stanford University, CA, USA
- C. Kurtz is also with the LIPADE (EA2517), University Paris Descartes, France
| | | | - Sandy Napel
- Department of Radiology of the School of Medicine, Stanford University, CA, USA
| | - Daniel L. Rubin
- Department of Radiology of the School of Medicine, Stanford University, CA, USA
| |
Collapse
|
145
|
Toward clinically usable CAD for lung cancer screening with computed tomography. Eur Radiol 2014; 24:2719-28. [DOI: 10.1007/s00330-014-3329-0] [Citation(s) in RCA: 33] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/14/2014] [Revised: 04/22/2014] [Accepted: 07/08/2014] [Indexed: 10/25/2022]
|
146
|
Dankerl P, Cavallaro A, Dietzel M, Tsymbal A, Kramer M, Seifert S, Uder M, Hammon M. Clinical evaluation of semi-automatic landmark-based lesion tracking software for CT-scans. Cancer Imaging 2014; 14:6. [PMID: 25609496 PMCID: PMC4212533 DOI: 10.1186/1470-7330-14-6] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/01/2013] [Accepted: 01/09/2014] [Indexed: 11/10/2022] Open
Abstract
Background To evaluate a semi-automatic landmark-based lesion tracking software enabling navigation between RECIST lesions in baseline and follow-up CT-scans. Methods The software automatically detects 44 stable anatomical landmarks in each thoraco/abdominal/pelvic CT-scan, sets up a patient specific coordinate-system and cross-links the coordinate-systems of consecutive CT-scans. Accuracy of the software was evaluated on 96 RECIST lesions (target- and non-target lesions) in baseline and follow-up CT-scans of 32 oncologic patients (64 CT-scans). Patients had to present at least one thoracic, one abdominal and one pelvic RECIST lesion. Three radiologists determined the deviation between lesions’ centre and the software’s navigation result in consensus. Results The initial mean runtime of the system to synchronize baseline and follow-up examinations was 19.4 ± 1.2 seconds, with subsequent navigation to corresponding RECIST lesions facilitating in real-time. Mean vector length of the deviations between lesions’ centre and the semi-automatic navigation result was 10.2 ± 5.1 mm without a substantial systematic error in any direction. Mean deviation in the cranio-caudal dimension was 5.4 ± 4.0 mm, in the lateral dimension 5.2 ± 3.9 mm and in the ventro-dorsal dimension 5.3 ± 4.0 mm. Conclusion The investigated software accurately and reliably navigates between lesions in consecutive CT-scans in real-time, potentially accelerating and facilitating cancer staging.
Collapse
|
147
|
Firmino M, Morais AH, Mendoça RM, Dantas MR, Hekis HR, Valentim R. Computer-aided detection system for lung cancer in computed tomography scans: review and future prospects. Biomed Eng Online 2014; 13:41. [PMID: 24713067 PMCID: PMC3995505 DOI: 10.1186/1475-925x-13-41] [Citation(s) in RCA: 92] [Impact Index Per Article: 8.4] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/10/2014] [Accepted: 03/28/2014] [Indexed: 12/25/2022] Open
Abstract
Introduction The goal of this paper is to present a critical review of major Computer-Aided Detection systems (CADe) for lung cancer in order to identify challenges for future research. CADe systems must meet the following requirements: improve the performance of radiologists providing high sensitivity in the diagnosis, a low number of false positives (FP), have high processing speed, present high level of automation, low cost (of implementation, training, support and maintenance), the ability to detect different types and shapes of nodules, and software security assurance. Methods The relevant literature related to “CADe for lung cancer” was obtained from PubMed, IEEEXplore and Science Direct database. Articles published from 2009 to 2013, and some articles previously published, were used. A systemic analysis was made on these articles and the results were summarized. Discussion Based on literature search, it was observed that many if not all systems described in this survey have the potential to be important in clinical practice. However, no significant improvement was observed in sensitivity, number of false positives, level of automation and ability to detect different types and shapes of nodules in the studied period. Challenges were presented for future research. Conclusions Further research is needed to improve existing systems and propose new solutions. For this, we believe that collaborative efforts through the creation of open source software communities are necessary to develop a CADe system with all the requirements mentioned and with a short development cycle. In addition, future CADe systems should improve the level of automation, through integration with picture archiving and communication systems (PACS) and the electronic record of the patient, decrease the number of false positives, measure the evolution of tumors, evaluate the evolution of the oncological treatment, and its possible prognosis.
Collapse
Affiliation(s)
- Macedo Firmino
- Department of Information and Computer Science, Federal Institute of Rio Grande do Norte (IFRN), Natal, Brazil.
| | | | | | | | | | | |
Collapse
|
148
|
Abstract
Mammography is the central diagnostic method for clinical diagnostics of breast cancer and the breast cancer screening program. In the clinical routine complementary methods, such as ultrasound, tomosynthesis and optional magnetic resonance imaging (MRI) are already combined for the diagnostic procedure. Future developments will utilize investigative procedures either as a hybrid (combination of several different imaging modalities in one instrument) or as a fusion method (the technical fusion of two or more of these methods) to implement fusion imaging into diagnostic algorithms. For screening there are reasonable hypotheses to aim for studies that individualize the diagnostic process within the screening procedure. Individual breast cancer risk prediction and individualized knowledge about sensitivity and specificity for certain diagnostic methods could be tested. The clinical implementation of these algorithms is not yet in sight.
Collapse
|
149
|
Dankerl P, Cavallaro A, Tsymbal A, Costa MJ, Suehling M, Janka R, Uder M, Hammon M. A retrieval-based computer-aided diagnosis system for the characterization of liver lesions in CT scans. Acad Radiol 2013; 20:1526-34. [PMID: 24200479 DOI: 10.1016/j.acra.2013.09.001] [Citation(s) in RCA: 20] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/17/2013] [Revised: 08/30/2013] [Accepted: 09/01/2013] [Indexed: 11/26/2022]
Abstract
RATIONALE AND OBJECTIVES To evaluate a computer-aided diagnosis (CADx) system for the characterization of liver lesions in computed tomography (CT) scans. The stand-alone predictive performance of the CADx system was assessed and compared to that of three radiologists who were provided with the same amount of image information to which the CADx system had access. MATERIALS AND METHODS The CADx system operates as an image search engine exploiting texture analysis of liver lesion image data for the lesion in question and lesions from a database. A region of interest drawn around an indeterminate liver lesion is used as input query. The CADx system retrieves lesions of similar histology (benign/malignant), density (hypodense/hyperdense), or type (cyst/hemangioma/metastasis). The system's performance was evaluated with leave-one-patient-out receiver operating characteristic area under the curve on 685 CT scans from 372 patients that contained 2325 liver lesions (193 <1 cm(3)). Sensitivity, specificity, and positive and negative predictive values were evaluated separately for subcentimeter lesions. Results were compared to those of three radiologists who rated 83 liver lesions (20 hemangiomas, 20 metastases, 20 cysts, 20 hepatocellular carcinomas, and 3 focal nodular hyperplasias) displaying only the liver. RESULTS The CADx system's leave-one-patient-out receiver operating characteristic area under the curve was 97.1% for density, 91.4% for histology, and 95.5% for lesion type. For subcentimeter lesions, input of additional semantic information improved the system's performance. The CADx system has been proved to significantly outperform radiologists in discriminating lesion histology and type, provided the radiologists have no access to information other than the image. The radiologists were most reliable in diagnosing hemangioma given the limited image data. CONCLUSIONS The CADx system under study discriminated reliably between various liver lesions, even outperforming radiologists when accessing the same image information and demonstrated promising performance in classifying subcentimeter lesions in particular.
Collapse
|
150
|
Abstract
Bone age determination from hand radiographs is one of the oldest radiographic procedures. The first atlas was published by Poland in 1898, and to date the Greulich Pyle atlas, although it dates from 1959, is still the most commonly used method. Bone age rating is time-consuming, suffers from an unsatisfactorily high rater variability, and therefore already 25 years ago it was proposed to replace the manual rating by an automated, computerized method, a field nowadays referred to as computer-aided diagnosis (CAD). The pursuit of this goal reached a first stage of accomplishment in 1992-1996 with the presentation of several systems. However, they had limited clinical value, and efforts in CAD research were increasingly focused on lesion detection for cancer screening. It was only in 2008 that a fully-automated bone age method was presented, which appears to be clinically acceptable. In this paper we consider the requirements that should be met by an automated bone age method and review the state of the art. Integration in PACS and saving time are important factors for radiologists. But it is the validation of the methods which poses the greatest challenge, because there is no gold standard for bone age rating, and the direct comparison to manual rating is therefore not sufficient for demonstrating that manual rating can be replaced by automated rating. One needs additional studies assessing the precision of a method and its accuracy when used for adult height prediction, which serves as an objective.
Collapse
Affiliation(s)
- RR van Rijn
- Department of Radiology, Academic Medical
Centre/Emma Children's Hospital Amsterdam, the Netherlands
| | | |
Collapse
|