1
|
Gao Y, Lin J, Zhou Y, Lin R. The application of traditional machine learning and deep learning techniques in mammography: a review. Front Oncol 2023; 13:1213045. [PMID: 37637035 PMCID: PMC10453798 DOI: 10.3389/fonc.2023.1213045] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/28/2023] [Accepted: 07/25/2023] [Indexed: 08/29/2023] Open
Abstract
Breast cancer, the most prevalent malignant tumor among women, poses a significant threat to patients' physical and mental well-being. Recent advances in early screening technology have facilitated the early detection of an increasing number of breast cancers, resulting in a substantial improvement in patients' overall survival rates. The primary techniques used for early breast cancer diagnosis include mammography, breast ultrasound, breast MRI, and pathological examination. However, the clinical interpretation and analysis of the images produced by these technologies often involve significant labor costs and rely heavily on the expertise of clinicians, leading to inherent deviations. Consequently, artificial intelligence(AI) has emerged as a valuable technology in breast cancer diagnosis. Artificial intelligence includes Machine Learning(ML) and Deep Learning(DL). By simulating human behavior to learn from and process data, ML and DL aid in lesion localization reduce misdiagnosis rates, and improve accuracy. This narrative review provides a comprehensive review of the current research status of mammography using traditional ML and DL algorithms. It particularly highlights the latest advancements in DL methods for mammogram image analysis and offers insights into future development directions.
Collapse
Affiliation(s)
- Ying’e Gao
- School of Nursing Fujian Medical University, Fuzhou, China
| | - Jingjing Lin
- School of Nursing Fujian Medical University, Fuzhou, China
| | - Yuzhuo Zhou
- Department of Surgery, Hannover Medical School, Hannover, Germany
| | - Rongjin Lin
- School of Nursing Fujian Medical University, Fuzhou, China
- Department of Nursing, the First Affiliated Hospital of Fujian Medical University, Fuzhou, China
| |
Collapse
|
2
|
Koley S, Dutta PK, Aganj I. Radius-optimized efficient template matching for lesion detection from brain images. Sci Rep 2021; 11:11586. [PMID: 34078935 PMCID: PMC8172536 DOI: 10.1038/s41598-021-90147-0] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/08/2020] [Accepted: 05/07/2021] [Indexed: 11/09/2022] Open
Abstract
Computer-aided detection of brain lesions from volumetric magnetic resonance imaging (MRI) is in demand for fast and automatic diagnosis of neural diseases. The template-matching technique can provide satisfactory outcome for automatic localization of brain lesions; however, finding the optimal template size that maximizes similarity of the template and the lesion remains challenging. This increases the complexity of the algorithm and the requirement for computational resources, while processing large MRI volumes with three-dimensional (3D) templates. Hence, reducing the computational complexity of template matching is needed. In this paper, we first propose a mathematical framework for computing the normalized cross-correlation coefficient (NCCC) as the similarity measure between the MRI volume and approximated 3D Gaussian template with linear time complexity, [Formula: see text], as opposed to the conventional fast Fourier transform (FFT) based approach with the complexity [Formula: see text], where [Formula: see text] is the number of voxels in the image and [Formula: see text] is the number of tried template radii. We then propose a mathematical formulation to analytically estimate the optimal template radius for each voxel in the image and compute the NCCC with the location-dependent optimal radius, reducing the complexity to [Formula: see text]. We test our methods on one synthetic and two real multiple-sclerosis databases, and compare their performances in lesion detection with FFT and a state-of-the-art lesion prediction algorithm. We demonstrate through our experiments the efficiency of the proposed methods for brain lesion detection and their comparable performance with existing techniques.
Collapse
Affiliation(s)
- Subhranil Koley
- School of Medical Science and Technology, Indian Institute of Technology Kharagpur, Kharagpur, WB, 721302, India.
| | - Pranab K Dutta
- Electrical Engineering Department, Indian Institute of Technology Kharagpur, Kharagpur, WB, 721302, India
| | - Iman Aganj
- Athinoula A. Martinos Center for Biomedical Imaging, Radiology Department, Massachusetts General Hospital, Harvard Medical School, 149 13th St., Suite 2301, Charlestown, MA, 02129, USA.,Computer Science and Artificial Intelligence Laboratory, Massachusetts Institute of Technology, 32 Vassar St., Cambridge, MA, 02139, USA
| |
Collapse
|
3
|
Breast Mass Detection in Mammography Based on Image Template Matching and CNN. SENSORS 2021; 21:s21082855. [PMID: 33919623 PMCID: PMC8072908 DOI: 10.3390/s21082855] [Citation(s) in RCA: 9] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 03/26/2021] [Revised: 04/12/2021] [Accepted: 04/15/2021] [Indexed: 02/02/2023]
Abstract
In recent years, computer vision technology has been widely used in the field of medical image processing. However, there is still a big gap between the existing breast mass detection methods and the real-world application due to the limited detection accuracy. It is known that humans locate the regions of interest quickly and further identify whether these regions are the targets we found. In breast cancer diagnosis, we locate all the potential regions of breast mass by glancing at the mammographic image from top to bottom and from left to right, then further identify whether these regions are a breast mass. Inspired by the process of human detection of breast mass, we proposed a novel breast mass detection method to detect breast mass on a mammographic image by stimulating the process of human detection. The proposed method preprocesses the mammographic image via the mathematical morphology method and locates the suspected regions of breast mass by the image template matching method. Then, it obtains the regions of breast mass by classifying these suspected regions into breast mass and background categories using a convolutional neural network (CNN). The bounding box of breast mass obtained by the mathematical morphology method and image template matching method are roughly due to the mathematical morphology method, which transforms all of the brighter regions into approximate circular areas. For regression of a breast mass bounding box, the optimal solution should be searched in the feasible region and the Particle Swarm Optimization (PSO) is suitable for solving the problem of searching the optimal solution within a certain range. Therefore, we refine the bounding box of breast mass by the PSO algorithm. The proposed breast mass detection method and the compared detection methods were evaluated on the open database Digital Database for Screening Mammography (DDSM). The experimental results demonstrate that the proposed method is superior to all of the compared detection methods in detection performance.
Collapse
|
4
|
Sapate S, Talbar S, Mahajan A, Sable N, Desai S, Thakur M. Breast cancer diagnosis using abnormalities on ipsilateral views of digital mammograms. Biocybern Biomed Eng 2020. [DOI: 10.1016/j.bbe.2019.04.008] [Citation(s) in RCA: 15] [Impact Index Per Article: 3.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/08/2023]
|
5
|
Gardezi SJS, Elazab A, Lei B, Wang T. Breast Cancer Detection and Diagnosis Using Mammographic Data: Systematic Review. J Med Internet Res 2019; 21:e14464. [PMID: 31350843 PMCID: PMC6688437 DOI: 10.2196/14464] [Citation(s) in RCA: 61] [Impact Index Per Article: 12.2] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/23/2019] [Revised: 06/11/2019] [Accepted: 06/12/2019] [Indexed: 12/19/2022] Open
Abstract
BACKGROUND Machine learning (ML) has become a vital part of medical imaging research. ML methods have evolved over the years from manual seeded inputs to automatic initializations. The advancements in the field of ML have led to more intelligent and self-reliant computer-aided diagnosis (CAD) systems, as the learning ability of ML methods has been constantly improving. More and more automated methods are emerging with deep feature learning and representations. Recent advancements of ML with deeper and extensive representation approaches, commonly known as deep learning (DL) approaches, have made a very significant impact on improving the diagnostics capabilities of the CAD systems. OBJECTIVE This review aimed to survey both traditional ML and DL literature with particular application for breast cancer diagnosis. The review also provided a brief insight into some well-known DL networks. METHODS In this paper, we present an overview of ML and DL techniques with particular application for breast cancer. Specifically, we search the PubMed, Google Scholar, MEDLINE, ScienceDirect, Springer, and Web of Science databases and retrieve the studies in DL for the past 5 years that have used multiview mammogram datasets. RESULTS The analysis of traditional ML reveals the limited usage of the methods, whereas the DL methods have great potential for implementation in clinical analysis and improve the diagnostic capability of existing CAD systems. CONCLUSIONS From the literature, it can be found that heterogeneous breast densities make masses more challenging to detect and classify compared with calcifications. The traditional ML methods present confined approaches limited to either particular density type or datasets. Although the DL methods show promising improvements in breast cancer diagnosis, there are still issues of data scarcity and computational cost, which have been overcome to a significant extent by applying data augmentation and improved computational power of DL algorithms.
Collapse
Affiliation(s)
- Syed Jamal Safdar Gardezi
- National-Regional Key Technology Engineering Laboratory for Medical Ultrasound, Guangdong, Key Laboratory for Biomedical Measurements and Ultrasound Imaging, School of Biomedical Engineering, Health Science Center, Shenzhen University, Shenzhen, China
| | - Ahmed Elazab
- National-Regional Key Technology Engineering Laboratory for Medical Ultrasound, Guangdong, Key Laboratory for Biomedical Measurements and Ultrasound Imaging, School of Biomedical Engineering, Health Science Center, Shenzhen University, Shenzhen, China
| | - Baiying Lei
- National-Regional Key Technology Engineering Laboratory for Medical Ultrasound, Guangdong, Key Laboratory for Biomedical Measurements and Ultrasound Imaging, School of Biomedical Engineering, Health Science Center, Shenzhen University, Shenzhen, China
| | - Tianfu Wang
- National-Regional Key Technology Engineering Laboratory for Medical Ultrasound, Guangdong, Key Laboratory for Biomedical Measurements and Ultrasound Imaging, School of Biomedical Engineering, Health Science Center, Shenzhen University, Shenzhen, China
| |
Collapse
|
6
|
Kelder A, Lederman D, Zheng B, Zigel Y. A new computer-aided detection approach based on analysis of local and global mammographic feature asymmetry. Med Phys 2018; 45:1459-1470. [DOI: 10.1002/mp.12806] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/05/2017] [Revised: 01/10/2018] [Accepted: 01/11/2018] [Indexed: 01/02/2023] Open
Affiliation(s)
- Adam Kelder
- Department of Biomedical Engineering; Ben-Gurion University of the Negev; Beer-Sheva Israel
| | - Dror Lederman
- Department of Biomedical Engineering; Ben-Gurion University of the Negev; Beer-Sheva Israel
- Department of Electrical Engineering; Holon Institute of Technology; Holon Israel
| | - Bin Zheng
- School of Electrical and Computer Engineering; University of Oklahoma; Norman OK USA
| | - Yaniv Zigel
- Department of Biomedical Engineering; Ben-Gurion University of the Negev; Beer-Sheva Israel
| |
Collapse
|
7
|
Lin LH, Chen TJ. Mutual Information Correlation with Human Vision in Medical Image Compression. Curr Med Imaging 2018; 14:64-70. [PMID: 29399011 PMCID: PMC5759175 DOI: 10.2174/1573405613666171003151036] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/04/2017] [Revised: 09/25/2017] [Accepted: 09/28/2017] [Indexed: 11/23/2022]
Abstract
BACKGROUND The lossy compression algorithm produces different results in various con-trasts areas. Low contrast area image quality declines greater than that of high contrast regions using equal compression ratio. These results were obtained in a subjective study. The objective image quali-ty metrics are more effective if the calculation method is more closely related to the human vision re-sults. METHODS This study first measured the PSNR and MI for discrimination between different contrast areas responding to lossy image compression in a SMPTE electronic pattern. The MI was consistent with human vision results in SMPTE electronic phantom but PSNR was not. The measurement was also applied to compressed medical images in different contrast cropping regions. RESULTS The MI was found to be close to human vision in CT and MR but not CRX. Both weighted PSNR and weighted MI were created to respond to the gray value and the contrast areas affected the quality estimation. CONCLUSION The W-PSNR and W-MI showed that they can discriminate between different contrast areas using image compression ratios and the series of lines are equal to the contrast values and better than the tranditional approach. The W-MI measures were found to perform better than W-PSNR and can be used as an image quality index.
Collapse
Affiliation(s)
- Li-Hui Lin
- Department of Mathematics & Computer Science, Wuyi University, Wuyishan, Fujian354300, China
- The Key Laboratory of Cognitive Computing and Intelligent Information Processing of Fujian Education Institutions, Wuyishan, Fujian354300, China
| | - Tzong-Jer Chen
- School of
Information Engineering, Baise University, Baise, Guangxi 533000, China
| |
Collapse
|
8
|
Malignant and Benign Mass Segmentation in Mammograms Using Active Contour Methods. Symmetry (Basel) 2017. [DOI: 10.3390/sym9110277] [Citation(s) in RCA: 16] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/16/2022] Open
|
9
|
Pöhlmann STL, Lim YY, Harkness E, Pritchard S, Taylor CJ, Astley SM. Three-dimensional segmentation of breast masses from digital breast tomosynthesis images. J Med Imaging (Bellingham) 2017; 4:034007. [PMID: 28948195 DOI: 10.1117/1.jmi.4.3.034007] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/31/2017] [Accepted: 08/16/2017] [Indexed: 11/14/2022] Open
Abstract
Assessment of three-dimensional (3-D) morphology and volume of breast masses is important for cancer diagnosis, staging, and treatment but cannot be derived from conventional mammography. Digital breast tomosynthesis (DBT) provides data from which 3-D mass segmentation could be obtained. Our method combined Gaussian mixture models based on intensity and a texture measure indicative of in-focus structure, gray-level variance. Thresholding these voxel probabilities, weighted by distance to the estimated mass center, gave the final 3-D segmentation. Evaluation used 40 masses annotated twice by a consultant radiologist on in-focus slices in two diagnostic views. Human intraobserver variability was assessed as the overlap between repeated annotations (median 77% and range 25% to 91%). Comparing the segmented mass outline with probability-weighted ground truth from these annotations, median agreement was 68%, and range was 7% to 88%. Annotated and segmented diameters correlated well with histological mass size (both Spearman's rank correlations [Formula: see text]). The volumetric segmentation demonstrated better agreement with tumor volumes estimated from pathology than volume derived from radiological annotations (95% limits of agreement [Formula: see text] to 11 ml and [Formula: see text] to 41 ml, respectively). We conclude that it is feasible to assess 3-D mass morphology and volume from DBT, and the method has the potential to aid breast cancer management.
Collapse
Affiliation(s)
- Stefanie T L Pöhlmann
- University of Manchester, Division of Informatics Imaging and Data Sciences, School of Health Sciences, Faculty of Biology Medicine and Health, Manchester, United Kingdom
| | - Yit Y Lim
- University Hospital of South Manchester, Nightingale Breast Centre, Manchester, United Kingdom
| | - Elaine Harkness
- University of Manchester, Division of Informatics Imaging and Data Sciences, School of Health Sciences, Faculty of Biology Medicine and Health, Manchester, United Kingdom
| | - Susan Pritchard
- University Hospital of South Manchester, Nightingale Breast Centre, Manchester, United Kingdom
| | - Christopher J Taylor
- University of Manchester, Division of Informatics Imaging and Data Sciences, School of Health Sciences, Faculty of Biology Medicine and Health, Manchester, United Kingdom
| | - Susan M Astley
- University of Manchester, Division of Informatics Imaging and Data Sciences, School of Health Sciences, Faculty of Biology Medicine and Health, Manchester, United Kingdom
| |
Collapse
|
10
|
Preoperative implant selection for unilateral breast reconstruction using 3D imaging with the Microsoft Kinect sensor. J Plast Reconstr Aesthet Surg 2017; 70:1059-1067. [PMID: 28595842 DOI: 10.1016/j.bjps.2017.04.005] [Citation(s) in RCA: 15] [Impact Index Per Article: 2.1] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/17/2016] [Revised: 03/31/2017] [Accepted: 04/14/2017] [Indexed: 11/22/2022]
Abstract
AIMS This study aimed to investigate whether breast volume measured preoperatively using a Kinect 3D sensor could be used to determine the most appropriate implant size for reconstruction. METHODS Ten patients underwent 3D imaging before and after unilateral implant-based reconstruction. Imaging used seven configurations, varying patient pose and Kinect location, which were compared regarding suitability for volume measurement. Four methods of defining the breast boundary for automated volume calculation were compared, and repeatability assessed over five repetitions. RESULTS The most repeatable breast boundary annotation used an ellipse to track the inframammary fold and a plane describing the chest wall (coefficient of repeatability: 70 ml). The most reproducible imaging position comparing pre- and postoperative volume measurement of the healthy breast was achieved for the sitting patient with elevated arms and Kinect centrally positioned (coefficient of repeatability: 141 ml). Optimal implant volume was calculated by correcting used implant volume by the observed postoperative asymmetry. It was possible to predict implant size using a linear model derived from preoperative volume measurement of the healthy breast (coefficient of determination R2 = 0.78, standard error of prediction 120 ml). Mastectomy specimen weight and experienced surgeons' choice showed similar predictive ability (both: R2 = 0.74, standard error: 141/142 ml). A leave one-out validation showed that in 61% of cases, 3D imaging could predict implant volume to within 10%; however for 17% of cases it was >30%. CONCLUSION This technology has the potential to facilitate reconstruction surgery planning and implant procurement to maximise symmetry after unilateral reconstruction.
Collapse
|
11
|
Koley S, Chakraborty C, Mainero C, Fischl B, Aganj I. A Fast Approach to Automatic Detection of Brain Lesions. BRAINLESION : GLIOMA, MULTIPLE SCLEROSIS, STROKE AND TRAUMATIC BRAIN INJURIES. BRAINLES (WORKSHOP) 2017; 10154:52-61. [PMID: 29082383 DOI: 10.1007/978-3-319-55524-9_6] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/04/2022]
Abstract
Template matching is a popular approach to computer-aided detection of brain lesions from magnetic resonance (MR) images. The outcomes are often sufficient for localizing lesions and assisting clinicians in diagnosis. However, processing large MR volumes with three-dimensional (3D) templates is demanding in terms of computational resources, hence the importance of the reduction of computational complexity of template matching, particularly in situations in which time is crucial (e.g. emergent stroke). In view of this, we make use of 3D Gaussian templates with varying radii and propose a new method to compute the normalized cross-correlation coefficient as a similarity metric between the MR volume and the template to detect brain lesions. Contrary to the conventional fast Fourier transform (FFT) based approach, whose runtime grows as O(N logN) with the number of voxels, the proposed method computes the cross-correlation in O(N). We show through our experiments that the proposed method outperforms the FFT approach in terms of computational time, and retains comparable accuracy.
Collapse
Affiliation(s)
- Subhranil Koley
- Athinoula A. Martinos Center for Biomedical Imaging, Radiology Department, Massachusetts General Hospital, Charlestown, MA, USA.,School of Medical Science and Technology, Indian Institute of Technology Kharagpur, Kharagpur, WB, India 721302
| | - Chandan Chakraborty
- School of Medical Science and Technology, Indian Institute of Technology Kharagpur, Kharagpur, WB, India 721302
| | - Caterina Mainero
- Athinoula A. Martinos Center for Biomedical Imaging, Radiology Department, Massachusetts General Hospital, Charlestown, MA, USA.,Radiology Department, Harvard Medical School, Boston, MA, USA
| | - Bruce Fischl
- Athinoula A. Martinos Center for Biomedical Imaging, Radiology Department, Massachusetts General Hospital, Charlestown, MA, USA.,Radiology Department, Harvard Medical School, Boston, MA, USA.,Computer Science and Artificial Intelligence Laboratory, Massachusetts Institute of Technology, Cambridge, MA, USA
| | - Iman Aganj
- Athinoula A. Martinos Center for Biomedical Imaging, Radiology Department, Massachusetts General Hospital, Charlestown, MA, USA.,Radiology Department, Harvard Medical School, Boston, MA, USA
| |
Collapse
|
12
|
Xu Y, Shen F, Xu X, Gao L, Wang Y, Tan X. Large-scale image retrieval with supervised sparse hashing. Neurocomputing 2017. [DOI: 10.1016/j.neucom.2016.05.109] [Citation(s) in RCA: 12] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/30/2022]
|
13
|
Albiol A, Corbi A, Albiol F. Automatic intensity windowing of mammographic images based on a perceptual metric. Med Phys 2017; 44:1369-1378. [PMID: 28160525 DOI: 10.1002/mp.12144] [Citation(s) in RCA: 6] [Impact Index Per Article: 0.9] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/10/2016] [Revised: 01/13/2017] [Accepted: 01/24/2017] [Indexed: 11/07/2022] Open
Abstract
PURPOSE Initial auto-adjustment of the window level WL and width WW applied to mammographic images. The proposed intensity windowing (IW) method is based on the maximization of the mutual information (MI) between a perceptual decomposition of the original 12-bit sources and their screen displayed 8-bit version. Besides zoom, color inversion and panning operations, IW is the most commonly performed task in daily screening and has a direct impact on diagnosis and the time involved in the process. METHODS The authors present a human visual system and perception-based algorithm named GRAIL (Gabor-relying adjustment of image levels). GRAIL initially measures a mammogram's quality based on the MI between the original instance and its Gabor-filtered derivations. From this point on, the algorithm performs an automatic intensity windowing process that outputs the WL/WW that best displays each mammogram for screening. GRAIL starts with the default, high contrast, wide dynamic range 12-bit data, and then maximizes the graphical information presented in ordinary 8-bit displays. Tests have been carried out with several mammogram databases. They comprise correlations and an ANOVA analysis with the manual IW levels established by a group of radiologists. A complete MATLAB implementation of GRAIL is available at https://github.com/TheAnswerIsFortyTwo/GRAIL. RESULTS Auto-leveled images show superior quality both perceptually and objectively compared to their full intensity range and compared to the application of other common methods like global contrast stretching (GCS). The correlations between the human determined intensity values and the ones estimated by our method surpass that of GCS. The ANOVA analysis with the upper intensity thresholds also reveals a similar outcome. GRAIL has also proven to specially perform better with images that contain micro-calcifications and/or foreign X-ray-opaque elements and with healthy BI-RADS A-type mammograms. It can also speed up the initial screening time by a mean of 4.5 s per image. CONCLUSIONS A novel methodology is introduced that enables a quality-driven balancing of the WL/WW of mammographic images. This correction seeks the representation that maximizes the amount of graphical information contained in each image. The presented technique can contribute to the diagnosis and the overall efficiency of the breast screening session by suggesting, at the beginning, an optimal and customized windowing setting for each mammogram.
Collapse
Affiliation(s)
- Alberto Albiol
- iTeam Research Institute, Universitat Politlècnica de Valéncia, València, Spain
| | - Alberto Corbi
- Instituto de Física Corpuscular (IFIC), Consejo Superior de Investigaciones Científicas, Universitat de València, València, Spain
| | - Francisco Albiol
- Instituto de Física Corpuscular (IFIC), Consejo Superior de Investigaciones Científicas, Universitat de València, València, Spain
| |
Collapse
|
14
|
Qiu Y, Yan S, Gundreddy RR, Wang Y, Cheng S, Liu H, Zheng B. A new approach to develop computer-aided diagnosis scheme of breast mass classification using deep learning technology. JOURNAL OF X-RAY SCIENCE AND TECHNOLOGY 2017; 25:751-763. [PMID: 28436410 PMCID: PMC5647205 DOI: 10.3233/xst-16226] [Citation(s) in RCA: 25] [Impact Index Per Article: 3.6] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/03/2023]
Abstract
PURPOSE To develop and test a deep learning based computer-aided diagnosis (CAD) scheme of mammograms for classifying between malignant and benign masses. METHODS An image dataset involving 560 regions of interest (ROIs) extracted from digital mammograms was used. After down-sampling each ROI from 512×512 to 64×64 pixel size, we applied an 8 layer deep learning network that involves 3 pairs of convolution-max-pooling layers for automatic feature extraction and a multiple layer perceptron (MLP) classifier for feature categorization to process ROIs. The 3 pairs of convolution layers contain 20, 10, and 5 feature maps, respectively. Each convolution layer is connected with a max-pooling layer to improve the feature robustness. The output of the sixth layer is fully connected with a MLP classifier, which is composed of one hidden layer and one logistic regression layer. The network then generates a classification score to predict the likelihood of ROI depicting a malignant mass. A four-fold cross validation method was applied to train and test this deep learning network. RESULTS The results revealed that this CAD scheme yields an area under the receiver operation characteristic curve (AUC) of 0.696±0.044, 0.802±0.037, 0.836±0.036, and 0.822±0.035 for fold 1 to 4 testing datasets, respectively. The overall AUC of the entire dataset is 0.790±0.019. CONCLUSIONS This study demonstrates the feasibility of applying a deep learning based CAD scheme to classify between malignant and benign breast masses without a lesion segmentation, image feature computation and selection process.
Collapse
Affiliation(s)
- Yuchen Qiu
- School of Electrical and Computer Engineering, University of Oklahoma, Norman, OK 73019, USA
| | - Shiju Yan
- University of Shanghai for Sciences and Technology, Shanghai, 200093, China
| | - Rohith Reddy Gundreddy
- School of Electrical and Computer Engineering, University of Oklahoma, Norman, OK 73019, USA
| | - Yunzhi Wang
- School of Electrical and Computer Engineering, University of Oklahoma, Norman, OK 73019, USA
| | - Samuel Cheng
- School of Electrical and Computer Engineering, University of Oklahoma, Tulsa, OK, 74135, USA
| | - Hong Liu
- School of Electrical and Computer Engineering, University of Oklahoma, Norman, OK 73019, USA
| | - Bin Zheng
- School of Electrical and Computer Engineering, University of Oklahoma, Norman, OK 73019, USA
| |
Collapse
|
15
|
Peng W, Mayorga RV, Hussein EMA. An automated confirmatory system for analysis of mammograms. COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE 2016; 125:134-144. [PMID: 26742491 DOI: 10.1016/j.cmpb.2015.09.019] [Citation(s) in RCA: 11] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/08/2015] [Revised: 09/18/2015] [Accepted: 09/23/2015] [Indexed: 06/05/2023]
Abstract
This paper presents an integrated system for the automatic analysis of mammograms to assist radiologists in confirming their diagnosis in mammography screening. The proposed automated confirmatory system (ACS) can process a digitalized mammogram online, and generates a high quality filtered segmentation of an image for biological interpretation and a texture-feature based diagnosis. We use a serial of image pre-processing and segmentation techniques, including 2D median filtering, seeded region growing (SRG) algorithm, image contrast enhancement, to remove noise, delete radiopaque artifacts and eliminate the projection of the pectoral muscle from a digitalized mammogram. We also develop an entire-image texture-feature based classification method, by combining a Rough-set approach to extract five fundamental texture features from images, and then an Artificial Neural Network technique to classify a mammogram as: normal; indicating the presence of a benign lump; or representing a malignant tumor. Here, 222 random images from the Mammographic Image Analysis Society (MIAS) database are used for the offline ACS training. Once the system is tuned and trained, it is ready for the automated use for the analysis and diagnosis of new mammograms. To test the trained system, a separate set of 100 random images from the MIAS and another set of 100 random images from the independent BancoWeb database are selected. The proposed ACS is shown to be successful in confirming diagnosis of mammograms from the two independent databases.
Collapse
Affiliation(s)
- W Peng
- Faculty of Engineering of Applied Science, University of Regina, Regina, Saskatchewan, Canada S4S 0A2
| | - R V Mayorga
- Faculty of Engineering of Applied Science, University of Regina, Regina, Saskatchewan, Canada S4S 0A2.
| | - E M A Hussein
- Faculty of Engineering of Applied Science, University of Regina, Regina, Saskatchewan, Canada S4S 0A2
| |
Collapse
|
16
|
Uchiyama Y, Abe A, Muramatsu C, Hara T, Shiraishi J, Fujita H. Eigenspace template matching for detection of lacunar infarcts on MR images. J Digit Imaging 2015; 28:116-22. [PMID: 24942983 DOI: 10.1007/s10278-014-9711-2] [Citation(s) in RCA: 7] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/26/2022] Open
Abstract
Detection of lacunar infarcts is important because their presence indicates an increased risk of severe cerebral infarction. However, accurate identification is often hindered by the difficulty in distinguishing between lacunar infarcts and enlarged Virchow-Robin spaces. Therefore, we developed a computer-aided detection (CAD) scheme for the detection of lacunar infarcts. Although our previous CAD method indicated a sensitivity of 96.8% with 0.71 false positives (FPs) per slice, further reduction of FPs remained an issue for the clinical application. Thus, the purpose of this study is to improve our CAD scheme by using template matching in the eigenspace. Conventional template matching is useful for the reduction of FPs, but it has the following two pitfalls: (1) It needs to maintain a large number of templates to improve the detection performance, and (2) calculation of the cross-correlation coefficient with these templates is time consuming. To solve these problems, we used template matching in the lower dimension space made by a principal component analysis. Our database comprised 1,143 T1- and T2-weighted images obtained from 132 patients. The proposed method was evaluated by using twofold cross-validation. By using this method, 34.1% of FPs was eliminated compared with our previous method. The final performance indicated that the sensitivity of the detection of lacunar infarcts was 96.8% with 0.47 FPs per slice. Therefore, the modified CAD scheme could improve FP rate without a significant reduction in the true positive rate.
Collapse
Affiliation(s)
- Yoshikazu Uchiyama
- Department of Medical Physics, Faculty of Life Science, Kumamoto University, 4-24-1 Kuhonji, Kumamoto, Kumamoto, 862-0976, Japan,
| | | | | | | | | | | |
Collapse
|
17
|
Kalinin SV, Sumpter BG, Archibald RK. Big-deep-smart data in imaging for guiding materials design. NATURE MATERIALS 2015; 14:973-80. [PMID: 26395941 DOI: 10.1038/nmat4395] [Citation(s) in RCA: 110] [Impact Index Per Article: 12.2] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/09/2015] [Accepted: 07/24/2015] [Indexed: 05/25/2023]
Abstract
Harnessing big data, deep data, and smart data from state-of-the-art imaging might accelerate the design and realization of advanced functional materials. Here we discuss new opportunities in materials design enabled by the availability of big data in imaging and data analytics approaches, including their limitations, in material systems of practical interest. We specifically focus on how these tools might help realize new discoveries in a timely manner. Such methodologies are particularly appropriate to explore in light of continued improvements in atomistic imaging, modelling and data analytics methods.
Collapse
Affiliation(s)
- Sergei V Kalinin
- Institute for Functional Imaging of Materials, Oak Ridge National Laboratory, Oak Ridge, Tennessee 37831, USA
- Center for Nanophase Materials Sciences, Oak Ridge National Laboratory, Oak Ridge, Tennessee 37831, USA
| | - Bobby G Sumpter
- Institute for Functional Imaging of Materials, Oak Ridge National Laboratory, Oak Ridge, Tennessee 37831, USA
- Center for Nanophase Materials Sciences, Oak Ridge National Laboratory, Oak Ridge, Tennessee 37831, USA
- Computer Science and Mathematics Division, Oak Ridge National Laboratory, Oak Ridge, Tennessee 37831, USA
| | - Richard K Archibald
- Institute for Functional Imaging of Materials, Oak Ridge National Laboratory, Oak Ridge, Tennessee 37831, USA
- Computer Science and Mathematics Division, Oak Ridge National Laboratory, Oak Ridge, Tennessee 37831, USA
| |
Collapse
|
18
|
Murakawa S, Tanigawa A, Uchiyama Y, Muramatsu C, Hara T, Fujita H. Kernel eigenspace template matching for detection of lacunar infarcts on MR images. Nihon Hoshasen Gijutsu Gakkai Zasshi 2015; 71:85-91. [PMID: 25748008 DOI: 10.6009/jjrt.2015_jsrt_71.2.85] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/11/2022]
Abstract
Detection of lacunar infarcts is important because their presence indicates an increased risk of severe cerebral infarction and dementia. However, accurate identification of lacunar infarcts is often difficult for radiologists. Our previous computer-aided detection (CAD) scheme achieved a sensitivity of 96.8% with 0.76 false positives (FPs) per slice. However, further reduction of FPs remained an issue for the clinical application. The purpose of this study is to improve our CAD scheme by using kernel eigenspace template matching. First, we selected the regions of interest (ROIs) around the candidate regions detected in our previous method. A kernel eigenspace was then made by using kernel principal component analysis of the training data set. A test ROI was projected onto the same kernel eigenspace as the training data set. The cross-correlation coefficients between the test ROI and all the training ROIs were calculated on the kernel eigenspace. By comparing the two maxima of coefficients with a lacunar ROI and an FP ROI, the test ROI was classified. By using the proposed method, the quantity of the templates became 1.9% of that in template matching on the real space and 31. 9% of FPs could be eliminated while keeping the same sensitivity; nevertheless 30.3% of FPs were eliminated when we employed the eigenspace template matching under the same condition. Therefore, kernel eigenspace template matching could improve FP rate without a significant reduction in the true positive rate.
Collapse
Affiliation(s)
- Saki Murakawa
- Graduate School of Health Sciences, Kumamoto University
| | | | | | | | | | | |
Collapse
|
19
|
Jiang M, Zhang S, Li H, Metaxas DN. Computer-aided diagnosis of mammographic masses using scalable image retrieval. IEEE Trans Biomed Eng 2014; 62:783-92. [PMID: 25361497 DOI: 10.1109/tbme.2014.2365494] [Citation(s) in RCA: 86] [Impact Index Per Article: 8.6] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/07/2022]
Abstract
Computer-aided diagnosis of masses in mammograms is important to the prevention of breast cancer. Many approaches tackle this problem through content-based image retrieval techniques. However, most of them fall short of scalability in the retrieval stage, and their diagnostic accuracy is, therefore, restricted. To overcome this drawback, we propose a scalable method for retrieval and diagnosis of mammographic masses. Specifically, for a query mammographic region of interest (ROI), scale-invariant feature transform (SIFT) features are extracted and searched in a vocabulary tree, which stores all the quantized features of previously diagnosed mammographic ROIs. In addition, to fully exert the discriminative power of SIFT features, contextual information in the vocabulary tree is employed to refine the weights of tree nodes. The retrieved ROIs are then used to determine whether the query ROI contains a mass. The presented method has excellent scalability due to the low spatial-temporal cost of vocabulary tree. Extensive experiments are conducted on a large dataset of 11 553 ROIs extracted from the digital database for screening mammography, which demonstrate the accuracy and scalability of our approach.
Collapse
|
20
|
Jalalian A, Mashohor SB, Mahmud HR, Saripan MIB, Ramli ARB, Karasfi B. Computer-aided detection/diagnosis of breast cancer in mammography and ultrasound: a review. Clin Imaging 2013; 37:420-6. [DOI: 10.1016/j.clinimag.2012.09.024] [Citation(s) in RCA: 229] [Impact Index Per Article: 20.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/24/2012] [Revised: 09/25/2012] [Accepted: 09/28/2012] [Indexed: 11/25/2022]
|
21
|
Good D, Lo J, Lee WR, Wu QJ, Yin FF, Das SK. A knowledge-based approach to improving and homogenizing intensity modulated radiation therapy planning quality among treatment centers: an example application to prostate cancer planning. Int J Radiat Oncol Biol Phys 2013; 87:176-81. [PMID: 23623460 DOI: 10.1016/j.ijrobp.2013.03.015] [Citation(s) in RCA: 177] [Impact Index Per Article: 16.1] [Reference Citation Analysis] [Abstract] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/28/2012] [Revised: 03/08/2013] [Accepted: 03/11/2013] [Indexed: 11/17/2022]
Abstract
PURPOSE Intensity modulated radiation therapy (IMRT) treatment planning can have wide variation among different treatment centers. We propose a system to leverage the IMRT planning experience of larger institutions to automatically create high-quality plans for outside clinics. We explore feasibility by generating plans for patient datasets from an outside institution by adapting plans from our institution. METHODS AND MATERIALS A knowledge database was created from 132 IMRT treatment plans for prostate cancer at our institution. The outside institution, a community hospital, provided the datasets for 55 prostate cancer cases, including their original treatment plans. For each "query" case from the outside institution, a similar "match" case was identified in the knowledge database, and the match case's plan parameters were then adapted and optimized to the query case by use of a semiautomated approach that required no expert planning knowledge. The plans generated with this knowledge-based approach were compared with the original treatment plans at several dose cutpoints. RESULTS Compared with the original plan, the knowledge-based plan had a significantly more homogeneous dose to the planning target volume and a significantly lower maximum dose. The volumes of the rectum, bladder, and femoral heads above all cutpoints were nominally lower for the knowledge-based plan; the reductions were significantly lower for the rectum. In 40% of cases, the knowledge-based plan had overall superior (lower) dose-volume histograms for rectum and bladder; in 54% of cases, the comparison was equivocal; in 6% of cases, the knowledge-based plan was inferior for both bladder and rectum. CONCLUSIONS Knowledge-based planning was superior or equivalent to the original plan in 95% of cases. The knowledge-based approach shows promise for homogenizing plan quality by transferring planning expertise from more experienced to less experienced institutions.
Collapse
Affiliation(s)
- David Good
- Medical Physics Graduate Program, Duke University, Durham, North Carolina, USA
| | | | | | | | | | | |
Collapse
|
22
|
Fauci F, Raso G, Magro R, Forni G, Lauria A, Bagnasco S, Cerello P, Cheran SC, Lopez Torres E, Bellotti R, Carlo FD, Gargano G, Tangaro S, Mitri ID, Nunzio GD, Cataldo R. A massive lesion detection algorithm in mammography. Phys Med 2012; 21:23-30. [PMID: 18348842 DOI: 10.1016/s1120-1797(05)80016-x] [Citation(s) in RCA: 9] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 07/07/2004] [Revised: 10/29/2004] [Accepted: 11/26/2004] [Indexed: 11/18/2022] Open
Abstract
A new algorithm for massive lesion detection in mammography is presented. The algorithm consists in three main steps: 1) reduction of the dimension of the image to be processed through the identification of regions of interest (roi) as candidates for massive lesions; 2) characterization of the RoI by means of suitable feature extraction; 3) pattern classification through supervised neural networks. Suspect regions are detected by searching for local maxima of the pixel grey level intensity. A ring of increasing radius, centered on a maximum, is considered until the mean intensity in the ring decreases to a defined fraction of the maximum. The ROIS thus obtained are described by average, variance, skewness and kurtosis of the intensity distributions at different fractions of the radius. A neural network approach is adopted to classify suspect pathological and healthy pattern. The software has been designed in the framework of the INFN (Istituto Nazionale Fisica Nucleare) research project GPCALMA (Grid Platform for Calma) which recruits physicists and radiologists from different Italian Research Institutions and hospitals to develop software for breast cancer detection.
Collapse
Affiliation(s)
- Francesco Fauci
- Dipartimento di Fisica e Tecnologie Relative dell'Università di Palermo and INFN-Sezione di Catania (Italy)
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | |
Collapse
|
23
|
Bator M, Nieniewski M. Detection of cancerous masses in mammograms by template matching: optimization of template brightness distribution by means of evolutionary algorithm. J Digit Imaging 2012; 25:162-72. [PMID: 21748410 DOI: 10.1007/s10278-011-9402-1] [Citation(s) in RCA: 11] [Impact Index Per Article: 0.9] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/24/2022] Open
Abstract
Optimization of brightness distribution in the template used for detection of cancerous masses in mammograms by means of correlation coefficient is presented. This optimization is performed by the evolutionary algorithm using an auxiliary mass classifier. Brightness along the radius of the circularly symmetric template is coded indirectly by its second derivative. The fitness function is defined as the area under curve (AUC) of the receiver operating characteristic (ROC) for the mass classifier. The ROC and AUC are obtained for a teaching set of regions of interest (ROIs), for which it is known whether a ROI is true-positive (TP) or false-positive (F). The teaching set is obtained by running the mass detector using a template with a predetermined brightness. Subsequently, the evolutionary algorithm optimizes the template by classifying masses in the teaching set. The optimal template (OT) can be used for detection of masses in mammograms with unknown ROIs. The approach was tested on the training and testing sets of the Digital Database for Screening Mammography (DDSM). The free-response receiver operating characteristic (FROC) obtained with the new mass detector seems superior to the FROC for the hemispherical template (HT). Exemplary results are the following: in the case of the training set in the DDSM, the true-positive fraction (TPF) = 0.82 for the OT and 0.79 for the HT; in the case of the testing set, TPF = 0.79 for the OT and 0.72 for the HT. These values were obtained for disease cases, and the false-positive per image (FPI) = 2.
Collapse
Affiliation(s)
- Marcin Bator
- Faculty of Applied Informatics and Mathematics, Warsaw University of Life Sciences, ul. Nowoursynowska 159, 02776, Warsaw, Poland.
| | | |
Collapse
|
24
|
Farjam R, Parmar HA, Noll DC, Tsien CI, Cao Y. An approach for computer-aided detection of brain metastases in post-Gd T1-W MRI. Magn Reson Imaging 2012; 30:824-36. [PMID: 22521993 DOI: 10.1016/j.mri.2012.02.024] [Citation(s) in RCA: 30] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/07/2011] [Revised: 01/20/2012] [Accepted: 02/17/2012] [Indexed: 11/25/2022]
Abstract
PURPOSE To develop an approach for computer-aided detection (CAD) of small brain metastases in post-Gd T1-weighted magnetic resonance imaging (MRI). METHOD A set of unevenly spaced 3D spherical shell templates was optimized to localize brain metastatic lesions by cross-correlation analysis with MRI. Theoretical and simulation analyses of effects of lesion size and shape heterogeneity were performed to optimize the number and size of the templates and the cross-correlation thresholds. Also, effects of image factors of noise and intensity variation on the performance of the CAD system were investigated. A nodule enhancement strategy to improve sensitivity of the system and a set of criteria based upon the size, shape and brightness of lesions were used to reduce false positives. An optimal set of parameters from the FROC curves was selected from a training dataset, and then the system was evaluated on a testing dataset including 186 lesions from 2753 MRI slices. Reading results from two radiologists are also included. RESULTS Overall, a 93.5% sensitivity with 0.024 of intra-cranial false positive rate (IC-FPR) was achieved in the testing dataset. Our investigation indicated that nodule enhancement was very effective in improving both sensitivity and specificity. The size and shape criteria reduced the IC-FPR from 0.075 to 0.021, and the brightness criterion decreases the extra-cranial FPR from 0.477 to 0.083 in the training dataset. Readings from the two radiologists had sensitivities of 60% and 67% in the training dataset and 70% and 80% in the testing dataset for the metastatic lesions <5 mm in diameter. CONCLUSION Our proposed CAD system has high sensitivity and fairly low FPR for detection of the small brain metastatic lesions in MRI compared to the previous work and readings of neuroradiologists. The potential of this method for assisting clinical decision- making warrants further evaluation and improvements.
Collapse
Affiliation(s)
- Reza Farjam
- Department of Biomedical Engineering, University of Michigan, Ann Arbor, MI 48109-2099, USA
| | | | | | | | | |
Collapse
|
25
|
Malof JM, Mazurowski MA, Tourassi GD. The effect of class imbalance on case selection for case-based classifiers: an empirical study in the context of medical decision support. Neural Netw 2012; 25:141-5. [PMID: 21820273 PMCID: PMC3834538 DOI: 10.1016/j.neunet.2011.07.002] [Citation(s) in RCA: 23] [Impact Index Per Article: 1.9] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/08/2009] [Revised: 07/06/2011] [Accepted: 07/07/2011] [Indexed: 11/16/2022]
Abstract
Case selection is a useful approach for increasing the efficiency and performance of case-based classifiers. Multiple techniques have been designed to perform case selection. This paper empirically investigates how class imbalance in the available set of training cases can impact the performance of the resulting classifier as well as properties of the selected set. In this study, the experiments are performed using a dataset for the problem of detecting breast masses in screening mammograms. The classification problem was binary and we used a k-nearest neighbor classifier. The classifier's performance was evaluated using the receiver operating characteristic (ROC) area under the curve (AUC) measure. The experimental results indicate that although class imbalance reduces the performance of the derived classifier and the effectiveness of selection at improving overall classifier performance, case selection can still be beneficial, regardless of the level of class imbalance.
Collapse
Affiliation(s)
- Jordan M Malof
- Department of Electrical and Computer Engineering, University of Louisville, Louisville, KY 40208, USA.
| | | | | |
Collapse
|
26
|
Liu H, Lan Y, Xu X, Song E, Hung CC. Fissures segmentation using surface features: content-based retrieval for mammographic mass using ensemble classifier. Acad Radiol 2011; 18:1475-84. [PMID: 22055794 DOI: 10.1016/j.acra.2011.08.012] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/10/2011] [Revised: 08/20/2011] [Accepted: 08/23/2011] [Indexed: 10/15/2022]
Abstract
RATIONALE AND OBJECTIVES Accurate classification is critical in mammography computer-aided diagnosis using content-based image retrieval approaches (CBIR CAD). The objectives of this study were to: 1) develop an accurate ensemble classifier based on domain knowledge and a robust feature selection method for CBIR CAD; 2) propose three new features; and 3) assess the performance of the proposed method and new features by using a relatively large imaging data set. MATERIALS AND METHODS The data set used in this study consisted of 2114 regions of interest (ROI) extracted from a publicly available image database. The proposed ensemble classifier method we called E-DGA-KNN included four steps. In the first step, 804 ROIs depict masses were divided into five classes according to their boundary types. Then, each class of ROI with an equal number of negative ROIs were put together to create a sub-database. Second, a dual-stage genetic algorithm, which was called DGA, was applied on those five sub-databases for feature selection and weights determination respectively. In the third step, five base K-nearest neighbor (KNN) classifiers were created by using the results of the second step on 2114 ROIs, and five detection scores for a given queried ROI were obtained. Finally, these classifiers are combined to yield a final classification. The performances of the proposed methods were evaluated by using receiver operating characteristic (ROC) analysis. A comparison with eight different methods on the data set was provided which include the stepwise linear discriminative analysis algorithm (SLDA) and particle swarm optimization (PSO) algorithm with KNN classifier. RESULTS When four hybrid feature selection methods were applied with single KNN classifier (ie, DGA-KNN, SLDA-WGA-KNN, SLDA-PSO-KNN, GA-PSO-KNN) and the proposed E-DGA-KNN method to the data set, the computed areas under the ROC curve (Az) were 0.8782 ± 0.0080, 0.8675 ± 0.0081, 0.8623 ± 0.0083, 0.8725 ± 0.0079, and 0.8927 ± 0.0073, respectively. If all features and single KNN classifier were used, the Az value was 0.8478 ± 0.0088. Az values were 0.8592 ± 0.0083 and 0.8632 ± 0.0081 when SLDA or GA algorithm used alone. CONCLUSIONS In this study, an ensemble classifier based on domain knowledge and a dual-stage feature selection method was proposed. Evaluation results indicated that the proposed method achieved largest value of ROC compared to other algorithms. The proposed method shows better performance and has the potential to improve the performance of CBIR CAD in interpreting and analyzing mammograms.
Collapse
|
27
|
Chanyavanich V, Das SK, Lee WR, Lo JY. Knowledge-based IMRT treatment planning for prostate cancer. Med Phys 2011; 38:2515-22. [PMID: 21776786 DOI: 10.1118/1.3574874] [Citation(s) in RCA: 136] [Impact Index Per Article: 10.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/25/2022] Open
Abstract
PURPOSE To demonstrate the feasibility of using a knowledge base of prior treatment plans to generate new prostate intensity modulated radiation therapy (IMRT) plans. Each new case would be matched against others in the knowledge base. Once the best match is identified, that clinically approved plan is used to generate the new plan. METHODS A database of 100 prostate IMRT treatment plans was assembled into an information-theoretic system. An algorithm based on mutual information was implemented to identify similar patient cases by matching 2D beam's eye view projections of contours. Ten randomly selected query cases were each matched with the most similar case from the database of prior clinically approved plans. Treatment parameters from the matched case were used to develop new treatment plans. A comparison of the differences in the dose-volume histograms between the new and the original treatment plans were analyzed. RESULTS On average, the new knowledge-based plan is capable of achieving very comparable planning target volume coverage as the original plan, to within 2% as evaluated for D98, D95, and D1. Similarly, the dose to the rectum and dose to the bladder are also comparable to the original plan. For the rectum, the mean and standard deviation of the dose percentage differences for D20, D30, and D50 are 1.8% +/- 8.5%, -2.5% +/- 13.9%, and -13.9% +/- 23.6%, respectively. For the bladder, the mean and standard deviation of the dose percentage differences for D20, D30, and D50 are -5.9% +/- 10.8%, -12.2% +/- 14.6%, and -24.9% +/- 21.2%, respectively. A negative percentage difference indicates that the new plan has greater dose sparing as compared to the original plan. CONCLUSIONS The authors demonstrate a knowledge-based approach of using prior clinically approved treatment plans to generate clinically acceptable treatment plans of high quality. This semiautomated approach has the potential to improve the efficiency of the treatment planning process while ensuring that high quality plans are developed.
Collapse
Affiliation(s)
- Vorakarn Chanyavanich
- Carl E. Ravin Advanced Imaging Laboratories, Department of Radiology, Duke University Medical Center, Durham, North Carolina 27705, USA.
| | | | | | | |
Collapse
|
28
|
Mazurowski MA, Lo JY, Harrawood BP, Tourassi GD. Mutual information-based template matching scheme for detection of breast masses: from mammography to digital breast tomosynthesis. J Biomed Inform 2011; 44:815-23. [PMID: 21554985 DOI: 10.1016/j.jbi.2011.04.008] [Citation(s) in RCA: 24] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/28/2010] [Revised: 04/21/2011] [Accepted: 04/22/2011] [Indexed: 10/18/2022]
Abstract
Development of a computational decision aid for a new medical imaging modality typically is a long and complicated process. It consists of collecting data in the form of images and annotations, development of image processing and pattern recognition algorithms for analysis of the new images and finally testing of the resulting system. Since new imaging modalities are developed more rapidly than ever before, any effort for decreasing the time and cost of this development process could result in maximizing the benefit of the new imaging modality to patients by making the computer aids quickly available to radiologists that interpret the images. In this paper, we make a step in this direction and investigate the possibility of translating the knowledge about the detection problem from one imaging modality to another. Specifically, we present a computer-aided detection (CAD) system for mammographic masses that uses a mutual information-based template matching scheme with intelligently selected templates. We presented principles of template matching with mutual information for mammography before. In this paper, we present an implementation of those principles in a complete computer-aided detection system. The proposed system, through an automatic optimization process, chooses the most useful templates (mammographic regions of interest) using a large database of previously collected and annotated mammograms. Through this process, the knowledge about the task of detecting masses in mammograms is incorporated in the system. Then, we evaluate whether our system developed for screen-film mammograms can be successfully applied not only to other mammograms but also to digital breast tomosynthesis (DBT) reconstructed slices without adding any DBT cases for training. Our rationale is that since mutual information is known to be a robust inter-modality image similarity measure, it has high potential of transferring knowledge between modalities in the context of the mass detection task. Experimental evaluation of the system on mammograms showed competitive performance compared to other mammography CAD systems recently published in the literature. When the system was applied "as-is" to DBT, its performance was notably worse than that for mammograms. However, with a simple additional preprocessing step, the performance of the system reached levels similar to that obtained for mammograms. In conclusion, the presented CAD system not only performed competitively on screen-film mammograms but it also performed robustly on DBT showing that direct transfer of knowledge across breast imaging modalities for mass detection is in fact possible.
Collapse
Affiliation(s)
- Maciej A Mazurowski
- Department of Radiology, Duke University Medical Center, 2424 Erwin Rd., Suite 302, Durham, NC 27705, USA.
| | | | | | | |
Collapse
|
29
|
Needs assessment for next generation computer-aided mammography reference image databases and evaluation studies. Int J Comput Assist Radiol Surg 2011; 6:749-67. [DOI: 10.1007/s11548-011-0553-9] [Citation(s) in RCA: 17] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/08/2010] [Accepted: 03/01/2011] [Indexed: 10/18/2022]
|
30
|
Tourassi GD, Mazurowski MA, Harrawood BP, Krupinski EA. Exploring the potential of context-sensitive CADe in screening mammography. Med Phys 2011; 37:5728-36. [PMID: 21158284 DOI: 10.1118/1.3501882] [Citation(s) in RCA: 14] [Impact Index Per Article: 1.1] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/07/2022] Open
Abstract
PURPOSE Conventional computer-assisted detection (CADe) systems in screening mammography provide the same decision support to all users. The aim of this study was to investigate the potential of a context-sensitive CADe system which provides decision support guided by each user's focus of attention during visual search and reporting patterns for a specific case. METHODS An observer study for the detection of malignant masses in screening mammograms was conducted in which six radiologists evaluated 20 mammograms while wearing an eye-tracking device. Eye-position data and diagnostic decisions were collected for each radiologist and case they reviewed. These cases were subsequently analyzed with an in-house knowledge-based CADe system using two different modes: Conventional mode with a globally fixed decision threshold and context-sensitive mode with a location-variable decision threshold based on the radiologists' eye dwelling data and reporting information. RESULTS The CADe system operating in conventional mode had 85.7% per-image malignant mass sensitivity at 3.15 false positives per image (FPsI). The same system operating in context-sensitive mode provided personalized decision support at 85.7%-100% sensitivity and 0.35-0.40 FPsI to all six radiologists. Furthermore, context-sensitive CADe system could improve the radiologists' sensitivity and reduce their performance gap more effectively than conventional CADe. CONCLUSIONS Context-sensitive CADe support shows promise in delineating and reducing the radiologists' perceptual and cognitive errors in the diagnostic interpretation of screening mammograms more effectively than conventional CADe.
Collapse
Affiliation(s)
- Georgia D Tourassi
- Department of Radiology, Carl E. Ravin Advanced Imaging Laboratories, Duke University Medical Center, Durham, North Carolina 27705, USA.
| | | | | | | |
Collapse
|
31
|
Quellec G, Lamard M, Bekri L, Cazuguel G, Roux C, Cochener B. Medical case retrieval from a committee of decision trees. ACTA ACUST UNITED AC 2010; 14:1227-35. [PMID: 20813626 DOI: 10.1109/titb.2010.2053716] [Citation(s) in RCA: 27] [Impact Index Per Article: 1.9] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
Abstract
A novel content-based information retrieval framework, designed to cover several medical applications, is presented in this paper. The presented framework allows the retrieval of possibly incomplete medical cases consisting of several images together with semantic information. It relies on a committee of decision trees, decision support tools well suited to process this type of information. In our proposed framework, images are characterized by their digital content. It was applied to two heterogeneous medical datasets for computer-aided diagnoses: a diabetic retinopathy follow-up dataset (DRD) and a mammography-screening dataset (DDSM). Measure of precision among the top five retrieved results of 0.788 + or - 0.137 and 0.869 + or - 0.161 was obtained on DRD and DDSM, respectively. On DRD, for instance, it increases by half the retrieval of single images.
Collapse
Affiliation(s)
- Gwénolé Quellec
- INSTITUT TELECOM/TELECOM Bretagne, Dpt ITI, Brest, F-29200 France.
| | | | | | | | | | | |
Collapse
|
32
|
Ke L, He W, Kang Y. Mass auto-detection in mammogram based on wavelet transform modulus maximum. ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. ANNUAL INTERNATIONAL CONFERENCE 2010; 2009:5760-3. [PMID: 19963653 DOI: 10.1109/iembs.2009.5332615] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/10/2022]
Abstract
High accurate detection of mass in mammogram is critical for improving the performance and efficiency of computer-aided diagnosis (CAD) system. In this paper, we propose a novel approach to enhance the detection performance of mass in mammograms using Wavelet Transform Modulus Maximum (WTMM). First, hunt the region of interest (ROI) through the whole image and the ROI was approximately located by multi-threshold method. Then the contour of the ROI was extracted from the modulus image acquired by Wavelet Transform Modulus Maximum (WTMM) method. The region of interest was finally refined by the contour extracted. Experimental results indicate that the proposed method is able to detect not only isolate masses, but also the masses connected with the glandular tissues successfully. This technique could potentially improve the performance of CAD system and diagnosis accuracy in mammograms.
Collapse
Affiliation(s)
- Li Ke
- Institute of Biomedical and Electromagnetic Engineering, Shenyang University of Technology, Shenyang, Liaoning, China.
| | | | | |
Collapse
|
33
|
Gao X, Wang Y, Li X, Tao D. On Combining Morphological Component Analysis and Concentric Morphology Model for Mammographic Mass Detection. ACTA ACUST UNITED AC 2010; 14:266-73. [PMID: 19906595 DOI: 10.1109/titb.2009.2036167] [Citation(s) in RCA: 39] [Impact Index Per Article: 2.8] [Reference Citation Analysis] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/11/2022]
Affiliation(s)
- Xinbo Gao
- School of Electronic Engineering, Xidian University, Xi'an 710071, China.
| | | | | | | |
Collapse
|
34
|
Image Similarity to Improve the Classification of Breast Cancer Images. ALGORITHMS 2009. [DOI: 10.3390/a2041503] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
|
35
|
Lladó X, Oliver A, Freixenet J, Martí R, Martí J. A textural approach for mass false positive reduction in mammography. Comput Med Imaging Graph 2009; 33:415-22. [PMID: 19406614 DOI: 10.1016/j.compmedimag.2009.03.007] [Citation(s) in RCA: 42] [Impact Index Per Article: 2.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/31/2008] [Revised: 03/25/2009] [Accepted: 03/26/2009] [Indexed: 10/20/2022]
|
36
|
Mazurowski MA, Zurada JM, Tourassi GD. An adaptive incremental approach to constructing ensemble classifiers: application in an information-theoretic computer-aided decision system for detection of masses in mammograms. Med Phys 2009; 36:2976-84. [PMID: 19673196 PMCID: PMC2832038 DOI: 10.1118/1.3132304] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/23/2008] [Revised: 04/18/2009] [Accepted: 04/20/2009] [Indexed: 11/07/2022] Open
Abstract
Ensemble classifiers have been shown efficient in multiple applications. In this article, the authors explore the effectiveness of ensemble classifiers in a case-based computer-aided diagnosis system for detection of masses in mammograms. They evaluate two general ways of constructing subclassifiers by resampling of the available development dataset: Random division and random selection. Furthermore, they discuss the problem of selecting the ensemble size and propose two adaptive incremental techniques that automatically select the size for the problem at hand. All the techniques are evaluated with respect to a previously proposed information-theoretic CAD system (IT-CAD). The experimental results show that the examined ensemble techniques provide a statistically significant improvement (AUC = 0.905 +/- 0.024) in performance as compared to the original IT-CAD system (AUC = 0.865 +/- 0.029). Some of the techniques allow for a notable reduction in the total number of examples stored in the case base (to 1.3% of the original size), which, in turn, results in lower storage requirements and a shorter response time of the system. Among the methods examined in this article, the two proposed adaptive techniques are by far the most effective for this purpose. Furthermore, the authors provide some discussion and guidance for choosing the ensemble parameters.
Collapse
Affiliation(s)
- Maciej A Mazurowski
- Department of Radiology, Carl E. Ravin Advanced Imaging Laboratories, Duke University Medical Center, Durham, North Carolina 27705, USA.
| | | | | |
Collapse
|
37
|
Zheng B. Computer-Aided Diagnosis in Mammography Using Content-based Image Retrieval Approaches: Current Status and Future Perspectives. ALGORITHMS 2009; 2:828-849. [PMID: 20305801 PMCID: PMC2841362 DOI: 10.3390/a2020828] [Citation(s) in RCA: 35] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
Abstract
As the rapid advance of digital imaging technologies, the content-based image retrieval (CBIR) has became one of the most vivid research areas in computer vision. In the last several years, developing computer-aided detection and/or diagnosis (CAD) schemes that use CBIR to search for the clinically relevant and visually similar medical images (or regions) depicting suspicious lesions has also been attracting research interest. CBIR-based CAD schemes have potential to provide radiologists with "visual aid" and increase their confidence in accepting CAD-cued results in the decision making. The CAD performance and reliability depends on a number of factors including the optimization of lesion segmentation, feature selection, reference database size, computational efficiency, and relationship between the clinical relevance and visual similarity of the CAD results. By presenting and comparing a number of approaches commonly used in previous studies, this article identifies and discusses the optimal approaches in developing CBIR-based CAD schemes and assessing their performance. Although preliminary studies have suggested that using CBIR-based CAD schemes might improve radiologists' performance and/or increase their confidence in the decision making, this technology is still in the early development stage. Much research work is needed before the CBIR-based CAD schemes can be accepted in the clinical practice.
Collapse
Affiliation(s)
- Bin Zheng
- Imaging Research Center, Department of Radiology, University of Pittsburgh, 3362 Fifth Avenue, Room 128, Pittsburgh, PA 15213, USA
| |
Collapse
|
38
|
Jinshan Tang, Rangayyan R, Jun Xu, El Naqa I, Yongyi Yang. Computer-Aided Detection and Diagnosis of Breast Cancer With Mammography: Recent Advances. ACTA ACUST UNITED AC 2009; 13:236-51. [DOI: 10.1109/titb.2008.2009441] [Citation(s) in RCA: 375] [Impact Index Per Article: 25.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/09/2022]
|
39
|
Wang XH, Park SC, Zheng B. Improving performance of content-based image retrieval schemes in searching for similar breast mass regions: an assessment. Phys Med Biol 2009; 54:949-61. [PMID: 19147902 PMCID: PMC2675923 DOI: 10.1088/0031-9155/54/4/009] [Citation(s) in RCA: 16] [Impact Index Per Article: 1.1] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/11/2022]
Abstract
This study aims to assess three methods commonly used in content-based image retrieval (CBIR) schemes and investigate the approaches to improve scheme performance. A reference database involving 3000 regions of interest (ROIs) was established. Among them, 400 ROIs were randomly selected to form a testing dataset. Three methods, namely mutual information, Pearson's correlation and a multi-feature-based k-nearest neighbor (KNN) algorithm, were applied to search for the 15 'the most similar' reference ROIs to each testing ROI. The clinical relevance and visual similarity of searching results were evaluated using the areas under receiver operating characteristic (ROC) curves (A(Z)) and average mean square difference (MSD) of the mass boundary spiculation level ratings between testing and selected ROIs, respectively. The results showed that the A(Z) values were 0.893 +/- 0.009, 0.606 +/- 0.021 and 0.699 +/- 0.026 for the use of KNN, mutual information and Pearson's correlation, respectively. The A(Z) values increased to 0.724 +/- 0.017 and 0.787 +/- 0.016 for mutual information and Pearson's correlation when using ROIs with the size adaptively adjusted based on actual mass size. The corresponding MSD values were 2.107 +/- 0.718, 2.301 +/- 0.733 and 2.298 +/- 0.743. The study demonstrates that due to the diversity of medical images, CBIR schemes using multiple image features and mass size-based ROIs can achieve significantly improved performance.
Collapse
Affiliation(s)
- Xiao-Hui Wang
- Department of Radiology, University of Pittsburgh, Pittsburgh, PA 15213, USA.
| | | | | |
Collapse
|
40
|
Giger ML, Chan HP, Boone J. Anniversary paper: History and status of CAD and quantitative image analysis: the role of Medical Physics and AAPM. Med Phys 2009; 35:5799-820. [PMID: 19175137 PMCID: PMC2673617 DOI: 10.1118/1.3013555] [Citation(s) in RCA: 165] [Impact Index Per Article: 11.0] [Reference Citation Analysis] [Abstract] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/17/2023] Open
Abstract
The roles of physicists in medical imaging have expanded over the years, from the study of imaging systems (sources and detectors) and dose to the assessment of image quality and perception, the development of image processing techniques, and the development of image analysis methods to assist in detection and diagnosis. The latter is a natural extension of medical physicists' goals in developing imaging techniques to help physicians acquire diagnostic information and improve clinical decisions. Studies indicate that radiologists do not detect all abnormalities on images that are visible on retrospective review, and they do not always correctly characterize abnormalities that are found. Since the 1950s, the potential use of computers had been considered for analysis of radiographic abnormalities. In the mid-1980s, however, medical physicists and radiologists began major research efforts for computer-aided detection or computer-aided diagnosis (CAD), that is, using the computer output as an aid to radiologists-as opposed to a completely automatic computer interpretation-focusing initially on methods for the detection of lesions on chest radiographs and mammograms. Since then, extensive investigations of computerized image analysis for detection or diagnosis of abnormalities in a variety of 2D and 3D medical images have been conducted. The growth of CAD over the past 20 years has been tremendous-from the early days of time-consuming film digitization and CPU-intensive computations on a limited number of cases to its current status in which developed CAD approaches are evaluated rigorously on large clinically relevant databases. CAD research by medical physicists includes many aspects-collecting relevant normal and pathological cases; developing computer algorithms appropriate for the medical interpretation task including those for segmentation, feature extraction, and classifier design; developing methodology for assessing CAD performance; validating the algorithms using appropriate cases to measure performance and robustness; conducting observer studies with which to evaluate radiologists in the diagnostic task without and with the use of the computer aid; and ultimately assessing performance with a clinical trial. Medical physicists also have an important role in quantitative imaging, by validating the quantitative integrity of scanners and developing imaging techniques, and image analysis tools that extract quantitative data in a more accurate and automated fashion. As imaging systems become more complex and the need for better quantitative information from images grows, the future includes the combined research efforts from physicists working in CAD with those working on quantitative imaging systems to readily yield information on morphology, function, molecular structure, and more-from animal imaging research to clinical patient care. A historical review of CAD and a discussion of challenges for the future are presented here, along with the extension to quantitative image analysis.
Collapse
Affiliation(s)
- Maryellen L Giger
- Department of Radiology, University of Chicago, Chicago, Illinois 60637, USA.
| | | | | |
Collapse
|
41
|
Li B, Meng MQH. Computer-aided detection of bleeding regions for capsule endoscopy images. IEEE Trans Biomed Eng 2009; 56:1032-9. [PMID: 19174349 DOI: 10.1109/tbme.2008.2010526] [Citation(s) in RCA: 81] [Impact Index Per Article: 5.4] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/16/2022]
Abstract
Capsule endoscopy (CE) has been widely used to diagnose diseases in human digestive tract. However, a tough problem of this new technology is that too many images to be inspected by eyes cause a huge burden to physicians, so it is significant to investigate computerized diagnosis methods. In this paper, a new computer-aided system aimed for bleeding region detection in CE images is proposed. This new system exploits color texture feature, an important clue used by physicians, to analyze status of gastrointestinal tract. We put forward a new idea of chrominance moment as the color part of color texture feature, which makes full use of Tchebichef polynomials and illumination invariant of hue/saturation/intensity color space. Combined with uniform local binary pattern, a current texture representation model, it can be applied to discriminate normal regions and bleeding regions in CE images. Classification of bleeding regions using multilayer perceptron neural network is then deployed to verify performance of the proposed color texture features. Experimental results on our bleeding image data show that the proposed scheme is promising in detecting bleeding regions.
Collapse
Affiliation(s)
- Baopu Li
- Department of Electronic Engineering, Chinese University of Hong Kong, New Territories, Hong Kong.
| | | |
Collapse
|
42
|
Wu ZQ, Jiang J, Peng YH. Effective features based on normal linear structures for detecting microcalcifications in mammograms. ACTA ACUST UNITED AC 2008. [DOI: 10.1109/icpr.2008.4761333] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/06/2022]
|
43
|
Singh S, Tourassi GD, Baker JA, Samei E, Lo JY. Automated breast mass detection in 3D reconstructed tomosynthesis volumes: a featureless approach. Med Phys 2008; 35:3626-36. [PMID: 18777923 DOI: 10.1118/1.2953562] [Citation(s) in RCA: 36] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/10/2023] Open
Abstract
The purpose of this study was to propose and implement a computer aided detection (CADe) tool for breast tomosynthesis. This task was accomplished in two stages-a highly sensitive mass detector followed by a false positive (FP) reduction stage. Breast tomosynthesis data from 100 human subject cases were used, of which 25 subjects had one or more mass lesions and the rest were normal. For stage 1, filter parameters were optimized via a grid search. The CADe identified suspicious locations were reconstructed to yield 3D CADe volumes of interest. The first stage yielded a maximum sensitivity of 93% with 7.7 FPs/breast volume. Unlike traditional CADe algorithms in which the second stage FP reduction is done via feature extraction and analysis, instead information theory principles were used with mutual information as a similarity metric. Three schemes were proposed, all using leave-one-case-out cross validation sampling. The three schemes, A, B, and C, differed in the composition of their knowledge base of regions of interest (ROIs). Scheme A's knowledge base was comprised of all the mass and FP ROIs generated by the first stage of the algorithm. Scheme B had a knowledge base that contained information from mass ROIs and randomly extracted normal ROIs. Scheme C had information from three sources of information-masses, FPs, and normal ROIs. Also, performance was assessed as a function of the composition of the knowledge base in terms of the number of FP or normal ROIs needed by the system to reach optimal performance. The results indicated that the knowledge base needed no more than 20 times as many FPs and 30 times as many normal ROIs as masses to attain maximal performance. The best overall system performance was 85% sensitivity with 2.4 FPs per breast volume for scheme A, 3.6 FPs per breast volume for scheme B, and 3 FPs per breast volume for scheme C.
Collapse
Affiliation(s)
- Swatee Singh
- Department of Radiology, Duke University Medical Center, Durham, North Carolina 27705, USA.
| | | | | | | | | |
Collapse
|
44
|
Mazurowski MA, Zurada JM, Tourassi GD. Selection of examples in case-based computer-aided decision systems. Phys Med Biol 2008; 53:6079-96. [PMID: 18854606 DOI: 10.1088/0031-9155/53/21/013] [Citation(s) in RCA: 14] [Impact Index Per Article: 0.9] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/11/2022]
Abstract
Case-based computer-aided decision (CB-CAD) systems rely on a database of previously stored, known examples when classifying new, incoming queries. Such systems can be particularly useful since they do not need retraining every time a new example is deposited in the case base. The adaptive nature of case-based systems is well suited to the current trend of continuously expanding digital databases in the medical domain. To maintain efficiency, however, such systems need sophisticated strategies to effectively manage the available evidence database. In this paper, we discuss the general problem of building an evidence database by selecting the most useful examples to store while satisfying existing storage requirements. We evaluate three intelligent techniques for this purpose: genetic algorithm-based selection, greedy selection and random mutation hill climbing. These techniques are compared to a random selection strategy used as the baseline. The study is performed with a previously presented CB-CAD system applied for false positive reduction in screening mammograms. The experimental evaluation shows that when the development goal is to maximize the system's diagnostic performance, the intelligent techniques are able to reduce the size of the evidence database to 37% of the original database by eliminating superfluous and/or detrimental examples while at the same time significantly improving the CAD system's performance. Furthermore, if the case-base size is a main concern, the total number of examples stored in the system can be reduced to only 2-4% of the original database without a decrease in the diagnostic performance. Comparison of the techniques shows that random mutation hill climbing provides the best balance between the diagnostic performance and computational efficiency when building the evidence database of the CB-CAD system.
Collapse
Affiliation(s)
- Maciej A Mazurowski
- Department of Electrical and Computer Engineering, University of Louisville, Lutz Hall, Room 407, Louisville, KY 40292, USA.
| | | | | |
Collapse
|
45
|
Freixenet J, Oliver A, Martí R, Lladó X, Pont J, Pérez E, Denton ERE, Zwiggelaar R. Eigendetection of masses considering false positive reduction and breast density information. Med Phys 2008; 35:1840-53. [PMID: 18561659 DOI: 10.1118/1.2897950] [Citation(s) in RCA: 18] [Impact Index Per Article: 1.1] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/07/2022] Open
Abstract
The purpose of this article is to present a novel algorithm for the detection of masses in mammographic computer-aided diagnosis systems. Four key points provide the novelty of our approach: (1) the use of eigenanalysis for describing variation in mass shape and size; (2) a Bayesian detection methodology providing a mathematical sound framework, flexible enough to include additional information; (3) the use of a two-dimensional principal components analysis approach to facilitate false positive reduction; and (4) the incorporation of breast density information, a parameter correlated with the performance of most mass detection algorithms and which is not considered in existing approaches. To study the performance of the system two experiments were carried out. The first is related to the ability of the system to detect masses, and thus, free-response receiver operating characteristic analysis was used, showing that the method is able to give high accuracy at a high specificity (80% detection at 1.40 false positives per image). Second, the ability of the system to highlight the pixels belonging to a mass is studied using receiver operating characteristic analysis, resulting in A(z) = 0.89 +/- 0.04. In addition, the robustness of the approach is demonstrated in an experiment where we used the Digital Database for Screening Mammography database for training and the Mammographic Image Analysis Society database for testing the algorithm.
Collapse
Affiliation(s)
- Jordi Freixenet
- Institute of Informatics and Applications - IdiBGi, University of Girona, Campus Montilivi, Ed. P-IV 17071, Girona, Spain
| | | | | | | | | | | | | | | |
Collapse
|
46
|
Tourassi GD, Ike R, Singh S, Harrawood B. Evaluating the effect of image preprocessing on an information-theoretic CAD system in mammography. Acad Radiol 2008; 15:626-34. [PMID: 18423320 DOI: 10.1016/j.acra.2007.12.013] [Citation(s) in RCA: 18] [Impact Index Per Article: 1.1] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/04/2007] [Revised: 12/12/2007] [Accepted: 12/12/2007] [Indexed: 11/28/2022]
Abstract
RATIONALE AND OBJECTIVES In our earlier studies, we reported an evidence-based computer-assisted decision (CAD) system for location-specific interrogation of mammograms. A content-based image retrieval framework with information theoretic (IT) similarity measures serves as the foundation for this system. Specifically, the normalized mutual information (NMI) was shown to be the most effective similarity measure for reduction of false-positive marks generated by other prescreening mass detection schemes. The objective of this work was to investigate the importance of image filtering as a possible preprocessing step in our IT-CAD system. MATERIALS AND METHODS Different filters were applied, each one aiming to compensate for known limitations of the NMI similarity measure. The study was based on a region-of-interest database that included true masses and false-positive regions from digitized mammograms. RESULTS Receiver-operating characteristics (ROC) analysis showed that IT-CAD is affected slightly by image filtering. Modest, yet statistically significant, performance gain was observed with median filtering (overall ROC area index A(z) improved from 0.78 to 0.82). However, Gabor filtering improved performance for the high-sensitivity portion of the ROC curve where a typical false-positive reduction scheme should operate (partial ROC area index (0.90)A(z) improved from 0.33 to 0.37). Fusion of IT-CAD decisions from different filtering schemes markedly improved performance (A(z) = 0.90 and (0.90)A(z) = 0.55). At 95% sensitivity, the system's specificity improved by 36.6%. CONCLUSIONS Additional improvement in false-positive reduction can be achieved by incorporating image filtering as a preprocessing step in our IT-CAD system.
Collapse
Affiliation(s)
- Georgia D Tourassi
- Digital Advanced Imaging Laboratories, Department of Radiology, Duke University Medical Center, 2424 Erwin Road, Hock Plaza, Suite 302, Durham, NC 27710, USA.
| | | | | | | |
Collapse
|
47
|
Mazurowski MA, Habas PA, Zurada JM, Tourassi GD. Decision optimization of case-based computer-aided decision systems using genetic algorithms with application to mammography. Phys Med Biol 2008; 53:895-908. [PMID: 18263947 DOI: 10.1088/0031-9155/53/4/005] [Citation(s) in RCA: 25] [Impact Index Per Article: 1.6] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/11/2022]
Abstract
This paper presents an optimization framework for improving case-based computer-aided decision (CB-CAD) systems. The underlying hypothesis of the study is that each example in the knowledge database of a medical decision support system has different importance in the decision making process. A new decision algorithm incorporating an importance weight for each example is proposed to account for these differences. The search for the best set of importance weights is defined as an optimization problem and a genetic algorithm is employed to solve it. The optimization process is tailored to maximize the system's performance according to clinically relevant evaluation criteria. The study was performed using a CAD system developed for the classification of regions of interests (ROIs) in mammograms as depicting masses or normal tissue. The system was constructed and evaluated using a dataset of ROIs extracted from the Digital Database for Screening Mammography (DDSM). Experimental results show that, according to receiver operator characteristic (ROC) analysis, the proposed method significantly improves the overall performance of the CAD system as well as its average specificity for high breast mass detection rates.
Collapse
Affiliation(s)
- Maciej A Mazurowski
- Department of Electrical and Computer Engineering, University of Louisville, Louisville, KY 40292, USA.
| | | | | | | |
Collapse
|
48
|
Zheng B. Mass Detection Scheme for Digitized Mammography. Cancer Imaging 2008. [DOI: 10.1016/b978-012374212-4.50036-5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/25/2022] Open
|
49
|
Zheng B, Mello-Thoms C, Wang XH, Abrams GS, Sumkin JH, Chough DM, Ganott MA, Lu A, Gur D. Interactive computer-aided diagnosis of breast masses: computerized selection of visually similar image sets from a reference library. Acad Radiol 2007; 14:917-27. [PMID: 17659237 PMCID: PMC2043128 DOI: 10.1016/j.acra.2007.04.012] [Citation(s) in RCA: 17] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/27/2007] [Revised: 04/15/2007] [Accepted: 04/18/2007] [Indexed: 10/23/2022]
Abstract
RATIONALE AND OBJECTIVES The clinical utility of interactive computer-aided diagnosis (ICAD) systems depends on clinical relevance and visual similarity between the queried breast lesions and the ICAD-selected reference regions. The objective of this study is to develop and test a new ICAD scheme that aims improve visual similarity of ICAD-selected reference regions. MATERIALS AND METHODS A large and diverse reference library involving 3,000 regions of interests was established. For each queried breast mass lesion by the observer, the ICAD scheme segments the lesion, classifies its boundary spiculation level, and computes 14 image features representing the segmented lesion and its surrounding tissue background. A conditioned k-nearest neighbor algorithm is applied to select a set of the 25 most "similar" lesions from the reference library. After computing the mutual information between the queried lesion and each of these initially selected 25 lesions, the scheme displays the six reference lesions with the highest mutual information scores. To evaluate the automated selection process of the six "visually similar" lesions to the queried lesion, we conducted a two-alternative forced-choice observer preference study using 85 queried mass lesions. Two sets of reference lesions selected by one new automated ICAD scheme and the other previously reported scheme using a subjective rating method were randomly displayed on the left and right side of the queried lesion. Nine observers were asked to decide for each of the 85 queried lesions which one of the two reference sets was "more visually similar" to the queried lesion. RESULTS In classification of mass boundary spiculation levels, the overall agreement rate between the automated scheme and an observer is 58.8% (Kappa = 0.31). In observer preference study, the nine observers preferred on average the reference lesion sets selected by the automated scheme as being more visually similar than the set selected by the subjective rating approach in 53.2% of the queried lesions. The results were not significantly different for the two methods (P = .128). CONCLUSIONS This study suggests that using the new automated ICAD scheme, the interobserver variability related issues can thus be avoided. Furthermore, the new scheme maintains the similar performance level as the previous scheme using the subjective rating method that can select reference sets that are significantly more visually similar (P < .05) than when using traditional ICAD schemes in which the mass boundary spiculation levels are not accurately detected and quantified.
Collapse
Affiliation(s)
- Bin Zheng
- Department of Radiology, Imaging Research Center, University of Pittsburgh, Pittsburgh, PA 15213, USA.
| | | | | | | | | | | | | | | | | |
Collapse
|
50
|
Tourassi GD, Harrawood B, Singh S, Lo JY. Information-theoretic CAD system in mammography: Entropy-based indexing for computational efficiency and robust performance. Med Phys 2007; 34:3193-204. [PMID: 17879782 DOI: 10.1118/1.2751075] [Citation(s) in RCA: 28] [Impact Index Per Article: 1.6] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/07/2022] Open
Abstract
We have previously presented a knowledge-based computer-assisted detection (KB-CADe) system for the detection of mammographic masses. The system is designed to compare a query mammographic region with mammographic templates of known ground truth. The templates are stored in an adaptive knowledge database. Image similarity is assessed with information theoretic measures (e.g., mutual information) derived directly from the image histograms. A previous study suggested that the diagnostic performance of the system steadily improves as the knowledge database is initially enriched with more templates. However, as the database increases in size, an exhaustive comparison of the query case with each stored template becomes computationally burdensome. Furthermore, blind storing of new templates may result in redundancies that do not necessarily improve diagnostic performance. To address these concerns we investigated an entropy-based indexing scheme for improving the speed of analysis and for satisfying database storage restrictions without compromising the overall diagnostic performance of our KB-CADe system. The indexing scheme was evaluated on two different datasets as (i) a search mechanism to sort through the knowledge database, and (ii) a selection mechanism to build a smaller, concise knowledge database that is easier to maintain but still effective. There were two important findings in the study. First, entropy-based indexing is an effective strategy to identify fast a subset of templates that are most relevant to a given query. Only this subset could be analyzed in more detail using mutual information for optimized decision making regarding the query. Second, a selective entropy-based deposit strategy may be preferable where only high entropy cases are maintained in the knowledge database. Overall, the proposed entropy-based indexing scheme was shown to reduce the computational cost of our KB-CADe system by 55% to 80% while maintaining the system's diagnostic performance.
Collapse
Affiliation(s)
- Georgia D Tourassi
- Digital Advanced Imaging Laboratories, Department of Radiology, Duke University Medical Center, Durham, North Carolina 27705, USA.
| | | | | | | |
Collapse
|