Linear structures in mammographic images: detection and classification

Punctured window based multiscale line detector for efficient segmentation of retinal blood vessels

Changes in the retinal vasculature can help diagnose diseases like diabetes, hypertension, and arteriosclerosis. To enable ophthalmologists to provide an efficient diagnosis and further reduce the cost of treatment, we propose an automated algorithm for the segmentation of retinal vasculature. Line detector is a classic approach for vessel-like structure detection or segmentation but with a fundamental flaw in estimation of the background intensity around a pixel. In this work, we highlight and rectify that issue in the classic line detector, by introducing the idea of punctured windows. This enhances the ability of a line detector to identify minor vessels in low contrast regions. Firstly, the image is denoised using a fractional filter. Then, the line detector with punctured window is used to compute the line responses at multiple scales. The final response is computed as the arithmetic mean of all responses at different scales and the underlying image intensity. Finally, hysteresis thresholding is applied to obtain the segmented vessels. The majority of methods proposed in the literature are evaluated only on DRIVE and STARE datasets, and using the performance metrics that are biased due to the issue of class imbalance. While many other methods fail to be consistent either across different datasets or the performance metrics used. The proposed algorithm is tested on four publically available datasets, namely, RC-SLO, STARE, CHASE_DB1, and DRIVE using several performance metrics that are unaffected by the class imbalance prevalent in vessel classification problems. The proposed technique is comparable with state-of-the-art methods and outperforms many of them.

Multi-discriminator adversarial convolutional network for nerve fiber segmentation in confocal corneal microscopy images

Quantitative measurements of corneal sub-basal nerves are biomarkers for many ocular surface disorders, and are also important for early diagnosis and assessment of progression of neurodegenerative diseases. This paper aims to develop an automatic method for nerve fiber segmentation from in vivo corneal confocal microscopy (CCM) images, which is fundamental for nerve morphology quantification. A novel multi-discriminator adversarial convolutional network (MDACN) is proposed, where both the generator and the two discriminators emphasize multi-scale feature representations. The generator is a U-shaped fully convolutional network with multi-scale split and concatenate blocks, and the two discriminators have different effective receptive fields, sensitive to features of different scales. A novel loss function is also proposed which enables the network to pay more attention to thin fibers. The MDACN framework was evaluated on four datasets. Experiment results show that our method has excellent segmentation performance for corneal nerve fibers and outperforms some state-of-the-art methods.

A synthesizing method for signal-enhanced and artifact-reduced mammogram from digital breast tomosynthesis

In this paper, we propose a method for compositing a synthetic mammogram (SM) from digital breast tomosynthesis (DBT) slice images. The method consists of four parts. The first part is image reconstruction of DBT from the acquired projection data by use of backprojection-filtration (BPF) algorithm with a low-frequency boosting scheme and a high-density object reduction technique embedded. Also, a few expectation-maximization (EM) iterations have been additively implemented on top of the BPF algorithm to prepare a separate volume image. The second is generating three kinds of intermediate SMs. A forward projection image and a linear structure weighted forward projection image were computed. A maximum intensity projection of the BPF reconstructed volume image was also generated. The third part is integrating three intermediate SMs. The last is the post-processing of the SM. We scanned two physical phantoms in a prototype DBT scanner, and we have evaluated the performance of the proposed method. We also performed a clinical data study by use of 30 patient data who went through both DBT and digital mammography (DM) scans. Three experienced radiologists have read the SMs generated by several component techniques and also read the DM of each patient, and evaluated the generated SMs. The experimental phantom study and the clinical reader study consistently demonstrated the usefulness of the proposed method.

A new robust method for blood vessel segmentation in retinal fundus images based on weighted line detector and hidden Markov model

BACKGROUND AND OBJECTIVE

Automatic vessel segmentation is a crucial preliminary processing step to facilitate ophthalmologist diagnosis in some diseases. But, due to the complexity of retinal fundus image, there are some problems on accurate segmentation of retinal vessel. In this paper, a new method for retinal vessel segmentation is proposed to handle two main problems: thin vessel missing and false detection in difficult regions.

METHODS

First, an improved line detector is proposed and used to fast extract the major structures of vessels. Then, Hidden Markov model (HMM) is applied to effectively detect vessel centerlines that include thin vessels. Finally, a denoising approach is presented to remove noises and two types of vessels are unified to obtain the complete segmentation results.

RESULTS

Our method is tested on two public databases (DRIVE and STARE databases), and five measures namely accuracy (Acc), sensitivity (Se), specificity (Sp), Dice coefficient (Dc), structural similarity index (SSIM) and feature similarity index (FSIM) are used to evaluate our segmentation performance. The respective values of the performance measures are 0.9475, 0.7262, 0.9803, 0.7781, 0.9992 and 0.9793 for DRIVE dataset and 0.9535, 0.7865, 0.9730, 0.7764, 0.9987 and 0.9742 for STARE dataset.

CONCLUSIONS

The experiment results show that our method outperforms most published state-of-the-art methods and is better the result of a human observer. Moreover, in term of specificity, our proposed algorithm can obtain the best score among the unsupervised methods. Meanwhile, there are excellent structure and feature similarities between our result and the ground truth according to achieved SSIM and FSIM. Visual inspection on the segmentation results shows that the proposed method produces more accurate segmentations on some difficult regions such as optic disc and central light reflex while detecting thin vessels effectively compared with the other methods.

Line-Detection Based on the Sum of Gradient Angle Differences

This paper presents a method to detect line pixels based on the sum of gradient angle differences (SGAD). The gradient angle differences are calculated by comparing the four pairs of gradients arising from eight neighboring pixels. In addition, a method to classify line pixels into ridges and valleys is proposed. Furthermore, a simple line model is defined for simulation experiments. Experiments are conducted with simulation images generated using the simple line model for three line-detection methods: second-derivatives (SD)-based method, extremity-count (EC)-based method, and proposed method. The results of the simulation experiments show that the proposed method produces more accurate line-detection results than the other methods in terms of the root mean square error when the line width is relatively large. In addition, the experiments conducted with natural images show that the SD- and EC-based methods suffer from bifurcation, fragmentation, and missing pixels. By contrast, for the original and the noise-contaminated versions of the natural images, the proposed SGAD-based line-detection method is affected by such problems to a considerably smaller extent than the other two methods.

Retinal vascular segmentation using superpixel-based line operator and its application to vascular topology estimation

PURPOSE

Automatic methods of analyzing of retinal vascular networks, such as retinal blood vessel detection, vascular network topology estimation, and arteries/veins classification are of great assistance to the ophthalmologist in terms of diagnosis and treatment of a wide spectrum of diseases.

METHODS

We propose a new framework for precisely segmenting retinal vasculatures, constructing retinal vascular network topology, and separating the arteries and veins. A nonlocal total variation inspired Retinex model is employed to remove the image intensity inhomogeneities and relatively poor contrast. For better generalizability and segmentation performance, a superpixel-based line operator is proposed as to distinguish between lines and the edges, thus allowing more tolerance in the position of the respective contours. The concept of dominant sets clustering is adopted to estimate retinal vessel topology and classify the vessel network into arteries and veins.

RESULTS

The proposed segmentation method yields competitive results on three public data sets (STARE, DRIVE, and IOSTAR), and it has superior performance when compared with unsupervised segmentation methods, with accuracy of 0.954, 0.957, and 0.964, respectively. The topology estimation approach has been applied to five public databases (DRIVE,STARE, INSPIRE, IOSTAR, and VICAVR) and achieved high accuracy of 0.830, 0.910, 0.915, 0.928, and 0.889, respectively. The accuracies of arteries/veins classification based on the estimated vascular topology on three public databases (INSPIRE, DRIVE and VICAVR) are 0.90.9, 0.910, and 0.907, respectively.

CONCLUSIONS

The experimental results show that the proposed framework has effectively addressed crossover problem, a bottleneck issue in segmentation and vascular topology reconstruction. The vascular topology information significantly improves the accuracy on arteries/veins classification.

Particle swarm optimization method for small retinal vessels detection on multiresolution fundus images

Retinal vessel segmentation plays an important role in the diagnosis of eye diseases and is considered as one of the most challenging tasks in computer-aided diagnosis (CAD) systems. The main goal of this study was to propose a method for blood-vessel segmentation that could deal with the problem of detecting vessels of varying diameters in high- and low-resolution fundus images. We proposed to use the particle swarm optimization (PSO) algorithm to improve the multiscale line detection (MSLD) method. The PSO algorithm was applied to find the best arrangement of scales in the MSLD method and to handle the problem of multiscale response recombination. The performance of the proposed method was evaluated on two low-resolution (DRIVE and STARE) and one high-resolution fundus (HRF) image datasets. The data include healthy (H) and diabetic retinopathy (DR) cases. The proposed approach improved the sensitivity rate against the MSLD by 4.7% for the DRIVE dataset and by 1.8% for the STARE dataset. For the high-resolution dataset, the proposed approach achieved 87.09% sensitivity rate, whereas the MSLD method achieves 82.58% sensitivity rate at the same specificity level. When only the smallest vessels were considered, the proposed approach improved the sensitivity rate by 11.02% and by 4.42% for the healthy and the diabetic cases, respectively. Integrating the proposed method in a comprehensive CAD system for DR screening would allow the reduction of false positives due to missed small vessels, misclassified as red lesions.

Locally adaptive decision in detection of clustered microcalcifications in mammograms

In computer-aided detection or diagnosis of clustered microcalcifications (MCs) in mammograms, the performance often suffers from not only the presence of false positives (FPs) among the detected individual MCs but also large variability in detection accuracy among different cases. To address this issue, we investigate a locally adaptive decision scheme in MC detection by exploiting the noise characteristics in a lesion area. Instead of developing a new MC detector, we propose a decision scheme on how to best decide whether a detected object is an MC or not in the detector output. We formulate the individual MCs as statistical outliers compared to the many noisy detections in a lesion area so as to account for the local image characteristics. To identify the MCs, we first consider a parametric method for outlier detection, the Mahalanobis distance detector, which is based on a multi-dimensional Gaussian distribution on the noisy detections. We also consider a non-parametric method which is based on a stochastic neighbor graph model of the detected objects. We demonstrated the proposed decision approach with two existing MC detectors on a set of 188 full-field digital mammograms (95 cases). The results, evaluated using free response operating characteristic (FROC) analysis, showed a significant improvement in detection accuracy by the proposed outlier decision approach over traditional thresholding (the partial area under the FROC curve increased from 3.95 to 4.25, p-value  <10^-4). There was also a reduction in case-to-case variability in detected FPs at a given sensitivity level. The proposed adaptive decision approach could not only reduce the number of FPs in detected MCs but also improve case-to-case consistency in detection.

A robust technique based on VLM and Frangi filter for retinal vessel extraction and denoising

The exploration of retinal vessel structure is colossally important on account of numerous diseases including stroke, Diabetic Retinopathy (DR) and coronary heart diseases, which can damage the retinal vessel structure. The retinal vascular network is very hard to be extracted due to its spreading and diminishing geometry and contrast variation in an image. The proposed technique consists of unique parallel processes for denoising and extraction of blood vessels in retinal images. In the preprocessing section, an adaptive histogram equalization enhances dissimilarity between the vessels and the background and morphological top-hat filters are employed to eliminate macula and optic disc, etc. To remove local noise, the difference of images is computed from the top-hat filtered image and the high-boost filtered image. Frangi filter is applied at multi scale for the enhancement of vessels possessing diverse widths. Segmentation is performed by using improved Otsu thresholding on the high-boost filtered image and Frangi's enhanced image, separately. In the postprocessing steps, a Vessel Location Map (VLM) is extracted by using raster to vector transformation. Postprocessing steps are employed in a novel way to reject misclassified vessel pixels. The final segmented image is obtained by using pixel-by-pixel AND operation between VLM and Frangi output image. The method has been rigorously analyzed on the STARE, DRIVE and HRF datasets.

Global detection approach for clustered microcalcifications in mammograms using a deep learning network

In computerized detection of clustered microcalcifications (MCs) from mammograms, the traditional approach is to apply a pattern detector to locate the presence of individual MCs, which are subsequently grouped into clusters. Such an approach is often susceptible to the occurrence of false positives (FPs) caused by local image patterns that resemble MCs. We investigate the feasibility of a direct detection approach to determining whether an image region contains clustered MCs or not. Toward this goal, we develop a deep convolutional neural network (CNN) as the classifier model to which the input consists of a large image window ([Formula: see text] in size). The multiple layers in the CNN classifier are trained to automatically extract image features relevant to MCs at different spatial scales. In the experiments, we demonstrated this approach on a dataset consisting of both screen-film mammograms and full-field digital mammograms. We evaluated the detection performance both on classifying image regions of clustered MCs using a receiver operating characteristic (ROC) analysis and on detecting clustered MCs from full mammograms by a free-response receiver operating characteristic analysis. For comparison, we also considered a recently developed MC detector with FP suppression. In classifying image regions of clustered MCs, the CNN classifier achieved 0.971 in the area under the ROC curve, compared to 0.944 for the MC detector. In detecting clustered MCs from full mammograms, at 90% sensitivity, the CNN classifier obtained an FP rate of 0.69 clusters/image, compared to 1.17 clusters/image by the MC detector. These results indicate that using global image features can be more effective in discriminating clustered MCs from FPs caused by various sources, such as linear structures, thereby providing a more accurate detection of clustered MCs on mammograms.

Characterizing Architectural Distortion in Mammograms by Linear Saliency

Architectural distortion (AD) is a common cause of false-negatives in mammograms. This lesion usually consists of a central retraction of the connective tissue and a spiculated pattern radiating from it. This pattern is difficult to detect due the complex superposition of breast tissue. This paper presents a novel AD characterization by representing the linear saliency in mammography Regions of Interest (ROI) as a graph composed of nodes corresponding to locations along the ROI boundary and edges with a weight proportional to the line intensity integrals along the path connecting any pair of nodes. A set of eigenvectors from the adjacency matrix is then used to extract discriminant coefficients that represent those nodes with higher salient lines. A dimensionality reduction is further accomplished by selecting the pair of nodes with major contribution for each of the computed eigenvectors. The set of main salient lines is then assembled as a feature vector that inputs a conventional Support Vector Machine (SVM). Experimental results with two benchmark databases, the mini-MIAS and DDSM databases, demonstrate that the proposed linear saliency domain method (LSD) performs well in terms of accuracy. The approach was evaluated with a set of 246 RoI extracted from the DDSM (123 normal tissues and 123 AD) and a set of 38 ROI from the mini-MIAS collections (19 normal tissues and 19 AD) respectively. The classification results showed respectively for both databases an accuracy rate of 89 % and 87 %, a sensitivity rate of 85 % and 95 %, and a specificity rate of 93 % and 84 %. Likewise, the area under curve (A _z ) of the Receiver Operating Characteristic (ROC) curve was 0.93 for both databases.

Improving the accuracy in detection of clustered microcalcifications with a context-sensitive classification model

PURPOSE

In computer-aided detection of microcalcifications (MCs), the detection accuracy is often compromised by frequent occurrence of false positives (FPs), which can be attributed to a number of factors, including imaging noise, inhomogeneity in tissue background, linear structures, and artifacts in mammograms. In this study, the authors investigated a unified classification approach for combating the adverse effects of these heterogeneous factors for accurate MC detection.

METHODS

To accommodate FPs caused by different factors in a mammogram image, the authors developed a classification model to which the input features were adapted according to the image context at a detection location. For this purpose, the input features were defined in two groups, of which one group was derived from the image intensity pattern in a local neighborhood of a detection location, and the other group was used to characterize how a MC is different from its structural background. Owing to the distinctive effect of linear structures in the detector response, the authors introduced a dummy variable into the unified classifier model, which allowed the input features to be adapted according to the image context at a detection location (i.e., presence or absence of linear structures). To suppress the effect of inhomogeneity in tissue background, the input features were extracted from different domains aimed for enhancing MCs in a mammogram image. To demonstrate the flexibility of the proposed approach, the authors implemented the unified classifier model by two widely used machine learning algorithms, namely, a support vector machine (SVM) classifier and an Adaboost classifier. In the experiment, the proposed approach was tested for two representative MC detectors in the literature [difference-of-Gaussians (DoG) detector and SVM detector]. The detection performance was assessed using free-response receiver operating characteristic (FROC) analysis on a set of 141 screen-film mammogram (SFM) images (66 cases) and a set of 188 full-field digital mammogram (FFDM) images (95 cases).

RESULTS

The FROC analysis results show that the proposed unified classification approach can significantly improve the detection accuracy of two MC detectors on both SFM and FFDM images. Despite the difference in performance between the two detectors, the unified classifiers can reduce their FP rate to a similar level in the output of the two detectors. In particular, with true-positive rate at 85%, the FP rate on SFM images for the DoG detector was reduced from 1.16 to 0.33 clusters/image (unified SVM) and 0.36 clusters/image (unified Adaboost), respectively; similarly, for the SVM detector, the FP rate was reduced from 0.45 clusters/image to 0.30 clusters/image (unified SVM) and 0.25 clusters/image (unified Adaboost), respectively. Similar FP reduction results were also achieved on FFDM images for the two MC detectors.

CONCLUSIONS

The proposed unified classification approach can be effective for discriminating MCs from FPs caused by different factors (such as MC-like noise patterns and linear structures) in MC detection. The framework is general and can be applicable for further improving the detection accuracy of existing MC detectors.

Vessel extraction from non-fluorescein fundus images using orientation-aware detector

The automatic extraction of blood vessels in non-fluorescein eye fundus images is a tough task in applications such as diabetic retinopathy screening. However, vessel shapes have complex variations, and accurate modeling of retinal vascular structures is challenging. We have therefore developed a new approach to accurately extract blood vessels in non-fluorescein fundus images using an orientation-aware detector (OAD). The detector was designed according to the intrinsic property of vessels being locally oriented and having linearly elongated structures. We employ the OAD to extract vessel shapes with no assumptions on parametric orientations of vessel shapes. The orientations of vessels can be efficiently modeled by the energy distribution of Fourier transformation. Accordingly, both wide and thin vessels can be extracted with two-scale segmentation in which line operators are applied in large scale and the Gabor filter bank is applied in small scale. A post-processing technique, based on the path opening operation, is applied to eliminate false responses to nonvascular areas, such as retinal structures (optic disc and macula) and pathologies (exudates, hemorrhages,and microaneurysms). This makes the detector robust and structure-aware. By achieving a competitive CAL measurement of 80.82% for the DRIVE database and 68.94% for the STARE, the experimental results demonstrated that the OAD approach outperforms existing segmentation methods. Furthermore, the proposed approach effectively works with non-fluorescein fundus images and proves highly accurate and robust in complicated regions such as the central reflex, close vessels, and crossover points, despite a high level of illumination noise in the original data.

Digital Topology and Geometry in Medical Imaging: A Survey

Digital topology and geometry refers to the use of topologic and geometric properties and features for images defined in digital grids. Such methods have been widely used in many medical imaging applications, including image segmentation, visualization, manipulation, interpolation, registration, surface-tracking, object representation, correction, quantitative morphometry etc. Digital topology and geometry play important roles in medical imaging research by enriching the scope of target outcomes and by adding strong theoretical foundations with enhanced stability, fidelity, and efficiency. This paper presents a comprehensive yet compact survey on results, principles, and insights of methods related to digital topology and geometry with strong emphasis on understanding their roles in various medical imaging applications. Specifically, this paper reviews methods related to distance analysis and path propagation, connectivity, surface-tracking, image segmentation, boundary and centerline detection, topology preservation and local topological properties, skeletonization, and object representation, correction, and quantitative morphometry. A common thread among the topics reviewed in this paper is that their theory and algorithms use the principle of digital path connectivity, path propagation, and neighborhood analysis.

Disparity Estimation on Stereo Mammograms

We consider the problem of depth estimation on digital stereo mammograms. Being able to elucidate 3D information from stereo mammograms is an important precursor to conducting 3D digital analysis of data from this promising new modality. The problem is generally much harder than the classic stereo matching problem on visible light images of the natural world, since nearly all of the 3D structural information of interest exists as complex network of multilayered, heavily occluded curvilinear structures. Toward addressing this difficult problem, we formulate a new stereo model that minimizes a global energy functional to densely estimate disparity on stereo mammogram images, by introducing a new singularity index as a constraint to obtain better estimates of disparity along critical curvilinear structures. Curvilinear structures, such as vasculature and spicules, are particularly salient structures in the breast, and being able to accurately position them in 3D is a valuable goal. Experiments on synthetic images with known ground truth and on real stereo mammograms highlight the advantages of the proposed stereo model over the canonical stereo model.

Stochastic extraction of elongated curvilinear structures with applications

The automatic extraction of elongated curvilinear structures (CLSs) is an important task in various image processing applications, including numerous remote sensing, and biometrical and medical problems. To address this task, we develop a stochastic approach that relies on a fixed-grid, localized Radon transform for line segment extraction and a conditional random field model to incorporate local interactions and refine the extracted CLSs. We propose several different energy data terms, the appropriate choice of which allows us to process images with different noise and geometry properties. The contribution of this paper is the design of a flexible and robust elongated CLS extraction framework that is comparatively fast due to the use of a fixed-grid configuration and fast deterministic Radon-based line detector. We present several different applications of the developed approach, namely: 1) CLS extraction in mammographic images; 2) road networks extraction from optical remotely sensed images; and 3) line extraction from palmprint images. The experimental results demonstrate that the method is fairly robust to CLS curvature and can accurately extract blurred and low-contrast elongated CLS.

Automated detection of proliferative diabetic retinopathy using a modified line operator and dual classification

Proliferative diabetic retinopathy (PDR) is a condition that carries a high risk of severe visual impairment. The hallmark of PDR is neovascularisation, the growth of abnormal new vessels. This paper describes an automated method for the detection of new vessels in retinal images. Two vessel segmentation approaches are applied, using the standard line operator and a novel modified line operator. The latter is designed to reduce false responses to non-vessel edges. Both generated binary vessel maps hold vital information which must be processed separately. This is achieved with a dual classification system. Local morphology features are measured from each binary vessel map to produce two separate feature sets. Independent classification is performed for each feature set using a support vector machine (SVM) classifier. The system then combines these individual classification outcomes to produce a final decision. Sensitivity and specificity results using a dataset of 60 images are 0.862 and 0.944 respectively on a per patch basis and 1.00 and 0.90 respectively on a per image basis.

Optimization of breast mass classification using sequential forward floating selection (SFFS) and a support vector machine (SVM) model

PURPOSE

Improving radiologists' performance in classification between malignant and benign breast lesions is important to increase cancer detection sensitivity and reduce false-positive recalls. For this purpose, developing computer-aided diagnosis schemes has been attracting research interest in recent years. In this study, we investigated a new feature selection method for the task of breast mass classification.

METHODS

We initially computed 181 image features based on mass shape, spiculation, contrast, presence of fat or calcifications, texture, isodensity, and other morphological features. From this large image feature pool, we used a sequential forward floating selection (SFFS)-based feature selection method to select relevant features and analyzed their performance using a support vector machine (SVM) model trained for the classification task. On a database of 600 benign and 600 malignant mass regions of interest, we performed the study using a tenfold cross-validation method. Feature selection and optimization of the SVM parameters were conducted on the training subsets only.

RESULTS

The area under the receiver operating characteristic curve [Formula: see text] was obtained for the classification task. The results also showed that the most frequently selected features by the SFFS-based algorithm in tenfold iterations were those related to mass shape, isodensity, and presence of fat, which are consistent with the image features frequently used by radiologists in the clinical environment for mass classification. The study also indicated that accurately computing mass spiculation features from the projection mammograms was difficult, and failed to perform well for the mass classification task due to tissue overlap within the benign mass regions.

CONCLUSION

In conclusion, this comprehensive feature analysis study provided new and valuable information for optimizing computerized mass classification schemes that may have potential to be useful as a "second reader" in future clinical practice.

Detection of architectural distortion in prior mammograms via analysis of oriented patterns

We demonstrate methods for the detection of architectural distortion in prior mammograms of interval-cancer cases based on analysis of the orientation of breast tissue patterns in mammograms. We hypothesize that architectural distortion modifies the normal orientation of breast tissue patterns in mammographic images before the formation of masses or tumors. In the initial steps of our methods, the oriented structures in a given mammogram are analyzed using Gabor filters and phase portraits to detect node-like sites of radiating or intersecting tissue patterns. Each detected site is then characterized using the node value, fractal dimension, and a measure of angular dispersion specifically designed to represent spiculating patterns associated with architectural distortion. Our methods were tested with a database of 106 prior mammograms of 56 interval-cancer cases and 52 mammograms of 13 normal cases using the features developed for the characterization of architectural distortion, pattern classification via quadratic discriminant analysis, and validation with the leave-one-patient out procedure. According to the results of free-response receiver operating characteristic analysis, our methods have demonstrated the capability to detect architectural distortion in prior mammograms, taken 15 months (on the average) before clinical diagnosis of breast cancer, with a sensitivity of 80% at about five false positives per patient.

False-positive reduction in mammography using multiscale spatial Weber law descriptor and support vector machines

In a CAD system for the detection of masses, segmentation of mammograms yields regions of interest (ROIs), which are not only true masses but also suspicious normal tissues that result in false positives. We introduce a new method for false-positive reduction in this paper. The key idea of our approach is to exploit the textural properties of mammograms and for texture description, to use Weber law descriptor (WLD), which outperforms state-of-the-art best texture descriptors. The basic WLD is a holistic descriptor by its construction because it integrates the local information content into a single histogram, which does not take into account the spatial locality of micropatterns. We extend it into a multiscale spatial WLD (MSWLD) that better characterizes the texture micro structures of masses by incorporating the spatial locality and scale of microstructures. The dimension of the feature space generated by MSWLD becomes high; it is reduced by selecting features based on their significance. Finally, support vector machines are employed to classify ROIs as true masses or normal parenchyma. The proposed approach is evaluated using 1024 ROIs taken from digital database for screening mammography and an accuracy of Az = 0.99 ± 0.003 (area under receiver operating characteristic curve) is obtained. A comparison reveals that the proposed method has significant improvement over the state-of-the-art best methods for false-positive reduction problem.

Blood vessel segmentation methodologies in retinal images--a survey

Retinal vessel segmentation algorithms are a fundamental component of automatic retinal disease screening systems. This work examines the blood vessel segmentation methodologies in two dimensional retinal images acquired from a fundus camera and a survey of techniques is presented. The aim of this paper is to review, analyze and categorize the retinal vessel extraction algorithms, techniques and methodologies, giving a brief description, highlighting the key points and the performance measures. We intend to give the reader a framework for the existing research; to introduce the range of retinal vessel segmentation algorithms; to discuss the current trends and future directions and summarize the open problems. The performance of algorithms is compared and analyzed on two publicly available databases (DRIVE and STARE) of retinal images using a number of measures which include accuracy, true positive rate, false positive rate, sensitivity, specificity and area under receiver operating characteristic (ROC) curve.

Detecting and classifying linear structures in mammograms using random forests

Detecting and classifying curvilinear structure is important in many image interpretation tasks. We focus on the challenging problem of detecting such structure in mammograms and deciding whether it is normal or abnormal. We adopt a discriminative learning approach based on a Dual-Tree Complex Wavelet representation and random forest classification. We present results of a quantitative comparison of our approach with three leading methods from the literature and with learning-based variants of those methods. We show that our new approach gives significantly better results than any of the other methods, achieving an area under the ROC curve A(z) = 0.923 for curvilinear structure detection, and A(z) = 0.761 for distinguishing between normal and abnormal structure (spicules). A detailed analysis suggests that some of the improvement is due to discriminative learning, and some due to the DT-CWT representation, which provides local phase information and good angular resolution.

Multilevel learning-based segmentation of ill-defined and spiculated masses in mammograms

PURPOSE

A learning-based approach integrating the use of pixel-level statistical modeling and spiculation detection is presented for the segmentation of mammographic masses with ill-defined margins and spiculations.

METHODS

The algorithm involves a multiphase pixel-level classification, using a comprehensive group of features computed from regional intensity, shape, and textures, to generate a mass-conditional probability map (PM). Then, the mass candidate, along with the background clutters consisting of breast fibroglandular and other nonmass tissues, is extracted from the PM by integrating the prior knowledge of shape and location of masses. A multiscale steerable ridge detection algorithm is employed to detect spiculations. Finally, all the object-level findings, including mass candidate, detected spiculations, and clutters, along with the PM, are integrated by graph cuts to generate the final segmentation mask.

RESULTS

The method was tested on 54 masses (51 malignant and 3 benign), all with ill-defined margins and irregular shape or spiculations. The ground truth delineations were provided by five experienced radiologists. Area overlapping ratio of 0.689 (+/- 0.160) and 0.540 (+/- 0.164) were obtained for segmenting entire mass and margin portion only, respectively. Williams index of area and contour based measurements indicated that the segmentation results of the algorithm agreed well with the radiologists' delineation.

CONCLUSIONS

The proposed approach could closely delineate the mass body. Most importantly, it is capable of including mass margin and its spicule extensions which are considered as key features for breast lesion analyses.

Automatic optic disc detection from retinal images by a line operator

Under the framework of computer-aided eye disease diagnosis, this paper presents an automatic optic disc (OD) detection technique. The proposed technique makes use of the unique circular brightness structure associated with the OD, i.e., the OD usually has a circular shape and is brighter than the surrounding pixels whose intensity becomes darker gradually with their distances from the OD center. A line operator is designed to capture such circular brightness structure, which evaluates the image brightness variation along multiple line segments of specific orientations that pass through each retinal image pixel. The orientation of the line segment with the minimum/maximum variation has specific pattern that can be used to locate the OD accurately. The proposed technique has been tested over four public datasets that include 130, 89, 40, and 81 images of healthy and pathological retinas, respectively. Experiments show that the designed line operator is tolerant to different types of retinal lesion and imaging artifacts, and an average OD detection accuracy of 97.4% is obtained.

Snakules: a model-based active contour algorithm for the annotation of spicules on mammography

We have developed a novel, model-based active contour algorithm, termed "snakules", for the annotation of spicules on mammography. At each suspect spiculated mass location that has been identified by either a radiologist or a computer-aided detection (CADe) algorithm, we deploy snakules that are converging open-ended active contours also known as snakes. The set of convergent snakules have the ability to deform, grow and adapt to the true spicules in the image, by an attractive process of curve evolution and motion that optimizes the local matching energy. Starting from a natural set of automatically detected candidate points, snakules are deployed in the region around a suspect spiculated mass location. Statistics of prior physical measurements of spiculated masses on mammography are used in the process of detecting the set of candidate points. Observer studies with experienced radiologists to evaluate the performance of snakules demonstrate the potential of the algorithm as an image analysis technique to improve the specificity of CADe algorithms and as a CADe prompting tool.

General retinal vessel segmentation using regularization-based multiconcavity modeling

Detecting blood vessels in retinal images with the presence of bright and dark lesions is a challenging unsolved problem. In this paper, a novel multiconcavity modeling approach is proposed to handle both healthy and unhealthy retinas simultaneously. The differentiable concavity measure is proposed to handle bright lesions in a perceptive space. The line-shape concavity measure is proposed to remove dark lesions which have an intensity structure different from the line-shaped vessels in a retina. The locally normalized concavity measure is designed to deal with unevenly distributed noise due to the spherical intensity variation in a retinal image. These concavity measures are combined together according to their statistical distributions to detect vessels in general retinal images. Very encouraging experimental results demonstrate that the proposed method consistently yields the best performance over existing state-of-the-art methods on the abnormal retinas and its accuracy outperforms the human observer, which has not been achieved by any of the state-of-the-art benchmark methods. Most importantly, unlike existing methods, the proposed method shows very attractive performances not only on healthy retinas but also on a mixture of healthy and pathological retinas.

Dual-model automatic detection of nerve-fibres in corneal confocal microscopy images

Corneal Confocal Microscopy (CCM) imaging is a non-invasive surrogate of detecting, quantifying and monitoring diabetic peripheral neuropathy. This paper presents an automated method for detecting nerve-fibres from CCM images using a dual-model detection algorithm and compares the performance to well-established texture and feature detection methods. The algorithm comprises two separate models, one for the background and another for the foreground (nerve-fibres), which work interactively. Our evaluation shows significant improvement (p approximately 0) in both error rate and signal-to-noise ratio of this model over the competitor methods. The automatic method is also evaluated in comparison with manual ground truth analysis in assessing diabetic neuropathy on the basis of nerve-fibre length, and shows a strong correlation (r = 0.92). Both analyses significantly separate diabetic patients from control subjects (p approximately 0).

A model-based framework for the detection of spiculated masses on mammography

The detection of lesions on mammography is a repetitive and fatiguing task. Thus, computer-aided detection systems have been developed to aid radiologists. The detection accuracy of current systems is much higher for clusters of microcalcifications than for spiculated masses. In this article, the authors present a new model-based framework for the detection of spiculated masses. The authors have invented a new class of linear filters, spiculated lesion filters, for the detection of converging lines or spiculations. These filters are highly specific narrowband filters, which are designed to match the expected structures of spiculated masses. As a part of this algorithm, the authors have also invented a novel technique to enhance spicules on mammograms. This entails filtering in the radon domain. They have also developed models to reduce the false positives due to normal linear structures. A key contribution of this work is that the parameters of the detection algorithm are based on measurements of physical properties of spiculated masses. The results of the detection algorithm are presented in the form of free-response receiver operating characteristic curves on images from the Mammographic Image Analysis Society and Digital Database for Screening Mammography databases.

Eigendetection of masses considering false positive reduction and breast density information

The purpose of this article is to present a novel algorithm for the detection of masses in mammographic computer-aided diagnosis systems. Four key points provide the novelty of our approach: (1) the use of eigenanalysis for describing variation in mass shape and size; (2) a Bayesian detection methodology providing a mathematical sound framework, flexible enough to include additional information; (3) the use of a two-dimensional principal components analysis approach to facilitate false positive reduction; and (4) the incorporation of breast density information, a parameter correlated with the performance of most mass detection algorithms and which is not considered in existing approaches. To study the performance of the system two experiments were carried out. The first is related to the ability of the system to detect masses, and thus, free-response receiver operating characteristic analysis was used, showing that the method is able to give high accuracy at a high specificity (80% detection at 1.40 false positives per image). Second, the ability of the system to highlight the pixels belonging to a mass is studied using receiver operating characteristic analysis, resulting in A(z) = 0.89 +/- 0.04. In addition, the robustness of the approach is demonstrated in an experiment where we used the Digital Database for Screening Mammography database for training and the Mammographic Image Analysis Society database for testing the algorithm.

Digital mammogram spiculated mass detection and spicule segmentation using level sets

This letter presents an automated mammographic computer aided diagnosis (CAD) system to detect and segment spicules in digital mammograms, termed spiculation segmentation with level sets (SSLS). SSLS begins with a segmentation of the suspicious mass periphery, which is created using a previously developed adaptive level set segmentation algorithm (ALSSM) by the authors. The mammogram is then analyzed using features derived from the Dixon and Taylor Line Operator (DTLO), which is a method of linear structure enhancement. Features are extracted, optimized, and then the suspicious mass is classified as benign or malignant. To assess the system efficacy, 60 difficult mammographic images from the Digital Database of Screening Mammography (DDSM), containing 30 benign non-spiculated cases, 17 malignant spiculated cases, and 13 malignant non-spiculated cases, are analyzed. The initial spiculation detection method found 100% of the spiculated lesions with no false positive detections, and has area under the receiver operating characteristics (ROC) curve A(Z)=1.0. The values using ALSSM (periphery segmentation only) are A(Z)=0.9687 and 0.9708 for two investigated feature sets, and increases to A(Z)=0.986 2 using SSLS (spiculation segmentation). The best classification results are 93% overall accuracy (OA), with three false positives (FP) and one false negative (FN) using a 1-NN (Nearest Neighbor) or 2-NN classifier, and 92% OA with three FP and two FN using a maximum likelihood classifier.

Retinal blood vessel segmentation using line operators and support vector classification

In the framework of computer-aided diagnosis of eye diseases, retinal vessel segmentation based on line operators is proposed. A line detector, previously used in mammography, is applied to the green channel of the retinal image. It is based on the evaluation of the average grey level along lines of fixed length passing through the target pixel at different orientations. Two segmentation methods are considered. The first uses the basic line detector whose response is thresholded to obtain unsupervised pixel classification. As a further development, we employ two orthogonal line detectors along with the grey level of the target pixel to construct a feature vector for supervised classification using a support vector machine. The effectiveness of both methods is demonstrated through receiver operating characteristic analysis on two publicly available databases of color fundus images.

Breast image registration techniques: a survey

Breast cancer is the most common type of cancer in women worldwide. Image registration plays an important role in breast cancer detection. This paper gives an overview of the current state-of-the-art in the breast image registration techniques. For the intramodality registration techniques, X-ray, MRI, and ultrasound are the primary focuses of interest. Intermodality techniques will cover the combination of different modalities. Validation of breast registration methods is also discussed.

Detecting wide lines using isotropic nonlinear filtering

Lines provide important information in images, and line detection is crucial in many applications. However, most of the existing algorithms focus only on the extraction of line positions, ignoring line thickness. This paper presents a novel wide line detector using an isotropic nonlinear filter. Unlike most existing edge and line detectors which use directional derivatives, our proposed wide line detector applies a nonlinear filter to extract a line completely without any derivative. The detector is based on the isotropic responses via circular masks. A general scheme for the analysis of the robustness of the proposed wide line detector is introduced and the dynamic selection of parameters is developed. In addition, this paper investigates the relationship between the size of circular masks and the width of detected lines. A sequence of tests has been conducted on a variety of image samples and our experimental results demonstrate the feasibility and effectiveness of the proposed method.