Knowledge-based interpretation of MR brain images

A fast segmentation-free fully automated approach to white matter injury detection in preterm infants

White matter injury (WMI) is the most prevalent brain injury in the preterm neonate leading to developmental deficits. However, detecting WMI in magnetic resonance (MR) images of preterm neonate brains using traditional WM segmentation-based methods is difficult mainly due to lack of reliable preterm neonate brain atlases to guide segmentation. Hence, we propose a segmentation-free, fast, unsupervised, atlas-free WMI detection method. We detect the ventricles as blobs using a fast linear maximally stable extremal regions algorithm. A reference contour equidistant from the blobs and the brain-background boundary is used to identify tissue adjacent to the blobs. Assuming normal distribution of the gray-value intensity of this tissue, the outlier intensities in the entire brain region are identified as potential WMI candidates. Thereafter, false positives are discriminated using appropriate heuristics. Experiments using an expert-annotated dataset show that the proposed method runs 20 times faster than our earlier work which relied on time-consuming segmentation of the WM region, without compromising WMI detection accuracy. Graphical Abstract Key Steps of Segmentation-free WMI Detection.

Review of Computational Methods on Brain Symmetric and Asymmetric Analysis from Neuroimaging Techniques

The brain is the most complex organ in the human body and it is divided into two hemispheres—left and right. The left hemisphere is responsible for control of the right side of our body, whereas the right hemisphere is responsible for control of the left side of our body. Brain image segmentation from different neuroimaging modalities is one of the important parts of clinical diagnostic tools. Neuroimaging based digital imagery generally contain noise, inhomogeneity, aliasing artifacts, and orientational deviations. Therefore, accurate segmentation of brain images is a very difficult task. However, the development of accurate segmentation of brain images is very important and crucial for a correct diagnosis of any brain related diseases. One of the fundamental segmentation tasks is to identify and segment inter-hemispheric fissure/mid-sagittal planes, which separate the two hemispheres of the brain. Moreover, the symmetric/asymmetric analyses of left and right hemispheres of brain structures are important for radiologists to analyze diseases such as Alzheimer’s, autism, schizophrenia, lesions and epilepsy. Therefore, in this paper, we have analyzed the existing computational techniques used to find brain symmetric/asymmetric analysis in different neuroimaging techniques such as the magnetic resonance (MR), computed tomography (CT), positron emission tomography (PET), single-photon emission computed tomography (SPECT), which are utilized for detecting various brain related disorders.

Tumor detection from enhanced magnetic resonance imaging using fuzzy curvelet

Effective medical image analysis is possible by the use of technique known as segmentation. Segmentation is a very challenging task because there is not any standard segmentation method is available for any medical application. In this article, we have proposed an automatic brain MR image segmentation method. Fast discrete curvelet transform and spatial fuzzy C-mean algorithm is used for noise removal and segmentation of brain MR image. Fuzzy entropy has been used for calculating adaptive and optimal threshold to separate out the image segments. Our proposed system is exclusively based on the information contained by the image itself. No extra information and no human intervention are required in our proposed system. We have tested our proposed system on different T1, T2 and PD brain MR images.

Automatic model-guided segmentation of the human brain ventricular system from CT images

RATIONALE AND OBJECTIVES

Accurate segmentation of the brain ventricular system on computed tomographic (CT) imaging is useful in neurodiagnosis and neurosurgery. Manual segmentation is time consuming, usually not reproducible, and subjective. Because of image noise, low contrast between soft tissues, large interslice distance, large shape, and size variations of the ventricular system, no automatic method is presently available. The authors propose a model-guided method for the automated segmentation of the ventricular system.

MATERIALS AND METHODS

Fifty CT scans of patients with strokes at different sites were collected for this study. Given a brain CT image, its ventricular system was segmented in five steps: (1) a predefined volumetric model was registered (or deformed) onto the image; (2) according to the deformed model, eight regions of interest were automatically specified; (3) the intensity threshold of cerebrospinal fluid was calculated in a region of interest and used to segment all regions of cerebrospinal fluid from the entire brain volume; (4) each ventricle was segmented in its specified region of interest; and (5) intraventricular calcification regions were identified to refine the ventricular segmentation.

RESULTS

Compared to ground truths provided by experts, the segmentation results of this method achieved an average overlap ratio of 85% for the entire ventricular system. On a desktop personal computer with a dual-core central processing unit running at 2.13 GHz, about 10 seconds were required to analyze each data set.

CONCLUSION

Experiments with clinical CT images showed that the proposed method can generate acceptable results in the presence of image noise, large shape, and size variations of the ventricular system, and therefore it is potentially useful for the quantitative interpretation of CT images in neurodiagnosis and neurosurgery.

Medical image segmentation using genetic algorithms

Genetic algorithms (GAs) have been found to be effective in the domain of medical image segmentation, since the problem can often be mapped to one of search in a complex and multimodal landscape. The challenges in medical image segmentation arise due to poor image contrast and artifacts that result in missing or diffuse organ/tissue boundaries. The resulting search space is therefore often noisy with a multitude of local optima. Not only does the genetic algorithmic framework prove to be effective in coming out of local optima, it also brings considerable flexibility into the segmentation procedure. In this paper, an attempt has been made to review the major applications of GAs to the domain of medical image segmentation.

Automatic segmentation of the human brain ventricles from MR images by knowledge-based region growing and trimming

Automatic segmentation of the human brain ventricular system from MR images is useful in studies of brain anatomy and its diseases. Existing intensity-based segmentation methods are adaptive to large shape and size variations of the ventricular system, but may leak to the non-ventricular regions due to the non-homogeneity, noise and partial volume effect in the images. Deformable model-based methods are more robust to noise and alleviate the leakage problem, but may generate wrong results when the shape or size of the ventricle to be segmented in the images has a large difference in comparison to its model. In this paper, we propose a knowledge-based region growing and trimming approach where: (1) a model of a ventricular system is used to define regions of interest (ROI) for the four ventricles (i.e., left, right, third and fourth); (2) to segment a ventricle in its ROI, a region growing procedure is first applied to obtain a connected region that contains the ventricle, and (3) a region trimming procedure is then employed to trim the non-ventricle regions. A hysteretic thresholding is developed for the region growing procedure to cope with the partial volume effect and minimize non-ventricular regions. The domain knowledge on the shape and intensity features of the ventricular system is used for the region trimming procedure. Due to the joint use of the model-based and intensity-based approaches, our method is robust to noise and large shape and size variations. Experiments on 18 simulated and 58 clinical MR images show that the proposed approach is able to segment the ventricular system accurately with the dice similarity coefficient ranging from 91% to 99%.

Prostate segmentation by feature enhancement using domain knowledge and adaptive region based operations

Estimation of prostate location and volume is essential in determining a dose plan for ultrasound-guided brachytherapy, a common prostate cancer treatment. However, manual segmentation is difficult, time consuming and prone to variability. In this paper, we present a semi-automatic discrete dynamic contour (DDC) model based image segmentation algorithm, which effectively combines a multi-resolution model refinement procedure together with the domain knowledge of the image class. The segmentation begins on a low-resolution image by defining a closed DDC model by the user. This contour model is then deformed progressively towards higher resolution images. We use a combination of a domain knowledge based fuzzy inference system (FIS) and a set of adaptive region based operators to enhance the edges of interest and to govern the model refinement using a DDC model. The automatic vertex relocation process, embedded into the algorithm, relocates deviated contour points back onto the actual prostate boundary, eliminating the need of user interaction after initialization. The accuracy of the prostate boundary produced by the proposed algorithm was evaluated by comparing it with a manually outlined contour by an expert observer. We used this algorithm to segment the prostate boundary in 114 2D transrectal ultrasound (TRUS) images of six patients scheduled for brachytherapy. The mean distance between the contours produced by the proposed algorithm and the manual outlines was 2.70 +/- 0.51 pixels (0.54 +/- 0.10 mm). We also showed that the algorithm is insensitive to variations of the initial model and parameter values, thus increasing the accuracy and reproducibility of the resulting boundaries in the presence of noise and artefacts.

Evolving Structure-Function Mappings in Cognitive Neuroscience Using Genetic Programming

A challenging goal of psychology and neuroscience is to map cognitive functions onto neuroanatomical structures. This paper shows how computational methods based upon evolutionary algorithms can facilitate the search for satisfactory mappings by efficiently combining constraints from neuroanatomy and physiology (the structures) with constraints from behavioural experiments (the functions). This methodology involves creation of a database coding for known neuroanatomical and physiological constraints, for mental programs made of primitive cognitive functions, and for typical experiments with their behavioural results. The evolutionary algorithms evolve theories mapping structures to functions in order to optimize the fit with the actual data. These theories lead to new, empirically testable predictions. The role of the prefrontal cortex in humans is discussed as an example. This methodology can be applied to the study of structures or functions alone, and can also be used to study other complex systems.

Segmentation of subcortical brain structures using fuzzy templates

We propose a novel method to automatically segment subcortical structures of human brain in magnetic resonance images by using fuzzy templates. A set of fuzzy templates of the structures based on features such as intensity, spatial location, and relative spatial relationship among structures are first created from a set of training images by defining the fuzzy membership functions and by fusing the information of features. Segmentation is performed by registering the fuzzy templates of the structures on the test image and then by fusing them with the tissue maps of the test image. The final decision is taken in order to optimize the certainty in the intensity, location, relative position, and tissue content of the structure. Our method does not require specific expert definition of each structure or manual interactions during segmentation process. The technique is demonstrated with the segmentation of five structures: thalamus, putamen, caudate, hippocampus, and amygdala; the performance of the present method is comparable with previous techniques.

Knowledge-driven automated extraction of the human cerebral ventricular system from MR images

This work presents an efficient and automated method to extract the human cerebral ventricular system from MRI driven by anatomic knowledge. The ventricular system is divided into six three-dimensional regions; six ROIs are defined based on the anatomy and literature studies regarding variability of the cerebral ventricular system. The distribution histogram of radiological properties is calculated in each ROI, and the intensity thresholds for extracting each region are automatically determined. Intensity inhomogeneities are accounted for by adjusting intensity threshold to match local situation. The extracting method is based on region-growing and anatomical knowledge, and is designed to include all ventricular parts, even if they appear unconnected on the image. The ventricle extraction method was implemented on the Window platform using C++, and was validated qualitatively on 30 MRI studies with variable parameters.

A flower image retrieval method based on ROI feature

Flower image retrieval is a very important step for computer-aided plant species recognition. In this paper, we propose an efficient segmentation method based on color clustering and domain knowledge to extract flower regions from flower images. For flower retrieval, we use the color histogram of a flower region to characterize the color features of flower and two shape-based features sets, Centroid-Contour Distance (CCD) and Angle Code Histogram (ACH), to characterize the shape features of a flower contour. Experimental results showed that our flower region extraction method based on color clustering and domain knowledge can produce accurate flower regions. Flower retrieval results on a database of 885 flower images collected from 14 plant species showed that our Region-of-Interest (ROI) based retrieval approach using both color and shape features can perform better than a method based on the global color histogram proposed by Swain and Ballard (1991) and a method based on domain knowledge-driven segmentation and color names proposed by Das et al.(1999).

Automatic segmentation of thalamus from brain MRI integrating fuzzy clustering and dynamic contours

Thalamus is an important neuro-anatomic structure in the brain. In this paper, an automated method is presented to segment thalamus from magnetic resonance images (MRI). The method is based on a discrete dynamic contour model that consists of vertices and edges connecting adjacent vertices. The model starts from an initial contour and deforms by external and internal forces. Internal forces are calculated from local geometry of the model and external forces are estimated from desired image features such as edges. However, thalamus has low contrast and discontinues edges on MRI, making external force estimation a challenge. The problem is solved using a new algorithm based on fuzzy C-means (FCM) unsupervised clustering, Prewitt edge-finding filter, and morphological operators. In addition, manual definition of the initial contour for the model makes the final segmentation operator-dependent. To eliminate this dependency, new methods are developed for generating the initial contour automatically. The proposed approaches are evaluated and validated by comparing automatic and radiologist's segmentation results and illustrating their agreement.

Automated human frontal lobe identification in MR images based on fuzzy-logic encoded expert anatomic knowledge

Identification of human brain structures in MR images comprises an area of increasing interest, which also presents numerous methodological challenges. Here we describe a new knowledge-based automated method designed to identify several major brain sulci and then to define the frontal lobes by using the identified sulci as landmarks. To identify brain sulci, sulcal images were generated by morphologic operations and then separated into different components based on connectivity analysis. Subsequently, the individual anatomic features were evaluated by using fuzzy membership functions. The crisp decisions, i.e., the identification of sulci, were made by taking the maximum of the summation of all the membership functions. The identification was designed in a hierarchical order. The longitudinal fissure was extracted first. The left and right central sulci were then identified based on the left and right hemispheres. Next, the lateral sulci were identified based on the central sulci and hemispheres. Finally, the left and right frontal lobes were defined from the two hemispheres. The method was evaluated by visual inspection, comparison with manual segmentation, and comparison with manually volumetric results in references. The average Jaccard similarities of left and right frontal lobes between the automated and manual segmentation were 0.89 and 0.91, respectively. The average Kappa indices of left and right frontal lobes between the automated and manual segmentation were 0.94 and 0.95, respectively. These results show relatively high accuracy of using this novel method for human frontal lobe identification and segmentation.

A knowledge-driven algorithm for a rapid and automatic extraction of the human cerebral ventricular system from MR neuroimages

A knowledge-driven algorithm for a rapid, robust, accurate, and automatic extraction of the human cerebral ventricular system from MR neuroimages is proposed. Its novelty is in combination of neuroanatomy, radiological properties, and variability of the ventricular system with image processing techniques. The ventricular system is divided into six 3D regions: bodies and inferior horns of the lateral ventricles, third ventricle, and fourth ventricle. Within each ventricular region, a 2D region of interest (ROI) is defined based on anatomy and variability. Each ventricular region is further subdivided into subregions, and conditions detecting and preventing leakage into the extra-ventricular space are specified for each subregion. The algorithm extracts the ventricular system by (1) processing each ROI (to calculate its local statistics, determine local intensity ranges of cerebrospinal fluid and gray and white matters, set a seed point within the ROI, grow region directionally in 3D, check anti-leakage conditions, and correct growing if leakage occurred) and (2) connecting all unconnected regions grown by relaxing growing conditions. The algorithm was validated qualitatively on 68 and quantitatively on 38 MRI normal and pathological cases (30 clinical, 20 MGH Brain Repository, and 18 MNI BrainWeb data sets). It runs successfully for normal and pathological cases provided that the slice thickness is less than 3.0 mm in axial and less than 2.0 mm in coronal directions, and the data do not have a high inter-slice intensity variability. The algorithm also works satisfactorily in the presence of up to 9% noise and up to 40% RF inhomogeneity for the BrainWeb data. The running time is less than 5 s on a Pentium 4, 2.0 GHz PC. The best overlap metric between the results of a radiology expert and the algorithm is 0.9879 and the worst 0.9527; the mean and standard deviation of the overlap metric are 0.9723 and 0.01087, respectively.

Automatic segmentation of subcortical brain structures in MR images using information fusion

This paper reports a new automated method for the segmentation of internal cerebral structures using an information fusion technique. The information is provided both by images and expert knowledge, and consists in morphological, topological, and tissue constitution data. All this ambiguous, complementary and redundant information is managed using a three-step fusion scheme based on fuzzy logic. The information is first modeled into a common theoretical frame managing its imprecision and incertitude. The models are then fused and a decision is taken in order to reduce the imprecision and to increase the certainty in the location of the structures. The whole process is illustrated on the segmentation of thalamus, putamen, and head of the caudate nucleus from expert knowledge and magnetic resonance images, in a protocol involving 14 healthy volunteers. The quantitative validation is achieved by comparing computed, manually segmented structures and published data by means of indexes assessing the accuracy of volume estimation and spatial location. Results suggest a consistent volume estimation with respect to the expert quantification and published data, and a high spatial similarity of the segmented and computed structures. This method is generic and applicable to any structure that can be defined by expert knowledge and morphological images.

Automated separation of gray and white matter from MR images of the human brain

A simple automatic procedure for segmentation of gray and white matter in high resolution 1.5T T1-weighted MR human brain images was developed and validated. The algorithm is based on histogram shape analysis of MR images that were corrected for scanner nonuniformity. Calibration and validation was done on a set of 80 MR images of human brains. The automatic method's values for the gray and white matter volumes were compared with the values from thresholds set twice by the best three of six raters. The automatic procedure was shown to perform as good as the best rater, where the average result of the best three raters was taken as reference. The method was also compared with two other histogram-based threshold methods, which yielded comparable results. The conclusion of the study thus is that automated threshold based methods can separate gray and white matter from MR brain images as reliably as human raters using a thresholding procedure.

Evolutionary computation in medicine: an overview

The term evolutionary computation encompasses a host of methodologies inspired by natural evolution that are used to solve hard problems. This paper provides an overview of evolutionary computation as applied to problems in the medical domains. We begin by outlining the basic workings of six types of evolutionary algorithms: genetic algorithms, genetic programming, evolution strategies, evolutionary programming, classifier systems, and hybrid systems. We then describe how evolutionary algorithms are applied to solve medical problems, including diagnosis, prognosis, imaging, signal processing, planning, and scheduling. Finally, we provide an extensive bibliography, classified both according to the medical task addressed and according to the evolutionary technique used.

Ovarian ultrasound image analysis: follicle segmentation

Ovarian ultrasound is an effective tool in infertility treatment. Repeated measurements of the size and shape of follicles over several days are the primary means of evaluation by physicians. Currently, follicle wall segmentation is achieved by manual tracing which is time consuming and susceptible to inter-operator variation. An automated method for follicle wall segmentation is reported that uses a four-step process based on watershed segmentation and knowledge-based graph search algorithm which utilizes priori information about follicle structure for inner and outer wall detection. The automated technique was tested on 36 ultrasonographic images of women's ovaries. Validation against manually traced borders has shown good correlation of manually defined and computer-determined area measurements (R2 = 0.85 - 0.96). The border positioning errors were small: 0.63+/-0.36 mm for inner border and 0.67+/-0.41 mm for outer border detection. The use of watershed segmentation and graph search methods facilitates fast, accurate inner and outer border detection with minimal user-interaction.

Segmentation and interpretation of MR brain images: an improved active shape model

This paper reports a novel method for fully automated segmentation that is based on description of shape and its variation using point distribution models (PDM's). An improvement of the active shape procedure introduced by Cootes and Taylor to find new examples of previously learned shapes using PDM's is presented. The new method for segmentation and interpretation of deep neuroanatomic structures such as thalamus, putamen, ventricular system, etc. incorporates a priori knowledge about shapes of the neuroanatomic structures to provide their robust segmentation and labeling in magnetic resonance (MR) brain images. The method was trained in eight MR brain images and tested in 19 brain images by comparison to observer-defined independent standards. Neuroanatomic structures in all testing images were successfully identified. Computer-identified and observer-defined neuroanatomic structures agreed well. The average labeling error was 7%+/-3%. Border positioning errors were quite small, with the average border positioning error of 0.8+/-0.1 pixels in 256 x 256 MR images. The presented method was specifically developed for segmentation of neuroanatomic structures in MR brain images. However, it is generally applicable to virtually any task involving deformable shape analysis.

Knowledge-based method for segmentation and analysis of lung boundaries in chest X-ray images

We present a knowledge-based approach to segmentation and analysis of the lung boundaries in chest X-rays. Image edges are matched to an anatomical model of the lung boundary using parametric features. A modular system architecture was developed which incorporates the model, image processing routines, an inference engine and a blackboard. Edges associated with the lung boundary are automatically identified and abnormal features are reported. In preliminary testing on 14 images for a set of 18 detectable abnormalities, the system showed a sensitivity of 88% and a specificity of 95% when compared with assessment by an experienced radiologist.

Precise segmentation of the lateral ventricles and caudate nucleus in MR brain images using anatomically driven histograms

This paper demonstrates a time-saving, automated method that helps to segment the lateral ventricles and caudate nucleus in T1-weighted coronal magnetic resonance (MR) brain images of normal control subjects. The method involves choosing intensity thresholds by using anatomical information and by locating peaks in histograms. To validate the method, the lateral ventricles and caudate nucleus were segmented in three brain scans by four experts, first using an established method involving isointensity contours and manual editing, and second using automatically generated intensity thresholds as an aid to the established method. The results demonstrate both time savings and increased reliability.

MRI measurement of brain tumor response: comparison of visual metric and automatic segmentation

An automatic magnetic resonance imaging (MRI) multispectral segmentation method and a visual metric are compared for their effectiveness to measure tumor response to therapy. Automatic response measurements are important for multicenter clinical trials. A visual metric such as the product of the largest diameter and the largest perpendicular diameter of the tumor is a standard approach, and is currently used in the Radiation Treatment Oncology Group (RTOG) and the Eastern Cooperative Oncology Group (EGOG) clinical trials. In the standard approach, the tumor response is based on the percentage change in the visual metric and is categorized into cure, partial response, stable disease, or progression. Both visual and automatic methods are applied to six brain tumor cases (gliomas) of varying levels of segmentation difficulty. The analyzed data were serial multispectral MR images, collected using MR contrast enhancement. A fully automatic knowledge guided method (KG) was applied to the MRI multispectral data, while the visual metric was taken from the MRI films using the T1 gadolinium enhanced image, with repeat measurements done by two radiologists and two residents. Tumor measurements from both visual and automatic methods are compared to "ground truth," (GT) i.e., manually segmented tumor. The KG method was found to slightly overestimate tumor volume, but in a consistent manner, and the estimated tumor response compared very well to hand-drawn ground truth with a correlation coefficient of 0.96. In contrast, the visually estimated metric had a large variation between observers, particularly for difficult cases, where the tumor margins are not well delineated. The inter-observer variation for the measurement of the visual metric was only 16%, i.e., observers generally agreed on the lengths of the diameters. However, in 30% of the studied cases no consensus was found for the categorical tumor response measurement, indicating that the categories are very sensitive to variations in the diameter measurements. Moreover, the method failed to correctly identify the response in half of the cases. The data demonstrate that automatic 3D methods are clearly necessary for objective and clinically meaningful assessment of tumor volume in single or multicenter clinical trials.