Optimal linear transformation for MRI feature extraction

Diffractive optical computing in free space

Structured optical materials create new computing paradigms using photons, with transformative impact on various fields, including machine learning, computer vision, imaging, telecommunications, and sensing. This Perspective sheds light on the potential of free-space optical systems based on engineered surfaces for advancing optical computing. Manipulating light in unprecedented ways, emerging structured surfaces enable all-optical implementation of various mathematical functions and machine learning tasks. Diffractive networks, in particular, bring deep-learning principles into the design and operation of free-space optical systems to create new functionalities. Metasurfaces consisting of deeply subwavelength units are achieving exotic optical responses that provide independent control over different properties of light and can bring major advances in computational throughput and data-transfer bandwidth of free-space optical processors. Unlike integrated photonics-based optoelectronic systems that demand preprocessed inputs, free-space optical processors have direct access to all the optical degrees of freedom that carry information about an input scene/object without needing digital recovery or preprocessing of information. To realize the full potential of free-space optical computing architectures, diffractive surfaces and metasurfaces need to advance symbiotically and co-evolve in their designs, 3D fabrication/integration, cascadability, and computing accuracy to serve the needs of next-generation machine vision, computational imaging, mathematical computing, and telecommunication technologies.

Analysis of Hybrid Feature Optimization Techniques Based on the Classification Accuracy of Brain Tumor Regions Using Machine Learning and Further Evaluation Based on the Institute Test Data

Aim

The goal of this study was to get optimal brain tumor features from magnetic resonance imaging (MRI) images and classify them based on the three groups of the tumor region: Peritumoral edema, enhancing-core, and necrotic tumor core, using machine learning classification models.

Materials and Methods

This study's dataset was obtained from the multimodal brain tumor segmentation challenge. A total of 599 brain MRI studies were employed, all in neuroimaging informatics technology initiative format. The dataset was divided into training, validation, and testing subsets online test dataset (OTD). The dataset includes four types of MRI series, which were combined together and processed for intensity normalization using contrast limited adaptive histogram equalization methodology. To extract radiomics features, a python-based library called pyRadiomics was employed. Particle-swarm optimization (PSO) with varying inertia weights was used for feature optimization. Inertia weight with a linearly decreasing strategy (W1), inertia weight with a nonlinear coefficient decreasing strategy (W2), and inertia weight with a logarithmic strategy (W3) were different strategies used to vary the inertia weight for feature optimization in PSO. These selected features were further optimized using the principal component analysis (PCA) method to further reducing the dimensionality and removing the noise and improve the performance and efficiency of subsequent algorithms. Support vector machine (SVM), light gradient boosting (LGB), and extreme gradient boosting (XGB) machine learning classification algorithms were utilized for the classification of images into different tumor regions using optimized features. The proposed method was also tested on institute test data (ITD) for a total of 30 patient images.

Results

For OTD test dataset, the classification accuracy of SVM was 0.989, for the LGB model (LGBM) was 0.992, and for the XGB model (XGBM) was 0.994, using the varying inertia weight-PSO optimization method and the classification accuracy of SVM was 0.996 for the LGBM was 0.998, and for the XGBM was 0.994, using PSO and PCA-a hybrid optimization technique. For ITD test dataset, the classification accuracy of SVM was 0.994 for the LGBM was 0.993, and for the XGBM was 0.997, using the hybrid optimization technique.

Conclusion

The results suggest that the proposed method can be used to classify a brain tumor as used in this study to classify the tumor region into three groups: Peritumoral edema, enhancing-core, and necrotic tumor core. This was done by extracting the different features of the tumor, such as its shape, grey level, gray-level co-occurrence matrix, etc., and then choosing the best features using hybrid optimal feature selection techniques. This was done without much human expertise and in much less time than it would take a person.

Compressed Sensing Image Reconstruction of Scanning Electrochemical Microscopy Measurements Carried Out at Ultrahigh Scan Speeds Using Continuous Line Probes

Previous studies on scanning electrochemical microscopy (SECM) imaging with nonlocal continuous line probes (CLPs) have demonstrated the ability to increase areal imaging rates by an order of magnitude compared to SECM based on conventional ultramicroelectrode (UME) disk electrodes. Increasing the linear scan speed of the CLP during imaging presents an opportunity to increase imaging rates even further but results in a significant deterioration in image quality due to transport processes in the liquid electrolyte. Here, we show that compressed sensing (CS) postprocessing can be successfully applied to CLP-based SECM measurements to reconstruct images with minimal distortion at probe scan rates greatly exceeding the conventional SECM ″speed limit″. By systematically evaluating the image quality of images generated by adaptable postprocessing CS methods for CLP-SECM data collected at varying scan rates, this work establishes a new upper bound for CLP scan rates. While conventional SECM imaging typically uses probe scan speeds characterized by Péclet numbers (Pe) < 1, this study shows that CS postprocessing methods can allow for an accurate image reconstruction for Pe approaching 5, corresponding to an order of magnitude increase in the maximum probe scan speed. This upper limit corresponds to the onset of chaotic convective flows within the electrolyte for the probes investigated in this work, highlighting the importance of considering hydrodynamics in the design of fast-scanning probes.

Comparison of Multispectral Image-Processing Methods for Brain Tissue Classification in BrainWeb Synthetic Data and Real MR Images

Accurate quantification of brain tissue is a fundamental and challenging task in neuroimaging. Over the past two decades, statistical parametric mapping (SPM) and FMRIB's Automated Segmentation Tool (FAST) have been widely used to estimate gray matter (GM) and white matter (WM) volumes. However, they cannot reliably estimate cerebrospinal fluid (CSF) volumes. To address this problem, we developed the TRIO algorithm (TRIOA), a new magnetic resonance (MR) multispectral classification method. SPM8, SPM12, FAST, and the TRIOA were evaluated using the BrainWeb database and real magnetic resonance imaging (MRI) data. In this paper, the MR brain images of 140 healthy volunteers (51.5 ± 15.8 y/o) were obtained using a whole-body 1.5 T MRI system (Aera, Siemens, Erlangen, Germany). Before classification, several preprocessing steps were performed, including skull stripping and motion and inhomogeneity correction. After extensive experimentation, the TRIOA was shown to be more effective than SPM and FAST. For real data, all test methods revealed that the participants aged 20–83 years exhibited an age-associated decline in GM and WM volume fractions. However, for CSF volume estimation, SPM8-s and SPM12-m both produced different results, which were also different compared with those obtained by FAST and the TRIOA. Furthermore, the TRIOA performed consistently better than both SPM and FAST for GM, WM, and CSF volume estimation. Compared with SPM and FAST, the proposed TRIOA showed more advantages by providing more accurate MR brain tissue classification and volume measurements, specifically in CSF volume estimation.

Interactive Feature Space Explorer© for multi-modal magnetic resonance imaging

Wider information content of multi-modal biomedical imaging is advantageous for detection, diagnosis and prognosis of various pathologies. However, the necessity to evaluate a large number images might hinder these advantages and reduce the efficiency. Herein, a new computer aided approach based on the utilization of feature space (FS) with reduced reliance on multiple image evaluations is proposed for research and routine clinical use. The method introduces the physician experience into the discovery process of FS biomarkers for addressing biological complexity, e.g., disease heterogeneity. This, in turn, elucidates relevant biophysical information which would not be available when automated algorithms are utilized. Accordingly, the prototype platform was designed and built for interactively investigating the features and their corresponding anatomic loci in order to identify pathologic FS regions. While the platform might be potentially beneficial in decision support generally and specifically for evaluating outlier cases, it is also potentially suitable for accurate ground truth determination in FS for algorithm development. Initial assessments conducted on two different pathologies from two different institutions provided valuable biophysical perspective. Investigations of the prostate magnetic resonance imaging data resulted in locating a potential aggressiveness biomarker in prostate cancer. Preliminary findings on renal cell carcinoma imaging data demonstrated potential for characterization of disease subtypes in the FS.

Robust volume assessment of brain tissues for 3-dimensional fourier transformation MRI via a novel multispectral technique

A new TRIO algorithm method integrating three different algorithms is proposed to perform brain MRI segmentation in the native coordinate space, with no need of transformation to a standard coordinate space or the probability maps for segmentation. The method is a simple voxel-based algorithm, derived from multispectral remote sensing techniques, and only requires minimal operator input to depict GM, WM, and CSF tissue clusters to complete classification of a 3D high-resolution multislice-multispectral MRI data. Results showed very high accuracy and reproducibility in classification of GM, WM, and CSF in multislice-multispectral synthetic MRI data. The similarity indexes, expressing overlap between classification results and the ground truth, were 0.951, 0.962, and 0.956 for GM, WM, and CSF classifications in the image data with 3% noise level and 0% non-uniformity intensity. The method particularly allows for classification of CSF with 0.994, 0.961 and 0.996 of accuracy, sensitivity and specificity in images data with 3% noise level and 0% non-uniformity intensity, which had seldom performed well in previous studies. As for clinical MRI data, the quantitative data of brain tissue volumes aligned closely with the brain morphometrics in three different study groups of young adults, elderly volunteers, and dementia patients. The results also showed very low rates of the intra- and extra-operator variability in measurements of the absolute volumes and volume fractions of cerebral GM, WM, and CSF in three different study groups. The mean coefficients of variation of GM, WM, and CSF volume measurements were in the range of 0.03% to 0.30% of intra-operator measurements and 0.06% to 0.45% of inter-operator measurements. In conclusion, the TRIO algorithm exhibits a remarkable ability in robust classification of multislice-multispectral brain MR images, which would be potentially applicable for clinical brain volumetric analysis and explicitly promising in cross-sectional and longitudinal studies of different subject groups.

Prediction of glioblastoma multiform response to bevacizumab treatment using multi-parametric MRI

Glioblastoma multiform (GBM) is a highly malignant brain tumor. Bevacizumab is a recent therapy for stopping tumor growth and even shrinking tumor through inhibition of vascular development (angiogenesis). This paper presents a non-invasive approach based on image analysis of multi-parametric magnetic resonance images (MRI) to predict response of GBM to this treatment. The resulting prediction system has potential to be used by physicians to optimize treatment plans of the GBM patients. The proposed method applies signal decomposition and histogram analysis methods to extract statistical features from Gd-enhanced regions of tumor that quantify its microstructural characteristics. MRI studies of 12 patients at multiple time points before and up to four months after treatment are used in this work. Changes in the Gd-enhancement as well as necrosis and edema after treatment are used to evaluate the response. Leave-one-out cross validation method is applied to evaluate prediction quality of the models. Predictive models developed in this work have large regression coefficients (maximum R² = 0.95) indicating their capability to predict response to therapy.

Feature-space-based FMRI analysis using the optimal linear transformation

The optimal linear transformation (OLT), an image analysis technique of feature space, was first presented in the field of MRI. This paper proposes a method of extending OLT from MRI to functional MRI (fMRI) to improve the activation-detection performance over conventional approaches of fMRI analysis. In this method, first, ideal hemodynamic response time series for different stimuli were generated by convolving the theoretical hemodynamic response model with the stimulus timing. Second, constructing hypothetical signature vectors for different activity patterns of interest by virtue of the ideal hemodynamic responses, OLT was used to extract features of fMRI data. The resultant feature space had particular geometric clustering properties. It was then classified into different groups, each pertaining to an activity pattern of interest; the applied signature vector for each group was obtained by averaging. Third, using the applied signature vectors, OLT was applied again to generate fMRI composite images with high SNRs for the desired activity patterns. Simulations and a blocked fMRI experiment were employed for the method to be verified and compared with the general linear model (GLM)-based analysis. The simulation studies and the experimental results indicated the superiority of the proposed method over the GLM-based analysis in detecting brain activities.

The optimal linear transformation-based fMRI feature space analysis

This paper proposes a method of extending the optimal linear transformation (OLT), an image analysis technique of feature space, from magnetic resonance imaging (MRI) to functional magnetic resonance imaging (fMRI) so as to improve the activation detection performance over conventional approaches of fMRI analysis. The method was: (1) ideal hemodynamic responses for different stimuli were generated by convolving the theoretical hemodynamic response model with the stimulus timing, (2) considering the ideal hemodynamic responses as hypothetical signature vectors for different activity patterns of interest, OLT was used to extract the features of fMRI data. The resultant feature space had particular geometric clustering properties. It was then classified into different groups, each pertaining to an activity pattern of interest; the applied signature vector for each group was obtained by averaging, (3) using the applied signature vectors, OLT was applied again to generate fMRI composite images with high SNRs for the desired activity patterns. Simulations and a blocked fMRI experiment were employed to validate the proposed method. The simulation and the experiment results indicated the proposed method was capable of improving some conventional methods to be more sensitive to activations, having strong contrast between activations and inactivations, and being more valid for complex activity patterns.

AC133+ progenitor cells as gene delivery vehicle and cellular probe in subcutaneous tumor models: a preliminary study

Background

Despite enormous progress in gene therapy for breast cancer, an optimal systemic vehicle for delivering gene products to the target tissue is still lacking. The purpose of this study was to determine whether AC133+ progenitor cells (APC) can be used as both gene delivery vehicles and cellular probes for magnetic resonance imaging (MRI). In this study, we used superparamagentic iron oxide (SPIO)-labeled APCs to carry the human sodium iodide symporter (hNIS) gene to the sites of implanted breast cancer in mouse model. In vivo real time tracking of these cells was performed by MRI and expression of hNIS was determined by Tc-99m pertechnetate (Tc-99m) scan.

Results

Three million human breast cancer (MDA-MB-231) cells were subcutaneously implanted in the right flank of nude mice. APCs, isolated from fresh human cord blood, were genetically transformed to carry the hNIS gene using adenoviral vectors and magnetically labeled with ferumoxides-protamine sulfate (FePro) complexes. Magnetically labeled genetically transformed cells were administered intravenously in tumor bearing mice when tumors reached 0.5 cm in the largest dimension. MRI and single photon emission computed tomography (SPECT) images were acquired 3 and 7 days after cell injection, with a 7 Tesla animal MRI system and a custom built micro-SPECT using Tc-99m, respectively. Expression of hNIS in accumulated cells was determined by staining with anti-hNIS antibody. APCs were efficiently labeled with ferumoxide-protamine sulfate (FePro) complexes and transduced with hNIS gene. Our study showed not only the accumulation of intravenously administered genetically transformed, magnetically labeled APCs in the implanted breast cancer, but also the expression of hNIS gene at the tumor site. Tc-99m activity ratio (tumor/non-tumor) was significantly different between animals that received non-transduced and transduced cells (P < 0.001).

Conclusion

This study indicates that genetically transformed, magnetically labeled APCs can be used both as delivery vehicles and cellular probes for detecting in vivo migration and homing of cells. Furthermore, they can potentially be used as a gene carrier system for the treatment of tumor or other diseases.

Automated segmentation and classification of high throughput yeast assay spots

Several technologies for characterizing genes and proteins from humans and other organisms use yeast growth or color development as read outs. The yeast two-hybrid assay, for example, detects protein-protein interactions by measuring the growth of yeast on a specific solid medium, or the ability of the yeast to change color when grown on a medium containing a chromogenic substrate. Current systems for analyzing the results of these types of assays rely on subjective and inefficient scoring of growth or color by human experts. Here, an image analysis system is described for scoring yeast growth and color development in high throughput biological assays. The goal is to locate the spots and score them in color images of two types of plates named "X-Gal" and "growth assay" plates, with uniformly placed spots (cell areas) on each plate (both plates in one image). The scoring system relies on color for the X-Gal spots, and texture properties for the growth assay spots. A maximum likelihood projection-based segmentation is developed to automatically locate spots of yeast on each plate. Then color histogram and wavelet texture features are extracted for scoring using an optimal linear transformation. Finally, an artificial neural network is used to score the X-Gal and growth assay spots using the extracted features. The performance of the system is evaluated using spots of 60 images. After training the networks using training and validation sets, the system was assessed on the test set. The overall accuracies of 95.4% and 88.2% are achieved, respectively, for scoring the X-Gal and growth assay spots.

Part 1. Automated change detection and characterization in serial MR studies of brain-tumor patients

The goal of this study was to create an algorithm which would quantitatively compare serial magnetic resonance imaging studies of brain-tumor patients. A novel algorithm and a standard classify-subtract algorithm were constructed. The ability of both algorithms to detect and characterize changes was compared using a series of digital phantoms. The novel algorithm achieved a mean sensitivity of 0.87 (compared with 0.59 for classify-subtract) and a mean specificity of 0.98 (compared with 0.92 for classify-subtract) with regard to identification of voxels as changing or unchanging and classification of voxels into types of change. The novel algorithm achieved perfect specificity in seven of the nine experiments. The novel algorithm was additionally applied to a short series of clinical cases, where it was shown to identify visually subtle changes. Automated change detection and characterization could facilitate objective review and understanding of serial magnetic resonance imaging studies in brain-tumor patients.

Multiparametric ISODATA analysis of embolic stroke and rt-PA intervention in rat

To increase the sensitivity of MRI parameters to detect tissue damage of ischemic stroke, an unsupervised analysis method, Iterative Self-Organizing Data Analysis Technique Algorithm (ISODATA), was applied to analyze the temporal evolution of ischemic damage in a focal embolic cerebral ischemia model in rat with and without recombinant tissue plasminogen activator (rt-PA) treatment. Male Wistar rats subjected to embolic stroke were investigated using a 7-T MRI system. Rats were randomized into control (n=9) and treated (n=9) groups. The treated rats received rt-PA via a femoral vein at 4 h after onset of embolic ischemia. ISODATA analysis employed parametric maps or weighted images (T1, T2, and diffusion). ISODATA results with parametric maps are superior to ISODATA with weighted images, and both of them were highly correlated with the infarction size measured from the corresponding histological section. At 24 h after embolic stroke, the average map ISODATA lesion sizes were 37.7+/-7.0 and 39.2+/-5.6 mm2 for the treated and the control group, respectively. Average histological infarction areas were 37.9+/-7.4 mm2 for treated rats and 39.4+/-6.1 mm2 for controls. The R2 values of the linear correlation between map ISODATA and histological data were 0.98 and 0.96 for treated and control rats, respectively. Both histological and map ISODATA data suggest that there is no significant difference in infarction area between non-treated and rt-PA-treated rats when treatment was administered 4 h after the onset of embolic stroke. The ISODATA lesion size analysis was also sensitive to changes of lesion size during acute and subacute stages of stroke. Our data demonstrate that the multiparameter map ISODATA approach provides a more sensitive quantitation of the ischemic lesion at all time points than image ISODATA and single MRI parametric analysis using T1, T2 or ADCw.

Detection of spectral signatures in multispectral MR images for classification

This paper presents a new spectral signature detection approach to magnetic resonance (MR) image classification. It is called constrained energy minimization (CEM) method, which is derived from the minimum variance distortionless response in passive sensor array processing. It considers a bank of spectral channels as an array of sensors where each spectral channel represents a sensor and object spectral signature in multispectral MR images are viewed as signals impinging upon the array. The strength of the CEM lies on its ability in detection of spectral signatures of interest without knowing image background. The detected spectral signatures are then used for classification. The CEM makes use of a finite impulse response (FIR) filter to linearly constrain a desired object while minimizing interfering effects caused by other unknown signal sources. Unlike most spatial-based classification techniques, the proposed CEM takes advantage of spectral characteristics to achieve object detection and classification. A series of experiments is conducted and compared with the commonly used c-means method for performance evaluation. The results show that the CEM method is a promising and effective spectral technique for MR image classification.

Improved contrast in multispectral phase images derived from magnetic resonance exams of multiple sclerosis patients

We describe a method to extract data from multispectral MR exams of patients with Multiple Sclerosis (MS). The technique produces images of "spectral phase" (SP) relative to a reference tissue. SP images allow retrospective suppression of signal in the reference tissue, while maintaining high spatial resolution. Image quality in SP images was determined from MR exams of 5 MS patients selected at random from a clinical trial underway at our institute. Exams consisting of proton density weighted (PDw), T2 weighted (T2w), T1 weighted (T1w), and gadolinium-DTPA enhanced T1w (GAD) images were acquired from each patient. The MR exams were corrected for intensity nonuniformity, then filtered with an algorithm based upon anisotropic diffusion, to reduce noise. Principal component (PC) images and SP images relative to cerebrospinal fluid (SP(CSF)), normal appearing white matter (SP(NAWM)), gray matter (SP(GM)), and temporalis muscle (SP(MUS)) were then calculated. Contrast between tissues and MS lesions in the MR and derived images was then determined by measuring the signal-difference-to-noise ratio (dSNR) between tissues. Our new SP images provided better tissue contrast than the original MR, filtered MR, and PC images. Contrast improved between CSF and NAWM (from 19.5 to 56), CSF and GM (from 15 to 36), GM and NAWM (from 8 to 14), MS lesions and CSF (from 16 to 35), and between MS lesions and NAWM (from 24 to 47). (Maximum contrast in the original MR images compared to maximum contrast in the SP images.) The additional contrast in SP images may aid the quantification and analysis of lesion activity in MR exams of MS patients.

Orthogonal subspace projection-based approaches to classification of MR image sequences

Orthogonal subspace projection (OSP) approach has shown success in hyperspectral image classification. Recently, the feasibility of applying OSP to multispectral image classification was also demonstrated via SPOT (Satellite Pour 1'Observation de la Terra) and Landsat (Land Satellite) images. Since an MR (magnetic resonance) image sequence is also acquired by multiple spectral channels (bands), this paper presents a new application of OSP in MR image classification. The idea is to model an MR image pixel in the sequence as a linear mixture of substances (such as white matter, gray matter, cerebral spinal fluid) of interest from which each of these substances can be classified by a specific subspace projection operator followed by a desired matched filter. The experimental results show that OSP provides a promising alternative to existing MR image classification techniques.

Feature space analysis: effects of MRI protocols

We present a method for exploring the relationship between the image segmentation results obtained by an optimal feature space method and the MRI protocols used. The steps of the work accomplished are as follows. (1) Patients with brain tumors were imaged on a 1.5 T General Electric Signa MRI System using multiple protocols (T1 and T2-weighted fast spin-echo and FLAIR). T1-weighted images were acquired before and after gadolinium injection. (2) Image volumes were co-registered, and images of a slice through the center of the tumor were selected for processing. (3) For each patient, several image sets were defined by selecting certain MR images (e.g., 4T2's+ IT1, 4T2's+FLAIR, 2T2's+ 1T1). (4) Using each image set, the optimal feature space was generated and images were segmented into normal tissues and different tumor zones. (5) Segmentation results obtained using the different MRI sets were compared. Based on the analysis results from 27 image sets, we found that the locations of the clusters for the tumor zones and their corresponding regions in the image domain changed as a function of the MR images (MRI protocols) used. However, the segmentation results for the total lesion and normal tissues remained relatively unchanged.

Principal component analysis of the dynamic response measured by fMRI: a generalized linear systems framework

Principal component analysis (PCA) is one of several structure-seeking multivariate statistical techniques, exploratory as well as inferential, that have been proposed recently for the characterization and detection of activation in both PET and fMRI time series data. In particular, PCA is data driven and does not assume that the neural or hemodynamic response reaches some steady state, nor does it involve correlation with any pre-defined or exogenous experimental design template. In this paper, we present a generalized linear systems framework for PCA based on the singular value decomposition (SVD) model for representation of spatio-temporal fMRI data sets. Statistical inference procedures for PCA, including point and interval estimation will be introduced without the constraint of explicit hypotheses about specific task-dependent effects. The principal eigenvectors capture both the spatial and temporal aspects of fMRI data in a progressive fashion; they are inherently matched to unique and uncorrelated features and are ranked in order of the amount of variance explained. PCA also acts as a variation reduction technique, relegating most of the random noise to the trailing components while collecting systematic structure into the leading ones. Features summarizing variability may not directly be those that are the most useful. Further analysis is facilitated through linear subspace methods involving PC rotation and strategies of projection pursuit utilizing a reduced, lower-dimensional natural basis representation that retains most of the information. These properties will be illustrated in the setting of dynamic time-series response data from fMRI experiments involving pharmacological stimulation of the dopaminergic nigro-striatal system in primates.

Feature space analysis of MRI

This paper presents an MRI feature-space image-analysis method and its application to brain tumor studies. The proposed method generates a transformed feature space in which the normal tissues (white matter, gray matter, and CSF) become orthonormal. As such, the method is expected to have site-to-site and patient-to-patient consistency, and is useful for identification of tissue types, segmentation of tissues, and quantitative measurements on tissues. The steps of the work accomplished are as follows: (1) Four T2-weighted and two T1-weighted images (before and after injection of gadolinium) were acquired for 10 tumor patients. (2) Images were analyzed by an image analyst according to the proposed algorithm. (3) Biopsy samples were extracted from each patient and were subsequently analyzed by the pathology laboratory. (4) Image-analysis results were compared with the biopsy results. Pre- and postsurgery feature spaces were also compared. The proposed method made it possible to visualize the MRI feature space and to segment the image. In all cases, the operators were able to find clusters for normal and abnormal tissues. Also, clusters for different zones of the tumor were found. The method successfully segmented the image into normal tissues (white matter, gray matter, and CSF) and different zones of the lesion (tumor, cyst, edema, radiation necrosis, necrotic core, and infiltrated tumor). The results agreed with those obtained from the biopsy samples. Comparison of pre- with postsurgery and radiation feature spaces illustrated that the original solid tumor was not present in the second study, but a new tissue component appeared in a different location of the feature space. This tissue could be radiation necrosis generated as a result of radiation.

Brain tumor segmentation and characterization by pattern analysis of multispectral NMR images

A major problem in tumor treatment planning and evaluation is determination of the tumor extent. This paper presents a pattern analysis methodology for segmentation and characterization of brain tumors from multispectral NMR images. The proposed approach has been used in 15 clinical studies of cerebral tumor patients who have been scheduled for surgical biopsy and resection. The tissue biopsy results, obtained at specific spatial coordinates determined in the analysis, have been utilized to validate the methodology. It was found that in all cases the lesion had extended into normal tissue, at least to the location where the sample was taken. In most cases, the proposed method suggested that the lesion had extended several millimetres beyond the point from where the biopsy sample was taken. In some cases, the extent of the lesion into normal tissue was well beyond the boundary seen on T1- or T2-weighted images. It is concluded that the proposed approach indicates brain tumor infiltration more precisely than what is visualized in the original NMR images and therefore its utilization facilitates proper treatment planning for the cerebral tumor patients.