Clinical applications of fusion imaging in oncology

Medical Image Fusion using bi-dimensional empirical mode decomposition (BEMD) and an Efficient Fusion Scheme

Background

Medical image fusion is being widely used for capturing complimentary information from images of different modalities. Combination of useful information presented in medical images is the aim of image fusion techniques, and the fused image will exhibit more information in comparison with source images.

Objective

In the current study, a BEMD-based multi-modal medical image fusion technique is utilized. Moreover, Teager-Kaiser energy operator (TKEO) was applied to lower BIMFs. The results were compared to six routine methods.

Material and Methods

In this study, which is of experimental type, an image fusion technique using bi-dimensional empirical mode decomposition (BEMD), Teager-Kaiser energy operator (TKEO) as a local feature selection and Hierarchical Model And X (HMAX) model is presented. BEMD fusion technique can preserve much functional information. In the process of fusion, we adopt the fusion rule of TKEO for lower bi-dimensional intrinsic mode functions (BIMFs) of two images and HMAX visual cortex model as a fusion rule for higher BIMFs, which are verified to be more appropriate for human vision system. Integrating BEMD and this efficient fusion scheme can retain more spatial and functional features of input images.

Results

We compared our method with IHS, DWT, LWT, PCA, NSCT and SIST methods. The simulation results and fusion performance show that the presented method is effective in terms of mutual information, quality of fused image (QAB/F), standard deviation, peak signal to noise ratio, structural similarity and considerably better results compared to six typical fusion methods.

Conclusion

The statistical analyses revealed that our algorithm significantly improved spatial features and diminished the color distortion compared to other fusion techniques. The proposed approach can be used for routine practice. Fusion of functional and morphological medical images is possible before, during and after treatment of tumors in different organs. Image fusion can enable interventional events and can be further assessed.

Comparison of diffusion tensor, dynamic susceptibility contrast MRI and (99m)Tc-Tetrofosmin brain SPECT for the detection of recurrent high-grade glioma

INTRODUCTION

Treatment induced necrosis is a relatively frequent finding in patients treated for high-grade glioma. Differentiation by imaging modalities between glioma recurrence and treatment induced necrosis is not always straightforward. This is a comparative study of diffusion tensor imaging (DTI), dynamic susceptibility contrast MRI and (99m)Tc-Tetrofosmin brain single-photon emission computed tomography (SPECT) for differentiation of recurrent glioma from treatment induced necrosis.

METHODS

A prospective study was made of 30 patients treated for high-grade glioma who had suspected recurrent tumor on follow-up MRI. All had been treated by surgical resection of the tumor followed by standard postoperative radiotherapy with chemotherapy. No residual tumor had been found on brain imaging immediately after the initial treatment. All the patients were studied with dynamic susceptibility contrast brain MRI and, within a week, (99m)Tc-Tetrofosmin brain SPECT.

RESULTS

Both (99m)Tc-Tetrofosmin brain SPECT and dynamic susceptibility contrast MRI could discriminate between tumor recurrence and treatment induced necrosis with 100% sensitivity and 100% specificity. An apparent diffusion coefficient (ADC) ratio cut-off value of 1.27 could differentiate recurrence from treatment induced necrosis with 65% sensitivity and 100% specificity and a fractional anisotropy (FA) ratio cut-off value of 0.47 could differentiate recurrence from treatment induced necrosis with 57% sensitivity and 100% specificity. A significant correlation was demonstrated between (99m)Tc-Tetrofosmin uptake ratio and rCBV (P=0.003).

CONCLUSIONS

Dynamic susceptibility contrast MRI and brain SPECT with (99m)Tc-Tetrofosmin had the same accuracy and may be used to detect recurrent tumor following treatment for glioma. DTI also showed promise for the detection of recurrent tumor, but was inferior to both dynamic susceptibility contrast MRI and brain SPECT.

[Positron emission tomography/magnetic resonance: Present and future]

PET/MRI has recently been introduced onto the market after several years of research and development. The simple notion of combining the molecular capabilities of the PET and its difference available radiotracers with the excellent tissue resolution of the MRI and wide range of multiparametric imaging techniques has generated great expectations upon the possible uses of this technology. Many challenges must be worked out. However, the most urgent one is the derivation of the MRI-based attenuation correction map. This is especially true because the PET/CT has already demonstrated a huge clinical impact within oncology, neurology and cardiology during its short existence. Despite these difficulties, research is being carried out at a rapid pace in the clinical setting in order to find areas in which the PET/MRI is superior to other existing imaging modalities. In the few initial publications found up to date that have analyzed its clinical role, areas have been identified where PET/CT can migrate to PET/MRI, even if only to suppress the CT scan's ionizing radiation. Nonetheless, there are many theoretical applications in which the PET/MRI can further improve the field of diagnostic imaging. In this article, we will review those applications, the evidence existing regarding the MRI and PET that support those premises as well as that which we have learned in the short period of one year with our experience using the PET/MRI.

Single-Photon Emission Computed Tomography/Computed Tomography in Brain Tumors

Anatomic imaging procedures (computed tomography [CT] and magnetic resonance imaging [MRI]) have become essential tools for brain tumor assessment. Functional images (positron emission tomography [PET] and single-photon emission computed tomography [SPECT]) can provide additional information useful during the diagnostic workup to determine the degree of malignancy and as a substitute or guide for biopsy. After surgery and/or radiotherapy, nuclear medicine examinations are essential to assess persistence of tumor, to differentiate recurrence from radiation necrosis and gliosis, and to monitor the disease. The combination of functional images with anatomic ones is of the utmost importance for a full evaluation of these patients, which can be obtained by means of imaging fusion. Despite the fast-growing diffusion of PET, in most cases of brain tumors, SPECT studies are adequate and provide results that parallel those obtained with PET. The main limitation of SPECT imaging with brain tumor-seeking radiopharmaceuticals is the lack of precise anatomic details; this drawback is overcome by the fusion with morphological studies that provide an anatomic map to scintigraphic data. In the past, software-based fusion of independently performed SPECT and CT or MRI demonstrated usefulness for brain tumor assessment, but this process is often time consuming and not practical for everyday nuclear medicine studies. The recent development of dual-modality integrated imaging systems, which allow the acquisition of SPECT and CT images in the same scanning session, and their co-registration by means of the hardware, has facilitated this process. In SPECT studies of brain tumors with various radiopharmaceuticals, fused images are helpful in providing the precise localization of neoplastic lesions, and in excluding the disease in sites of physiologic tracer uptake. This information is useful for optimizing diagnosis, therapy monitoring, and radiotherapy treatment planning, with a positive impact on patient management.

Single-Photon Emission Computed Tomography/Computed Tomography in Abdominal Diseases

Single-photon emission computed tomography (SPECT) studies of the abdominal region are established in conventional nuclear medicine because of their easy and large availability, even in the most peripheral hospitals. It is well known that SPECT imaging demonstrates function, rather than anatomy. It is useful in the diagnosis of various disorders because of its ability to detect changes caused by disease before identifiable anatomic correlates and clinical manifestations exist. However, SPECT data frequently need anatomic landmarks to precisely depict the site of a focus of abnormal tracer uptake and the structures containing normal activity; the fusion with morphological studies can furnish an anatomical map to scintigraphic findings. In the past, software-based fusion of independently performed SPECT and CT or magnetic resonance images have been demonstrated to be time consuming and not useful for routine clinical employment. The recent development of dual-modality integrated imaging systems, which provide SPECT and CT images in the same scanning session, with the acquired images co-registered by means of the hardware, has created a new scenario. The first data have been mainly reported in oncology patients and indicate that SPECT/CT is very useful because it is able to provide further information of clinical value in several cases. In SPECT studies of abdominal diseases, hybrid SPECT/CT can play a role in the differential diagnosis of hepatic hemangiomas located near vascular structures, in precisely detecting and localizing active splenic tissue caused by splenosis in splenectomy patients, in providing important information for therapy optimization in patients submitted to hepatic arterial perfusion scintigraphy, in accurately identifying the involved bowel segments in patients with inflammatory bowel diseases, and in correctly localizing the bleeding sites in patients with gastrointestinal bleeding.

Bildfusion von SPECT und CT als präzisierende Diagnostik von malignen Tumoren im Mund-Kiefer-Gesichtsbereich

OBJECTIVE

The aim of this study was to evaluate the benefit of image fusion of CT (computertomography) and bone SPECT (single photon emission computed tomography) in diagnosis of head and neck cancer.

METHODS AND PATIENTS

Computer based image fusion has been applied in 39 patients with suspected cancer in the oromaxillofacial region following CT and SPECT without any further hazard for the patients. Afterwards image fusion was set in comparision to simultaneously evaluation of CT and SPECT and histological findings.

RESULTS

In 5 out of 39 patients SPECT/CT image fusion obtained more precise anatomical findings in tumour expansion than simultaneously evaluation of CT and SPECT.

CONCLUSION

For planning of surgical and radiation therapy of oral and maxillofacial cancer, image fusion of CT/SPECT provides efficient and plastical diagnostic imaging. Particularly in complex anatomical regions like maxilla or base of the skull image fusion could be an additional device, if simultaneous evaluation of CT and SPECT is not clear.

Preoperative Image Fusion of Fluoro-2-Deoxy-d-Glucose???Positron Emission Tomography and Computed Tomography Data Sets in Oral Maxillofacial Carcinoma

OBJECTIVE

The aim was to evaluate the clinical and therapeutic value of digital image fusion of 2-[18]-fluoro-2-deoxy-D-glucose (F18-FDG) positron emission tomography (PET) and computed tomography (CT) in patients suffering from an oral maxillofacial carcinoma.

METHODS

Seventeen patients (11 male, 6 female; age range: 45-89 years) suffering from an oral maxillofacial carcinoma underwent CT and F18-FDG-PET (333-370 MBq). The data of the 2 imaging modalities were fused on an image workstation. This image fusion was then visualized in the axial, coronal, and sagittal planes.

RESULTS

PET showed a high pathologic FDG uptake in the tumor in 17 of 17 patients. CT detected the tumor in 12 of 17 patients. The image fusion of FDG-PET and CT showed the tumor in 17 of 17 patients. The final diagnosis was carcinoma of the mandible in 9 of 17 patients, carcinoma of the mouth floor in 3 of 17 patients, carcinoma of the tongue in 3 of 17 patients, carcinoma of the roof of the mouth in 1 of 17 patients, and carcinoma of the parotis gland in 1 of 17 patients.

CONCLUSIONS

Preoperative image fusion of FDG-PET and CT data sets in oral maxillofacial carcinoma is possible in the clinical routine. Combined morphologic (CT) and functional (PET) imaging improves tumor localization even if the tumor is hardly visible on CT because of the artefacts of dental metallic implants (3/17 patients) or because of the small size of the tumor (2/17 patients). Image fusion is helpful for planning possible surgery (visual models) or radiotherapy (exact region of interest).

Image fusion of thallium-201 SPECT and MR imaging for the assessment of recurrent head and neck tumors following flap reconstructive surgery

The aim of this study was to assess the value of fused MR and Tl-201 single photon emission computed tomography (SPECT) images in the diagnosis of recurrent head and neck tumors in patients after flap reconstruction surgery. Twenty-four patients after resection of primary head and neck tumors with flap reconstruction were suspected of having recurrent tumor by follow-up MR examination. Both MR examination and Tl-201 SPECT were prospectively performed to produce fused images. For qualitative analysis, two independent readers separately evaluated the existence of tumor recurrence in the fused images. The Tl-201 uptake of the lesion (Tl index) was also quantitatively compared with that of the normal nuchal muscles. Eighteen patients were histologically proved as having recurrence. The remaining 6 patients, false positive on MRI alone, had non-recurrence. Using the fused images, false positive was found in 1 case for one reader and 2 cases for the other reader. The Tl index of recurrent tumors was significantly higher (p < 0.001) than that of non-recurrent mass lesions. In the assessment of recurrent tumors following flap reconstruction surgery in the head and neck, the use of fused MRI and Tl-201 SPECT images can reduce the number of false positives.

SPECT/CT in tumor imaging: technical aspects and clinical applications

Diagnostic imaging has gained a major role in the management of patients with cancer and has made a further step forward with the introduction of fusion techniques into the field. This technology provides hybrid images of two independent modalities, a functional scintigraphic technique and an anatomical procedure, yielding a superior imaging study. Scintigraphy is based on the use of single photon or positron emitting tracers providing a description of function or processes, whereas computed tomography (CT), ultrasound, or magnetic resonance imaging (MRI) depict the precise localization and type of morphological changes that have occurred in the lesions. Initial attempts to coregister the functional and anatomical information following acquisition of the two imaging modalities on separate machines, in different sessions, failed to disclose the proper alignment with precise coregistration, in particular for non-head studies, and were associated with patient preparation and mathematical modeling that were too cumbersome to be used on a routine basis. The recent introduction of a hybrid imaging device containing a low dose CT system and a gamma camera on a single gantry enabled the sequential acquisition of the two imaging modalities, with subsequent merging of data into a composite image display. These hybrid studies have led to a revolution in the field of imaging, with highly accurate localization of tumor sites, assessment of invasion into surrounding tissues, and characterization of their functional status.

Gallium-67 scintigraphy: a cornerstone in functional imaging of lymphoma

Until recently, gallium-67 scintigraphy (GS) has been the best available functional imaging modality for evaluating patients with non-Hodgkin's lymphoma (NHL) and Hodgkin's disease (HD). The diagnostic accuracy of GS in detecting lymphoma is based on optimisation of the imaging protocol, knowledge of potential physiological and benign sites of (67)Ga uptake, and the Ga avidity characteristics of the individual lymphoma. As (67)Ga is a tumour viability agent, the role of GS is primarily at follow-up. A residual mass persisting on CT after treatment poses a common clinical dilemma: it may indicate the presence of viable lymphoma, which requires further treatment, or it can be benign, consisting of only fibrotic and necrotic tissues. GS can successfully differentiate between these conditions. Routine follow-up with GS may allow early diagnosis of recurrence and early institution of treatment. Reversion of a positive GS to a negative test, and the rapidity with which this occurs has a high predictive value for the outcome of the individual patient. Lymphoma showing a normal GS early during treatment has a better prognosis than lymphoma with persistence of pathological findings. Other tumour-seeking single-photon emitting agents, such as thallium-201, technetium-99m methoxyisobutylisonitrile and indium-111 octreotide, have been investigated in lymphoma, primarily as an alternative to GS in specific clinical settings, but are of limited value. The role of radioimmunoscintigraphy is gaining importance in conjunction with radioimmunotherapy. Fluorine-18 fluorodeoxyglucose (FDG) imaging of lymphoma using either dedicated or camera-based PET systems is gradually replacing GS for assessment of lymphoma. FDG overcomes some of the limitations of GS while sharing its tumour viability characteristics. The extensive clinical knowledge and experience accumulated over three decades with GS in lymphoma provides a solid background as well as a model for the assessment of new functional imaging techniques.

The fusion of anatomic and physiologic imaging in the management of patients with cancer

Imaging is of major clinical importance in the noninvasive evaluation and management of patients with cancer. Computed tomography (CT) and other anatomic imaging modalities, such as magnetic resonance imaging (MRI) or ultrasound, have a high diagnostic ability by visualizing lesion morphology and by providing the exact localization of malignant sites. Nuclear medicine provides information on the function and metabolism of cancer. Over the last decade, there have been numerous attempts to combine data obtained from different imaging techniques. Fused images of nuclear medicine and CT (or to a lesser extent, MRI) overcome the inherent limitations of both modalities. Valuable physiologic information benefits from a precise topographic localization. Coregistered data have been shown to be useful in the evaluation of patients with cancer at diagnosis and staging, in monitoring the response to treatment, and during follow up, for early detection of recurrence. Time-consuming and difficult realignment and computation for fusion of independent studies have, until now, limited the use of registration techniques to pilot studies performed in a small number of patients. The development of the new technology of single photon emission computed tomography/CT and positron emission tomography/CT that allows for combined functional and anatomic data acquisition has the potential to make fusion an everyday clinical tool.

The indications of FDG-PET in neck oncology

FDG-PET imaging in neck oncology has a definite clinical impact in the post-therapy setting, assisting in the management of thyroid cancers and SCC of the neck. Quantitation of FDG uptake in suspicious areas may be helpful but should be regarded cautiously. Overall, wider incorporation of FDG imaging in clinical routine depends also on cost availability issues of FDG and of imaging devices. Dual-coincidence scanners for FDG imaging are much cheaper than dedicated PET scanners and are installed in growing numbers in many centers. These devices have inferior sensitivity; however, series published with these scanners produce encouraging results. Easier and more acceptable clinical application will also be facilitated by the systematic use of coregistration with anatomic images. Both prerequisites might be fulfilled by the emergence on the market of a gamma camera-mounted anatomic X-ray tomograph, which in addition to dual-coincidence scintigraphic imaging provides radiographic images of comparable quality to third-generation CT systems. This type of hybrid gamma camera-CT scanner has great potential in a region of complex anatomy, such as the head and neck.

Digital image fusion of CT and PET data sets--clinical value in abdominal/pelvic malignancies

PURPOSE

We investigated the clinical relevance of digital image fusion of CT and 2-[18F]fluoro-2-deoxy-D-glucose ([18F]FDG) positron emission tomography (PET) studies in patients with suspected abdominal and/or pelvic metastasis.

METHOD

Nineteen patients with suspected residual/recurrent malignancies underwent CT and [18F]FDG PET studies of the abdomen and/or pelvis. The data sets of both modalities were fused on a digital workstation by automatic adaptation of the pixel size and the slice thickness. Different body positions were corrected by semiautomatic adaptation of the body axes. The fused images were reconstructed in sagittal, coronal, and axial planes.

RESULTS

Good spatial correlation between both modalities was achieved in all patients. Image fusion improved the spatial allocation of pathologically increased [18F]FDG uptake in 7 of 35 lesions (20%).

CONCLUSION

This work suggests that digital image fusion of CT and [18F]FDG PET data sets improves the anatomical localization of foci with increased [18F]FDG enhancement of the retroperitoneum and the abdominal/pelvic wall, respectively.

Multimodality nuclear medicine imaging in three-dimensional radiation treatment planning for lung cancer: challenges and prospects

The purpose of this study was to determine the utility of quantitative single photon emission computed tomography (SPECT) lung perfusion scans and F-18 fluorodeoxyglucose positron emission computed tomography (PET) during X-ray computed tomography (CT)-based treatment planning for patients with lung cancer. Pre-radiotherapy SPECT (n = 104) and PET (n = 35) images were available to the clinician to assist in radiation field design for patients with bronchogenic cancer. The SPECT and PET scans were registered with anatomic information derived from CT. The information from SPECT and PET provides the treatment planner with functional data not seen with CT. SPECT yields three-dimensional (3D) lung perfusion maps. PET provides 3D metabolic images that assist in tumor localization. The impact of the nuclear medicine images on the treatment planning process was assessed by determining the frequency, type, and extent of changes to plans. Pre-radiotherapy SPECT scans were used to modify 11 (11%) treatment plans; primarily altering beam angles to avoid highly functioning tissue. Fifty (48%) SPECT datasets were judged to be 'potentially useful' due to the detection of hypoperfused regions of the lungs, but were not used during treatment planning. PET data influenced 34% (12 of 35) of the treatment plans examined, and resulted in enlarging portions of the beam aperture (margins) up to 15 mm. Challenges associated with image quality and registration arise when utilizing nuclear medicine data in the treatment planning process. Initial implementation of advanced SPECT image reconstruction techniques that are not typically used in the clinic suggests that the reconstruction method may influence dose response data derived from the SPECT images and improve image registration with CT. The use of nuclear medicine transmission computed tomography (TCT) for both SPECT and PET is presented as a possible tool to reconstruct more accurate emission images and to aid in the registration of emission data with the planning CT. Nuclear medicine imaging techniques appear to be a potentially valuable tool during radiotherapy treatment planning for patients with lung cancer. The utilization of accurate nuclear medicine image reconstruction techniques and TCT may improve the treatment planning process.

The contribution of 18F-fluoro-2-deoxy-glucose positron emission tomographic imaging to radiotherapy planning in lung cancer

A retrospective analysis was performed to determine whether coronal thoracic [18F]fluoro-2-deoxy-glucose positron emission tomography (FDG-PET) scans, if viewed at the time of radiotherapy (RT) planning, would have influenced the anterior-posterior (AP) RT volumes that were administered to a group of unoperated lung cancer patients. Viewing of PET and diagnostic images enabled a qualitative assessment of whether abnormal thoracic PET activity was present in areas regarded as normal by diagnostic imaging; this would, therefore, have influenced the RT volume if done prospectively. Additionally a method of graphical co-registration was devised to quantitate the adequacy of coverage of each patient's abnormal PET activity by his/her actual RT field. Of 15 patients analyzed, 26.7% (four patients) would have had their RT volume influenced by PET findings, highlighting the potential value of PET in treatment planning.

An investigation of the physical characteristics of 66Ga as an isotope for PET imaging and quantification

Isotopes commonly used for PET imaging and quantification have a straightforward decay scheme involving "pure" positron (beta +) emission, i.e., 95%-100% beta + abundance, with no additional gamma rays. 66Ga (Emax = 4.2 MeV, T1/2 = 9.5 h) is a member of a category of isotopes with a lower abundance of beta +'s (57%) and a more complicated spectrum involving combinations of gamma rays that are emitted in cascade. These additional gamma rays tend to cause a higher singles rate, resulting in more random coincidence events. The most abundant positron (51.5%) in the spectrum has one of the highest energies considered for PET imaging. For the purpose of monoclonal antibody dosimetry using 66Ga, it is important to verify the quantification in phantoms prior to initiating human studies. A series of quantitative phantom measurements were performed on the PC4600, a head-optimized BGO based scanner with multiple detector rings. Count rate linearity was verified over concentrations ranging from 4.0 kBq/cc to 37 kBq/cc (0.11-1.0 microCi/cc); resolution averaged 16 mm full width half-maximum in the x and y directions in both the direct and cross planes. Axial resolution was 14 mm. The range of the energetic positrons (up to 4.153 MeV, range 7.6 mm in tissue) was verified as a primary source of resolution degradation. Within the limits outlined above, 66Ga is a suitable isotope for use as 66Ga citrate or with monoclonal antibodies in the detection and staging of tumors and other lesions. In addition, the energetic positrons have possible therapeutic applications when used as a monoclonal antibody label.