A continuous 4D motion model from multiple respiratory cycles for use in lung radiotherapy

A novel computer modeling and simulation technique for bronchi motion tracking in human lungs under respiration

In this work, we proposed a novel computer modeling and simulation technique for motion tracking of lung bronchi (or tumors) under respiration using 9 cases of computed tomography (CT)-based patient-specific finite element (FE) models and Ogden's hyperelastic model. In the fabrication of patient-specific FE models for the respiratory system, various organs such as the mediastinum, diaphragm, and thorax that could affect the lung motions during breathing were considered. To describe the nonlinear material behavior of lung parenchyma, the comparative simulation for biaxial tension-compression of lung parenchyma was carried out using several hyperelastic models in ABAQUS, and then, Ogden's model was adopted as an optimal model. Based on the aforementioned FE models and Ogden's material model, the 9 cases of respiration simulation were carried out from exhalation to inhalation, and the motion of lung bronchi (or tumors) was tracked. In addition, the changes in lung volume, lung cross-sectional area on the axial plane during breathing were calculated. Finally, the simulation results were quantitatively compared to the inhalation/exhalation CT images of 9 subjects to validate the proposed technique. Through the simulation, it was confirmed that the average relative errors of simulation to clinical data regarding to the displacement of 258 landmarks in the lung bronchi branches of total subjects were 1.10%~2.67%. In addition, the average relative errors of those with respect to the lung cross-sectional area changes and the volume changes in the superior-inferior direction were 0.20%~5.00% and 1.29 ~ 9.23%, respectively. Hence, it was considered that the simulation results were coincided well with the clinical data. The novelty of the present study is as follows: (1) The framework from fabrication of the human respiratory system to validation of the bronchi motion tracking is provided step by step. (2) The comparative simulation study for nonlinear material behavior of lung parenchyma was carried out to describe the realistic lung motion. (3) Various organs surrounding the lung parenchyma and restricting its motion were considered in respiration simulation. (4) The simulation results such as landmark displacement, lung cross-sectional area/volume changes were quantitatively compared to the clinical data of 9 subjects.

A study of quantitative indicators for slice sorting in cine-mode 4DCT

The uncertainties of four-dimensional computed tomography (4DCT), also called as residual motion artefacts (RMA), induced from irregular respiratory patterns can degrade the quality of overall radiotherapy. This study aims to quantify and reduce those uncertainties. A comparative study on quantitative indicators for RMA was performed, and based on this, we proposed a new 4DCT sorting method that is applicable without disrupting the current clinical workflow. In addition to the default phase sorting strategy, both additional amplitude information from external surrogates and the quantitative metric for RMA, investigated in this study, were introduced. The comparison of quantitative indicators and the performance of the proposed sorting method were evaluated via 10 cases of breath-hold (BH) CT and 30 cases of 4DCT. It was confirmed that N-RMSD (normalised root-mean-square-deviation) was best matched to the visual standards of our institute’s regime, manual sorting method, and could accurately represent RMA. The performance of the proposed method to reduce 4DCT uncertainties was improved by about 18.8% in the averaged value of N-RMSD compared to the default phase sorting method. To the best of our knowledge, this is the first study that evaluates RMA indicators using both BHCT and 4DCT with visual-criteria-based manual sorting and proposes an improved 4DCT sorting strategy based on them.

PET respiratory motion correction: quo vadis?

Positron emission tomography (PET) respiratory motion correction has been a subject of great interest for the last twenty years, prompted mainly by the development of multimodality imaging devices such as PET/computed tomography (CT) and PET/magnetic resonance imaging (MRI). PET respiratory motion correction involves a number of steps including acquisition synchronization, motion estimation and finally motion correction. The synchronization steps include the use of different external device systems or data driven approaches which have been gaining ground over the last few years. Patient specific or generic motion models using the respiratory synchronized datasets can be subsequently derived and used for correction either in the image space or within the image reconstruction process. Similar overall approaches can be considered and have been proposed for both PET/CT and PET/MRI devices. Certain variations in the case of PET/MRI include the use of MRI specific sequences for the registration of respiratory motion information. The proposed review includes a comprehensive coverage of all these areas of development in field of PET respiratory motion for different multimodality imaging devices and approaches in terms of synchronization, estimation and subsequent motion correction. Finally, a section on perspectives including the potential clinical usage of these approaches is included.

Prediction of the motion of chest internal points using a recurrent neural network trained with real-time recurrent learning for latency compensation in lung cancer radiotherapy

During the radiotherapy treatment of patients with lung cancer, the radiation delivered to healthy tissue around the tumor needs to be minimized, which is difficult because of respiratory motion and the latency of linear accelerator (LINAC) systems. In the proposed study, we first use the Lucas-Kanade pyramidal optical flow algorithm to perform deformable image registration (DIR) of chest computed tomography (CT) scan images of four patients with lung cancer. We then track three internal points close to the lung tumor based on the previously computed deformation field and predict their position with a recurrent neural network (RNN) trained using real-time recurrent learning (RTRL) and gradient clipping. The breathing data is quite regular, sampled at approximately 2.5 Hz, and includes artificially added drift in the spine direction. The amplitude of the motion of the tracked points ranged from 12.0 mm to 22.7 mm. Finally, we propose a simple method for recovering and predicting three-dimensional (3D) tumor images from the tracked points and the initial tumor image, based on a linear correspondence model and the Nadaraya-Watson non-linear regression. The root-mean-square (RMS) error, maximum error and jitter corresponding to the RNN prediction on the test set were smaller than the same performance measures obtained with linear prediction and least mean squares (LMS). In particular, the maximum prediction error associated with the RNN, equal to 1.51 mm, is respectively 16.1% and 5.0% lower than the error given by a linear predictor and LMS. The average prediction time per time step with RTRL is equal to 119 ms, which is less than the 400 ms marker position sampling time. The tumor position in the predicted images appears visually correct, which is confirmed by the high mean cross-correlation between the original and predicted images, equal to 0.955. The standard deviation of the Gaussian kernel and the number of layers in the optical flow algorithm were the parameters having the most significant impact on registration performance. Their optimization led respectively to a 31.3% and 36.2% decrease in the registration error. Using only a single layer proved to be detrimental to the registration quality because tissue motion in the lower part of the lung has a high amplitude relative to the resolution of the CT scan images. The random initialization of the hidden units and the number of these hidden units were found to be the most important factors affecting the performance of the RNN. Increasing the number of hidden units from 15 to 250 led to a 56.3% decrease in the prediction error on the cross-validation data. Similarly, optimizing the standard deviation of the initial Gaussian distribution of the synaptic weights σ_init^RNN led to a 28.4% decrease in the prediction error on the cross-validation data, with the error minimized for σ_init^RNN=0.02 with the four patients.

Evaluation of four surface surrogates for modeling lung tumor positions over several fractions in radiotherapy

Patient breathing during lung cancer radiotherapy reduces the ability to keep a sharp dose gradient between tumor and normal tissues. To mitigate detrimental effects, accurate information about the tumor position is required. In this work, we evaluate the errors in modeled tumor positions over several fractions of a simple tumor motion model driven by a surface surrogate measure and its time derivative. The model is tested with respect to four different surface surrogates and a varying number of surrogate and image acquisitions used for model training. Fourteen patients were imaged 100 times with cine CT, at three sessions mimicking a planning session followed by two treatment fractions. Patient body contours were concurrently detected by a body surface laser scanning system BSLS from which four surface surrogates were extracted; thoracic point TP, abdominal point AP, the radial distance mean RDM, and a surface derived volume SDV. The motion model was trained on session 1 and evaluated on sessions 2 and 3 by comparing modeled tumor positions with measured positions from the cine images. The number of concurrent surrogate and image acquisitions used in the training set was varied, and its impact on the final result was evaluated. The use of AP as a surface surrogate yielded the smallest error in modeled tumor positions. The mean deviation between modeled and measured tumor positions was 1.9 mm. The corresponding deviations for using the other surrogates were 2.0 mm (RDM), 2.8 mm (SDV), and 3.0 mm (TP). To produce a motion model that accurately models the tumor position over several fractions requires at least 10 simultaneous surrogate and image acquisitions over 1–2 minutes.

Pitfalls on PET/CT Due to Artifacts and Instrumentation

PET/CT has become a preferred imaging modality over PET-only scanners in clinical practice. However, along with the significant improvement in diagnostic accuracy and patient throughput, pitfalls on PET/CT are reported as well. This review provides a general overview on the potential influence of the limitations with respect to PET/CT instrumentation and artifacts associated with the modality integration on the image appearance and quantitative accuracy of PET. Approaches proposed in literature to address the limitations or minimize the artifacts are discussed as well as their current challenges for clinical applications. Although the CT component can play an important role in assisting clinical diagnosis, we concentrate on the imaging scenarios where CT is used to provide auxiliary information for attenuation compensation and scatter correction in PET.

Validation of a CT-based motion model with in-situ fluoroscopy for lung surface deformation estimation

Many surrogate-based motion models (SMMs), proposed to guide motion management in radiotherapy, are constructed by correlating motion of an external surrogate and internal anatomy during CT-simulation. Changes in this correlation define model break down. We validate a methodology that incorporates fluoroscopic images (FL) acquired during treatment for SMM construction and update. Under a prospective IRB, 4DCT scans, VisionRT surfaces, and orthogonal FLs were collected from five lung cancer patients. VisionRT surfaces and two FL time-series were acquired pre- and post-treatment. A simulated annealing optimization scheme was used to estimate optimal lung deformations by maximizing the mutual information between digitally reconstructed radiographs (DRRs) of the SMM-estimated 3D images and FLs. Our SMM used partial-least-regression and was trained using the optimal deformations and VisionRT surfaces from the first breathing-cycle. SMM performance was evaluated using the mutual information score between reference FLs and the corresponding SMM or phase-assigned 4DCT DRRs. The Hausdorff distance for contoured landmarks was used to evaluate target position estimation error. For four out of five patients, two principal components approximated lung surface deformations with submillimeter accuracy. Analysis of the mutual information score between more than 4,000 pairs of FL and DRR demonstrated that our model led to more similarity between the FL and DRR images compared to 4DCT and DRR images from a model based on an a priori correlation model. Our SMM consistently displayed lower mean and 95^th percentile Hausdorff distances. For one patient, 95^th percentile Hausdorff distance was reduced by 11mm. Patient-averaged reductions in mean and 95^th percentile Hausdorff distances were 3.6mm and 7mm for right-lung, and 3.1mm and 4mm for left-lung targets. FL data were used to evaluate model performance and investigate the feasibility of model update. Despite variability in breathing, use of post-treatment FL preserved model fidelity and consistently outperformed 4DCT for position estimation.

Development and prospective in-patient proof-of-concept validation of a surface photogrammetry + CT-based volumetric motion model for lung radiotherapy

PURPOSE

We develop and validate a motion model that uses real-time surface photogrammetry acquired concurrently with four-dimensional computed tomography (4DCT) to estimate respiration-induced changes within the entire irradiated volume, over arbitrarily many respiratory cycles.

METHODS

A research, couch-mounted, VisionRT (VRT) system was used to acquire optical surface data (15 Hz, ROI = 15 × 20 cm² ) from the thoraco-abdominal surface of a consented lung SBRT patient, concurrently with their standard-of-care 4DCT. The end-exhalation phase from the 4DCT was regarded as reference and for each remaining phase, deformation vector fields (DVFs) with respect to the reference phase were computed. To reduce dimensionality, the first two principal components (PCs) of the matrix of nine DVFs were calculated. In parallel, ten phase-averaged VRT surfaces were created. Surface DVFs and corresponding PCs were computed. A principal least squares regression was used to relate the PCs of surface DVF to those of volume DVFs, establishing a relationship between time-varying surface and the underlying time-varying volume. Proof-of-concept validation was performed during each treatment fraction by concurrently acquiring 30 s time series of real-time surface data and "ground truth" kV fluoroscopic data (FL). A ray-tracing algorithm was used to create a digitally reconstructed fluorograph (DRF), and motion trajectories of high-contrast, soft-tissue, anatomical features in the DRF were compared with those from kV FL.

RESULTS

For five of the six fluoroscopic acquisition sessions, the model out-performed 4DCT in predicting contour Dice coefficient with respect to fluoroscopy-derived contours. Similarly, the model exhibited a marked improvement over 4DCT for patch positions on the diaphragm. Model patch position errors varied from 5 to -15 mm while 4DCT errors ranged between 5 and -22.4 mm. For one fluoroscopic acquisition, a marked change in the a priori internal-external correlation resulted in model errors comparable to those of 4DCT.

CONCLUSIONS

We described the development and a proof-of-concept validation for a volumetric motion model that uses surface photogrammetry to correlate the time-varying thoraco-abdominal surface to the time-varying internal thoraco-abdominal volume. These early results indicate that the proposed approach can result in a marked improvement over 4DCT. While limited by the duration of the fluoroscopic acquisitions as well as the resolution of the acquired images, the DRF-based proof-of-concept technique developed here is model-agnostic, and therefore, has the potential to be used as an in-patient validation tool for other volumetric motion models.

A hybrid proton and hyperpolarized gas tagging MRI technique for lung respiratory motion imaging: a feasibility study

The aim of this work was to develop a novel hybrid 3D hyperpolarized (HP) gas tagging MRI (t-MRI) technique and to evaluate it for lung respiratory motion measurement with comparison to deformable image registrations (DIR) methods. Three healthy subjects underwent a hybrid MRI which combines 3D HP gas t-MRI with a low resolution (Low-R, 4.5 mm isotropic voxels) 3D proton MRI (p-MRI), plus a high resolution (High-R, 2.5 mm isotropic voxels) 3D p-MRI, during breath-holds at the end-of-inhalation (EOI) and the end-of-exhalation (EOE). Displacement vector field (DVF) of the lung motion was determined from the t-MRI images by tracking tagging grids and from the High-R p-MRI using three DIR methods (B-spline based method implemented by Velocity, Free Form Deformation by MIM, and B-spline by an open source software Elastix: denoted as A, B, and C, respectively), labeled as tDVF and dDVF, respectively. The tDVF from the HP gas t-MRI was used as ground-truth reference to evaluate performance of the three DIR methods. Differences in both magnitude and angle between the tDVF and dDVFs were analyzed. The mean lung motion of the three subjects was 37.3 mm, 8.9 mm and 12.9 mm, respectively. Relatively large discrepancies were observed between the tDVF and the dDVFs as compared to previously reported DIR errors. The mean  ±  standard deviation (SD) DVF magnitude difference was 8.3  ±  5.6 mm, 9.2  ±  4.5 mm, and 9.3  ±  6.1 mm, and the mean  ±  SD DVF angular difference was 29.1  ±  12.1°, 50.1  ±  28.6°, and 39.0  ±  6.3°, for the DIR Methods A, B, and C, respectively. These preliminary results showed that the hybrid HP gas t-MRI technique revealed different lung motion patterns as compared to the DIR methods. It may provide unique perspectives in developing and evaluating DIR of the lungs. Novelty and Significance We designed a MRI protocol that includes a novel hybrid MRI technique (3D HP gas t-MRI with a low resolution 3D p-MRI) plus a high resolution 3D p-MRI. We tested the novel hybrid MRI technique on three healthy subjects for measuring regional lung respiratory motion with comparison to deformable image registrations (DIR) methods, and observed relatively large discrepancies in lung motion between HP gas t-MRI and DIR methods.

Nearest Neighbor Method to Estimate Internal Target for Real-Time Tumor Tracking

PURPOSE

This work proposed a nearest neighbor estimation method to track the respiration-induced tumor motion.

METHODS

Based on the simultaneously collected motion traces of external surrogate and internal target during the modeling phase prior to treatment, we first obtain the nearest neighbors of the current surrogate in external space. Subsequently, the concurrent targets in internal space are determined and used to estimate the current target position. The method was validated on 71 cases that were from 3 open access databases. In addition, to evaluate the method's estimation and prediction accuracy, we compared the method with other works.

RESULTS

Except for 2 cases, the nearest neighbor estimation achieved the root-mean-square error of <3 mm. The comparison indicated that the method had better estimation accuracy than polynomial model and good prediction performance.

DISCUSSION

The 2 exceptive cases were further analyzed for failure causes. We inferred that one was because of the lack of estimating new target in our method, and the other one was because of the mistake during data collection. Accordingly, the potential solutions were suggested. Besides, the method's estimation for surrogate outliers, effects of modeling length, calibration, and extension were discussed.

CONCLUSION

The results demonstrated nearest neighbor estimation's effectiveness. Except for this, the method imposes no restrictions on the modality of the pretreatment target images and does not assume a specific correspondence function between the surrogate and the target. With only 1 critical parameter, this nearest neighbor estimation method is easy to implement in clinical setting and thus has potential for broad applications.

A 4D global respiratory motion model of the thorax based on CT images: A proof of concept

PURPOSE

Respiratory motion reduces the sensitivity and specificity of medical images especially in the thoracic and abdominal areas. It may affect applications such as cancer diagnostic imaging and/or radiation therapy (RT). Solutions to this issue include modeling of the respiratory motion in order to optimize both diagnostic and therapeutic protocols. Personalized motion modeling required patient-specific four-dimensional (4D) imaging which in the case of 4D computed tomography (4D CT) acquisition is associated with an increased dose. The goal of this work was to develop a global respiratory motion model capable of relating external patient surface motion to internal structure motion without the need for a patient-specific 4D CT acquisition.

METHODS

The proposed global model is based on principal component analysis and can be adjusted to a given patient anatomy using only one or two static CT images in conjunction with a respiratory synchronized patient external surface motion. It is based on the relation between the internal motion described using deformation fields obtained by registering 4D CT images and patient surface maps obtained either from optical imaging devices or extracted from CT image-based patient skin segmentation. 4D CT images of six patients were used to generate the global motion model which was validated by adapting it on four different patients having skin segmented surfaces and two other patients having time of flight camera acquired surfaces. The reproducibility of the proposed model was also assessed on two patients with two 4D CT series acquired within 2 weeks of each other.

RESULTS

Profile comparison shows the efficacy of the global respiratory motion model and an improvement while using two CT images in order to adapt the model. This was confirmed by the correlation coefficient with a mean correlation of 0.9 and 0.95 while using one or two CT images respectively and when comparing acquired to model generated 4D CT images. For the four patients with segmented surfaces, expert validation indicates an error of 2.35 ± 0.26 mm compared to 6.07 ± 0.76 mm when using a simple interpolation between full inspiration (FI) and full expiration (FE) CT only; i.e., without specific modeling of the respiratory motion. For the two patients with acquired surfaces, this error was of 2.48 ± 0.18 mm. In terms of reproducibility, model error changes of 0.12 and 0.17 mm were measured for the two patients concerned.

CONCLUSIONS

The framework for the derivation of a global respiratory motion model was developed. A single or two static CT images and associated patient surface motion, as a surrogate measure, are only needed to personalize the model. This model accuracy and reproducibility were assessed by comparing acquired vs model generated 4D CT images. Future work will consist of assessing extensively the proposed model for radiotherapy applications.

A prospective gating method to acquire a diverse set of free-breathing CT images for model-based 4DCT

Breathing motion modeling requires observation of tissues at sufficiently distinct respiratory states for proper 4D characterization. This work proposes a method to improve sampling of the breathing cycle with limited imaging dose. We designed and tested a prospective free-breathing acquisition protocol with a simulation using datasets from five patients imaged with a model-based 4DCT technique. Each dataset contained 25 free-breathing fast helical CT scans with simultaneous breathing surrogate measurements. Tissue displacements were measured using deformable image registration. A correspondence model related tissue displacement to the surrogate. Model residual was computed by comparing predicted displacements to image registration results. To determine a stopping criteria for the prospective protocol, i.e. when the breathing cycle had been sufficiently sampled, subsets of N scans where 5  ⩽  N  ⩽  9 were used to fit reduced models for each patient. A previously published metric was employed to describe the phase coverage, or 'spread', of the respiratory trajectories of each subset. Minimum phase coverage necessary to achieve mean model residual within 0.5 mm of the full 25-scan model was determined and used as the stopping criteria. Using the patient breathing traces, a prospective acquisition protocol was simulated. In all patients, phase coverage greater than the threshold necessary for model accuracy within 0.5 mm of the 25 scan model was achieved in six or fewer scans. The prospectively selected respiratory trajectories ranked in the (97.5  ±  4.2)th percentile among subsets of the originally sampled scans on average. Simulation results suggest that the proposed prospective method provides an effective means to sample the breathing cycle with limited free-breathing scans. One application of the method is to reduce the imaging dose of a previously published model-based 4DCT protocol to 25% of its original value while achieving mean model residual within 0.5 mm.

MRI-guided lung SBRT: Present and future developments

Stereotactic body radiotherapy (SBRT) is rapidly becoming an alternative to surgery for the treatment of early-stage non-small cell lung cancer patients. Lung SBRT is administered in a hypo-fractionated, conformal manner, delivering high doses to the target. To avoid normal-tissue toxicity, it is crucial to limit the exposure of nearby healthy organs-at-risk (OAR). Current image-guided radiotherapy strategies for lung SBRT are mostly based on X-ray imaging modalities. Although still in its infancy, magnetic resonance imaging (MRI) guidance for lung SBRT is not exposure-limited and MRI promises to improve crucial soft-tissue contrast. Looking beyond anatomical imaging, functional MRI is expected to inform treatment decisions and adaptations in the future. This review summarises and discusses how MRI could be advantageous to the different links of the radiotherapy treatment chain for lung SBRT: diagnosis and staging, tumour and OAR delineation, treatment planning, and inter- or intrafractional motion management. Special emphasis is placed on a new generation of hybrid MRI treatment devices and their potential for real-time adaptive radiotherapy.

T2-Weighted 4D Magnetic Resonance Imaging for Application in Magnetic Resonance-Guided Radiotherapy Treatment Planning

OBJECTIVES

The aim of this study was to develop and verify a method to obtain good temporal resolution T2-weighted 4-dimensional (4D-T2w) magnetic resonance imaging (MRI) by using motion information from T1-weighted 4D (4D-T1w) MRI, to support treatment planning in MR-guided radiotherapy.

MATERIALS AND METHODS

Ten patients with primary non-small cell lung cancer were scanned at 1.5 T axially with a volumetric T2-weighted turbo spin echo sequence gated to exhalation and a volumetric T1-weighted stack-of-stars spoiled gradient echo sequence with golden angle spacing acquired in free breathing. From the latter, 20 respiratory phases were reconstructed using the recently developed 4D joint MoCo-HDTV algorithm based on the self-gating signal obtained from the k-space center. Motion vector fields describing the respiratory cycle were obtained by deformable image registration between the respiratory phases and projected onto the T2-weighted image volume. The resulting 4D-T2w volumes were verified against the 4D-T1w volumes: an edge-detection method was used to measure the diaphragm positions; the locations of anatomical landmarks delineated by a radiation oncologist were compared and normalized mutual information was calculated to evaluate volumetric image similarity.

RESULTS

High-resolution 4D-T2w MRI was obtained. Respiratory motion was preserved on calculated 4D-T2w MRI, with median diaphragm positions being consistent with less than 6.6 mm (2 voxels) for all patients and less than 3.3 mm (1 voxel) for 9 of 10 patients. Geometrical positions were coherent between 4D-T1w and 4D-T2w MRI as Euclidean distances between all corresponding anatomical landmarks agreed to within 7.6 mm (Euclidean distance of 2 voxels) and were below 3.8 mm (Euclidean distance of 1 voxel) for 355 of 470 pairs of anatomical landmarks. Volumetric image similarity was commensurate between 4D-T1w and 4D-T2w MRI, as mean percentage differences in normalized mutual information (calculated over all respiratory phases and patients), between corresponding respiratory phases of 4D-T1w and 4D-T2w MRI and the tie-phase of 4D-T1w and 3-dimensional T2w MRI, were consistent to 0.41% ± 0.37%. Four-dimensional T2w MRI displayed tumor extent, structure, and position more clearly than corresponding 4D-T1w MRI, especially when mobile tumor sites were adjacent to organs at risk.

CONCLUSIONS

A methodology to obtain 4D-T2w MRI that retrospectively applies the motion information from 4D-T1w MRI to 3-dimensional T2w MRI was developed and verified. Four-dimensional T2w MRI can assist clinicians in delineating mobile lesions that are difficult to define on 4D-T1w MRI, because of poor tumor-tissue contrast.

A hybrid patient-specific biomechanical model based image registration method for the motion estimation of lungs

This paper presents a new hybrid biomechanical model-based non-rigid image registration method for lung motion estimation. In the proposed method, a patient-specific biomechanical modelling process captures major physically realistic deformations with explicit physical modelling of sliding motion, whilst a subsequent non-rigid image registration process compensates for small residuals. The proposed algorithm was evaluated with 10 4D CT datasets of lung cancer patients. The target registration error (TRE), defined as the Euclidean distance of landmark pairs, was significantly lower with the proposed method (TRE = 1.37 mm) than with biomechanical modelling (TRE = 3.81 mm) and intensity-based image registration without specific considerations for sliding motion (TRE = 4.57 mm). The proposed method achieved a comparable accuracy as several recently developed intensity-based registration algorithms with sliding handling on the same datasets. A detailed comparison on the distributions of TREs with three non-rigid intensity-based algorithms showed that the proposed method performed especially well on estimating the displacement field of lung surface regions (mean TRE = 1.33 mm, maximum TRE = 5.3 mm). The effects of biomechanical model parameters (such as Poisson's ratio, friction and tissue heterogeneity) on displacement estimation were investigated. The potential of the algorithm in optimising biomechanical models of lungs through analysing the pattern of displacement compensation from the image registration process has also been demonstrated.

Novel Super-Resolution Approach to Time-Resolved Volumetric 4-Dimensional Magnetic Resonance Imaging With High Spatiotemporal Resolution for Multi-Breathing Cycle Motion Assessment

PURPOSE

To develop and evaluate a super-resolution approach to reconstruct time-resolved 4-dimensional magnetic resonance imaging (TR-4DMRI) with a high spatiotemporal resolution for multi-breathing cycle motion assessment.

METHODS AND MATERIALS

A super-resolution approach was developed to combine fast 3-dimensional (3D) cine MRI with low resolution during free breathing (FB) and high-resolution 3D static MRI during breath hold (BH) using deformable image registration. A T1-weighted, turbo field echo sequence, coronal 3D cine acquisition, partial Fourier approximation, and SENSitivity Encoding parallel acceleration were used. The same MRI pulse sequence, field of view, and acceleration techniques were applied in both FB and BH acquisitions; the intensity-based Demons deformable image registration method was used. Under an institutional review board-approved protocol, 7 volunteers were studied with 3D cine FB scan (voxel size: 5 × 5 × 5 mm³) at 2 Hz for 40 seconds and a 3D static BH scan (2 × 2 × 2 mm³). To examine the image fidelity of 3D cine and super-resolution TR-4DMRI, a mobile gel phantom with multi-internal targets was scanned at 3 speeds and compared with the 3D static image. Image similarity among 3D cine, 4DMRI, and 3D static was evaluated visually using difference image and quantitatively using voxel intensity correlation and Dice index (phantom only). Multi-breathing-cycle waveforms were extracted and compared in both phantom and volunteer images using the 3D cine as the references.

RESULTS

Mild imaging artifacts were found in the 3D cine and TR-4DMRI of the mobile gel phantom with a Dice index of >0.95. Among 7 volunteers, the super-resolution TR-4DMRI yielded high voxel-intensity correlation (0.92 ± 0.05) and low voxel-intensity difference (<0.05). The detected motion differences between TR-4DMRI and 3D cine were -0.2 ± 0.5 mm (phantom) and -0.2 ± 1.9 mm (diaphragms).

CONCLUSION

Super-resolution TR-4DMRI has been reconstructed with adequate temporal (2 Hz) and spatial (2 × 2 × 2 mm³) resolutions. Further TR-4DMRI characterization and improvement are necessary before clinical applications. Multi-breathing cycles can be examined, providing patient-specific breathing irregularities and motion statistics for future 4D radiation therapy.

Automated identification and reduction of artifacts in cine four-dimensional computed tomography (4DCT) images using respiratory motion model

PURPOSE

Four-dimensional computed tomography (4DCT) images are often marred by artifacts that substantially degrade image quality and confound image interpretation. Human observation remains the standard method of 4DCT artifact evaluation, which is time-consuming and subjective. We develop a method to automatically identify and reduce artifacts in cine 4DCT images.

METHODS

We proposed an algorithm that consisted of two main stages: deformable image registration and respiratory motion simulation. Specifically, each 4DCT phase image was registered to the breath-holding CT image using the block-matching method, with erroneous spatial matches removed by the least median of squares filter and the full displacement vector field generated by the moving least squares interpolation. The lung's respiratory motion trajectory was then recovered from the displacement vector field using the parameterized polynomial function, with fitting parameters estimated by combinatorial optimization. In this way, artifacts were located according to deviations between image points and their motion trajectories and further corrected based on position prediction.

RESULTS

The mean spatial error (standard deviation) was 1.00 (0.85) mm after registration as opposed to 6.96 (4.61) mm before registration. In addition, we took human observation conducted by medical experts as the gold standard. The average sensitivity, specificity, and accuracy of the proposed method in artifact identification were 0.97, 0.84, and 0.89, respectively.

CONCLUSIONS

The proposed method identified and reduced artifacts accurately and automatically, providing an alternative way to analyze 4DCT image quality and to correct problematic images for radiation therapy.

Regional Lung Ventilation Analysis Using Temporally Resolved Magnetic Resonance Imaging

OBJECTIVE

We propose a computer-aided method for regional ventilation analysis and observation of lung diseases in temporally resolved magnetic resonance imaging (4D MRI).

METHODS

A shape model-based segmentation and registration workflow was used to create an atlas-derived reference system in which regional tissue motion can be quantified and multimodal image data can be compared regionally. Model-based temporal registration of the lung surfaces in 4D MRI data was compared with the registration of 4D computed tomography (CT) images. A ventilation analysis was performed on 4D MR images of patients with lung fibrosis; 4D MR ventilation maps were compared with corresponding diagnostic 3D CT images of the patients and 4D CT maps of subjects without impaired lung function (serving as reference).

RESULTS

Comparison between the computed patient-specific 4D MR regional ventilation maps and diagnostic CT images shows good correlation in conspicuous regions. Comparison to 4D CT-derived ventilation maps supports the plausibility of the 4D MR maps. Dynamic MRI-based flow-volume loops and spirograms further visualize the free-breathing behavior.

CONCLUSIONS

The proposed methods allow for 4D MR-based regional analysis of tissue dynamics and ventilation in spontaneous breathing and comparison of patient data. The proposed atlas-based reference coordinate system provides an automated manner of annotating and comparing multimodal lung image data.

From clinical imaging and computational models to personalised medicine and image guided interventions

This short paper describes the development of the UCL Centre for Medical Image Computing (CMIC) from 2006 to 2016, together with reference to historical developments of the Computational Imaging sciences Group (CISG) at Guy's Hospital. Key early work in automated image registration led to developments in image guided surgery and improved cancer diagnosis and therapy. The work is illustrated with examples from neurosurgery, laparoscopic liver and gastric surgery, diagnosis and treatment of prostate cancer and breast cancer, and image guided radiotherapy for lung cancer.

Deformable Registration of Biomedical Images Using 2D Hidden Markov Models

Robust registration of unimodal and multimodal images is a key task in biomedical image analysis, and is often utilized as an initial step on which subsequent analysis techniques critically depend. We propose a novel probabilistic framework, based on a variant of the 2D hidden Markov model, namely, the turbo hidden Markov model, to capture the deformation between pairs of images. The hidden Markov model is tailored to capture spatial transformations across images via state transitions, and modality-specific data costs via emission probabilities. The method is derived for the unimodal setting (where simpler matching metrics may be used) as well as the multimodal setting, where different modalities may provide very different representations for a given class of objects, necessitating the use of advanced similarity measures. We utilize a rich model with hundreds of model parameters to describe the deformation relationships across such modalities. We also introduce a local edge-adaptive constraint to allow for varying degrees of smoothness between object boundaries and homogeneous regions. The parameters of the described method are estimated in a principled manner from training data via maximum likelihood learning, and the deformation is subsequently estimated using an efficient dynamic programming algorithm. Experimental results demonstrate the improved performance of the proposed approach over the state-of-the-art deformable registration techniques, on both unimodal and multimodal biomedical data sets.

Modeling the Nonlinear Motion of the Rat Central Airways

Advances in volumetric medical imaging techniques allowed the subject-specific modeling of the bronchial flow through the first few generations of the central airways using computational fluid dynamics (CFD). However, a reliable CFD prediction of the bronchial flow requires modeling of the inhomogeneous deformation of the central airways during breathing. This paper addresses this issue by introducing two models of the central airways motion. The first model utilizes a node-to-node mapping between the discretized geometries of the central airways generated from a number of successive computed tomography (CT) images acquired dynamically (without breath hold) over the breathing cycle of two Sprague-Dawley rats. The second model uses a node-to-node mapping between only two discretized airway geometries generated from the CT images acquired at end-exhale and at end-inhale along with the ventilator measurement of the lung volume change. The advantage of this second model is that it uses just one pair of CT images, which more readily complies with the radiation dosage restrictions for humans. Three-dimensional computer aided design geometries of the central airways generated from the dynamic-CT images were used as benchmarks to validate the output from the two models at sampled time-points over the breathing cycle. The central airway geometries deformed by the first model showed good agreement to the benchmark geometries within a tolerance of 4%. The central airway geometry deformed by the second model better approximated the benchmark geometries than previous approaches that used a linear or harmonic motion model.

Prediction of high-dimensional states subject to respiratory motion: a manifold learning approach

The development of high-dimensional imaging systems in image-guided radiotherapy provides important pathways to the ultimate goal of real-time full volumetric motion monitoring. Effective motion management during radiation treatment usually requires prediction to account for system latency and extra signal/image processing time. It is challenging to predict high-dimensional respiratory motion due to the complexity of the motion pattern combined with the curse of dimensionality. Linear dimension reduction methods such as PCA have been used to construct a linear subspace from the high-dimensional data, followed by efficient predictions on the lower-dimensional subspace. In this study, we extend such rationale to a more general manifold and propose a framework for high-dimensional motion prediction with manifold learning, which allows one to learn more descriptive features compared to linear methods with comparable dimensions. Specifically, a kernel PCA is used to construct a proper low-dimensional feature manifold, where accurate and efficient prediction can be performed. A fixed-point iterative pre-image estimation method is used to recover the predicted value in the original state space. We evaluated and compared the proposed method with a PCA-based approach on level-set surfaces reconstructed from point clouds captured by a 3D photogrammetry system. The prediction accuracy was evaluated in terms of root-mean-squared-error. Our proposed method achieved consistent higher prediction accuracy (sub-millimeter) for both 200 ms and 600 ms lookahead lengths compared to the PCA-based approach, and the performance gain was statistically significant.

Technical Note: Simulation of 4DCT tumor motion measurement errors

PURPOSE

To determine if and by how much the commercial 4DCT protocols under- and overestimate tumor breathing motion.

METHODS

1D simulations were conducted that modeled a 16-slice CT scanner and tumors moving proportionally to breathing amplitude. External breathing surrogate traces of at least 5-min duration for 50 patients were used. Breathing trace amplitudes were converted to motion by relating the nominal tumor motion to the 90th percentile breathing amplitude, reflecting motion defined by the more recent 5DCT approach. Based on clinical low-pitch helical CT acquisition, the CT detector moved according to its velocity while the tumor moved according to the breathing trace. When the CT scanner overlapped the tumor, the overlapping slices were identified as having imaged the tumor. This process was repeated starting at successive 0.1 s time bin in the breathing trace until there was insufficient breathing trace to complete the simulation. The tumor size was subtracted from the distance between the most superior and inferior tumor positions to determine the measured tumor motion for that specific simulation. The effect of the scanning parameter variation was evaluated using two commercial 4DCT protocols with different pitch values. Because clinical 4DCT scan sessions would yield a single tumor motion displacement measurement for each patient, errors in the tumor motion measurement were considered systematic. The mean of largest 5% and smallest 5% of the measured motions was selected to identify over- and underdetermined motion amplitudes, respectively. The process was repeated for tumor motions of 1-4 cm in 1 cm increments and for tumor sizes of 1-4 cm in 1 cm increments.

RESULTS

In the examined patient cohort, simulation using pitch of 0.06 showed that 30% of the patients exhibited a 5% chance of mean breathing amplitude overestimations of 47%, while 30% showed a 5% chance of mean breathing amplitude underestimations of 36%; with a separate simulation using pitch of 0.1 showing, respectively, 37% overestimation and 61% underestimation.

CONCLUSIONS

The simulation indicates that commercial low-pitch helical 4DCT processes potentially yield large tumor motion measurement errors, both over- and underestimating the tumor motion.

A Method for Assessing Ground-Truth Accuracy of the 5DCT Technique

PURPOSE

To develop a technique that assesses the accuracy of the breathing phase-specific volume image generation process by patient-specific breathing motion model using the original free-breathing computed tomographic (CT) scans as ground truths.

METHODS

Sixteen lung cancer patients underwent a previously published protocol in which 25 free-breathing fast helical CT scans were acquired with a simultaneous breathing surrogate. A patient-specific motion model was constructed based on the tissue displacements determined by a state-of-the-art deformable image registration. The first image was arbitrarily selected as the reference image. The motion model was used, along with the free-breathing phase information of the original 25 image datasets, to generate a set of deformation vector fields that mapped the reference image to the 24 nonreference images. The high-pitch helically acquired original scans served as ground truths because they captured the instantaneous tissue positions during free breathing. Image similarity between the simulated and the original scans was assessed using deformable registration that evaluated the pointwise discordance throughout the lungs.

RESULTS

Qualitative comparisons using image overlays showed excellent agreement between the simulated images and the original images. Even large 2-cm diaphragm displacements were very well modeled, as was sliding motion across the lung-chest wall boundary. The mean error across the patient cohort was 1.15 ± 0.37 mm, and the mean 95th percentile error was 2.47 ± 0.78 mm.

CONCLUSION

The proposed ground truth-based technique provided voxel-by-voxel accuracy analysis that could identify organ-specific or tumor-specific motion modeling errors for treatment planning. Despite a large variety of breathing patterns and lung deformations during the free-breathing scanning session, the 5-dimensionl CT technique was able to accurately reproduce the original helical CT scans, suggesting its applicability to a wide range of patients.

Patient-specific biomechanical model for the prediction of lung motion from 4-D CT images

This paper presents an approach to predict the deformation of the lungs and surrounding organs during respiration. The framework incorporates a computational model of the respiratory system, which comprises an anatomical model extracted from computed tomography (CT) images at end-expiration (EE), and a biomechanical model of the respiratory physiology, including the material behavior and interactions between organs. A personalization step is performed to automatically estimate patient-specific thoracic pressure, which drives the biomechanical model. The zone-wise pressure values are obtained by using a trust-region optimizer, where the estimated motion is compared to CT images at end-inspiration (EI). A detailed convergence analysis in terms of mesh resolution, time stepping and number of pressure zones on the surface of the thoracic cavity is carried out. The method is then tested on five public datasets. Results show that the model is able to predict the respiratory motion with an average landmark error of 3.40 ±1.0 mm over the entire respiratory cycle. The estimated 3-D lung motion may constitute as an advanced 3-D surrogate for more accurate medical image reconstruction and patient respiratory analysis.

Digital reconstruction of high-quality daily 4D cone-beam CT images using prior knowledge of anatomy and respiratory motion

Conventional in-room cone-beam computed tomography (CBCT) lacks explicit representation of patient respiratory motion and usually has poor image quality and inaccurate CT numbers for target delineation and/or adaptive treatment planning. In-room four-dimensional (4D) CBCT image acquisition is still time consuming and suffers the same issue of poor image quality. To overcome this limitation, we developed a computational framework to digitally synthesize high-quality daily 4D CBCT images using the prior knowledge of motion and appearance learned from the planning 4D CT dataset. A patient-specific respiratory motion model was first constructed from the planning 4D CT images using principal component analysis of displacement vector fields across different respiratory phases. Subsequently, the respiratory motion model as well as the image content of the planning CT was spatially mapped onto the daily CBCT using deformable image registration. The synthesized 4D images possess explicit patient motion while maintaining the geometric accuracy of patient's anatomy at the time of treatment. We validated our model by quantitatively comparing the synthesized 4D CBCT against the 4D CT dataset acquired in the same day from protocol patients undergoing daily in-room CBCT setup and weekly 4D CT for treatment evaluation. Our preliminary results have demonstrated good agreement of contours in different motion phases between the synthesized and acquired scans. Various imaging artifacts were also suppressed and soft-tissue visibility was enhanced.

Determination of regional lung air volume distribution at mid-tidal breathing from computed tomography: a retrospective study of normal variability and reproducibility

Background

Determination of regional lung air volume has several clinical applications. This study investigates the use of mid-tidal breathing CT scans to provide regional lung volume data.

Methods

Low resolution CT scans of the thorax were obtained during tidal breathing in 11 healthy control male subjects, each on two separate occasions. A 3D map of air volume was derived, and total lung volume calculated. The regional distribution of air volume from centre to periphery of the lung was analysed using a radial transform and also using one dimensional profiles in three orthogonal directions.

Results

The total air volumes for the right and left lungs were 1035 +/− 280 ml and 864 +/− 315 ml, respectively (mean and SD). The corresponding fractional air volume concentrations (FAVC) were 0.680 +/− 0.044 and 0.658 +/− 0.062. All differences between the right and left lung were highly significant (p < 0.0001). The coefficients of variation of repeated measurement of right and left lung air volumes and FAVC were 6.5% and 6.9% and 2.5% and 3.6%, respectively. FAVC correlated significantly with lung space volume (r = 0.78) (p < 0.005). FAVC increased from the centre towards the periphery of the lung. Central to peripheral ratios were significantly higher for the right (0.100 +/− 0.007 SD) than the left (0.089 +/− 0.013 SD) (p < 0.0001).

Conclusion

A technique for measuring the distribution of air volume in the lung at mid-tidal breathing is described. Mean values and reproducibility are described for healthy male control subjects. Fractional air volume concentration is shown to increase with lung size.

Comparing approaches to correct for respiratory motion in NH3 PET-CT cardiac perfusion imaging

Aim

Respiratory motion affects cardiac PET-computed tomography (CT) imaging by reducing attenuation correction (AC) accuracy and by introducing blur. The aim of this study was to compare three approaches for reducing motion-induced AC errors and evaluate the inclusion of respiratory motion correction.

Materials and methods

AC with a helical CT was compared with averaged cine and gated cine CT, as well as with a pseudo-gated CT, which was produced by applying PET-derived motion fields to the helical CT. Data-driven gating was used to produce respiratory-gated PET and CT images, and 60 NH₃ PET scans were attenuation corrected with each of the CTs. Respiratory motion correction was applied to the gated and pseudo-gated attenuation-corrected PET images.

Results

Anterior and lateral wall intensity measured in attenuation-corrected PET images generally increased when PET-CT alignment improved and decreased when alignment degraded. On average, all methods improved PET-CT liver and cardiac alignment, and increased anterior wall intensity by more than 10% in 36, 33 and 25 cases for the averaged, gated and pseudo-gated CTAC PET images, respectively. However, cases were found where alignment worsened and severe artefacts resulted. This occurred in more cases and to a greater extent for the averaged and gated CT, where the anterior wall intensity reduced by more than 10% in 21 and 24 cases, respectively, compared with six cases for the pseudo-gated CT. Application of respiratory motion correction increased the average anterior and inferior wall intensity, but only 13% of cases increased by more than 10%.

Conclusion

All methods improved average respiratory-induced AC errors; however, some severe artefacts were produced. The pseudo-gated CT was found to be the most robust method.

Joint surface reconstruction and 4D deformation estimation from sparse data and prior knowledge for marker-less Respiratory motion tracking

PURPOSE

The intraprocedural tracking of respiratory motion has the potential to substantially improve image-guided diagnosis and interventions. The authors have developed a sparse-to-dense registration approach that is capable of recovering the patient's external 3D body surface and estimating a 4D (3D + time) surface motion field from sparse sampling data and patient-specific prior shape knowledge.

METHODS

The system utilizes an emerging marker-less and laser-based active triangulation (AT) sensor that delivers sparse but highly accurate 3D measurements in real-time. These sparse position measurements are registered with a dense reference surface extracted from planning data. Thereby a dense displacement field is recovered, which describes the spatio-temporal 4D deformation of the complete patient body surface, depending on the type and state of respiration. It yields both a reconstruction of the instantaneous patient shape and a high-dimensional respiratory surrogate for respiratory motion tracking. The method is validated on a 4D CT respiration phantom and evaluated on both real data from an AT prototype and synthetic data sampled from dense surface scans acquired with a structured-light scanner.

RESULTS

In the experiments, the authors estimated surface motion fields with the proposed algorithm on 256 datasets from 16 subjects and in different respiration states, achieving a mean surface reconstruction accuracy of ± 0.23 mm with respect to ground truth data-down from a mean initial surface mismatch of 5.66 mm. The 95th percentile of the local residual mesh-to-mesh distance after registration did not exceed 1.17 mm for any subject. On average, the total runtime of our proof of concept CPU implementation is 2.3 s per frame, outperforming related work substantially.

CONCLUSIONS

In external beam radiation therapy, the approach holds potential for patient monitoring during treatment using the reconstructed surface, and for motion-compensated dose delivery using the estimated 4D surface motion field in combination with external-internal correlation models.

Continuous registration based on computed tomography for breathing motion compensation

Introduction

Image guidance for intervention is applied for complex and difficult anatomical regions. Nowadays, it is typically used in neurosurgery, otolaryngology, orthopedics and dentistry. The application of the image-guided system for soft tissues is challenging due to various deformations caused by respiratory motion, tissue elasticity and peristalsis.

Aim

The main task for the presented approach is continuous registration of preoperative computed tomography (CT) and patient position in the operating room (OR) without touching the patient and compensation of breathing motion. This approach is being developed as a step to image-guided percutaneous liver RF tumor ablation.

Material and methods

Up to ten integrated radiological markers are placed on the patient's skin before CT scans. Then the anatomical model based on CT images is calculated. Point-to-point registration based on the Horn algorithm during a few breathing cycles is performed using a videometric tracking system. The transformation which corresponds to the minimum fiducial registration error (FRE) is found during the registration and it is treated as the initial transformation for calculating local deformation field of breathing motion compensation based on the spline approach.

Results

For manual registration of the abdominal phantom, the mean values of target registration error (TRE), fiducial localization error (FLE) and FRE are all below 4 mm for the rigid transformation and are below 1 mm for the affine transformation. For the patient's data they are all below 9 mm and 6 mm, respectively. For the automatic method, different marker configurations have been evaluated while dividing the respiratory cycle into inhale and exhale. Average median values for FRE, TRE rigid estimation and TRE based on spline deformation were 15.56 mm, 0.82 mm and 7.21 mm respectively.

Conclusions

In this application two registration methods of abdominal preoperative CT anatomical model and physical patient position in OR were presented and compared. The presented approach is being developed as a step to image-guided percutaneous liver radiofrequency ablation tumor ablation. Implementation of the automated registration method to clinical practice is easier because of shortening of preparation time in OR, no necessity of touching the patient, and no dependency on the physician's experience.

Estimating the 4D respiratory lung motion by spatiotemporal registration and super-resolution image reconstruction

PURPOSE

One of the main challenges in lung cancer radiation therapy is how to reduce the treatment margin but accommodate the geometric uncertainty of moving tumor. 4D-CT is able to provide the full range of motion information for the lung and tumor. However, accurate estimation of lung motion with respect to the respiratory phase is difficult due to various challenges in image registration, e.g., motion artifacts and large interslice thickness in 4D-CT. Meanwhile, the temporal coherence across respiration phases is usually not guaranteed in the conventional registration methods which consider each phase image in 4D-CT independently. To address these challenges, the authors present a unified approach to estimate the respiratory lung motion with two iterative steps.

METHODS

First, the authors propose a novel spatiotemporal registration algorithm to align all phase images of 4D-CT (in low-resolution) to a high-resolution group-mean image in the common space. The temporal coherence of registration is maintained by a set of temporal fibers that delineate temporal correspondences across different respiratory phases. Second, a super-resolution technique is utilized to build the high-resolution group-mean image with more anatomical details than any individual phase image, thus largely alleviating the registration uncertainty especially in correspondence detection. In particular, the authors use the concept of sparse representation to keep the group-mean image as sharp as possible.

RESULTS

The performance of our 4D motion estimation method has been extensively evaluated on both the simulated datasets and real lung 4D-CT datasets. In all experiments, our method achieves more accurate and consistent results in lung motion estimation than all other state-of-the-art approaches under comparison.

CONCLUSIONS

The authors have proposed a novel spatiotemporal registration method to estimate the lung motion in 4D-CT. Promising results have been obtained, which indicates the high applicability of our method in clinical lung cancer radiation therapy.

GND-PCA-based statistical modeling of diaphragm motion extracted from 4D MRI

We analyzed a statistical model of diaphragm motion using regular principal component analysis (PCA) and generalized N-dimensional PCA (GND-PCA). First, we generate 4D MRI of respiratory motion from 2D MRI using an intersection profile method. We then extract semiautomatically the diaphragm boundary from the 4D-MRI to get subject-specific diaphragm motion. In order to build a general statistical model of diaphragm motion, we normalize the diaphragm motion in time and spatial domains and evaluate the diaphragm motion model of 10 healthy subjects by applying regular PCA and GND-PCA. We also validate the results using the leave-one-out method. The results show that the first three principal components of regular PCA contain more than 98% of the total variation of diaphragm motion. However, validation using leave-one-out method gives up to 5.0 mm mean of error for right diaphragm motion and 3.8 mm mean of error for left diaphragm motion. Model analysis using GND-PCA provides about 1 mm margin of error and is able to reconstruct the diaphragm model by fewer samples.

A novel technique for markerless, self-sorted 4D-CBCT: feasibility study

PURPOSE

Four-dimensional CBCT (4D-CBCT) imaging in the treatment room can provide verification of moving targets, facilitating the potential for margin reduction and consequent dose escalation. Reconstruction of 4D-CBCT images requires correlation of respiratory phase with projection acquisition, which is often achieved with external surrogate measures of respiration. However, external measures may not be a direct representation of the motion of the internal anatomy and it is therefore the aim of this work to develop a novel technique for markerless, self-sorted 4D-CBCT reconstruction.

METHODS

A novel 4D-CBCT reconstruction technique based on the principles of Fourier transform (FT) theory was investigated for markerless extraction of respiratory phase directly from projection data. In this FT technique, both phase information (FT-phase) and magnitude information (FT-magnitude) were separately implemented in order to discern projections corresponding to peak inspiration, which then facilitated the proceeding sort and bin processes involved in retrospective 4D image reconstruction. In order to quantitatively evaluate the accuracy of the Fourier methods, peak-inspiration projections identified each by FT-phase and FT-magnitude were compared to those manually identified by visual tracking of structures. The average phase difference as assigned by each method vs the manual technique was calculated per projection dataset. The percentage of projections that were assigned within 10% phase of each other was also computed. Both Fourier methods were tested on two phantom datasets, programmed to exhibit sinusoidal respiratory cycles of 2.0 cm in amplitude with respiratory cycle lengths of 3 and 6 s, respectively. Additionally, three sets of patient projections were studied. All of the data were previously acquired at slow-gantry speeds ranging between 0.6°/s and 0.7°/s over a 200° rotation. Ten phase bins with 10% phase windows were selected for 4D-CBCT reconstruction of one phantom and one patient case for visual and quantitative comparison. Line profiles were plotted for the 0% and 50% phase images as reconstructed by the manual technique and each of the Fourier methods.

RESULTS

As compared with the manual technique, the FT-phase method resulted in average phase differences of 1.8% for the phantom with the 3 s respiratory cycle, 3.9% for the phantom with the 6 s respiratory cycle, 2.9% for patient 1, 5.0% for patient 2, and 3.8% for patient 3. For the FT-magnitude method, these numbers were 2.1%, 4.0%, 2.9%, 5.3%, and 3.5%, respectively. The percentage of projections that were assigned within 10% phase by the FT-phase method as compared to the manual technique for the five datasets were 100.0%, 100.0%, 97.6%, 93.4%, and 94.1%, respectively, whereas for the FT-magnitude method these percentages were 98.1%, 92.3%, 98.7%, 87.3%, and 95.7%. Reconstructed 4D phase images for both the phantom and patient case were visually and quantitatively equivalent between each of the Fourier methods vs the manual technique.

CONCLUSIONS

A novel technique employing the basics of Fourier transform theory was investigated and demonstrated to be feasible in achieving markerless, self-sorted 4D-CBCT reconstruction.

Building motion models of lung tumours from cone-beam CT for radiotherapy applications

A method is presented to build a surrogate-driven motion model of a lung tumour from a cone-beam CT scan, which does not require markers. By monitoring an external surrogate in real time, it is envisaged that the motion model be used to drive gated or tracked treatments. The motion model would be built immediately before each fraction of treatment and can account for inter-fraction variation. The method could also provide a better assessment of tumour shape and motion prior to delivery of each fraction of stereotactic ablative radiotherapy. The two-step method involves enhancing the tumour region in the projections, and then fitting the surrogate-driven motion model. On simulated data, the mean absolute error was reduced to 1 mm. For patient data, errors were determined by comparing estimated and clinically identified tumour positions in the projections, scaled to mm at the isocentre. Averaged over all used scans, the mean absolute error was under 2.5 mm in superior-inferior and transverse directions.

On mixed reality environments for minimally invasive therapy guidance: systems architecture, successes and challenges in their implementation from laboratory to clinic

Mixed reality environments for medical applications have been explored and developed over the past three decades in an effort to enhance the clinician's view of anatomy and facilitate the performance of minimally invasive procedures. These environments must faithfully represent the real surgical field and require seamless integration of pre- and intra-operative imaging, surgical instrument tracking, and display technology into a common framework centered around and registered to the patient. However, in spite of their reported benefits, few mixed reality environments have been successfully translated into clinical use. Several challenges that contribute to the difficulty in integrating such environments into clinical practice are presented here and discussed in terms of both technical and clinical limitations. This article should raise awareness among both developers and end-users toward facilitating a greater application of such environments in the surgical practice of the future.

Advances in 4D radiation therapy for managing respiration: part I - 4D imaging

Techniques for managing respiration during imaging and planning of radiation therapy are reviewed, concentrating on free-breathing (4D) approaches. First, we focus on detailing the historical development and basic operational principles of currently-available "first generation" 4D imaging modalities: 4D computed tomography, 4D cone beam computed tomography, 4D magnetic resonance imaging, and 4D positron emission tomography. Features and limitations of these first generation systems are described, including necessity of breathing surrogates for 4D image reconstruction, assumptions made in acquisition and reconstruction about the breathing pattern, and commonly-observed artifacts. Both established and developmental methods to deal with these limitations are detailed. Finally, strategies to construct 4D targets and images and, alternatively, to compress 4D information into static targets and images for radiation therapy planning are described.

Tracking the motion trajectories of junction structures in 4D CT images of the lung

Respiratory motion poses a major challenge in lung radiotherapy. Based on 4D CT images, a variety of intensity-based deformable registration techniques have been proposed to study the pulmonary motion. However, the accuracy achievable with these approaches can be sub-optimal because the deformation is defined globally in space. Therefore, the accuracy of the alignment of local structures may be compromised. In this work, we propose a novel method to detect a large collection of natural junction structures in the lung and use them as the reliable markers to track the lung motion. Specifically, detection of the junction centers and sizes is achieved by analysis of local shape profiles on one segmented image. To track the temporal trajectory of a junction, the image intensities within a small region of interest surrounding the center are selected as its signature. Under the assumption of the cyclic motion, we describe the trajectory by a closed B-spline curve and search for the control points by maximizing a metric of combined correlation coefficients. Local extrema are suppressed by improving the initial conditions using random walks from pair-wise optimizations. Several descriptors are introduced to analyze the motion trajectories. Our method was applied to 13 real 4D CT images. More than 700 junctions in each case are detected with an average positive predictive value of greater than 90%. The average tracking error between automated and manual tracking is sub-voxel and smaller than the published results using the same set of data.