Introduction of a pseudo demons force to enhance deformation range for robust reconstruction of super-resolution time-resolved 4DMRI

Ultra-fast multi-parametric 4D-MRI image reconstruction for real-time applications using a downsampling-invariant deformable registration (D2R) model

BACKGROUND AND PURPOSE

Motion estimation from severely downsampled 4D-MRI is essential for real-time imaging and tumor tracking. This simulation study developed a novel deep learning model for simultaneous MR image reconstruction and motion estimation, named the Downsampling-Invariant Deformable Registration (D2R) model.

MATERIALS AND METHODS

Forty-three patients undergoing radiotherapy for liver tumors were recruited for model training and internal validation. Five prospective patients from another center were recruited for external validation. Patients received 4D-MRI scans and 3D MRI scans. The 4D-MRI was retrospectively down-sampled to simulate real-time acquisition. Motion estimation was performed using the proposed D2R model. The accuracy and robustness of the proposed D2R model and baseline methods, including Demons, Elastix, the parametric total variation (pTV) algorithm, and VoxelMorph, were compared. High-quality (HQ) 4D-MR images were also constructed using the D2R model for real-time imaging feasibility verification. The image quality and motion accuracy of the constructed HQ 4D-MRI were evaluated.

RESULTS

The D2R model showed significantly superior and robust registration performance than all the baseline methods at downsampling factors up to 500. HQ T1-weighted and T2-weighted 4D-MR images were also successfully constructed with significantly improved image quality, sub-voxel level motion error, and real-time efficiency. External validation demonstrated the robustness and generalizability of the technique.

CONCLUSION

In this study, we developed a novel D2R model for deformation estimation of downsampled 4D-MR images. HQ 4D-MR images were successfully constructed using the D2R model. This model may expand the clinical implementation of 4D-MRI for real-time motion management during liver cancer treatment.

A Simulation Study of Tolerance of Breathing Amplitude Variations in Radiotherapy of Lung Cancer Using 4DCT and Time-Resolved 4DMRI

As patient breathing irregularities can introduce a large uncertainty in targeting the internal tumor volume (ITV) of lung cancer patients, and thereby affect treatment quality, this study evaluates dose tolerance of tumor motion amplitude variations in ITV-based volumetric modulated arc therapy (VMAT). A motion-incorporated planning technique was employed to simulate treatment delivery of 10 lung cancer patients' clinical VMAT plans using original and three scaling-up (by 0.5, 1.0, and 2.0 cm) motion waveforms from single-breath four-dimensional computed tomography (4DCT) and multi-breath time-resolved 4D magnetic resonance imaging (TR-4DMRI). The planning tumor volume (PTV = ITV + 5 mm margin) dose coverage (PTV D95%) was evaluated. The repeated waveforms were used to move the isocenter in sync with the clinical leaf motion and gantry rotation. The continuous VMAT arcs were broken down into many static beam fields at the control points (2°-interval) and the composite plan represented the motion-incorporated VMAT plan. Eight motion-incorporated plans per patient were simulated and the plan with the native 4DCT waveform was used as a control. The first (D95% ≤ 95%) and second (D95% ≤ 90%) plan breaching points due to motion amplitude increase were identified and analyzed. The PTV D95% in the motion-incorporated plans was 99.4 ± 1.0% using 4DCT, closely agreeing with the corresponding ITV-based VMAT plan (PTV D95% = 100%). Tumor motion irregularities were observed in TR-4DMRI and triggered D95% ≤ 95% in one case. For small tumors, 4 mm extra motion triggered D95% ≤ 95%, and 6-8 mm triggered D95% ≤ 90%. For large tumors, 14 mm and 21 mm extra motions triggered the first and second breaching points, respectively. This study has demonstrated that PTV D95% breaching points may occur for small tumors during treatment delivery. Clinically, it is important to monitor and avoid systematic motion increase, including baseline drift, and large random motion spikes through threshold-based beam gating.

Advances and potential of optical surface imaging in radiotherapy

This article reviews the recent advancements and future potential of optical surface imaging (OSI) in clinical applications as a four-dimensional (4D) imaging modality for surface-guided radiotherapy (SGRT), including OSI systems, clinical SGRT applications, and OSI-based clinical research. The OSI is a non-ionizing radiation imaging modality, offering real-time 3D surface imaging with a large field of view (FOV), suitable for in-room interactive patient setup, and real-time motion monitoring at any couch rotation during radiotherapy. So far, most clinical SGRT applications have focused on treating superficial breast cancer or deep-seated brain cancer in rigid anatomy, because the skin surface can serve as tumor surrogates in these two clinical scenarios, and the procedures for breast treatments in free-breathing (FB) or at deep-inspiration breath-hold (DIBH), and for cranial stereotactic radiosurgery (SRS) and radiotherapy (SRT) are well developed. When using the skin surface as a body-position surrogate, SGRT promises to replace the traditional tattoo/laser-based setup. However, this requires new SGRT procedures for all anatomical sites and new workflows from treatment simulation to delivery. SGRT studies in other anatomical sites have shown slightly higher accuracy and better performance than a tattoo/laser-based setup. In addition, radiographical image-guided radiotherapy (IGRT) is still necessary, especially for stereotactic body radiotherapy (SBRT). To go beyond the external body surface and infer an internal tumor motion, recent studies have shown the clinical potential of OSI-based spirometry to measure dynamic tidal volume as a tumor motion surrogate, and Cherenkov surface imaging to guide and assess treatment delivery. As OSI provides complete datasets of body position, deformation, and motion, it offers an opportunity to replace fiducial-based optical tracking systems. After all, SGRT has great potential for further clinical applications. In this review, OSI technology, applications, and potential are discussed since its first introduction to radiotherapy in 2005, including technical characterization, different commercial systems, and major clinical applications, including conventional SGRT on top of tattoo/laser-based alignment and new SGRT techniques attempting to replace tattoo/laser-based setup. The clinical research for OSI-based tumor tracking is reviewed, including OSI-based spirometry and OSI-guided tumor tracking models. Ongoing clinical research has created more SGRT opportunities for clinical applications beyond the current scope.

Real-Time 2D MR Cine From Beam Eye's View With Tumor-Volume Projection to Ensure Beam-to-Tumor Conformality for MR-Guided Radiotherapy of Lung Cancer

Purpose

To minimize computation latency using a predictive strategy to retrieve and project tumor volume onto 2D MR beam eye’s view (BEV) cine from time-resolved four-dimensional magnetic resonance imaging (TR-4DMRI) libraries (inhalation/exhalation) for personalized MR-guided intensity-modulated radiotherapy (IMRT) or volumetric-modulated arc therapy (VMAT).

Methods

Two time-series forecasting algorithms, autoregressive (AR) modeling and deep-learning-based long short-term memory (LSTM), were applied to predict the diaphragm position in the next 2D BEV cine to identify a motion-matched and hysteresis-accounted image to retrieve the tumor volume from the inhalation/exhalation TR-4DMRI libraries. Three 40-s TR-4DMRI (2 Hz, 3 × 80 images) per patient of eight lung cancer patients were used to create patient-specific inhalation/exhalation 4DMRI libraries, extract diaphragmatic waveforms, and interpolate them to f = 4 and 8 Hz to match 2D cine frame rates. Along a (40•f)-timepoint waveform, 30•f training timepoints were moved forward to produce 3×(10•f-1) predictions. The accuracy of position prediction was assessed against the waveform ground truth. The accuracy of tumor volume projections was evaluated using the center-of-mass difference (∆COM) and Dice similarity index against the TR-4DMRI ground truth for both IMRT (six beam angles, 30° interval) and VMAT (240/480 beam angles, 1.5°/0.75° interval, at 4/8 Hz, respectively).

Results

The accuracy of the first-timepoint prediction is 0.36 ± 0.10 mm (AR) and 0.62 ± 0.21 mm (LSTM) at 4 Hz and 0.06 ± 0.02 mm (AR) and 0.18 ± 0.06 mm (LSTM) at 8 Hz. A 10%–20% random error in prediction-library matching increases the overall uncertainty slightly. For both IMRT and VMAT, the accuracy of projected tumor volume contours on 2D BEV cine is ∆COM = 0.39 ± 0.13 mm and DICE = 0.97 ± 0.02 at 4 Hz and ∆COM = 0.10 ± 0.04 mm and DICE = 1.00 ± 0.00 at 8Hz.

Conclusion

This study demonstrates the feasibility of accurately predicting respiratory motion during 2D BEV cine imaging, identifying a motion-matched and hysteresis-accounted tumor volume, and projecting tumor volume contour on 2D BEV cine for real-time assessment of beam-to-tumor conformality, promising for optimal personalized MR-guided radiotherapy.

Stability and Reliability of Enhanced External-Internal Motion Correlation via Dynamic Phase-Shift Corrections Over 30-min Timeframe for Respiratory-Gated Radiotherapy

To assess the stability of patient-specific phase shifts between external- and internal-respiratory motion waveforms, the reliability of enhanced external–internal correlation with phase-shift correction, and the feasibility of guiding respiratory-gated radiotherapy (RGRT) over 30 min. In this clinical feasibility investigation, external bellows and internal-navigator waveforms were simultaneously and prospectively acquired along with two four-dimensional magnetic resonance imaging (4DMRI) scans (6–15 m each) with 15–20 m intervals in 10 volunteers. A bellows was placed 5 cm inferior to the xiphoid to monitor abdominal motion, and an MR navigator was used to track the diaphragmatic motion. The mean phase-domain (MPD) method was applied, which combines three individual phase-calculating methods: phase-space oval fitting, principal component analysis, and analytic signal analysis, weighted by the reciprocal of their residual errors (RE) excluding outliers (RE >2σ). The time-domain cross-correlation (TCC) analysis was applied for comparison. Dynamic phase-shift correction was performed based on the phase shift detected on the fly within two 10 s moving datasets. Simulating bellows-triggered gating, the median and 95% confidence interval for the navigator's position at beam-on/beam-off and %harm (percentage of beam-on time outside the safety margin) were calculated. Averaged across all subjects, the mean phase shifts are found indistinguishable (p > .05) between scan 1 (55˚ ± 9˚) and scan 2 (59˚ ± 11˚). Using the MPD method the averaged correlation increases from 0.56 ± 0.22 to 0.85 ± 0.11 for scan 1 and from 0.47 ± 0.30 to 0.84 ± 0.08 for scan 2. The TCC correction results in similar results. After phase-shift correction, the number of cases that were suitable for amplitude gating (with <10%harm) increased from 2 to 17 out of 20 cases. A patient-specific, stable phase-shift between the external and internal motions was observed and corrected using the MPD and TCC methods, producing long-lasting enhanced motion correlation over 30m. Phase-shift correction offers a feasible strategy for improving the accuracy of tumor-motion prediction during RGRT.

Feasibility of MR-guided radiotherapy using beam-eye-view 2D-cine with tumor-volume projection

PURPOSE

Current magnetic resonance imaging (MRI) guided radiotherapy (MRgRT) applies sagittal/coronal 2D-cine to monitor major tumor motions, however, the beam eye's view (BEV) with volumetric tumor projection would be the best measure for radiation beam conformality, independent of tumor through-plane motion. The goal is to assess the feasibility, accuracy, and performance of the BEV approach.

METHODS

Beam-specific BEV 2D-cine with volume-projected tumor contours were simulated to establish a 2D/3D tumor match against a tumor-motion library based on multi-breath time-resolved (TR) 4DMRI images. Two BEV-library-matching methods were developed: (1) fast screening with tumor center-of-mass (∆COM), in-plane area ratio, and DICE similarity, and finalizing with the highest DICE score and (2) DICE screening for top-3 candidates and finalizing with rigid registration. A 4D-XCAT digital phantom and 8 lung-cancer patients were used for assessment. For each patient, 3 sets of 40 s TR-4DMRI were acquired at 2 Hz and 6 representative BEV were created with the isocenter set at tumor COM in mid-respiration. One TR-4DMRI set (40 × 2 = 80-images) was used to simulate BEV 2D-cine and the other two (160-images) were used to create a library. The matching result was validated against the ground truth within the test set. Using a leave-one-out strategy, the success rate, accuracy, and speed of tumor matching were assessed for volume-projected tumors over 11520 time-points (=8patients•3sets•80images•6BEVs).

RESULTS

Volume-projected tumor contour area on the 6 BEVs varies by 60% ± 8% and [Formula: see text] (in-plane/volume-projected) varies by 82% ± 9%. The [Formula: see text] changes with tumor shape, orientation, and through-plane motion. Method-1 produces 96% matching success (ΔCOM = 0.7 ± 0.2 mm, [Formula: see text]=1.01 ± 0.02, Dice=0.92 ± 0.02) with the computational time of 15 ± 1 ms/match, while method-2 produces 94% ± 1% success (ΔCOM = 0.2 ± 0.1 mm, [Formula: see text]=1.00 ± 0.01, Dice = 0.94 ± 0.02) with 223 ± 13 ms/match.

CONCLUSION

This study has demonstrated the feasibility, accuracy, and benefits of BEV 2D-cine imaging with tumor-volume projection, allowing real-time tumor motion monitoring and beam conformality checking. Further clinical evaluation is necessary before MRgRT applications.

Enhanced super-resolution reconstruction of T1w time-resolved 4DMRI in low-contrast tissue using 2-step hybrid deformable image registration

Purpose

Deformable image registration (DIR) in low‐contrast tissues is often suboptimal because of low visibility of landmarks, low driving‐force to deform, and low penalty for misalignment. We aim to overcome the shortcomings for improved reconstruction of time‐resolved four‐dimensional magnetic resonance imaging (TR‐4DMRI).

Methods and Materials

Super‐resolution TR‐4DMRI reconstruction utilizes DIR to combine high‐resolution (highR:2x2x2mm³) breath‐hold (BH) and low‐resolution (lowR:5x5x5mm³) free‐breathing (FB) 3D cine (2Hz) images to achieve clinically acceptable spatiotemporal resolution. A 2‐step hybrid DIR approach was developed to segment low‐dynamic‐range (LDR) regions: low‐intensity lungs and high‐intensity “bodyshell” (=body‐lungs) for DIR refinement after conventional DIR. The intensity in LDR regions was renormalized to the full dynamic range (FDR) to enhance local tissue contrast. A T1‐mapped 4D XCAT digital phantom was created, and seven volunteers and five lung cancer patients were scanned with two BH and one 3D cine series per subject to compare the 1‐step conventional and 2‐step hybrid DIR using: (a) the ground truth in the phantom, (b) highR‐BH references, which were used to simulate 3D cine images by down‐sampling and Rayleigh‐noise‐adding, and (c) cross‐verification between two TR‐4DMRI images reconstructed from two BHs. To assess DIR improvement, 8‐17 blood vessel bifurcations were used in volunteers, and lung tumor position, size, and shape were used in phantom and patients, together with the voxel intensity correlation (VIC), structural similarity (SSIM), and cross‐consistency check (CCC).

Results

The 2‐step hybrid DIR improves contrast and DIR accuracy. In volunteers, it improves low‐contrast alignment from 6.5 ± 1.8 mm to 3.3 ± 1.0 mm. In phantom, it improves tumor center of mass alignment (COM = 1.3 ± 0.2 mm) and minimizes DIR directional difference. In patients, it produces almost‐identical tumor COM, size, and shape (dice> 0.85) as the reference. The VIC and SSIM are significantly increased and the number of CCC outliers are reduced by half.

Conclusion

The 2‐step hybrid DIR improves low‐contrast‐tissue alignment and increases lung tumor fidelity. It is recommended to adopt the 2‐step hybrid DIR for TR‐4DMRI reconstruction.

A super-resolution framework for the reconstruction of T2-weighted (T2w) time-resolved (TR) 4DMRI using T1w TR-4DMRI as the guidance

PURPOSE

The purpose of this study was to develop T2-weighted (T2w) time-resolved (TR) four-dimensional magnetic resonance imaging (4DMRI) reconstruction technique with higher soft-tissue contrast for multiple breathing cycle motion assessment by building a super-resolution (SR) framework using the T1w TR-4DMRI reconstruction as guidance.

METHODS

The multi-breath T1w TR-4DMRI was reconstructed by deforming a high-resolution (HR: 2 × 2 × 2 mm³ ) volumetric breath-hold (BH, 20s) three-dimensional magnetic resonance imaging (3DMRI) image to a series of low-resolution (LR: 5 × 5 × 5 mm³ ) 3D cine images at a 2Hz frame rate in free-breathing (FB, 40 s) using an enhanced Demons algorithm, namely [T1^BH →FB] reconstruction. Within the same imaging session, respiratory-correlated (RC) T2w 4DMRI (2 × 2 × 2 mm³ ) was acquired based on an internal navigator to gain HR T2w (T2^HR ) in three states (full exhalation and mid and full inhalation) in ~5 min. Minor binning artifacts in the RC-4DMRI were automatically identified based on voxel intensity correlation (VIC) between consecutive slices as outliers (VIC < VIC^mean -σ) and corrected by deforming the artifact slices to interpolated slices from the adjacent slices iteratively until no outliers were identified. A T2^HR image with minimal deformation (<1 cm at the diaphragm) from the T1^BH image was selected for multi-modal B-Spline deformable image registration (DIR) to establish the T2^HR -T1^BH voxel correspondence. Two approaches to reconstruct T2w TR-4DMRI were investigated: (A) T2^HR →[T1^BH →FB]: to deform T2w HR to T1w BH only as T1w TR-4DMRI was reconstructed, and combine the two displacement vector fields (DVFs) to reconstruct T2w TR-4DMRI, and (B) [T2^HR ←T1^BH ]→FB: to deform T1w BH to T2w HR first and apply the deformed T1w BH to reconstruct T2w TR-4DMRI. The reconstruction times were similar, 8-12 min per volume. To validate the two methods, T2w- and T1w-mapped 4D XCAT digital phantoms were utilized with three synthetic spherical tumors (ϕ = 2.0, 3.0, and 4.0 cm) in the lower or mid lobes as the ground truth to evaluate the tumor location (the center of mass, COM), size (volume ratio, %V), and shape (Dice index). Six lung cancer patients were scanned under an IRB-approved protocol and the T2w TR-4DMRI images reconstructed from the two methods were compared based on the preservation of the three tumor characteristics. The local tumor-contained image quality was also characterized using the VIC and structure similarity (SSIM) indexes.

RESULTS

In the 4D digital phantom, excellent tumor alignment after T2^HR -T1^HR DIR is achieved: ∆COM = 0.8 ± 0.5 mm, %V = 1.06 ± 0.02, and Dice = 0.91 ± 0.03, in both deformation directions using the DIR-target image as the reference. In patients, binning artifacts are corrected with improved image quality: average VIC increases from 0.92 ± 0.03 to 0.95 ± 0.01. Both T2w TR-4DMRI reconstruction methods produce similar tumor alignment errors ∆COM = 2.9 ± 0.6 mm. However, method B ([T2^HR ←T1^BH ]→FB) produces superior results in preserving more T2w tumor features with a higher %V = 0.99 ± 0.03, Dice = 0.81 ± 0.06, VIC = 0.85 ± 0.06, and SSIM = 0.65 ± 0.10 in the T2w TR-4DMRI images.

CONCLUSIONS

This study has demonstrated the feasibility of T2w TR-4DMRI reconstruction with high soft-tissue contrast and adequately-preserved tumor position, size, and shape in multiple breathing cycles. The T2w-centric DIR (method B) produces a superior solution for the SR-based framework of T2w TR-4DMRI reconstruction with highly preserved tumor characteristics and local image features, which are useful for tumor delineation and motion management in radiation therapy.

Respiratory-Correlated (RC) vs. Time-Resolved (TR) Four-Dimensional Magnetic Resonance Imaging (4DMRI) for Radiotherapy of Thoracic and Abdominal Cancer

Recent technological and clinical advancements of both respiratory-correlated (RC) and time-resolved (TR) four-dimensional magnetic resonance imaging (4DMRI) techniques are reviewed in light of tumor/organ motion simulation, monitoring, and assessment in radiotherapy. For radiotherapy of thoracic and abdominal cancer, respiratory-induced tumor motion, and motion variation due to breathing irregularities are the major uncertainties in treatment. RC-4DMRI is developed to assess tumor motion for treatment planning, whereas TR-4DMRI is developed to assess both motion and motion variation for treatment planning, delivery and assessment. RC-4DMRI is reconstructed to provide one-breathing-cycle motion, similar to 4D computed tomography (4DCT), the current clinical standard, but with higher soft-tissue contrast, no ionizing radiation, and less binning artifacts due to the use of an internal respiratory surrogate. Recent studies have shown that its spatial resolution has reached or exceeded that of 4DCT and scanning time becomes clinically acceptable. TR-4DMRI is recently developed with an adequate spatiotemporal resolution to assess tumor motion and motion variations for treatment simulation, delivery and assessment. The super-resolution approach is most promising since it can image any organ/body motion, whereas RC-4D MRI are limited to resolve only respiration-induced motion and some TR-4DMRI approaches may more or less depend on RC-4DMRI. TR-4DMRI provides multi-breath motion data that are useful not only in MR-guided radiotherapy but also for building a patient-specific motion model to guide radiotherapy treatment using an non-MR-equipped linear accelerator. Based on 4DMRI motion data, motion-corrected dynamic contrast imaging and diffusion-weighted imaging have also been reported, aiming to facilitate tumor delineation for more accurate radiotherapy targeting. Both RC- and TR-4DMRI have been evaluated for potential clinical applications, such as delineation of tumor volumes, where sufficiently high spatial resolution and large field-of-view are required. The 4DMRI techniques are promising to play a role in motion assessment in radiotherapy treatment planning, delivery, assessment, and adaptation.