A dual-stream deep convolutional network for reducing metal streak artifacts in CT images

Semi-supervised spatial-frequency transformer for metal artifact reduction in maxillofacial CT and evaluation with intraoral scan

PURPOSE

To develop a semi-supervised domain adaptation technique for metal artifact reduction with a spatial-frequency transformer (SFTrans) model (Semi-SFTrans), and to quantitatively compare its performance with supervised models (Sup-SFTrans and ResUNet) and traditional linear interpolation MAR method (LI) in oral and maxillofacial CT.

METHODS

Supervised models, including Sup-SFTrans and a state-of-the-art model termed ResUNet, were trained with paired simulated CT images, while semi-supervised model, Semi-SFTrans, was trained with both paired simulated and unpaired clinical CT images. For evaluation on the simulated data, we calculated Peak Signal-to-Noise Ratio (PSNR) and Structural Similarity Index Measure (SSIM) on the images corrected by four methods: LI, ResUNet, Sup-SFTrans, and Semi-SFTrans. For evaluation on the clinical data, we collected twenty-two clinical cases with real metal artifacts, and the corresponding intraoral scan data. Three radiologists visually assessed the severity of artifacts using Likert scales on the original, Sup-SFTrans-corrected, and Semi-SFTrans-corrected images. Quantitative MAR evaluation was conducted by measuring Mean Hounsfield Unit (HU) values, standard deviations, and Signal-to-Noise Ratios (SNRs) across Regions of Interest (ROIs) such as the tongue, bilateral buccal, lips, and bilateral masseter muscles, using paired t-tests and Wilcoxon signed-rank tests. Further, teeth integrity in the corrected images was assessed by comparing teeth segmentation results from the corrected images against the ground-truth segmentation derived from registered intraoral scan data, using Dice Score and Hausdorff Distance.

RESULTS

Sup-SFTrans outperformed LI, ResUNet and Semi-SFTrans on the simulated dataset. Visual assessments from the radiologists showed that average scores were (2.02 ± 0.91) for original CT, (4.46 ± 0.51) for Semi-SFTrans CT, and (3.64 ± 0.90) for Sup-SFTrans CT, with intra correlation coefficients (ICCs)＞0.8 of all groups and p < 0.001 between groups. On soft tissue, both Semi-SFTrans and Sup-SFTrans significantly reduced metal artifacts in tongue (p < 0.001), lips, bilateral buccal regions, and masseter muscle areas (p < 0.05). Semi-SFTrans achieved superior metal artifact reduction than Sup-SFTrans in all ROIs (p < 0.001). SNR results indicated significant differences between Semi-SFTrans and Sup-SFTrans in tongue (p = 0.0391), bilateral buccal (p = 0.0067), lips (p = 0.0208), and bilateral masseter muscle areas (p = 0.0031). Notably, Semi-SFTrans demonstrated better teeth integrity preservation than Sup-SFTrans (Dice Score: p < 0.001; Hausdorff Distance: p = 0.0022).

CONCLUSION

The semi-supervised MAR model, Semi-SFTrans, demonstrated superior metal artifact reduction performance over supervised counterparts in real dental CT images.

CT metal artefact reduction for hip and shoulder implants using novel algorithms and machine learning: A systematic review with pairwise and network meta-analyses

INTRODUCTION

Many tools have been developed to reduce metal artefacts in computed tomography (CT) images resulting from metallic prosthesis; however, their relative effectiveness in preserving image quality is poorly understood. This paper reviews the literature on novel metal artefact reduction (MAR) methods targeting large metal artefacts in fan-beam CT to examine their effectiveness in reducing metal artefacts and effect on image quality.

METHODS

The PRISMA checklist was used to search for articles in five electronic databases (MEDLINE, Scopus, Web of Science, IEEE, EMBASE). Studies that assessed the effectiveness of recently developed MAR method on fan-beam CT images of hip and shoulder implants were reviewed. Study quality was assessed using the National Institute of Health (NIH) tool. Meta-analyses were conducted in R, and results that could not be meta-analysed were synthesised narratively.

RESULTS

Thirty-six studies were reviewed. Of these, 20 studies proposed statistical algorithms and 16 used machine learning (ML), and there were 19 novel comparators. Network meta-analysis of 19 studies showed that Recurrent Neural Network MAR (RNN-MAR) is more effective in reducing noise (LogOR 20.7; 95 % CI 12.6-28.9) without compromising image quality (LogOR 4.4; 95 % CI -13.8-22.5). The network meta-analysis and narrative synthesis showed novel MAR methods reduce noise more effectively than baseline algorithms, with five out of 23 ML methods significantly more effective than Filtered Back Projection (FBP) (p < 0.05). Computation time varied, but ML methods were faster than statistical algorithms.

CONCLUSION

ML tools are more effective in reducing metal artefacts without compromising image quality and are computationally faster than statistical algorithms. Overall, novel MAR methods were also more effective in reducing noise than the baseline reconstructions.

IMPLICATIONS FOR PRACTICE

Implementation research is needed to establish the clinical suitability of ML MAR in practice.

Stereotactic Body Radiation Therapy (SBRT) in prostate cancer in the presence of hip prosthesis - is it a contraindication? A narrative review

Hip replacement is a common orthopedic surgery in the aging population. With the rising incidence of prostate cancer, metallic hip prosthetics can cause considerable beam hardening and streak artifacts, leading to difficulty in identifying the target volumes and planning process for radiation treatment. The growing use of Stereotactic Body Radiation Therapy (SBRT) to treat prostate cancer is now well established. However, the use of this treatment modality in the presence of a hip prosthesis is poorly understood. There is enough literature on planning for external beam radiation treatment without any difficulties in the presence of hip prosthesis with conventional or Hypofractionated treatment. However, there is a shortage of literature on the impact of the prosthesis in SBRT planning, and there is a need for further understanding and measures to mitigate the obstacles in planning for SBRT in the presence of hip prosthesis. We present our review of the intricacies that need to be understood while considering SBRT in the presence of hip prostheses in prostate cancer treatment.

Evaluation of a prototype metal artifact reduction algorithm for cone beam CT in patients undergoing radioembolization

Metal artifacts notoriously pose significant challenge in computed tomography (CT), leading to inaccuracies in image formation and interpretation. Artifact reduction tools have been designed to improve cone beam computed tomography (CBCT) image quality by reducing artifacts caused by certain high-density materials. Metal artifact reduction (MAR) tools are specific algorithms that are applied during image reconstruction to minimize or eliminate artifacts degrading CBCT images. The purpose of the study is to evaluate the effect of a MAR algorithm on image quality in CBCT performed for evaluating patients before transarterial radioembolization (TARE). We retrospectively included 40 consecutive patients (aged 65 ± 13 years; 23 males) who underwent 45 CBCT examinations (Allura FD 20, XperCT Roll protocol, Philips Healthcare, Best, The Netherlands) in the setting of evaluation for TARE between January 2017 and December 2018. Artifacts caused by coils, catheters, and surgical clips were scored subjectively by four readers on a 5-point scale (1 = artifacts affecting diagnostic information to 5 = no artifacts) using a side-by-side display of uncorrected and MAR-corrected images. In addition, readers scored tumor visibility and vessel discrimination. MAR-corrected images were assigned higher scores, indicating better image quality. The differences between the measurements with and without MAR were most impressive for coils with a mean improvement of 1.6 points (95%CI [1.5 1.8]) on the 5-point likert scale, followed by catheters 1.4 points (95%CI [1.3 1.5]) and clips 0.7 points (95%CI [0.3 1.1]). Improvements for other artifact sources were consistent but relatively small (below 0.25 points on average). Interrater agreement was good to perfect (Kendall's W coefficient = 0.68-0.95) and was higher for MAR-corrected images, indicating that MAR improves diagnostic accuracy. A metal artifact reduction algorithm can improve diagnostic and interventional accuracy of cone beam CT in patients undergoing radioembolization by reducing artifacts caused by diagnostic catheters and coils, lowering interference of metal artifacts with adjacent major structures, and improving tumor visibility.

Image quality evaluation of a new high-performance ring-gantry cone-beam computed tomography imager

Objective. Newer cone-beam computed tomography (CBCT) imaging systems offer reconstruction algorithms including metal artifact reduction (MAR) and extended field-of-view (eFoV) techniques to improve image quality. In this study a new CBCT imager, the new Varian HyperSight CBCT, is compared to fan-beam CT and two CBCT imagers installed in a ring-gantry and C-arm linear accelerator, respectively.Approach. The image quality was assessed for HyperSight CBCT which uses new hardware, including a large-size flat panel detector, and improved image reconstruction algorithms. The decrease of metal artifacts was quantified (structural similarity index measure (SSIM) and root-mean-squared error (RMSE)) when applying MAR reconstruction and iterative reconstruction for a dental and spine region using a head-and-neck phantom. The geometry and CT number accuracy of the eFoV reconstruction was evaluated outside the standard field-of-view (sFoV) on a large 3D-printed chest phantom. Phantom size dependency of CT numbers was evaluated on three cylindrical phantoms of increasing diameter. Signal-to-noise and contrast-to-noise were quantified on an abdominal phantom.Main results. In phantoms with streak artifacts, MAR showed comparable results for HyperSight CBCT and CT, with MAR increasing the SSIM (0.97-0.99) and decreasing the RMSE (62-55 HU) compared to iterative reconstruction without MAR. In addition, HyperSight CBCT showed better geometrical accuracy in the eFoV than CT (Jaccard Conformity Index increase of 0.02-0.03). However, the CT number accuracy outside the sFoV was lower than for CT. The maximum CT number variation between different phantom sizes was lower for the HyperSight CBCT imager (∼100 HU) compared to the two other CBCT imagers (∼200 HU), but not fully comparable to CT (∼50 HU).Significance. This study demonstrated the imaging performance of the new HyperSight CBCT imager and the potential of applying this CBCT system in more advanced scenarios by comparing the quality against fan-beam CT.

Image quality and metal artifact reduction in total hip arthroplasty CT: deep learning-based algorithm versus virtual monoenergetic imaging and orthopedic metal artifact reduction

BACKGROUND

To compare image quality, metal artifacts, and diagnostic confidence of conventional computed tomography (CT) images of unilateral total hip arthroplasty patients (THA) with deep learning-based metal artifact reduction (DL-MAR) to conventional CT and 130-keV monoenergetic images with and without orthopedic metal artifact reduction (O-MAR).

METHODS

Conventional CT and 130-keV monoenergetic images with and without O-MAR and DL-MAR images of 28 unilateral THA patients were reconstructed. Image quality, metal artifacts, and diagnostic confidence in bone, pelvic organs, and soft tissue adjacent to the prosthesis were jointly scored by two experienced musculoskeletal radiologists. Contrast-to-noise ratios (CNR) between bladder and fat and muscle and fat were measured. Wilcoxon signed-rank tests with Holm-Bonferroni correction were used.

RESULTS

Significantly higher image quality, higher diagnostic confidence, and less severe metal artifacts were observed on DL-MAR and images with O-MAR compared to images without O-MAR (p < 0.001 for all comparisons). Higher image quality, higher diagnostic confidence for bone and soft tissue adjacent to the prosthesis, and less severe metal artifacts were observed on DL-MAR when compared to conventional images and 130-keV monoenergetic images with O-MAR (p ≤ 0.014). CNRs were higher for DL-MAR and images with O-MAR compared to images without O-MAR (p < 0.001). Higher CNRs were observed on DL-MAR images compared to conventional images and 130-keV monoenergetic images with O-MAR (p ≤ 0.010).

CONCLUSIONS

DL-MAR showed higher image quality, diagnostic confidence, and superior metal artifact reduction compared to conventional CT images and 130-keV monoenergetic images with and without O-MAR in unilateral THA patients.

RELEVANCE STATEMENT

DL-MAR resulted into improved image quality, stronger reduction of metal artifacts, and improved diagnostic confidence compared to conventional and virtual monoenergetic images with and without metal artifact reduction, bringing DL-based metal artifact reduction closer to clinical application.

KEY POINTS

• Metal artifacts introduced by total hip arthroplasty hamper radiologic assessment on CT. • A deep-learning algorithm (DL-MAR) was compared to dual-layer CT images with O-MAR. • DL-MAR showed best image quality and diagnostic confidence. • Highest contrast-to-noise ratios were observed on the DL-MAR images.

Advances in metal artifact reduction in CT images: A review of traditional and novel metal artifact reduction techniques

Metal artifacts degrade CT image quality, hampering clinical assessment. Numerous metal artifact reduction methods are available to improve the image quality of CT images with metal implants. In this review, an overview of traditional methods is provided including the modification of acquisition and reconstruction parameters, projection-based metal artifact reduction techniques (MAR), dual energy CT (DECT) and the combination of these techniques. Furthermore, the additional value and challenges of novel metal artifact reduction techniques that have been introduced over the past years are discussed such as photon counting CT (PCCT) and deep learning based metal artifact reduction techniques.

Two-stage generative adversarial networks for metal artifact reduction and visualization in ablation therapy of liver tumors

PURPOSE

The strong metal artifacts produced by the electrode needle cause poor image quality, thus preventing physicians from observing the surgical situation during the puncture process. To address this issue, we propose a metal artifact reduction and visualization framework for CT-guided ablation therapy of liver tumors.

METHODS

Our framework contains a metal artifact reduction model and an ablation therapy visualization model. A two-stage generative adversarial network is proposed to reduce the metal artifacts of intraoperative CT images and avoid image blurring. To visualize the puncture process, the axis and tip of the needle are localized, and then the needle is rebuilt in 3D space intraoperatively.

RESULTS

Experiments show that our proposed metal artifact reduction method achieves higher SSIM (0.891) and PSNR (26.920) values than the state-of-the-art methods. The accuracy of ablation needle reconstruction is 2.76 mm average in needle tip localization and 1.64° average in needle axis localization.

CONCLUSION

We propose a novel metal artifact reduction and an ablation therapy visualization framework for CT-guided ablation therapy of liver cancer. The experiment results indicate that our approach can reduce metal artifacts and improve image quality. Furthermore, our proposed method demonstrates the potential for displaying the relative position of the tumor and the needle intraoperatively.

SemiMAR: Semi-Supervised Learning for CT Metal Artifact Reduction

Metal artifacts lead to CT imaging quality degradation. With the success of deep learning (DL) in medical imaging, a number of DL-based supervised methods have been developed for metal artifact reduction (MAR). Nonetheless, fully-supervised MAR methods based on simulated data do not perform well on clinical data due to the domain gap. Although this problem can be avoided in an unsupervised way to a certain degree, severe artifacts cannot be well suppressed in clinical practice. Recently, semi-supervised metal artifact reduction (MAR) methods have gained wide attention due to their ability in narrowing the domain gap and improving MAR performance in clinical data. However, these methods typically require large model sizes, posing challenges for optimization. To address this issue, we propose a novel semi-supervised MAR framework. In our framework, only the artifact-free parts are learned, and the artifacts are inferred by subtracting these clean parts from the metal-corrupted CT images. Our approach leverages a single generator to execute all complex transformations, thereby reducing the model's scale and preventing overlap between clean part and artifacts. To recover more tissue details, we distill the knowledge from the advanced dual-domain MAR network into our model in both image domain and latent feature space. The latent space constraint is achieved via contrastive learning. We also evaluate the impact of different generator architectures by investigating several mainstream deep learning-based MAR backbones. Our experiments demonstrate that the proposed method competes favorably with several state-of-the-art semi-supervised MAR techniques in both qualitative and quantitative aspects.

A nonlinear scaling-based normalized metal artifact reduction to reduce low-frequency artifacts in energy-integrating and photon-counting CT

BACKGROUND

Metal within the scan plane can cause severe artifacts when reconstructing X-ray computed tomography (CT) scans. Both in clinical use and recent research, normalized metal artifact reduction (NMAR) has established as the reference method for correcting metal artifacts, but NMAR introduces inconsistencies within the sinogram, which can cause additional low-frequency artifacts after image reconstruction.

PURPOSE

This paper introduces an extension to NMAR by applying a nonlinear scaling function (NLS-NMAR) to reduce low-frequency artifacts, which get introduced by the reconstruction of interpolation-edge-related sinogram inconsistencies in the normalized sinogram domain.

METHODS

After linear interpolation of the metal trace, an NLS function is applied in the prior-normalized sinogram domain to reduce the impact of the interpolation edges during filtered backprojection. After sinogram denormalization and image reconstruction, the low frequencies of the NLS image are combined with different high frequencies to restore anatomic details. An anthropomorphic dental phantom with removable metal inserts was utilized on two different CT systems to quantitatively assess the artifact reduction performance in terms of HU deviations and the root-mean-square-error within relevant regions of interest. Clinical dental examples were assessed to qualitatively demonstrate the problem of the interpolation-related blooming as well as to demonstrate the performance of the NLS function to reduce respective artifacts. To quantitatively prove HU consistency, HU values were assessed in central ROIs in the clinical cases. In addition, single clinical cases of a hip replacement and pedicle screws in the spine are shown to demonstrate the method's results in other body regions.

RESULTS

The NLS-NMAR can minimize the effect of interpolation-related sinogram inconsistencies and thus reduce resulting hyperdense blooming artifacts. In the phantom results, the reconstructions with the NLS-NMAR-corrected low frequencies demonstrate the lowest error. In the qualitative assessment of the clinical data, the NLS-NMAR shows a tremendous enhancement in image quality, also performing best within all assessed images series.

CONCLUSION

The NLS-NMAR provides a small yet effective extension to conventional NMAR by reducing low-frequency hyperdense metal trace-interpolation-related artifacts in computed tomography.

Self-trained deep convolutional neural network for noise reduction in CT

Purpose

Supervised deep convolutional neural network (CNN)-based methods have been actively used in clinical CT to reduce image noise. The networks of these methods are typically trained using paired high- and low-quality data from a massive number of patients and/or phantom images. This training process is tedious, and the network trained under a given condition may not be generalizable to patient images acquired and reconstructed under different conditions. We propose a self-trained deep CNN (ST_CNN) method for noise reduction in CT that does not rely on pre-existing training datasets.

Approach

The ST_CNN training was accomplished using extensive data augmentation in the projection domain, and the inference was applied to the data itself. Specifically, multiple independent noise insertions were applied to the original patient projection data to generate multiple realizations of low-quality projection data. Then, rotation augmentation was adopted for both the original and low-quality projection data by applying the rotation angle directly on the projection data so that images were rotated at arbitrary angles without introducing additional bias. A large number of paired low- and high-quality images from the same patient were reconstructed and paired for training the ST_CNN model.

Results

No significant difference was found between the ST_CNN and conventional CNN models in terms of the peak signal-to-noise ratio and structural similarity index measure. The ST_CNN model outperformed the conventional CNN model in terms of noise texture and homogeneity in liver parenchyma as well as better subjective visualization of liver lesions. The ST_CNN may sacrifice the sharpness of vessels slightly compared to the conventional CNN model but without affecting the visibility of peripheral vessels or diagnosis of vascular pathology.

Conclusions

The proposed ST_CNN method trained from the data itself may achieve similar image quality in comparison with conventional deep CNN denoising methods pre-trained on external datasets.

Is AI the way forward for reducing metal artifacts in CT? development of a generic deep learning-based method and initial evaluation in patients with sacroiliac joint implants

PURPOSE

To develop a deep learning-based metal artifact reduction technique (dl-MAR) and quantitatively compare metal artifacts on dl-MAR-corrected CT-images, orthopedic metal artifact reduction (O-MAR)-corrected CT-images and uncorrected CT-images after sacroiliac (SI) joint fusion.

METHODS

dl-MAR was trained on CT-images with simulated metal artifacts. Pre-surgery CT-images and uncorrected, O-MAR-corrected and dl-MAR-corrected post-surgery CT-images of twenty-five patients undergoing SI joint fusion were retrospectively obtained. Image registration was applied to align pre-surgery with post-surgery CT-images within each patient, allowing placement of regions of interest (ROIs) on the same anatomical locations. Six ROIs were placed on the metal implant and the contralateral side in bone lateral of the SI joint, the gluteus medius muscle and the iliacus muscle. Metal artifacts were quantified as the difference in Hounsfield units (HU) between pre- and post-surgery CT-values within the ROIs on the uncorrected, O-MAR-corrected and dl-MAR-corrected images. Noise was quantified as standard deviation in HU within the ROIs. Metal artifacts and noise in the post-surgery CT-images were compared using linear multilevel regression models.

RESULTS

Metal artifacts were significantly reduced by O-MAR and dl-MAR in bone (p < 0.001), contralateral bone (O-MAR: p = 0.009; dl-MAR: p < 0.001), gluteus medius (p < 0.001), contralateral gluteus medius (p < 0.001), iliacus (p < 0.001) and contralateral iliacus (O-MAR: p = 0.024; dl-MAR: p < 0.001) compared to uncorrected images. Images corrected with dl-MAR resulted in stronger artifact reduction than images corrected with O-MAR in contralateral bone (p < 0.001), gluteus medius (p = 0.006), contralateral gluteus medius (p < 0.001), iliacus (p = 0.017), and contralateral iliacus (p < 0.001). Noise was reduced by O-MAR in bone (p = 0.009) and gluteus medius (p < 0.001) while noise was reduced by dl-MAR in all ROIs (p < 0.001) in comparison to uncorrected images.

CONCLUSION

dl-MAR showed superior metal artifact reduction compared to O-MAR in CT-images with SI joint fusion implants.

Physics-informed sinogram completion for metal artifact reduction in CT imaging

Objective.Metal artifacts in the computed tomography (CT) imaging are unavoidably adverse to the clinical diagnosis and treatment outcomes. Most metal artifact reduction (MAR) methods easily result in the over-smoothing problem and loss of structure details near the metal implants, especially for these metal implants with irregular elongated shapes. To address this problem, we present the physics-informed sinogram completion (PISC) method for MAR in CT imaging, to reduce metal artifacts and recover more structural textures.Approach.Specifically, the original uncorrected sinogram is firstly completed by the normalized linear interpolation algorithm to reduce metal artifacts. Simultaneously, the uncorrected sinogram is also corrected based on the beam-hardening correction physical model, to recover the latent structure information in metal trajectory region by leveraging the attenuation characteristics of different materials. Both corrected sinograms are fused with the pixel-wise adaptive weights, which are manually designed according to the shape and material information of metal implants. To furtherly reduce artifacts and improve the CT image quality, a post-processing frequency split algorithm is adopted to yield the final corrected CT image after reconstructing the fused sinogram.Main results.We qualitatively and quantitatively evaluated the presented PISC method on two simulated datasets and three real datasets. All results demonstrate that the presented PISC method can effectively correct the metal implants with various shapes and materials, in terms of artifact suppression and structure preservation.Significance.We proposed a sinogram-domain MAR method to compensate for the over-smoothing problem existing in most MAR methods by taking advantage of the physical prior knowledge, which has the potential to improve the performance of the deep learning based MAR approaches.

Deep Learning Image Reconstruction for CT: Technical Principles and Clinical Prospects

Filtered back projection (FBP) has been the standard CT image reconstruction method for 4 decades. A simple, fast, and reliable technique, FBP has delivered high-quality images in several clinical applications. However, with faster and more advanced CT scanners, FBP has become increasingly obsolete. Higher image noise and more artifacts are especially noticeable in lower-dose CT imaging using FBP. This performance gap was partly addressed by model-based iterative reconstruction (MBIR). Yet, its "plastic" image appearance and long reconstruction times have limited widespread application. Hybrid iterative reconstruction partially addressed these limitations by blending FBP with MBIR and is currently the state-of-the-art reconstruction technique. In the past 5 years, deep learning reconstruction (DLR) techniques have become increasingly popular. DLR uses artificial intelligence to reconstruct high-quality images from lower-dose CT faster than MBIR. However, the performance of DLR algorithms relies on the quality of data used for model training. Higher-quality training data will become available with photon-counting CT scanners. At the same time, spectral data would greatly benefit from the computational abilities of DLR. This review presents an overview of the principles, technical approaches, and clinical applications of DLR, including metal artifact reduction algorithms. In addition, emerging applications and prospects are discussed.

Systematic Review of Advanced AI Methods for Improving Healthcare Data Quality in Post COVID-19 Era

At the beginning of the COVID-19 pandemic, there was significant hype about the potential impact of artificial intelligence (AI) tools in combatting COVID-19 on diagnosis, prognosis, or surveillance. However, AI tools have not yet been widely successful. One of the key reason is the COVID-19 pandemic has demanded faster real-time development of AI-driven clinical and health support tools, including rapid data collection, algorithm development, validation, and deployment. However, there was not enough time for proper data quality control. Learning from the hard lessons in COVID-19, we summarize the important health data quality challenges during COVID-19 pandemic such as lack of data standardization, missing data, tabulation errors, and noise and artifact. Then we conduct a systematic investigation of computational methods that address these issues, including emerging novel advanced AI data quality control methods that achieve better data quality outcomes and, in some cases, simplify or automate the data cleaning process. We hope this article can assist healthcare community to improve health data quality going forward with novel AI development.

A component method to delineate surgical spine implants for proton Monte Carlo dose calculation

PURPOSE

Metallic implants have been correlated to local control failure for spinal sarcoma and chordoma patients due to the uncertainty of implant delineation from computed tomography (CT). Such uncertainty can compromise the proton Monte Carlo dose calculation (MCDC) accuracy. A component method is proposed to determine the dimension and volume of the implants from CT images.

METHODS

The proposed component method leverages the knowledge of surgical implants from medical supply vendors to predefine accurate contours for each implant component, including tulips, screw bodies, lockers, and rods. A retrospective patient study was conducted to demonstrate the feasibility of the method. The reference implant materials and samples were collected from patient medical records and vendors, Medtronic and NuVasive. Additional CT images with extensive features, such as extended Hounsfield units and various reconstruction diameters, were used to quantify the uncertainty of implant contours.

RESULTS

For in vivo patient implant estimation, the reference and the component method differences were 0.35, 0.17, and 0.04 cm3 for tulips, screw bodies, and rods, respectively. The discrepancies by a conventional threshold method were 5.46, 0.76, and 0.05 cm3 , respectively. The mischaracterization of implant materials and dimensions can underdose the clinical target volume coverage by 20 cm3 for a patient with eight lumbar implants. The tulip dominates the dosimetry uncertainty as it can be made from titanium or cobalt-chromium alloys by different vendors.

CONCLUSIONS

A component method was developed and demonstrated using phantom and patient studies with implants. The proposed method provides more accurate implant characterization for proton MCDC and can potentially enhance the treatment quality for proton therapy. The current proof-of-concept study is limited to the implant characterization for lumbar spine. Future investigations could be extended to cervical spine and dental implants for head-and-neck patients where tight margins are required to spare organs at risk.

Combined clustered scan-based metal artifact reduction algorithm (CCS-MAR) for ultrasound-guided cardiac radioablation

Cardiac radioablation is a promising treatment for cardiac arrhythmias, but accurate dose delivery can be affected by heart motion. For this reason, real-time cardiac motion monitoring during radioablation is of paramount importance. Real-time ultrasound (US) guidance can be a solution. The US-guided cardiac radioablation workflow can be simplified by the simultaneous US and planning computed tomography (CT) acquisition, which can result in US transducer-induced metal artifacts on the planning CT scans. To reduce the impact of these artifacts, a new metal artifact reduction (MAR) algorithm (named: Combined Clustered Scan-based MAR [CCS-MAR]) has been developed and compared with iMAR (Siemens), O-MAR (Philips) and MDT (ReVision Radiology) algorithms. CCS-MAR is a fully automated sinogram inpainting-based MAR algorithm, which uses a two-stage correction process based on a normalized MAR method. The second stage aims to correct errors remaining from the first stage to create an artifact-free combined clustered scan for the process of metal artifact reduction. To evaluate the robustness of CCS-MAR, conventional CT scans and/or dual-energy CT scans from three anthropomorphic phantoms and transducers with different sizes were used. The performance of CCS-MAR for metal artifact reduction was compared with other algorithms through visual comparison, image quality metrics analysis, and HU value restoration evaluation. The results of this study show that CCS-MAR effectively reduced the US transducer-induced metal artifacts and that it improved HU value accuracy more or comparably to other MAR algorithms. These promising results justify future research into US transducer-induced metal artifact reduction for the US-guided cardiac radioablation purposes.

Deep learning method for reducing metal artifacts in dental cone-beam CT using supplementary information from intra-oral scan

Objective. Recently, dental cone-beam computed tomography (CBCT) methods have been improved to significantly reduce radiation dose while maintaining image resolution with minimal equipment cost. In low-dose CBCT environments, metallic inserts such as implants, crowns, and dental fillings cause severe artifacts, which result in a significant loss of morphological structures of teeth in reconstructed images. Such metal artifacts prevent accurate 3D bone-teeth-jaw modeling for diagnosis and treatment planning. However, the performance of existing metal artifact reduction (MAR) methods in handling the loss of the morphological structures of teeth in reconstructed CT images remains relatively limited. In this study, we developed an innovative MAR method to achieve optimal restoration of anatomical details. Approach. The proposed MAR approach is based on a two-stage deep learning-based method. In the first stage, we employ a deep learning network that utilizes intra-oral scan data as side-inputs and performs multi-task learning of auxiliary tooth segmentation. The network is designed to improve the learning ability of capturing teeth-related features effectively while mitigating metal artifacts. In the second stage, a 3D bone-teeth-jaw model is constructed with weighted thresholding, where the weighting region is determined depending on the geometry of the intra-oral scan data. Main results. The results of numerical simulations and clinical experiments are presented to demonstrate the feasibility of the proposed approach. Significance. We propose for the first time a MAR method using radiation-free intra-oral scan data as supplemental information on the tooth morphological structures of teeth, which is designed to perform accurate 3D bone-teeth-jaw modeling in low-dose CBCT environments.

Low-dimensional Manifold Constrained Disentanglement Network for Metal Artifact Reduction

Deep neural network based methods have achieved promising results for CT metal artifact reduction (MAR), most of which use many synthesized paired images for supervised learning. As synthesized metal artifacts in CT images may not accurately reflect the clinical counterparts, an artifact disentanglement network (ADN) was proposed with unpaired clinical images directly, producing promising results on clinical datasets. However, as the discriminator can only judge if large regions semantically look artifact-free or artifact-affected, it is difficult for ADN to recover small structural details of artifact-affected CT images based on adversarial losses only without sufficient constraints. To overcome the illposedness of this problem, here we propose a low-dimensional manifold (LDM) constrained disentanglement network (DN), leveraging the image characteristics that the patch manifold of CT images is generally low-dimensional. Specifically, we design an LDM-DN learning algorithm to empower the disentanglement network through optimizing the synergistic loss functions used in ADN while constraining the recovered images to be on a low-dimensional patch manifold. Moreover, learning from both paired and unpaired data, an efficient hybrid optimization scheme is proposed to further improve the MAR performance on clinical datasets. Extensive experiments demonstrate that the proposed LDM-DN approach can consistently improve the MAR performance in paired and/or unpaired learning settings, outperforming competing methods on synthesized and clinical datasets.

Dual-energy CT based mass density and relative stopping power estimation for proton therapy using physics-informed deep learning

Proton therapy requires accurate dose calculation for treatment planning to ensure the conformal doses are precisely delivered to the targets. The conversion of CT numbers to material properties is a significant source of uncertainty for dose calculation. The aim of this study is to develop a physics-informed deep learning (PIDL) framework to derive accurate mass density and relative stopping power maps from dual-energy computed tomography (DECT) images. The PIDL framework allows deep learning (DL) models to be trained with a physics loss function, which includes a physics model to constrain DL models. Five DL models were implemented including a fully connected neural network (FCNN), dual-FCNN (DFCNN), and three variants of residual networks (ResNet): ResNet-v1 (RN-v1), ResNet-v2 (RN-v2), and dual-ResNet-v2 (DRN-v2). An artificial neural network (ANN) and the five DL models trained with and without physics loss were explored to evaluate the PIDL framework. Two empirical DECT models were implemented to compare with the PIDL method. DL training data were from CIRS electron density phantom 062M (Computerized Imaging Reference Systems, Inc., Norfolk, VA). The performance of DL models was tested by CIRS adult male, adult female, and 5-year-old child anthropomorphic phantoms. For density map inference, the physics-informed RN-v2 was 3.3%, 2.9% and 1.9% more accurate than ANN for the adult male, adult female, and child phantoms. The physics-informed DRN-v2 was 0.7%, 0.6%, and 0.8% more accurate than DRN-v2 without physics training for the three phantoms, respectfully. The results indicated that physics-informed training could reduce uncertainty when ANN/DL models without physics training were insufficient to capture data structures or derived significant errors. DL models could also achieve better image noise control compared to the empirical DECT parametric mapping methods. The proposed PIDL framework can potentially improve proton range uncertainty by offering accurate material properties conversion from DECT.

Phase retrieval based on deep learning in grating interferometer

Grating interferometry is a promising technique to obtain differential phase contrast images with illumination source of low intrinsic transverse coherence. However, retrieving the phase contrast image from the differential phase contrast image is difficult due to the accumulated noise and artifacts from the differential phase contrast image (DPCI) reconstruction. In this paper, we implemented a deep learning-based phase retrieval method to suppress these artifacts. Conventional deep learning based denoising requires noise/clean image pair, but it is not feasible to obtain sufficient number of clean images for grating interferometry. In this paper, we apply a recently developed neural network called Noise2Noise (N2N) that uses noise/noise image pairs for training. We obtained many DPCIs through combination of phase stepping images, and these were used as input/target pairs for N2N training. The application of the N2N network to simulated and measured DPCI showed that the phase contrast images were retrieved with strongly suppressed phase retrieval artifacts. These results can be used in grating interferometer applications which uses phase stepping method.

Completion of Metal-Damaged Traces Based on Deep Learning in Sinogram Domain for Metal Artifacts Reduction in CT Images

In computed tomography (CT) images, the presence of metal artifacts leads to contaminated object structures. Theoretically, eliminating metal artifacts in the sinogram domain can correct projection deviation and provide reconstructed images that are more real. Contemporary methods that use deep networks for completing metal-damaged sinogram data are limited to discontinuity at the boundaries of traces, which, however, lead to secondary artifacts. This study modifies the traditional U-net and adds two sinogram feature losses of projection images—namely, continuity and consistency of projection data at each angle, improving the accuracy of the complemented sinogram data. Masking the metal traces also ensures the stability and reliability of the unaffected data during metal artifacts reduction. The projection and reconstruction results and various evaluation metrics reveal that the proposed method can accurately repair missing data and reduce metal artifacts in reconstructed CT images.

NRG Oncology Survey of Monte Carlo Dose Calculation Use in US Proton Therapy Centers

Purpose/Objective(s)

Monte Carlo (MC) dose calculation has appeared in primary commercial treatment-planning systems and various in-house platforms. Dual-energy computed tomography (DECT) and metal artifact reduction (MAR) techniques complement MC capabilities. However, no publications have yet reported how proton therapy centers implement these new technologies, and a national survey is required to determine the feasibility of including MC and companion techniques in cooperative group clinical trials.

Materials/Methods

A 9-question survey was designed to query key clinical parameters: scope of MC utilization, validation methods for heterogeneities, clinical site-specific imaging guidance, proton range uncertainties, and how implants are handled. A national survey was distributed to all 29 operational US proton therapy centers on 13 May 2019.

Results

We received responses from 25 centers (86% participation). Commercial MC was most commonly used for primary plan optimization (16 centers) or primary dose evaluation (18 centers), while in-house MC was used more frequently for secondary dose evaluation (7 centers). Based on the survey, MC was used infrequently for gastrointestinal, genitourinary, gynecology and extremity compared with other more heterogeneous disease sites (P < .007). Although many centers had published DECT research, only 3/25 centers had implemented DECT clinically, either in the treatment-planning system or to override implant materials. Most centers (64%) treated patients with metal implants on a case-by-case basis, with a variety of methods reported. Twenty-four centers (96%) used MAR images and overrode the surrounding tissue artifacts; however, there was no consensus on how to determine metal dimension, materials density, or stopping powers.

Conclusion

The use of MC for primary dose calculation and optimization was prevalent and, therefore, likely feasible for clinical trials. There was consensus to use MAR and override tissues surrounding metals but no consensus about how to use DECT and MAR for human tissues and implants. Development and standardization of these advanced technologies are strongly encouraged for vendors and clinical physicists.

Inner-ear augmented metal artifact reduction with simulation-based 3D generative adversarial networks

Metal Artifacts creates often difficulties for a high quality visual assessment of post-operative imaging in computed tomography (CT). A vast body of methods have been proposed to tackle this issue, but these methods were designed for regular CT scans and their performance is usually insufficient when imaging tiny implants. In the context of post-operative high-resolution CT imaging, we propose a 3D metal artifact reduction algorithm based on a generative adversarial neural network. It is based on the simulation of physically realistic CT metal artifacts created by cochlea implant electrodes on preoperative images. The generated images serve to train a 3D generative adversarial networks for artifacts reduction. The proposed approach was assessed qualitatively and quantitatively on clinical conventional and cone beam CT of cochlear implant postoperative images. These experiments show that the proposed method outperforms other general metal artifact reduction approaches.

DAN-Net: Dual-domain adaptive-scaling non-local network for CT metal artifact reduction

Metallic implants can heavily attenuate x-rays in computed tomography (CT) scans, leading to severe artifacts in reconstructed images, which significantly jeopardize image quality and negatively impact subsequent diagnoses and treatment planning. With the rapid development of deep learning in the field of medical imaging, several network models have been proposed for metal artifact reduction (MAR) in CT. Despite the encouraging results achieved by these methods, there is still much room to further improve performance. In this paper, a novel dual-domain adaptive-scaling non-local network (DAN-Net) is proposed for MAR. We correct the corrupted sinogram using adaptive scaling first to preserve more tissue and bone details. Then, an end-to-end dual-domain network is adopted to successively process the sinogram and its corresponding reconstructed image is generated by the analytical reconstruction layer. In addition, to better suppress the existing artifacts and restrain the potential secondary artifacts caused by inaccurate results of the sinogram-domain network, a novel residual sinogram learning strategy and non-local module are leveraged in the proposed network model. Experiments demonstrate the performance of the proposed DAN-Net is competitive with several state-of-the-art MAR methods in both qualitative and quantitative aspects.

The application of metal artifact reduction methods on computed tomography scans for radiotherapy applications: A literature review

Metal artifact reduction (MAR) methods are used to reduce artifacts from metals or metal components in computed tomography (CT). In radiotherapy (RT), CT is the most used imaging modality for planning, whose quality is often affected by metal artifacts. The aim of this study is to systematically review the impact of MAR methods on CT Hounsfield Unit values, contouring of regions of interest, and dose calculation for RT applications. This systematic review is performed in accordance with the PRISMA guidelines; the PubMed and Web of Science databases were searched using the main keywords "metal artifact reduction", "computed tomography" and "radiotherapy". A total of 382 publications were identified, of which 40 (including one review article) met the inclusion criteria and were included in this review. The selected publications (except for the review article) were grouped into two main categories: commercial MAR methods and research-based MAR methods. Conclusion: The application of MAR methods on CT scans can improve treatment planning quality in RT. However, none of the investigated or proposed MAR methods was completely satisfactory for RT applications because of limitations such as the introduction of other errors (e.g., other artifacts) or image quality degradation (e.g., blurring), and further research is still necessary to overcome these challenges.

Photon-counting normalized metal artifact reduction (NMAR) in diagnostic CT

PURPOSE

Metal artifacts can drastically reduce the diagnostic value of computed tomography (CT) images. Even the state-of-the-art algorithms cannot remove them completely. Photon-counting CT inherently provides spectral information, similar to dual-energy CT. Many applications, such as material decomposition, are not possible when metal artifacts are present. Our aim is to develop a prior-based metal artifact reduction specifically for photon-counting CT that can correct each bin image individually or in their combinations.

METHODS

Photon-counting CT sorts incoming photons into several energy bins, producing bin and threshold images containing spectral information. We use this spectral information to obtain a better prior image for the state-of-the-art metal artifact reduction algorithm FSNMAR. First, we apply a non-linear transformation to the bin images to obtain bone-emphasized images. Subsequently, we forward-project the bin images and bone-emphasized images and multiply the resulting sinograms with each other element-wise to mimic beam hardening effects. These sinograms are reconstructed and linearly combined to produce an artifact-reduced image. The coefficients of this linear combination are automatically determined by minimizing a threshold-based cost function in the image domain. After thresholding, we obtain the prior image for FSNMAR, which is applied to the individual bin images and the lowest threshold image. We test our photon-counting normalized metal artifact reduction (PCNMAR) on forensic CT data and compare it to conventional FSNMAR, where the prior is generated via linear sinogram inpainting. For numerical analysis, we compute both the standard deviation in an ROI with metal artifacts and the CNR of soft tissue and fat.

RESULTS

PCNMAR can effectively reduce metal artifacts without sacrificing the overall image quality. Compared to FSNMAR, our method produces fewer secondary artifacts and is more consistent with the measurements. Areas that contain metal, air, and soft tissue are more accurate in PCNMAR. In some cases, the standard deviation in the artifact ROI is reduced by more than 50% relative to FSNMAR, while the CNR values are similar. If extreme artifacts are present, PCNMAR is unable to outperform FSNMAR. Using either two, four, or only the highest energy bin to produce the prior image yielded comparable results.

CONCLUSIONS

PCNMAR is an effective method of reducing metal artifacts in photon-counting CT. The spectral information available in photon-counting CT is highly beneficial for metal artifact reduction, especially the high-energy bin, which inherently contains fewer artifacts. While scanning with four instead of two bins does not provide a better artifact reduction, it allows for more freedom in the selection of energy thresholds.

A Cross-Domain Metal Trace Restoring Network for Reducing X-Ray CT Metal Artifacts

Metal artifacts commonly appear in computed tomography (CT) images of the patient body with metal implants and can affect disease diagnosis. Known deep learning and traditional metal trace restoring methods did not effectively restore details and sinogram consistency information in X-ray CT sinograms, hence often causing considerable secondary artifacts in CT images. In this paper, we propose a new cross-domain metal trace restoring network which promotes sinogram consistency while reducing metal artifacts and recovering tissue details in CT images. Our new approach includes a cross-domain procedure that ensures information exchange between the image domain and the sinogram domain in order to help them promote and complement each other. Under this cross-domain structure, we develop a hierarchical analytic network (HAN) to recover fine details of metal trace, and utilize the perceptual loss to guide HAN to concentrate on the absorption of sinogram consistency information of metal trace. To allow our entire cross-domain network to be trained end-to-end efficiently and reduce the graphic memory usage and time cost, we propose effective and differentiable forward projection (FP) and filtered back-projection (FBP) layers based on FP and FBP algorithms. We use both simulated and clinical datasets in three different clinical scenarios to evaluate our proposed network's practicality and universality. Both quantitative and qualitative evaluation results show that our new network outperforms state-of-the-art metal artifact reduction methods. In addition, the elapsed time analysis shows that our proposed method meets the clinical time requirement.

Metal artifact reduction for the segmentation of the intra cochlear anatomy in CT images of the ear with 3D-conditional GANs

Cochlear implants (CIs) are surgically implanted neural prosthetic devices that are used to treat severe-to-profound hearing loss. These devices are programmed post implantation and precise knowledge of the implant position with respect to the intra cochlear anatomy (ICA) can help the programming audiologists. Over the years, we have developed algorithms that permit determining the position of implanted electrodes relative to the ICA using pre- and post-implantation CT image pairs. However, these do not extend to CI recipients for whom pre-implantation CT (Pre-CT) images are not available. This is so because post-operative images are affected by strong artifacts introduced by the metallic implant. To overcome this issue, we have proposed two methods to segment the ICA in post-implantation CT (Post-CT) images, but they lead to segmentation errors that are substantially larger than errors obtained with Pre-CT images. Recently, we have proposed an approach that uses 2D-conditional generative adversarial nets (cGANs) to synthesize pre-operative images from post-operative images. This permits to use segmentation algorithms designed to operate on Pre-CT images even when these are not available. We have shown that it substantially and significantly improves the results obtained with methods designed to operate directly on post-CT images. In this article, we expand on our earlier work by moving from a 2D architecture to a 3D architecture. We perform a large validation and comparative study that shows that the 3D architecture improves significantly the quality of the synthetic images measured by the commonly used MSSIM (Mean Structural SIMilarity index). We also show that the segmentation results obtained with the 3D architecture are better than those obtained with the 2D architecture although differences have not reached statistical significance.