Observer performance for adaptive, image-based denoising and filtered back projection compared to scanner-based iterative reconstruction for lower dose CT enterography

Radiation dose reduction in pediatric computed tomography (CT) using deep convolutional neural network denoising

AIM

We evaluated the quality of noncontrast chest computed tomography (CT) for pediatric patients at two dose levels with and without denoising using a deep convolutional neural network (CNN).

MATERIALS AND METHODS

Forty children underwent noncontrast chest CTs for "chronic cough" using a routine dose (RD) protocol. Images were reconstructed using iterative reconstruction (IR). A validated noise insertion method was used to simulate 20% dose (TD) data for each case. A deep CNN model was trained and validated on 10 cases and then applied to the remaining 30 cases. Three certificate of qualification (CAQ)-certified pediatric radiologists evaluated 30 cases under 4 conditions: (1) RD + IR; (2) RD + CNN; (3) TD + IR; and (4) TD + CNN. Likert scales were used to score subjective image quality (1-5, 5 = excellent) and subjective noise artifact (1-4, 4 = no noise). Images were reviewed for specific findings.

RESULTS

For the 30 patients evaluated (14 female, mean age: 10.8 years, range: 0.17-17), the mean effective dose was 0.46 ± 0.21 mSv for the original RD exam, with an effective dose of 0.09 mSv for the TD exam. Both RD + CNN (3.6 ± 1.1, p < 0.001) and TD + CNN (3.4 ± 0.9, p = 0.023) had higher image quality than RD + IR (3.1 ± 0.9). Both RD + CNN (3.2 ± 0.9, p-value = <0.001) and TD + CNN (2.9 ± 0.6, p-value = 0.001) showed significantly lower subjective noise artifact scores than RD + IR (2.7 ± 0.7). There was excellent intrareader (RD + IR-RD + CNN: mean κ = 0.96, RD + IR-TD + CNN = 0.96, RD + IR-TD + IR = 0.98) and moderate inter-reader reliability (RD + IR: mean κ = 0.55, RD + CNN = 0.50, TD + CNN = 0.54, TD + IR = 0.57) on all 4 image reconstructions.

CONCLUSION

CNN denoising outperforms IR as a means of radiation dose reduction in pediatric CT.

Diagnostic performance and image quality of an image-based denoising algorithm applied to radiation dose-reduced CT in diagnosing acute appendicitis

PURPOSE

To evaluate diagnostic performance and image quality of ultralow-dose CT (ULDCT) in diagnosing acute appendicitis with an image-based deep-learning denoising algorithm (IDLDA).

METHODS

This retrospective multicenter study included 180 patients (mean ± standard deviation, 29 ± 9 years; 91 female) who underwent contrast-enhanced 2-mSv CT for suspected appendicitis from February 2014 to August 2016. We simulated ULDCT from 2-mSv CT, reducing the dose by at least 50%. Then we applied an IDLDA on ULDCT to produce denoised ULDCT (D-ULDCT). Six radiologists with different experience levels (three board-certified radiologists and three residents) independently reviewed the ULDCT and D-ULDCT. They rated the likelihood of appendicitis and subjective image qualities (subjective image noise, diagnostic acceptability, and artificial sensation). One radiologist measured image noise, signal-to-noise ratio (SNR), and contrast-to-noise ratio (CNR). We used the receiver operating characteristic (ROC) analyses, Wilcoxon's signed-rank tests, and paired t-tests.

RESULTS

The area under the ROC curves (AUC) for diagnosing appendicitis ranged 0.90-0.97 for ULDCT and 0.94-0.97 for D-ULDCT. The AUCs of two residents were significantly higher on D-ULDCT (AUC difference = 0.06 [95% confidence interval, 0.01-0.11; p = .022] and 0.05 [0.00-0.10; p = .046], respectively). D-ULDCT provided better subjective image noise and diagnostic acceptability to all six readers. However, the response of board-certified radiologists and residents differed in artificial sensation (all p ≤ .003). D-ULDCT showed significantly lower image noise, higher SNR, and higher CNR (all p < .001).

CONCLUSION

An IDLDA can provide better ULDCT image quality and enhance diagnostic performance for less-experienced radiologists.

Is the Mixed Use of Magnetic Resonance Enterography and Computed Tomography Enterography Adequate for Routine Periodic Follow-Up of Bowel Inflammation in Patients with Crohn's Disease?

OBJECTIVE

Computed tomography enterography (CTE) and magnetic resonance enterography (MRE) are considered substitutes for each other for evaluating Crohn's disease (CD). However, the adequacy of mixing them for routine periodic follow-up for CD has not been established. This study aimed to compare MRE alone with the mixed use of CTE and MRE for the periodic follow-up of small bowel inflammation in patients with CD.

MATERIALS AND METHODS

We retrospectively compared two non-randomized groups, each comprising 96 patients with CD. One group underwent CTE and MRE (MRE followed by CTE or vice versa) for the follow-up of CD (interval, 13-27 months [median, 22 months]), and the other group underwent MRE alone (interval, 15-26 months [median, 21 months]). However, these two groups were similar in clinical characteristics. Three independent readers from three different institutions determined whether inflammation had decreased, remained unchanged, or increased within the entire small bowel and the terminal ileum based on sequential enterography of the patients after appropriate blinding. We compared the two groups for inter-reader agreement and accuracy (terminal ileum only) using endoscopy as the reference standard for enterographic interpretation.

RESULTS

The inter-reader agreement was greater in the MRE alone group for the entire small bowel (intraclass correlation coefficient [ICC]: 0.683 vs. 0.473; p = 0.005) and the terminal ileum (ICC: 0.656 vs. 0.490; p = 0.030). The interpretation accuracy was higher in the MRE alone group without statistical significance (70.9%-74.5% vs. 57.9%-64.9% in individual readers; adjusted odds ratio = 3.21; p = 0.077).

CONCLUSION

The mixed use of CTE and MRE was inferior to MRE alone in terms of inter-reader reliability and could probably be less accurate than MRE alone for routine monitoring of small bowel inflammation in patients with CD. Therefore, the consistent use of MRE is favored for this purpose.

An interactive eye-tracking system for measuring radiologists' visual fixations in volumetric CT images: Implementation and initial eye-tracking accuracy validation

PURPOSE

Eye-tracking approaches have been used to understand the visual search process in radiology. However, previous eye-tracking work in computer tomography (CT) has been limited largely to single cross-sectional images or video playback of the reconstructed volume, which do not accurately reflect radiologists' visual search activities and their interactivity with three-dimensional image data at a computer workstation (e.g., scroll, pan, and zoom) for visual evaluation of diagnostic imaging targets. We have developed a platform that integrates eye-tracking hardware with in-house-developed reader workstation software to allow monitoring of the visual search process and reader-image interactions in clinically relevant reader tasks. The purpose of this work is to validate the spatial accuracy of eye-tracking data using this platform for different eye-tracking data acquisition modes.

METHODS

An eye-tracker was integrated with a previously developed workstation designed for reader performance studies. The integrated system captured real-time eye movement and workstation events at 1000 Hz sampling frequency. The eye-tracker was operated either in head-stabilized mode or in free-movement mode. In head-stabilized mode, the reader positioned their head on a manufacturer-provided chinrest. In free-movement mode, a biofeedback tool emitted an audio cue when the head position was outside the data collection range (general biofeedback) or outside a narrower range of positions near the calibration position (strict biofeedback). Four radiologists and one resident were invited to participate in three studies to determine eye-tracking spatial accuracy under three constraint conditions: head-stabilized mode (i.e., with use of a chin rest), free movement with general biofeedback, and free movement with strict biofeedback. Study 1 evaluated the impact of head stabilization versus general or strict biofeedback using a cross-hair target prior to the integration of the eye-tracker with the image viewing workstation. In Study 2, after integration of the eye-tracker and reader workstation, readers were asked to fixate on targets that were randomly distributed within a volumetric digital phantom. In Study 3, readers used the integrated system to scroll through volumetric patient CT angiographic images while fixating on the centerline of designated blood vessels (from the left coronary artery to dorsalis pedis artery). Spatial accuracy was quantified as the offset between the center of the intended target and the detected fixation using units of image pixels and the degree of visual angle.

RESULTS

The three head position constraint conditions yielded comparable accuracy in the studies using digital phantoms. For Study 1 involving the digital crosshairs, the median ± the standard deviation of offset values among readers were 15.2 ± 7.0 image pixels with the chinrest, 14.2 ± 3.6 image pixels with strict biofeedback, and 19.1 ± 6.5 image pixels with general biofeedback. For Study 2 using the random dot phantom, the median ± standard deviation offset values were 16.7 ± 28.8 pixels with use of a chinrest, 16.5 ± 24.6 pixels using strict biofeedback, and 18.0 ± 22.4 pixels using general biofeedback, which translated to a visual angle of about 0.8° for all three conditions. We found no obvious association between eye-tracking accuracy and target size or view time. In Study 3 viewing patient images, use of the chinrest and strict biofeedback demonstrated comparable accuracy, while the use of general biofeedback demonstrated a slightly worse accuracy. The median ± standard deviation of offset values were 14.8 ± 11.4 pixels with use of a chinrest, 21.0 ± 16.2 pixels using strict biofeedback, and 29.7 ± 20.9 image pixels using general biofeedback. These corresponded to visual angles ranging from 0.7° to 1.3°.

CONCLUSIONS

An integrated eye-tracker system to assess reader eye movement and interactive viewing in relation to imaging targets demonstrated reasonable spatial accuracy for assessment of visual fixation. The head-free movement condition with audio biofeedback performed similarly to head-stabilized mode.

Low-dose CT image and projection dataset

PURPOSE

To describe a large, publicly available dataset comprising computed tomography (CT) projection data from patient exams, both at routine clinical doses and simulated lower doses.

ACQUISITION AND VALIDATION METHODS

The library was developed under local ethics committee approval. Projection and image data from 299 clinically performed patient CT exams were archived for three types of clinical exams: noncontrast head CT scans acquired for acute cognitive or motor deficit, low-dose noncontrast chest scans acquired to screen high-risk patients for pulmonary nodules, and contrast-enhanced CT scans of the abdomen acquired to look for metastatic liver lesions. Scans were performed on CT systems from two different CT manufacturers using routine clinical protocols. Projection data were validated by reconstructing the data using several different reconstruction algorithms and through use of the data in the 2016 Low Dose CT Grand Challenge. Reduced dose projection data were simulated for each scan using a validated noise-insertion method. Radiologists marked location and diagnosis for detected pathologies. Reference truth was obtained from the patient medical record, either from histology or subsequent imaging.

DATA FORMAT AND USAGE NOTES

Projection datasets were converted into the previously developed DICOM-CT-PD format, which is an extended DICOM format created to store CT projections and acquisition geometry in a nonproprietary format. Image data are stored in the standard DICOM image format and clinical data in a spreadsheet. Materials are provided to help investigators use the DICOM-CT-PD files, including a dictionary file, data reader, and user manual. The library is publicly available from The Cancer Imaging Archive (https://doi.org/10.7937/9npb-2637).

POTENTIAL APPLICATIONS

This CT data library will facilitate the development and validation of new CT reconstruction and/or denoising algorithms, including those associated with machine learning or artificial intelligence. The provided clinical information allows evaluation of task-based diagnostic performance.

Application of Vendor-Neutral Iterative Reconstruction Technique to Pediatric Abdominal Computed Tomography

Objective

To compare image qualities between vendor-neutral and vendor-specific hybrid iterative reconstruction (IR) techniques for abdominopelvic computed tomography (CT) in young patients.

Materials and Methods

In phantom study, we used an anthropomorphic pediatric phantom, age-equivalent to 5-year-old, and reconstructed CT data using traditional filtered back projection (FBP), vendor-specific and vendor-neutral IR techniques (ClariCT; ClariPI) in various radiation doses. Noise, low-contrast detectability and subjective spatial resolution were compared between FBP, vendor-specific (i.e., iDose1 to 5; Philips Healthcare), and vendor-neutral (i.e., ClariCT1 to 5) IR techniques in phantom. In 43 patients (median, 14 years; age range 1–19 years), noise, contrast-to-noise ratio (CNR), and qualitative image quality scores of abdominopelvic CT were compared between FBP, iDose level 4 (iDose4), and ClariCT level 2 (ClariCT2), which showed most similar image quality to clinically used vendor-specific IR images (i.e., iDose4) in phantom study. Noise, CNR, and qualitative imaging scores were compared using one-way repeated measure analysis of variance.

Results

In phantom study, ClariCT2 showed noise level similar to iDose4 (14.68–7.66 Hounsfield unit [HU] vs. 14.78–6.99 HU at CT dose index volume range of 0.8–3.8 mGy). Subjective low-contrast detectability and spatial resolution were similar between ClariCT2 and iDose4. In clinical study, ClariCT2 was equivalent to iDose4 for noise (14.26–17.33 vs. 16.01–18.90) and CNR (3.55–5.24 vs. 3.20–4.60) (p > 0.05). For qualitative imaging scores, the overall image quality ([reader 1, reader 2]; 2.74 vs. 2.07, 3.02 vs. 2.28) and noise (2.88 vs. 2.23, 2.93 vs. 2.33) of ClariCT2 were superior to those of FBP (p < 0.05), and not different from those of iDose4 (2.74 vs. 2.72, 3.02 vs. 2.98; 2.88 vs. 2.77, 2.93 vs. 2.86) (p > 0.05).

Conclusion

Vendor-neutral IR technique shows image quality similar to that of clinically used vendor-specific hybrid IR technique for abdominopelvic CT in young patients.

Computed Tomography and Magnetic Resonance Small Bowel Enterography: Current Status and Future Trends Focusing on Crohn's Disease

Computed tomography enterography (CTE) and magnetic resonance enterography (MRE) are presently state-of-the-art radiologic tests used to examine the small bowel for various indications. This article focuses on CTE and MRE for the evaluation of Crohn disease. The article describes recent efforts to achieve more standardized interpretation of CTE and MRE, summarizes recent research studies investigating the role and impact of CTE and MRE more directly for several different clinical and research issues beyond general diagnostic accuracy, and provides an update on progress in imaging techniques. Also addressed are areas that need further exploration in the future.

Computed Tomography Enterography

Computed tomography (CT) enterography is a noninvasive imaging modality with superb spatial and temporal resolution, specifically tailored to evaluate the small bowel. It has several advantages over other radiologic and optical imaging modalities, all of which serve as complementary investigations to one another. This article describes CTE technique, including dose reduction techniques, special considerations for the pediatric population, common technical and interpretive pitfalls, and reviews some of the more common small bowel entities seen with CTE.

Advanced imaging techniques for small bowel Crohn's disease: what does the future hold?

Treatment of Crohn's disease (CD) is intrinsically reliant on imaging techniques, due to the preponderance of small bowel disease and its transmural pattern of inflammation. Ultrasound (US), computed tomography (CT) and magnetic resonance imaging (MRI) are the most widely employed imaging methods and have excellent diagnostic accuracy in most instances. Some limitations persist, perhaps the most clinically relevant being the distinction between inflammatory and fibrotic strictures. In this regard, several methodologies have recently been tested in animal models and human patients, namely US strain elastography, shear wave elastography, contrast-enhanced US, magnetization transfer MRI and contrast dynamics in standard MRI. Technical advances in each of the imaging methods may expand their indications. The addition of oral contrast to abdominal US appears to substantially improve its diagnostic capabilities compared to standard US. Ionizing dose-reduction methods in CT can decrease concern about cumulative radiation exposure in CD patients and diffusion-weighted MRI may reduce the need for gadolinium contrast. Clinical indexes of disease activity and severity are also increasingly relying on imaging scores, such as the recently developed Lémann Index. In this review we summarize some of the recent advances in small bowel CD imaging and how they might affect clinical practice in the near future.

Estimation of Observer Performance for Reduced Radiation Dose Levels in CT: Eliminating Reduced Dose Levels That Are Too Low Is the First Step

RATIONALE AND OBJECTIVES

This study aims to estimate observer performance for a range of dose levels for common computed tomography (CT) examinations (detection of liver metastases or pulmonary nodules, and cause of neurologic deficit) to prioritize noninferior dose levels for further analysis.

MATERIALS AND METHODS

Using CT data from 131 examinations (abdominal CT, 44; chest CT, 44; head CT, 43), CT images corresponding to 4%-100% of the routine clinical dose were reconstructed with filtered back projection or iterative reconstruction. Radiologists evaluated CT images, marking specified targets, providing confidence scores, and grading image quality. Noninferiority was assessed using reference standards, reader agreement rules, and jackknife alternative free-response receiver operating characteristic figures of merit. Reader agreement required that a majority of readers at lower dose identify target lesions seen by the majority of readers at routine dose.

RESULTS

Reader agreement identified dose levels lower than 50% and 4% to have inadequate performance for detection of hepatic metastases and pulmonary nodules, respectively, but could not exclude any low dose levels for head CT. Estimated differences in jackknife alternative free-response receiver operating characteristic figures of merit between routine and lower dose configurations found that only the lowest dose configurations tested (ie, 30%, 4%, and 10% of routine dose levels for abdominal, chest, and head CT examinations, respectively) did not meet criteria for noninferiority. At lower doses, subjective image quality declined before observer performance. Iterative reconstruction was only beneficial when filtered back projection did not result in noninferior performance.

CONCLUSION

Opportunity exists for substantial radiation dose reduction using existing CT technology for common diagnostic tasks.

Effect of Radiation Dose Reduction and Reconstruction Algorithm on Image Noise, Contrast, Resolution, and Detectability of Subtle Hypoattenuating Liver Lesions at Multidetector CT: Filtered Back Projection versus a Commercial Model-based Iterative Reconstruction Algorithm

Purpose To determine the effect of radiation dose and iterative reconstruction (IR) on noise, contrast, resolution, and observer-based detectability of subtle hypoattenuating liver lesions and to estimate the dose reduction potential of the IR algorithm in question. Materials and Methods This prospective, single-center, HIPAA-compliant study was approved by the institutional review board. A dual-source computed tomography (CT) system was used to reconstruct CT projection data from 21 patients into six radiation dose levels (12.5%, 25%, 37.5%, 50%, 75%, and 100%) on the basis of two CT acquisitions. A series of virtual liver lesions (five per patient, 105 total, lesion-to-liver prereconstruction contrast of -15 HU, 12-mm diameter) were inserted into the raw CT projection data and images were reconstructed with filtered back projection (FBP) (B31f kernel) and sinogram-affirmed IR (SAFIRE) (I31f-5 kernel). Image noise (pixel standard deviation), lesion contrast (after reconstruction), lesion boundary sharpness (average normalized gradient at lesion boundary), and contrast-to-noise ratio (CNR) were compared. Next, a two-alternative forced choice perception experiment was performed (16 readers [six radiologists, 10 medical physicists]). A linear mixed-effects statistical model was used to compare detection accuracy between FBP and SAFIRE and to estimate the radiation dose reduction potential of SAFIRE. Results Compared with FBP, SAFIRE reduced noise by a mean of 53% ± 5, lesion contrast by 12% ± 4, and lesion sharpness by 13% ± 10 but increased CNR by 89% ± 19. Detection accuracy was 2% higher on average with SAFIRE than with FBP (P = .03), which translated into an estimated radiation dose reduction potential (±95% confidence interval) of 16% ± 13. Conclusion SAFIRE increases detectability at a given radiation dose (approximately 2% increase in detection accuracy) and allows for imaging at reduced radiation dose (16% ± 13), while maintaining low-contrast detectability of subtle hypoattenuating focal liver lesions. This estimated dose reduction is somewhat smaller than that suggested by past studies. ^© RSNA, 2017 Online supplemental material is available for this article.

Small Bowel Imaging: an Update

Bowel imaging had experienced relevant technical advances during the last decade. The developments in the field of cross-sectional imaging had a particular impact on the assessment of Crohn's disease. The purpose of this manuscript is to provide a review of the main progress of cross-sectional imaging in the assessment of Crohn's disease and other small bowel diseases with relevance in clinical practice and in research. Also, we outline the technical advances, trends, and potential contributions of new technological cross-sectional imaging improvements that may have potential impact and contribution in the near future.

Impact of number of repeated scans on model observer performance for a low-contrast detection task in computed tomography

Channelized Hotelling observer (CHO) models have been shown to correlate well with human observers for several phantom-based detection/classification tasks in clinical computed tomography (CT). A large number of repeated scans were used to achieve an accurate estimate of the model's template. The purpose of this study is to investigate how the experimental and CHO model parameters affect the minimum required number of repeated scans. A phantom containing 21 low-contrast objects was scanned on a 128-slice CT scanner at three dose levels. Each scan was repeated 100 times. For each experimental configuration, the low-contrast detectability, quantified as the area under receiver operating characteristic curve, [Formula: see text], was calculated using a previously validated CHO with randomly selected subsets of scans, ranging from 10 to 100. Using [Formula: see text] from the 100 scans as the reference, the accuracy from a smaller number of scans was determined. Our results demonstrated that the minimum number of repeated scans increased when the radiation dose level decreased, object size and contrast level decreased, and the number of channels increased. As a general trend, it increased as the low-contrast detectability decreased. This study provides a basis for the experimental design of task-based image quality assessment in clinical CT using CHO.