Quantitative image quality analysis of a nonlinear spatio-temporal filter

Recent advancements and future directions in automatic swallowing analysis via videofluoroscopy: A review

Videofluoroscopic swallowing studies (VFSS) capture the complex anatomy and physiology contributing to bolus transport and airway protection during swallowing. While clinical assessment of VFSS can be affected by evaluators subjectivity and variability in evaluation protocols, many efforts have been dedicated to developing methods to ensure consistent measures and reliable analyses of swallowing physiology using advanced computer-assisted methods. Latest advances in computer vision, pattern recognition, and deep learning technologies provide new paradigms to explore and extract information from VFSS recordings. The literature search was conducted on four bibliographic databases with exclusive focus on automatic videofluoroscopic analyses. We identified 46 studies that employ state-of-the-art image processing techniques to solve VFSS analytical tasks including anatomical structure detection, bolus contrast segmentation, and kinematic event recognition. Advanced computer vision and deep learning techniques have enabled fully automatic swallowing analysis and abnormality detection, resulting in improved accuracy and unprecedented efficiency in swallowing assessment. By establishing this review of image processing techniques applied to automatic swallowing analysis, we intend to demonstrate the current challenges in VFSS analyses and provide insight into future directions in developing more accurate and clinically explainable algorithms.

DCEUS-based focal parametric perfusion imaging of microvessel with single-pixel resolution and high contrast

This study aimed to develop a focal microvascular contrast-enhanced ultrasonic parametric perfusion imaging (PPI) scheme to overcome the tradeoff between the resolution, contrast, and accuracy of focal PPI in the tumor. Its resolution was limited by the low signal-to-clutter ratio (SCR) of time-intensity-curves (TICs) induced by multiple limitations, which deteriorated the accuracy and contrast of focal PPI. The scheme was verified by the in-vivo perfusion experiments. Single-pixel TICs were first extracted to ensure PPI with the highest resolution. The SCR of focal TICs in the tumor was improved using respiratory motion compensation combined with detrended fluctuation analysis. The entire and focal PPIs of six perfusion parameters were then accurately created after filtrating the valid TICs and targeted perfusion parameters. Compared with those of the conventional PPIs, the axial and lateral resolutions of focal PPIs were improved by 30.29% (p < .05) and 32.77% (p < .05), respectively; the average contrast and accuracy evaluated by SCR improved by 7.24 ± 4.90 dB (p < .05) and 5.18 ± 1.28 dB (p < .05), respectively. The edge, morphostructure, inhomogeneous hyper-enhanced distribution, and ring-like perfusion features in intratumoral microvessel were accurately distinguished and highlighted by the focal PPIs. The developed focal PPI can assist clinicians in making confirmed diagnoses and in providing appropriate therapeutic strategies for liver tumor.

A motion-compensated image filter for low-dose fluoroscopy in a real-time tumor-tracking radiotherapy system

In the real-time tumor-tracking radiotherapy system, a surrogate fiducial marker inserted in or near the tumor is detected by fluoroscopy to realize respiratory-gated radiotherapy. The imaging dose caused by fluoroscopy should be minimized. In this work, an image processing technique is proposed for tracing a moving marker in low-dose imaging. The proposed tracking technique is a combination of a motion-compensated recursive filter and template pattern matching. The proposed image filter can reduce motion artifacts resulting from the recursive process based on the determination of the region of interest for the next frame according to the current marker position in the fluoroscopic images. The effectiveness of the proposed technique and the expected clinical benefit were examined by phantom experimental studies with actual tumor trajectories generated from clinical patient data. It was demonstrated that the marker motion could be traced in low-dose imaging by applying the proposed algorithm with acceptable registration error and high pattern recognition score in all trajectories, although some trajectories were not able to be tracked with the conventional spatial filters or without image filters. The positional accuracy is expected to be kept within ±2 mm. The total computation time required to determine the marker position is a few milliseconds. The proposed image processing technique is applicable for imaging dose reduction.

A spatio-temporal detective quantum efficiency and its application to fluoroscopic systems

PURPOSE

Fluoroscopic x-ray imaging systems are used extensively in spatio-temporal detection tasks and require a spatio-temporal description of system performance. No accepted metric exists that describes spatio-temporal fluoroscopic performance. The detective quantum efficiency (DQE) is a metric widely used in radiography to quantify system performance and as a surrogate measure of patient "dose efficiency". It has been applied previously to fluoroscopic systems with the introduction of a temporal correction factor. However, the use of a temporally-corrected DQE does not provide system temporal information and it is only valid under specific conditions, many of which are not likely to be satisfied by suboptimal systems. The authors propose a spatio-temporal DQE that describes performance in both space and time and is applicable to all spatio-temporal quantum-based imaging systems.

METHODS

The authors define a spatio-temporal DQE (two spatial-frequency axes and one temporal-frequency axis) in terms of a small-signal spatio-temporal modulation transfer function (MTF) and spatio-temporal noise power spectrum (NPS). Measurements were made on an x-ray image intensifier-based bench-top system using continuous fluoroscopy with an RQA-5 beam at 3.9 microR/frame and hardened 50 kVp beam (0.8 mm Cu filtration added) at 1.9 microR/frame.

RESULTS

A zero-frequency DQE value of 0.64 was measured under both conditions. Nonideal performance was noted at both larger spatial and temporal frequencies; DQE values decreased by approximately 50% at the cutoff temporal frequency of 15 Hz.

CONCLUSIONS

The spatio-temporal DQE enables measurements of decreased temporal system performance at larger temporal frequencies analogous to previous measurements of decreased (spatial) performance. This marks the first time that system performance and dose efficiency in both space and time have been measured on a fluoroscopic system using DQE and is the first step toward the generalized use of DQE on clinical fluoroscopic systems.

[An investigation of the subjective assessment of fluoroscopic imaging using instantaneous detectability]

Instantaneous detectability was introduced in a method for the subjective assessment of fluoroscopic images, particularly in the interventional radiology (IVR) procedure. Quantitatively, instantaneous detectability was obtained by measuring the time required for observers to detect the tip of a linear pattern, such as a guide wire, just after the image is displayed. Dynamic images used in this measurement, which mimic degraded fluoroscopic images, were created in the computer simulation software by adding a low-contrast linear pattern to a noisy background image. Radiological technologists and students in the faculty of computer engineering participated in the assessment, and all measurements were performed using a personal computer system. Even if the contrast-to-noise ratio was identical, instantaneous detectability was remarkably increased when the background noise was dominated by higher frequency components. Also, the sign test suggested that a frame rate of 30 f/s significantly improved detectability compared to a frame rate of 15 f/s. These results enable us to discuss new possibilities for image processing and the optimization of system performance. Although the standard deviation of the measured inter- and intra-observer data was large, statistical significance should be suitably examined by a paired-comparison like the sign test, which will be one of the important analyzers in experiments investigating human performance.

A small-signal approach to temporal modulation transfer functions with exposure-rate dependence and its application to fluoroscopic detective quantum efficiency

The detective quantum efficiency (DQE) is a metric widely used in radiography to quantify system performance and as a surrogate measure of patient "dose efficiency." It has been applied previously to fluoroscopic systems with the introduction of a temporal correction factor. Calculation of this correction factor relies on measurements of the temporal modulation transfer function (MTF). However, the temporal MTF is often exposure-rate dependent, violating a necessary Fourier linearity requirement. The authors show that a Fourier analysis is appropriate for fluoroscopic systems if a "small-signal" approach is used. Using a semitransparent edge, a lag-corrected DQE is described and measured for an x-ray image intensifier-based fluoroscopic system under continuous (non-pulsed) exposure conditions. It was found that results were equivalent for both rising and falling-edge profiles independent of edge attenuation when effective attenuation was in the range of 0.1-0.6. This suggests that this range is appropriate for measuring the small-signal temporal MTF. In general, lag was greatest at low exposure rates. It was also found that results obtained using a falling-edge profile with a radiopaque edge were equivalent to the small-signal results for the test system. If this result is found to be true generally, it removes the need for the small-signal approach. Lag-corrected DQE values were validated by comparison with radiographic DQE values obtained using very long exposures under the same conditions. Lag was observed to inflate DQE measurements by up to 50% when ignored.

Noise reduction in low-dose x-ray fluoroscopy for image-guided radiation therapy

PURPOSE

To improve the quality of low-dose X-ray fluoroscopic images using statistics-based restoration algorithm so that the patient fluoroscopy can be performed with reduced radiation dose.

METHOD AND MATERIALS

Noise in the low-dose fluoroscopy was suppressed by temporal and spatial filtering. The temporal correlation among neighboring frames was considered by the Karhunen-Loève (KL) transform (i.e., principal component analysis). After the KL transform, the selected neighboring frames of fluoroscopy were decomposed to uncorrelated and ordered principal components. For each KL component, a penalized weighted least-squares (PWLS) objective function was constructed to restore the ideal image. The penalty was chosen as anisotropic quadratic, and the penalty parameter in each KL component was inversely proportional to its corresponding eigenvalue. Smaller KL eigenvalue is associated with the KL component of lower signal-to-noise ratio (SNR), and a larger penalty parameter should be used for such KL component. The low-dose fluoroscopic images were acquired using a Varian Acuity simulator. A quality assurance phantom and an anthropomorphic chest phantom were used to evaluate the presented algorithm.

RESULTS

In the images restored by the proposed KL domain PWLS algorithm, noise is greatly suppressed, whereas fine structures are well preserved. Average improvement rate of SNR is 75% among selected regions of interest. Comparison studies with traditional techniques, such as the mean and median filters, show that the proposed algorithm is advantageous in terms of structure preservation.

CONCLUSIONS

The proposed noise reduction algorithm can significantly improve the quality of low-dose X-ray fluoroscopic image and allows for dose reduction in X-ray fluoroscopy.

A moving slanted-edge method to measure the temporal modulation transfer function of fluoroscopic systems

Lag in fluoroscopic systems introduces a frame-averaging effect that reduces measurements of image noise and incorrectly inflates measurements of the detective quantum efficiency (DQE). A correction can be implemented based on measurements of the temporal modulation transfer function (MTF). We introduce a method of measuring the temporal MTF under fluoroscopic conditions using a moving slanted edge, a generalization of the slanted-edge method used to measure the (spatial) MTF, providing the temporal MTF of the entire imaging system. The method uses a single x-ray exposure, constant edge velocity, and assumes spatial and temporal blurring are separable. The method was validated on a laboratory x-ray image intensifier (XRII) system by comparison with direct measurements of the XRII optical response, showing excellent agreement over the entire frequency range tested (+/- 100 Hz). With proper access to linearized data and continuous fluoroscopy, this method can be implemented in a clinical setting on both XRII and flat-panel detectors. It is shown that the temporal MTF of the CsI-based validation system is a function of exposure rate. The rising-edge response showed more lag than the falling edge, and the temporal MTF decreased with decreasing exposure rate. It is suggested that a small-signal approach, in which the range of exposure rates is restricted to a linear range by using a semitransparent moving edge, would be appropriate for measuring the DQE of these systems.

A psychophysical test of the visual pathway of children with autism

Signal detection psychophysical experiments were conducted to investigate the visual path of children with autism. Computer generated images with Gaussian noise were used. Simple signals, still and in motion were embedded in the background noise. The computer monitor was linearized to properly display the contrast changes. To our knowledge, this is the first time that experiments of this type have been done with observers with autism. Our results show that the visual capabilities of typically developed children were superior to those of the children with autism, and that the related problems of children with autism are sensation related only in a reduced proportion. There is no evidence that they are disabled in detecting simple visual stimuli, still and in motion.

Quantitative assessment of image quality enhancement due to unsharp-mask processing in x-ray fluoroscopy

Spatial unsharp-mask processing and its variants are commonly used in x-ray radiography to enhance image contrast. We investigated the effect of three unsharp-masking filter kernels of different sizes on the detection of an advanced guidewire tip in simulated x-ray fluoroscopy image sequences. To isolate the effect of visual temporal processing, we repeated the experiments on single images. Filter gains were selected so that all three kernels increased the contrast of a 0.018-in. (0.457-mm) guidewire by a factor of 2 but had different effects on image noise and signal profiles. There was no statistically significant effect of unsharp masking on human-observer performance in single images. However, all three kernels significantly improved average performance in image sequences, and the guidewire contrast required for detection was reduced by 32%-40%. A prewhitening channelized observer model predicted the disparity between sequences and single images and fitted measurements at different kernel sizes well. A nonprewhitening observer model did not. We conclude that unsharp masking is a simple and effective method of improving guidewire visualization in fluoroscopically guided interventional procedures and that quantitative image quality studies are essential for evaluation of image-processing techniques in sequences such as x-ray fluoroscopy.

Image quality evaluation of flat panel and image intensifier digital magnification in x-ray fluoroscopy

Interventional devices used in radiology often have dimensions on the order of a pixel, and radiologists resort to image magnification to better visualize such small devices. Traditional image intensifier (II) systems use analog magnification with x-ray exposure inversely proportional to the area of field of view (FOV) so as to maintain light output for the camera. Analog magnification is impossible with flat panel (FP) detectors, and images must be magnified using digital interpolation that does not reduce the pixel partial area effect for small devices. We quantitatively investigated image quality of digital and analog magnification using a clinically relevant task of detecting a partially deployed stent in x-ray fluoroscopy image sequences that were created using realistic detector models. Using the standard exposure strategy for II analog magnification, exposure was increased from a nominal 43.65 nGy (5.0 microR) per frame at 23 cm FOV to 79.9 nGy (9.15 microR) per frame and 117.81 nGy (13.49 microR) per frame at 17 cm and 14 cm FOV, respectively. Contrast sensitivity improved significantly (p<0.1) by 43.5+/-6.5% and 64.1+/-7.3% with the 17 cm and 14 cm FOV, respectively. Exposure for digitally magnified images was varied in an adaptive forced choice experiment so as to match performance with II analog magnification. For digital magnification, bilinear interpolation was used to give magnified stents sizes equivalent to those in the analog magnified images. For equivalent image quality, FP required 34.87+/-2.59, 80.16+/-5.37, and 84.08+/-5.59 nGy per frame at normal, and the two magnification modes, respectively. Hence, FP with digital magnification gives significant (p<0.1) dose savings of 20+/-6% and 27+/-5% at the normal and highest magnification modes, respectively. Digitally magnified II images required exposures of 110.85+/-8.07 and 103.34+/-5.90 nGy per frame for the two magnifications levels, respectively, giving no significant (p>0.1) dose savings. A spatiotemporal human observer model based on signal detection theory successfully predicted the human data and was used to predict other conditions associated with image magnification. Model predictions quantitatively showed that magnification is most useful when signal size is relatively small and that FP digital magnification can improve image quality for the stent deployment task without increasing exposure. In conclusion, the results show that FP digital magnification can be useful and dose efficient as compared to analog magnification.