The important role of task-based model observers and related techniques in medical imaging

Model observers and detectability index in x-ray imaging: historical review, applications and future trends

The detectability index, originally developed in psychophysics, has been applied in medical imaging to integrate objective metrics with subjective assessments. This index accounts for both image processing properties and the limitations of the human visual system, thus enhancing the clinical efficacy of imaging technologies. By providing a single metric that captures multiple aspects of image quality, the detectability index offers a comprehensive evaluation of clinical images. Numerous applications of this index across various areas of medical imaging are documented in the literature, along with recommendations for its use in periodic performance evaluations of imaging devices. However, since different modalities of images may require different detectability indices, it is crucial to assess the adequacy of the properties of the image being analyzed and those from the adopted index. A thorough understanding of this metric, including its statistical nature and complex relationship with model observers, is essential to ensure its proper application and interpretation, and to prevent misuse. Medical physicists face the challenge of a lack of organized guidance on the detectability index, necessitating a comprehensive review of its merits and drawbacks. This paper aims to trace the origins, concepts, and clinical applications of the detectability index, offering insight into its strengths, limitations, and future potential. To achieve this, an extensive literature review was conducted, covering the evolution of the index from its early use in radar interpretation to its current applications in modern imaging techniques and future trends. The paper includes supplementary materials such as a compendium of fundamental concepts, ancillary information, and mathematical deductions to help readers less experienced in the subject.

DEMIST: A Deep-Learning-Based Detection-Task-Specific Denoising Approach for Myocardial Perfusion SPECT

There is an important need for methods to process myocardial perfusion imaging (MPI) single-photon emission computed tomography (SPECT) images acquired at lower-radiation dose and/or acquisition time such that the processed images improve observer performance on the clinical task of detecting perfusion defects compared to low-dose images. To address this need, we build upon concepts from model-observer theory and our understanding of the human visual system to propose a detection task-specific deep-learning-based approach for denoising MPI SPECT images (DEMIST). The approach, while performing denoising, is designed to preserve features that influence observer performance on detection tasks. We objectively evaluated DEMIST on the task of detecting perfusion defects using a retrospective study with anonymized clinical data in patients who underwent MPI studies across two scanners (N = 338). The evaluation was performed at low-dose levels of 6.25%, 12.5%, and 25% and using an anthropomorphic channelized Hotelling observer. Performance was quantified using area under the receiver operating characteristics curve (AUC). Images denoised with DEMIST yielded significantly higher AUC compared to corresponding low-dose images and images denoised with a commonly used task-agnostic deep learning-based denoising method. Similar results were observed with stratified analysis based on patient sex and defect type. Additionally, DEMIST improved visual fidelity of the low-dose images as quantified using root mean squared error and structural similarity index metric. A mathematical analysis revealed that DEMIST preserved features that assist in detection tasks while improving the noise properties, resulting in improved observer performance. The results provide strong evidence for further clinical evaluation of DEMIST to denoise low-count images in MPI SPECT.

Comparison of post reconstruction- and reconstruction-based deep learning denoising methods in cardiac SPECT

Objective. The quality of myocardial perfusion SPECT (MPS) images is often hampered by low count statistics. Poor image quality might hinder reporting the studies and in the worst case lead to erroneous diagnosis. Deep learning (DL)-based methods can be used to improve the quality of the low count studies. DL can be applied in several different methods, which might affect the outcome. The aim of this study was to investigate the differences between post reconstruction- and reconstruction-based denoising methods.Approach. A UNET-type network was trained using ordered subsets expectation maximization (OSEM) reconstructed MPS studies acquired with half, quarter and eighth of full-activity. The trained network was applied as a post reconstruction denoiser (OSEM+DL) and it was incorporated into a regularized reconstruction algorithm as a deep learning penalty (DLP). OSEM+DL and DLP were compared against each other and against OSEM images without DL denoising in terms of noise level, myocardium-ventricle contrast and defect detection performance with signal-to-noise ratio of a non-prewhitening matched filter (NPWMF-SNR) applied to artificial perfusion defects inserted into defect-free clinical MPS scans. Comparisons were made using half-, quarter- and eighth-activity data.Main results. OSEM+DL provided lower noise level at all activities than other methods. DLP's noise level was also always lower than matching activity OSEM's. In addition, OSEM+DL and DLP outperformed OSEM in defect detection performance, but contrary to noise level ranking DLP had higher NPWMF-SNR overall than OSEM+DL. The myocardium-ventricle contrast was highest with DLP and lowest with OSEM+DL. Both OSEM+DL and DLP offered better image quality than OSEM, but visually perfusion defects were deeper in OSEM images at low activities.Significance. Both post reconstruction- and reconstruction-based DL denoising methods have great potential for MPS. The preference between these methods is a trade-off between smoother images and better defect detection performance.

Advancing Research on Medical Image Perception by Strengthening Multidisciplinary Collaboration

Medical image interpretation is central to detecting, diagnosing, and staging cancer and many other disorders. At a time when medical imaging is being transformed by digital technologies and artificial intelligence, understanding the basic perceptual and cognitive processes underlying medical image interpretation is vital for increasing diagnosticians' accuracy and performance, improving patient outcomes, and reducing diagnostician burnout. Medical image perception remains substantially understudied. In September 2019, the National Cancer Institute convened a multidisciplinary panel of radiologists and pathologists together with researchers working in medical image perception and adjacent fields of cognition and perception for the "Cognition and Medical Image Perception Think Tank." The Think Tank's key objectives were to identify critical unsolved problems related to visual perception in pathology and radiology from the perspective of diagnosticians, discuss how these clinically relevant questions could be addressed through cognitive and perception research, identify barriers and solutions for transdisciplinary collaborations, define ways to elevate the profile of cognition and perception research within the medical image community, determine the greatest needs to advance medical image perception, and outline future goals and strategies to evaluate progress. The Think Tank emphasized diagnosticians' perspectives as the crucial starting point for medical image perception research, with diagnosticians describing their interpretation process and identifying perceptual and cognitive problems that arise. This article reports the deliberations of the Think Tank participants to address these objectives and highlight opportunities to expand research on medical image perception.

Deep learning with noise-to-noise training for denoising in SPECT myocardial perfusion imaging

PURPOSE

Post-reconstruction filtering is often applied for noise suppression due to limited data counts in myocardial perfusion imaging (MPI) with single-photon emission computed tomography (SPECT). We study a deep learning (DL) approach for denoising in conventional SPECT-MPI acquisitions, and investigate whether it can be more effective for improving the detectability of perfusion defects compared to traditional postfiltering.

METHODS

Owing to the lack of ground truth in clinical studies, we adopt a noise-to-noise (N2N) training approach for denoising in SPECT-MPI images. We consider a coupled U-Net (CU-Net) structure which is designed to improve learning efficiency through feature map reuse. For network training we employ a bootstrap procedure to generate multiple noise realizations from list-mode clinical acquisitions. In the experiments we demonstrated the proposed approach on a set of 895 clinical studies, where the iterative OSEM algorithm with three-dimensional (3D) Gaussian postfiltering was used to reconstruct the images. We investigated the detection performance of perfusion defects in the reconstructed images using the non-prewhitening matched filter (NPWMF), evaluated the uniformity of left ventricular (LV) wall in terms of image intensity, and quantified the effect of smoothing on the spatial resolution of the reconstructed LV wall by using its full-width at half-maximum (FWHM).

RESULTS

Compared to OSEM with Gaussian postfiltering, the DL denoised images with CU-Net significantly improved the detection performance of perfusion defects at all contrast levels (65%, 50%, 35%, and 20%). The signal-to-noise ratio (SNR_D ) in the NPWMF output was increased on average by 8% over optimal Gaussian smoothing (P < 10^-4 , paired t-test), while the inter-subject variability was greatly reduced. The CU-Net also outperformed a 3D nonlocal means (NLM) filter and a convolutional autoencoder (CAE) denoising network in terms of SNR_D . In addition, the FWHM of the LV wall in the reconstructed images was varied by less than 1%. Furthermore, CU-Net also improved the detection performance when the images were processed with less post-reconstruction smoothing (a trade-off of increased noise for better LV resolution), with SNR_D improved on average by 23%.

CONCLUSIONS

The proposed DL with N2N training approach can yield additional noise suppression in SPECT-MPI images over conventional postfiltering. For perfusion defect detection, DL with CU-Net could outperform conventional 3D Gaussian filtering with optimal setting as well as NLM and CAE.