Why and how is soft copy reading possible in clinical practice?

Role of ambient light in the detection of contrast elements in digital dental radiography

OBJECTIVE

This study aimed to evaluate the effect of different ambient light levels on observer detection of small contrast differences in a contrast phantom by using a high-end liquid crystal display (LCD) monitor.

STUDY DESIGN

An aluminum step wedge was converted into a contrast phantom by the addition of bore holes. Radiographic images of the contrast elements were presented to 20 observers. Images were displayed in random order under different ambient light levels (0, 50, 200, and 500 lux) twice, and the observers had to determine if contrast elements were visible. Sensitivity and specificity were determined to calculate areas under receiver operating characteristic curves and Friedmann's test was applied to evaluate the influence of the ambient light level on observer performance.

RESULTS

Mean AZ values were moderate for each ambient light level at 0.715, 0.793, 0.764, and 0.722 for 0, 50, 200, and 500 lux, respectively. The influence of the ambient light level on observer performance was not statistically significant (P > .05).

CONCLUSIONS

There was no significant influence of ambient light between 0 and 500 lux on observer ability to detect small contrast details displayed on a high-end LCD monitor.

Is targeted reconstruction necessary for evaluating contrast-enhanced chest computed tomography using a liquid crystal display monitor?

PURPOSE

The aim of this study was to examine whether 20-cm field-of-view (FOV) targeted reconstruction (TR) on contrast-enhanced (CE) chest computed tomography (CT) might improve the diagnostic value compared with simple zooming (SZ) from whole-thorax FOV images using a 2 million (2M)-pixel liquid crystal display (LCD) monitor.

MATERIALS AND METHODS

We prospectively evaluated 44 patients. SZ images were magnified from a FOV of 26-34 cm (mean 29.7 cm). Parameters were 512 x 512 matrix and 3 mm thickness and interval. Images were reconstructed using a soft-tissue kernel. Three radiologists evaluated contour, spiculation, notch, pleural tag, invasion, and internal characteristics of the lesions using 5-scale scores. We also performed a phantom study to evaluate the spatial resolution of images.

RESULTS

The diagnostic value of the TR images was similar to that of the SZ images, with the findings identified in 88%-100% of the cases. Artifacts from high-density structures deteriorated the image quality in six (14%), and the SZ images were judged to be preferable in five of them. In the phantom study, there was little difference in spatial resolution between the two images.

CONCLUSION

The SZ images from whole-thorax FOV on CE chest CT were similar in quality to TR images using a 2M-pixel LCD monitor.

The impact of acoustic noise found within clinical departments on radiology performance

RATIONALE AND OBJECTIVES

In recent years, there has been increasing interest in the impact of environmental factors such as ambient light on radiologist performance. One commonly encountered distractor found within all clinical departments that has received little or no attention is acoustic noise.

MATERIALS AND METHODS

The present work records the level of noises encountered within environments where radiologic images are viewed and establishes the impact of a clinically relevant level of noise on the ability of radiologists to perform a typical diagnostic task. Noise levels were recorded 10 times within each of 14 environments, 11 of which were locations where radiologic images are judged. Thirty chest images were then presented to 26 senior radiologists, who were asked to detect up to three nodular lesions within 30 posteroanterior chest x-ray images in the absence and presence of noise at an amplitude demonstrated in the clinical environment. Jackknife free-response receiver-operating characteristic analyses was performed on the free-response data.

RESULTS

The results demonstrated that noise amplitudes rarely exceeded that encountered with normal conversation with the maximum mean value for an image-viewing environment being 56.1 dB. This level of noise had no impact on the ability of radiologists to identify chest lesions with figure of merits of 0.68, 0.69, and 0.68 with noise and 0.65, 0.68, and 0.67 without noise for chest radiologists, nonchest radiologists, and all radiologists, respectively. Equally, no differences were seen for false-positive and false-negative scores or on the time required to judge the images.

CONCLUSION

These findings suggest that noise at levels encountered within areas where radiologic images are viewed is not a major distractor within the reporting environment, but the need for further work has been identified.

Comparison of observer performance on soft-copy reading of digital chest radiographs: High resolution liquid-crystal display monitors versus cathode-ray tube monitors

The purpose of this study is to compare observer performance for detection of abnormalities on chest radiographs with 5-megapixel resolution liquid-crystal displays (LCD) and 5-megapixel resolution cathode-ray tube (CRT) monitors under bright and subdued ambient light conditions. Six radiologists reviewed a total of 254 digital chest radiographs under four different conditions with a combination of two types of monitors (a 5-megapixel resolution LCD and a 5-megapixel resolution CRT monitor) and with two types of ambient light (460 and 50 lux). The abnormalities analyzed were nodules, pneumothorax and interstitial lung disease. For each reader, the detection performance using 5-megapixel LCD and 5-megapixel CRT monitors under bright and subdued ambient light conditions were compared using multi-case and multi-modality ROC analysis. For each type of ambient light, the average detection performance with the two types of monitors was also compared. For each reader, the observer performance of 5-megapixel LCD and 5-megapixel CRT monitors, under both bright and subdued ambient light conditions, showed no significant statistical differences for detecting nodules, pneumothorax and interstitial lung disease. In addition, there was no significant statistical difference in the average performance when the two monitor displays, under both bright and subdued ambient light conditions, were compared.

A method to optimize the processing algorithm of a computed radiography system for chest radiography

A test methodology using an anthropomorphic-equivalent chest phantom is described for the optimization of the Agfa computed radiography "MUSICA" processing algorithm for chest radiography. The contrast-to-noise ratio (CNR) in the lung, heart and diaphragm regions of the phantom, and the "system modulation transfer function" (sMTF) in the lung region, were measured using test tools embedded in the phantom. Using these parameters the MUSICA processing algorithm was optimized with respect to low-contrast detectability and spatial resolution. Two optimum "MUSICA parameter sets" were derived respectively for maximizing the CNR and sMTF in each region of the phantom. Further work is required to find the relative importance of low-contrast detectability and spatial resolution in chest images, from which the definitive optimum MUSICA parameter set can then be derived. Prior to this further work, a compromised optimum MUSICA parameter set was applied to a range of clinical images. A group of experienced image evaluators scored these images alongside images produced from the same radiographs using the MUSICA parameter set in clinical use at the time. The compromised optimum MUSICA parameter set was shown to produce measurably better images.

Comparison of LCD and CRT displays based on efficacy for digital mammography

RATIONALE AND OBJECTIVES

To compare two display technologies, cathode ray tube (CRT) and liquid crystal display (LCD), in terms of diagnostic accuracy for several common clinical tasks in digital mammography.

MATERIALS AND METHODS

Simulated masses and microcalcifications were inserted into normal digital mammograms to produce an image set of 400 images. Images were viewed on one CRT and one LCD medical-quality display device by five experienced breast-imaging radiologists who rated the images using a categorical rating paradigm. The observer data were analyzed to determine overall classification accuracy, overall lesion detection accuracy, and accuracy for four specific diagnostic tasks: detection of benign masses, malignant masses, and microcalcifications, and discrimination of benign and malignant masses.

RESULTS

Radiologists had similar overall classification accuracy (LCD: 0.83 +/- 0.01, CRT: 0.82 +/- 0.01) and lesion detection accuracy (LCD: 0.87 +/- 0.01, CRT: 0.85 +/- 0.01) on both displays. The difference in accuracy between LCD and CRT for the detection of benign masses, malignant masses, and microcalcifications, and discrimination of benign and malignant masses was -0.019 +/- 0.009, 0.020 +/- 0.008, 0.012 +/- 0.013, and 0.0094 +/- 0.011, respectively. Overall, the two displays did not exhibit any statistically significant difference (P > .05).

CONCLUSION

This study explored the suitability of two different soft-copy displays for the viewing of mammographic images. It found that LCD and CRT displays offer similar clinical utility for mammographic tasks.

Resolution and noise measurements of five CRT and LCD medical displays

The performance of soft-copy displays plays a significant role in the overall image quality of a digital radiographic system. In this work, we discuss methods to characterize the resolution and noise of both cathode ray tube (CRT) and liquid crystal display (LCD) devices. We measured the image quality of five different commercial display devices, representing both CRT and LCD technologies, using a high-quality charge-coupled device (CCD) camera. The modulation transfer function (MTF) was calculated using the line technique, correcting for the MTF of the CCD camera and the display pixel size. The normalized noise power spectrum (NPS) was computed from two-dimensional Fourier analysis of uniform images. To separate the effects of pixel structure from interpixel luminance variations, we created structure-free images by eliminating the pixel structures of the display device. The NPS was then computed from these structure-free images to isolate interpixel luminance variations. We found that the MTF of LCDs remained close to the theoretical limit dictated by their inherent pixel size (0.85 +/- 0.08 at Nyquist frequency), in contrast to the MTF for the two CRT displays, which dropped to 0.15 +/- 0.08 at the Nyquist frequency. However, the NPS of LCDs showed significant peaks due to the subpixel structure, while the NPS of CRT displays exhibited a nearly flat power spectrum. After removing the pixel structure, the structured noise peaks for LCDs were eliminated and the overall noise magnitude was significantly reduced. The average total noise-to-signal ratio for CRT displays was 6.55% +/- 0.59%, of which 6.03% +/- 0.24% was due to interpixel luminance variations, while LCD displays had total noise to signal ratios of 46.1% +/- 5.1% of which 1.50% +/- 0.41% were due to interpixel luminance variations. Depending on the extent of the blurring and prewhitening processes of the human visual system, the magnitude of the display noise (including pixel structure) potentially perceived by the observer was reduced to 0.43% +/- 0.01% (accounting for blurring only) and 0.40 +/- 0.01% (accounting for blurring and prewhitening) for CRTs, and 1.02% +/- 0.22% (accounting for blurring only) and 0.36% +/- 0.08% (accounting for blurring and prewhitening) for LCDs.

Acceptance tests of diagnostic displays in a PACS system according to AAPM TG18

In a filmless environment it is necessary to execute acceptance and constancy tests on monitors used for interpretation of medical images. Performances of Barco CRT MGD521 MKII, Barco LCD L685EX monitors have been evaluated. Acceptancepress were executed following AAPM Task Group 18 guidelines. Visual and instrumental evaluations of geometric distortions, reflections, luminances response, contrast, uniformity, resolution, angular response and veiling glare were made. Barco monitors showed optimal performances, while EIZO monitors were accepted with some reserve on their quality level. Finally a comparative evaluation between monitors and film (the actual gold standard) was performed by an interview of ten radiologists: the monitors showed a quality at least equal to film. These monitors are currently in use for routine medical interpretation.

A method for verified access when using soft copy display

Soft copy display is a rapidly developing area. To date, most soft copy systems can be classed by their application, e.g. review or reporting. With technology convergence this distinction is becoming less defined by the hardware and more defined by the software functionality. Although it is accepted that routine quality assurance should be conducted on soft copy monitors, this would be logistically difficult to achieve if any monitor within a hospital could be used for image review or reporting. This work proposes a simple psychophysical check to ensure optimal display performance before viewing software can be run. This is in the form of a challenge/response code constructed from letters just above the threshold of detection. This verified login would act as a portal to launching the image viewing software. The developed system was tested on three different types of monitor and five observers. Results indicate that the verified login was able to control access for displays below the optimal settings but was not as sensitive for adjustments above the optimum. However it is believed this is still of value as the lower presentation will compress the display gamma curve and reduce detail contrast. It also provides a minimum level of audit and quality control that might otherwise be missing.

Flat-panel display (LCD) versus high-resolution gray-scale display (CRT) for chest radiography: an observer preference study

OBJECTIVE

Our objective was to compare cathode ray tube (CRT) display with liquid crystal display (LCD) for soft-copy viewing of chest radiographs in a clinical setting.

MATERIALS AND METHODS

We displayed 80 posteroanterior digital chest radiographs side by side on a 5-megapixel CRT display and a 3-megapixel LCD. Gradation characteristics of both monitors were adjusted to DICOM display standards. Using a 4-point scale, seven radiologists ranked overall image quality and visibility of anatomic landmarks. Data analysis included Wilcoxon's rank sum test to assess the significance of preference for the different display modes and calculation of the percentage of images ranked equally by at least five of the seven radiologists.

RESULTS

Wilcoxon's rank sum test found significant preferences (p < 0.001) for the CRT display for visualization of structures in low-attenuation areas of the thorax and for the LCD for visualization of structures in high-attenuation areas of the thorax. Overall image quality was ranked equal by at least five radiologists in 70% of cases, whereas for the remaining images a significant preference was found for the CRT display.

CONCLUSION

We conclude that, under subdued ambient lighting conditions and without use of windowing, for most images the overall quality is equal with high-resolution CRT display and LCD. In images judged preferentially, we found a significant superiority for LCD for delineating mediastinal structures and for CRT display for delineating structures in the lung.

[The quality of digital mammograms. Development and use of phantoms for optimal safety]

Digital imaging in mammography is becoming more and more accepted using both computed (CR) and direct radiography (DR). These techniques will soon be used in screening programs. Therefore, quality assurance for this technique is indispensable. The relevance of the current regulations, such as EPOC and the German QS-RL was investigated. For the investigation, a breast phantom and appropriate software were developed. Both were tested using digital mammography systems from six manufactures. Quality assurance parameters (such as contrast to noise ratio and contrast resolution) were calculated from these data sets. The results should be considered in future standards for mammography (IEC respectively DIN). In addition, this type of test procedure is time saving and enables a reduction in test devices, i. e. in costs.

Soft-Copy Reading of Digital Chest Radiographs

OBJECTIVE

We sought to evaluate whether soft-copy reading of simulated pulmonary chest lesions is influenced by ambient light and automatic optimization of cathode ray tube (CRT) monitor luminance.

MATERIALS AND METHODS

Four types of simulated lesions (nodules, lines, micronodules, and patchy opacities) were superimposed over an anthropomorphic chest phantom. Lesion detection with soft-copy reading was assessed using a high-contrast grayscale 2K CRT monitor under the following conditions: (1) subdued lighting (<50 lux); (2) normal lighting conditions (450 lux) without, and (3) with a sensitivity modulation to automatically adjust the CRT luminance to the increased amount of ambient light. Reading data were analyzed according to receiver operating curve. Significance of differences was tested using an analysis of variance for repeated measures.

RESULTS

Ambient room light of 450 lux did not significantly influence the detection of nodules and patchy opacities. However, bright ambient light significantly decreased detection of micronodules (0.60 vs. 0.74) and lines (0.52 vs. 0.66) relative to subdued lighting conditions. Automatic luminance adjustment could compensate the effect of ambient light for the micronodules (0.77) but not for the lines (0.53).

CONCLUSION

Bright ambient light significantly decreases detection of small low-contrast structures. This may be partially but not completely compensated by an automatic luminance adaptation.

Assessment of flat panel LCD primary class display performance based on AAPM TG 18 acceptance protocol

The image display is an important component of the Picture Archiving and Communication System (PACS) and of digital imaging in general. In this paper, we assess the display performance of 32 different flat panel LCD devices, in terms of their reflection, luminance response, luminance uniformity, resolution, noise, veiling glare and color uniformity included in the tentative guidelines of the AAPM TG18 document version 8.1. We also report on the angular dependencies of luminance and contrast, which constitute one of the miscellaneous tests. The tools used included a telescopic photometer, which was also used as a colorimeter, an illuminance meter, light sources for the reflection assessment, light-blocking devices, and digital TG18 test patterns. The luminance ratio (LR), maximum luminance difference (ALmax) and deviation of contrast response with respect to that of DICOM GSDF were 379.2+/-61.0, 1.6+/-1.1%, and 4.84+/-0.58%, respectively. The maximum luminance nonuniformity was 9.2+/-3.9% for the 10% luminance of the TG18-UNL10 test pattern. In the luminance-based resolution test, the percent luminance difference (deltaL) at the center was 0.78+/-0.42%. In all cases of noise testing, the rectangular target in each square in the three quadrants was visible, as were all 15 targets, except for the smallest one, in each corner pattern and the center pattern. The glare ratio (GR) was 2350+/-1460. The average color uniformity parameter, delta(u',v'), across the display area of each display device was 0.002+/-0.001. Nevertheless, not all of the color uniformity parameters of the display devices associated with a workstation met the acceptance criteria. For 7 selected flat panel displays, the mean specular and diffuse reflection coefficients were 0.0061+/-0.0010 and 0.0017+/-0.0005 cd/m2 per lux, respectively. All of the test results conformed to the criteria recommended by AAPM TG18, indicating that the displays were fully acceptable for diagnostic image interpretation. The maximum viewing angle conforming to the DICOM 3.14 standard luminance responses with a 10% tolerance was found to be approximately 50 degrees in both directions along the vertical axis, 10 degrees in the upper direction and 20 degrees in the lower direction along the horizontal axis, and 20 degrees in the upper direction and 10 degrees in the lower direction along the diagonal axis. Therefore, a radiologist should interpret a displayed image by considering the physical characteristics of the narrow viewing angle of the AMLCD displays. The acceptance testing protocol described herein demonstrates the successful clinical implementation of the guidelines for the viewing conditions of medical displays, and if implemented with a QC program, can be used to determine when LCD devices used for diagnostic interpretation need to be upgraded.

Effect of room illuminance on monitor black level luminance and monitor calibration

In this article we demonstrate the effect of room illuminance and surrounding monitor black level luminance on image quality for soft copy interpretation. Luminance values of a 10% central target and image quality evaluations and observer performance using a contrast-detail mammography (CDMAM) phantom demonstrate these effects. Our results indicate that high room illuminance has a more damaging effect on image quality when the surrounding monitor luminance is 0% to 5% of the maximum monitor luminance. The effect of room illuminance is less obvious when the surrounding monitor luminance is 20% of the maximum.

Impact of Ambient Light and Window Settings on the Detectability of Catheters on Soft-Copy Display of Chest Radiographs at Bedside

OBJECTIVE

The aim of this study was to evaluate how ambient light and interactive adjustment of density and contrast affect the detection of catheter fragments when interpreting bedside chest radiographs on soft-copy displays.

MATERIALS AND METHODS

A total of 131 catheter fragments were superimposed over 10 bedside chest radiographs obtained with storage phosphor technology. Images were displayed on a clinical intensive care unit viewing station (color cathode-ray tube monitor, 21 inch [53 cm], 1280 x 1024 matrix) and were independently evaluated by five radiologists. The number of catheter fragments per image varied between 12 and 14, with an approximately equal distribution in high- and low-absorption areas. Detectability of catheter fragments was assessed under subdued and bright ambient light conditions with and without interactive adjustment of window width and level.

RESULTS

Under subdued light, the detection rate of catheter fragments was significantly higher than under bright light (51.8% vs 56.6%, p < 0.05). Interactive window setting adjustment significantly increased the detection rate from 52.5% to 60.8% (p < 0.05) under subdued light and from 47.9% to 55.6% (p < 0.05) under bright light. With adjustment of window settings, the difference between the detection rates under subdued light (60.8%) and under bright light (55.6%) did not reach statistical significance.

CONCLUSION

Detection of catheters on soft-copy display is significantly decreased by bright ambient light, an effect that can be largely compensated for by means of interactive adjustment of window settings.

Pulmonary nodule detection and visual search: P45 and P104 monochrome versus color monitor displays

RATIONALE AND OBJECTIVES

The faceplate of a cathode-ray tube (CRT) display monitor is covered on the vacuum side with a phosphor screen. The different phosphors that can be used for this screen have distinctly different physical properties that can affect the noise properties of the display. Differences in noise affect the signal-to-noise ratio and, hence, may affect diagnostic performance. This study evaluated observer performance and visual search parameters in the detection of pulmonary nodules, comparing two monochrome CRT monitors with different phosphors (P45 and P104) and a color CRT monitor.

MATERIALS AND METHODS

The receiver operating characteristic paradigm was used to evaluate observer performance with a series of radiographic chest images containing solitary pulmonary nodules. Eye position was recorded as the observers searched the images on each type of monitor.

RESULTS

Observer performance, as indicated by the area under the receiver operating characteristic curve and compared by means of an analysis of variance test, was best for the P45 monitor, next best for the P104 monitor, and worst for the color monitor. All differences were statistically significant. Eye-position parameters were also affected by monitor type. The time required to fixate the lesion and overall search times were longest with the color monitor.

CONCLUSION

The type of phosphor used in the CRT monitor faceplate can affect diagnostic performance and visual search parameters. Care should be taken in the selection of monitors for use in clinical radiology.

Enhanced visualization processing: effect on workflow

RATIONALE AND OBJECTIVES

Soft-copy viewing of digital radiographs allows for image processing to improve visualization of anatomy and lesions, but it can take more time than film-based viewing. Enhanced visualization processing (EVP) was developed to increase the latitude of an image without reducing the vital contrast, potentially reducing the need for the radiologist to manipulate images. This study examined the influence of processing radiographic images with EVP on workflow in a picture archiving and communications system (PACS).

MATERIALS AND METHODS

Portable computed radiographic chest images were obtained and processed either with EVP or without. A security camera with a videocassette recorder was positioned above the PACS workstation. Four radiologists reviewed the images during their normal work schedule. The current diagnostic image was used to determine if the case contained EVP or non-EVP images. The videotapes of the sessions were reviewed to determine diagnostic viewing times and how zoom and/or window and level manipulation was used.

RESULTS

Viewing time was significantly longer for the non-EVP than the EVP cases. The difference occurred with all readers. Window and level manipulation was used on 35% of the EVP and 41% of the non-EVP images. Zoom was used on 64% of the EVP and 69% of the non-EVP images. Average time spent using zoom and window and level manipulation was significantly shorter with the EVP than with the non-EVP images.

CONCLUSION

EVP of chest images displayed on PACS monitors significantly improved workflow as measured by viewing time. EVP decreased use of window and level manipulation and zooming and the amount of time each one was used.

Soft-copy quality control of digital spot images obtained by using X-ray image intensifiers

PURPOSE

To evaluate 12 x-ray image intensifier (XRII) digital spot systems.

MATERIALS AND METHODS

Four objective tests were performed to assess XRII digital spots: entrance exposure, patient exposure, soft-copy gray scale, and pixel noise. Two additional tests were performed to assess high-contrast limiting resolution and threshold contrast detection.

RESULTS

Digital spot XRII entrance exposures averaged 1 x 10(-7) C/kg (0.38 mR) for units with large fields of view (FOVs); mean entrance exposure in a medium-sized patient was 1. 25 x 10(-5) C/kg (48 mR). Luminance measurements of the table-side monitors provided a mean of 473 just-noticeable differences in gray scale with the room lights off. Mean resolution with a bar test pattern was measured as 1.5 line pairs per millimeter for systems with a 40-cm FOV. Measured pixel noise (in relative units) was 6-25. Mean threshold contrast with the lights off was 0.85%.

CONCLUSION

Once input exposure is normalized for FOV and image matrix size, soft-copy assessment of limiting resolution with either low-contrast detection or, preferably, an off-line noise metric (pixel SD) provides objective measurements of digital spot image quality. With the lights on, 10 systems with room-light sensors had an 11% loss of gray scale. For systems without sensors, the loss was 33%.

Development of an electronic radiologist's office in a private institute

A computer system that improves the quality, user-friendliness, accessibility, and management of radiology data (images, reports, databases, knowledge) was implemented at a private institute. A picture archiving and communication system (PACS) was integrated with the radiology information system (RIS). Two servers and 12 personal computers form the integrated system. The first server is dedicated to management and archiving of Digital Imaging and Communications in Medicine (DICOM) images. The second server is dedicated to management of the RIS and archiving of patient data (Structured Query Language database), reports (hypertext markup language [HTML]), and images in the Joint Photographic Experts Group (JPEG) format (mini-PACS). There are three main client-server networks: a common network of imaging modalities (magnetic resonance imaging, computed tomography, ultrasonography, digital radiography) and two fast Ethernet networks (the PACS network and the RIS network). The RIS-PACS is linked remotely with other workstations and servers via Integrated Services Digital Network (ISDN). Images and reports can be distributed to referring physicians in the form of multimedia HTML and JPEG documents, which can also be used for quick and easy archiving, distribution, and reviewing within the institute. However, referring physicians have been reluctant to use electronic reports and images.