A new full-field digital mammography system with and without the use of an advanced post-processing algorithm: comparison of image quality and diagnostic performance

Selection and Reporting of Statistical Methods to Assess Reliability of a Diagnostic Test: Conformity to Recommended Methods in a Peer-Reviewed Journal

Objective

To evaluate the frequency and adequacy of statistical analyses in a general radiology journal when reporting a reliability analysis for a diagnostic test.

Materials and Methods

Sixty-three studies of diagnostic test accuracy (DTA) and 36 studies reporting reliability analyses published in the Korean Journal of Radiology between 2012 and 2016 were analyzed. Studies were judged using the methodological guidelines of the Radiological Society of North America-Quantitative Imaging Biomarkers Alliance (RSNA-QIBA), and COnsensus-based Standards for the selection of health Measurement INstruments (COSMIN) initiative. DTA studies were evaluated by nine editorial board members of the journal. Reliability studies were evaluated by study reviewers experienced with reliability analysis.

Results

Thirty-one (49.2%) of the 63 DTA studies did not include a reliability analysis when deemed necessary. Among the 36 reliability studies, proper statistical methods were used in all (5/5) studies dealing with dichotomous/nominal data, 46.7% (7/15) of studies dealing with ordinal data, and 95.2% (20/21) of studies dealing with continuous data. Statistical methods were described in sufficient detail regarding weighted kappa in 28.6% (2/7) of studies and regarding the model and assumptions of intraclass correlation coefficient in 35.3% (6/17) and 29.4% (5/17) of studies, respectively. Reliability parameters were used as if they were agreement parameters in 23.1% (3/13) of studies. Reproducibility and repeatability were used incorrectly in 20% (3/15) of studies.

Conclusion

Greater attention to the importance of reporting reliability, thorough description of the related statistical methods, efforts not to neglect agreement parameters, and better use of relevant terminology is necessary.

Does the Reporting Quality of Diagnostic Test Accuracy Studies, as Defined by STARD 2015, Affect Citation?

Objective

To determine the rate with which diagnostic test accuracy studies that are published in a general radiology journal adhere to the Standards for Reporting of Diagnostic Accuracy Studies (STARD) 2015, and to explore the relationship between adherence rate and citation rate while avoiding confounding by journal factors.

Materials and Methods

All eligible diagnostic test accuracy studies that were published in the Korean Journal of Radiology in 2011–2015 were identified. Five reviewers assessed each article for yes/no compliance with 27 of the 30 STARD 2015 checklist items (items 28, 29, and 30 were excluded). The total STARD score (number of fulfilled STARD items) was calculated. The score of the 15 STARD items that related directly to the Quality Assessment of Diagnostic Accuracy Studies (QUADAS)-2 was also calculated. The number of times each article was cited (as indicated by the Web of Science) after publication until March 2016 and the article exposure time (time in months between publication and March 2016) were extracted.

Results

Sixty-three articles were analyzed. The mean (range) total and QUADAS-2-related STARD scores were 20.0 (14.5–25) and 11.4 (7–15), respectively. The mean citation number was 4 (0–21). Citation number did not associate significantly with either STARD score after accounting for exposure time (total score: correlation coefficient = 0.154, p = 0.232; QUADAS-2-related score: correlation coefficient = 0.143, p = 0.266).

Conclusion

The degree of adherence to STARD 2015 was moderate for this journal, indicating that there is room for improvement. When adjusted for exposure time, the degree of adherence did not affect the citation rate.

Performance of Screening Mammography: A Report of the Alliance for Breast Cancer Screening in Korea

Objective

To analyze the diagnostic accuracy and trend in screening mammography in Korea.

Materials and Methods

We retrospectively linked the information from hospitals participating in the Alliance of Breast Cancer Screening in Korea (ABCS-K) and the database of the National Cancer Screening Program. We calculated performance indicators, including the recall rate, cancer detection rate (CDR), positive predictive value (PPV), sensitivity, specificity, false-positive rate (FPR), and interval cancer rate (ICR). Changes in the performance indicators were calculated as the annual percent change with 95% confidence interval (CI).

Results

We enrolled 128756 cases from 10 hospitals from 2005 to 2010. The recall rate was 19.1% with a downward trend over time (-12.1% per year; 95% CI, -15.9 to -8.2). The CDR was 2.69 per 1000 examinations, without a significant trend. The PPV was 1.4% with an upward trend (20.8% per year; 95% CI, 15.2 to 26.7). The sensitivity was 86.5% without a significant trend, whereas the specificity was 81.1% with an upward trend (3.3% per year; 95% CI, 2.1 to 4.5). The FPR was 18.9% with a downward trend (-12.4% per year; 95% CI, -16.2 to -8.4). The ICR was 0.5 per 1000 negative examinations without a significant trend. There were institutional variations in the diagnostic accuracy and trend except for the CDR, sensitivity, and ICR.

Conclusion

The sensitivity and CDR of screening mammography in the ABCS-K from 2005 to 2010 were compatible with those for Western women. The recall rate, PPV and specificity, however, were suboptimal, although they showed significant improvements over this period. A further analysis is required to explain institutional variations.

Significance and Application of Digital Breast Tomosynthesis for the BI-RADS Classification of Breast Cancer

BACKGROUND

Full-field digital mammography (FFDM) with dense breasts has a high rate of missed diagnosis, and digital breast tomosynthesis (DBT) could reduce organization overlapping and provide more reliable images for BI-RADS classification. This study aims to explore application of COMBO (FFDM+DBT) for effect and significance of BI-RADS classification of breast cancer.

MATERIALS AND METHODS

In this study, we selected 832 patients who had been treated from May 2013 to November 2013. Classify FFDM and COMBO examination according to BI-RADS separately and compare the differences for glands in the image of the same patient in judgment, mass characteristics display and indirect signs. Employ Paired Wilcoxon rank sum test was used in 79 breast cancer patients to find differences between two examine methods.

RESULTS

The results indicated that COMBO pattern is able to observe more details in distribution of glands when estimating content. Paired Wilcoxon rank sum test showed that overall classification level of COMBO is higher significantly compared to FFDM to BI-RADS diagnosis and classification of breast (P<0.05). The area under FFDM ROC curve is 0.805, while that is 0.941 in COMBO pattern. COMBO shows relation of mass with the surrounding tissues, the calcification in the mass, and multiple foci clearly in breast cancer tissues. The optimal sensitivity of cut-off value in COMBO pattern is 82.9%, which is higher than that in FFDM (60%). They share the same specificity which is both 93.2%.

CONCLUSIONS

Digital Breast Tomosynthesis (DBT) could be used for the BI-RADS classification in breast cancer in clinical.