A simple scoring system for breast MRI interpretation: does it compensate for reader experience?

Diagnostic performance of Kaiser score in the evaluation of breast cancer using MRI: A systematic review and meta-analysis

PURPOSE

To assess the performance of Kaiser score (KS) in detecting and characterizing breast cancer on magnetic resonance imaging (MRI).

METHODS

The protocol was pre-registered at (https://osf.io/83c6j/). We performed a comprehensive search in PubMed, Embase, Cochrane Library, and Web of Science until 30 October 2024 for studies that used KS for detection of breast cancer on MRI. The risk of bias in the included studies was evaluated utilizing Quality Assessment of Diagnostic Accuracy Studies 2 (QUADAS-2). Diagnostic values of area under the curve (AUC), sensitivity, specificity, positive and negative likelihood ratios, and diagnostic odds ratio were calculated using a random-effects bivariate model. Meta-regression was used to explore the source of heterogeneity when I2 was ≥ 50 %. P-value < 0.05 was considered statistically significant.

RESULTS

A total of 29 studies with 7918 patients and 8451 breast lesions were included. The pooled sensitivity, specificity, and AUC of KS for detecting malignant breast lesions on MRI were 95 % (95 % CI = 94 % to 96 %), 70 % (95 % CI = 64 % to 75 %), and 0.94 (95 % CI = 0.91 to 0.96), while for Breast Imaging Reporting and Data System (BI-RADS), they were 97 % (95 % CI = 92 % to 99 %), 46 % (95 % CI = 30 % to 62 %), and 0.89 (95 % CI = 0.86 to 0.91). Sensitivity difference was not statistically significant (p-value = 0.803), but specificity difference was significant (p-value = 0.001). Also, KS demonstrated slightly better diagnostic accuracy for mass lesions with a sensitivity of 96 % (95 % CI = 94 % to 97 %), specificity of 69 % (95 % CI = 60 % to 77 %), and AUC of 0.96 (95 % CI = 0.94 to 0.97) compared to non-mass lesions with 93 % (95 % CI = 88 % to 96 %), 68 % (95 % CI = 58 % to 77 %), and 0.91 (95 % CI = 0.88 to 0.94) values, respectively. KS showed better performance in larger lesions.

CONCLUSION

The KS's superior diagnostic performance compared to BI-RADS, particularly its ability to avoid unnecessary biopsies, makes it valuable for diagnostic and clinical decision-making.

Contrıbutıon of Kaıser score in non-mass enhanced breast lesions

OBJECTIVE

Our study aimed to investigate the effectiveness of Kaiser Score (KS) in diagnosing Non-mass enhanced (NME) lesions and its impact on the inter-reader agreement between experienced and inexperienced readers.

MATERIALS AND METHODS

A retrospective analysis was conducted on 189 NME lesions from 182 MRIs. Two readers (an experienced radiologist and a radiology resident) independently evaluated lesions using the KS, blinded to clinical and pathological data. The KS was modified (MKS) by adding 2 points for microcalcifications on mammography and subtracting 4 points for ADC values > 1.4 x 10^-3 mm2/s. Interobserver agreement was assessed with the Intraclass Correlation Coefficient (ICC), and diagnostic performance was evaluated via ROC analysis, with sensitivity and specificity calculated at > 4 and > 5 cut-offs.

RESULTS

Interobserver agreement improved with MKS (ICC: 0.763) compared to KS (ICC: 0.667). For the experienced reader, both KS and MKS achieved high sensitivity (>94 %) at a cut-off of > 4. At > 5, specificity improved from 40.5 % to 58.7 % for KS and 39.1 % to 55.8 % for MKS without significantly affecting sensitivity. For the inexperienced reader, MKS improved sensitivity (96.8 %) and specificity (39 %) at > 4. At > 5, specificity increased to 55.8 %, with a non-significant decrease in sensitivity (86.2 %).

CONCLUSION

The Kaiser Score is a quick and systematic tool that enhances diagnostic accuracy and reduces biopsy rates, particularly benefiting inexperienced readers. While higher thresholds improve specificity for experienced readers, they may reduce sensitivity for inexperienced readers, potentially missing malignancies. As a complement to BI-RADS, the Kaiser Score helps standardize evaluations and bridge experience gaps in MRI interpretation.

Can structured integration of BI-RADS criteria by a clinical decision rule reduce the number of unnecessary biopsies in BI-RADS 4 lesions? A systematic review and meta-analysis

AIM

This systematic review and meta-analysis investigate the added value of structured integration of Breast Imaging Reporting and Data System (BI-RADS) criteria using the Kaiser score (KS) to avoid unnecessary biopsies in BI-RADS 4 lesions.

MATERIAL AND METHODS

A systematic review and meta-analysis were conducted using predefined criteria. Eligible articles, published in English until May 2024, dealt with KS in the context of BI-RADS 4 MRI. Two reviewers extracted study characteristics, including true positives (TP), false positives (FP), true negatives (TN), and false negatives (FN). Sensitivity, specificity, negative likelihood ratio, and positive likelihood ratio were calculated using bivariate random effects. Fagan nomograms identified the maximum pre-test probability at which post-test probabilities of a negative MRI aligned with the 2% malignancy rate benchmark for downgrading BI-RADS 4 to BI-RADS 3. I² statistics and meta-regression explored sources of heterogeneity. p-values < 0.05 were considered significant.

RESULTS

Seven studies with 1877 lesions (833 malignant, 1044 benign) were included. The average breast cancer prevalence was 47.3%. Pooled sensitivity was 94.3% (95%-CI 88.9%-97.1%), and pooled specificity was 68.1% (95%-CI 56.6%-77.7%) using a random effects model. Overall, 52/833 cases were FNs (6.2%). Fagan nomograms showed that KS could rule out breast cancer in BI-RADS 4 lesions at a pre-test probability of 20.3% for all lesions, 25.4% for masses, and 15.2% for non-mass lesions.

CONCLUSIONS

In MRI-assessed BI-RADS 4 lesions, applying structured BI-RADS criteria with the KS reduces unnecessary biopsies by 70% with a 6.2% FN rate. Breast cancer can be ruled out up to pre-test probabilities of 20.3%.

KEY POINTS

Question What, if any, value is added by structured integration of BI-RADS criteria using the Kaiser Score (KS) to avoid unnecessary biopsies in BI-RADS 4 lesions? Findings The structured integration of BI-RADS criteria using the Kaiser Score (KS) reduces unnecessary biopsies in BI-RADS 4 lesions by 70%. Clinical relevance The structured approach offered by the Kaiser Score (KS) avoids unnecessary recalls, potentially reducing patient anxiety, lessening the burden on medical personnel, and the need for further imaging and biopsies due to more objective and thus efficient clinical decision-making in evaluating BI-RADS 4 lesions.

Diagnostic Performance of Kaiser score in MRI BI-RADS 3 Lesions: A Promising tool to reduce unnecessary biopsies

PURPOSE

To evaluate the possibility of reducing unnecessary biopsies in patients with BI-RADS 3 lesions by implementing Kaiser score (KS).

METHOD

In this retrospective, single-center study, we included 79 female patients with BI-RADS 3 lesions and risk factors who underwent biopsy following magnetic resonance imaging. Three readers (two experienced breast radiologists and a radiology resident) blinded evaluated the lesions using KS. Lesions with a KS ≤ 4 were considered benign. Results were compared with the histopathological findings (gold standard) assessing sensitivity and specificity along with 95 % confidence intervals (CI) for each reader. Inter-reader agreement was assessed using Fleiss' kappa with 95 % CIs. Moreover, Cohen's kappa was used to assess concordance between two readers at time.

RESULTS

79 female patients (mean age, 50.9 ± 12.2 (standard deviation)) were evaluated. The area under the receiver operating characteristic curve for the three readers was excellent: 0.99, 0.99, and 0.90), respectively. The sensitivity of the two breast radiologists and the resident was 0.92 (95 % CI: 0.62 - 0.99), 1.00 (95 % CI: 0.95 - 1.00) and 0.75 (95 % CI: 0.42 - 0.95), respectively, while the specificity was 1.00 (95 % CI: 0.95---1.00), 0.99 (95 % CI: 0.92 - 1.00), and 1.00 (95 % CI: 0.95 - 1.00) respectively. By using a KS ≤ 4 value to indicate benignity, 66 to 67 biopsies (84 to 85 % of all the biopsies) would have been avoided. Inter-reader concordance via Fleiss' kappa was 0.792 (95 % CI: 0.68 - 0.91).

CONCLUSIONS

The implementation of KS could have spared 84-85% of biopsies, proving to be a quick, user-friendly tool with strong inter-observer agreement and high specificity.

A nomogram based on multiparametric magnetic resonance imaging improves the diagnostic performance of breast lesions diagnosed as BI-RADS category 4: A comparative study with the Kaiser score

PURPOSE

To construct a nomogram combining Kaiser score (KS), synthetic MRI (syMRI) parameters, apparent diffusion coefficient (ADC), and clinical features to distinguish benign and malignant breast lesions better.

METHODS

From December 2022 to February 2024, a retrospective cohort of 168 patients with breast lesions diagnosed as Breast Imaging Reporting and Data System (BI-RADS) category 4 by ultrasound and/or mammography was included. The research population was divided into the training set (n = 117) and the validation set (n = 51) by random sampling with a ratio of 7:3. Breast lesions' KS, ADC, relaxation time of syMRI, and clinical and imaging features were statistically analyzed and compared between malignant and benign groups. Two experienced radiologists independently assigned KS, and measured quantitative values of ADC and parameters of syMRI, and the intraclass correlation coefficient (ICC) was calculated. Independent predictors were identified by univariable and multivariable logistic regression analysis. Then, a nomogram was established, and its performance was evaluated by the area under the curve (AUC), calibration curve, and decision curve.

RESULTS

There were 168 lesions (118 malignant and 50 benign) in 168 female patients confirmed by histopathology. The interobserver agreement for each quantitative parameter was excellent. Older patient (OR = 1.091, 95 % confidence interval [CI]: 1.017-1.170, P = 0.014), higher lesions' KS (OR = 288.431, 95 % CI: 34.930-2381.654, P < 0.001), lower ADC (OR = 0.077, 95 % CI: 0.011-0.558, P = 0.011), and lower T2 relaxation time (OR = 0.918, 95 % CI: 0.868-0.972, P = 0.003) were independent predictors of breast malignancies and utilized to establish the nomogram. The accuracy of KS, ADC, T2, and patient age in predicting malignant breast lesions was 88.89 %, 79.48 %, 82.05 %, and 58.97 %, respectively. No significant differences in AUCs of KS, ADC and T2 were observed in distinguishing benign from malignant breast lesions. The nomogram yielded higher AUCs of 0.968 (0.934-0.996) and 0.959 (0.863-0.995) in training and validation sets than KS, ADC, T2, and patient age (p < 0.05).

CONCLUSION

Although there were no significant differences among the AUCs of KS, ADC, and T2, the constructed nomogram incorporating these parameters significantly improves diagnostic performance for distinguishing benign and malignant BI-RADS 4 breast lesions. Future external validation is needed in practical applications.

Breast lesions on MRI in mass and non-mass enhancement: Kaiser score and modified Kaiser score + for readers of variable experience

OBJECTIVES

To compare the diagnostic performance of three readers using BI-RADS and Kaiser score (KS) based on mass and non-mass enhancement (NME) lesions.

METHODS

A total of 630 lesions, 393 malignant and 237 benign, 458 mass and 172 NME, were analyzed. Three radiologists with 3 years, 6 years, and 13 years of experience made diagnoses. 596 cases had diffusion-weighted imaging, and the apparent diffusion coefficient (ADC) was measured. For lesions with ADC > 1.4 × 10-3 mm2/s, the KS was reduced by 4 as the modified KS +, and the benefit was assessed.

RESULTS

When using BI-RADS, AUC was 0.878, 0.915, and 0.941 for mass, and 0.771, 0.838, 0.902 for NME for Reader-1, 2, and 3, respectively, better for mass than for NME. The diagnostic accuracy of KS was improved compared to BI-RADS for less experienced readers. For Reader-1, AUC was increased from 0.878 to 0.916 for mass (p = 0.005) and from 0.771 to 0.822 for NME (p = 0.124). Based on the cut-off value of BI-RADS ≥ 4B and KS ≥ 5 as malignant, the sensitivity of KS by Readers-1 and -2 was significantly higher for both Mass and NME. When ADC was considered to change to modified KS +, the AUC and the accuracy for all three readers were improved, showing higher specificity with slightly degraded sensitivity.

CONCLUSION

The benefit of KS compared to BI-RADS was most noticeable for the less experienced readers in improving sensitivity. Compared to KS, KS + can improve specificity for all three readers. For NME, the KS and KS + criteria need to be further improved.

CLINICAL RELEVANCE STATEMENT

KS provides an intuitive method for diagnosing lesions on breast MRI. BI-RADS and KS face greater difficulties in evaluating NME compared to mass lesions. Adding ADC to the KS can improve specificity with slightly degraded sensitivity.

KEY POINTS

KS provides an intuitive method for interpreting breast lesions on MRI, most helpful for novice readers. KS, compared to BI-RADS, improved sensitivity in both mass and NME groups for less experienced readers. NME lesions were considered during the development of the KS flowchart, but may need to be better defined.

Kaiser score diagnosis of breast MRI lesions: Factors associated with false-negative and false-positive results

PURPOSE

We sought factors associated with false-negative and false-positive results in the diagnosis of breast lesions using the Kaiser score (KS) on breast magnetic resonance imaging (MRI).

METHODS

We retrospectively analyzed 1058 patients with 1058 breast lesions who underwent preoperative breast MRI with successful histopathologic results. Two radiologists assessed each lesion according to KS criteria, and clinicopathologic features and MRI findings were analyzed. Multivariate regression analysis was conducted to identify factors associated with false-negative and false-positive KS results.

RESULTS

Of the 1058 lesions, 859 were malignant and 199 were benign. Particularly high misdiagnosis rates were observed for intraductal papilloma, inflammatory lesion, and mucinous carcinoma. For breast cancer, KS yielded 821 (95.6 %) true-positive and 38 (4.4 %) false-negative results. Multivariate analysis showed that smaller lesion size (≤1 cm) (OR, 3.698; 95 %CI, 1.430-9.567; p = 0.007), absence of ipsilateral breast hypervascularity (OR, 3.029; 95 %CI, 1.370-6.693; p = 0.006), and presence of hyperintensity on T2WI (OR, 2.405; 95 %CI, 1.121-5.162; p = 0.024) were significantly associated with false-negative breast cancer results. For benign lesions, KS yielded 141 (70.9 %) true-negative and 58 (29.1 %) false-positive results. Multivariate regression analysis revealed that non-mass enhancement lesions (OR, 4.660; 95 %CI, 2.018-10.762; p＜0.001), moderate/high background parenchymal enhancement (OR, 2.402; 95 %CI, 1.180-4.892; p = 0.016), and the presence of hyperintensity on T2WI (OR, 2.986; 95 %CI, 1.386-6.433; p = 0.005) were significantly associated with false-positive KS results.

CONCLUSION

Several clinicopathologic and MRI features influence the accuracy of KS diagnosis. Understanding these factors may facilitate appropriate use of KS and guide alternative diagnostic approaches, ultimately improving diagnostic accuracy in the evaluation of breast lesions.

Reliability of Kaiser Score in Assessing Additional Breast Lesions Identified on Staging MRI in Patients with Breast Cancer

(1) Background: The Kaiser score is a user-friendly tool that evaluates lesions on breast MRI and has been studied in the general population and a few specific clinical scenarios. We aim to evaluate the performance of the Kaiser score in the characterization of additional lesions identified on staging breast MRI. (2) Methods: The Kaiser score of the biopsied additional lesions identified on staging MRI in recently diagnosed breast cancer patients was retrospectively determined. Statistical analysis was performed to evaluate the diagnostic capability of the Kaiser score and whether it is affected by different imaging and pathological parameters of the additional and the index lesion. (3) Results: Seventy-six patients with ninety-two MRI-detected lesions constitute the studied population. There was a statistically significant difference in the Kaiser score between benign and malignant lesions, irrespective of the pathology of the index cancer (p = 0.221) or the size and the imaging features of the additional lesion. Using a cutoff of 5 and above for suspicious lesions, biopsy could have been avoided in 34/92 lesions. (4) Conclusions: The Kaiser score can assist radiologists in the evaluation of additional MRI lesions identified in recently diagnosed breast cancer patients, thus decreasing the number of unneeded biopsies and delays in definitive surgical management.

Cancer detection rate of breast-MR in supplemental screening after negative mammography in women with dense breasts. Preliminary results of the MA-DETECT-Study after 200 participants

BACKGROUND

Due to increased cancer detection rates (CDR), breast MR (breast MRI) can reduce underdiagnosis of breast cancer compared to conventional imaging techniques, particularly in women with dense breasts. The purpose of this study is to report the additional breast cancer yield by breast MRI in women with dense breasts after receiving a negative screening mammogram.

METHODS

For this study we invited consecutive participants of the national German breast cancer Screening program with breast density categories ACR C & D and a negative mammogram to undergo additional screening by breast MRI. Endpoints were CDR and recall rates. This study reports interim results in the first 200 patients. At a power of 80% and considering an alpha error of 5%, this preliminary population size is sufficient to demonstrate a 4/1000 improvement in CDR.

RESULTS

In 200 screening participants, 8 women (40/1000, 17.4-77.3/1000) were recalled due to positive breast MRI findings. Image-guided biopsy revealed 5 cancers in 4 patients (one bilateral), comprising four invasive cancers and one case of DCIS. 3 patients revealed 4 invasive cancers presenting with ACR C breast density and one patient non-calcifying DCIS in a woman with ACR D breast density, resulting in a CDR of 20/1000 (95%-CI 5.5-50.4/1000) and a PPV of 50% (95%-CI 15.7-84.3%).

CONCLUSION

Our initial results demonstrate that supplemental screening using breast MRI in women with heterogeneously dense and very dense breasts yields an additional cancer detection rate in line with a prior randomized trial on breast MRI screening of women with extremely dense breasts. These findings are highly important as the population investigated constitutes a much higher proportion of women and yielded cancers particularly in women with heterogeneously dense breasts.

Enhancing the Kaiser score for lesion characterization in unenhanced breast MRI

PURPOSE

To adapt the methodology of the Kaiser score, a clinical decision rule for lesion characterization in breast MRI, for unenhanced protocols.

METHOD

In this retrospective IRB-approved cross-sectional study, we included 93 consecutive patients who underwent breast MRI between 2021 and 2023 for further work-up of BI-RADS 0, 3-5 in conventional imaging or for staging purposes (BI-RADS 6). All patients underwent biopsy for histologic verification or were followed for a minimum of 12 months. MRI scans were conducted using 1.5 T or 3 T scanners using dedicated breast coils and a protocol in line with international recommendations including DWI and ADC. Lesion characterization relied solely on T2w and DWI/ADC-derived features (such as lesion type, margins, shape, internal signal, surrounding tissue findings, ADC value). Statistical analysis was done using decision tree analysis aiming to distinguish benign (histology/follow-up) from malignant outcomes.

RESULTS

We analyzed a total of 161 lesions (81 of them non-mass) with a malignancy rate of 40%. Lesion margins (spiculated, irregular, or circumscribed) were identified as the most important criterion within the decision tree, followed by the ADC value as second most important criterion. The resulting score demonstrated a strong diagnostic performance with an AUC of 0.840, providing both rule-in and rule-out criteria. In an independent test set of 65 lesions the diagnostic performance was verified by two readers (AUC 0.77 and 0.87, kappa: 0.62).

CONCLUSIONS

We developed a clinical decision rule for unenhanced breast MRI including lesion margins and ADC value as the most important criteria, achieving high diagnostic accuracy.

Diagnostic accuracy of the breast MRI Kaiser score in suspected architectural distortions and its comparison with mammography

Suspicious architectural distortion is an elusive finding in breast cancer diagnosis. This study aimed to evaluate the diagnostic accuracy of the Kaiser score for suspicious architectural distortions observed on mammography and compare it with the BI-RADS score of the lesion. Mammograms performed between January 2013 and March 2023 were retrospectively analyzed for the presence of suspicious architectural distortion. Forty-one patients, who had at least 1 year of radiological follow-up or pathology results, and underwent breast MRI, were included in the study. Mammography findings and the BI-RADS category of the lesion were assessed. MRI findings were evaluated and Kaiser scoring was performed according to the tree flowchart. Ninety-one percent of the enhanced lesions had a Kaiser score of 5 and above. In the diagnosis of malignancy, the Kaiser score yielded an accuracy of 75.61% (AUC 0.833). A statistically significant correlation was observed indicating that a malignant diagnosis was more prevalent in patients with a Kaiser score of 5 and above (p < 0.05). Additionally statistically significant relationship was also observed between the BI-RADS category of architectural distortions on mammography and the Kaiser score (p = 0.007). The combined utilization of mammography findings and the evidence-based Kaiser score in suspected architectural distortions provides more accurate results in the differential diagnosis of breast cancer.

Using the Kaiser Score as a clinical decision rule for breast lesion classification: Does computer-assisted curve type analysis improve diagnosis?

PURPOSE

We aimed to investigate the effect of using visual or automatic enhancement curve type assessment on the diagnostic performance of the Kaiser Score (KS), a clinical decision rule for breast MRI.

METHOD

This IRB-approved retrospective study analyzed consecutive conventional BI-RADS 0, 4 or 5 patients who underwent biopsy after 1.5T breast MRI according to EUSOBI recommendations between 2013 and 2015. The KS includes five criteria (spiculations; signal intensity (SI)-time curve type; margins of the lesion; internal enhancement; and presence of edema) resulting in scores from 1 (=lowest) to 11 (=highest risk of breast cancer). Enhancement curve types (Persistent, Plateau or Wash-out) were assessed by two radiologists independently visually and using a pixel-wise color-coded computed parametric map of curve types. KS diagnostic performance differences between readings were compared by ROC analysis.

RESULTS

In total 220 lesions (147 benign, 73 malignant) including mass (n = 148) and non-mass lesions (n = 72) were analyzed. KS reading performance in distinguishing benign from malignant lesions did not differ between visual analysis and parametric map (P = 0.119; visual: AUC 0.875, sensitivity 95 %, specificity 63 %; and map: AUC 0.901, sensitivity 97 %, specificity 65 %). Additionally, analyzing mass and non-mass lesions separately, showed no difference between parametric map based and visual curve type-based KS analysis as well (P = 0.130 and P = 0.787).

CONCLUSIONS

The performance of the Kaiser Score is largely independent of the curve type assessment methodology, confirming its robustness as a clinical decision rule for breast MRI in any type of breast lesion in clinical routine.

Added value of clinical decision rules for the management of enhancing breast MRI lesions: A systematic comparison of the Kaiser score and the Göttingen score

PURPOSE

We investigated the added value of two internationally used clinical decision rules in the management of enhancing lesions on breast MRI.

METHODS

This retrospective, institutional review board approved study included consecutive patients from two different populations. Patients received breast MRI according to the recommendations of the European Society of Breast Imaging (EUSOBI). Initially, all examinations were assessed by expert readers without using clinical decision rules. All lesions rated as category 4 or 5 according to the Breast Imaging Reporting and Data System were histologically confirmed. These lesions were re-evaluated by an expert reader blinded to the histology. He assigned each lesion a Göttingen score (GS) and a Kaiser score (KS) on different occasions. To provide an estimate on inter-reader agreement, a second fellowship-trained reader assessed a subset of these lesions. Subgroup analyses based on lesion type (mass vs. non-mass), size (>1 cm vs. ≤ 1 cm), menopausal status, and significant background parenchymal enhancement were conducted. The areas under the ROC curves (AUCs) for the GS and KS were compared, and the potential to avoid unnecessary biopsies was determined according to previously established cutoffs (KS > 4, GS > 3) RESULTS: 527 lesions in 506 patients were included (mean age: 51.8 years, inter-quartile-range: 43.0-61.0 years). 131/527 lesions were malignant (24.9 %; 95 %-confidence-interval: 21.3-28.8). In all subgroups, the AUCs of the KS (median = 0.91) were higher than those of the GS (median = 0.83). Except for "premenopausal patients" (p = 0.057), these differences were statistically significant (p ≤ 0.01). Kappa agreement was higher for the KS (0.922) than for the GS (0.358).

CONCLUSION

Both the KS and the GS provided added value for the management of enhancing lesions on breast MRI. The KS was superior to the GS in terms of avoiding unnecessary biopsies and showed superior inter-reader agreement; therefore, it may be regarded as the clinical decision rule of choice.

How Does Diagnostic Accuracy Evolve with Increased Breast MRI Experience?

Introduction: Our institution is part of a provincial program providing annual breast MRI screenings to high-risk women. We assessed how MRI experience, background parenchymal enhancement (BPE), and the amount of fibroglandular tissue (FGT) affect the biopsy-proven predictive value (PPV3) and accuracy for detecting suspicious MRI findings. Methods: From all high-risk screening breast MRIs conducted between 1 July 2011 and 30 June 2020, we reviewed all BI-RADS 4/5 observations with pathological tissue diagnoses. Overall and annual PPV3s were computed. Radiologists with fewer than ten observations were excluded from performance analyses. PPV3s were computed for each radiologist. We assessed how MRI experience, BPE, and FGT impacted diagnostic accuracy using logistic regression analyses, defining positive cases as malignancies alone (definition A) or malignant or high-risk lesions (definition B). Findings: There were 536 BI-RADS 4/5 observations with tissue diagnoses, including 77 malignant and 51 high-risk lesions. A total of 516 observations were included in the radiologist performance analyses. The average radiologist's PPV3 was 16 ± 6% (definition A) and 25 ± 8% (definition B). MRI experience in years correlated significantly with positive cases (definition B, OR = 1.05, p = 0.03), independent of BPE or FGT. Diagnostic accuracy improved exponentially with increased MRI experience (definition B, OR of 1.27 and 1.61 for 5 and 10 years, respectively, p = 0.03 for both). Lower levels of BPE significantly correlated with increased odds of findings being malignant, independent of FGT and MRI experience. Summary: More extensive MRI reading experience improves radiologists' diagnostic accuracy for high-risk or malignant lesions, even in MRI studies with increased BPE.

Improved Differential Diagnosis Based on BI-RADS Descriptors and Apparent Diffusion Coefficient for Breast Lesions: A Multiparametric MRI Analysis as Compared to Kaiser Score

RATIONALE AND OBJECTIVES

To develop the nomogram utilizing the American College of Radiology BI-RADS descriptors, clinical features, and apparent diffusion coefficient (ADC) to differentiate benign from malignant breast lesions.

MATERIALS AND METHODS

A total of 341 lesions (161 malignant and 180 benign) were included. Clinical data and imaging features were reviewed. Univariable and multivariable logistic regression analyses were performed to determine the independent variables. ADC as a continuous or classified into binary form with a cutoff value of 1.30 × 10-3 mm2/s, incorporated other independent predictors to construct two nomograms, respectively. Receiver operating curve and calibration plot was employed to test the models' discriminative ability. The diagnostic performance between the developed model and the Kaiser score (KS) was also compared.

RESULTS

In both models, high patient age, the presence of root sign, time-intensity curves (TICs) types (plateau and washout), heterogenous internal enhancement, the presence of peritumoral edema, and ADC were independently associated with malignancy. The AUCs of two multivariable models (AUC, 0.957; 95% CI: 0.929-0.976 and AUC, 0.958; 95% CI: 0.931-0.976) were significantly higher than that of the KS (AUC, 0.919, 95% CI: 0.885-0.946; both P < 0.001). At the same sensitivity of 95.7%, our models showed an increase in specificity by 5.56% (P = 0.076) and 6.11% (P = 0.035), respectively, as compared to the KS.

CONCLUSION

The models incorporating MRI features (root sign, TIC, margins, internal enhancement, and presence of edema), quantitative ADC value, and patient age showed improved diagnostic performance and might have avoided more unnecessary biopsies in comparison with the KS, although further external validation is required.

Contrasts Between Diffusion-Weighted Imaging and Dynamic Contrast-Enhanced MR in Diagnosing Malignancies of Breast Nonmass Enhancement Lesions Based on Morphologic Assessment

BACKGROUND

Nonmass enhancement (NME) breast lesions are considered to be the leading cause of unnecessary biopsies. Diffusion-weighted imaging (DWI) or dynamic contrast-enhanced (DCE) sequences are typically used to differentiate between benign and malignant NMEs. It is important to know which one is more effective and reliable.

PURPOSE

To compare the diagnostic performance of DCE curves and DWI in discriminating benign and malignant NME lesions on the basis of morphologic characteristics assessment on contrast-enhanced (CE)-MRI images.

STUDY TYPE

Retrospective.

SUBJECTS

A total of 180 patients with 184 lesions in the training cohort and 75 patients with 77 lesions in the validation cohort with pathological results.

FIELD STRENGTH/SEQUENCE

A 3.0 T/multi-b-value DWI (b values = 0, 50, 1000, and 2000 sec/mm2 ) and time-resolved angiography with stochastic trajectories and volume-interpolated breath-hold examination (TWIST-VIBE) sequence.

ASSESSMENT

In the training cohort, a diagnostic model for morphology based on the distribution and internal enhancement characteristics was first constructed. The apparent diffusion coefficient (ADC) model (ADC + morphology) and the time-intensity curves (TIC) model (TIC + morphology) were then established using binary logistic regression with pathological results as the reference standard. Both models were compared for sensitivity, specificity, and area under the curve (AUC) in the training and the validation cohort.

STATISTICAL TESTS

Receiver operating characteristic (ROC) curve analysis and two-sample t-tests/Mann-Whitney U-test/Chi-square test were performed. P < 0.05 was considered statistically significant.

RESULTS

For the TIC/ADC model in the training cohort, sensitivities were 0.924/0.814, specificities were 0.615/0.615, and AUCs were 0.811 (95%, 0.727, 0.894)/0.769 (95%, 0.681, 0.856). The AUC of the TIC-ADC combined model was significantly higher than ADC model alone, while comparable with the TIC model (P = 0.494). In the validation cohort, the AUCs of TIC/ADC model were 0.799/0.635.

DATA CONCLUSION

Based on the morphologic analyses, the performance of the TIC model was found to be superior than the ADC model for differentiating between benign and malignant NME lesions.

EVIDENCE LEVEL

4.

TECHNICAL EFFICACY

Stage 2.

Introduction of a breast apparent diffusion coefficient category system (ADC-B) derived from a large multicenter MRI database

OBJECTIVES

To develop an intuitive and generally applicable system for the reporting, assessment, and documentation of ADC to complement standard BI-RADS criteria.

METHODS

This was a multicentric, retrospective analysis of 11 independently conducted institutional review board-approved studies from seven institutions performed between 2007 and 2019. Breast Apparent Diffusion coefficient (ADC-B) categories comprised ADC-B0 (ADC non-diagnostic), ADC-B1 (no enhancing lesion), and ADC-B2-5. The latter was defined by plotting ADC versus cumulative malignancy rates. Statistics comprised ANOVA with post hoc testing and ROC analysis. p values ≤ 0.05 were considered statistically significant.

RESULTS

A total of 1625 patients (age: 55.9 years (± 13.8)) with 1736 pathologically verified breast lesions were included. The mean ADC (× 10-3 mm2/s) differed significantly between benign (1.45, SD .40) and malignant lesions (.95, SD .39), and between invasive (.92, SD .22) and in situ carcinomas (1.18, SD .30) (p < .001). The following ADC-B categories were identified: ADC-B0-ADC cannot be assessed; ADC-B1-no contrast-enhancing lesion; ADC-B2-ADC ≥ 1.9 (cumulative malignancy rate < 0.1%); ADC-B3-ADC 1.5 to < 1.9 (0.1-1.7%); ADC-B4-ADC 1.0 to < 1.5 (10-24.5%); and ADC-B5-ADC < 1.0 (> 24.5%). At the latter threshold, a positive predictive value of 95.8% (95% CI 0.94-0.97) for invasive versus non-invasive breast carcinomas was reached.

CONCLUSIONS

The breast apparent diffusion coefficient system (ADC-B) provides a simple and widely applicable categorization scheme for assessment, documentation, and reporting of apparent diffusion coefficient values in contrast-enhancing breast lesions on MRI.

CLINICAL RELEVANCE STATEMENT

The ADC-B system, based on diverse MRI examinations, is clinically relevant for stratifying breast cancer risk via apparent diffusion coefficient measurements, and complements BI-RADS for improved clinical decision-making and patient outcomes.

KEY POINTS

• The breast apparent diffusion coefficient category system (ADC-B) is a simple tool for the assessment, documentation, and reporting of ADC values in contrast-enhancing breast lesions on MRI. • The categories comprise ADC-B0 for non-diagnostic examinations, ADC-B1 for examinations without an enhancing lesion, and ADC-B2-5 for enhancing lesions with an increasing malignancy rate. • The breast apparent diffusion coefficient category system may be used to complement BI-RADS in clinical decision-making.

Diagnostic value of Kaiser score combined with breast vascular assessment from breast MRI for the characterization of breast lesions

Objectives

The Kaiser scoring system for breast magnetic resonance imaging is a clinical decision-making tool for diagnosing breast lesions. However, the Kaiser score (KS) did not include the evaluation of breast vascularity. Therefore, this study aimed to use KS combined with breast vascular assessment, defined as KS^*, and investigate the effectiveness of KS^* in differentiating benign from malignant breast lesions.

Methods

This retrospective study included 223 patients with suspicious breast lesions and pathologically verified results. The histopathological diagnostic criteria were according to the fifth edition of the WHO classification of breast tumors. The KS^* was obtained after a joint evaluation combining the original KS and breast vasculature assessment. The receiver operating characteristic (ROC) curve was used for comparing differences in the diagnostic performance between KS^* and KS, and the area under the receiver operating characteristic (AUC) was compared.

Results

There were 119 (53.4%) benign and 104 (46.6%) malignant lesions in total. The overall sensitivity, specificity, and accuracy of increased ipsilateral breast vascularity were 69.2%, 76.5%, and 73.1%, respectively. The overall sensitivity, specificity, and accuracy of AVS were 82.7%, 76.5%, and 79.4%, respectively. For all lesions included the AUC of KS^* was greater than that of KS (0.877 vs. 0.858, P = 0.016). The largest difference in AUC was observed in the non-mass subgroup (0.793 vs. 0.725, P = 0.029).

Conclusion

Ipsilaterally increased breast vascularity and a positive AVS sign were significantly associated with malignancy. KS combined with breast vascular assessment can effectively improve the diagnostic ability of KS for breast lesions, especially for non-mass lesions.

Diagnostic performance of Kaiser score in patients with newly diagnosed breast cancer: Factors associated with false-negative results

PURPOSE

To investigate the factors associated with false-negative results in the diagnosis of breast cancer via breast magnetic resonance imaging (MRI) using the Kaiser score (KS).

METHODS

This institutional review board (IRB)-approved, single-center, retrospective study enrolled 219 consecutive histopathologically proven breast cancer lesions in 205 women who underwent preoperative breast MRI. Two breast radiologists evaluated each lesion according to the KS. The clinicopathological characteristics and imaging findings were also analyzed. Interobserver variability was assessed using the intraclass correlation coefficient (ICC). Multivariate regression analysis was used to investigate factors associated with false-negative KS results for breast cancer diagnosis.

RESULTS

Of 219 breast cancers, KS yielded 200 (91.3%) true-positive and 19 (8.7%) false-negative results. The interobserver ICC for the KS between the two readers was good, with a value of 0.804 (95% CI 0.751-0.846). Multivariate regression analysis revealed that small lesion size (≤1 cm) (adjusted OR 6.86, 95% CI 2.14-21.94, p = 0.001) and personal breast cancer history (adjusted OR 7.59, 95% CI, 1.55-37.23, p = 0.012) were significantly associated with false-negative KS results.

CONCLUSION

Small lesion size (≤1 cm) and presence of personal breast cancer history are factors significantly associated with false-negative KS results. Our results suggest that radiologists should consider these factors in clinical practice as potential pitfalls of KS, which may be compensated for by a multimodal approach combined with clinical evaluation.

Radiomics model to classify mammary masses using breast DCE-MRI compared to the BI-RADS classification performance

BACKGROUND

Recent advanced in radiomics analysis could help to identify breast cancer among benign mammary masses. The aim was to create a radiomics signature using breast DCE-MRI extracted features to classify tumors and to compare the performances with the BI-RADS classification.

MATERIAL AND METHODS

From September 2017 to December 2019 images, exams and records from consecutive patients with mammary masses on breast DCE-MRI and available histology from one center were retrospectively reviewed (79 patients, 97 masses). Exclusion criterion was malignant uncertainty. The tumors were split in a train-set (70%) and a test-set (30%). From 14 kinetics maps, 89 radiomics features were extracted, for a total of 1246 features per tumor. Feature selection was made using Boruta algorithm, to train a random forest algorithm on the train-set. BI-RADS classification was recorded from two radiologists.

RESULTS

Seventy-seven patients were analyzed with 94 tumors, (71 malignant, 23 benign). Over 1246 features, 17 were selected from eight kinetic maps. On the test-set, the model reaches an AUC = 0.94 95 CI [0.85-1.00] and a specificity of 33% 95 CI [10-70]. There were 43/94 (46%) lesions BI-RADS4 (4a = 12/94 (13%); 4b = 9/94 (10%); and 4c = 22/94 (23%)). The BI-RADS score reached an AUC = 0.84 95 CI [0.73-0.95] and a specificity of 17% 95 CI [3-56]. There was no significant difference between the ROC curves for the model or the BI-RADS score (p = 0.19).

CONCLUSION

A radiomics signature from features extracted using breast DCE-MRI can reach an AUC of 0.94 on a test-set and could provide as good results as BI-RADS to classify mammary masses.

Diagnostic performance of the Kaiser score in the evaluation of breast lesions on contrast-enhanced mammography

OBJECTIVES

We aimed to investigate whether the Kaiser score (KS) could improve the diagnostic performance of breast imaging reporting and data system (BI-RADS) in evaluating breast enhancing lesions on contrast-enhanced mammography (CEM).

METHODS

Three hundred fifty-nine patients with 375 lesions (231 malignant and 144 benign) were included in this retrospective study from April 2019 to December 2021.Two readers with different levels of experience in breast imaging were asked to give a BI-RADS assessment category according to the CEM BI-RADS and final score based on the KS. The diagnostic performance of all lesions, mass and non-mass enhancement (NME) were assessed by receiver operating characteristic (ROC) analysis, and the areas under the ROC curve (AUCs) were measured. The weighted kappa coefficients were calculated to investigate the interreader agreement.

RESULTS

The AUCs of the KS for all lesions were 0.915 (95 %CI: 0.884-0.947) and 0.876 (95 %CI: 0.838-0.914) for two readers. When mass and NME were evaluated separately, the AUCs of the KS for mass were higher than those for NME (p < 0.001). The AUCs of BI-RADS for all lesion diagnoses ranged between 0.821 (95 %CI: 0.778-0.864) and 0.842(95 %CI: 0.801-0.883) for two readers. The AUCs of the KS were higher than those of BI-RADS (p < 0.001, p = 0.016). There were no significant differences in the sensitivity between the KS (97.4 %) and BI-RADS (99.6 %) for all lesions (p = 0.130). The specificity of the KS was significantly higher than that of BI-RADS (p < 0.001). Compared with BI-RADS, the application of the KS could have potentially obviated 41.7 % to 47.9 % unnecessary biopsies in 144 benign lesions. Interreader agreement between the two readers of the KS was almost perfect (k = 0.883 [95 % CI: 0.842-0.924]).

CONCLUSION

The use of the KS provided a high diagnostic performance in distinguishing malignant and benign breast lesions on CEM and outperformed BI-RADS. The application of the KS can downgrade up to 47.9% of unnecessary biopsies of benign breast lesions.

Value of contrast-enhanced mammography combined with the Kaiser score for clinical decision-making regarding tomosynthesis BI-RADS 4A lesions

OBJECTIVES

To investigate the diagnostic performance of contrast-enhanced mammography (CEM) combined with the Kaiser score (KS) in digital breast tomosynthesis (DBT) BI-RADS 4A lesions to potentially reduce unnecessary breast biopsies.

METHODS

This retrospective study evaluated 106 patients with 109 DBT BI-RADS 4A lesions from June 2019 to June 2021. For the absence of enhancement on CEM, the lesions were downgraded to BI-RADS 3. For lesions with enhancement, the readers were asked to classify all enhancing lesions referring to the KS for breast MRI. Receiver operating characteristic (ROC) curve analysis was used to evaluate the diagnostic performance. Two readers rated all cases and interreader agreement was assessed by Cohen's kappa coefficients.

RESULTS

There were ninety-five benign lesions and 14 malignant lesions. CEM combined with KS's accuracy, represented by the area under the curve (AUC), ranged between 0.880 and 0.906. The use of the KS improved the performance, with a significant difference relative to a single BI-RADS reading or US (p < 0.001). CEM with KS had higher specificity than CEM with BI-RADS or US (p < 0.001), without difference in sensitivity (p > 0.05). CEM combined with KS could have potentially obviated 72 (75.8%) to 78 (82.1%) unnecessary benign biopsies in 95 benign lesions previously DBT classified as BI-RADS 4A. The interreader agreement was substantial (kappa: 0.727) for KS.

CONCLUSIONS

CEM combined with KS may be used in DBT BI-RADS 4A lesions to substantially reduce unnecessary benign biopsies.

KEY POINTS

• CEM combined with the Kaiser scoring system shows high diagnostic performance for DBT BI-RADS 4A lesions. • The application of CEM combined with the Kaiser scoring system may avoid 75.8% to 82.1% of unnecessary benign breast biopsies. • CEM combined with the KS aids clinical decision-making in DBT BI-RADS 4A lesions.

Evaluation of the differentiation of benign and malignant breast lesions using synthetic relaxometry and the Kaiser score

Objective

To investigate whether there is added value of quantitative parameters from synthetic magnetic resonance imaging (SyMRI) as a complement to the Kaiser score (KS) to differentiate benign and malignant breast lesions.

Materials and methods

In this single-institution study, 122 patients who underwent breast MRI from March 2020 to May 2021 were retrospectively analyzed. SyMRI and dynamic contrast-enhanced MRI were performed using a 3.0-T system. Two experienced radiologists independently assigned the KS and measured the quantitative values of T1 relaxation time (T1), T2 relaxation time (T2), and proton density (PD) from SyMRI. Pathology was regarded as the gold standard. The diagnostic values were compared using the appropriate statistical tests.

Results

There were 122 lesions (86 malignant and 36 benign) in 122 women. The T1 value was identified as the only independent factor for the differentiation of malignant and benign lesions. The diagnostic accuracy of incorporating the T1 into the KS protocol (T1+KS) was 95.1% and 92.1% for all lesions (ALL) and The American College of Radiology (ACR) Breast Imaging Reporting and Data System (BI-RADS) category 4 lesions, respectively, which was significantly higher than that of either T1 (ALL: 82.8%, P = 0.0001; BI-RADS 4: 78.9%, P = 0.002) or KS (ALL: 90.2%, P = 0.031; BI-RADS 4: 84.2%, P = 0.031) alone. The sensitivity and specificity of T1+KS were also higher than those of the T1 or KS alone. The combined diagnosis could have avoided another 15.6% biopsies compared with using KS alone.

Conclusions

Incorporating T1 into the KS protocol improved both the sensitivity and specificity to differentiate benign and malignant breast lesions, thus avoiding unnecessary invasive procedures.

Assessment of breast lesions by the Kaiser score for differential diagnosis on MRI: the added value of ADC and machine learning modeling

OBJECTIVES

To evaluate the diagnostic performance of Kaiser score (KS) adjusted with the apparent diffusion coefficient (ADC) (KS+) and machine learning (ML) modeling.

METHODS

A dataset of 402 malignant and 257 benign lesions was identified. Two radiologists assigned the KS. If a lesion with KS > 4 had ADC > 1.4 × 10^-3 mm²/s, the KS was reduced by 4 to become KS+. In order to consider the full spectrum of ADC as a continuous variable, the KS and ADC values were used to train diagnostic models using 5 ML algorithms. The performance was evaluated using the ROC analysis, compared by the DeLong test. The sensitivity, specificity, and accuracy achieved using the threshold of KS > 4, KS+ > 4, and ADC ≤ 1.4 × 10^-3 mm²/s were obtained and compared by the McNemar test.

RESULTS

The ROC curves of KS, KS+, and all ML models had comparable AUC in the range of 0.883-0.921, significantly higher than that of ADC (0.837, p < 0.0001). The KS had sensitivity = 97.3% and specificity = 59.1%; and the KS+ had sensitivity = 95.5% with significantly improved specificity to 68.5% (p < 0.0001). However, when setting at the same sensitivity of 97.3%, KS+ could not improve specificity. In ML analysis, the logistic regression model had the best performance. At sensitivity = 97.3% and specificity = 65.3%, i.e., compared to KS, 16 false-positives may be avoided without affecting true cancer diagnosis (p = 0.0015).

CONCLUSION

Using dichotomized ADC to modify KS to KS+ can improve specificity, but at the price of lowered sensitivity. Machine learning algorithms may be applied to consider the ADC as a continuous variable to build more accurate diagnostic models.

KEY POINTS

• When using ADC to modify the Kaiser score to KS+, the diagnostic specificity according to the results of two independent readers was improved by 9.4-9.7%, at the price of slightly degraded sensitivity by 1.5-1.8%, and overall had improved accuracy by 2.6-2.9%. • When the KS and the continuous ADC values were combined to train models by machine learning algorithms, the diagnostic specificity achieved by the logistic regression model could be significantly improved from 59.1 to 65.3% (p = 0.0015), while maintaining at the high sensitivity of KS = 97.3%, and thus, the results demonstrated the potential of ML modeling to further evaluate the contribution of ADC. • When setting the sensitivity at the same levels, the modified KS+ and the original KS have comparable specificity; therefore, KS+ with consideration of ADC may not offer much practical help, and the original KS without ADC remains as an excellent robust diagnostic method.

Can DWI provide additional value to Kaiser score in evaluation of breast lesions

OBJECTIVES

To explore added value of diffusion-weighted imaging (DWI) as an adjunct to Kaiser score (KS) for differentiation of benign from malignant lesions on breast magnetic resonance imaging (MRI).

METHODS

Two hundred forty-six patients with 273 lesions (155 malignancies) were included in this retrospective study from January 2015 to December 2019. All lesions were proved by pathology. Two radiologists blind to pathological results evaluated lesions according to KS. Lesions with score > 4 were considered malignant. Four thresholds of ADC values -1.3 × 10^-3mm²/s, 1.4 × 10^-3mm²/s, 1.53 × 10^-3mm²/s, and 1.6 × 10^-3mm²/s were used to distinguish benign from malignant lesions. For combined diagnosis, a lesion with KS > 4 and ADC values below the preset cutoffs was considered as malignant; otherwise, it was benign. Sensitivity, specificity, and area under the curve (AUC) were compared between KS, DWI, and combined diagnosis.

RESULTS

The AUC of KS was significantly higher than that of DWI alone (0.941 vs 0.901, p = 0.04). The sensitivity of KS (96.8%) and DWI (97.4 - 99.4%) was comparable (p > 0.05) while the specificity of KS (83.9%) was significantly higher than that of DWI (19.5-56.8%) (p < 0.05). Adding DWI as an adjunct to KS resulted in a 0-2.5% increase of specificity and a 0.1-1.3% decrease of sensitivity; however, the difference did not reach statistical significance (p > 0.05).

CONCLUSION

KS showed higher diagnostic performance than DWI alone for discrimination of breast benign and malignant lesions. DWI showed no additional value to KS for characterizing breast lesions.

KEY POINTS

• KS showed higher diagnostic performance than DWI alone for differentiation of benign from breast malignant lesions. • DWI alone showed a high sensitivity but a low specificity for characterizing breast lesions. • Diagnostic performance did not improve using DWI as an adjunct to KS.

Breast MRI: does a clinical decision algorithm outweigh reader experience?

Objectives

Due to its high sensitivity, DCE MRI of the breast (MRIb) is increasingly used for both screening and assessment purposes. The Kaiser score (KS) is a clinical decision algorithm, which formalizes and guides diagnosis in breast MRI and is expected to compensate for lesser reader experience. The aim was to evaluate the diagnostic performance of untrained residents using the KS compared to off-site radiologists experienced in breast imaging using only MR BI-RADS.

Methods

Three off-site, board-certified radiologists, experienced in breast imaging, interpreted MRIb according to the MR BI-RADS scale. The same studies were read by three residents in radiology without prior training in breast imaging using the KS. All readers were blinded to clinical information. Histology was used as the gold standard. Statistical analysis was conducted by comparing the AUC of the ROC curves.

Results

A total of 80 women (median age 52 years) with 93 lesions (32 benign, 61 malignant) were included. The individual within-group performance of the three expert readers (AUC 0.723–0.742) as well as the three residents was equal (AUC 0.842–0.928), p > 0.05, respectively. But, the rating of each resident using the KS significantly outperformed the experts’ ratings using the MR BI-RADS scale (p ≤ 0.05).

Conclusion

The KS helped residents to achieve better results in reaching correct diagnoses than experienced radiologists empirically assigning MR BI-RADS categories in a clinical “problem solving MRI” setting. These results support that reporting breast MRI benefits more from using a diagnostic algorithm rather than expert experience.

Key Points

• Reporting breast MRI benefits more from using a diagnostic algorithm rather than expert experience in a clinical “problem solving MRI” setting.

• The Kaiser score, which provides a clinical decision algorithm for structured reporting, helps residents to reach an expert level in breast MRI reporting and to even outperform experienced radiologists using MR BI-RADS without further formal guidance.

Supplementary Information

The online version contains supplementary material available at 10.1007/s00330-022-09015-8.

A simplified scoring protocol to improve diagnostic accuracy with the breast imaging reporting and data system in breast magnetic resonance imaging

BACKGROUND

The breast imaging reporting and data system (BI-RADS) lexicon provides a standardized terminology for describing leision characteristics but does not provide defined rules for converting specific imaging features into diagnostic categories. The inter-reader agreement of the BI-RADS is moderate. In this study, we explored the use of a simplified protocol and scoring system for BI-RADS categorization which integrates the morphologic features (MF), kinetic time-intensity curve (TIC), and apparent diffusion coefficient (ADC) values with equal weights, with a view to providing a convenient and practical method for breast magnetic resonance imaging (MRI) and improving the inter-reader agreement and diagnostic performance of BI-RADS.

METHODS

This cross-sectional, retrospective, single-center study included 879 patients with 898 histopathologically verified lesions who underwent an MRI scan on a 3.0 Tesla GE Discovery 750 MRI scanner between January 1, 2017, and June 30, 2020. The BI-RADS categorization of the studied lesions was assessed according to the sum of the assigned scores (the presence of malignant MF, lower ADC, and suspicious TIC each warranted a score of +1). Total scores of +2 and +3 were classified as category 5, scores of +1 were classified as category 4, and scores of +0 but with other lesions of interest were classified as category 3. The receiver operating characteristic (ROC) curves were plotted, and the sensitivity, specificity, and accuracy of this categorization were investigated to assess its efficacy and its consistency with pathology.

RESULTS

There were 472 malignant, 104 risk, and 322 benign lesions. Our simplified scoring protocol had high diagnostic accuracy, with an area under curve (AUC) value of 0.896. In terms of the borderline effect of pathological risk and category 4 lesions, our results showed that when risk lesions were classified together with malignant ones, the AUC value improved (0.876 vs. 0.844 and 0.909 vs. 0.900). When category 4 and 5 lesions were classified as malignant, the specificity, accuracy, and AUC value decreased (82.3% vs. 93.2%, 89.3% vs. 90.2%, and 0.876 vs. 0.909, respectively). Therefore, to improve the diagnostic accuracy of the protocol for BI-RADS categorization, only category 5 lesions should be considered to be malignant.

CONCLUSIONS

Our simplified scoring protocol that integrates MF, TIC, and ADC values with equal weights for BI-RADS categorization could improve both the diagnostic performance of the protocol for BI-RADS categorization in clinical practice and the understanding of the benign-risk-malignant breast diseases.

Evidence-Based and Structured Diagnosis in Breast MRI using the Kaiser Score

BACKGROUND

 Breast MRI is the most sensitive method for the detection of breast cancer and is an integral part of modern breast imaging. On the other hand, interpretation of breast MRI exams is considered challenging due to the complexity of the available information. Clinical decision rules that combine diagnostic criteria in an algorithm can help the radiologist to read breast MRI by supporting objective and largely experience-independent diagnosis.

METHOD

 Narrative review. In this article, the Kaiser Score (KS) as a clinical decision rule for breast MRI is introduced, its diagnostic criteria are defined, and strategies for clinical decision making using the KS are explained and discussed.

RESULTS

 The KS is based on machine learning and has been independently validated by international research. It is largely independent of the examination technique that is used. It allows objective differentiation between benign and malignant contrast-enhancing breast MRI findings using diagnostic BI-RADS criteria taken from T2w and dynamic contrast-enhanced T1w images. A flowchart guides the reader in up to three steps to determine a score corresponding to the probability of malignancy that can be used to assign a BI-RADS category. Individual decision making takes the clinical context into account and is illustrated by typical scenarios.

KEY POINTS

· The KS as an evidence-based decision rule to objectively distinguish benign from malignant breast lesions is based on information contained in T2w und dynamic contrast-enhanced T1w sequences and is largely independent of specific examination protocols.. · The KS diagnostic criteria are in line with the MRI BI-RADS lexicon. We focused on defining a default category to be applied in the case of equivocal imaging criteria.. · The KS reflects increasing probabilities of malignancy and, together with the clinical context, assists individual decision making..

CITATION FORMAT

· Baltzer PA, Krug KB, Dietzel M. Evidence-Based and Structured Diagnosis in Breast MRI using the Kaiser Score. Fortschr Röntgenstr 2022; DOI: 10.1055/a-1829-5985.

Evaluation of Ultrasound Elastography Combined With Chi-Square Automatic Interactive Detector in Reducing Unnecessary Fine-Needle Aspiration on TIRADS 4 Thyroid Nodules

Background

Conventional ultrasound diagnosis of thyroid nodules (TNs) had a high false-positive rate, resulting in many unnecessary fine-needle aspirations (FNAs).

Objective

This study aimed to establish a simple algorithm to reduce unnecessary FNA on TIRADS 4 TNs using different quantitative parameters of ultrasonic elasticity and chi-square automatic interactive detector (CHAID) method.

Methods

From January 2020 to May 2021, 432 TNs were included in the study, which were confirmed by FNA or surgical pathology. Each TN was examined using conventional ultrasound, sound touch elastography, and Shell measurement function. The quantitative parameters E and E_shell were recorded, and the E_shell/E values were calculated for each TN. The diagnostic performance of the quantitative parameters was evaluated using the receiver operating characteristic curves. The CHAID was used to classify and analyze the quantitative parameters, and the prediction model was established.

Results

A total of 226 TNs were malignant and 206 were benign. E_shell and E_shell/E ratio were included in the classification algorithm, which showed a depth of two ramifications (E_shell/E ≤ 0.988 or 0.988–1.043 or >1.043; if E_shell/E ≤ 0.988, then E_shell ≤ 64.0 or 64.0–74.0 or >74.0; if E_shell/E = 0.988–1.043, then E_shell ≤ 66.0 or > 66.0; if E_shell/E >1.043, then E_shell ≤ 69.0 or >69.0). The unnecessary FNAs could have been avoided in 57.3% of the cases using this algorithm.

Conclusion

The prediction model using quantitative parameters had high diagnostic performance; it could quickly distinguish benign lesions and avoid subjective influence to some extent.

A Comparative Assessment of MR BI-RADS 4 Breast Lesions With Kaiser Score and Apparent Diffusion Coefficient Value

Objectives

To investigate the diagnostic performance of the Kaiser score and apparent diffusion coefficient (ADC) to differentiate Breast Imaging Reporting and Data System (BI-RADS) Category 4 lesions at dynamic contrast-enhanced (DCE) MRI.

Methods

This was a single-institution retrospective study of patients who underwent breast MRI from March 2020 to June 2021. All image data were acquired with a 3-T MRI system. Kaiser score of each lesion was assigned by an experienced breast radiologist. Kaiser score+ was determined by combining ADC and Kaiser score. Receiver operating characteristic (ROC) curve analysis was performed to evaluate the diagnostic performance of Kaiser score+, Kaiser score, and ADC. The area under the curve (AUC) values were calculated and compared by using the Delong test. The differences in sensitivity and specificity between different indicators were determined by the McNemar test.

Results

The study involved 243 women (mean age, 43.1 years; age range, 18-67 years) with 268 MR BI-RADS 4 lesions. Overall diagnostic performance for Kaiser score (AUC, 0.902) was significantly higher than for ADC (AUC, 0.81; p = 0.004). There were no significant differences in AUCs between Kaiser score and Kaiser score+ (p = 0.134). The Kaiser score was superior to ADC in avoiding unnecessary biopsies (p < 0.001). Compared with the Kaiser score alone, the specificity of Kaiser score+ increased by 7.82%, however, at the price of a lower sensitivity.

Conclusion

For MR BI-RADS category 4 breast lesions, the Kaiser score was superior to ADC mapping regarding the potential to avoid unnecessary biopsies. However, the combination of both indicators did not significantly contribute to breast cancer diagnosis of this subgroup.

Magnetic resonance imaging in diagnosis of indeterminate breast (BIRADS 3 & 4A) in a general population

OBJECTIVE

Currently, mammography and ultrasonography are the most used imaging techniques for breast cancer screening. However, these examinations report many indeterminate studies with a low probability of being malignant, i.e., BIRADS 3 and 4A. This prospective study aims to evaluate the value of breast magnetic resonance imaging (MRI) to clarify the BIRADS categorization of indeterminate mammography or ultrasonography studies.

METHODS

MRI studies acquired prospectively from 105 patients previously classified as BIRADS 3 or 4A were analyzed independently by four radiologists with different experience levels. Interobserver agreement was determined by the first-order agreement coefficient (AC1), and divergent results were re-analyzed for consensus. The possible correlation between the MRI and the mammography/ultrasound findings was evaluated, and each study was independently classified in one of the five BIRADS categories (BIRADS 1 to 5). In lesions categorized as BIRADS 4 or 5 at MRI, histopathological diagnosis was established by image-guided biopsy; while short-term follow-up was performed in lesions rated as BIRADS 3.

RESULTS

Breast MRI was useful in diagnosing three invasive ductal carcinomas, upgraded from BIRADS 4A to BIRADS 5. It also allowed excluding malignancy in 86 patients (81.9%), avoiding 22 unnecessary biopsies and 64 short-term follow-ups. The MRI showed good diagnostic performance with the area under roc curve, sensitivity, specificity, PPV, and NPV of 0.995, 100%, 83.5%, 10.5%, and 100%, respectively.

CONCLUSIONS

MRI showed to be useful as a problem-solving tool to clarify indeterminate findings in breast cancer screening and avoiding unnecessary short-follow-ups and percutaneous biopsies.

A Multicentric Comparison of Apparent Diffusion Coefficient Mapping and the Kaiser Score in the Assessment of Breast Lesions

MATERIALS AND METHODS

In this multicentric study, individual patient data from 3 different centers were analyzed. Consecutive patients receiving standardized multiparametric breast magnetic resonance imaging for standard nonscreening indications were included. At each center, 2 experienced radiologists with more than 5 years of experience retrospectively interpreted the examinations in consensus and applied the KS to every histologically verified lesion. The corresponding mean ADC of each lesion was measured using a Wielema type 4 region of interest. According to established methods, the KS and ADC were combined, yielding the KS+ score. Diagnostic accuracy was evaluated by the area under the receiver operating characteristics curve (AUROC) and compared between the KS, ADC, and KS+ (DeLong test). Likewise, the potential to help avoid unnecessary biopsies was compared between the KS, ADC, and KS+ based on established high sensitivity thresholds (McNemar test).

RESULTS

A total of 450 lesions in 414 patients (mean age, 51.5 years; interquartile range, 42-60.8 years) were included, with 219 lesions being malignant (48.7%; 95% confidence interval [CI], 44%-53.4%). The performance of the KS (AUROC, 0.915; CI, 0.886-0.939) was significantly better than that of the ADC (AUROC, 0.848; CI, 0.811-0.880; P < 0.001). The largest difference between these parameters was observed when assessing subcentimeter lesions (AUROC, 0.909 for KS; CI, 0.849-0.950 vs 0.811 for ADC; CI, 0.737-0.871; P = 0.02).The use of the KS+ (AUROC, 0.918; CI, 0.889-0.942) improved the performance slightly, but without any significant difference relative to a single KS or ADC reading (P = 0.64).When applying high sensitivity thresholds for avoiding unnecessary biopsies, the KS and ADC achieved equal sensitivity (97.7% for both; cutoff values, >4 for KS and ≤1.4 × 10-3 mm2/s for ADC). However, the rate of potentially avoidable biopsies was higher when using the KS (specificity: 65.4% for KS vs 32.9% for ADC; P < 0.0001). The KS was superior to the KS+ in avoiding unnecessary biopsies.

CONCLUSIONS

Both the KS and ADC may be used to distinguish benign from malignant breast lesions. However, KS proved superior in this task including, most of all, when assessing small lesions less than 1 cm. Using the KS may avoid twice as many unnecessary biopsies, and the combination of both the KS and ADS does not improve diagnostic performance.

Diffusion-weighted Imaging Allows for Downgrading MR BI-RADS 4 Lesions in Contrast-enhanced MRI of the Breast to Avoid Unnecessary Biopsy

PURPOSE

Diffusion-weighted imaging with the calculation of an apparent diffusion coefficient (ADC) has been proposed as a quantitative biomarker on contrast-enhanced MRI (CE-MRI) of the breast. There is a need to approve a generalizable ADC cutoff. The purpose of this study was to evaluate whether a predefined ADC cutoff allows downgrading of BI-RADS 4 lesions on CE-MRI, avoiding unnecessary biopsies.

EXPERIMENTAL DESIGN

This was a retrospective, multicentric, cross-sectional study. Data from five centers were pooled on the individual lesion level. Eligible patients had a BI-RADS 4 rating on CE-MRI. For each center, two breast radiologists evaluated the images. Data on lesion morphology (mass, non-mass), size, and ADC were collected. Histology was the standard of reference. A previously suggested ADC cutoff (≥1.5 × 10-3 mm2/second) was applied. A negative likelihood ratio of 0.1 or lower was considered as a rule-out criterion for breast cancer. Diagnostic performance indices were calculated by ROC analysis.

RESULTS

There were 657 female patients (mean age, 42; SD, 14.1) with 696 BI-RADS 4 lesions included. Disease prevalence was 59.5% (414/696). The area under the ROC curve was 0.784. Applying the investigated ADC cutoff, sensitivity was 96.6% (400/414). The potential reduction of unnecessary biopsies was 32.6% (92/282).

CONCLUSIONS

An ADC cutoff of ≥1.5 × 10-3 mm2/second allows downgrading of lesions classified as BI-RADS 4 on breast CE-MRI. One-third of unnecessary biopsies could thus be avoided.

An A.I. classifier derived from 4D radiomics of dynamic contrast-enhanced breast MRI data: potential to avoid unnecessary breast biopsies

Objectives

Due to its high sensitivity, DCE MRI of the breast (bMRI) is increasingly used for both screening and assessment purposes. The high number of detected lesions poses a significant logistic challenge in clinical practice. The aim was to evaluate a temporally and spatially resolved (4D) radiomics approach to distinguish benign from malignant enhancing breast lesions and thereby avoid unnecessary biopsies.

Methods

This retrospective study included consecutive patients with MRI-suspicious findings (BI-RADS 4/5). Two blinded readers analyzed DCE images using a commercially available software, automatically extracting BI-RADS curve types and pharmacokinetic enhancement features. After principal component analysis (PCA), a neural network–derived A.I. classifier to discriminate benign from malignant lesions was constructed and tested using a random split simple approach. The rate of avoidable biopsies was evaluated at exploratory cutoffs (C₁, 100%, and C₂, ≥ 95% sensitivity).

Results

Four hundred seventy (295 malignant) lesions in 329 female patients (mean age 55.1 years, range 18–85 years) were examined. Eighty-six DCE features were extracted based on automated volumetric lesion analysis. Five independent component features were extracted using PCA. The A.I. classifier achieved a significant (p < .001) accuracy to distinguish benign from malignant lesion within the test sample (AUC: 83.5%; 95% CI: 76.8–89.0%). Applying identified cutoffs on testing data not included in training dataset showed the potential to lower the number of unnecessary biopsies of benign lesions by 14.5% (C₁) and 36.2% (C₂).

Conclusion

The investigated automated 4D radiomics approach resulted in an accurate A.I. classifier able to distinguish between benign and malignant lesions. Its application could have avoided unnecessary biopsies.

Key Points

• Principal component analysis of the extracted volumetric and temporally resolved (4D) DCE markers favored pharmacokinetic modeling derived features.

• An A.I. classifier based on 86 extracted DCE features achieved a good to excellent diagnostic performance as measured by the area under the ROC curve with 80.6% (training dataset) and 83.5% (testing dataset).

• Testing the resulting A.I. classifier showed the potential to lower the number of unnecessary biopsies of benign breast lesions by up to 36.2%, p < .001 at the cost of up to 4.5% (n = 4) false negative low-risk cancers.

Supplementary Information

The online version contains supplementary material available at 10.1007/s00330-021-07787-z.

Diagnostic performance of the Kaiser score for characterizing lesions on breast MRI with comparison to a multiparametric classification system

PURPOSE

To determine the diagnostic performance of the Kaiser score and to compare it with the BI-RADS-based multiparametric classification system (MCS).

METHOD

Two breast radiologists, blinded to the clinical and pathological information, separately evaluated a database of 499 consecutive patients with structural 3.0 T breast MRI and 697 histopathologically verified lesions. The Kaiser scores and corresponding MCS categories were recorded. The sensitivity and specificity of the Kaiser score and the MCS categories to differentiate benign from malignant lesions were calculated. The interobserver reproducibility and receiver operating characteristic (ROC) parameters were analysed.

RESULTS

The sensitivity and specificity of the MCS were 100 % and 12 %, respectively, and those of the Kaiser score were 98.5 % and 34.8 % for reader 1 and 98.7 % and 47.5 % for reader 2. The area under the ROC-curve was 85.9 and 87.6 for readers 1 and 2. The interobserver intraclass correlation coefficient was excellent at 0.882. Reader 1 upgraded six lesions from BI-RADS 3 to a Kaiser score of >4, and reader 2 upgraded seven lesions. When applying the Kaiser score to 158 benign lesions readers 1 and 2 would have reduced the biopsy rate by 22.8 % and 35.4 %, respectively.

CONCLUSIONS

The Kaiser score showed high diagnostic accuracy with excellent interobserver reproducibility. The MCS had perfect sensitivity but low specificity. Although the Kaiser score had slightly lower sensitivity, its specificity was 3-4 times greater than that of the MCS. Thus, the Kaiser score has the potential to considerably reduce the biopsy rate for true negative lesions.

Correct determination of the enhancement curve is critical to ensure accurate diagnosis using the Kaiser score as a clinical decision rule for breast MRI

OBJECTIVES

the Kaiser score is increasingly recognized as a valuable tool to improve breast MRI interpretation. Contrast enhancement kinetics are the second most important diagnostic criterion, thus defining the curve type plays a crucial role in Kaiser score assessment. We investigate whether the timepoint used to determine the initial enhancement (earlyor peak) for the signal-intensity time curve analysis affects the diagnostic performance of the Kaiser score.

METHODS

This IRB-approved, retrospective, single-center study included 70 consecutives histologically verified breast MRI cases. Two off-site breast radiologists independently read all examinations using the Kaiser score, assessing the initial enhancement using three approaches: -first (1 st), second (2nd) and peak (maximum) of either 1 st or 2nd post-contrast timepoints. The initial enhancement was then compared to the last timepoint (delayed enhancement) to determine the curve type. Visual assessment of curve types was used for this study. Diagnostic performance was evaluated by receiver operating characteristics (ROC) analysis.

RESULTS

Kaiser score reading results using the peak enhancement of either the first or second timepoint performed significantly better than the other approaches (P < 0.05, respectively) and specifically achieved higher sensitivity. Diagnostic accuracy (AUC area under the curve) ranged between 85.4 % and 91.6 %, without significant differences between the two readers (P < 0.5).

CONCLUSIONS

Diagnostic performance of the Kaiser score is significantly influenced by how the initial enhancement timepoint is determined. Peak enhancement should be used as initial timepoint to avoid pitfalls due to timing or physiological differences.

[Artificial intelligence in breast imaging : Areas of application from a clinical perspective]

Klinisches/methodisches Problem

Bei der Mammadiagnostik gilt es, klinische sowie multimodal bildgebende Informationen mit perkutanen und operativen Eingriffen zu koordinieren. Aus dieser Komplexität entsteht eine Reihe von Problemen: übersehene Karzinome, Überdiagnose, falsch-positive Befunde, unnötige weiterführende Bildgebung, Biopsien und Operationen.

Radiologische Standardverfahren

Folgende Untersuchungsverfahren werden in der Mammadiagnostik eingesetzt: Röntgenmammographie, Tomosynthese, kontrastangehobene Mammographie, (multiparametrischer) Ultraschall, Magnetresonanztomographie, Computertomographie, nuklearmedizinische Verfahren sowie deren Hybridvarianten.

Methodische Innovationen

Künstliche Intelligenz (KI) verspricht Abhilfe bei praktisch allen Problemen der Mammadiagnostik. Potenziell lassen sich Fehlbefunde vermeiden, bildgebende Verfahren effizienter einsetzen und möglicherweise auch biologische Phänotypen von Mammakarzinomen definieren.

Leistungsfähigkeit

Auf KI basierende Software wird für zahlreiche Anwendungen entwickelt. Am weitesten fortgeschritten sind Systeme für das Screening mittels Mammographie. Probleme sind monozentrische sowie kurzfristig am finanziellen Erfolg orientierte Ansätze.

Bewertung

Künstliche Intelligenz (KI) verspricht eine Verbesserung der Mammadiagnostik. Durch die Vereinfachung von Abläufen, die Reduktion monotoner und ergebnisloser Tätigkeiten und den Hinweis auf mögliche Fehler ist eine Beschleunigung von dann weitgehend fehlerfreien Abläufen denkbar.

Empfehlung für die Praxis

In diesem Beitrag werden die Anforderungen der Mammadiagnostik und mögliche Einsatzgebiete der der KI beleuchtet. Je nach Definition gibt es bereits praktisch anwendbare Softwaretools für die Mammadiagnostik. Globale Lösungen stehen allerdings noch aus.

Application of the Kaiser score to increase diagnostic accuracy in equivocal lesions on diagnostic mammograms referred for MR mammography

INTRODUCTION

We aimed to interpret MR mammography (MRM) using the Kaiser scores for equivocal or inconclusive lesions on mammography (MG).

METHODS

Retrospective IRB-approved evaluation of 3623 MG for which MRM was deployed as a problem-solving tool, after inclusion-exclusion criteria were met. Three readers with different levels of experience assigned a final score from 1 to 11 based on the previously established tree classification system. Area under the curve (AUC) derived from receiver operating characteristic (ROC) analysis was used to determine the overall diagnostic performance for all lesions and separately for mass and non-mass enhancement. Sensitivity, specificity, and likelihood ratio values were obtained at different cut-off values of >4, > 5, and > 8 to rule in and rule out malignancy.

RESULT

Histopathology of 183 mass and 133 non-mass enhancement (NME) lesions show benign etiology in 95 and malignant in 221. The AUC was 0.796 [0.851 for mass and 0.715 for NME]. Applying the Kaiser score upgraded 202 lesions with correct prediction in 77 %, and downgraded 28 lesions with correct prediction in 60.8 %. Using a score <5 instead of <4 to rule out malignancy improved our diagnostic ability to correctly identify 100 % benign lesions. Applying Kaiser score correctly downgraded 60.8 % (17/28) lesions; thus avoiding biopsies in these. Using a high cut-off value>8 to rule-in malignancy, we correctly identified 59.7 % of lesions with 80 % specificity and positive likelihood ratio of 3.

CONCLUSION

The Kaiser score has clinical translation benefits when used as a problem-solving tool for inconclusive MG findings.

[Kaiser score for diagnosis of breast lesions presenting as non-mass enhancement on MRI]

OBJECTIVE

To evaluate the diagnostic efficacy of Kaiser score for breast lesions presenting as non-mass enhancement.

METHODS

We collected data from patients with breast lesions presenting as non-mass enhancement on preoperative DCE-MRI between January, 2014 and June, 2019. All the cases were confirmed by surgical pathology or puncture biopsy. With pathology results as the gold standard, we evaluated the diagnostic efficacy of Kaiser score and MRI BI-RADS classification and the consistency between the diagnostic results by the two methods and the pathological results.

RESULTS

A total of 90 lesions were detected in 88 patients, including 28 benign lesions (31.1%) and 62 malignant lesions (68.9%). For diagnosis of the lesions, the sensitivity, specificity, positive predictive value, negative predictive value and accuracy of Kaiser Score were 100%, 75%, 89.9%, 100% and 92%, as compared with 93.5%, 46.4%, 79.5%, 76.5% and 78.9% of MRI BI-RADS, respectively. The diagnostic specificity of Kaiser score was significantly higher than that of BI-RADS classification (P=0.021).

CONCLUSIONS

The Kaiser score system provides a diagnostic strategy for BI-RADS classification of breast lesions with non-mass enhancement and has a better diagnostic efficacy than BI-RADS classification alone. The use of Kaiser score can significantly improve the diagnostic specificity of such breast lesions for inexperienced radiologists.

Subcategory classifications of Breast Imaging and Data System (BI-RADS) category 4 lesions on MRI

PURPOSE

Category 4 in BI-RADS for magnetic resonance imaging (MRI) has a wide range of probabilities of malignancy, extending from > 2 to < 95%. We classified category 4 lesions into three subcategories and analyzed the positive predictive value (PPV) of malignancy in a tertiary hospital.

MATERIALS AND METHODS

This retrospective study included 346 breast MRIs with 434 category 2-5 lesions. All enhancing lesions were classified as category 2 (0% probability of malignancy), 3 (> 0%, ≤ 2%), 4 (> 2%, < 95%) and 5 (≥ 95%); category 4 lesions were further subcategorized into 4A (> 2%, ≤ 10%), 4B (> 10%, ≤ 50%) and 4C (> 50%, < 95%) at the time of diagnosis. Radiological and pathological reports were retrospectively analyzed, and the PPVs were calculated.

RESULTS

We included 149 malignant and 285 benign lesions. The PPVs of subcategories 4A, 4B and 4C were 1.8%, 11.8% and 67.5%, respectively. The PPVs were higher for lesions coexisting with category 5 or 6 lesions compared with those for isolated lesions.

CONCLUSION

Category 4 lesions can be classified into three subcategories depending on the likelihood of malignancy. Lesions coexisting with category 5 or 6 lesions are more likely to be malignant.

The Kaiser score reliably excludes malignancy in benign contrast-enhancing lesions classified as BI-RADS 4 on breast MRI high-risk screening exams

OBJECTIVES

MRI is an integral part of breast cancer screening in high-risk patients. We investigated whether the application of the Kaiser score, a clinical decision-support tool, may be used to exclude malignancy in contrast-enhancing lesions classified as BI-RADS 4 on breast MRI screening exams.

METHODS

This retrospective study included 183 consecutive, histologically proven, suspicious (MR BI-RADS 4) lesions detected within our local high-risk screening program. All lesions were evaluated according to the Kaiser score for breast MRI by three readers blinded to the final histopathological diagnosis. The Kaiser score ranges from 1 (lowest, cancer very unlikely) to 11 (highest, cancer very likely) and reflects increasing probabilities of malignancy, with scores greater than 4 requiring biopsy. Receiver operating characteristic (ROC) curve analysis was used to evaluate diagnostic accuracy.

RESULTS

There were 142 benign and 41 malignant lesions, diagnosed in 159 patients (mean age, 43.6 years). Median Kaiser scores ranged between 2 and 5 in benign and 7 and 8 in malignant lesions. For all lesions, the Kaiser score's accuracy, represented by the area under the curve (AUC), ranged between 86.5 and 90.2. The sensitivity of the Kaiser score was high, between 95.1 and 97.6% for all lesions, and was best in mass lesions. Application of the Kaiser score threshold for malignancy (≤ 4) could have potentially avoided 64 (45.1%) to 103 (72.5%) unnecessary biopsies in 142 benign lesions previously classified as BI-RADS 4.

CONCLUSIONS

The use of Kaiser score in high-risk MRI screening reliably excludes malignancy in more than 45% of contrast-enhancing lesions classified as BI-RADS 4.

KEY POINTS

• The Kaiser score shows high diagnostic accuracy in identifying malignancy in contrast-enhancing lesions in patients undergoing high-risk screening for breast cancer. • The application of the Kaiser score may avoid > 45% of unnecessary breast biopsies in high-risk patients. • The Kaiser score aids decision-making in high-risk breast cancer MRI screening programs.

Impact of the Kaiser score on clinical decision-making in BI-RADS 4 mammographic calcifications examined with breast MRI

OBJECTIVES

To investigate whether the application of the Kaiser score for breast magnetic resonance imaging (MRI) might downgrade breast lesions that present as mammographic calcifications and avoid unnecessary breast biopsies METHODS: This IRB-approved, retrospective, cross-sectional, single-center study included 167 consecutive patients with suspicious mammographic calcifications and histopathologically verified results. These patients underwent a pre-interventional breast MRI exam for further diagnostic assessment before vacuum-assisted stereotactic-guided biopsy (95 malignant and 72 benign lesions). Two breast radiologists with different levels of experience independently read all examinations using the Kaiser score, a machine learning-derived clinical decision-making tool that provides probabilities of malignancy by a formalized combination of diagnostic criteria. Diagnostic performance was assessed by receiver operating characteristics (ROC) analysis and inter-reader agreement by the calculation of Cohen's kappa coefficients.

RESULTS

Application of the Kaiser score revealed a large area under the ROC curve (0.859-0.889). Rule-out criteria, with high sensitivity, were applied to mass and non-mass lesions alike. The rate of potentially avoidable breast biopsies ranged between 58.3 and 65.3%, with the lowest rate observed with the least experienced reader.

CONCLUSIONS

Applying the Kaiser score to breast MRI allows stratifying the risk of breast cancer in lesions that present as suspicious calcifications on mammography and may thus avoid unnecessary breast biopsies.

KEY POINTS

• The Kaiser score is a helpful clinical decision tool for distinguishing malignant from benign breast lesions that present as calcifications on mammography. • Application of the Kaiser score may obviate 58.3-65.3% of unnecessary stereotactic biopsies of suspicious calcifications. • High Kaiser scores predict breast cancer with high specificity, aiding clinical decision-making with regard to re-biopsy in case of negative results.

Implementation of machine learning into clinical breast MRI: Potential for objective and accurate decision-making in suspicious breast masses

We investigated whether the integration of machine learning (ML) into MRI interpretation can provide accurate decision rules for the management of suspicious breast masses. A total of 173 consecutive patients with suspicious breast masses upon complementary assessment (BI-RADS IV/V: n = 100/76) received standardized breast MRI prior to histological verification. MRI findings were independently assessed by two observers (R1/R2: 5 years of experience/no experience in breast MRI) using six (semi-)quantitative imaging parameters. Interobserver variability was studied by ICC (intraclass correlation coefficient). A polynomial kernel function support vector machine was trained to differentiate between benign and malignant lesions based on the six imaging parameters and patient age. Ten-fold cross-validation was applied to prevent overfitting. Overall diagnostic accuracy and decision rules (rule-out criteria) to accurately exclude malignancy were evaluated. Results were integrated into a web application and published online. Malignant lesions were present in 107 patients (60.8%). Imaging features showed excellent interobserver variability (ICC: 0.81–0.98) with variable diagnostic accuracy (AUC: 0.65–0.82). Overall performance of the ML algorithm was high (AUC = 90.1%; BI-RADS IV: AUC = 91.6%). The ML algorithm provided decision rules to accurately rule-out malignancy with a false negative rate <1% in 31.3% of the BI-RADS IV cases. Thus, integration of ML into MRI interpretation can provide objective and accurate decision rules for the management of suspicious breast masses, and could help to reduce the number of potentially unnecessary biopsies.

Limited role of DWI with apparent diffusion coefficient mapping in breast lesions presenting as non-mass enhancement on dynamic contrast-enhanced MRI

BACKGROUND

Available data proving the value of DWI for breast cancer diagnosis is mainly for enhancing masses; DWI may be less sensitive and specific in non-mass enhancement (NME) lesions. The objective of this study was to assess the diagnostic accuracy of DWI using different ROI measurement approaches and ADC metrics in breast lesions presenting as NME lesions on dynamic contrast-enhanced (DCE) MRI.

METHODS

In this retrospective study, 95 patients who underwent multiparametric MRI with DCE and DWI from September 2007 to July 2013 and who were diagnosed with a suspicious NME (BI-RADS 4/5) were included. Twenty-nine patients were excluded for lesion non-visibility on DWI (n = 24: 12 benign and 12 malignant) and poor DWI quality (n = 5: 1 benign and 4 malignant). Two readers independently assessed DWI and DCE-MRI findings in two separate randomized readings using different ADC metrics and ROI approaches. NME lesions were classified as either benign (> 1.3 × 10^-3 mm²/s) or malignant (≤ 1.3 × 10^-3 mm²/s). Histopathology was the standard of reference. ROC curves were plotted, and AUCs were determined. Concordance correlation coefficient (CCC) was measured.

RESULTS

There were 39 malignant (59%) and 27 benign (41%) lesions in 66 (65 women, 1 man) patients (mean age, 51.8 years). The mean ADC value of the darkest part of the tumor (Dptu) achieved the highest diagnostic accuracy, with AUCs of up to 0.71. Inter-reader agreement was highest with Dptu ADC max (CCC 0.42) and lowest with the point tumor (Ptu) ADC min (CCC = - 0.01). Intra-reader agreement was highest with Wtu ADC mean (CCC = 0.44 for reader 1, 0.41 for reader 2), but this was not associated with the highest diagnostic accuracy.

CONCLUSIONS

Diagnostic accuracy of DWI with ADC mapping is limited in NME lesions. Thirty-one percent of lesions presenting as NME on DCE-MRI could not be evaluated with DWI, and therefore, DCE-MRI remains indispensable. Best results were achieved using Dptu 2D ROI measurement and ADC mean.

Associations Between Magnetic Resonance Imaging Findings and Clincopathologic Factors in Triple-Negative Breast Cancer

OBJECTIVE

The aim of the study was to evaluate the magnetic resonance imaging findings associated with clinicopathologic factors in patients with triple-negative breast cancer.

METHODS

One hundred one patients with surgically confirmed triple-negative breast cancer who underwent preoperative breast magnetic resonance imaging with diffusion-weighted imaging (DWI) were included in this study. Presence of rim enhancement on contrast-enhanced T1-weighted imaging and hyperintense rim on DWI were visually assessed. Pathologic data about presence of recurrence and presence of lymphovascular invasion (LVI) were reviewed. Statistics for relative risk of recurrence carried out.

RESULTS

Of the 101, 13 cases (12.9%) were recurred after a median follow-up of 18.5 months. Rim enhancement was more frequently seen in the LVI-positive group (P = 0.046). Hyperintense rim on DWI and apparent diffusion coefficient values showed no significant relationship with clinical-pathologic factors.

CONCLUSIONS

Rim enhancement was significantly associated with positive LVI status in patients with triple-negative breast cancer. Our study suggests that rim enhancement may be useful to predict the prognosis.

Problem-solving breast MRI: useful or a source of new problems?

PURPOSE

We aimed to evaluate the findings and results from breast magnetic resonance imaging (MRI) examinations performed for problem-solving purposes due to inconclusive conventional imaging findings.

METHODS

Imaging findings, biopsy and follow-up results were retrospectively evaluated for breast MRI performed for problem-solving purposes at our department between January 2011 and December 2016 for cases whose mammography, tomosynthesis, or ultrasonography findings were inconclusive.

RESULTS

Lesions were identified in 414 of 986 problem-solving MRI examinations, and 13.3% of these lesions were diagnosed as malignant. A total of 124 lesions were additionally found by MRI, and 9.7% of these lesions were diagnosed as malignant. MRI produced false-negative results in four cases. In cases whose conventional imaging methods yielded indefinite results, the sensitivity, specificity, negative and positive predictive values of MRI were found to be 96.3%, 83%, 99.3%, and 46.5%, respectively. For the additional lesions identified, the sensitivity, specificity, negative and positive predictive values of MRI were found to be 91.7%, 69%, 98.7%, and 24%, respectively.

CONCLUSION

Breast MRI is a reliable problem-solving method for excluding malignancy that cannot be confirmed by conventional imaging. In such cases, additional findings from MRI may help identify new cancers that cannot be detected with conventional methods. However, it has moderately low specificity which may cause unnecessary biopsies, follow-ups, and anxiety to patients.

Clinical role of breast MRI now and going forward

Magnetic resonance imaging (MRI) is a well-established method in breast imaging, with manifold clinical applications, including the non-invasive differentiation between benign and malignant breast lesions, preoperative staging, detection of scar versus recurrence, implant assessment, and the evaluation of high-risk patients. At present, dynamic contrast-enhanced MRI is the most sensitive imaging technique for breast cancer diagnosis, and provides excellent morphological and to some extent also functional information. To compensate for the limited functional information, and to increase the specificity of MRI while preserving its sensitivity, additional functional parameters such as diffusion-weighted imaging and apparent diffusion coefficient mapping, and MR spectroscopic imaging have been investigated and implemented into the clinical routine. Several additional MRI parameters to capture breast cancer biology are still under investigation. MRI at high and ultra-high field strength and advances in hard- and software may also further improve this imaging technique. This article will review the current clinical role of breast MRI, including multiparametric MRI and abbreviated protocols, and provide an outlook on the future of this technique. In addition, the predictive and prognostic value of MRI as well as the evolving field of radiogenomics will be discussed.

Imaging Phenotypes in Women at High Risk for Breast Cancer on Mammography, Ultrasound, and Magnetic Resonance Imaging Using the Fifth Edition of the Breast Imaging Reporting and Data System

OBJECTIVE

To assess imaging phenotypes of familial breast cancer on mammography (MG), ultrasound (US), and magnetic resonance imaging (MRI) using the fifth edition of the BI-RADS; to investigate inter-observer agreement and to correlate imaging phenotypes with risk status, histopathology, and molecular subtypes derived by immunohistochemical surrogate.

MATERIALS AND METHODS

Forty-nine women (BRCA-1/2 mutation carriers and women with >20% lifetime risk) were diagnosed with breast cancer within our high-risk screening program. BI-RADS MG, US, and MRI imaging descriptors were correlated with risk status, histopathology, and molecular subtypes derived by immunohistochemical surrogate. Inter-rater agreement for BI-RADS MG, US, and MRI categories was assessed.

RESULTS

Fifty-two breast cancers were diagnosed and 98% were detectable in at least one modality. MRI detected more cancers (P < 0.001). No lesion had benign morphology on BI-RADS. BRCA-1 had triple-negative and high-grade tumors in the posterior part and in the upper-outer quadrant (P ≤ 0.01); positive-family-history patients had intermediate-grade neoplasms (P < 0.01) in the middle part (P = 0.04) and in the upper-outer quadrants (P = 0.05). There was moderate inter-rater agreement for the assigned BI-RADS assessment for MG (k = 0.554) and MRI (k = 0.512) and substantial inter-rater agreement for US (k = 0.741).

CONCLUSIONS

Imaging phenotypes of familial breast cancers with BI-RADS are malignant in all imaging modalities. Risk status seems to influence cancer location.

A Simple Ultrasound Based Classification Algorithm Allows Differentiation of Benign from Malignant Breast Lesions by Using Only Quantitative Parameters

Purpose

We hypothesized that different quantitative ultrasound (US) parameters may be used as complementary diagnostic criteria and aimed to develop a simple classification algorithm to distinguish benign from malignant breast lesions and aid in the decision to perform biopsy or not.

Procedures

One hundred twenty-four patients, each with one biopsy-proven, sonographically evident breast lesion, were included in this prospective, IRB-approved study. Each lesion was examined with B-mode US, Color/Power Doppler US and elastography (Acoustic Radiation Force Impulse–ARFI). Different quantitative parameters were recorded for each technique, including pulsatility (PI) and resistive Index (RI) for Doppler US and lesion maximum, intermediate, and minimum shear wave velocity (SWV_max, SWV_interm, and SWV_min) as well as lesion-to-fat SWV ratio for ARFI. Receiver operating characteristic curve (ROC) analysis was used to evaluate the diagnostic performance of each quantitative parameter. Classification analysis was performed using the exhaustive chi-squared automatic interaction detection method. Results include the probability for malignancy for every descriptor combination in the classification algorithm.

Results

Sixty-five lesions were malignant and 59 benign. Out of all quantitative indices, maximum SWV (SWV_max), and RI were included in the classification algorithm, which showed a depth of three ramifications (SWV_max ≤ or > 3.16; if SWV_max ≤ 3.16 then RI ≤ 0.66, 0.66–0.77 or > 0.77; if RI ≤ 0.66 then SWV_max ≤ or > 2.71). The classification algorithm leads to an AUC of 0.887 (95 % CI 0.818–0.937, p < 0.0001), a sensitivity of 98.46 % (95 % CI 91.7–100 %), and a specificity of 61.02 % (95 % CI 47.4–73.5 %). By applying the proposed algorithm, a false-positive biopsy could have been avoided in 61 % of the cases.

Conclusions

A simple classification algorithm incorporating two quantitative US parameters (SWV_max and RI) shows a high diagnostic performance, being able to accurately differentiate benign from malignant breast lesions and lower the number of unnecessary breast biopsies in up to 60 % of all cases, avoiding any subjective interpretation bias.