A Comparative Assessment of MR BI-RADS 4 Breast Lesions With Kaiser Score and Apparent Diffusion Coefficient Value

Diagnostic performance of Kaiser score in the evaluation of breast cancer using MRI: A systematic review and meta-analysis

PURPOSE

To assess the performance of Kaiser score (KS) in detecting and characterizing breast cancer on magnetic resonance imaging (MRI).

METHODS

The protocol was pre-registered at (https://osf.io/83c6j/). We performed a comprehensive search in PubMed, Embase, Cochrane Library, and Web of Science until 30 October 2024 for studies that used KS for detection of breast cancer on MRI. The risk of bias in the included studies was evaluated utilizing Quality Assessment of Diagnostic Accuracy Studies 2 (QUADAS-2). Diagnostic values of area under the curve (AUC), sensitivity, specificity, positive and negative likelihood ratios, and diagnostic odds ratio were calculated using a random-effects bivariate model. Meta-regression was used to explore the source of heterogeneity when I2 was ≥ 50 %. P-value < 0.05 was considered statistically significant.

RESULTS

A total of 29 studies with 7918 patients and 8451 breast lesions were included. The pooled sensitivity, specificity, and AUC of KS for detecting malignant breast lesions on MRI were 95 % (95 % CI = 94 % to 96 %), 70 % (95 % CI = 64 % to 75 %), and 0.94 (95 % CI = 0.91 to 0.96), while for Breast Imaging Reporting and Data System (BI-RADS), they were 97 % (95 % CI = 92 % to 99 %), 46 % (95 % CI = 30 % to 62 %), and 0.89 (95 % CI = 0.86 to 0.91). Sensitivity difference was not statistically significant (p-value = 0.803), but specificity difference was significant (p-value = 0.001). Also, KS demonstrated slightly better diagnostic accuracy for mass lesions with a sensitivity of 96 % (95 % CI = 94 % to 97 %), specificity of 69 % (95 % CI = 60 % to 77 %), and AUC of 0.96 (95 % CI = 0.94 to 0.97) compared to non-mass lesions with 93 % (95 % CI = 88 % to 96 %), 68 % (95 % CI = 58 % to 77 %), and 0.91 (95 % CI = 0.88 to 0.94) values, respectively. KS showed better performance in larger lesions.

CONCLUSION

The KS's superior diagnostic performance compared to BI-RADS, particularly its ability to avoid unnecessary biopsies, makes it valuable for diagnostic and clinical decision-making.

Can structured integration of BI-RADS criteria by a clinical decision rule reduce the number of unnecessary biopsies in BI-RADS 4 lesions? A systematic review and meta-analysis

AIM

This systematic review and meta-analysis investigate the added value of structured integration of Breast Imaging Reporting and Data System (BI-RADS) criteria using the Kaiser score (KS) to avoid unnecessary biopsies in BI-RADS 4 lesions.

MATERIAL AND METHODS

A systematic review and meta-analysis were conducted using predefined criteria. Eligible articles, published in English until May 2024, dealt with KS in the context of BI-RADS 4 MRI. Two reviewers extracted study characteristics, including true positives (TP), false positives (FP), true negatives (TN), and false negatives (FN). Sensitivity, specificity, negative likelihood ratio, and positive likelihood ratio were calculated using bivariate random effects. Fagan nomograms identified the maximum pre-test probability at which post-test probabilities of a negative MRI aligned with the 2% malignancy rate benchmark for downgrading BI-RADS 4 to BI-RADS 3. I² statistics and meta-regression explored sources of heterogeneity. p-values < 0.05 were considered significant.

RESULTS

Seven studies with 1877 lesions (833 malignant, 1044 benign) were included. The average breast cancer prevalence was 47.3%. Pooled sensitivity was 94.3% (95%-CI 88.9%-97.1%), and pooled specificity was 68.1% (95%-CI 56.6%-77.7%) using a random effects model. Overall, 52/833 cases were FNs (6.2%). Fagan nomograms showed that KS could rule out breast cancer in BI-RADS 4 lesions at a pre-test probability of 20.3% for all lesions, 25.4% for masses, and 15.2% for non-mass lesions.

CONCLUSIONS

In MRI-assessed BI-RADS 4 lesions, applying structured BI-RADS criteria with the KS reduces unnecessary biopsies by 70% with a 6.2% FN rate. Breast cancer can be ruled out up to pre-test probabilities of 20.3%.

KEY POINTS

Question What, if any, value is added by structured integration of BI-RADS criteria using the Kaiser Score (KS) to avoid unnecessary biopsies in BI-RADS 4 lesions? Findings The structured integration of BI-RADS criteria using the Kaiser Score (KS) reduces unnecessary biopsies in BI-RADS 4 lesions by 70%. Clinical relevance The structured approach offered by the Kaiser Score (KS) avoids unnecessary recalls, potentially reducing patient anxiety, lessening the burden on medical personnel, and the need for further imaging and biopsies due to more objective and thus efficient clinical decision-making in evaluating BI-RADS 4 lesions.

What Is the Added Value of DWI Compared With Structured Assessment of BI-RADS Criteria by the Kaiser Score? A Systematic Review and Meta-analysis

OBJECTIVE

This systematic review and meta-analysis investigated the added value of DWI compared with the structured assessment of BI-RADS criteria using the Kaiser score.

MATERIALS AND METHODS

Articles published in English until May 2024 were included. Two independent reviewers extracted data on the characteristics of studies evaluating the added value of DWI to distinguish benign from malignant breast lesions compared with structured assessment of the BI-RADS criteria. Using bivariate random-effects models, the sensitivity and specificity were calculated. I2 statistics, Deek's funnel plot asymmetry test for publication bias, and meta-regression were applied for the data analysis.

RESULTS

Five studies comprising 1005 malignant and 846 benign lesions were eligible for data synthesis. The pooled sensitivity and specificity estimates of structured BI-RADS assessment were 95.7% (95% confidence interval [CI], 92.6%-97.5%) and 68.7% (95% CI, 60.9%-75.6%), respectively. Adding DWI to the structured BI-RADS assessment achieved a pooled sensitivity of 94.4% (95% CI, 90.5%-96.7%) and a pooled specificity of 74.9% (95% CI, 68.8%-80.2%). Adding DWI to the structured BI-RADS assessment significantly changed neither the sensitivity ( P = 0.52) nor the specificity ( P = 0.20).

CONCLUSIONS

This systematic review and meta-analysis revealed only a limited, statistically nonsignificant added value of DWI compared with the structured assessment of BI-RADS criteria using the Kaiser score.

Development and Validation of a Diagnostic Model for Enhancing Lesions on Breast MRI: Based on Kaiser Score

RATIONALE AND OBJECTIVES

This study aims to develop and validate a new diagnostic model based on the Kaiser score for preoperative diagnosis of the malignancy probability of enhancing lesions on breast MRI.

MATERIALS AND METHODS

This study collected consecutive inpatient data (including imaging data, clinical data, and pathological data) from two different institutions. All patients underwent preoperative breast Dynamic Contrast-Enhanced Magnetic Resonance Imaging (DCE-MRI) examinations and were found to have enhancing lesions. These lesions were confirmed as benign or malignant by surgical resection or biopsy pathology (all carcinomas in situ were confirmed by pathology after surgical resection). Data from one institution were used as the training set(284 cases), and data from the other institution were used as the validation set(107 cases). The Kaiser score was directly incorporated into the diagnostic model as a single predictive variable. Other predictive variables were screened using Least Absolute Shrinkage and Selection Operator (LASSO) regression. Multivariate logistic regression was employed to integrate the Kaiser score and other selected predictive variables to construct a new diagnostic model, presented in the form of a nomogram. Receiver operating characteristic (ROC) curve, DeLong test, net reclassification improvement (NRI), and integrated discrimination improvement (IDI) were adopted to evaluate and compare the discrimination of the diagnostic model for breast enhancing lesions based on Kaiser score (hereinafter referred to as the "breast lesion diagnostic model") and the Kaiser score alone. Calibration curves were used to assess the calibration of the breast lesion diagnostic model, and decision curve analysis (DCA) was used to evaluate the clinical efficacy of the diagnostic model and the Kaiser score.

RESULTS

LASSO regression indicated that, besides the indicators already included in the Kaiser score system, "age", "MIP sign", "associated imaging features", and "clinical breast examination (CBE) results" were other valuable diagnostic parameters for breast enhancing lesions. In the training set, the AUCs of the breast lesion diagnostic model and the Kaiser score were 0.948 and 0.869, respectively, with a statistically significant difference (p < 0.05). In the validation set, the AUCs of the breast lesion diagnostic model and the Kaiser score were 0.956 and 0.879, respectively, with a statistically significant difference (p < 0.05). The DeLong test, NRI, and IDI showed that the breast lesion diagnostic model had a higher discrimination ability for breast enhancing lesions compared to the Kaiser score alone, with statistically significant differences (p < 0.05). The calibration curves indicated good calibration of the breast lesion diagnostic model. DCA demonstrated that the breast lesion diagnostic model had higher clinical application value, with greater net clinical benefit over a wide range of diagnostic thresholds compared to the Kaiser score.

CONCLUSION

The Kaiser score-based breast lesion diagnostic model, which integrates "age," "MIP sign", "associated imaging features", and "CBE results", can be used for the preoperative diagnosis of the malignancy probability of breast enhancing lesions, and it outperforms the classic Kaiser score in terms of diagnostic performance for such lesions.

A nomogram based on multiparametric magnetic resonance imaging improves the diagnostic performance of breast lesions diagnosed as BI-RADS category 4: A comparative study with the Kaiser score

PURPOSE

To construct a nomogram combining Kaiser score (KS), synthetic MRI (syMRI) parameters, apparent diffusion coefficient (ADC), and clinical features to distinguish benign and malignant breast lesions better.

METHODS

From December 2022 to February 2024, a retrospective cohort of 168 patients with breast lesions diagnosed as Breast Imaging Reporting and Data System (BI-RADS) category 4 by ultrasound and/or mammography was included. The research population was divided into the training set (n = 117) and the validation set (n = 51) by random sampling with a ratio of 7:3. Breast lesions' KS, ADC, relaxation time of syMRI, and clinical and imaging features were statistically analyzed and compared between malignant and benign groups. Two experienced radiologists independently assigned KS, and measured quantitative values of ADC and parameters of syMRI, and the intraclass correlation coefficient (ICC) was calculated. Independent predictors were identified by univariable and multivariable logistic regression analysis. Then, a nomogram was established, and its performance was evaluated by the area under the curve (AUC), calibration curve, and decision curve.

RESULTS

There were 168 lesions (118 malignant and 50 benign) in 168 female patients confirmed by histopathology. The interobserver agreement for each quantitative parameter was excellent. Older patient (OR = 1.091, 95 % confidence interval [CI]: 1.017-1.170, P = 0.014), higher lesions' KS (OR = 288.431, 95 % CI: 34.930-2381.654, P < 0.001), lower ADC (OR = 0.077, 95 % CI: 0.011-0.558, P = 0.011), and lower T2 relaxation time (OR = 0.918, 95 % CI: 0.868-0.972, P = 0.003) were independent predictors of breast malignancies and utilized to establish the nomogram. The accuracy of KS, ADC, T2, and patient age in predicting malignant breast lesions was 88.89 %, 79.48 %, 82.05 %, and 58.97 %, respectively. No significant differences in AUCs of KS, ADC and T2 were observed in distinguishing benign from malignant breast lesions. The nomogram yielded higher AUCs of 0.968 (0.934-0.996) and 0.959 (0.863-0.995) in training and validation sets than KS, ADC, T2, and patient age (p < 0.05).

CONCLUSION

Although there were no significant differences among the AUCs of KS, ADC, and T2, the constructed nomogram incorporating these parameters significantly improves diagnostic performance for distinguishing benign and malignant BI-RADS 4 breast lesions. Future external validation is needed in practical applications.

Breast lesions on MRI in mass and non-mass enhancement: Kaiser score and modified Kaiser score + for readers of variable experience

OBJECTIVES

To compare the diagnostic performance of three readers using BI-RADS and Kaiser score (KS) based on mass and non-mass enhancement (NME) lesions.

METHODS

A total of 630 lesions, 393 malignant and 237 benign, 458 mass and 172 NME, were analyzed. Three radiologists with 3 years, 6 years, and 13 years of experience made diagnoses. 596 cases had diffusion-weighted imaging, and the apparent diffusion coefficient (ADC) was measured. For lesions with ADC > 1.4 × 10-3 mm2/s, the KS was reduced by 4 as the modified KS +, and the benefit was assessed.

RESULTS

When using BI-RADS, AUC was 0.878, 0.915, and 0.941 for mass, and 0.771, 0.838, 0.902 for NME for Reader-1, 2, and 3, respectively, better for mass than for NME. The diagnostic accuracy of KS was improved compared to BI-RADS for less experienced readers. For Reader-1, AUC was increased from 0.878 to 0.916 for mass (p = 0.005) and from 0.771 to 0.822 for NME (p = 0.124). Based on the cut-off value of BI-RADS ≥ 4B and KS ≥ 5 as malignant, the sensitivity of KS by Readers-1 and -2 was significantly higher for both Mass and NME. When ADC was considered to change to modified KS +, the AUC and the accuracy for all three readers were improved, showing higher specificity with slightly degraded sensitivity.

CONCLUSION

The benefit of KS compared to BI-RADS was most noticeable for the less experienced readers in improving sensitivity. Compared to KS, KS + can improve specificity for all three readers. For NME, the KS and KS + criteria need to be further improved.

CLINICAL RELEVANCE STATEMENT

KS provides an intuitive method for diagnosing lesions on breast MRI. BI-RADS and KS face greater difficulties in evaluating NME compared to mass lesions. Adding ADC to the KS can improve specificity with slightly degraded sensitivity.

KEY POINTS

KS provides an intuitive method for interpreting breast lesions on MRI, most helpful for novice readers. KS, compared to BI-RADS, improved sensitivity in both mass and NME groups for less experienced readers. NME lesions were considered during the development of the KS flowchart, but may need to be better defined.

Application of the Kaiser score on contrast-enhanced mammography in the differential diagnosis of breast lesions: comparison with breast magnetic resonance imaging

Background

The Kaiser score (KS) as a clinical decision rule has been proven capable of enhancing the diagnostic efficiency for suspicious breast lesions and obviating unnecessary benign biopsies. However, the consistency of KS in contrast-enhanced mammography (CEM-KS) and KS on magnetic resonance imaging (MRI-KS) is still unclear. This study aimed to evaluate and compare the diagnostic efficacy and agreement of CEM-KS and MRI-KS for suspicious breast lesions.

Methods

This retrospective study included 207 patients from April 2019 to June 2022. The radiologists assigned a diagnostic category to all lesions using the Breast Imaging Reporting and Data System (BI-RADS). Subsequently, they were asked to assign a final diagnostic category for each lesion according to the KS. The diagnostic performance was evaluated by the area under the receiver operating characteristic curve (AUC). The agreement in terms of the kinetic curve and the KS categories for CEM and MRI were evaluated via the Cohen kappa coefficient.

Results

The AUC was higher for the CEM-KS category assignment than for the CEM-BI-RADS category assignment (0.856 vs. 0.776; P=0.047). The AUC was higher for MRI-KS than for MRI-BI-RADS (0.841 vs. 0.752; P =0.015). The AUC of CEM-KS was not significantly different from that of MRI-KS (0.856 vs. 0.841; P=0.538). The difference between the AUCs for CEM-BI-RADS and MRI-BI-RADS was not statistically significant (0.776 vs. 0.752; P=0.400). The kappa agreement for the characterization of suspicious breast lesions using CEM-KS and MRI-KS was 0.885.

Conclusions

The KS substantially improved the diagnostic performance of suspicious breast lesions, not only in MRI but also in CEM. CEM-KS and MRI-KS showed similar diagnostic performance and almost perfect agreement for the characterization of suspicious breast lesions. Therefore, CEM holds promise as an alternative when breast MRI is not available or contraindicated.

Using the Kaiser Score as a clinical decision rule for breast lesion classification: Does computer-assisted curve type analysis improve diagnosis?

PURPOSE

We aimed to investigate the effect of using visual or automatic enhancement curve type assessment on the diagnostic performance of the Kaiser Score (KS), a clinical decision rule for breast MRI.

METHOD

This IRB-approved retrospective study analyzed consecutive conventional BI-RADS 0, 4 or 5 patients who underwent biopsy after 1.5T breast MRI according to EUSOBI recommendations between 2013 and 2015. The KS includes five criteria (spiculations; signal intensity (SI)-time curve type; margins of the lesion; internal enhancement; and presence of edema) resulting in scores from 1 (=lowest) to 11 (=highest risk of breast cancer). Enhancement curve types (Persistent, Plateau or Wash-out) were assessed by two radiologists independently visually and using a pixel-wise color-coded computed parametric map of curve types. KS diagnostic performance differences between readings were compared by ROC analysis.

RESULTS

In total 220 lesions (147 benign, 73 malignant) including mass (n = 148) and non-mass lesions (n = 72) were analyzed. KS reading performance in distinguishing benign from malignant lesions did not differ between visual analysis and parametric map (P = 0.119; visual: AUC 0.875, sensitivity 95 %, specificity 63 %; and map: AUC 0.901, sensitivity 97 %, specificity 65 %). Additionally, analyzing mass and non-mass lesions separately, showed no difference between parametric map based and visual curve type-based KS analysis as well (P = 0.130 and P = 0.787).

CONCLUSIONS

The performance of the Kaiser Score is largely independent of the curve type assessment methodology, confirming its robustness as a clinical decision rule for breast MRI in any type of breast lesion in clinical routine.

Added value of clinical decision rules for the management of enhancing breast MRI lesions: A systematic comparison of the Kaiser score and the Göttingen score

PURPOSE

We investigated the added value of two internationally used clinical decision rules in the management of enhancing lesions on breast MRI.

METHODS

This retrospective, institutional review board approved study included consecutive patients from two different populations. Patients received breast MRI according to the recommendations of the European Society of Breast Imaging (EUSOBI). Initially, all examinations were assessed by expert readers without using clinical decision rules. All lesions rated as category 4 or 5 according to the Breast Imaging Reporting and Data System were histologically confirmed. These lesions were re-evaluated by an expert reader blinded to the histology. He assigned each lesion a Göttingen score (GS) and a Kaiser score (KS) on different occasions. To provide an estimate on inter-reader agreement, a second fellowship-trained reader assessed a subset of these lesions. Subgroup analyses based on lesion type (mass vs. non-mass), size (>1 cm vs. ≤ 1 cm), menopausal status, and significant background parenchymal enhancement were conducted. The areas under the ROC curves (AUCs) for the GS and KS were compared, and the potential to avoid unnecessary biopsies was determined according to previously established cutoffs (KS > 4, GS > 3) RESULTS: 527 lesions in 506 patients were included (mean age: 51.8 years, inter-quartile-range: 43.0-61.0 years). 131/527 lesions were malignant (24.9 %; 95 %-confidence-interval: 21.3-28.8). In all subgroups, the AUCs of the KS (median = 0.91) were higher than those of the GS (median = 0.83). Except for "premenopausal patients" (p = 0.057), these differences were statistically significant (p ≤ 0.01). Kappa agreement was higher for the KS (0.922) than for the GS (0.358).

CONCLUSION

Both the KS and the GS provided added value for the management of enhancing lesions on breast MRI. The KS was superior to the GS in terms of avoiding unnecessary biopsies and showed superior inter-reader agreement; therefore, it may be regarded as the clinical decision rule of choice.

Quantitative evaluation of Kaiser score in diagnosing breast dynamic contrast-enhanced magnetic resonance imaging for patients with high-grade background parenchymal enhancement

Background

High-grade background parenchymal enhancement (BPE), including moderate and marked, poses a considerable challenge for the diagnosis of breast disease due to its tendency to increase the rate of false positives and false negatives. The purpose of our study was to explore whether the Kaiser score can be used for more accurate assessment of benign and malignant lesions in high-grade BPE compared with the Breast Imaging Reporting and Data System (BI-RADS).

Methods

A retrospective review was conducted on consecutive breast dynamic contrast-enhanced magnetic resonance imaging (DCE-MRI) scans from 2 medical centers. Included were patients who underwent DCE-MRI demonstrating high-grade BPE and who had a pathology-confirmed diagnosis. Excluded were patients who had received neoadjuvant chemotherapy or who had undergone biopsy prior to MRI examination. Two physicians with more than 7 years of experience specializing in breast imaging diagnosis jointly reviewed breast magnetic resonance (MR) images. The Kaiser score was used to determine the sensitivity, specificity, and positive predictive value (PPV), and negative predictive value (NPV) of the BI-RADS from different BPE groups and different enhancement types. The performance of the Kaiser score and BI-RADS were compared according to diagnostic accuracy.

Results

A total of 126 cases of high-grade BPE from 2 medical centers were included in this study. The Kaiser score had a higher specificity and PPV than did the BI-RADS (87.5% vs. 46.3%) as well as a higher PPV (94.3% vs. 79.8%). The value of diagnostic accuracy and 95% confidence interval (CI) for the Kaiser score (accuracy 0.928; 95% CI: 0.883-0.973) was larger than that for BI-RADS (accuracy 0.810; 95% CI: 0.741-0.879). Moreover, the Kaiser score had a significantly higher value of diagnostic accuracy for both mass and non-mass enhancement, especially mass lesions (Kaiser score: accuracy 0.947, 95% CI: 0.902-0.992; BI-RADS: accuracy 0.821, 95% CI: 0.782-0.860), with a P value of 0.006.

Conclusions

The Kaiser score is a useful diagnostic tool for the evaluation of high-grade BPE lesions, with a higher specificity, PPV, and diagnostic accuracy as compared to the BI-RADS.

Combination of ultrafast dynamic contrast-enhanced MRI-based radiomics and artificial neural network in assessing BI-RADS 4 breast lesions: Potential to avoid unnecessary biopsies

Objectives

To investigate whether combining radiomics extracted from ultrafast dynamic contrast-enhanced MRI (DCE-MRI) with an artificial neural network enables differentiation of MR BI-RADS 4 breast lesions and thereby avoids false-positive biopsies.

Methods

This retrospective study consecutively included patients with MR BI-RADS 4 lesions. The ultrafast imaging was performed using Differential sub-sampling with cartesian ordering (DISCO) technique and the tenth and fifteenth postcontrast DISCO images (DISCO-10 and DISCO-15) were selected for further analysis. An experienced radiologist used freely available software (FAE) to perform radiomics extraction. After principal component analysis (PCA), a multilayer perceptron artificial neural network (ANN) to distinguish between malignant and benign lesions was developed and tested using a random allocation approach. ROC analysis was performed to evaluate the diagnostic performance.

Results

173 patients (mean age 43.1 years, range 18-69 years) with 182 lesions (95 benign, 87 malignant) were included. Three types of independent principal components were obtained from the radiomics based on DISCO-10, DISCO-15, and their combination, respectively. In the testing dataset, ANN models showed excellent diagnostic performance with AUC values of 0.915-0.956. Applying the high-sensitivity cutoffs identified in the training dataset demonstrated the potential to reduce the number of unnecessary biopsies by 63.33%-83.33% at the price of one false-negative diagnosis within the testing dataset.

Conclusions

The ultrafast DCE-MRI radiomics-based machine learning model could classify MR BI-RADS category 4 lesions into benign or malignant, highlighting its potential for future application as a new tool for clinical diagnosis.

Diagnostic performance of the Kaiser score in the evaluation of breast lesions on contrast-enhanced mammography

OBJECTIVES

We aimed to investigate whether the Kaiser score (KS) could improve the diagnostic performance of breast imaging reporting and data system (BI-RADS) in evaluating breast enhancing lesions on contrast-enhanced mammography (CEM).

METHODS

Three hundred fifty-nine patients with 375 lesions (231 malignant and 144 benign) were included in this retrospective study from April 2019 to December 2021.Two readers with different levels of experience in breast imaging were asked to give a BI-RADS assessment category according to the CEM BI-RADS and final score based on the KS. The diagnostic performance of all lesions, mass and non-mass enhancement (NME) were assessed by receiver operating characteristic (ROC) analysis, and the areas under the ROC curve (AUCs) were measured. The weighted kappa coefficients were calculated to investigate the interreader agreement.

RESULTS

The AUCs of the KS for all lesions were 0.915 (95 %CI: 0.884-0.947) and 0.876 (95 %CI: 0.838-0.914) for two readers. When mass and NME were evaluated separately, the AUCs of the KS for mass were higher than those for NME (p < 0.001). The AUCs of BI-RADS for all lesion diagnoses ranged between 0.821 (95 %CI: 0.778-0.864) and 0.842(95 %CI: 0.801-0.883) for two readers. The AUCs of the KS were higher than those of BI-RADS (p < 0.001, p = 0.016). There were no significant differences in the sensitivity between the KS (97.4 %) and BI-RADS (99.6 %) for all lesions (p = 0.130). The specificity of the KS was significantly higher than that of BI-RADS (p < 0.001). Compared with BI-RADS, the application of the KS could have potentially obviated 41.7 % to 47.9 % unnecessary biopsies in 144 benign lesions. Interreader agreement between the two readers of the KS was almost perfect (k = 0.883 [95 % CI: 0.842-0.924]).

CONCLUSION

The use of the KS provided a high diagnostic performance in distinguishing malignant and benign breast lesions on CEM and outperformed BI-RADS. The application of the KS can downgrade up to 47.9% of unnecessary biopsies of benign breast lesions.

Evaluation of the differentiation of benign and malignant breast lesions using synthetic relaxometry and the Kaiser score

Objective

To investigate whether there is added value of quantitative parameters from synthetic magnetic resonance imaging (SyMRI) as a complement to the Kaiser score (KS) to differentiate benign and malignant breast lesions.

Materials and methods

In this single-institution study, 122 patients who underwent breast MRI from March 2020 to May 2021 were retrospectively analyzed. SyMRI and dynamic contrast-enhanced MRI were performed using a 3.0-T system. Two experienced radiologists independently assigned the KS and measured the quantitative values of T1 relaxation time (T1), T2 relaxation time (T2), and proton density (PD) from SyMRI. Pathology was regarded as the gold standard. The diagnostic values were compared using the appropriate statistical tests.

Results

There were 122 lesions (86 malignant and 36 benign) in 122 women. The T1 value was identified as the only independent factor for the differentiation of malignant and benign lesions. The diagnostic accuracy of incorporating the T1 into the KS protocol (T1+KS) was 95.1% and 92.1% for all lesions (ALL) and The American College of Radiology (ACR) Breast Imaging Reporting and Data System (BI-RADS) category 4 lesions, respectively, which was significantly higher than that of either T1 (ALL: 82.8%, P = 0.0001; BI-RADS 4: 78.9%, P = 0.002) or KS (ALL: 90.2%, P = 0.031; BI-RADS 4: 84.2%, P = 0.031) alone. The sensitivity and specificity of T1+KS were also higher than those of the T1 or KS alone. The combined diagnosis could have avoided another 15.6% biopsies compared with using KS alone.

Conclusions

Incorporating T1 into the KS protocol improved both the sensitivity and specificity to differentiate benign and malignant breast lesions, thus avoiding unnecessary invasive procedures.

Assessment of breast lesions by the Kaiser score for differential diagnosis on MRI: the added value of ADC and machine learning modeling

OBJECTIVES

To evaluate the diagnostic performance of Kaiser score (KS) adjusted with the apparent diffusion coefficient (ADC) (KS+) and machine learning (ML) modeling.

METHODS

A dataset of 402 malignant and 257 benign lesions was identified. Two radiologists assigned the KS. If a lesion with KS > 4 had ADC > 1.4 × 10^-3 mm²/s, the KS was reduced by 4 to become KS+. In order to consider the full spectrum of ADC as a continuous variable, the KS and ADC values were used to train diagnostic models using 5 ML algorithms. The performance was evaluated using the ROC analysis, compared by the DeLong test. The sensitivity, specificity, and accuracy achieved using the threshold of KS > 4, KS+ > 4, and ADC ≤ 1.4 × 10^-3 mm²/s were obtained and compared by the McNemar test.

RESULTS

The ROC curves of KS, KS+, and all ML models had comparable AUC in the range of 0.883-0.921, significantly higher than that of ADC (0.837, p < 0.0001). The KS had sensitivity = 97.3% and specificity = 59.1%; and the KS+ had sensitivity = 95.5% with significantly improved specificity to 68.5% (p < 0.0001). However, when setting at the same sensitivity of 97.3%, KS+ could not improve specificity. In ML analysis, the logistic regression model had the best performance. At sensitivity = 97.3% and specificity = 65.3%, i.e., compared to KS, 16 false-positives may be avoided without affecting true cancer diagnosis (p = 0.0015).

CONCLUSION

Using dichotomized ADC to modify KS to KS+ can improve specificity, but at the price of lowered sensitivity. Machine learning algorithms may be applied to consider the ADC as a continuous variable to build more accurate diagnostic models.

KEY POINTS

• When using ADC to modify the Kaiser score to KS+, the diagnostic specificity according to the results of two independent readers was improved by 9.4-9.7%, at the price of slightly degraded sensitivity by 1.5-1.8%, and overall had improved accuracy by 2.6-2.9%. • When the KS and the continuous ADC values were combined to train models by machine learning algorithms, the diagnostic specificity achieved by the logistic regression model could be significantly improved from 59.1 to 65.3% (p = 0.0015), while maintaining at the high sensitivity of KS = 97.3%, and thus, the results demonstrated the potential of ML modeling to further evaluate the contribution of ADC. • When setting the sensitivity at the same levels, the modified KS+ and the original KS have comparable specificity; therefore, KS+ with consideration of ADC may not offer much practical help, and the original KS without ADC remains as an excellent robust diagnostic method.

Breast MRI: does a clinical decision algorithm outweigh reader experience?

Objectives

Due to its high sensitivity, DCE MRI of the breast (MRIb) is increasingly used for both screening and assessment purposes. The Kaiser score (KS) is a clinical decision algorithm, which formalizes and guides diagnosis in breast MRI and is expected to compensate for lesser reader experience. The aim was to evaluate the diagnostic performance of untrained residents using the KS compared to off-site radiologists experienced in breast imaging using only MR BI-RADS.

Methods

Three off-site, board-certified radiologists, experienced in breast imaging, interpreted MRIb according to the MR BI-RADS scale. The same studies were read by three residents in radiology without prior training in breast imaging using the KS. All readers were blinded to clinical information. Histology was used as the gold standard. Statistical analysis was conducted by comparing the AUC of the ROC curves.

Results

A total of 80 women (median age 52 years) with 93 lesions (32 benign, 61 malignant) were included. The individual within-group performance of the three expert readers (AUC 0.723–0.742) as well as the three residents was equal (AUC 0.842–0.928), p > 0.05, respectively. But, the rating of each resident using the KS significantly outperformed the experts’ ratings using the MR BI-RADS scale (p ≤ 0.05).

Conclusion

The KS helped residents to achieve better results in reaching correct diagnoses than experienced radiologists empirically assigning MR BI-RADS categories in a clinical “problem solving MRI” setting. These results support that reporting breast MRI benefits more from using a diagnostic algorithm rather than expert experience.

Key Points

• Reporting breast MRI benefits more from using a diagnostic algorithm rather than expert experience in a clinical “problem solving MRI” setting.

• The Kaiser score, which provides a clinical decision algorithm for structured reporting, helps residents to reach an expert level in breast MRI reporting and to even outperform experienced radiologists using MR BI-RADS without further formal guidance.

Supplementary Information

The online version contains supplementary material available at 10.1007/s00330-022-09015-8.