A Simplified Approach to Adnexal Lesions May Be Enough

Inter-reader reliability of Ovarian-Adnexal Reporting and Data System US: a systematic review and meta-analysis

PURPOSE

Ovarian-Adnexal Reporting and Data System (O-RADS) US provides a standardized lexicon for ovarian and adnexal lesions, facilitating risk stratification based on morphological features for malignancy assessment, which is essential for proper management. However, systematic determination of inter-reader reliability in O-RADS US categorization remains unexplored. This study aimed to systematically determine the inter-reader reliability of O-RADS US categorization and identify the factors that affect it.

METHODS

Original articles reporting the inter-reader reliability of O-RADS US in lesion categorization were identified in the MEDLINE, EMBASE, and Web of Science databases from January 2018 to December 2023. DerSimonian-Laird random-effects models were used to determine the meta-analytic pooled inter-reader reliability of the O-RADS US categorization. Subgroup meta-regression analysis was performed to identify the factors causing study heterogeneity.

RESULTS

Fourteen original articles with 5139 ovarian and adnexal lesions were included. The inter-reader reliability of O-RADS US in lesion categorization ranged from 0.71 to 0.99, with a meta-analytic pooled estimate of 0.83 (95% CI, 0.78-0.88), indicating almost perfect reliability. Substantial study heterogeneity was observed in the inter-reader reliability of the O-RADS US categorization (I2 = 96.9). In subgroup meta-regression analysis, reader experience was the only factor associated with study heterogeneity. Pooled inter-reader reliability of the O-RADS US categorization was higher in studies with all experienced readers (0.86; 95% CI, 0.81-0.91) compared to those with multiple readers including trainees (0.74; 95% CI, 0.70-0.78; P = 0.009). The inter-reader reliability of US descriptors ranged from 0.39 to 0.97, with ascites and peritoneal nodules showing almost perfect reliability (0.79- 0.97).

CONCLUSION

The O-RADS US risk stratification system demonstrated almost perfect inter-reader reliability in lesion categorization. Our results highlight the importance of targeted training and descriptor simplification to improve inter-reader reliability and clinical adoption.

Diagnostic Efficacy of Ultrasound-Based International Ovarian Tumor Analysis Simple Rules and Assessment of the Different Neoplasias in the Adnexa Model in Malignancy Prediction Among Women With Adnexal Masses: A Systematic Review

Transvaginal ultrasonography (USG) is most commonly used before surgery to accurately diagnose benign and malignant ovarian masses for effective treatment, avoid unnecessary interventions, improve the prognosis of patients, and preserve fertility in patients with benign tumors. Therefore, the objective of the present systematic review was to assess the diagnostic efficacy of ultrasound-based International Ovarian Tumor Analysis (IOTA) Simple Rules (SR) and Assessment of Different NEoplasias in the adneXa (ADNEX) model in predicting malignancy among women with adnexal masses. A systematic literature search was carried out on electronic databases consisting of Science Direct, PubMed, and Google Scholar. The keywords utilized to perform the literature search and include relevant articles consisted of "Diagnostic Efficacy", AND "Ultrasound-Based International Ovarian Tumor Analysis Simple Rules", AND "International Ovarian Tumor Analysis ADNEX Model", AND "Adnexal masses", AND "Ovarian tumors". Based on the selection criteria, a total of five studies were included. The study concluded that both the models showed high diagnostic efficacy for malignancy prediction; however, in comparison to the IOTA SR, the IOTA ADNEX model demonstrated good diagnostic efficacy.

Diagnostic Performance of Ultrasonography-Based Risk Models in Differentiating Between Benign and Malignant Ovarian Tumors in a US Cohort

Importance

Ultrasonography-based risk models can help nonexpert clinicians evaluate adnexal lesions and reduce surgical interventions for benign tumors. Yet, these models have limited uptake in the US, and studies comparing their diagnostic accuracy are lacking.

Objective

To evaluate, in a US cohort, the diagnostic performance of 3 ultrasonography-based risk models for differentiating between benign and malignant adnexal lesions: International Ovarian Tumor Analysis (IOTA) Simple Rules with inconclusive cases reclassified as malignant or reevaluated by an expert, IOTA Assessment of Different Neoplasias in the Adnexa (ADNEX), and Ovarian-Adnexal Reporting and Data System (O-RADS).

Design, Setting, and Participants

This retrospective diagnostic study was conducted at a single US academic medical center and included consecutive patients aged 18 to 89 years with adnexal masses that were managed surgically or conservatively between January 2017 and October 2022.

Exposure

Evaluation of adnexal lesions using the Simple Rules, ADNEX, and O-RADS.

Main Outcomes and Measures

The main outcome was diagnostic performance, including area under the receiver operating characteristic (ROC) curve (AUC), sensitivity, specificity, positive and negative predictive values, and positive and negative likelihood ratios. Surgery or follow-up were reference standards. Secondary analyses evaluated the models' performances stratified by menopause status and race.

Results

The cohort included 511 female patients with a 15.9% malignant tumor prevalence (81 patients). Mean (SD) ages of patients with benign and malignant adnexal lesions were 44.1 (14.4) and 52.5 (15.2) years, respectively, and 200 (39.1%) were postmenopausal. In the ROC analysis, the AUCs for discriminative performance of the ADNEX and O-RADS models were 0.96 (95% CI, 0.93-0.98) and 0.92 (95% CI, 0.90-0.95), respectively. After converting the ADNEX continuous individualized risk into the discrete ordinal categories of O-RADS, the ADNEX performance was reduced to an AUC of 0.93 (95% CI, 0.90-0.96), which was similar to that for O-RADS. The Simple Rules combined with expert reevaluation had 93.8% sensitivity (95% CI, 86.2%-98.0%) and 91.9% specificity (95% CI, 88.9%-94.3%), and the Simple Rules combined with malignant classification had 93.8% sensitivity (95% CI, 86.2%-98.0%) and 88.1% specificity (95% CI, 84.7%-91.0%). At a 10% risk threshold, ADNEX had 91.4% sensitivity (95% CI, 83.0%-96.5%) and 86.3% specificity (95% CI, 82.7%-89.4%) and O-RADS had 98.8% sensitivity (95% CI, 93.3%-100%) and 74.4% specificity (95% CI, 70.0%-78.5%). The specificities of all models were significantly lower in the postmenopausal group. Subgroup analysis revealed high performances independent of race.

Conclusions and Relevance

In this diagnostic study of a US cohort, the Simple Rules, ADNEX, and O-RADS models performed well in differentiating between benign and malignant adnexal lesions; this outcome has been previously reported primarily in European populations. Risk stratification models can lead to more accurate and consistent evaluations of adnexal masses, especially when used by nonexpert clinicians, and may reduce unnecessary surgeries.

Interreader Agreement and Intermodality Concordance of O-RADS US and MRI for Assessing Large, Complex Ovarian-Adnexal Cysts

Purpose To assess interreader agreement of the Ovarian-Adnexal Reporting and Data System (O-RADS) and intermodality concordance between US and MRI for characterizing complex adnexal cysts measuring 5 cm or larger. Materials and Methods This retrospective study included 58 "complex cysts" measuring at least 5 cm in size observed at both US and MRI in 54 women (median age, 37 years ± 12 [SD]; seven postmenopausal women) between July 2017 and June 2020, identified from an electronic US database. A separate set of two blinded radiologists independently reviewed the US or MR images to assign the O-RADS category, and an adjudicator resolved discrepancies (a total of six readers). Lesion outcome (49 benign, eight malignant, one lost to follow-up) was recorded. Interreader agreement of O-RADS US and O-RADS MRI and concordance between US and MRI were analyzed. Results Interreader agreement was fair for US (κ = 0.31), moderate for MRI (κ = 0.43), and moderate between US and MRI (κ = 0.58). A significant positive correlation was found between O-RADS US and MRI (τ = 0.72, P < .001). The O-RADS 4 threshold yielded the highest accuracy for both US and MRI (area under the receiver operating characteristic curve = 0.92 and 0.995, respectively). Considering O-RADS US 4 or 5 as potentially malignant and 1-3 as benign, eight lesions that were assessed as potentially malignant at US were correctly downgraded to benign by using findings at MRI. Using findings at MRI, one malignant lesion that was assessed as benign at US was upgraded to potentially malignant. Conclusion O-RADS US and MRI had excellent performance and positive correlation, but significant interobserver variability remains. Keywords: Ovary, MR Imaging, Ultrasonography © RSNA, 2022 See also the commentary by Baumgarten in this issue.