Quality assurance of radiotherapy in the ongoing EORTC 1420 "Best of" trial for early stage oropharyngeal, supraglottic and hypopharyngeal carcinoma: results of the benchmark case procedure

INTRODUCTION

The current phase III EORTC 1420 Best-of trial (NCT02984410) compares the swallowing function after transoral surgery versus intensity modulated radiotherapy (RT) in patients with early-stage carcinoma of the oropharynx, supraglottis and hypopharynx. We report the analysis of the Benchmark Case (BC) procedures before patient recruitment with special attention to dysphagia/aspiration related structures (DARS).

MATERIALS AND METHODS

Submitted RT volumes and plans from participating centers were analyzed and compared against the gold-standard expert delineations and dose distributions. Descriptive analysis of protocol deviations was conducted. Mean Sorensen-Dice similarity index (mDSI) and Hausdorff distance (mHD) were applied to evaluate the inter-observer variability (IOV).

RESULTS

65% (23/35) of the institutions needed more than one submission to achieve Quality assurance (RTQA) clearance. OAR volume delineations were the cause for rejection in 53% (40/76) of cases. IOV could be improved in 5 out of 12 OARs by more than 10 mm after resubmission (mHD). Despite this, final IOV for critical OARs in delineation remained significant among DARS by choosing an aleatory threshold of 0.7 (mDSI) and 15 mm (mHD).

CONCLUSIONS

This is to our knowledge the largest BC analysis among Head and neck RTQA programs performed in the framework of a prospective trial. Benchmarking identified non-common OARs and target delineations errors as the main source of deviations and IOV could be reduced in a significant number of cases after this process. Due to the substantial resources involved with benchmarking, future benchmark analyses should assess fully the impact on patients' clinical outcome.

Independent external validation using the EORTC HNCG-ROG 1219 DAHANCA trial data of NTCP models for acute oral mucositis

PURPOSE

To externally validate previously published Normal Tissue Complication Probability (NTCP) models developed by separate teams for grade 3 oral mucositis (g3OM).

MATERIALS AND METHODS

Two models were validated: a logistic model, based on 144 head and neck cancer (HNC) patients receiving induction chemotherapy followed by chemo-IMRT; a multivariable logistic model for prediction of g3OM for 253 patients receiving radical treatment for the head and neck squamous cell carcinoma (HNSCC). The EORTC HNCG-ROG 1219 DAHANCA trial dataset, consisting of 169 patients was used as the validation cohort. This cohort was treated with accelerated fractionated chemo-IMRT, with/without the hypoxic radiosensitizer Nimorazole for HNSCC. External validity was assessed using the scaled Brier score. Calibration was assessed in terms of calibration curves as well as measures of mean and weak calibration. Hosmer-Lemeshow was used for goodness-of-fit test. Discrimination was calculated using the area under the receiver operating curve (AUC-ROC).

RESULTS

The prevalence of g3OM in the validation cohort (35.5%) was similar to that of two development cohorts, i.e. 38.7% and 31.9% for Bhide logistic and Otter multivariable logistic models respectively. The scaled Brier scores showed good overall model performance. Perfect calibration was observed in the prevalence range of 20% to 40%. AUC-ROC was acceptable in external validation (0.67). The Hosmer-Lemeshow test showed good agreement between predicted and observed outcomes for two models.

CONCLUSION

The NTCP models were validated and lead to valid predictions in a wide range of diverse treatment techniques and patient characteristics, also when Nimorazole is added as hypoxic radiosensitizer.