Quality assurance of radiotherapy in the ongoing EORTC 1420 "Best of" trial for early stage oropharyngeal, supraglottic and hypopharyngeal carcinoma: results of the benchmark case procedure

Large-scale dose evaluation of deep learning organ contours in head-and-neck radiotherapy by leveraging existing plans

Background and purpose

Retrospective dose evaluation for organ-at-risk auto-contours has previously used small cohorts due to additional manual effort required for treatment planning on auto-contours. We aimed to do this at large scale, by a) proposing and assessing an automated plan optimization workflow that used existing clinical plan parameters and b) using it for head-and-neck auto-contour dose evaluation.

Materials and methods

Our automated workflow emulated our clinic's treatment planning protocol and reused existing clinical plan optimization parameters. This workflow recreated the original clinical plan (P OG ) with manual contours (P MC ) and evaluated the dose effect (P OG - P MC ) on 70 photon and 30 proton plans of head-and-neck patients. As a use-case, the same workflow (and parameters) created a plan using auto-contours (P AC ) of eight head-and-neck organs-at-risk from a commercial tool and evaluated their dose effect (P MC - P AC ).

Results

For plan recreation (P OG - P MC ), our workflow had a median impact of 1.0% and 1.5% across dose metrics of auto-contours, for photon and proton respectively. Computer time of automated planning was 25% (photon) and 42% (proton) of manual planning time. For auto-contour evaluation (P MC - P AC ), we noticed an impact of 2.0% and 2.6% for photon and proton radiotherapy. All evaluations had a median Δ NTCP (Normal Tissue Complication Probability) less than 0.3%.

Conclusions

The plan replication capability of our automated program provides a blueprint for other clinics to perform auto-contour dose evaluation with large patient cohorts. Finally, despite geometric differences, auto-contours had a minimal median dose impact, hence inspiring confidence in their utility and facilitating their clinical adoption.

Radiotherapy trial quality assurance processes: a systematic review

Quality assurance remains a neglected component of many trials, particularly for technical interventions, such as surgery and radiotherapy, for which quality of treatment is an important component in defining outcomes. We aimed to evaluate evidence for the processes used in radiotherapy quality assurance of clinical trials. A systematic review was undertaken focusing on use of a pre-trial outlining benchmark case and subsequent on-trial individual case reviews of outlining for recruited patients. These pre-trial and on-trial checks are used to ensure consistency and standardisation of treatment for each patient recruited to the trial by confirming protocol compliance. Non-adherence to the trial protocol has been shown to have a negative effect on trial outcomes. 29 studies published between January, 2000, and December, 2022, were identified that reported on either outlining benchmark case results or outlining individual case review results, or both. The trials identified varied in their use of radiotherapy quality assurance practices and reporting of outcomes was inconsistent. Deviations from trial protocols were frequent, particularly regarding outlining. Studies correlating benchmark case results with on-trial individual case reviews provided mixed results, meaning firm conclusions could not be drawn regarding the influence of the pre-trial benchmark case on subsequent on-trial performance. The optimal radiotherapy quality assurance processes were unclear, and there was little evidence available. Improved reporting of outcomes from radiotherapy quality assurance programmes is needed to develop an evidence base for the optimal approach to radiotherapy quality assurance in trials.

ARCHERY: a prospective observational study of artificial intelligence-based radiotherapy treatment planning for cervical, head and neck and prostate cancer - study protocol

INTRODUCTION

Fifty per cent of patients with cancer require radiotherapy during their disease course, however, only 10%-40% of patients in low-income and middle-income countries (LMICs) have access to it. A shortfall in specialised workforce has been identified as the most significant barrier to expanding radiotherapy capacity. Artificial intelligence (AI)-based software has been developed to automate both the delineation of anatomical target structures and the definition of the position, size and shape of the radiation beams. Proposed advantages include improved treatment accuracy, as well as a reduction in the time (from weeks to minutes) and human resources needed to deliver radiotherapy.

METHODS

ARCHERY is a non-randomised prospective study to evaluate the quality and economic impact of AI-based automated radiotherapy treatment planning for cervical, head and neck, and prostate cancers, which are endemic in LMICs, and for which radiotherapy is the primary curative treatment modality. The sample size of 990 patients (330 for each cancer type) has been calculated based on an estimated 95% treatment plan acceptability rate. Time and cost savings will be analysed as secondary outcome measures using the time-driven activity-based costing model. The 48-month study will take place in six public sector cancer hospitals in India (n=2), Jordan (n=1), Malaysia (n=1) and South Africa (n=2) to support implementation of the software in LMICs.

ETHICS AND DISSEMINATION

The study has received ethical approval from University College London (UCL) and each of the six study sites. If the study objectives are met, the AI-based software will be offered as a not-for-profit web service to public sector state hospitals in LMICs to support expansion of high quality radiotherapy capacity, improving access to and affordability of this key modality of cancer cure and control. Public and policy engagement plans will involve patients as key partners.

Evaluation of neoadjuvant chemotherapy combined with PD-1 inhibitors in patients with oropharyngeal and hypopharyngeal squamous cell carcinoma: a comparative study of antitumor activity

PURPOSE

To assess the antitumor activity of neoadjuvant chemotherapy in conjunction with PD-1 inhibitors (neoadjuvant chemoimmunotherapy) among patients with oropharyngeal and hypopharyngeal squamous cell carcinoma (OPHSCC) and compare its efficacy with neoadjuvant chemotherapy alone.

METHODS

We conducted a retrospective analysis using data from patients diagnosed with OPHSCC and treated at the Sun Yat-sen University Cancer Center between September 2012 and August 2022. We included patients who received neoadjuvant chemotherapy alone or combined with PD-1 inhibitors. We assessed the clinical response using the Response Evaluation Criteria in Solid Tumors and evaluated progression-free survival (PFS) and overall survival (OS).

RESULTS

Preliminary results demonstrate that neoadjuvant chemoimmunotherapy exhibited robust antitumor activity in OPHSCC, with an impressive overall response rate (ORR) of 81.0%. Complete response and partial response rates were 14.9% and 65.9%, respectively. Notably, neoadjuvant chemoimmunotherapy demonstrated superior PFS and OS to neoadjuvant chemotherapy alone. The 1-year PFS rate was 80.7%, and the 2-year rate was 61.1%. Additionally, the 1-year OS rate reached 92.3%. Finally, a multivariate analysis identified the American Joint Committee on Cancer stage reduction post-treatment as a favorable predictor of PFS.

CONCLUSION

Our results underscore the promising potential of neoadjuvant chemoimmunotherapy in enhancing antitumor activity in patients with OPHSCC. The robust ORR, along with improved PFS and OS, supports the utility of this combined approach. These results pave the way for further investigations to validate and refine the application of neoadjuvant chemoimmunotherapy in this challenging clinical context.

Assessing Interobserver Variability in the Delineation of Structures in Radiation Oncology: A Systematic Review

PURPOSE

The delineation of target volumes and organs at risk is the main source of uncertainty in radiation therapy. Numerous interobserver variability (IOV) studies have been conducted, often with unclear methodology and nonstandardized reporting. We aimed to identify the parameters chosen in conducting delineation IOV studies and assess their performances and limits.

METHODS AND MATERIALS

We conducted a systematic literature review to highlight major points of heterogeneity and missing data in IOV studies published between 2018 and 2021. For the main used metrics, we did in silico analyses to assess their limits in specific clinical situations.

RESULTS

All disease sites were represented in the 66 studies examined. Organs at risk were studied independently of tumor site in 29% of reviewed IOV studies. In 65% of studies, statistical analyses were performed. No gold standard (GS; ie, reference) was defined in 36% of studies. A single expert was considered as the GS in 21% of studies, without testing intraobserver variability. All studies reported both absolute and relative indices, including the Dice similarity coefficient (DSC) in 68% and the Hausdorff distance (HD) in 42%. Limitations were shown in silico for small structures when using the DSC and dependence on irregular shapes when using the HD. Variations in DSC values were large between studies, and their thresholds were inconsistent. Most studies (51%) included 1 to 10 cases. The median number of observers or experts was 7 (range, 2-35). The intraclass correlation coefficient was reported in only 9% of cases. Investigating the feasibility of studying IOV in delineation, a minimum of 8 observers with 3 cases, or 11 observers with 2 cases, was required to demonstrate moderate reproducibility.

CONCLUSIONS

Implementation of future IOV studies would benefit from a more standardized methodology: clear definitions of the gold standard and metrics and a justification of the tradeoffs made in the choice of the number of observers and number of delineated cases should be provided.

Nasopharyngeal cancer: the impact of guidelines and teaching on radiation target volume delineation

Target volume delineation in the radiation treatment of nasopharyngeal cancer is challenging due to several reasons such as the complex anatomy of the site, the need for the elective coverage of definite anatomical regions, the curative intent of treatment and the rarity of the disease, especially in non-endemic areas. We aimed to analyze the impact of educational interactive teaching courses on target volume delineation accuracy between Italian radiation oncology centers. Only one contour dataset per center was admitted. The educational course consisted in three parts: (1) The completely anonymized image dataset of a T4N1 nasopharyngeal cancer patient was shared between centers before the course with the request of target volume and organs at risk delineation; (2) the course was held online with dedicated multidisciplinary sessions on nasopharyngeal anatomy, nasopharyngeal cancer pattern of diffusion and on the description and explanation of international contouring guidelines. At the end of the course, the participating centers were asked to resubmit the contours with appropriate corrections; (3) the pre- and post-course contours were analyzed and quantitatively and qualitatively compared with the benchmark contours delineated by the panel of experts. The analysis of the 19 pre- and post-contours submitted by the participating centers revealed a significant improvement in the Dice similarity index in all the clinical target volumes (CTV1, CTV2 and CTV3) passing from 0.67, 0.51 and 0.48 to 0.69, 0.65 and 0.52, respectively. The organs at risk delineation was also improved. The qualitative analysis consisted in the evaluation of the inclusion of the proper anatomical regions in the target volumes; it was conducted following internationally validated guidelines of contouring for nasopharyngeal radiation treatment. All the sites were properly included in target volume delineation by  >50% of the centers after correction. A significant improvement was registered for the skull base, the sphenoid sinus and the nodal levels. These results demonstrated the important role that educational courses with interactive sessions could have in such a challenging task as target volume delineation in modern radiation oncology.