Quantifying interobserver variation in target definition in palliative radiotherapy

Dosimetric evaluation of a spinal cord dose-limiting 3D-CRT technique for radiotherapy of spinal metastases

BACKGROUND

To evaluate the possible advantages of a simple spinal cord (SC) dose-limiting three-dimensional conformal radiotherapy (3D-CRT) technique in comparison to conventional two-dimensional (2D) techniques and other 3D-CRT techniques for spinal bone irradiation.

METHODS

For 41 spinal target volumes, seven different techniques were evaluated, using a standard schedule of 30 Gy in 10 fractions. The SC dose-limiting 3D-CRT technique 1F2S-18MV using a single posterior field (F) supplemented by two anterior segment fields (S) and 18-MV photon beams was compared to two conventional 2D techniques (a single posterior field, PA, and two opposed anterior-posterior fields, APPA), three other 3D-CRT techniques (a single posterior field supplemented by four segment fields, 1F4S; two wedged fields, WD, and the SC dose-limiting variant using 6 MV, 1F2S-6MV) along with the original clinically applied plans.

RESULTS

1F2S-18MV demonstrated notably better results for all target volume parameters compared to the conventional 2D techniques (p < 0.001). Limitation of the SC dose was significantly superior with 1F2S-18MV in comparison to PA and APPA (SC Dmean: 28.9 ± 0.4  vs. 30.1 ± 0.6 Gy and 30.1 ± 0.4 Gy; SC Dmax: 30.9 ± 0.7  vs. 32.5 ± 1.0 Gy and 31.8 ± 0.7 Gy; SC D1cm3 : 30.1 ± 0.6  vs. 31.7 ± 0.9 Gy and 31.1 ± 0.6 Gy; p < 0.001). Likewise, lower mean SC doses with 1F2S-18MV were observed in comparison to the more treatment time-consuming 3D-CRT techniques (1F4S, WD) and the original plans without relevant compromises on the dose homogeneity in the target volume and the dose exposure to the other OARs.

CONCLUSION

In treatment planning of spinal metastases, simple variants of 3D-CRT-techniques like 1F2S-18MV can offer a significant dose limitation to the SC while providing a sufficient dose coverage of the target volume. Especially in patients with favorable life expectancy and potential need for re-irradiation, such SC dose-limiting 3D-CRT techniques may be a reasonable approach.

Development of a Comprehensive, Contour-Based, Peer Review Workflow at a Community Proton Center

Purpose

Quality assurance and continuing quality improvement are integral parts of any radiation oncology practice. With increasingly conformal radiation treatments, it has become critical to focus on every slice of the target contour to ensure adequate tumor coverage and optimal normal tissue sparing. Proton therapy centers open internationally with increasing frequency, and radiation oncologists with varying degrees of subspecialization apply proton therapy in daily practice. Precise treatment with proton therapy allows us to limit toxicity but requires in-depth knowledge of the unique properties of proton beam delivery. To address this need at our proton therapy center, we developed a comprehensive peer review program to help improve the quality of care that we were providing for our patients.

Materials and Methods

We implemented a policy of comprehensive peer review for all patients treated at our community proton facility starting in January 2013. Peer review begins at the time of referral with prospective cases being reviewed for appropriateness for proton therapy at daily rounds. There is then biweekly review of target contouring and treatment plans.

Results

During a 6-month period from June 2013 to November 2013, a total of 223 new patients were treated. Documentation of peer review at chart rounds was completed for 222 of the 223 patients (99.6%). An average of 10.7 cases were reviewed in each biweekly chart rounds session, with a total of 560 case presentations. The average time required for contour review was 145 seconds (±71 seconds) and plan review was 120 seconds (±64 seconds). Modifications were suggested for 21 patients (7.9%) during contour review and for 19 patients (6.4%) during treatment plan review. An average of 4 physicians were present at each session.

Conclusions

We demonstrated that the implementation of a comprehensive, prospective peer review program is feasible in the community setting. This article can serve as a framework for future quality assurance programs.

An evaluation of an advanced practice role in palliative radiation therapy

Introduction

The purpose of the study was to evaluate the palliative advanced practice radiation therapy (APRT) role with respect to the impact on waiting times for patients from referral to radiation treatment delivery, the ability of the APRT to define palliative radiation therapy fields and patient satisfaction. The evaluation of the impact of the APRT role and referral pathway on patient waiting times has been previously published.

Methods

Patients were allocated to two different pathways; APRT and standard. Patients in the APRT pathway had their radiotherapy treatment managed by the APRT including defining their palliative fields blinded to the radiation oncologist (RO).

Results

Of the 150 palliative patients, 94 had their radiation therapy managed by the APRT and 56 were managed through the standard pathway. 82/92 APRT defined fields were accepted by the RO.

Conclusions

Inter‐observer variability between the APRT and the RO in defining palliative radiation therapy fields is similar to that reported in the literature between clinicians. With previously published reduced wait times from referral to treatment for palliative patients, the establishment of the APRT role is justified.

Inter-observer agreement in GTV delineation of bone metastases on CT and impact of MR imaging: A multicenter study

BACKGROUND AND PURPOSE

The use of Stereotactic Body Radiotherapy (SBRT) for bone metastases is increasing rapidly. Therefore, knowledge of the inter-observer differences in tumor volume delineation is essential to guarantee precise dose delivery. The aim of this study is to compare inter-observer agreement in bone metastases delineated on different imaging modalities.

MATERIAL AND METHODS

Twenty consecutive patients with bone metastases treated with SBRT were selected. All patients received CT and MR imaging in treatment position prior to SBRT. Five observers from three institutions independently delineated gross tumor volume (GTV) on CT alone, CT with co-registered MRI and MRI alone. Four contours per imaging modality per patient were available, as one set of contours was shared by 2 observers. Inter-observer agreement, expressed in generalized conformity index [CIgen], volumes of contours and contours center of mass (COM) were calculated per patient and imaging modality.

RESULTS

Mean GTV delineated on MR (45.9±52.0cm³) was significantly larger compared to CT-MR (40.2±49.4cm³) and CT (34.8±41.8cm³). A considerable variation in CIgen was found on CT (mean 0.46, range 0.15-0.75) and CT-MRI (mean 0.54, range 0.17-0.71). The highest agreement was found on MRI (mean 0.56, range 0.20-0.77). The largest variations of COM were found in anterior-posterior direction for all imaging modalities.

CONCLUSIONS

Large inter-observer variation in GTV delineation exists for CT, CT-MRI and MRI. MRI-based GTV delineation resulted in larger volumes and highest consistency between observers.

Uncertainties in volume delineation in radiation oncology: A systematic review and recommendations for future studies

BACKGROUND AND PURPOSE

Volume delineation is a well-recognised potential source of error in radiotherapy. Whilst it is important to quantify the degree of interobserver variability (IOV) in volume delineation, the resulting impact on dosimetry and clinical outcomes is a more relevant endpoint. We performed a literature review of studies evaluating IOV in target volume and organ-at-risk (OAR) delineation in order to analyse these with respect to the metrics used, reporting of dosimetric consequences, and use of statistical tests.

METHODS AND MATERIALS

Medline and Pubmed databases were queried for relevant articles using keywords. We included studies published in English between 2000 and 2014 with more than two observers.

RESULTS

119 studies were identified covering all major tumour sites. CTV (n=47) and GTV (n=38) were most commonly contoured. Median number of participants and data sets were 7 (3-50) and 9 (1-132) respectively. There was considerable heterogeneity in the use of metrics and methods of analysis. Statistical analysis of results was reported in 68% (n=81) and dosimetric consequences in 21% (n=25) of studies.

CONCLUSION

There is a lack of consistency in conducting and reporting analyses from IOV studies. We suggest a framework to use for future studies evaluating IOV.

Delineation of the larynx as organ at risk in radiotherapy: a contouring course within "Rete Oncologica Piemonte-Valle d'Aosta" network to reduce inter- and intraobserver variability

AIMS

To evaluate the usefulness of a contouring course in reducing inter- and intraobserver variability in the definition of the larynx as organ at risk (OAR).

METHODS

Within the "Rete Oncologica Piemonte-Valle d'Aosta" network, a contouring course focusing on larynx delineation was proposed. Twenty-six radiotherapist technicians (RTTs) experienced in delineating OARs were asked to contour larynx before and after the training. An expert radiation oncologist defined the reference volume for educational purpose. The contoured volumes obtained before and after the course were compared using descriptive statistics (mean value, standard deviation-SD, and coefficient of variation-COV) of volumes and maximum diameters. Conformity index (CI), dice coefficient (DC), and percentage of overlap were used to evaluate the spatial accuracy of the different volumes compared to the reference. Further analysis regarding the variation in the centre of mass (COM) displacement was performed.

RESULTS

The mean volume was 40.4 cm³ before and 65.9 cm³ after the course, approaching the reference value. Mean anteroposterior, laterolateral, and craniocaudal diameters improved, getting each closer to the reference. Moreover, the COM moved approaching reference coordinates. Mean percentage of intersection and DC strongly increased after the course, rising from 57.76 to 93.83 % and from 0.68 to 0.89, respectively. CI enhanced from 0.06 to 0.31.

CONCLUSIONS

This study shows an improvement in larynx definition after the contouring course with lower interobserver variability and major consistency compared to the reference volume. Other specific educational activities may further increase the quality of radiation therapy contouring in this setting.

Rapid access palliative radiation therapy programs: an efficient model of care

Palliating symptoms of advanced and metastatic cancers are one of the most common indications for radiation therapy (RT), and the demand for palliative RT is increasing. Dedicated rapid access palliative RT programs improve access to care, and can deliver RT in a more efficient and evidence-based manner than standard RT programs. In this narrative review, we discuss the role of palliative RT in comprehensive cancer care, and challenges that have faced patients trying to access it. We describe how rapid access programs developed to address these challenges and provide an overview of dedicated programs worldwide. Finally, we show how these programs can serve as models for multidisciplinary care and education, and sources of exciting research opportunities in clinical care and advanced technologies.

A semiautomatic CT-based ensemble segmentation of lung tumors: comparison with oncologists' delineations and with the surgical specimen

PURPOSE

To assess the clinical relevance of a semiautomatic CT-based ensemble segmentation method, by comparing it to pathology and to CT/PET manual delineations by five independent radiation oncologists in non-small cell lung cancer (NSCLC).

MATERIALS AND METHODS

For 20 NSCLC patients (stages Ib-IIIb) the primary tumor was delineated manually on CT/PET scans by five independent radiation oncologists and segmented using a CT based semi-automatic tool. Tumor volume and overlap fractions between manual and semiautomatic-segmented volumes were compared. All measurements were correlated with the maximal diameter on macroscopic examination of the surgical specimen. Imaging data are available on www.cancerdata.org.

RESULTS

High overlap fractions were observed between the semi-automatically segmented volumes and the intersection (92.5±9.0, mean±SD) and union (94.2±6.8) of the manual delineations. No statistically significant differences in tumor volume were observed between the semiautomatic segmentation (71.4±83.2 cm(3), mean±SD) and manual delineations (81.9±94.1 cm(3); p=0.57). The maximal tumor diameter of the semiautomatic-segmented tumor correlated strongly with the macroscopic diameter of the primary tumor (r=0.96).

CONCLUSIONS

Semiautomatic segmentation of the primary tumor on CT demonstrated high agreement with CT/PET manual delineations and strongly correlated with the macroscopic diameter considered as the "gold standard". This method may be used routinely in clinical practice and could be employed as a starting point for treatment planning, target definition in multi-center clinical trials or for high throughput data mining research. This method is particularly suitable for peripherally located tumors.

Critical discussion of evaluation parameters for inter-observer variability in target definition for radiation therapy

BACKGROUND AND PURPOSE

Inter-observer studies represent a valid method for the evaluation of target definition uncertainties and contouring guidelines. However, data from the literature do not yet give clear guidelines for reporting contouring variability. Thus, the purpose of this work was to compare and discuss various methods to determine variability on the basis of clinical cases and a literature review.

PATIENTS AND METHODS

In this study, 7 prostate and 8 lung cases were contoured on CT images by 8 experienced observers. Analysis of variability included descriptive statistics, calculation of overlap measures, and statistical measures of agreement. Cross tables with ratios and correlations were established for overlap parameters.

RESULTS

It was shown that the minimal set of parameters to be reported should include at least one of three volume overlap measures (i.e., generalized conformity index, Jaccard coefficient, or conformation number). High correlation between these parameters and scatter of the results was observed.

CONCLUSION

A combination of descriptive statistics, overlap measure, and statistical measure of agreement or reliability analysis is required to fully report the interrater variability in delineation.