Quality assurance in conformal radiotherapy: DYNARAD consensus report on practice guidelines

Are Quality Indicators for Radiotherapy Useful in the Evaluation of Service Efficacy in a New Based Radiotherapy Institution?

Aims and background

A number of documents assess the need for quality assurance in radiotherapy, which must be constantly monitored and possibly improved. In this regard, a system that confirms the quality of a department has been suggested and quality indicators have been used to improve the quality of the service. The National Health Service ( Istituto Superiore di Sanità) approved a National Research Project to increase the quality of radiotherapy. The aim of the present study was to analyze the practical feasibility and efficacy of the quality indicators elaborated by the National Health Service study group in a radiotherapy unit.

Patients and methods

The voluntary accredited program was carried out by the Radiotherapy Department of IRCC in Candiolo from June to August 2002. We analyzed 8 of the 13 indicators according to the National Health Service Project. For this purpose, 133 consecutive patients treated in our Unit were analyzed, and the results are reported according to the appropriate indicator (number of staff related to patients treated, waiting list, case history accuracy, multidisciplinary approach, number of treatment plans performed by CT, number of fields per fraction, number of portal imaging performed per overall treatment, and patient satisfaction).

Results

The number of professional staff related to the number of patients treated was easy to calculate and it could be the basis for further evaluation. The overall waiting time was 55.4 days, and it changed for different radiotherapy goals. We obtained 80% conformity in case-history accuracy. The number of multidisciplinary consultations performed ranged between 50% and 100%. The number of CT plans was about 1.6 ± 0.9 plans per patient. The mean number of fields performed per day and per patient is 3.5 ± 1.7 and was in agreement with the fact that more than 50% of treatments in our Center were performed with conformal radiotherapy. An average of 16.7 ±10.0 portal imaging per case was performed. The percentage of patient satisfaction with the staff obtained a very high compliance.

Conclusions

The self evaluation promoted by the National Health Service Project allows the monitoring of the activities of the service in order to asses critical factors and it can be the starting point to improve the quality of the service and to compare national and international quality assurance results.

A new index: Triple Point Conformity Scale (CS3) and its implication in qualitative evaluation of radiotherapy plan

Background

Across the history of radiotherapy, with gradual technological progress and various methods of irradiation, the purpose has always been to deliver homogeneously 100% of the prescribed dose to 100% of the target volume containing the identifiable tumour and/or tumour cells potentially present while limiting the dose to adjacent normal tissues.

Material and methods

The formula for triple point conformity scale is: CS3=(V95+V100+V105)/3VT. (a) Lower limit determination: CS3=(VT+0·93 VT+0·0)/3VT=0·643; (b) Upper limit determination: in order to find out an empirical relation in between V105 and VT, we studied over 593 cancer patients of various sites by taking planning target volume as target, and an empirical relation is derived out as: V105/VT=0·0007. Hence, CS3=(VT+VT+0·0007 VT)/3VT=0·6667~0·667.

Result

Upper and lower limits of CS3 have been calculated at 0·643 and 0·667, respectively. Maximum value of CS3 index is recorded 0·656 while minimum value is 0·478.

Discussion

The CS3 scale constitutes an attractive tool because it could facilitate decisions during analysis of various treatment plans proposed for conformal radiotherapy. Its major advantages are its simplicity and integration of multiple parameters.

Conclusion

The triple point conformity scale (CS3) provides better qualitative information about radiotherapy plans as compared to other conformity indices. This study advises the users to use the CS3 scale to evaluate a conformal radiotherapy plan which encompasses a wide range of relevant clinical volumes, and is able to extract qualitative dosimetric information.

Organizational, technical, physical and clinical quality standards for radiotherapy

BACKGROUND

Indisputably, radiotherapy has become an entirely interdisciplinary specialty. This situation requires efficient planning, verification, monitoring, quality control and constant improvement of all aspects of service delivery, referring both to patients' (including diagnosis, prescription and method of treatment, its justification, realization and follow up) and organizational, technical and physics matters.

AIM

The aim of this work was to develop technical, physics and clinical quality standards for radiotherapy. This paper presents chosen standards for each of the aforementioned category.

MATERIALS AND METHODS

For the development of quality standards the comparison analysis of EU and Polish acts of law passed between 1980 and 2010 was conducted, the universal industrial ISO norm 9001:2008 referring to quality management system was reviewed. Recommendations of this norm were completed with detailed quality standards based on the author's 11 year work experience and the review of articles on quality assurance and quality control standards for radiotherapy published between 1984 and 2009 and the review of current recommendations and guidelines of American, International, European and National bodies (associations, societies, agencies such as AAPM, ESTRO, IAEA, and OECI) for quality assurance and quality management in radiotherapy.

RESULTS

As a result 352 quality standards for radiotherapy were developed and categorized into the following three groups: (1) organizational standards, (2) physics and technical standards and (3) clinical standards.

CONCLUSIONS

Proposed quality standards for radiotherapy, can be used by any institution using ionizing radiation for medical procedures. Nevertheless standards are only of value if they are implemented, reviewed, audited and improved and if there is a clear mechanism in place to monitor and address failure to meet agreed standards.

Clinical quality standards for radiotherapy

AIM OF THE STUDY

The technological progress that is currently being witnessed in the areas of diagnostic imaging, treatment planning systems and therapeutic equipment has caused radiotherapy to become a high-tech and interdisciplinary domain involving staff of various backgrounds. This allows steady improvement in therapy results, but at the same time makes the diagnostic, imaging and therapeutic processes more complex and complicated, requiring every stage of those processes to be planned, organized, controlled and improved so as to assure high quality of services provided. The aim of this paper is to present clinical quality standards for radiotherapy as developed by the author.

MATERIAL AND METHODS

In order to develop the quality standards, a comparative analysis was performed between European and Polish legal acts adopted in the period of 1980-2006 and the universal industrial ISO 9001:2008 standard, defining requirements for quality management systems, and relevant articles published in 1984-2009 were reviewed, including applicable guidelines and recommendations of American, international, European and Polish bodies, such as the American Association of Physicists in Medicine (AAPM), the European Society for Radiotherapy & Oncology (ESTRO), the International Atomic Energy Agency (IAEA), and the Organisation of European Cancer Institutes (OECI) on quality assurance and management in radiotherapy.

RESULTS

As a result, 352 quality standards for radiotherapy were developed and categorized into the following three groups: 1 - organizational standards; 2 - physico-technical standards and 3 - clinical standards.

CONCLUSION

Proposed clinical quality standards for radiotherapy can be used by any institution using ionizing radiation for medical purposes. However, standards are of value only if they are implemented, reviewed, audited and improved, and if there is a clear mechanism in place to monitor and address failure to meet agreed standards.

Conformity index: a review

We present a critical analysis of the conformity indices described in the literature and an evaluation of their field of application. Three-dimensional conformal radiotherapy, with or without intensity modulation, is based on medical imaging techniques, three-dimensional dosimetry software, compression accessories, and verification procedures. It consists of delineating target volumes and critical healthy tissues to select the best combination of beams. This approach allows better adaptation of the isodose to the tumor volume, while limiting irradiation of healthy tissues. Tools must be developed to evaluate the quality of proposed treatment plans. Dosimetry software provides the dose distribution in each CT section and dose-volume histograms without really indicating the degree of conformity. The conformity index is a complementary tool that attributes a score to a treatment plan or that can compare several treatment plans for the same patient. The future of conformal index in everyday practice therefore remains unclear.

[Conformal index and radiotherapy]

Goal of radiotherapy is to treat patient with the best therapeutic ratio, i.e. the highest local control and the lowest toxicity rates. The conformal approach, three-dimensional conformal radiotherapy or intensity-modulated radiotherapy, is based on imageries, up-dated 3-D treatment planning systems, immobilization systems, restricted quality assurance and treatment verification. The aim is to ensure a high dose distribution tailored to the limits of the target volume, while reducing exposure of normal tissues. The evaluation tools used for optimizing treatment are the visual inspection of the dose distribution in various planes, and the dose-volume histograms, but they do not fully quantify the conformity of dose distributions. The conformal index is a tool for scoring a given plan or for evaluating different treatment plans for the same patient. This paper describes the onset and evolution of conformal index and his potential application field.

Conformal radiotherapy for paranasal sinus and nasal cavity tumors: three-dimensional treatment planning and preliminary results in 40 patients

PURPOSE

To assess the possibility to deliver a high and homogeneous irradiation with respect to maximal tolerated dose to the visual pathways for paranasal sinus and nasal cavity tumors.

METHODS AND MATERIALS

Forty patients with advanced stage malignant tumors were treated with postoperative (30) or primary (10 patients) conformal radiotherapy (CRT). Five patients were previously irradiated. Six to 15 individually shaped isocentric noncoplanar field arrangements, using a multileaf collimator were designed. Dose-volume histograms (DVH) for the planning target volumes (PTV) and the optic pathways were analyzed in 31 cases.

RESULTS

Median and maximal delivered doses to the PTV were 60 (+/-3) and 66 (+/-4) Gy. Dose distributions for critical organs are detailed. Median follow-up was 19 months (3 to 48). Local, nodal, and metastatic recurrences occurred in 8, 2, and 7 cases, respectively. Major prognostic factor for local recurrences was central nervous system (CNS) involvement. One patient died of meningitis. Two patients developed cataract, and 1 patient ipsilateral blindness due to vascular glaucoma.

CONCLUSION

CRT for locally advanced paranasal sinus and nasal cavity tumors enables the delivery of high homogeneous doses to the PTV with respect to critical organs, with a low toxicity and a high local control.

[Glossary of conformal radiotherapy]

Most of the concepts and terms related to conformal radiotherapy were produced by English-speaking authors and eventually validated by international groups of experts, whose working language was also English. Therefore, a significant part of this literature is poorly accessible to the French-speaking radiation oncology community. The present paper gathers the 'official' definitions already published in French, along with propositions for the remaining terms which should be submitted to a more formal and representative validation process.

[Conformal radiotherapy: principles and classification]

'Conformal radiotherapy' is the name fixed by usage and given to a new form of radiotherapy resulting from the technological improvements observed during, the last ten years. While this terminology is now widely used, no precise definition can be found in the literature. Conformal radiotherapy refers to an approach in which the dose distribution is more closely 'conformed' or adapted to the actual shape of the target volume. However, the achievement of a consensus on a more specific definition is hampered by various difficulties, namely in characterizing the degree of 'conformality'. We have therefore suggested a classification scheme be established on the basis of the tools and the procedures actually used for all steps of the process, i.e., from prescription to treatment completion. Our classification consists of four levels: schematically, at level 0, there is no conformation (rectangular fields); at level 1, a simple conformation takes place, on the basis of conventional 2D imaging; at level 2, a 3D reconstruction of the structures is used for a more accurate conformation; and level 3 includes research and advanced dynamic techniques. We have used our personal experience, contacts with colleagues and data from the literature to analyze all the steps of the planning process, and to define the tools and procedures relevant to a given level. The corresponding tables have been discussed and approved at the European level within the Dynarad concerted action. It is proposed that the term 'conformal radiotherapy' be restricted to procedures where all steps are at least at level 2.

[Conformal radiotherapy in cancer of the upper aerodigestive tract]

The outcome of head and neck malignancies is closely related to the achievement of local tumor control. The occurrence of severe late complications is the consequence of the anatomic vicinity between dose-limiting normal tissues and the tumor, thus reducing the curative potential of radiotherapy. Conformal radiotherapy is presently actively investigated as a way to improve the dose distribution in head and neck malignancies (especially when originating from the nasopharynx or the sinuses) while protecting healthy organs. Such an approach requires a chain of sophisticated procedures, including efficient quality assurance programs, in order to achieve the proper degree of safety. The relatively limited clinical studies published to-date have already confirmed the advantage of conformal radiotherapy in terms of dose delivery. The development of beam intensity modulation is likely to further contribute to the improvement of the therapeutic ratio.

[Economic aspects of conformal radiotherapy]

The significantly higher human and material costs induced by the development of conformal radiotherapy cannot be ignored. In France, the present criteria for medical reimbursements underestimate the costs related to treatment preparation and evaluation, slowing down the implementation of new equipment and therapeutic practices. To fit the legitimate concerns regarding health cost containment, conformal radiotherapy should be submitted to appropriate economic analyses. These analyses are based on rigorous methods aimed at weighing the actual costs of conformal treatment by the benefits achieved in terms of tumor control, normal tissue complication and the patients' quality of life. The conclusions from the few studies published to date are rather in favour of conformal radiotherapy when compared to alternative therapeutic procedures. These early results need to be confirmed in order to support more rational reimbursement modalities to promote innovative treatments.

External audit on the clinical practice and medical decision-making at the departments of radiotherapy in Budapest and Vienna

PURPOSE

To present an example of how to study and analyze the clinical practice and the quality of medical decision-making under daily routine working conditions in a radiotherapy department, with the aims of detecting deficiencies and improving the quality of patient care.

METHODS

Two departments, each with a divisional organization structure and an established internal audit system, the University Clinic of Radiotherapy and Radiobiology in Vienna (Austria), and the Department of Radiotherapy at the National Institute of Oncology in Budapest (Hungary), conducted common external audits. The descriptive parameters of the external audit provided information on the auditing (auditor and serial number of the audit), the cohorts (diagnosis, referring institution, serial number and intention of radiotherapy) and the staff responsible for the treatment (division and physician). During the ongoing external audits, the qualifying parameters were (1) the sound foundation of the indication of radiotherapy, (2) conformity to the institution protocol (3), the adequacy of the choice of radiation equipment, (4) the appropriateness of the treatment plan, and the correspondence of the latter with (5) the simulation and (6) verification films. Various degrees of deviation from the treatment principles were defined and scored on the basis of the concept of Horiot et al. (Horiot JC, Schueren van der E. Johansson KA, Bernier J, Bartelink H. The program of quality assurance of the EORTC radiotherapy group. A historical overview. Radiother. Oncol. 1993,29:81-84), with some modifications. The action was regarded as adequate (score 1) in the event of no deviation or only a small deviation with presumably no alteration of the desired end-result of the treatment. A deviation adversely influencing the result of the therapy was considered a major deviation (score 3). Cases involving a minor deviation (score 2) were those only slightly affecting the therapeutic end-results, with effects between those of cases with scores 1 and 3. Non-performance of the necessary radiotherapeutic procedures was penalized by the highest score of 4. Statistical evaluation was performed with the BMDP software package, using variance analysis.

RESULTS

Bimonthly audits (six with a duration of 4-6 h in each institution) were carried out by three auditors from the evaluating departments; they reviewed a total of 452 cases in Department A, and 265 cases in Department B. Despite the comparable staffing and instrumental conditions, a markedly higher number (1.5 times) of new cases were treated in Department A, but with a lower quality of radiotherapy, as adequate values of qualifying parameters (1-6) were more frequent for the cases treated in Department B (85.3%, 94%, 83.4%, 28.3%, 41.9% and 81.1%) than for those in Department A (67%, 83.4%, 87.8%, 26.1%, 33.2% and 17.7%). The responsible division (including staff and instrumentation), the responsible physician and the type of the disease each exerted a highly significant effect on the quality level of the treatment. Statistical analysis revealed a positive influence of the curative (relative to the palliative/symptomatic) intention of the treatment on the level of quality, but the effect of the first radiotherapy (relative to the second or further one) was statistically significant in only one department. At the same time, the quality parameters did not vary with the referring institution, the auditing person or the serial number of the audit.

CONCLUSION

The external audit relating to the provision of radiotherapeutic care proved feasible with the basic conformity and compliance of the staff and resulted in valuable information to take correction measures.

An integrated system for the production of field shaping devices in radiotherapy

A system has been developed in our department that simplifies the production processes of field shaping devices in radiotherapy, integrating an image grabbing and processing facility at a radiotherapy simulator and an automated block cutter. The data acquisition subsystem captures images, processes and corrects them for pincushion distortions, creates a composite radiograph, records user defined contours of blocks and exports data to the block cutter controller. A robotic subsystem drives and controls the polystyrene cutting unit. The system has been experimentally evaluated. Errors in contour definition were found to be less than 1 mm for a broad range of gantry angles and not exceeding 1.5 mm for those gantry orientations that present maximum magnetic field related image intensifier distortion, while the automated block cutter is capable of cutting out contours in polystyrene with an accuracy comparable to that of commercially available systems. The system is expected to contribute to the overall improvement of radiotherapy processes, particularly in low budget radiotherapy departments, introducing improvements in accuracy and efficiency at minimum costs.

[Practical determination of volume and doses in conformal radiotherapy]

The determination of the target volumes and the dose to be delivered are critical medical steps in order to locally control the disease and to limit the risks of normal tissues injury. While many clinical situations are compatible with standardised technique and beam arrangements, the tools provided by modern medical diagnostic imaging procedures and tridimensional dosimetry allow an improved conformation of the irradiated volume and the administered dose to the clinical target volume. However, this approach requires an increased precision in tumour and normal tissues delineation, based on patient immobilisation devices, standardisation of mobile organs repletion status and image acquisition procedures, explicit definition of the biological and physical safety margins, definition of acceptable levels of dose heterogeneity in the planning target volume and appropriate quality assurance procedures.