Benchmarking survival outcomes: A funnel plot for survival data

Survival of patients with colorectal liver metastases treated with and without preoperative chemotherapy: Nationwide propensity score-matched study

INTRODUCTION

Routine treatment with preoperative systemic chemotherapy (CTx) in patients with colorectal liver metastases (CRLM) remains controversial due to lack of consistent evidence demonstrating associated survival benefits. This study aimed to determine the effect of preoperative CTx on overall survival (OS) compared to surgery alone and to assess hospital and oncological network variation in 5-year OS.

METHODS

This was a population-based study of all patients who underwent liver resection for CRLM between 2014 and 2017 in the Netherlands. After 1:1 propensity score matching (PSM), OS was compared between patients treated with and without preoperative CTx. Hospital and oncological network variation in 5-year OS corrected for case-mix factors was calculated using an observed/expected ratio.

RESULTS

Of 2820 patients included, 852 (30.2%) and 1968 (69.8%) patients were treated with preoperative CTx and surgery alone, respectively. After PSM, 537 patients remained in each group, median number of CRLM; 3 [IQR 2-4], median size of CRLM; 28 mm [IQR 18-44], synchronous CLRM (71.1%). Median follow-up was 80.8 months. Five-year OS rates after PSM for patients treated with and without preoperative chemotherapy were 40.2% versus 38.3% (log-rank P = 0.734). After stratification for low, medium, and high tumour burden based on the tumour burden score (TBS) OS was similar for preoperative chemotherapy vs. surgery alone (log-rank P = 0.486, P = 0.914, and P = 0.744, respectively). After correction for non-modifiable patient and tumour characteristics, no relevant hospital or oncological network variation in five-year OS was observed.

CONCLUSION

In patients eligible for surgical resection, preoperative chemotherapy does not provide an overall survival benefit compared to surgery alone.

Benchmarking of survival outcomes following Haematopoietic Stem Cell Transplantation (HSCT): an update of the ongoing project of the European Society for Blood and Marrow Transplantation (EBMT) and Joint Accreditation Committee of ISCT and EBMT (JACIE)

From 2016 EBMT and JACIE developed an international risk-adapted benchmarking program of haematopoietic stem cell transplant (HSCT) outcome to provide individual EBMT Centers with a means of quality-assuring the HSCT process and meeting FACT-JACIE accreditation requirements relating to 1-year survival outcomes. Informed by previous experience from Europe, North America and Australasia, the Clinical Outcomes Group (COG) established criteria for patient and Center selection, and a set of key clinical variables within a dedicated statistical model adapted to the capabilities of the EBMT Registry. The first phase of the project was launched in 2019 to test the acceptability of the benchmarking model through assessment of Centers' performance for 1-year data completeness and survival outcomes of autologous and allogeneic HSCT covering 2013-2016. A second phase was delivered in July 2021 covering 2015-2019 and including survival outcomes. Reports of individual Center performance were shared directly with local principal investigators and their responses were assimilated. The experience thus far has supported the feasibility, acceptability and reliability of the system as well as identifying its limitations. We provide a summary of experience and learning so far in this 'work in progress', as well as highlighting future challenges of delivering a modern, robust, data-complete, risk-adapted benchmarking program across new EBMT Registry systems.