Validation of Models Used to Inform Colorectal Cancer Screening Guidelines: Accuracy and Implications

Stress-testing US colorectal cancer screening guidelines: Decennial colonoscopy from age 45 is robust to natural history uncertainty and colonoscopy sensitivity assumptions

PurposeThe 2023 American College of Physicians (ACP) guidelines for colorectal cancer (CRC) screening are at odds with the United States Preventive Task Force (USPSTF) guidelines, with the former recommending screening starting at age 50 y and the latter at age 45 y. This article "stress tests" CRC colonoscopy screening strategies to investigate their robustness to uncertainties stemming from the natural history of disease and sensitivity of colonoscopy.MethodsThis study uses the CRC-SPIN microsimulation model to project the life-years gained (LYG) under several colonoscopy CRC screening strategies. The model was extended to include birth cohort effects on adenoma risk. We estimated natural history parameters under 2 different assumptions about the youngest age of adenoma initiation. For each, we generated 500 parameter sets to reflect uncertainty in the natural history parameters. We simulated 26 colonoscopy screening strategies and examined 4 different colonoscopy sensitivity assumptions, encompassing the range of sensitivities consistent with prior tandem colonoscopy studies. Across this set of scenarios, we identify efficient screening strategies and report posterior credible intervals for benefits of screening (LYG), burden (number of colonoscopies), and incremental burden-effectiveness ratios.ResultsProjected absolute screening benefits varied widely based on assumptions, but strategies starting at age 45 y were consistently in the efficiency frontier. Strategies in which screening starts at age 50 y with 10-y intervals were never efficient, saving fewer life-years than starting screening at age 45 y and performing colonoscopies every 15 y while requiring more colonoscopies per person.ConclusionsDecennial colonoscopy screening initiation at age 45 y remained a robust recommendation. Colonoscopy screening with a 10-y interval starting at age 50 y did not result in an efficient use of colonoscopies in any of the scenarios evaluated.HighlightsColorectal cancer colonoscopy screening strategies initiated at age 45 y were projected to yield more life-years gained while requiring the least number of colonoscopies across different model assumptions about disease natural history and colonoscopy sensitivity.Colonoscopy screening starting at age 50 y with a 10-y interval consistently underperformed strategies that started at age 45 y.

Projected Colorectal Cancer Incidence and Mortality Based on Observed Adherence to Colonoscopy and Sequential Stool-Based Screening

INTRODUCTION

Modeling supporting recommendations for colonoscopy and stool-based colorectal cancer (CRC) screening tests assumes 100% sequential participant adherence. The impact of observed adherence on the long-term effectiveness of screening is unknown. We evaluated the effectiveness of a program of screening colonoscopy every 10 years vs annual high-sensitivity guaiac-based fecal occult blood testing (HSgFOBT) using observed sequential adherence data.

METHODS

The MIcrosimulation SCreening ANalysis (MISCAN) model used observed sequential screening adherence, HSgFOBT positivity, and diagnostic colonoscopy adherence in HSgFOBT-positive individuals from the National Colonoscopy Study (single-screening colonoscopy vs ≥4 HSgFOBT sequential rounds). We compared CRC incidence and mortality over 15 years with no screening or 10 yearly screening colonoscopy vs annual HSgFOBT with 100% and differential observed adherence from the trial.

RESULTS

Without screening, simulated incidence and mortality over 15 years were 20.9 (95% probability interval 15.8-26.9) and 6.9 (5.0-9.2) per 1,000 participants, respectively. In the case of 100% adherence, only screening colonoscopy was predicted to result in lower incidence; however, both tests lowered simulated mortality to a similar level (2.1 [1.6-2.9] for screening colonoscopy and 2.5 [1.8-3.4] for HSgFOBT). Observed adherence for screening colonoscopy (83.6%) was higher than observed sequential HSgFOBT adherence (73.1% first round; 49.1% by round 4), resulting in lower simulated incidence and mortality for screening colonoscopy (14.4 [10.8-18.5] and 2.9 [2.1-3.9], respectively) than HSgFOBT (20.8 [15.8-28.1] and 3.9 [2.9-5.4], respectively), despite a 91% adherence to diagnostic colonoscopy with FOBT positivity. The relative risk of CRC mortality for screening colonoscopy vs HSgFOBT was 0.75 (95% probability interval 0.68-0.80). Findings were similar in sensitivity analyses with alternative assumptions for repeat colonoscopy, test performance, risk, age, and projection horizon.

DISCUSSION

Where sequential adherence to stool-based screening is suboptimal and colonoscopy is accessible and acceptable-as observed in the national colonoscopy study, microsimulation, comparative effectiveness, screening recommendations.

Cost-utility analysis of expanding the colorectal cancer screening policy in Flanders

OBJECTIVE

Since 2013, Flanders has introduced a screening programme for colorectal cancer for all citizens aged between 50 and 74 years. The objective of this study was to assess the cost-utility of an expansion of the colorectal cancer screening policy in Flanders (Belgium) and to place these findings in the international context.

METHODS

Cost-utility analysis using high-detail data about screening participation, screening results, and epidemiological data, a Markov cohort model has been constructed to study long-term costs and effects. A cost-utility analysis was performed as a three-way comparison between current, expanded (from age 45 years), and no screening scenarios, from a societal and healthcare perspective. Robustness was assessed by both one-way and probabilistic sensitivity analyses.

RESULTS

Analyses show that both current and expanded screening result in quality-adjusted life years (QALY) gains and are mostly cost-saving. Overall, 97.5% of Incremental Cost-Effectiveness Ratios (ICERs) remained well below € 2000 per QALY for all comparisons. Parameters related to the colonoscopy that follows a positive test result such as compliance and cost are especially impactful on the cost-effectiveness.

CONCLUSIONS

Screening participation and screening costs have remained comparatively stable, making colorectal cancer screening a cost-effective (dominant) policy. Expanding the screen age to 45 years is also cost-effective (dominant) compared with current screening, albeit with a slimmer margin.

Benefit-Harm Analysis for Informed Decision Making on Participating in Colorectal Cancer Screening: A Modeling Study

OBJECTIVES

To facilitate informed decision making on participating in colorectal cancer (CRC) screening, we assessed the benefit-harm balance of CRC screening for a wide range of subgroups over different time horizons.

METHODS

The study combined incidence proportions of benefits and harms of (not) participating in CRC screening estimated by the Adenoma and Serrated pathway to CAncer microsimulation model, a preference eliciting survey, and benefit-harm balance modeling combining all outcomes to determine the net health benefit of CRC screening over 10, 20, and 30 years. Probability of net health benefit was estimated for 210 different subgroups based on age, sex, previous participation in CRC screening, and lifestyle.

RESULTS

CRC screening was net beneficial in 183 of 210 subgroups over 30 years (median probability [MP] of 0.79, interquartile range [IQR] of 0.69-0.85) across subgroups. Net health benefit was greater for men (MP 0.82; IQR 0.69-0.89) than women (MP 0.76; IQR 0.67-0.83) and for those without history of participation in previous screenings (MP 0.84; IQR 0.80-0.89) compared with those with (MP 0.69; IQR 0.59-0.75). Net health benefit decreased with increasing age, from MP of 0.84 (IQR 0.80-0.86) at age 55 to 0.61 (IQR 0.56-0.71) at age 75. Shorter time horizons led to lower benefit, with MP of 0.70 (IQR 0.62-0.80) over 20 years and 0.54 (IQR 0.48-0.67) over 10 years.

CONCLUSIONS

Our benefit-harm analysis provides information about net health benefit of screening participation, based on important characteristics and preferences of individuals, which could assist screening invitees in making informed decisions on screening participation.

Estimated US Cancer Deaths Prevented With Increased Use of Lung, Colorectal, Breast, and Cervical Cancer Screening

Importance

Increased use of recommended screening could help achieve the Cancer Moonshot goal of reducing US cancer deaths.

Objective

To estimate the number of cancer deaths that could be prevented with a 10-percentage point increase in the use of US Preventive Services Task Force (USPSTF)-recommended screening.

Design, Setting, and Participants

This decision analytical model study is an extension of previous studies conducted for the USPSTF from 2018 to 2023. This study simulated contemporary cohorts of US adults eligible for lung, colorectal, breast, and cervical cancer screening.

Exposures

Annual low-dose computed lung tomography among eligible adults aged 50 to 80 years; colonoscopy every 10 years among adults aged 45 to 75 years; biennial mammography among female adults aged 40 to 74 years; and triennial cervical cytology screening among female adults aged 21 to 29 years, followed by human papillomavirus testing every 5 years from ages 30 to 65 years.

Main Outcomes and Measures

Estimated number of cancer deaths prevented with a 10-percentage point increase in screening use, assuming screening commences at the USPSTF-recommended starting age and continues throughout the lifetime. Outcomes were presented 2 ways: (1) per 100 000 and (2) among US adults in 2021; and they were expressed among the target population at the age of screening initiation. For lung cancer, estimates were among those who will also meet the smoking eligibility criteria during their lifetime. Harms from increased uptake were also reported.

Results

A 10-percentage point increase in screening use at the age that USPSTF recommended screening commences was estimated to prevent 226 lung cancer deaths (range across models within the cancer site, 133-332 deaths), 283 (range, 263-313) colorectal cancer deaths, 82 (range, 61-106) breast cancer deaths, and 81 (1 model; no range available) cervical cancer deaths over the lifetimes of 100 000 persons eligible for screening. These rates corresponded with an estimated 1010 (range, 590-1480) lung cancer deaths prevented, 11 070 (range, 10 280-12 250) colorectal cancer deaths prevented, 1790 (range, 1330-2310) breast cancer deaths prevented, and 1710 (no range available) cervical cancer deaths prevented over the lifetimes of eligible US residents at the recommended age to initiate screening in 2021. Increased uptake was also estimated to generate harms, including 100 000 (range, 45 000-159 000) false-positive lung scans, 6000 (range, 6000-7000) colonoscopy complications, 300 000 (range, 295 000-302 000) false-positive mammograms, and 348 000 (no range available) colposcopies over the lifetime.

Conclusions and Relevance

In this decision analytical model study, a 10-percentage point increase in uptake of USPSTF-recommended lung, colorectal, breast, and cervical cancer screening at the recommended starting age was estimated to yield important reductions in cancer deaths. Achieving these reductions is predicated on ensuring equitable access to screening.

Comparison of Simulated Outcomes Between Stool- and Blood-Based Colorectal Cancer Screening Tests

The Centers for Medicare & Medicaid Services (CMS) recommend covering blood-based tests meeting proposed minimum performance thresholds for colorectal cancer (CRC) screening. Outcomes were compared between currently available stool-based screening tests and a hypothetical blood-based test meeting CMS minimum thresholds. Using the Colorectal Cancer and Adenoma Incidence and Mortality Microsimulation Model (CRC-AIM), outcomes were simulated for average-risk individuals screened between ages 45 and 75 years with triennial multitarget stool DNA (mt-sDNA), annual fecal immunochemical test (FIT), and annual fecal occult blood test (FOBT). Per CMS guidance, blood-based CRC screening was modeled triennially, with 74% CRC sensitivity and 90% specificity. Although not specified by CMS, adenoma sensitivity was set between 10% and 20%. Published adenoma and CRC sensitivity and specificity were used for stool-based tests. Adherence was set at (1) 100%, (2) 30%-70%, in 10% increments, and (3) real-world rates for stool-based tests (mt-sDNA = 65.6%; FIT = 42.6%; FOBT = 34.4%). Assuming perfect adherence, a blood-based test produced ≥19 lower life-years gained (LYG) than stool-based strategies. At the best-case scenario for blood-based tests (100% adherence and 20% adenoma sensitivity), mt-sDNA at real-world adherence achieved more LYG (287.2 vs. 297.1, respectively) with 14% fewer colonoscopies. At 100% blood-based test adherence and real-world mt-sDNA and FIT adherence, the blood-based test would require advanced adenoma sensitivity of 30% to reach the LYG of mt-sDNA (297.1) and ∼15% sensitivity to reach the LYG of FIT (258.9). This model suggests that blood-based tests with CMS minimally acceptable CRC sensitivity and low advanced adenoma sensitivity will frequently yield inferior outcomes to stool-based testing across a wide range of adherence assumptions.

Calibration and Validation of the Colorectal Cancer and Adenoma Incidence and Mortality (CRC-AIM) Microsimulation Model Using Deep Neural Networks

OBJECTIVES

Machine learning (ML)-based emulators improve the calibration of decision-analytical models, but their performance in complex microsimulation models is yet to be determined.

METHODS

We demonstrated the use of an ML-based emulator with the Colorectal Cancer (CRC)-Adenoma Incidence and Mortality (CRC-AIM) model, which includes 23 unknown natural history input parameters to replicate the CRC epidemiology in the United States. We first generated 15,000 input combinations and ran the CRC-AIM model to evaluate CRC incidence, adenoma size distribution, and the percentage of small adenoma detected by colonoscopy. We then used this data set to train several ML algorithms, including deep neural network (DNN), random forest, and several gradient boosting variants (i.e., XGBoost, LightGBM, CatBoost) and compared their performance. We evaluated 10 million potential input combinations using the selected emulator and examined input combinations that best estimated observed calibration targets. Furthermore, we cross-validated outcomes generated by the CRC-AIM model with those made by CISNET models. The calibrated CRC-AIM model was externally validated using the United Kingdom Flexible Sigmoidoscopy Screening Trial (UKFSST).

RESULTS

The DNN with proper preprocessing outperformed other tested ML algorithms and successfully predicted all 8 outcomes for different input combinations. It took 473 s for the trained DNN to predict outcomes for 10 million inputs, which would have required 190 CPU-years without our DNN. The overall calibration process took 104 CPU-days, which included building the data set, training, selecting, and hyperparameter tuning of the ML algorithms. While 7 input combinations had acceptable fit to the targets, a combination that best fits all outcomes was selected as the best vector. Almost all of the predictions made by the best vector laid within those from the CISNET models, demonstrating CRC-AIM's cross-model validity. Similarly, CRC-AIM accurately predicted the hazard ratios of CRC incidence and mortality as reported by UKFSST, demonstrating its external validity. Examination of the impact of calibration targets suggested that the selection of the calibration target had a substantial impact on model outcomes in terms of life-year gains with screening.

CONCLUSIONS

Emulators such as a DNN that is meticulously selected and trained can substantially reduce the computational burden of calibrating complex microsimulation models.

HIGHLIGHTS

Calibrating a microsimulation model, a process to find unobservable parameters so that the model fits observed data, is computationally complex.We used a deep neural network model, a popular machine learning algorithm, to calibrate the Colorectal Cancer Adenoma Incidence and Mortality (CRC-AIM) model.We demonstrated that our approach provides an efficient and accurate method to significantly speed up calibration in microsimulation models.The calibration process successfully provided cross-model validation of CRC-AIM against 3 established CISNET models and also externally validated against a randomized controlled trial.

Effectiveness of Colorectal Cancer (CRC) Screening on All-Cause and CRC-Specific Mortality Reduction: A Systematic Review and Meta-Analysis

(1) Background: The aim of this study was to pool and compare all-cause and colorectal cancer (CRC) specific mortality reduction of CRC screening in randomized control trials (RCTs) and simulation models, and to determine factors that influence screening effectiveness. (2) Methods: PubMed, Embase, Web of Science and Cochrane library were searched for eligible studies. Multi-use simulation models or RCTs that compared the mortality of CRC screening with no screening in general population were included. CRC-specific and all-cause mortality rate ratios and 95% confidence intervals were calculated by a bivariate random model. (3) Results: 10 RCTs and 47 model studies were retrieved. The pooled CRC-specific mortality rate ratios in RCTs were 0.88 (0.80, 0.96) and 0.76 (0.68, 0.84) for guaiac-based fecal occult blood tests (gFOBT) and single flexible sigmoidoscopy (FS) screening, respectively. For the model studies, the rate ratios were 0.45 (0.39, 0.51) for biennial fecal immunochemical tests (FIT), 0.31 (0.28, 0.34) for biennial gFOBT, 0.61 (0.53, 0.72) for single FS, 0.27 (0.21, 0.35) for 10-yearly colonoscopy, and 0.35 (0.29, 0.42) for 5-yearly FS. The CRC-specific mortality reduction of gFOBT increased with higher adherence in both studies (RCT: 0.78 (0.68, 0.89) vs. 0.92 (0.87, 0.98), model: 0.30 (0.28, 0.33) vs. 0.92 (0.51, 1.63)). Model studies showed a 0.62-1.1% all-cause mortality reduction with single FS screening. (4) Conclusions: Based on RCTs and model studies, biennial FIT/gFOBT, single and 5-yearly FS, and 10-yearly colonoscopy screening significantly reduces CRC-specific mortality. The model estimates are much higher than in RCTs, because the simulated biennial gFOBT assumes higher adherence. The effectiveness of screening increases at younger screening initiation ages and higher adherences.

The role of modeling studies in asthma management and clinical decision-making: a Delphi survey of physician knowledge and perceptions

OBJECTIVE

To investigate the knowledge and perceptions of physicians on the role of modeling studies in asthma, using a modified Delphi procedure.

METHODS

Group opinions among a panel of respiratory experts were obtained using two online questionnaires and a virtual scientific workshop. A consensus was pre-defined as agreement by >75% of participants.

RESULTS

From 26 experts who agreed to participate, 22 completed both surveys. At the end of the process, the panel rated their own understanding of modeling as good (77%) but that among physicians in general as poor (77%). Participants agreed that data from modeling studies should be used, at least sometimes, to inform treatment guidelines (91%) and could be useful for guiding clinical decisions (100%). Perceived barriers to using modeling studies were 'A lack of understanding' (81%) and 'A lack of standardized methodology' (82%). Based on data from two modeling studies, no consensus was reached on physicians recommending regular inhaled corticosteroids (ICS) versus as-needed therapy for patients with mild asthma, whereas 77% agreed that they would recommend regular ICS over maintenance and reliever therapy for ≥80% of their patients with moderate asthma. No consensus was reached on the value of modeling data in relation to empirical data.

CONCLUSION

There is overall support among respiratory experts for the usefulness of modeling data to guide asthma treatment guidelines and clinical decision making. More publications on modeling data using robust models and accessible terminology will aid the understanding of physicians in general and help clarify the evidence-based value of modeling studies.

Modeling the Natural History and Screening Effects of Colorectal Cancer Using Both Adenoma and Serrated Neoplasia Pathways: The Development, Calibration, and Validation of a Discrete Event Simulation Model

Background. Existing colorectal cancer (CRC) screening models mostly focus on the adenoma pathway of CRC development, overlooking the serrated neoplasia pathway, which might result in overly optimistic screening predictions. In addition, Bayesian inference methods have not been widely used for model calibration. We aimed to develop a CRC screening model accounting for both pathways, calibrate it with approximate Bayesian computation (ABC) methods, and validate it with large CRC screening trials. Methods. A discrete event simulation (DES) of the CRC natural history (DECAS) was constructed using the adenoma and serrated pathways in R software. The model simulates CRC-related events in a specific birth cohort through various natural history states. Calibration took advantage of 74 prevalence data points from the German screening colonoscopy program of 5.2 million average-risk participants using an ABC method. CRC incidence outputs from DECAS were validated with the German national cancer registry data; screening effects were validated using 17-y data from the UK Flexible Sigmoidoscopy Screening sigmoidoscopy trial and a German screening colonoscopy cohort study. Results. The Bayesian calibration rendered 1,000 sets of posterior parameter samples. With the calibrated parameters, the observed age- and sex-specific CRC prevalences from the German registries were within the 95% DECAS-predicted intervals. Regarding screening effects, DECAS predicted a 41% (95% intervals 30%-51%) and 62% (95% intervals 55%-68%) reduction in 17-y cumulative CRC mortality for a single screening sigmoidoscopy and colonoscopy, respectively, falling within 95% confidence intervals reported in the 2 clinical studies used for validation. Conclusions. We presented DECAS, the first Bayesian-calibrated DES model for CRC natural history and screening, accounting for 2 CRC tumorigenesis pathways. The validated model can serve as a valid tool to evaluate the (cost-)effectiveness of CRC screening strategies.

Highlights

This article presents a new discrete event simulation model, DECAS, which models both adenoma-carcinoma and serrated neoplasia pathways for colorectal cancer (CRC) development and CRC screening effects.DECAS is calibrated based on a Bayesian inference method using the data from German screening colonoscopy program, which consists of more than 5 million first-time average-risk participants aged 55 years and older in 2003 to 2014.DECAS is flexible for evaluating various CRC screening strategies and can differentiate screening effects in different parts of the colon.DECAS is validated with large screening sigmoidoscopy and colonoscopy clinical study data and can be further used to evaluate the (cost-)effectiveness of German colorectal cancer screening strategies.

Cost-effectiveness analysis of colorectal cancer screening in Shanghai, China: a modelling study

•

The current Shanghai CRC screening program is cost-effective.

•

Changing to a validated FIT would make the program more efficient.

•

The results were sensitive to an increase in the cost of the validated FIT.

•

The results were sensitive to more participation in screening and colonoscopy.

Background

The current community-based colorectal cancer (CRC) screening program in Shanghai, launched in 2013, invited individuals aged 50–74 years to triennial screening with a qualitative faecal immunochemical test (FIT) and questionnaire-based risk assessment (RA). We aimed to evaluate the effectiveness and cost-effectiveness of the existing Shanghai screening program and compare it to using a validated two-sample quantitative FIT.

Methods

We simulated four strategies (no screening, Shanghai FIT, Shanghai FIT + RA and validated FIT) for the Shanghai screening program and evaluated CRC incidence, CRC mortality, the number of life years gained (LYG), the number of FITs, and colonoscopies required for each. An incremental cost-effectiveness analysis was performed to assess the cost- effectiveness of each strategy.

Results

All screening modalities reduced CRC incidence and CRC mortality, gained extra number of LYG compared to no screening. Screening using the Shanghai FIT and validated FIT reduced CRC incidence from 45 cases to 43 per 1,000 simulated individuals (4.4%). Incidence was reduced to 42 cases (6.7%) using the Shanghai FIT + RA. All screening strategies reduced CRC mortality by 10.0% (from 10 to 9 deaths) and resulted in 6 to 7 LYG. The validated FIT was the most cost-effective among the evaluated strategies (ICER ¥26,461 per LYG).

Conclusions

Our findings show that the current Shanghai screening program is (cost-) effective compared to no screening, but changing to a validated FIT would make the program more efficient.

Optimising colorectal cancer screening in Shanghai, China: a modelling study

INTRODUCTION

To reduce the burden of colorectal cancer (CRC) in Shanghai, China, a CRC screening programme was commenced in 2013 inviting those aged 50-74 years to triennial screening with a faecal immunochemical test (FIT) and risk assessment. However, it is unknown whether this is the optimal screening strategy for this population. We aimed to determine the optimal CRC screening programme for Shanghai in terms of benefits, burden, harms and cost-effectiveness.

METHODS

Using Microsimulation Screening Analysis-Colon (MISCAN-Colon), we estimated the costs and effects of the current screening programme compared with a situation without screening. Subsequently, we estimated the benefits (life years gained (LYG)), burden (number of screening events, colonoscopies and false-positive tests), harms (number of colonoscopy complications) and costs (Renminb (¥)) of screening for 324 alternative screening strategies. We compared several different age ranges, screening modalities, intervals and FIT cut-off levels. An incremental cost-effectiveness analysis determined the optimal strategy assuming a willingness-to-pay of ¥193 931 per LYG.

RESULTS

Compared with no screening, the current screening programme reduced CRC incidence by 40% (19 cases per 1000 screened individuals) and CRC mortality by 67% (7 deaths). This strategy gained 32 additional life years, increased colonoscopy demand to 1434 per 1000 individuals and cost an additional ¥199 652. The optimal screening strategy was annual testing using a validated one-sample FIT, with a cut-off of 10 µg haemoglobin per gram from ages 45 to 80 years (incremental cost-effectiveness ratio, ¥62 107). This strategy increased LY by 0.18% and costs by 27%. Several alternative cost-effective strategies using a validated FIT offered comparable benefits to the current programme but lower burden and costs.

CONCLUSIONS

Although the current screening programme in Shanghai is effective at reducing CRC incidence and mortality, the programme could be optimised using a validated FIT. When implementing CRC screening, jurisdictions with limited health resources should use a validated test.

Sequentially calibrating a Bayesian microsimulation model to incorporate new information and assumptions

BACKGROUND

Microsimulation models are mathematical models that simulate event histories for individual members of a population. They are useful for policy decisions because they simulate a large number of individuals from an idealized population, with features that change over time, and the resulting event histories can be summarized to describe key population-level outcomes. Model calibration is the process of incorporating evidence into the model. Calibrated models can be used to make predictions about population trends in disease outcomes and effectiveness of interventions, but calibration can be challenging and computationally expensive.

METHODS

This paper develops a technique for sequentially updating models to take full advantage of earlier calibration results, to ultimately speed up the calibration process. A Bayesian approach to calibration is used because it combines different sources of evidence and enables uncertainty quantification which is appealing for decision-making. We develop this method in order to re-calibrate a microsimulation model for the natural history of colorectal cancer to include new targets that better inform the time from initiation of preclinical cancer to presentation with clinical cancer (sojourn time), because model exploration and validation revealed that more information was needed on sojourn time, and that the predicted percentage of patients with cancers detected via colonoscopy screening was too low.

RESULTS

The sequential approach to calibration was more efficient than recalibrating the model from scratch. Incorporating new information on the percentage of patients with cancers detected upon screening changed the estimated sojourn time parameters significantly, increasing the estimated mean sojourn time for cancers in the colon and rectum, providing results with more validity.

CONCLUSIONS

A sequential approach to recalibration can be used to efficiently recalibrate a microsimulation model when new information becomes available that requires the original targets to be supplemented with additional targets.

Colorectal Cancer Screening within Colonoscopy Capacity Constraints: Can FIT-Based Programs Save More Lives by Trading off More Sensitive Test Cutoffs against Longer Screening Intervals?

Introduction. Colorectal cancer (CRC) prevention programs using fecal immunochemical testing (FIT) in screening rely on colonoscopy for secondary and surveillance testing. Colonoscopy capacity is an important constraint. Some European programs lack sufficient capacity to provide optimal screening intensity regarding age ranges, intervals, and FIT cutoffs. It is currently unclear how to optimize programs within colonoscopy capacity constraints. Design. Microsimulation modeling, using the MISCAN-Colon model, was used to determine if more effective CRC screening programs can be identified within constrained colonoscopy capacity. A total of 525 strategies were modeled and compared, varying 3 key screening parameters: screening intervals, age ranges, and FIT cutoffs, including previously unevaluated 4- and 5-year screening intervals (using a lifetime horizon and 100% adherence). Results were compared with the policy decisions taken in Ireland to provide CRC screening within available colonoscopy capacity. Outcomes estimated net costs, quality-adjusted life-years (QALYs), and required colonoscopies. The optimal strategies within finite colonoscopy capacity constraints were identified. Results. Combining a reduced FIT cutoff of 10 µg Hb/g, an extended screening interval of 4 y and an age range of 60–72 y requires 6% fewer colonoscopies, reduces net costs by 23% while preventing 15% more CRC deaths and saving 16% more QALYs relative to a strategy (FIT 40 µg Hb/g, 2-yearly, 60–70 year) approximating current policy. Conclusion. Previously overlooked longer screening intervals may optimize cancer prevention with finite colonoscopy capacity constraints. Changes could save lives, reduce costs, and relieve colonoscopy capacity pressures. These findings are relevant to CRC screening programs across Europe that employ FIT-based testing, which face colonoscopy capacity constraints.

Colorectal Cancer Screening: An Updated Modeling Study for the US Preventive Services Task Force

Importance

The US Preventive Services Task Force (USPSTF) is updating its 2016 colorectal cancer screening recommendations.

Objective

To provide updated model-based estimates of the benefits, burden, and harms of colorectal cancer screening strategies and to identify strategies that may provide an efficient balance of life-years gained (LYG) from screening and colonoscopy burden to inform the USPSTF.

Design, Setting, and Participants

Comparative modeling study using 3 microsimulation models of colorectal cancer screening in a hypothetical cohort of 40-year-old US individuals at average risk of colorectal cancer.

Exposures

Screening from ages 45, 50, or 55 years to ages 70, 75, 80, or 85 years with fecal immunochemical testing (FIT), multitarget stool DNA testing, flexible sigmoidoscopy alone or with FIT, computed tomography colonography, or colonoscopy. All persons with an abnormal noncolonoscopy screening test result were assumed to undergo follow-up colonoscopy. Screening intervals varied by test. Full adherence with all procedures was assumed.

Main Outcome and Measures

Estimated LYG relative to no screening (benefit), lifetime number of colonoscopies (burden), number of complications from screening (harms), and balance of incremental burden and benefit (efficiency ratios). Efficient strategies were those estimated to require fewer additional colonoscopies per additional LYG relative to other strategies.

Results

Estimated LYG from screening strategies ranged from 171 to 381 per 1000 40-year-olds. Lifetime colonoscopy burden ranged from 624 to 6817 per 1000 individuals, and screening complications ranged from 5 to 22 per 1000 individuals. Among the 49 strategies that were efficient options with all 3 models, 41 specified screening beginning at age 45. No single age to end screening was predominant among the efficient strategies, although the additional LYG from continuing screening after age 75 were generally small. With the exception of a 5-year interval for computed tomography colonography, no screening interval predominated among the efficient strategies for each modality. Among the strategies highlighted in the 2016 USPSTF recommendation, lowering the age to begin screening from 50 to 45 years was estimated to result in 22 to 27 additional LYG, 161 to 784 additional colonoscopies, and 0.1 to 2 additional complications per 1000 persons (ranges are across screening strategies, based on mean estimates across models). Assuming full adherence, screening outcomes and efficient strategies were similar by sex and race and across 3 scenarios for population risk of colorectal cancer.

Conclusions and Relevance

This microsimulation modeling analysis suggests that screening for colorectal cancer with stool tests, endoscopic tests, or computed tomography colonography starting at age 45 years provides an efficient balance of colonoscopy burden and life-years gained.

Impact of screening and follow-up colonoscopy adenoma sensitivity on colorectal cancer screening outcomes in the CRC-AIM microsimulation model

BACKGROUND

Real-world data for patients with positive colorectal cancer (CRC) screening stool-tests demonstrate that adenoma detection rates are lower when endoscopists are blinded to the stool-test results. This suggests adenoma sensitivity may be lower for screening colonoscopy than for follow-up to a known positive stool-based test. Previous CRC microsimulation models assume identical sensitivities between screening and follow-up colonoscopies after positive stool-tests. The Colorectal Cancer and Adenoma Incidence and Mortality Microsimulation Model (CRC-AIM) was used to explore the impact on screening outcomes when assuming different adenoma sensitivity between screening and combined follow-up/surveillance colonoscopies.

METHODS

Modeled screening strategies included colonoscopy every 10 years, triennial multitarget stool DNA (mt-sDNA), or annual fecal immunochemical test (FIT) from 50 to 75 years. Outcomes were reported per 1000 individuals without diagnosed CRC at age 40. Base-case adenoma sensitivity values were identical for screening and follow-up/surveillance colonoscopies. Ranges of adenoma sensitivity values for colonoscopy performance were developed using different slopes of odds ratio adjustments and were designated as small, medium, or large impact scenarios.

RESULTS

As the differences in adenoma sensitivity for screening versus follow-up/surveillance colonoscopies became greater, life-years gained (LYG) and reductions in CRC-related incidence and mortality versus no screening increased for mt-sDNA and FIT and decreased for screening colonoscopy. The LYG relative to screening colonoscopy reached >90% with FIT in the base-case scenario and with mt-sDNA in a "medium impact" scenario.

CONCLUSIONS

Assuming identical adenoma sensitivities for screening and follow-up/surveillance colonoscopies underestimate the potential benefits of stool-based screening strategies.

Development and Validation of Three Regional Microsimulation Models for Predicting Colorectal Cancer Screening Benefits in Europe

Background. Validated microsimulation models have been shown to be useful tools in providing support for colorectal cancer (CRC) screening decisions. Aiming to assist European countries in reducing CRC mortality, we developed and validated three regional models for evaluating CRC screening in Europe. Methods. Microsimulation Screening Analysis–Colon (MISCAN-Colon) model versions for Italy, Slovenia, and Finland were quantified using data from different national institutions. These models were validated against the best available evidence for the effectiveness of screening from their region (when available): the Screening for COlon REctum (SCORE) trial and the Florentine fecal immunochemical test (FIT) screening study for Italy; the Norwegian Colorectal Cancer Prevention (NORCCAP) trial and the guaiac fecal occult blood test (gFOBT) Finnish population-based study for Finland. When published evidence was not available (Slovenia), the model was validated using cancer registry data. Results. Our three models reproduced age-specific CRC incidence rates and stage distributions in the prescreening period. Moreover, the Italian and Finnish models replicated CRC mortality reductions (reasonably) well against the best available evidence. CRC mortality reductions were predicted slightly larger than those observed (except for the Florentine FIT study), but consistently within the corresponding 95% confidence intervals. Conclusions. Our findings corroborate the MISCAN-Colon reliability in supporting decision making on CRC screening. Furthermore, our study provides the model structure for an additional tool (EU-TOPIA CRC evaluation tool: http://miscan.eu-topia.org) that aims to help policymakers and researchers monitoring or improving CRC screening in Europe.

Harms and Benefits of Cancer Screening

In recommending and offering screening, health services make a health claim ('it's good for you'). This article considers ethical aspects of establishing the case for cancer screening, building a service programme, monitoring its operation, improving its quality and integrating it with medical progress. The value of (first) screening is derived as a function of key parameters: prevalence of the target lesion in the detectable pre-clinical phase, the validity of the test and the respective net utilities or values attributed to four health states-true positives, false positives, false negatives and true negatives. Decision makers as diverse as public regulatory agencies, medical associations, health insurance funds or individual screenees can legitimately come up with different values even when presented with the same evidence base. The main intended benefit of screening is the reduction of cause-specific mortality. All-cause mortality is not measurably affected. Overdiagnosis and false-positive tests with their sequelae are the main harms. Harms and benefits accrue to distinct individuals. Hence the health claim is an invitation to a lottery with benefits for few and harms to many, a violation of the non-maleficence principle. While a public decision maker may still propose a justified screening programme, respect for individual rights and values requires preference-sensitive, autonomy-enhancing educational materials-even at the expense of programme effectiveness. Opt-in recommendations and more 'consumer-oriented' qualitative research are needed.

Estimating the impact of differential adherence on the comparative effectiveness of stool-based colorectal cancer screening using the CRC-AIM microsimulation model

BACKGROUND

Real-world adherence to colorectal cancer (CRC) screening strategies is imperfect. The CRC-AIM microsimulation model was used to estimate the impact of imperfect adherence on the relative benefits and burdens of guideline-endorsed, stool-based screening strategies.

METHODS

Predicted outcomes of multi-target stool DNA (mt-sDNA), fecal immunochemical tests (FIT), and high-sensitivity guaiac-based fecal occult blood tests (HSgFOBT) were simulated for 40-year-olds free of diagnosed CRC. For robustness, imperfect adherence was incorporated in multiple ways and with extensive sensitivity analysis. Analysis 1 assumed adherence from 0%-100%, in 10% increments. Analysis 2 longitudinally applied real-world first-round differential adherence rates (base-case imperfect rates = 40% annual FIT vs 34% annual HSgFOBT vs 70% triennial mt-sDNA). Analysis 3 randomly assigned individuals to receive 1, 5, or 9 lifetime (9 = 100% adherence) mt-sDNA tests and 1, 5, or 9 to 26 (26 = 100% adherence) FIT tests. Outcomes are reported per 1000 individuals compared with no screening.

RESULTS

Each screening strategy decreased CRC incidence and mortality versus no screening. In individuals screened between ages 50-75 and adherence ranging from 10%a-100%, the life-years gained (LYG) for triennial mt-sDNA ranged from 133.1-300.0, for annual FIT from 96.3-318.1, and for annual HSgFOBT from 99.8-320.6. At base-case imperfect adherence rates, mt-sDNA resulted in 19.1% more LYG versus FIT, 25.4% more LYG versus HSgFOBT, and generally had preferable efficiency ratios while offering the most LYG. Completion of at least 21 FIT tests is needed to reach approximately the same LYG achieved with 9 mt-sDNA tests.

CONCLUSIONS

Adherence assumptions affect the conclusions of CRC screening microsimulations that are used to inform CRC screening guidelines. LYG from FIT and HSgFOBT are more sensitive to changes in adherence assumptions than mt-sDNA because they require more tests be completed for equivalent benefit. At imperfect adherence rates, mt-sDNA provides more LYG than FIT or HSgFOBT at an acceptable tradeoff in screening burden.

Validation of Colorectal Cancer Models on Long-term Outcomes from a Randomized Controlled Trial

Microsimulation models are often used to predict long-term outcomes and guide policy decisions regarding cancer screening. The United Kingdom Flexible Sigmoidoscopy Screening (UKFSS) Trial examines a one-time intervention of flexible sigmoidoscopy that was implemented before a colorectal cancer (CRC) screening program was established. Long-term study outcomes, now a full 17 y following randomization, have been published. We use the outcomes from this trial to validate 3 microsimulation models for CRC to long-term study outcomes. We find that 2 of 3 models accurately predict the relative effect of screening (the hazard ratios) on CRC-specific incidence 17 y after screening. We find that all 3 models yield predictions of the relative effect of screening on CRC incidence and mortality (i.e., the hazard ratios) that are reasonably close to the UKFSS results. Two of the 3 models accurately predict the relative reduction in CRC incidence 17 y after screening. One model accurately predicted the absolute incidence and mortality rates in the screened group. The models differ in their estimates related to adenoma detection at screening. Although high-quality screening results help to inform models, trials are expensive, last many years, and can be complicated by ethical issues and technological changes across the duration of the trial. Thus, well-calibrated and validated models are necessary to predict outcomes for which data are not available. The results from this validation demonstrate the utility of models in predicting long-term outcomes and in collaborative modeling to account for uncertainty.

Cost of Increasing Years-of-Life-Gained (YLG) Using Fecal Immunochemical Testing as a Population-Level Screening Model in a Rural Appalachian Population

PURPOSE

Given the innovation of fecal immunochemical testing (FIT) to detect polyps in the rectum and colon for removal by colonoscopy, it is important to determine the cost per Life-Year Gained (LYG) when using FIT as a population-level screening model. This is particularly true for medically underserved rural populations. Accordingly, the purpose of this study was to make this determination among rural Appalachians experiencing isolation and economic challenges.

METHODS

The study occurred in an 8-county area of southeastern Kentucky. Kits were distributed to 1,424 residents. Seven hundred thirty-two kits (51.4%) were completed and returned. A Markov decision-analytic model was developed using PrecisionTree 7.6.

FINDINGS

Reactive test results occurred for 144 of the completed kits (19.7%). Thirty-seven colonoscopies were verified, with 15 of these indicating precancerous changes or actual cancer. Program costs were estimated at $461,952, with the average cost per person screened estimated at $324. Cost per LYG was $7,912.

CONCLUSIONS

In contrast to an average cost per LYG of $17,200, our findings suggest a highly favorable cost-effectiveness ratio for this population of medically underserved rural residents. Cost-benefit analyses suggest that the screening program begins to yield positive net benefits at the stage when project recipients undergo colonoscopy, suggesting that this is the key step for behavioral intervention and intensified outreach.

Validation of Microsimulation Models against Alternative Model Predictions and Long-Term Colorectal Cancer Incidence and Mortality Outcomes of Randomized Controlled Trials

Background. This study aimed to assess the validity of 2 microsimulation models of colorectal cancer (CRC), Policy1-Bowel and ASCCA. Methods. The model-estimated CRC risk in population subgroups with different health statuses, "dwell time" (time from incident precancerous polyp to symptomatically detected CRC), and reduction in symptomatically detected CRC incidence after a one-time complete removal of polyps and/or undetected CRC were compared with published findings from 3 well-established models (MISCAN, CRC-SPIN, and SimCRC). Furthermore, 6 randomized controlled trials (RCTs) that provided screening using a guaiac fecal occult blood test (Funen trial, Burgundy trial, and Minnesota Colon Cancer Control Study [MCCCS]) or flexible sigmoidoscopy (NORCCAP, SCORE, and UKFSST) with long-term follow-up were simulated. Model-estimated long-term relative reductions of CRC incidence (RR_inc) and mortality (RR_mort) were compared with the RCTs' findings. Results. The Policy1-Bowel and ASCCA estimates showed more similarities to CRC-SPIN and SimCRC. For example, overall dwell times estimated by Policy1-Bowel (24.0 years) and ASCCA (25.3) were comparable to CRC-SPIN (25.8) and SimCRC (25.2) but higher than MISCAN (10.6). In addition, ∼86% of Policy1-Bowel's and ∼74% of ASCCA's estimated RR_inc and RR_mort were consistent with the RCTs' long-term follow-up findings. For example, at 17 to 18 years of follow-up, the MCCCS reported RR_mort of 0.67 (95% confidence interval [CI], 0.51-0.83) and 0.79 (95% CI, 0.62-0.97) for the annual and biennial screening arm, respectively, and the UKFSST reported RR_mort of 0.70 (95% CI, 0.62-0.79) for CRC at all sites and 0.54 (95% CI, 0.46-0.65) for distal CRC. The corresponding model estimates were 0.65, 0.74, 0.81, and 0.61, respectively, for Policy1-Bowel and 0.65, 0.70, 0.75, and 0.58, respectively, for ASCCA. Conclusion. Policy1-Bowel and ASCCA's estimates are largely consistent with the data included for comparisons, which indicates good model validity.

Quantifying the impact of adherence to screening strategies on colorectal cancer incidence and mortality

Current recommendations of The US Preventive Services Task Force (USPSTF) on colorectal cancer (CRC) screening strategies are based on models that assume 100% adherence. Since adherence can have a large effect on screening outcomes, we aimed to compare the effectiveness of CRC screening strategies under reported adherence rates at the population level. We developed and validated a microsimulation model to assess the effectiveness of colonoscopy (COL), flexible sigmoidoscopy (FS), high-sensitivity guaiac fecal occult blood-test (HS-gFOBT), fecal immunochemical test (FIT), multitarget stool DNA test (FIT-DNA), computed tomography colonography (CTC), and methylated SEPT9 DNA test (SEPT9) in terms of CRC incidence and mortality, incremental life years gained (LYG), number of colonoscopies, and adverse events for men and women 50 years or older over their lifetime. We assessed outcomes under 100% adherence rates and reported adherence rates. We also performed sensitivity analyses to evaluate the impact of varying adherence levels on CRC outcomes. Assuming 100% adherence, FIT-DNA, FIT, HS-gFOBT, and SEPT9 averted 42-45 CRC cases and 25-26 CRC deaths, COL 46 cases and 26 deaths, CTC 39 cases and 23 deaths, FS 32 cases and 19 deaths per 1000 individuals. Assuming reported adherence, SEPT9 averted 37 CRC cases and 23 CRC deaths, COL 34 cases and 20 deaths, FIT-DNA, FIT, CTC and HS-gFOBT 16-25 cases and 10-16 deaths per 1000 individuals. LYG reflected the effectiveness of each strategy in reducing CRC cases and deaths. Adverse events were more common for COL (3.7 per 1000 screened) and annual SEPT9 (3.4 per 1000 screened), and proportional to the number of colonoscopies. Among the screening strategies recommended by USPSTF, colonoscopy results in the largest benefit when we account for adherence. Adherence rates higher than 65%-70% would be required for any stool or blood-based screening modality to match the benefits of colonoscopy.

MICROSIMULATION MODEL CALIBRATION USING INCREMENTAL MIXTURE APPROXIMATE BAYESIAN COMPUTATION

Microsimulation models (MSMs) are used to inform policy by predicting population-level outcomes under different scenarios. MSMs simulate individual-level event histories that mark the disease process (such as the development of cancer) and the effect of policy actions (such as screening) on these events. MSMs often have many unknown parameters; calibration is the process of searching the parameter space to select parameters that result in accurate MSM prediction of a wide range of targets. We develop Incremental Mixture Approximate Bayesian Computation (IMABC) for MSM calibration, which results in a simulated sample from the posterior distribution of model parameters given calibration targets. IMABC begins with a rejection-based ABC step, drawing a sample of points from the prior distribution of model parameters and accepting points that result in simulated targets that are near observed targets. Next, the sample is iteratively updated by drawing additional points from a mixture of multivariate normal distributions and accepting points that result in accurate predictions. Posterior estimates are obtained by weighting the final set of accepted points to account for the adaptive sampling scheme. We demonstrate IMABC by calibrating CRC-SPIN 2.0, an updated version of a MSM for colorectal cancer (CRC) that has been used to inform national CRC screening guidelines.

A Need for Change! A Coding Framework for Improving Transparency in Decision Modeling

The use of open-source programming languages, such as R, in health decision sciences is growing and has the potential to facilitate model transparency, reproducibility, and shareability. However, realizing this potential can be challenging. Models are complex and primarily built to answer a research question, with model sharing and transparency relegated to being secondary goals. Consequently, code is often neither well documented nor systematically organized in a comprehensible and shareable approach. Moreover, many decision modelers are not formally trained in computer programming and may lack good coding practices, further compounding the problem of model transparency. To address these challenges, we propose a high-level framework for model-based decision and cost-effectiveness analyses (CEA) in R. The proposed framework consists of a conceptual, modular structure and coding recommendations for the implementation of model-based decision analyses in R. This framework defines a set of common decision model elements divided into five components: (1) model inputs, (2) decision model implementation, (3) model calibration, (4) model validation, and (5) analysis. The first four components form the model development phase. The analysis component is the application of the fully developed decision model to answer the policy or the research question of interest, assess decision uncertainty, and/or to determine the value of future research through value of information (VOI) analysis. In this framework, we also make recommendations for good coding practices specific to decision modeling, such as file organization and variable naming conventions. We showcase the framework through a fully functional, testbed decision model, which is hosted on GitHub for free download and easy adaptation to other applications. The use of this framework in decision modeling will improve code readability and model sharing, paving the way to an ideal, open-source world.

Colorectal cancer screening with faecal immunochemical testing, sigmoidoscopy or colonoscopy: a microsimulation modelling study

OBJECTIVE

To estimate benefits and harms of different colorectal cancer screening strategies, stratified by (baseline) 15-year colorectal cancer risk.

DESIGN

Microsimulation modelling study using MIcrosimulation SCreening ANalysis-Colon (MISCAN-Colon).

SETTING

A parallel guideline committee (BMJ Rapid Recommendations) defined the time frame and screening interventions, including selection of outcome measures.

POPULATION

Norwegian men and women aged 50-79 years with varying 15-year colorectal cancer risk (1-7%).

COMPARISONS

Four screening strategies were compared with no screening: biennial or annual faecal immunochemical test (FIT) or single sigmoidoscopy or colonoscopy at 100% adherence.

MAIN OUTCOME MEASURES

Colorectal cancer mortality and incidence, burdens, and harms over 15 years of follow-up. The certainty of the evidence was assessed using the GRADE approach.

RESULTS

Over 15 years of follow-up, screening individuals aged 50-79 at 3% risk of colorectal cancer with annual FIT or single colonoscopy reduced colorectal cancer mortality by 6 per 1000 individuals. Single sigmoidoscopy and biennial FIT reduced it by 5 per 1000 individuals. Colonoscopy, sigmoidoscopy, and annual FIT reduced colorectal cancer incidence by 10, 8, and 4 per 1000 individuals, respectively. The estimated incidence reduction for biennial FIT was 1 per 1000 individuals. Serious harms were estimated to be between 3 per 1000 (biennial FIT) and 5 per 1000 individuals (colonoscopy); harms increased with older age. The absolute benefits of screening increased with increasing colorectal cancer risk, while harms were less affected by baseline risk. Results were sensitive to the setting defined by the guideline panel. Because of uncertainty associated with modelling assumptions, we applied a GRADE rating of low certainty evidence to all estimates.

CONCLUSIONS

Over a 15 year period, all screening strategies may reduce colorectal cancer mortality to a similar extent. Colonoscopy and sigmoidoscopy may also reduce colorectal cancer incidence, while FIT shows a smaller incidence reduction. Harms are rare and of similar magnitude for all screening strategies.

External Validation of a Colorectal Cancer Model Against Screening Trial Long-Term Follow-Up Data

BACKGROUND

The University of Sheffield School of Health and Related Research (ScHARR) Bowel Cancer Screening Model has been used previously to make decisions about colorectal cancer screening strategies in England.

OBJECTIVES

The objective of this study was to perform an external validation of the ScHARR model against long-term follow-up data about colorectal cancer (CRC) incidence and mortality reductions due to screening, from the Nottingham trial of guaiac faecal occult blood testing for CRC, and the UK Flexible Sigmoidoscopy Screening Trial.

METHODS

The ScHARR model was adapted prior to validation to reflect the setting of each trial in terms of population characteristics, details of screening and surveillance programs, uptake of screening, and further investigations and study follow-up. The impact of using current versus historical CRC incidence and mortality data in the validation was also examined by carrying out a series of analyses in which historical data from different years was included in the model.

RESULTS

The ScHARR model was able to predict CRC incidence and mortality rate/hazard ratios from both trials to well within the 95% confidence intervals in the observed data. While it was less accurate in predicting absolute incidence and mortality rates, modeling historical incidence and mortality data enabled these predictions to be improved considerably.

CONCLUSION

The ScHARR model is able to replicate the long-term relative benefit from screening observed in 2 large-scale UK-based screening trials and can therefore be considered to be an appropriate tool to facilitate decision making around the English bowel cancer screening program.

Evidence-based sizing of non-inferiority trials using decision models

Background

There are significant challenges to the successful conduct of non-inferiority trials because they require large numbers to demonstrate that an alternative intervention is “not too much worse” than the standard. In this paper, we present a novel strategy for designing non-inferiority trials using an approach for determining the appropriate non-inferiority margin (δ), which explicitly balances the benefits of interventions in the two arms of the study (e.g. lower recurrence rate or better survival) with the burden of interventions (e.g. toxicity, pain), and early and late-term morbidity.

Methods

We use a decision analytic approach to simulate a trial using a fixed value for the trial outcome of interest (e.g. cancer incidence or recurrence) under the standard intervention (p_S) and systematically varying the incidence of the outcome in the alternative intervention (p_A). The non-inferiority margin, p_A – p_S = δ, is reached when the lower event rate of the standard therapy counterbalances the higher event rate but improved morbidity burden of the alternative. We consider the appropriate non-inferiority margin as the tipping point at which the quality-adjusted life-years saved in the two arms are equal.

Results

Using the European Polyp Surveillance non-inferiority trial as an example, our decision analytic approach suggests an appropriate non-inferiority margin, defined here as the difference between the two study arms in the 10-year risk of being diagnosed with colorectal cancer, of 0.42% rather than the 0.50% used to design the trial. The size of the non-inferiority margin was smaller for higher assumed burden of colonoscopies.

Conclusions

The example demonstrates that applying our proposed method appears feasible in real-world settings and offers the benefits of more explicit and rigorous quantification of the various considerations relevant for determining a non-inferiority margin and associated trial sample size.

Modeling in Colorectal Cancer Screening: Assessing External and Predictive Validity of MISCAN-Colon Microsimulation Model Using NORCCAP Trial Results

BACKGROUND

Microsimulation models are increasingly being used to inform colorectal cancer (CRC) screening recommendations. MISCAN-Colon is an example of such a model, used to inform the Dutch CRC screening program and US Preventive Services Task Force guidelines. Assessing the validity of these models is essential to provide transparency regarding their performance. In this study, we tested the external and predictive validity of MISCAN-Colon.

METHODS

We validated MISCAN-Colon using the Norwegian Colorectal Cancer Prevention (NORCCAP) trial, a randomized controlled trial that examined the effectiveness of once-only flexible sigmoidoscopy (FS) screening. We simulated the study population and design of the NORCCAP trial in MISCAN-Colon and compared 10- to 12-year model-predicted hazard ratios (HRs) for overall and distal CRC incidence and mortality to those observed. In addition, we compared the numbers of screen-detected neoplasia. Finally, we predicted the trial's future results to allow for the assessment of predictive validity.

RESULTS

MISCAN-Colon predicted an HR for overall CRC incidence (0.85), distal CRC incidence (0.82), overall CRC mortality (0.68), and distal CRC mortality (0.62). These were within the limits of the 95% confidence intervals of the NORCCAP trial results. Similar results were observed for the number of screen-detected cancers. The model significantly underestimated the number of screen-detected adenomas. Model-predicted HRs for CRC incidence and mortality up to 15- to 17-year follow-up were 0.84 and 0.72, respectively.

CONCLUSION

Although the underestimation of screen-detected adenomas requires further investigation, MISCAN-Colon is able to make a valid replication of the CRC incidence and mortality reduction of an FS screening trial, which suggests that it can be considered a useful tool to support decision making on CRC screening.

Implications of Epigenetic Drift in Colorectal Neoplasia

Many normal tissues undergo age-related drift in DNA methylation, providing a quantitative measure of tissue age. Here, we identify and validate 781 CpG islands (CGI) that undergo significant methylomic drift in 232 normal colorectal tissues and show that these CGI continue to drift in neoplasia while retaining significant correlations across samples. However, compared with normal colon, this drift advanced (∼3-4-fold) faster in neoplasia, consistent with increased cell proliferation during neoplastic progression. The observed drift patterns were broadly consistent with modeled adenoma-to-carcinoma sojourn time distributions from colorectal cancer incidence data. These results support the hypothesis that, beginning with the founder premalignant cell, cancer precursors frequently sojourn for decades before turning into cancer, implying that the founder cell typically arises early in life. At least 77% to 89% of the observed drift variance in distal and rectal tumors was explained by stochastic variability associated with neoplastic progression, whereas only 55% of the variance was explained for proximal tumors. However, gene-CGI pairs in the proximal colon that underwent drift were significantly and primarily negatively correlated with cancer gene expression, suggesting that methylomic drift participates in the clonal evolution of colorectal cancer. Methylomic drift advanced in colorectal neoplasia, consistent with extended sojourn time distributions, which accounts for a significant fraction of epigenetic heterogeneity in colorectal cancer. Importantly, these estimated long-duration premalignant sojourn times suggest that early dietary and lifestyle interventions may be more effective than later changes in reducing colorectal cancer incidence. SIGNIFICANCE: These findings present age-related methylomic drift in colorectal neoplasia as evidence that premalignant cells can persist for decades before becoming cancerous.See related commentary by Sapienza, p. 437.

Cost-effectiveness of colorectal cancer screening programmes using sigmoidoscopy and immunochemical faecal occult blood test

OBJECTIVE

Several European countries are implementing organized colorectal cancer (CRC) screening programmes using faecal immunochemical test (FIT) and/or flexible sigmoidoscopy (FS), but the cost-effectiveness of these programmes is not yet available. We aimed to assess cost-effectiveness, based on data from the established Piedmont screening programme.

METHODS

Using the Piedmont programme data, a Markov model was constructed comparing three strategies in a simulated cohort of 100,000 subjects: single FS, biennial FIT, or sequential strategy (FS + FIT offered to FS non-responders). Estimates for CRC incidence and mortality prevention were derived from studies of organized screening. Cost analysis for FS and FIT was based on data from organized programmes. Incremental cost-effectiveness ratios (ICER) between the different strategies were calculated. Sensitivity and probabilistic analyses were performed.

RESULTS

Direct costs for FS, and for FIT at first and subsequent rounds, were estimated as €160, €33, and €21, respectively. All the simulated strategies were effective (10-17% CRC incidence reduction) and cost-effective vs. no screening (ICER <€1000 per life-year saved). FS and FS + FIT were the only cost-saving strategies, with FS least expensive (€15 saving per person invited). FS + FIT and FS were the only non-dominated strategies. FS + FIT were more effective and cost-effective than FS (ICER €1217 per life-year saved). The residual marginal uncertainty was mainly related to parameters inherent to FIT effectiveness and adherence.

CONCLUSIONS

Organized CRC screening programmes are highly cost-effective, irrespective of the test selected. A sequential approach with FS and FIT appears the most cost-effective option. A single FS is the least expensive, but convenient, approach.

Optimizing colorectal cancer screening by race and sex: Microsimulation analysis II to inform the American Cancer Society colorectal cancer screening guideline

BACKGROUND

Colorectal cancer (CRC) risk varies by race and sex. This study, 1 of 2 microsimulation analyses to inform the 2018 American Cancer Society CRC screening guideline, explored the influence of race and sex on optimal CRC screening strategies.

METHODS

Two Cancer Intervention and Surveillance Modeling Network microsimulation models, informed by US incidence data, were used to evaluate a variety of screening methods, ages to start and stop, and intervals for 4 demographic subgroups (black and white males and females) under 2 scenarios for the projected lifetime CRC risk for 40-year-olds: 1) assuming that risk had remained stable since the early screening era and 2) assuming that risk had increased proportionally to observed incidence trends under the age of 40 years. Model-based screening recommendations were based on the predicted level of benefit (life-years gained) and burden (required number of colonoscopies), the incremental burden-to-benefit ratio, and the relative efficiency in comparison with strategies with similar burdens.

RESULTS

When lifetime CRC risk was assumed to be stable over time, the models differed in the recommended age to start screening for whites (45 vs 50 years) but consistently recommended screening from the age of 45 years for blacks. When CRC risk was assumed to be increased, the models recommended starting at the age of 45 years, regardless of race and sex. Strategies recommended under both scenarios included colonoscopy every 10 or 15 years, annual fecal immunochemical testing, and computed tomographic colonography every 5 years through the age of 75 years.

CONCLUSIONS

Microsimulation modeling suggests that CRC screening should be considered from the age of 45 years for blacks and for whites if the lifetime risk has increased proportionally to the incidence for younger adults. Cancer 2018;124:2974-85. © 2018 The Authors. Cancer published by Wiley Periodicals, Inc. on behalf of American Cancer Society.

Colon cancer screening with CT colonography: logistics, cost-effectiveness, efficiency and progress

Colorectal cancer (CRC) incidence and mortality can be significantly reduced by population screening. Several different screening methods are currently in use, and this review focuses specifically on the imaging technique computed tomographic colonography (CTC). The challenges and logistics of CTC screening, as well as the importance of test accuracy, uptake, quality assurance and cost-effectiveness will be discussed. With comparable advanced adenoma detection rates to colonoscopy (the most commonly used whole-colon investigation), CTC is a less-invasive alternative, requiring less laxative, and with the potential benefit that it permits assessment of extra colonic structures. Three large-scale European trials have contributed valuable evidence supporting the use of CTC in population screening, and highlight the importance of selecting appropriate clinical management pathways based on initial CTC findings. Future research into CTC-screening will likely focus on radiologist training and CTC quality assurance, with identification of evidence-based key performance indicators that are associated with clinically-relevant outcomes such as the incidence of post-test interval cancers (CRC occurring after a presumed negative CTC). In comparison to other CRC screening techniques, CTC offers a safe and accurate option that is particularly useful when colonoscopy is contraindicated. Forthcoming cost-effectiveness analyses which evaluate referral thresholds, the impact of extra-colonic findings and real-world uptake will provide useful information regarding the feasibility of future CTC population screening.

Cost-effectiveness and budget impact analyses of a colorectal cancer screening programme in a high adenoma prevalence scenario using MISCAN-Colon microsimulation model

Background

The Basque Colorectal Cancer Screening Programme began in 2009 and the implementation has been complete since 2013. Faecal immunological testing was used for screening in individuals between 50 and 69 years old. Colorectal Cancer in Basque country is characterized by unusual epidemiological features given that Colorectal Cancer incidence is similar to other European countries while adenoma prevalence is higher. The object of our study was to economically evaluate the programme via cost-effectiveness and budget impact analyses with microsimulation models.

Methods

We applied the Microsimulation Screening Analysis (MISCAN)-Colon model to predict trends in Colorectal Cancer incidence and mortality and to quantify the short- and long-term effects and costs of the Basque Colorectal Cancer Screening Programme. The model was calibrated to the Basque demographics in 2008 and age-specific Colorectal Cancer incidence data in the Basque Cancer Registry from 2005 to 2008 before the screening begun. The model was also calibrated to the high adenoma prevalence observed for the Basque population in a previously published study. The multi-cohort approach used in the model included all the cohorts in the programme during 30 years of implementation, with lifetime follow-up. Unit costs were obtained from the Basque Health Service and both cost-effectiveness analysis and budget impact analysis were carried out.

Results

The goodness-of-fit of the model adaptation to observed programme data was evidence of validation. In the cost-effectiveness analysis, the savings from treatment were larger than the added costs due to screening. Thus, the Basque programme was dominant compared to no screening, as life expectancy increased by 29.3 days per person. The savings in the budget analysis appeared 10 years after the complete implementation of the programme. The average annual budget was €73.4 million from year 2023 onwards.

Conclusions

This economic evaluation showed a screening intervention with a major health gain that also produced net savings when a long follow-up was used to capture the late economic benefit. The number of colonoscopies required was high but remain within the capacity of the Basque Health Service. So far in Europe, no other population Colorectal Cancer screening programme has been evaluated by budget impact analysis.

Electronic supplementary material

The online version of this article (10.1186/s12885-018-4362-1) contains supplementary material, which is available to authorized users.

Post-imaging colorectal cancer or interval cancer rates after CT colonography: a systematic review and meta-analysis

BACKGROUND

CT colonography is highly sensitive for colorectal cancer, but interval or post-imaging colorectal cancer rates (diagnosis of cancer after initial negative CT colonography) are unknown, as are their underlying causes. We did a systematic review and meta-analysis of post-CT colonography and post-imaging colorectal cancer rates and causes to address this gap in understanding.

METHODS

We systematically searched MEDLINE, Embase, and the Cochrane Central Register of Controlled Trials. We included randomised, cohort, cross-sectional, or case-control studies published between Jan 1, 1994, and Feb 28, 2017, using CT colonography done according to international consensus standards with the aim of detecting cancer or polyps, and reporting post-imaging colorectal cancer rates or sufficient data to allow their calculation. We excluded studies in which all CT colonographies were done because of incomplete colonoscopy or if CT colonography was done with knowledge of colonoscopy findings. We contacted authors of component studies for additional data where necessary for retrospective CT colonography image review and causes for each post-imaging colorectal cancer. Two independent reviewers extracted data from the study reports. Our primary outcome was prevalence of post-imaging colorectal cancer 36 months after CT colonography. We used random-effects meta-analysis to estimate pooled post-imaging colorectal cancer rates, expressed using the total number of cancers and total number of CT colonographies as denominators, and per 1000 person-years. This study is registered with PROSPERO, number CRD42016042437.

FINDINGS

2977 articles were screened and 12 studies were eligible for analysis. These studies reported data for 19 867 patients (aged 18-96 years; of 11 590 with sex data available, 6532 [56%] were female) between March, 2002, and May, 2015. At a mean of 34 months' follow-up (range 3-128·4 months), CT colonography detected 643 colorectal cancers. 29 post-imaging colorectal cancers were subsequently diagnosed. The pooled post-imaging colorectal cancer rate was 4·42 (95% CI 3·03-6·42) per 100 cancers detected, corresponding to 1·61 (1·11-2·33) post-imaging colorectal cancers per 1000 CT colonographies or 0·64 (0·44-0·92) post-imaging colorectal cancers per 1000 person-years. Heterogeneity was low (I²=0%). 17 (61%) of 28 post-imaging colorectal cancers were attributable to perceptual error and were visible in retrospect.

INTERPRETATION

CT colonography does not lead to an excess of post-test cancers relative to colonoscopy within 3-5 years, and the low 5-year post-imaging colorectal cancer rate confirms that the recommended screening interval of 5 years is safe. Since most post-imaging colorectal cancers arise from perceptual errors, radiologist training and quality assurance could help to reduce post-imaging colorectal cancer rates.

FUNDING

St Mark's Hospital Foundation and the UK National Institute for Health Research via the UCL/UCLH Biomedical Research Centre.

Effect of Time to Diagnostic Testing for Breast, Cervical, and Colorectal Cancer Screening Abnormalities on Screening Efficacy: A Modeling Study

Background: Patients who receive an abnormal cancer screening result require follow-up for diagnostic testing, but the time to follow-up varies across patients and practices.Methods: We used a simulation study to estimate the change in lifetime screening benefits when time to follow-up for breast, cervical, and colorectal cancers was increased. Estimates were based on four independently developed microsimulation models that each simulated the life course of adults eligible for breast (women ages 50-74 years), cervical (women ages 21-65 years), or colorectal (adults ages 50-75 years) cancer screening. We assumed screening based on biennial mammography for breast cancer, triennial Papanicolaou testing for cervical cancer, and annual fecal immunochemical testing for colorectal cancer. For each cancer type, we simulated diagnostic testing immediately and at 3, 6, and 12 months after an abnormal screening exam.Results: We found declines in screening benefit with longer times to diagnostic testing, particularly for breast cancer screening. Compared to immediate diagnostic testing, testing at 3 months resulted in reduced screening benefit, with fewer undiscounted life years gained per 1,000 screened (breast: 17.3%, cervical: 0.8%, colorectal: 2.0% and 2.7%, from two colorectal cancer models), fewer cancers prevented (cervical: 1.4% fewer, colorectal: 0.5% and 1.7% fewer, respectively), and, for breast and colorectal cancer, a less favorable stage distribution.Conclusions: Longer times to diagnostic testing after an abnormal screening test can decrease screening effectiveness, but the impact varies substantially by cancer type.Impact: Understanding the impact of time to diagnostic testing on screening effectiveness can help inform quality improvement efforts. Cancer Epidemiol Biomarkers Prev; 27(2); 158-64. ©2017 AACR.

The OncoSim model: development and use for better decision-making in Canadian cancer control

The Canadian Partnership Against Cancer was created in 2007 by the federal government to accelerate cancer control across Canada. Its OncoSim microsimulation model platform, which consists of a suite of specific cancer models, was conceived as a tool to augment conventional resources for population-level policy- and decision-making. The Canadian Partnership Against Cancer manages the OncoSim program, with funding from Health Canada and model development by Statistics Canada. Microsimulation modelling allows for the detailed capture of population heterogeneity and health and demographic history over time. Extensive data from multiple Canadian sources were used as inputs or to validate the model. OncoSim has been validated through expert consultation; assessments of face validity, internal validity, and external validity; and model fit against observed data. The platform comprises three in-depth cancer models (lung, colorectal, cervical), with another in-depth model (breast) and a generalized model (25 cancers) being in development. Unique among models of its class, OncoSim is available online for public sector use free of charge. Users can customize input values and output display, and extensive user support is provided. OncoSim has been used to support decision-making at the national and jurisdictional levels. Although simulation studies are generally not included in hierarchies of evidence, they are integral to informing cancer control policy when clinical studies are not feasible. OncoSim can evaluate complex intervention scenarios for multiple cancers. Canadian decision-makers thus have a powerful tool to assess the costs, benefits, cost-effectiveness, and budgetary effects of cancer control interventions when faced with difficult choices for improvements in population health and resource allocation.

Impact of adenoma detection on the benefit of faecal testing vs. colonoscopy for colorectal cancer

Colonoscopy quality, as measured by adenoma detection rates, varies widely across providers and is inversely related to patients' post-colonoscopy cancer risk. This has unknown consequences for the benefits of faecal immunochemical testing (FIT) vs. primary colonoscopy screening for colorectal cancer. Using an established microsimulation model, we predicted the lifetime colorectal cancer incidence and mortality benefits of annual FIT vs. 10-yearly colonoscopy screening at differing ADR levels (quintiles; averages 15.3-38.7%), with colonoscopy performance assumptions estimated from community-based data on physician ADRs and patients' post-colonoscopy risk of cancer. For patients receiving FIT screening with follow-up colonoscopy by physicians from the highest ADR quintile, simulated lifetime cancer incidence and mortality were 28.8 and 5.4 per 1,000, respectively, vs. 20.6 and 4.4 for primary colonoscopy screening (risk ratios, RR = 1.40; 95% probability interval (PI), 1.19-1.71 for incidence, and RR = 1.22; 95%PI, 1.02-1.54 for mortality). With every 5% point ADR decrease, lifetime cancer incidence was predicted to increase on average 9.0% for FIT vs. 12.3% for colonoscopy, and mortality increased 9.9% vs. 13.3%. In ADR quintile 1, simulated mortality was lower for FIT than colonoscopy screening (10.1 vs. 11.8; RR = 0.85; 95%PI, 0.83-0.90), while incidences were more similar. This suggests that relative cancer incidence and mortality reductions for FIT vs. colonoscopy screening may differ by ADR, with fewer predicted deaths with colonoscopy screening in higher ADR settings and fewer deaths with annual FIT screening in lower ADR settings.

Early detection versus primary prevention in the PLCO flexible sigmoidoscopy screening trial: Which has the greatest impact on mortality?

BACKGROUND

Screening for colorectal cancer (CRC) with flexible sigmoidoscopy (FS) has been shown to reduce CRC mortality. The current study examined whether the observed mortality reduction was due primarily to the prevention of incident CRC via removal of adenomatous polyps or to the early detection of cancer and improved survival.

METHODS

The Prostate, Lung, Colorectal, and Ovarian (PLCO) cancer screening trial randomized 154,900 men and women aged 55 to 74 years. Individuals underwent FS screening at baseline and at 3 or 5 years versus usual care. CRC-specific survival was analyzed using Kaplan-Meier curves and proportional hazards modeling. The authors estimated the percentage of CRC deaths averted by early detection versus primary prevention using a model that applied intervention arm survival rates to CRC cases in the usual-care arm and vice versa.

RESULTS

A total of 1008 cases of CRC in the intervention arm and 1291 cases of CRC in the usual-care arm were observed. Through 13 years of follow-up, there was no significant difference noted between the trial arms with regard to CRC-specific survival for all CRC (68% in the intervention arm vs 65% in the usual-care arm; P =.16) or proximal CRC (68% vs 62%, respectively; P = .11) cases; however, survival in distal CRC cases was found to be higher in the intervention arm compared with the usual-care arm (77% vs 66%; P<.0001). Within each arm, symptom-detected cases had significantly worse survival compared with screen-detected cases. Overall, approximately 29% to 35% of averted CRC deaths were estimated to be due to early detection and 65% to 71% were estimated to be due to primary prevention.

CONCLUSIONS

CRC-specific survival was similar across arms in the PLCO trial, suggesting a limited role for early detection in preventing CRC deaths. Modeling suggested that approximately two-thirds of avoided deaths were due to primary prevention. Future CRC screening guidelines should emphasize primary prevention via the identification and removal of precursor lesions. Cancer 2017;123:4815-22. © 2017 American Cancer Society.

Evaluation of the colorectal cancer screening Programme in the Basque Country (Spain) and its effectiveness based on the Miscan-colon model

Abstract

The population-based Basque Colorectal Cancer (CRC) Screening Programme started in 2009 with a biennial immunochemical quantitative test (FIT) biennial and colonoscopy under sedation in positive cases. The population target of 586,700 residents was from 50 to 69 years old and the total coverage was reached at the beginning of 2014. The aim of our study was to determine possible scenarios in terms of incidence, mortality and reduction of Life-years-Lost (L-y-L) in the medium and long term of CRC.

Methods

Invitations were sent out by the Programme from 2009 to 2014, with combined organizational strategies. Simulation was done by MISCAN-colon (Microsimulation Screening Analysis) over 30 years comparing the results of screening vs no-screening, taking the population-based Cancer Registry into account. Lifetime population and real data from the Programme were used from 2008 to 2012. The model was run differentially for men and women.

Results

924,416 invitations were sent out from 2009 to 2014. The average participation rate was 68.4%, CRC detection rate was 3.4% and the Advanced Adenoma detection rate was 24.0‰, with differences observed in sex and age. Future scenarios showed a higher decrease of incidence (17.2% vs 14.7%), mortality (28.1% vs 22.4%) and L-y-L (22.6% vs 18.4%) in men than women in 2030.

Conclusions

The Basque Country CRC Programme results are aligned to its strategy and comparable to other programmes. MISCAN model was found to be a useful tool to predict the benefits of the programme in the future. The effectiveness of the Programme has not been formally established as case control studies are required to determine long term benefits from the screening strategy.

Post-colonoscopy colorectal cancers in Sweden: room for quality improvement

OBJECTIVE

Post-colonoscopy colorectal cancer (PCCRC), a cancer occurring within a short interval of a colonoscopy, might be partly explained as missed or incompletely resected lesions. Associated risk factors are age, sex, comorbidity, cancer location, and colonoscopy volume. There is a gap in the knowledge of prevalence of PCCRC and the impact of different risk factors in Sweden.

METHODS

This is a retrospective population-based observational cohort study of the colonoscopies performed on adults during the years 2001-2010 that were identified from Swedish health registers. The rate of PCCRC (diagnosed 6-36 months after the first colonoscopy) was defined as the number of PCCRCs divided by the number of colorectal cancers (CRC) in the interval of 0-36 months. Univariate and multivariate Poisson regression analyses examined associations with PCCRC.

RESULTS

There were 289 729 colonoscopies performed on 249 079 individuals included in the study. There were 16 319 individuals with a colorectal cancer diagnosis 0-36 months after a colonoscopy. Of these, 1286 (7.9%) were PCCRCs. In the multivariate analysis, young age (18-30 years) and former polyp diagnosis had the highest risks [relative risk (RR)=3.3; 95% confidence interval: 2.1-5.2 and RR=3.1; 95% confidence interval: 2.7-3.6]. The impact of other risk factors, such as female sex, comorbidity, right sided colorectal cancer location, and time period, was consistent with the finding in other studies.

CONCLUSION

The prevalence of PCCRC in Sweden seems to be relatively high, indicating that there is room for improvement in colonoscopy quality. The high RR of PCCRC in the youngest age group, even though there were only a few cases, has not been described in other studies.

Validation of a Cardiovascular Disease Policy Microsimulation Model Using Both Survival and Receiver Operating Characteristic Curves

BACKGROUND

Despite some advances, cardiovascular disease (CVD) remains the leading cause of death and healthcare costs in the United States. We therefore developed a comprehensive CVD policy simulation model that identifies cost-effective approaches for reducing CVD burden. This paper aims to: 1) describe our model in detail; and 2) perform model validation analyses.

METHODS

The model simulates 1,000,000 adults (ages 35 to 80 years) using a variety of CVD-related epidemiological data, including previously calibrated Framingham-based risk scores for coronary heart disease and stroke. We validated our microsimulation model using recent National Health and Nutrition Examination Survey (NHANES) data, with baseline values collected in 1999-2000 and cause-specific mortality follow-up through 2011. Model-based (simulated) results were compared to observed all-cause and CVD-specific mortality data (from NHANES) for the same starting population using survival curves and, in a method not typically used for disease model validation, receiver operating characteristic (ROC) curves.

RESULTS

Observed 10-year all-cause mortality in NHANES v. the simulation model was 11.2% (95% CI, 10.3% to 12.2%) v. 10.9%; corresponding results for CVD mortality were 2.2% (1.8% to 2.7%) v. 2.6%. Areas under the ROC curves for model-predicted 10-year all-cause and CVD mortality risks were 0.83 (0.81 to 0.85) and 0.84 (0.81 to 0.88), respectively; corresponding results for 5-year risks were 0.80 (0.77 to 0.83) and 0.81 (0.75 to 0.87), respectively.

LIMITATIONS

The model is limited by the uncertainties in the data used to estimate its input parameters. Additionally, our validation analyses did not include non-fatal CVD outcomes due to NHANES data limitations.

CONCLUSIONS

The simulation model performed well in matching to observed nationally representative longitudinal mortality data. ROC curve analysis, which has been traditionally used for risk prediction models, can also be used to assess discrimination for disease simulation models.

Estimation of Benefits, Burden, and Harms of Colorectal Cancer Screening Strategies: Modeling Study for the US Preventive Services Task Force

IMPORTANCE

The US Preventive Services Task Force (USPSTF) is updating its 2008 colorectal cancer (CRC) screening recommendations.

OBJECTIVE

To inform the USPSTF by modeling the benefits, burden, and harms of CRC screening strategies; estimating the optimal ages to begin and end screening; and identifying a set of model-recommendable strategies that provide similar life-years gained (LYG) and a comparable balance between LYG and screening burden.

DESIGN, SETTING, AND PARTICIPANTS

Comparative modeling with 3 microsimulation models of a hypothetical cohort of previously unscreened US 40-year-olds with no prior CRC diagnosis.

EXPOSURES

Screening with sensitive guaiac-based fecal occult blood testing, fecal immunochemical testing (FIT), multitarget stool DNA testing, flexible sigmoidoscopy with or without stool testing, computed tomographic colonography (CTC), or colonoscopy starting at age 45, 50, or 55 years and ending at age 75, 80, or 85 years. Screening intervals varied by modality. Full adherence for all strategies was assumed.

MAIN OUTCOMES AND MEASURES

Life-years gained compared with no screening (benefit), lifetime number of colonoscopies required (burden), lifetime number of colonoscopy complications (harms), and ratios of incremental burden and benefit (efficiency ratios) per 1000 40-year-olds.

RESULTS

The screening strategies provided LYG in the range of 152 to 313 per 1000 40-year-olds. Lifetime colonoscopy burden per 1000 persons ranged from fewer than 900 (FIT every 3 years from ages 55-75 years) to more than 7500 (colonoscopy screening every 5 years from ages 45-85 years). Harm from screening was at most 23 complications per 1000 persons screened. Strategies with screening beginning at age 50 years generally provided more LYG as well as more additional LYG per additional colonoscopy than strategies with screening beginning at age 55 years. There were limited empirical data to support a start age of 45 years. For persons adequately screened up to age 75 years, additional screening yielded small increases in LYG relative to the increase in colonoscopy burden. With screening from ages 50 to 75 years, 4 strategies yielded a comparable balance of screening burden and similar LYG (median LYG per 1000 across the models): colonoscopy every 10 years (270 LYG); sigmoidoscopy every 10 years with annual FIT (256 LYG); CTC every 5 years (248 LYG); and annual FIT (244 LYG).

CONCLUSIONS AND RELEVANCE

In this microsimulation modeling study of a previously unscreened population undergoing CRC screening that assumed 100% adherence, the strategies of colonoscopy every 10 years, annual FIT, sigmoidoscopy every 10 years with annual FIT, and CTC every 5 years performed from ages 50 through 75 years provided similar LYG and a comparable balance of benefit and screening burden.