Appropriateness of imaging for lung cancer staging in a national cohort

The American Cancer Society National Lung Cancer Roundtable strategic plan: Promoting guideline-concordant lung cancer staging

Accurate staging improves lung cancer survival by increasing the chances of delivering stage-appropriate therapy. However, there is underutilization of, and variability in, the use of guideline-recommended diagnostic tests used to stage lung cancer. Consequently, the American Cancer Society National Lung Cancer Roundtable (ACS NLCRT) convened the Triage for Appropriate Treatment Task Group-a multidisciplinary expert and stakeholder panel-to identify knowledge and/or resource gaps contributing to guideline-discordant staging and make recommendations to overcome these gaps. The task group determined the following: Gap 1: facilitators of and barriers to guideline-concordant staging are incompletely understood; Recommendation 1: identify facilitators of and barriers to guideline-concordant lung cancer staging; Gap 2: the level of evidence supporting staging algorithms is low-to-moderate; Recommendation 2: prioritize comparative-effectiveness studies evaluating lung cancer staging; Gap 3: guideline recommendations vary across professional societies; Recommendation 3: harmonize guideline recommendations across professional societies; Gap 4: existing databases do not contain sufficient information to measure guideline-concordant staging; Recommendation 4: augment existing databases with the information required to measure guideline-concordant staging; Gap 5: health systems do not have a performance feedback mechanism for lung cancer staging; Recommendation 5: develop and implement a performance feedback mechanism for lung cancer staging; Gap 6: patients rarely self-advocate for guideline-concordant staging; Recommendation 6: increase opportunities for patient self-advocacy for guideline-concordant staging; and Gap 7: current health policies do not motivate guideline-concordant lung cancer staging; Recommendation 7: organize a representative working group under the ACS NLCRT that promotes policies that motivate guideline-concordant lung cancer staging. PLAIN LANGUAGE SUMMARY: Staging-determining the degree of cancer spread-is important because it helps clinicians choose the best cancer treatment. Receiving the best cancer treatment leads to the best possible patient outcomes. Practice guidelines are intended to help clinicians stage patients with lung cancer. However, lung cancer staging in the United States often varies from practice guideline recommendations. This report identifies seven opportunities to improve lung cancer staging.

Performance of a rule-based semi-automated method to optimize chart abstraction for surveillance imaging among patients treated for non-small cell lung cancer

BACKGROUND

We aim to develop and test performance of a semi-automated method (computerized query combined with manual review) for chart abstraction in the identification and characterization of surveillance radiology imaging for post-treatment non-small cell lung cancer patients.

METHODS

A gold standard dataset consisting of 3011 radiology reports from 361 lung cancer patients treated at the Veterans Health Administration from 2008 to 2016 was manually created by an abstractor coding image type, image indication, and image findings. Computerized queries using a text search tool were performed to code reports. The primary endpoint of query performance was evaluated by sensitivity, positive predictive value (PPV), and F1 score. The secondary endpoint of efficiency compared semi-automated abstraction time to manual abstraction time using a separate dataset and the Wilcoxon rank-sum test.

RESULTS

Query for image type demonstrated the highest sensitivity of 85%, PPV 95%, and F1 score 0.90. Query for image indication demonstrated sensitivity 72%, PPV 70%, and F1 score 0.71. The image findings queries ranged from sensitivity 75-85%, PPV 23-25%, and F1 score 0.36-0.37. Semi-automated abstraction with our best performing query (image type) improved abstraction times by 68% per patient compared to manual abstraction alone (from median 21.5 min (interquartile range 16.0) to 6.9 min (interquartile range 9.5), p < 0.005).

CONCLUSIONS

Semi-automated abstraction using the best performing query of image type improved abstraction efficiency while preserving data accuracy. The computerized query acts as a pre-processing tool for manual abstraction by restricting effort to relevant images. Determining image indication and findings requires the addition of manual review for a semi-automatic abstraction approach in order to ensure data accuracy.

Characterizing and quantifying low-value diagnostic imaging internationally: a scoping review

BACKGROUND

Inappropriate and wasteful use of health care resources is a common problem, constituting 10-34% of health services spending in the western world. Even though diagnostic imaging is vital for identifying correct diagnoses and administrating the right treatment, low-value imaging-in which the diagnostic test confers little to no clinical benefit-is common and contributes to inappropriate and wasteful use of health care resources. There is a lack of knowledge on the types and extent of low-value imaging. Accordingly, the objective of this study was to identify, characterize, and quantify the extent of low-value diagnostic imaging examinations for adults and children.

METHODS

A scoping review of the published literature was performed. Medline-Ovid, Embase-Ovid, Scopus, and Cochrane Library were searched for studies published from 2010 to September 2020. The search strategy was built from medical subject headings (Mesh) for Diagnostic imaging/Radiology OR Health service misuse/Medical overuse OR Procedures and Techniques Utilization/Facilities and Services Utilization. Articles in English, German, Dutch, Swedish, Danish, or Norwegian were included.

RESULTS

A total of 39,986 records were identified and, of these, 370 studies were included in the final synthesis. Eighty-four low-value imaging examinations were identified. Imaging of atraumatic pain, routine imaging in minor head injury, trauma, thrombosis, urolithiasis, after thoracic interventions, fracture follow-up and cancer staging/follow-up were the most frequently identified low-value imaging examinations. The proportion of low-value imaging varied between 2 and 100% inappropriate or unnecessary examinations.

CONCLUSIONS

A comprehensive list of identified low-value radiological examinations for both adults and children are presented. Future research should focus on reasons for low-value imaging utilization and interventions to reduce the use of low-value imaging internationally.

SYSTEMATIC REVIEW REGISTRATION

PROSPERO: CRD42020208072.

Associations Among Military Sexual Trauma, Opioid Use Disorder, and Gender

INTRODUCTION

Opioid use disorder and high-risk opioid prescription increase the risks for overdose and death. In Veterans, military sexual trauma is associated with increased risk for assorted health conditions. This study evaluates the association of military sexual trauma with opioid use disorder and high-risk opioid prescription and potential moderation by gender.

METHODS

In a national sample of Veterans Health Administration outpatients receiving care from October 1, 2009 to August 1, 2017, logistic regression models were fit to evaluate the associations between military sexual trauma and opioid use disorder and high-risk opioid prescription, adjusting for demographic and clinical covariates. A second set of models included a gender X military sexual trauma interaction. Analyses were conducted in 2020-2021.

RESULTS

Patients with history of military sexual trauma (n=327,193) had 50% higher odds of opioid use disorder diagnosis (AOR=1.50, 95% CI=1.45, 1.54, p<0.001) and 5% higher odds of high-risk opioid prescription (AOR=1.05, 95% CI=1.04, 1.07, p<0.001) than those without history of military sexual trauma (n=7,738,665). The effect of military sexual trauma on opioid use disorder was stronger in men than in women . The predicted probability of opioid use disorder among men with history of military sexual trauma (1.5%) was nearly double that of women with history of military sexual trauma (0.8%).

CONCLUSIONS

Military sexual trauma was a significant risk factor for opioid use disorder and high-risk opioid prescription, with the former association particularly strong in men. Clinical care for Veterans with military sexual trauma should consider elevated risk of opioid use disorder and high-risk opioid prescription.

Not Following the Rules in Guideline Care for Lung Cancer Diagnosis and Staging Has Negative Impact

BACKGROUND

Recent studies have identified poor adherence to recommended guidelines in diagnosing and staging patients with non-small cell lung cancer (NSCLC), and this practice has been associated with numerous negative downstream effects. However, these reports consist predominantly of large administrative databases with inherent limitations. We aimed to describe guideline-inconsistent care and identify any associated factors within the Swedish Cancer Institute health care system.

METHODS

A review of patients with a diagnosis of primary NSCLC between January 1, 2014 and December 31, 2014 within our community hospital network was performed. Univariate and multivariable logistic regression analyses were performed to identify factors associated with guideline-inconsistent care.

RESULTS

Guideline-inconsistent care was identified in 24% (98 of 406) of patients: 58% (46 of 81) in clinical stage III and 29% (52 of 179) in stage IV. Of the 46 clinical stage III patients with guideline-inconsistent care, 43% (20) had no invasive mediastinal lymph node sampling before treatment initiation. Patients with guideline-inconsistent care more frequently underwent additional invasive procedures and had a delay in management. Regression analyses identified clinical stage III disease, stage IV with distant metastases, and specialty ordering the diagnostic test to be associated with guideline-inconsistent care.

CONCLUSIONS

Guideline-inconsistent diagnosis and staging of patients with NSCLC, particularly patients with stage III disease, are highly prevalent. This finding is associated with incomplete staging, a higher number of additional procedures, and a delay in management. The identification of this vulnerable population may serve as a target for quality improvement interventions aimed to increase adherence to guidelines while decreasing unnecessary procedures and time to treatment.

Utility of FDG PET/CT for Preoperative Staging of Non-Small Cell Lung Cancers Manifesting as Subsolid Nodules With a Solid Portion of 3 cm or Smaller

OBJECTIVE. The objective of our study was to investigate the utility of FDG PET/CT for the preoperative staging of subsolid non-small cell lung cancers (NSCLCs) with a solid portion size of 3 cm or smaller. MATERIALS AND METHODS. We retrospectively enrolled 855 patients with pathologically proven NSCLCs manifesting as subsolid nodules with a solid portion of 3 cm or smaller on CT. We then compared the diagnostic performances of FDG PET/CT and chest CT for detecting lymph node (LN), intrathoracic, or distant metastases in patients who underwent preoperative chest CT and FDG PET/CT. After propensity score matching, we compared the diagnostic performance of FDG PET/CT in the group who underwent both chest CT and FDG PET/CT with that of chest CT in patients who did not undergo FDG PET/CT. RESULTS. There were LN metastases in 25 of 765 patients (3.3%) who underwent surgical LN dissection or biopsy and intrathoracic or distant metastasis in two of 855 patients (0.2%). For LN staging, FDG PET/CT showed a sensitivity of 44.0%, specificity of 81.5%, positive predictive value of 9.6%, negative predictive value of 97.0%, and accuracy of 79.9%, which were lower than those of chest CT for accuracy (p < 0.0001). FDG PET/CT could not accurately detect any intrathoracic or distant metastasis. After propensity score matching, the diagnostic accuracy for LN staging of FDG PET/CT in the group who underwent both CT and FDG PET/CT was lower than that of chest CT in the group who did not undergo FDG PET/CT (p = 0.002), and the diagnostic accuracy for intrathoracic and distant metastases was not different (p > 0.999). CONCLUSION. FDG PET/CT has limited utility in preoperatively detecting LN or distant metastasis in patients with subsolid NSCLCs with a solid portion size of 3 cm or smaller.

Preoperative brain MRI for clinical stage IA lung cancer: is routine scanning rational?

PURPOSE

Early detection and control of lung cancer brain metastases (BMs) are important. However, several guideline recommendations are inconsistent with regard to routine preoperative brain MRI, especially in patients with clinical stage IA lung cancer. Our study evaluated the value of preoperative brain MRI in patients with clinical stage IA lung cancer.

METHODS

A retrospective analysis of patients with lung cancer was performed using a prospectively collected database. Clinical data and the results of brain MRI were collected and analyzed.

RESULTS

Patients with pathologically proved primary lung cancer who underwent an MRI at initial diagnosis were identified (3392 patients). In total, 170 patients (5.0%) were diagnosed with BMs. The increased frequency of BMs was significantly associated with advanced clinical stage (P = 0.000) and pathological type (P = 0.011). BMs were detected in 11 out of 1595 patients with clinical stage IA lung cancer (0.7%). BMs were more common in patients with clinical stage cT1c lung cancer (1.9%) than those with clinical stage cT1a or cT1b (0.1%, odds ratio = 21.30, 95% confidence interval: 2.7-166.9, P = 0.000). All patients with stage IA lung cancer and BMs had solid lung lesions (P = 0.002).

CONCLUSIONS

Preoperative brain MRI might help identify BMs in patients with lung cancer that has progressed beyond stage IA. In patients with clinical stage IA lung cancer, we do not recommend preoperative brain MRI, but it may potentially be beneficial in those with solid T1c cancers.

Lymph Node Size Predicts for Asymptomatic Brain Metastases in Patients With Non-small-cell Lung Cancer at Diagnosis

BACKGROUND

We questioned whether the National Comprehensive Cancer Network recommendations for brain magnetic resonance imaging (MRI) for patients with stage ≥ IB non-small-cell lung cancer (NSCLC) was high-yield compared with American College of Clinical Pharmacy and National Institute for Health and Care Excellence guidelines recommending stage III and above NSCLC. We present the prevalence and factors predictive of asymptomatic brain metastases at diagnosis in patients with NSCLC without extracranial metastases.

MATERIALS AND METHODS

A retrospective analysis of 193 consecutive, treatment-naïve patients with NSCLC diagnosed between January 2010 and August 2015 was performed. Exclusion criteria included no brain MRI staging, symptomatic brain metastases, or stage IV based on extracranial disease. Univariate and multivariate logistic regression was performed.

RESULTS

The patient characteristics include median age of 65 years (range, 36-90 years), 51% adenocarcinoma/36% squamous carcinoma, and pre-MRI stage grouping of 31% I, 22% II, 34% IIIA, and 13% IIIB. The overall prevalence of brain metastases was 5.7% (n = 11). One (2.4%) stage IA and 1 (5.6%) stage IB patient had asymptomatic brain metastases at diagnosis, both were adenocarcinomas. On univariate analysis, increasing lymph nodal stage (P = .02), lymph nodal size > 2 cm (P = .009), multi-lymph nodal N1/N2 station involvement (P = .027), and overall stage (P = .005) were associated with asymptomatic brain metastases. On multivariate analysis, increasing lymph nodal size remained significant (odds ratio, 1.545; P = .009).

CONCLUSION

Our series shows a 5.7% rate of asymptomatic brain metastasis for patients with stage I to III NSCLC. Increasing lymph nodal size was the only predictor of asymptomatic brain metastases, suggesting over-utilization of MRI in early-stage disease, especially in lymph node-negative patients with NSCLC. Future efforts will explore the utility of baseline MRI in lymph node-positive stage II and all stage IIIA patients.

Choosing wisely in oncology: necessity and obstacles

In the last decades, the survival of many patients with cancer improved thanks to modern diagnostic methods and progresses in therapy. Still for several tumours, especially when diagnosed at an advanced stage, the benefits of treatment in terms of increased survival or quality of life are at best modest when not marginal, and should be weighed against the potential discomfort caused by medical procedures. As in other specialties, in oncology as well the dialogue between doctor and patient should be encouraged about the potential overuse of diagnostic procedures or treatments. Several oncological societies produced recommendations similar to those proposed by other medical disciplines adhering to the Choosing Wisely (CW) campaign. In this review, we describe what was reported in the medical literature concerning adequacy of screening, diagnostic, treatment and follow-up procedures and the potential impact on them of the CW. We only marginally touch on the more complex topic of treatment appropriateness, for which several evaluation methods have been developed (including the European Society for Medical Oncology-magnitude of clinical benefit scale). Finally, we review the possible obstacles for the development of CW in the oncological setting and focus on the strategies which could allow CW to evolve in the cancer field, so as to enhance the therapeutic relationship between medical professionals and patients and promote more appropriate management.

Added Value of Including Entire Brain on Body Imaging With FDG PET/MRI

OBJECTIVE

FDG PET/MRI examination of the body is routinely performed from the skull base to the mid thigh. Many types of brain abnormalities potentially could be detected on PET/MRI if the head was included. The objective of this study was therefore to identify and characterize brain findings incidentally detected on PET/MRI of the body with the head included.

MATERIALS AND METHODS

We retrospectively identified 269 patients with FDG PET/MRI whole-body scans that included the head. PET/MR images of the brain were reviewed by a nuclear medicine physician and neuroradiologist, first individually and then concurrently. Both PET and MRI findings were identified, including abnormal FDG uptake, standardized uptake value, lesion size, and MRI signal characteristics. For each patient, relevant medical history and prior imaging were reviewed.

RESULTS

Of the 269 subjects, 173 were women and 96 were men (mean age, 57.4 years). Only the initial PET/MR image of each patient was reviewed. A total of 37 of the 269 patients (13.8%) had abnormal brain findings noted on the PET/MRI whole-body scan. Sixteen patients (5.9%) had vascular disease, nine patients (3.3%) had posttherapy changes, and two (0.7%) had benign cystic lesions in the brain. Twelve patients (4.5%) had serious nonvascular brain abnormalities, including cerebral metastasis in five patients and pituitary adenomas in two patients. Only nine subjects (3.3%) had a new neurologic or cognitive symptom suggestive of a brain abnormality.

CONCLUSION

Routine body imaging with FDG PET/MRI of the area from the skull base to the mid thigh may miss important brain abnormalities when the head is not included. The additional brain abnormalities identified on whole-body imaging may provide added clinical value to the management of oncology patients.

Dilemmas in Lung Cancer Staging

The advent of the 8th edition of the lung cancer staging system reflects a further meticulous evidence-based advance in the stratification of the survival of patients with lung cancer. Although addressing many limitations of earlier staging systems, several limitations in staging remain. This article reviews from a radiological perspective the limitations of the current staging system, highlighting the process of TNM restructuring, the residual issues with regards to the assignment of T, N, M descriptors, and their associated stage groupings and how these dilemmas impact guidance of multidisciplinary teams taking care of patients with lung cancer.

An audit of clinical practice, referral patterns, and appropriateness of clinical indications for brain MRI examinations: A single-centre study in Ghana

INTRODUCTION

The aim of this study was to investigate current brain MRI practice, pattern of brain MRI requests, and their appropriateness using the American College of Radiology (ACR) Appropriateness Criteria.

MATERIAL AND METHODS

We used direct observation and questionnaires to obtain data concerning routine brain MRI practice. We then retrospectively analyzed (i) demographic characteristics, (ii) clinical history, and (iii) appropriateness of brain MRI requests against published criteria.

RESULTS

All patients were administered the screening questionnaire; however, no reviews were undertaken directly with patients, and no signature of the radiographer was recorded. Apart from routine brain protocol, there were dedicated protocols for epilepsy and stroke. Brain MRI images from 161 patients (85 Males; 76 Females) were analyzed. The age group with most brain MRI requests were from 26 to 45 year olds. The commonest four clinical indications for imaging were brain tumour, headache, seizure, and stroke. Using the ACR Appropriateness Criteria, almost 43% of the brain MRI scans analyzed were found to be "usually appropriate", 38% were "maybe appropriate" and 19% were categorized as "usually not appropriate".

CONCLUSION

There was knowledge gap with regards to MRI safety in local practice, thus there is the utmost need for MRI safety training. Data on the commonest indications for performing brain MRI in this study should be used to inform local neuroradiological practice. Dedicated stroke and epilepsy MRI protocols require additional sequences i.e. MRA and 3D T1 volume acquisition, respectively. The ACR Appropriateness Criteria is recommended for use by the referring practitioners to improve appropriateness of brain MRI requests.

Reducing Bottlenecks to Improve the Efficiency of the Lung Cancer Care Delivery Process: A Process Engineering Modeling Approach to Patient-Centered Care

The process of lung cancer care from initial lesion detection to treatment is complex, involving multiple steps, each introducing the potential for substantial delays. Identifying the steps with the greatest delays enables a focused effort to improve the timeliness of care-delivery, without sacrificing quality. We retrospectively reviewed clinical events from initial detection, through histologic diagnosis, radiologic and invasive staging, and medical clearance, to surgery for all patients who had an attempted resection of a suspected lung cancer in a community healthcare system. We used a computer process modeling approach to evaluate delays in care delivery, in order to identify potential 'bottlenecks' in waiting time, the reduction of which could produce greater care efficiency. We also conducted 'what-if' analyses to predict the relative impact of simulated changes in the care delivery process to determine the most efficient pathways to surgery. The waiting time between radiologic lesion detection and diagnostic biopsy, and the waiting time from radiologic staging to surgery were the two most critical bottlenecks impeding efficient care delivery (more than 3 times larger compared to reducing other waiting times). Additionally, instituting surgical consultation prior to cardiac consultation for medical clearance and decreasing the waiting time between CT scans and diagnostic biopsies, were potentially the most impactful measures to reduce care delays before surgery. Rigorous computer simulation modeling, using clinical data, can provide useful information to identify areas for improving the efficiency of care delivery by process engineering, for patients who receive surgery for lung cancer.

Overuse of Health Care Services in the Management of Cancer: A Systematic Review

BACKGROUND

Overuse, the provision of health services for which harms outweigh the benefits, results in suboptimal patient care and may contribute to the rising costs of cancer care. We performed a systematic review of the evidence on overuse in oncology.

METHODS

We searched Medline, EMBASE, the Cochrane Library, Web of Science, SCOPUS databases, and 2 grey literature sources, for articles published between December 1, 2011 and March 10, 2017. We included publications from December 2011 to evaluate the literature since the inception of the ABIM Foundation's Choosing Wisely initiative in 2012. We included original research articles quantifying overuse of any medical service in patients with a cancer diagnosis when utilizing an acceptable standard to define care appropriateness, excluding studies of cancer screening. One of 4 investigator reviewed titles and abstracts and 2 of 4 reviewed each full-text article and extracted data. Methodology used PRISMA guidelines.

RESULTS

We identified 59 articles measuring overuse of 154 services related to imaging, procedures, and therapeutics in cancer management. The majority of studies addressed adult or geriatric patients (98%) and focused on US populations (76%); the most studied services were diagnostic imaging in low-risk prostate and breast cancer. Few studies evaluated active cancer therapeutics or interventions aimed at reducing overuse. Rates of overuse varied widely among services and among studies of the same service.

CONCLUSIONS

Despite recent attention to overuse in cancer, evidence identifying areas of overuse remains limited. Broader investigation, including assessment of active cancer treatment, is critical for identifying improvement targets to optimize value in cancer care.

Evidence for overuse of medical services around the world

Overuse, which is defined as the provision of medical services that are more likely to cause harm than good, is a pervasive problem. Direct measurement of overuse through documentation of delivery of inappropriate services is challenging given the difficulty of defining appropriate care for patients with individual preferences and needs; overuse can also be measured indirectly through examination of unwarranted geographical variations in prevalence of procedures and care intensity. Despite the challenges, the high prevalence of overuse is well documented in high-income countries across a wide range of services and is increasingly recognised in low-income countries. Overuse of unneeded services can harm patients physically and psychologically, and can harm health systems by wasting resources and deflecting investments in both public health and social spending, which is known to contribute to health. Although harms from overuse have not been well quantified and trends have not been well described, overuse is likely to be increasing worldwide.

FDG PET/CT in cancer: comparison of actual use with literature-based recommendations

Purpose

The Region of Southern Denmark (RSD), covering 1.2 of Denmark’s 5.6 million inhabitants, established a task force to (1) retrieve literature evidence for the clinical use of positron emission tomography (PET)/CT and provide consequent recommendations and further to (2) compare the actual use of PET/CT in the RSD with these recommendations. This article summarizes the results.

Methods

A Work Group appointed a professional Subgroup which made Clinician Groups conduct literature reviews on six selected cancers responsible for 5,768 (62.6 %) of 9,213 PET/CT scans in the RSD in 2012. Rapid Evidence Assessment was applied, using the methodology of systematic reviews with predefined limitations to search PubMed, Embase and the Cochrane Library for articles published in English/Danish/Swedish/Norwegian since 2002. PICO questions were defined, data recorded and quality appraised and rated with regard to strength and evidence level. Consequent recommendations for applications of PET/CT were established. The actual use of PET/CT was compared with these, where grades A and B indicated “established” and “useful” and grades C and D “potentially useful” and “non-recommendable” indications, respectively.

Results

Of 11,729 citations, 1,729 were considered for review, and 204 were included. The evidence suggested usefulness of PET/CT in lung, lymphoma, melanoma, head and neck, and colorectal cancers, whereas evidence was sparse in gynaecological cancers. The agreement between actual use of PET/CT and literature-based recommendations was high in the first five mentioned cancers in that 96.2 % of scans were made for grade A or B indications versus only 22.2 % in gynaecological cancers.

Conclusion

Evidence-based usefulness was reported in five of six selected cancers; evidence was sparse in the sixth, gynaecological cancers. Actual use of PET/CT agreed well with recommendations.

Electronic supplementary material

The online version of this article (doi:10.1007/s00259-015-3217-0) contains supplementary material, which is available to authorized users.

Implementing effective and sustainable multidisciplinary clinical thoracic oncology programs

Three models of care are described, including two models of multidisciplinary care for thoracic malignancies. The pros and cons of each model are discussed, the evidence supporting each is reviewed, and the need for more (and better) research into care delivery models is highlighted. Key stakeholders in thoracic oncology care delivery outcomes are identified, and the need to consider stakeholder perspectives in designing, validating and implementing multidisciplinary programs as a vehicle for quality improvement in thoracic oncology is emphasized. The importance of reconciling stakeholder perspectives, and identify meaningful stakeholder-relevant benchmarks is also emphasized. Metrics for measuring program implementation and overall success are proposed.