The Department of Veterans Affairs' NSQIP: the first national, validated, outcome-based, risk-adjusted, and peer-controlled program for the measurement and enhancement of the quality of surgical care. National VA Surgical Quality Improvement Program

Outcome after pancreaticoduodenectomy for periampullary cancer: an analysis from the Veterans Affairs National Surgical Quality Improvement Program

The aim of this study is to define the risk factors that predict adverse outcomes for patients undergoing pancreaticoduodenectomy for periampullary cancer in the Department of Veterans Affairs Healthcare System (VA). The VA National Surgical Quality Improvement Program prospectively collected data on 462 patients undergoing pancreaticoduodenectomy in 123 VA medical centers from 1990 to 2000. Independent variables included 68 preoperative and 12 intraoperative variables. The main outcome measures were 30-day postoperative mortality and morbidity, as measured by a set of 20 pre-defined complications. Predictive models for 30-day morbidity and mortality were constructed using logistic regression analysis. The 30-day morbidity rate was 45.9% (212/462). The 30-day postoperative mortality rate was 9.3% (43/462). Significant predictors of mortality included: preoperative serum albumin, American Society of Anesthesiologists classification, preoperative bilirubin >20mg/dl, and operative time. The use of preoperative biliary tract instrumentation did not predict postoperative death or septic complications. This study provides a set of preoperative risk factors that are predictive of adverse outcome following pancreaticoduodenectomy. These factors may assist in patient selection for this procedure and are likely to facilitate risk-adjusted comparison of pancreaticoduodenectomy outcomes between different health care systems.

The volume-outcome relationship: from Luft to Leapfrog

Numerous reports have documented a volume-outcome relationship for complex medical and surgical care, although many such studies are compromised by the use of discharge abstract data, inadequate risk adjustment, and problematic statistical methodology. Because of the volume-outcome association, and because valid outcome measurements are unavailable for many procedures, volume-based referral strategies have been advocated as an alternative approach to health-care quality improvement. This is most appropriate for procedures with the greatest outcome variability between low-volume and high-volume providers, such as esophagectomy and pancreatectomy, and for particularly high-risk subgroups of patients. Whenever possible, risk-adjusted outcome data should supplement or supplant volume standards, and continuous quality improvement programs should seek to emulate the processes of high-volume, high-quality providers. The Leapfrog Group has established a minimum volume requirement of 500 procedures for coronary artery bypass grafting. In view of the questionable basis for this recommendation, we suggest that it be reevaluated.

The impact of co-morbid disease on cancer control and survival following radical cystectomy

PURPOSE

We clarified the impact of concurrent medical disease on tumor control and survival following radical cystectomy.

MATERIALS AND METHODS

A total of 106 consecutive patients with clinically localized (cT2 or less) disease underwent radical cystectomy at the University of Michigan between 1997 and 1998. The Charlson Index, a validated risk adjustment index, was used to assess preoperative co-morbidity. The 3 primary end points were pathological stage, disease specific survival and overall survival. Logistic regression models were used to determine the relationship between Charlson Index and pathological stage, while Cox regression models were used for the 2 survival end points.

RESULTS

Of our study population 24% had a Charlson Index score of 2 or greater. Myocardial infarction, nonurothelial solid malignancies and cerebrovascular disease were the most common co-morbid conditions at 14%, 12% and 10%, respectively. On bivariate analysis the Charlson Index was significantly associated with decreased disease specific (p = 0.049) and overall (p = 0.016) survival. In a multivariate model the index was independently associated with decreased cancer specific survival (p = 0.049) and increased risk of extravesical disease (p = 0.033).

CONCLUSIONS

We demonstrated an association between co-morbid illness and adverse pathological and survival outcome following radical cystectomy. This finding underscores the value of assessing overall health before recommending and proceeding with surgery. Moreover, our results emphasize the need to adjust for co-morbidity when comparing outcomes following radical cystectomy.

Surgeons and cognitive processes

BACKGROUND

The surgical mind is geared to make important decisions and perform highly skilled tasks. The aim of this review is to explore the cognitive processes that link these actions.

METHODS

The core of this review is derived from a literature search of a computer database (Medline).

RESULTS AND CONCLUSION

The surgical image is one of action. However, the effective performance of surgery requires more than mere manual dexterity and it is evident that competent surgeons exhibit the cognitive traits that are held by all experts. The changes that are occurring in surgery indicate a need to place greater emphasis on the cognitive processes that underpin the practice of surgery. It is important that surgeons do not become victims of their own cult image.

Outcomes after esophagectomy: a ten-year prospective cohort

BACKGROUND

The Department of Veterans Affairs National Surgical Quality Improvement Program is a unique resource to prospectively analyze surgical outcomes from a cross-section of surgical services nationally. We used this database to assess risk factors for morbidity and mortality after esophagectomy in Veterans Affairs Medical Centers from 1991 to 2001.

METHODS

A total of 1,777 patients underwent an esophagectomy at 109 Veterans Affairs hospitals with complete in-hospital and 30-day outcomes recorded. Bivariate and multivariable analyses were completed.

RESULTS

Thirty-day mortality was 9.8% (174/1,777) and the incidence of one or more of 20 predefined complications was 49.5% (880/1,777). The most frequent postoperative complications were pneumonia in 21% (380/1,777), respiratory failure in 16% (288/1,777), and ventilator support more than 48 hours in 22% (387/1,777). Preoperative predictors of mortality based on multivariable analysis included neoadjuvant therapy, blood urea nitrogen level of more than 40 mg/dL, alkaline phosphatase level of more than 125 U/L, diabetes mellitus, alcohol abuse, decreased functional status, ascites, and increasing age. Preoperative factors impacting morbidity were increasing age, dyspnea, diabetes mellitus, chronic obstructive pulmonary disease, alkaline phosphatase level of more than 125 U/L, lower serum albumin concentration, increased complexity score, and decreased functional status. Intraoperative risk factors for mortality included the need for transfusion; intraoperative risk factors for morbidity included the need for transfusion and longer operative time.

CONCLUSIONS

These data constitute the largest prospective outcomes cohort in the literature and document a near 50% morbidity rate and 10% mortality rate after esophagectomy. Data from this study can be used to better stratify patients before esophagectomy.

Connections between quality measurement and improvement

BACKGROUND

Measurement is necessary but not sufficient for quality improvement. Because the purpose of the national quality measurement and reporting system (NQMRS) is to improve quality, a discussion of the link between measurement and improvement is critical for ensuring an appropriate system design.

OBJECTIVES

To classify approaches to the use of measurement in improvement into two different--although linked and potentially synergistic--agendas, or "pathways." To discuss the barriers encountered in each of these pathways and identify steps needed to motivate improvement in both pathways.

RESEARCH DESIGN

Descriptive, conceptual discussion.

FINDINGS

The barriers to the use of information to motivate change include, in Pathway I (selection), the lack of skill, knowledge, and motivation on the part of those who could drive change by using data to choose from among competing providers, and, in Pathway II (change in care delivery), the deficiencies in organizational and professional capacity in health care to lead change and improvement itself.

CONCLUSIONS

Neither the dynamics of selection nor the dynamics of improvement work reliably today. The barriers are not just in the lack of uniform, simple, and reliable measurements, they also include a lack of capacity among the organizations and individuals acting on both pathways.

To what extent should quality of care decisions be based on health outcomes data? Application to carotid endarterectomy

BACKGROUND AND PURPOSE

Most quality improvement methods implicitly assume that facilities with high complication rates are likely to have substandard processes of care, a stable characteristic that, in the absence of intervention, will persist over time. We assessed the extent to which this holds true for carotid endarterectomy.

METHODS

Using data from the Department of Veterans Affairs National Surgical Quality Improvement Project, we classified facilities on the basis of 30-day complications of carotid endarterectomy (stroke, myocardial infarction, death) during 1994 to 1995 (period 1, n=3389) and then compared these groups of facilities for complication rates during 1996 to 1997 (period 2, n=4453).

RESULTS

Despite wide variation in facility-specific complication rates, the correlation between rates in periods 1 and 2 was low (Spearman correlation coefficient, 0.04; P=0.01) Facility-specific rates did not show greater correlation when we examined only facilities with higher volumes patients in different clinical categories (asymptomatic, transient ischemic attack, stroke). Comorbid illness profiles were similar between the 2 time periods.

CONCLUSIONS

Most of the facility-specific differences in complication rates in period 1 were not maintained into period 2. Many apparent quality improvement problems may not be as large as they first appear, especially when based on few complications per facility. The inability, in practice, to estimate complication rates at a high degree of precision is a fundamental difficulty for clinical policy making regarding procedures with complication rates such as carotid endarterectomy.

Cholecystectomy in patients with previous spinal cord injury

BACKGROUND

The number of people in the United States with spinal cord injury (SCI) is estimated at about 200,000. The prevalence of gallbladder disease in this population is about three times as high as in neurally intact people, but the results of surgical treatment have received little attention.

METHODS

A retrospective, population-based study of patients with SCI who later received cholecystectomy for benign gallbladder disease was performed. National computer data sets of all patients receiving medical care in all Department of Veterans Affairs (DVA) medical centers for fiscal years 1994 to 1998 were used. Computer-based data were augmented with chart-based resources.

RESULTS

During the period of interest, there were 21,849 patients with ICD-9-CM codes for SCI in the DVA computer system, among whom 367 had codes for cholecystectomy. After retrieval and review of data from individual charts, 118 were deemed evaluable. There were 68 who had successful laparoscopic cholecystectomy and 14 who required conversion to open cholecystectomy after laparoscopic efforts failed (conversion rate 14 of 82=17%). There were 36 who received planned open cholecystectomy. Patients under the age of 60 years were more likely to have a laparoscopic approach (P <0.05). Emergency cholecystectomies were more likely to be performed via the open route (P <0.01). The morbidity rate was 8 of 68 (12%) for successful laparoscopic cholecystectomy, 4 of 14 (29%) for failed laparoscopic surgery completed by conventional open technique, and 11 of 36 (31%) for planned open surgery. The mortality rate in the traditional surgery group was 1 of 36 (3%). There were no deaths in the other groups.

CONCLUSIONS

We believe this series is the largest so far reported. The mortality rate of cholecystectomy in SCI patients is comparable to that in neurally intact individuals, but the morbidity rate is high. Contractures, stomas, heterotopic ossification, and other sequelae of SCI do not generally cause technical difficulties with surgery. If complications of cholecystectomy are indeed SCI-related, attention to perioperative SCI care could improve outcomes of cholecystectomy. Future research should continue to explore this important research topic.

The National Surgical Quality Improvement Program in non-veterans administration hospitals: initial demonstration of feasibility

OBJECTIVE

To assess the feasibility of implementing the National Surgical Quality Improvement Program (NSQIP) methodology in non-VA hospitals.

SUMMARY BACKGROUND DATA

Using data adjusted for patient preoperative risk, the NSQIP compares the performance of all VA hospitals performing major surgery and anonymously compares these hospitals using the ratio of observed to expected adverse events. These results are provided to each hospital and used to identify areas for improvement. Since the NSQIP's inception in 1994, the VA has reported consistent improvements in all surgery performance measures. Given the success of the NSQIP within the VA, as well as the lack of a comparable system in non-VA hospitals, this pilot study was undertaken to test the applicability of the NSQIP models and methodology in the nonfederal sector.

METHODS

Beginning in 1999, three academic medical centers (Emory University, Atlanta, GA; University of Michigan, Ann Arbor, MI; University of Kentucky, Lexington, KY) volunteered the time of a dedicated surgical nurse reviewer who was trained in NSQIP methodology. At each academic center, these nurse reviewers used NSQIP protocols to abstract clinical data from general surgery and vascular surgery patients. Data were manually collected and then transmitted via the Internet to a secure web site developed by the NSQIP. These data were compared to the data for general and vascular surgery patients collected during a concurrent time period (10/99 to 9/00) within the VA by the NSQIP. Logistic regression models were developed for both non-VA and VA hospital data. To assess the models' predictive values, C-indices (0.5 = no prediction; 1.0 = perfect prediction) were calculated after applying the models to the non-VA as well as the VA databases.

RESULTS

Data from 2,747 (general surgery 2,251; vascular surgery 496) non-VA hospital cases were compared to data from 41,360 (general surgery 31,393; vascular surgery 9,967) VA cases. The bivariate relationships between individual risk factors and 30-day mortality or morbidity were similar in the non-VA and VA patient populations for over 66% of the risk variables. C-indices of 0.942 (general surgery), 0.915 (vascular surgery), and 0.934 (general plus vascular surgery) were obtained following application of the VA NSQIP mortality model to the non-VA patient data. Lower C-indices (0.778, general surgery; 0.638, vascular surgery; 0.760, general plus vascular surgery) were obtained following application of the VA NSQIP morbidity model to the non-VA patient data. Although the non-VA sample size was smaller than the VA, preliminary analysis suggested no differences in risk-adjusted mortality between the non-VA and VA cohorts. CONCLUSIONS With some adjustments, the NSQIP methodology can be implemented and generates reasonable predictive models within non-VA hospitals.

Modest serum creatinine elevation affects adverse outcome after general surgery

BACKGROUND

Modest preoperative serum creatinine elevation (1.5 to 3.0 mg/dL) has been recently shown to be independently associated with morbidity and mortality after cardiac surgery. It is important to know if this association can be applied more broadly to general surgery cases.

METHODS

Multivariable logistic regression analyses of 46 risk variables in 49,081 cases from the Veterans Affairs National Surgical Quality Improvement Program, undergoing major general surgery from 10/1/96 through 9/30/98.

RESULTS

Thirty day mortality and several cardiac, respiratory, infectious and hemorrhagic morbidities were significantly (P < 0.001) higher in patients with a serum creatinine>1.5 mg/dL. With multivariable analysis, the adjusted odds ratio for mortality for patients with a serum creatinine of 1.5 to 3.0 mg/dL was 1.44 [95% confidence interval (95% CI) 1.22 to 1.71] and for creatinine>3.0 mg/dL was 1.93 (95% CI 1.51 to 2.46). The adjusted odds ratio for morbidity (one or more postoperative complications) for patients with a serum creatinine of 1.5 to 3.0 mg/dL was 1.18 (95% CI 1.06 to 1.32) and for creatinine>3.0 mg/dL was 1.19 (95% CI 0.99 to 1.43). Further stratification and recursive partitioning of creatinine levels revealed that a serum creatinine level>1.5 mg/dL was the approximate threshold for both increased morbidity and mortality.

CONCLUSIONS

Modest preoperative serum creatinine elevation (>1.5 mg/dL) is a significant predictor of risk-adjusted morbidity and mortality after general surgery. A preoperative serum creatinine of 1.5 mg/dL or higher is a readily available marker for potential adverse outcomes after general surgery.

Development of an appropriate list of surgical procedures of a specified maximum anesthetic complexity to be performed at a new ambulatory surgery facility

A common but difficult task for a hospital when it decides to open a freestanding ambulatory surgery facility is how to decide which surgical procedures should be done at the new facility. This is necessary in order to determine how many operating rooms to plan for the new facility and which ancillary services are needed on-site. In this case study, we describe a novel methodology that we used to develop a comprehensive list of procedures to be done at a new ambulatory facility. The level of anesthetic complexity of a procedure was defined by its number of ASA Relative Value Guide basic units. Broad categories of procedures (e.g., eye surgery) were defined according to the International Classification of Diseases, Ninth Revision, Clinical Modification. We identified 22 categories that are of a type that every procedure in the category has no more than seven basic units. In addition, by analyzing all procedures that the hospital being studied actually performed on an ambulatory basis, we identified six other categories of procedures that were of a type that all procedures eligible for surgery at the new facility had seven or fewer basic units.

IMPLICATIONS

We describe a novel method to develop a comprehensive list of procedures that have a prespecified maximum level of anesthetic complexity to be performed at a new ambulatory surgery facility.

Strengths and limitations of competitive versus non-competitive models of integrated capitated fundholding

Integrated budget-holding (fundholding) based on risk-adjusted capitation is commonly proposed as a central element of health system reform. Two contrasting models have been developed: the competitive model where fundholders or health plans compete for enrollees; and the non-competitive model, where plan membership is determined according to an objective attribute such as place of residence. Under the competitive model, efficiency is sought through consumer choice of plan. A range of regulatory elements may also be introduced to moderate undesirable elements of competition. Under the non-competitive model, efficiency is achieved through government regulation and the fact that the fundholder has continuing responsibility for the health of a defined population, supported by micro-management tools (such as quality assurance and selective payment arrangements). In theory, the non-competitive model encourages population-based health services planning. While both models assume risk-adjusted capitated funding, the requirements of any formula are more stringent under the competitive model. Economic theory, as well as documented health system experience, can help identify the relative strengths and limitations of each model. Concerns with the competitive model relate primarily to the capacity to develop robust risk adjusters for capitation sufficient to reduce the incentives for patient risk selection. Possible reductions in the quality of care are also a concern, compounded by difficulties for consumers in discriminating between plans. Efficiency under the non-competitive model requires a strong and appropriate regulatory/policy framework and effective use of micro-management tools. Funding equity objectives can be met through either model by the adoption of income-related contributions, but under the competitive model this may be compromised by incentives for the fundholders to select low-risk patients. Evidence drawn from regional fundholding in New South Wales (NSW, Australia), the US Veterans Health Agency and the literature on managed care in the USA illustrate these concerns. The problem of risk selection in the competitive model is a major theoretical concern, confirmed by the empirical evidence. This, together with concerns regarding other aspects of performance, suggests that the non-competitive model may be preferable, at least as an interim step in reform in public or mixed systems. Future research on this issue is clearly required.

Thirty-day postoperative death rate at an academic medical center

OBJECTIVE

To improve understanding of perioperative deaths at an academic medical center.

SUMMARY BACKGROUND DATA

Because published data have typically focused on specific patient populations, diagnoses, or procedures, there are few data regarding surgical deaths and complications in institutional or regional studies. Specifically, surgical adverse events and errors are generally not studied comprehensively. This limits the overall understanding of complications and deaths.

METHODS

Data from all operations performed in the main operating suite of the University of Virginia Health Sciences Center from January 1 to June 30, 1999, were compared with state death records to gain a dataset of patients dying within 30 days of surgery. All clinical records from patients who died were screened for adverse events and subsequently reviewed by three surgeons who identified adverse events and errors and performed comparisons with survivors.

RESULTS

One hundred nineteen deaths followed 7,379 operations performed on 6,296 patients, yielding a patient death rate of 1.9%. Patients dying within 30 days of surgery were older and had higher American Society of Anesthesiologists scores. Of 119 deaths, 86 (72.3%) were attributable to the patient's primary disease. Twenty-three patient deaths (19.3% of all deaths, 0.37% of all patients) could not be attributed to the patient's primary disease and thus were suspicious for an adverse event (AE) as the cause of the death. Of the 23 deaths suspicious for AE, 15 (12.6% of all deaths, and 65.2% of AE deaths) followed an error in care and thus were classified as potentially preventable, affecting 0.24% of the study population.

CONCLUSIONS

Overall, the 30-day postoperative death rate was low in the total surgical population at an academic medical center. Errors and AEs were associated with 12.6% and 19.3% of deaths, respectively. Retrospective review inadequately characterized the nature of AEs and failed to determine causality. Prospective audits of outcomes will enhance our understanding of surgical AEs.

Morbidity and mortality of gastrectomy for cancer in Department of Veterans Affairs Medical Centers

BACKGROUND

The purpose of this study was to define risk factors that predict 30-day morbidity and mortality after gastrectomy for cancer in Veterans Affairs (VA) Medical Centers.

METHODS

The VA National Surgical Quality Improvement Program prospectively collected data on 708 patients undergoing gastrectomy for cancer in 123 participating VA medical centers from 1991 to 1998. Independent variables included 68 preoperative patient characteristics and 12 intraoperative variables; the dependent variables were 21 defined adverse outcomes and death. Predictive models for 30-day morbidity and mortality were constructed by using stepwise logistic regression analysis.

RESULTS

The 30-day morbidity rate was 33.3% (236 of 708). The overall 30-day mortality rate was 7.6% (54 of 708). Significant positive predictors of morbidity (P <.05) included current pneumonia, American Society of Anesthesiologists class IV (threat to life), partially dependent functional status, dyspnea on minimal exertion, preoperative transfusion, extended operative time, and increasing age. Significant positive predictors of mortality (P <.05) included do not resuscitate status, prior stroke, intraoperative transfusion, preoperative weight loss, preoperative transfusion, and elevated preoperative alkaline phosphatase level.

CONCLUSIONS

Risk factors predicting morbidity and mortality rates at VA hospitals after gastrectomy for gastric cancer are reported by using a prospectively collected, multi-institutional database. Assigning relative weights to factors associated with adverse outcomes may help improve patient care.

The effect of patient selection on comorbidity-adjusted operative mortality risk. Implications for outcomes studies of surgical procedures

Consumers of outcomes research may assume that risk-adjustment procedures based on patients' comorbid conditions will control for baseline prognostic differences between comparison groups, so that differences in risk-adjusted outcomes represent effects other than those due to differences in comorbidity severity. However, surgeons may differ in their threshold to operate on patients with different intensities of the same comorbidity, which may not be accounted for using commonly employed risk-adjustment methods. We developed a model to explore the effect that selection based on comorbidity severity could have on estimates of the risk-adjusted relative risk (RR) of operative death. Larger effects on the apparent RR of operative death were observed when both the proportion of patients in the high-risk ("selected") stratum and the relative increase in the risk of death due to being in the high-risk stratum were large. Biased estimates of the risk-adjusted RR of operative death will be observed if surgeons differentially select patients based on comorbidity severity and if differences in comorbidity severity are not captured by the risk-adjustment methodology.

Identifying patient preoperative risk factors and postoperative adverse events in administrative databases: results from the Department of Veterans Affairs National Surgical Quality Improvement Program

BACKGROUND

The Department of Veterans Affairs (DVA) National Surgical Quality Improvement Program (NSQIP) employs trained nurse data collectors to prospectively gather preoperative patient characteristics and 30-day postoperative outcomes for most major operations in 123 DVA hospitals to provide risk-adjusted outcomes to centers as quality indicators. It has been suggested that routine hospital discharge abstracts contain the same information and would provide accurate and complete data at much lower cost.

STUDY DESIGN

With preoperative risks and 30-day outcomes recorded by trained data collectors as criteria standards, ICD-9-CM hospital discharge diagnosis codes in the Patient Treatment File (PTF) were tested for sensitivity and positive predictive value. ICD-9-CM codes for 61 preoperative patient characteristics and 21 postoperative adverse events were identified.

RESULTS

Moderately good ICD-9-CM matches of descriptions were found for 37 NSQIP preoperative patient characteristics (61%); good data were available from other automated sources for another 15 (25%). ICD-9-CM coding was available for only 13 (45%) of the top 29 predictor variables. In only three (23%) was sensitivity and in only four (31%) was positive predictive value greater than 0.500. There were ICD-9-CM matches for all 21 NSQIP postoperative adverse events; multiple matches were appropriate for most. Postoperative occurrence was implied in only 41%; same breadth of clinical description in only 23%. In only four (7%) was sensitivity and only two (4%) was positive predictive value greater than 0.500.

CONCLUSION

Sensitivity and positive predictive value of administrative data in comparison to NSQIP data were poor. We cannot recommend substitution of administrative data for NSQIP data methods.

Perioperative anemia: an independent risk factor for infection, mortality, and resource utilization in surgery

BACKGROUND

Previous studies on patients with hip fractures and in patients with colorectal cancer have documented that perioperative transfusion is associated with a significant increase in postoperative infection rate. Therefore, we sought to investigate the incidence of preoperative and postoperative anemia in noncardiac surgical patients and to determine if transfusion is an independent risk factor for infection and adverse outcome postoperatively.

METHODS

Prospective data from the National Veterans Administration Surgical Quality Improvement Program (NSQIP) was collected on 6301 noncardiac surgical patients at the Veterans Affairs Maryland Healthcare System from 1995 to 2000.

RESULTS

The mean age of the study cohort was 61 +/- 13. Descriptive data revealed 95% were male, 44% used tobacco, 19% were diabetic, 9% had COPD, 9% used alcohol, 3% used steroids, 1.7% had a diagnosis of cancer, and 1.2% had ascites. Preoperative anemia (hematocrit less than 36) was found in 33.9% and postoperative anemia was found in 84.1% of the study cohort. In the postoperative period, 32.5% of patients had a hematocrit of 26-30, and 26.5% had a hematocrit of 21-25. Mean units of blood transfused in the perioperative period ranged from 0.1 +/- 0.9 in patients without anemia to 2.7 +/- 2.9 in those with anemia. Incidence of pneumonia increased from 2.6 to 5% with increasing degree of anemia. Multiple logistic regression analysis documented that low preoperative hematocrit, low postoperative hematocrit, and increased blood transfusion rates were associated with increased mortality (P < 0.01), increased postoperative pneumonia (P < or = 0.05), and increased hospital length of stay (P < 0.05).

CONCLUSION

There is a high incidence of preoperative and postoperative anemia in surgical patients, with a coincident increase in blood utilization. These factors are associated with increased risk for perioperative infection and adverse outcome (mortality) in surgical patients. Consideration should be given to preoperative diagnosis and correction of anemia with iron, vitamin B12, folate supplementation, or administration of recombinant human erythropoietin.

Lower extremity nontraumatic amputation among veterans with peripheral arterial disease: is race an independent factor?

OBJECTIVES

To determine if race/ethnicity is independently associated with an increased risk for nontraumatic lower extremity amputation versus lower extremity bypass revascularization among patients with peripheral arterial disease (PAD).

METHODS

Data were analyzed from the National VA Surgical Quality Improvement Program (NSQIP) and from the Veterans Affairs Patient Treatment File (PTF). Race/ethnicity was defined as non-Hispanic white, black, or Hispanic. Variables that were univariately associated (P < or = 0.05) with the outcome of amputation were placed into a multiple logistic regression model to determine independent predictors for the dependent variable, lower extremity amputation versus lower extremity bypass revascularization.

RESULTS

Three thousand eighty-five lower extremity amputations and 8409 lower extremity bypass operations were identified. Among all cases included, there were 416 Hispanic patients (3.6%), 2337 black patients (20.3%), and 8741 non-Hispanic white patients (76.1%). Among all variables within the model, Hispanic and black race were each associated with a greater risk for amputation than a history of rest pain/gangrene (Hispanic race 1.4, 95% CI 1.1, 1.9; black race 1.5, 95% CI 1.4, 1.7; rest pain/gangrene 1.1, 95% CI 1.0, 1.3). The final model had a c statistic of 0.83.

CONCLUSION

Hispanic race and black race were independent risk factors for lower extremity amputation in patients with PAD. Although the burden of certain atherosclerotic risk factors (eg, diabetes and hypertension) is higher in minority patients, the impact of this burden does not account for the increased risk for the outcome of lower extremity amputation in these two populations. Further research is needed to better understand the reason(s) why race/ethnicity is independently associated with poor outcomes in PAD.

Consensus-based method for risk adjustment for surgery for congenital heart disease

OBJECTIVE

The aim was to develop a consensus-based method of risk adjustment for in-hospital mortality among children younger than 18 years after surgery for congenital heart disease (designated RACHS-1).

METHODS

An 11-member national panel of pediatric cardiologists and cardiac surgeons used clinical judgment to place surgical procedures into six risk categories. Categories were refined after review of information from the Pediatric Cardiac Care Consortium and three statewide hospital discharge data sets. The effects of including additional clinical variables were explored by comparing areas under receiver-operator characteristic curves.

RESULTS

Among 4602 surgical patients in the Pediatric Cardiac Care Consortium data set and 4493 in the hospital discharge data, 3767 (81.9%) and 3832 (85.3%), respectively, had a single cardiac procedure, and 98.5% and 89.2%, respectively, were able to be assigned to one of six risk categories defined by the panel. Mortality rates showed expected trends (P <.001). For the Pediatric Cardiac Care Consortium data, mortality rates were 0.4% in category 1, 3.8% in 2, 8.5% in 3, 19.4% in 4, and 47.7% in 6; rates were similar in the hospital discharge data. There were too few cases in category 5 to estimate mortality rates. In multivariable models, younger age, prematurity, and the presence of a major noncardiac structural anomaly added to the risk of in-hospital death predicted by risk category alone. Best performance was obtained when cases with multiple procedures were placed in the risk category of the most complex procedure.

CONCLUSION

The RACHS-1 method should adjust for baseline risk differences and allow meaningful comparisons of in-hospital mortality for groups of children undergoing surgery for congenital heart disease.

A decade's experience with quality improvement in cardiac surgery using the Veterans Affairs and Society of Thoracic Surgeons national databases

OBJECTIVE

To review the Department of Veteran Affairs (VA) and the Society of Thoracic Surgeons (STS) national databases over the past 10 years to evaluate their relative similarities and differences, to appraise their use as quality improvement tools, and to assess their potential to facilitate improvements in quality of cardiac surgical care.

SUMMARY BACKGROUND DATA

The VA developed a mandatory risk-adjusted database in 1987 to monitor outcomes of cardiac surgery at all VA medical centers. In 1989 the STS developed a voluntary risk-adjusted database to help members assess quality and outcomes in their individual programs and to facilitate improvements in quality of care.

METHODS

A short data form on every veteran operated on at each VA medical center is completed and transmitted electronically for analysis of unadjusted and risk-adjusted death and complications, as well as length of stay. Masked, confidential semiannual reports are then distributed to each program's clinical team and the associated administrator. These reports are also reviewed by a national quality oversight committee. Thus, VA data are used both locally for quality improvement and at the national level with quality surveillance. The STS dataset (217 core fields and 255 extended fields) is transmitted for each patient semiannually to the Duke Clinical Research Institute (DCRI) for warehousing, analysis, and distribution. Site-specific reports are produced with regional and national aggregate comparisons for unadjusted and adjusted surgical deaths and complications, as well as length of stay for coronary artery bypass grafting (CABG), valvular procedures, and valvular/CABG procedures. Both databases use the logistic regression modeling approach. Data for key processes of care are also captured in both databases. Research projects are frequently carried out using each database.

RESULTS

More than 74,000 and 1.6 million cardiac surgical patients have been entered into the VA and STS databases, respectively. Risk factors that predict surgical death for CABG are very similar in the two databases, as are the odds ratios for most of the risk factors. One major difference is that the VA is 99% male, the STS 71% male. Both databases have shown a significant reduction in the risk-adjusted surgical death rate during the past decade despite the fact that patients have presented with an increased risk factor profile. The ratio of observed to expected deaths decreased from 1.05 to 0.9 for the VA and from 1.5 to 0.9 for the STS.

CONCLUSION

It appears that the routine feedback of risk-adjusted data on local performance provided by these programs heightens awareness and leads to self-examination and self-assessment, which in turn improves quality and outcomes. This general quality improvement template should be considered for application in other settings beyond cardiac surgery.

Preoperative risk factors for 30-day mortality after elective surgery for vascular disease in Department of Veterans Affairs hospitals: is race important?

PURPOSE

Racial variation in health care outcomes is an important topic. Risk-adjustment models have not been developed for elective abdominal aortic aneurysm repair (AAA), lower extremity bypass revascularization (LEB), or lower extremity amputation (AMP). Earlier studies examining racial variation in mortality and morbidity from AAA, LEB, or AMP were limited to administrative data. This study determined risk factors for mortality after surgery for vascular disease and determined whether race is an important risk factor.

METHODS

Data in this prospective observational study were obtained from the Department of Veterans Affairs (VA) National Surgical Quality Improvement Program. Detailed demographic and clinical data were collected prospectively from patients' medical records by trained nurse reviewers. Eligible patients were those 18 years and older who underwent elective AAA, LEB, or AMP at one of 44 VA medical centers performing both vascular and cardiac surgery (phase I; October 1991 to December 1993) and at one of these 44 or 79 additional VA medical centers performing vascular but not cardiac surgery (phase II; January 1994 to August 1995). The independent association of several preoperative factors with the 30-day postoperative mortality rate was examined with stepwise logistic regression analysis for AAA, LEB, and AMP. Models were developed in the combined 44 VA medical centers and validated in the 79 VA medical centers. The independent association of race with the 30-day postoperative mortality rate was examined after controlling for important preoperative risk factors for each operation.

RESULTS

More than 10,000 surgical operations were examined, and 5, 3, and 10 independent preoperative predictors of 30-day mortality rate were identified for AAA, LEB, and AMP, respectively. The observed mortality rate for patients undergoing AAA was higher (7.2% vs 3.2%; P =.02) in African American patients than in white patients in the 44 VA medical centers, although the differences were not significant in LEB and AMP or at the additional 79 hospitals. After important preoperative risk factors were controlled, there was no difference in 30-day mortality rates between African American patients and white patients.

CONCLUSION

We identified several important preoperative risk factors for 30-day mortality rate in three vascular operations. From the results of this study, race was determined not to be an independent predictor of mortality.

Length of stay as a source of bias in comparing performance in VA and private sector facilities: lessons learned from a regional evaluation of intensive care outcomes

OBJECTIVES

Compare intensive care unit (ICU) mortality and length of stay (LOS) in a VA hospital and private sector hospitals and examine the impact of hospital utilization on mortality comparisons.

RESEARCH DESIGN

Retrospective cohort study.

SUBJECTS

Consecutive ICU admissions to a VA hospital (n = 1,142) and 27 private sector hospitals (n = 51,249) serving the same health care market in 1994 to 1995.

MEASURES

Mortality and ICU LOS were adjusted for severity of illness using a validated method that considers physiologic data from the first 24 hours of ICU admission. Mortality comparisons were made using two different multivariable techniques.

RESULTS

Unadjusted in-hospital mortality was higher in VA patients (14.5% vs. 12.0%; P = 0.01), as was hospital (28.3 vs. 11.3 days; P <0.001) and ICU (4.3 vs. 3.9 days; P <0.001) LOS. Using logistic regression to adjust for severity, the odds of death was similar in VA patients, relative to private sector patients (OR 1.16, 95% CI 0.93-1.44; P = 0.18). However, a higher proportion of VA deaths occurred after 21 hospital days (33% vs. 13%; P <0.001). Using proportional hazards regression and censoring patients at hospital discharge, the risk for death was lower in VA patients (hazard ratio 0.70; 95% CI 0.59-0.82; P <0.001). After adjusting for severity, differences in ICU LOS were no longer significant (P = 0.19).

CONCLUSIONS

Severity-adjusted mortality in ICU patients was lower in a VA hospital than in private sector hospitals in the same health care market, based on proportional hazards regression. This finding differed from logistic regression analysis, in which mortality was similar, suggesting that comparisons of hospital mortality between systems with different hospital utilization patterns may be biased if LOS is not considered. If generalizable to other markets, our findings further suggest that ICU outcomes are at least similar in VA hospitals.

Volume standards for high-risk surgical procedures: potential benefits of the Leapfrog initiative

BACKGROUND

As part of a broader effort aimed at improving hospital safety, a large coalition of employers, the Leapfrog Group, will soon require hospitals caring for their employees to meet volume standards for 5 high-risk surgical procedures. We estimated the potential benefits of full nationwide implementation of these volume standards. METHODS. Using data from Nationwide Inpatient Sample and other sources, we first estimated the total number of each of the 5 procedures-coronary-artery bypass graft, abdominal aortic aneurysm repair, coronary angioplasty, esophagectomy, and carotid endarterectomy-performed each year in hospitals in US metropolitan areas. (Leapfrog exempts hospitals in rural areas to avoid access issues.) We then projected the effectiveness of volume standards (in terms of relative risks of mortality) for each procedure using data from a published structured literature review.

RESULTS

With full implementation nationwide, the Leapfrog volume standards would save 2581 lives. Of the procedures, volume standards would save the most lives with coronary-artery bypass graft (1486), followed by abdominal aortic-aneurysm repair (464), coronary angioplasty (345), esophagectomy (168), and carotid endarterectomy (118). In our estimates of the number of lives saved, we considered assumptions about how many patients would be affected and the effectiveness of volume standards (ie, strength of underlying volume-outcome relationships with each procedure).

CONCLUSIONS

If the Leapfrog volume standards are successfully implemented, employers and health-care purchasers could prevent many surgical deaths by requiring hospital volume standards for high-risk procedures.

Comparison of surgical outcomes between teaching and nonteaching hospitals in the Department of Veterans Affairs

OBJECTIVE

To determine whether the investment in postgraduate education and training places patients at risk for worse outcomes and higher costs than if medical and surgical care was delivered in nonteaching settings.

SUMMARY BACKGROUND DATA

The Veterans Health Administration (VA) plays a major role in the training of medical students, residents, and fellows.

METHODS

The database of the VA National Surgical Quality Improvement Program was analyzed for all major noncardiac operations performed during fiscal years 1997, 1998, and 1999. Teaching status of a hospital was determined on the basis of a background and structure questionnaire that was independently verified by a research fellow. Stepwise logistic regression was used to construct separate models predictive of 30-day mortality and morbidity for each of seven surgical specialties and eight operations. Based on these models, a severity index for each patient was calculated. Hierarchical logistic regression models were then created to examine the relationship between teaching versus nonteaching hospitals and 30-day postoperative mortality and morbidity, after adjusting for patient severity.

RESULTS

Teaching hospitals performed 81% of the total surgical workload and 90% of the major surgery workload. In most specialties in teaching hospitals, the residents were the primary surgeons in more than 90% of the operations. Compared with nonteaching hospitals, the patient populations in teaching hospitals had a higher prevalence of risk factors, underwent more complex operations, and had longer operation times. Risk-adjusted mortality rates were not different between the teaching and nonteaching hospitals in the specialties and operations studied. The unadjusted complication rate was higher in teaching hospitals in six of seven specialties and four of eight operations. Risk adjustment did not eliminate completely these differences, probably reflecting the relatively poor predictive validity of some of the risk adjustment models for morbidity. Length of stay after major operations was not consistently different between teaching and nonteaching hospitals.

CONCLUSION

Compared with nonteaching hospitals, teaching hospitals in the VA perform the majority of complex and high-risk major procedures, with comparable risk-adjusted 30-day mortality rates. Risk-adjusted 30-day morbidity rates in teaching hospitals are higher in some specialties and operations than in nonteaching hospitals. Although this may reflect the weak predictive validity of some of the risk adjustment models for morbidity, it may also represent suboptimal processes and structures of care that are unique to teaching hospitals. Despite good quality of care in teaching hospitals, as evidenced by the 30-day mortality data, efforts should be made to examine further the structures and processes of surgical care prevailing in these hospitals.

Risk-adjusted surgical outcomes

Measures of risk-adjusted outcome are particularly suited for the assessment of the quality of surgical care. The reliability of measures of quality that use surgical outcomes is enhanced by prospective data acquisition and should be adjusted for the preoperative severity of illness. Such measures should be based only on reliable and validated data, and they should apply state-of-the-art analytical methods. The risk-adjusted postoperative mortality rate is useful as a quality measure only in specialties and operations expected to have a high rate of postoperative deaths. Risk-adjusted complications are more common but are limited as a comparative measure of quality by a lack of uniform definitions and data collection mechanisms. In specialties in which the expected postoperative mortality is low, risk-adjusted functional outcomes are promising measures for the assessment of the quality of surgical care. Measures of cost and patient satisfaction should also be incorporated in systems designed to measure the quality and cost-effectiveness of surgical care.

Comparison of complications after radical and partial nephrectomy: results from the National Veterans Administration Surgical Quality Improvement Program

OBJECTIVE

To determine whether radical nephrectomy causes less morbidity, less mortality and is associated with a shorter hospital stay than is partial nephrectomy.

PATIENTS AND METHODS

A total of 1885 nephrectomies (1373 radical and 512 partial) conducted between 1991 and 1998 in the Department of Veterans Affairs (VA) National Surgical Quality Improvement Program were evaluated. Using multivariate analyses, outcomes were risk-adjusted based on 45 preoperative variables to compare mortality and morbidity rates.

RESULTS

The unadjusted 30-day mortality was 2.0% for radical and 1.6% for partial nephrectomy (P = 0.58). Risk-adjusting the two groups did not result in a statistically significant difference in mortality. The 30-day overall morbidity rate was 15% for radical and 16.2% for partial nephrectomy (P = 0.52); risk-adjusted morbidity rates were not statistically different. There were no statistically significant differences in the rates of postoperative progressive renal failure, acute renal failure, urinary tract infection, prolonged ileus, transfusion requirement, deep wound infection, or extended length of stay.

CONCLUSIONS

Partial nephrectomy carried out in the VA program has low morbidity and mortality rates, comparable with the complication rates after radical nephrectomy.

Outcomes assessment and minimally invasive surgery: historical perspective and future directions

BACKGROUND

Outcomes assessment is being used increasingly to shape practice patterns in all areas of medicine. Although outcomes assessment is not a new concept, the widespread application of outcomes measurement for modifying practice is novel. Instead of focusing on results of interventions in highly controlled environments, outcomes studies usually report results as they occur in uncontrolled, real-world environments. Recently, the Society of American Gastrointestinal Endoscopic Surgeons (SAGES) has initiated a society-wide initiative to monitor outcomes in patients undergoing various laparoscopic operations.

METHODS

Pertinent literature is reviewed as it relates to outcomes assessment. The historical background underpinning the modern interest in outcomes is outlined. Definitions of terms useful for understanding outcomes research are given. The impact of outcomes assessment on minimally invasive surgery, both positive and negative, are examined. The SAGES outcome initiative is introduced.

CONCLUSIONS

Although outcomes studies usually do not provide information on the causes of observations made, they have gained in popularity because they provide information about patient perceptions of disease, disability, and treatment. Minimally invasive surgical procedures often are reported in terms of outcomes assessment because a controlled clinical trial was rendered impossible by early and widespread application of laparoscopic surgery. The SAGES outcomes initiative will provide the necessary tools for the participation of surgeons in the process of practice profiling.

Using the Veterans Administration National Surgical Quality Improvement Program to improve patient outcomes

BACKGROUND

The primary goal of collecting quality assurance data is to ultimately improve patient care. The VA National Surgical Quality Improvement Program (NSQIP) provides each station with risk-adjusted morbidity and mortality data on a regular basis. This report of one medical center's use of the risk-adjusted data shows how it can be used to improve patient care.

MATERIALS AND METHODS

Risk-adjusted surgical outcome data for Fiscal Year 1996 (FY96) was received from the NSQIP coordinating center. The Salt Lake City VA medical center was identified as a high outlier for morbidity in general surgery. Patient charts were reviewed and data analyzed to determine practice patterns and to determine if there were any provider issues. Data analysis revealed a large number of wound complications and uncovered a practice pattern of closure of contaminated wounds. Using these data and data from the literature, wound infection and disruption prevention protocols were instituted in the fall of 1997. Wound complications from January to December 1996 (preprotocol) and January to December 1998 (postprotocol) were compared using Student's t test.

RESULTS

The total number of operations in 1998 was 719 compared with 634 in 1996. Superficial wound infections dropped from 3.6 to 1.7%, while overall wound complications dropped from 5.5 to 2.9%. None of these changes were statistically significant.

CONCLUSIONS

Although introduction of wound infection and disruption prevention protocols did not result in a statistically significant decrease in wound complication, it did result in a clinically significant improvement in patient care.

Relation of surgical volume to outcome in eight common operations: results from the VA National Surgical Quality Improvement Program

OBJECTIVE

To examine, in the Veterans Health Administration (VHA), the relation between surgical volume and outcome in eight commonly performed operations of intermediate complexity.

SUMMARY BACKGROUND DATA

In multihospital health care systems such as VHA, consideration is often given to closing low-volume surgical services, with the assumption that better surgical outcomes are achieved in hospitals with larger surgical volumes. Literature data to support this assumption in intermediate-complexity operations are either limited or controversial.

METHODS

The VHA National Surgical Quality Improvement Program data on nonruptured abdominal aortic aneurysmectomy, vascular infrainguinal reconstruction, carotid endarterectomy (CEA), lung lobectomy/pneumonectomy, open and laparoscopic cholecystectomy, partial colectomy, and total hip arthroplasty were used. Pearson correlation, analysis of variance, mixed effects hierarchical logistic regression, and automatic interaction detection analysis were used to assess the association of annual procedure/specialty volume with risk-adjusted 30-day death (and stroke in CEA).

RESULTS

Eight major surgical procedures (68,631 operations) were analyzed. No statistically significant associations between procedure or specialty volume and 30-day mortality rate (or 30-day stroke rate in CEA) were found.

CONCLUSIONS

In VHA hospitals, the procedure and surgical specialty volume in eight prevalent operations of intermediate complexity are not associated with risk-adjusted 30-day mortality rate from these operations, or with the risk-adjusted 30-day stroke rate from CEA. Volume of surgery in these operations should not be used as a surrogate for quality of surgical care.

Postoperative complications in Parkinson's disease

BACKGROUND

Although Parkinson's disease is relatively common in America, with an average annual incidence of 20 cases per 100,000 population, little information exists about postoperative morbidity and mortality in those Parkinson's patients who undergo elective surgery.

METHODS

We performed a retrospective cohort study using the Veterans Affairs (VA) Austin database system (a cumulative index of admissions and discharges from all US VA Medical Centers) to identify 41,213 patients who underwent elective bowel resection, cholecystectomy, or radical prostatectomy between January 1, 1990, and December 31, 1995. We examined the study population using univariate analysis, acute length of stay with multivariate analysis, and postoperative complications with logistic regression.

RESULTS

The selected surgeries were performed on 234 patients with a diagnosis of Parkinson's disease and 40,979 with no such diagnosis. In univariate analysis, patients with Parkinson's disease had significantly longer acute hospital stays than non-Parkinson's patients (11.4 +/- 15.9 days vs 8.8 +/- 9.0 days, P < .001). In addition, Parkinson's patients had a higher in-hospital mortality than non-Parkinson's patients (7.3% vs 3.8%, P = .006). After we adjusted for coexisting morbidity, age, admitting location, and gender, patients with Parkinson's disease had an average acute hospital stay 2.34 days longer than that of non-Parkinson's patients (P < .001). However, the mortality difference did not reach statistical significance in multivariate analysis (P = .098). Finally, Parkinson's patients had significantly increased incidences of urinary-tract infection (odds ratio 2.045, P < .001), aspiration pneumonia (odds ratio 3.825, P < .001), and bacterial infections (odds ratio 1.682, P < .001).

CONCLUSIONS

Patients with Parkinson's disease are at greater risk for specific complications and longer hospital stay after elective bowel resection, cholecystectomy, or radical prostatectomy. Awareness of these complications may help caregivers to reduce postoperative mortality and morbidity and to decrease the length of hospitalization.

Prognostic models of thirty-day mortality and morbidity after major pulmonary resection

BACKGROUND

A part of the prospective, multi-institutional National Veterans Affairs Surgical Quality Improvement Program was developed to predict 30-day mortality and morbidity for patients undergoing a major pulmonary resection.

METHODS

Perioperative data were acquired from 194,319 noncardiac surgical operations at 123 Veterans Affairs Medical Centers between October 1, 1991, and August 31, 1995. Current Procedural Terminology code-based analysis was undertaken for major pulmonary resections (lobectomy and pneumonectomy). Preoperative, intraoperative, and outcome variables were collected. The 30-day mortality and morbidity models were developed by means of multivariable stepwise logistic regression with the preoperative and intraoperative variables used as independent predictors of outcome.

RESULTS

A total of 3516 patients (mean age 64 9 years) underwent either lobectomy (n = 2949) or pneumonectomy (n = 567). Thirty-day mortality was 4.0% for lobectomy (119/2949) and 11.5% for pneumonectomy (65/567). The preoperative predictors of 30-day mortality were albumin, do not resuscitate status, transfusion of more than 4 units, age, disseminated cancer, impaired sensorium, prothrombin time more than 12 seconds, type of operation, and dyspnea. When the intraoperative variables were considered, intraoperative blood loss was added to the preoperative model. In the presence of these intraoperative variables in the model, do not resuscitate status and prothrombin time more than 12 seconds were only marginally significant. Thirty-day morbidity, defined as the presence of 1 or more of the 21 predefined complications, was 23.8% for lobectomy (703/2949) and 25.7% for pneumonectomy (146/567). In multivariable models, independent preoperative predictors (P <.05) of 30-day morbidity were age, weight loss greater than 10% in the 6 months before surgery, history of chronic obstructive pulmonary disease, transfusion of more than 4 units, albumin, hemiplegia, smoking, and dyspnea. When intraoperative variables were added to the preoperative model, the duration of operation time and intraoperative transfusions were included in the model and albumin became marginally significant.

CONCLUSIONS

This analysis identifies independent patient risk factors that are associated with 30-day mortality and morbidity for patients undergoing a major pulmonary resection. This series provides an initial risk-adjustment model for major pulmonary resections. Future refinements will allow comparative assessment of surgical outcomes and quality of care at many institutions.

The "new VA": a national laboratory for health care quality management

In 1995, the Veterans Health Administration (VHA) initiated the most radical redesign of the veterans health care system since the system was formally created in 1946. One of the goals of this reengineering effort has been to ensure the consistent and predictable provision of high-quality care everywhere in the system. To accomplish this goal, the VHA has organized more than 100 different quality improvement activities according to a structure-, process-, and outcomes-focused quality management accountability framework (QMAF) that targets 10 interrelated dimensions of quality management (QM). Each of these dimensions utilizes a defined strategy and employs a menu of quality assessment and assurance tactics. Organizing these many different quality improvement activities into an accountability framework should facilitate the development of policies and procedures that will systematize the VHA's QM. The VHA's new operational structure and its approach to quality improvement provide a unique national laboratory for health care QM.