The Department of Veterans Affairs' NSQIP: the first national, validated, outcome-based, risk-adjusted, and peer-controlled program for the measurement and enhancement of the quality of surgical care. National VA Surgical Quality Improvement Program

Assessment of the Reliability of Data Collected for the Department of Veterans Affairs National Surgical Quality Improvement Program

BACKGROUND

The Office of the Medical Inspector of the Department of Veterans Affairs (VA) studied the reliability of data collected by the VA's National Surgical Quality Improvement Program (NSQIP). The study focused on case selection bias, accuracy of reports on patients who died, and interrater reliability measurements of patient risk variables and outcomes.

STUDY DESIGN

Surgical data from a sample of 15 VA medical centers were analyzed. For case selection bias, reviewers applied NSQIP criteria to include or exclude 2,460 patients from the database, comparing their results with those of NSQIP staff. For accurate reporting of patients who died, reviewers compared Social Security numbers of 10,444 NSQIP records with those found in the VA Beneficiary Identification and Records Locator Subsystem, VA Patient Treatment Files, and Social Security Administration death files. For measurement of interrater reliability, reviewers reabstracted 59 variables in each of 550 patient medical records that also were recorded in the NSQIP database.

RESULTS

On case selection bias, the reviewers agreed with NSQIP decisions on 2,418 (98%) of the 2,460 cases. Computer record matching identified 4 more deaths than the NSQIP total of 198, a difference of about 2%. For 52 of the categorical variables, agreement, uncorrected for chance, was 96%. For 48 of 52 categorical variables, kappas ranged from 0.61 to 1.0 (substantial to almost perfect agreement); none of the variables had kappas of less than 0.20 (slight to poor agreement).

CONCLUSIONS

This sample of medical centers shows adherence to criteria in selecting cases for the NSQIP database, for reporting deaths, and for collecting patient risk variables.

Adverse outcomes in surgical patients: implementation of a nationwide reporting system

PROBLEM

Lack of comparable data on adverse outcomes in hospitalised surgical patients.

DESIGN

A Plan-Do-Study-Act (PDSA) cycle to implement and evaluate nationwide uniform reporting of adverse outcomes in surgical patients. Evaluation was done within the Reach Efficacy-Adoption Implementation Maintenance (RE-AIM) framework.

SETTING

All 109 surgical departments in The Netherlands.

KEY MEASURES FOR IMPROVEMENT

Increase in the number of departments implementing the reporting system and exporting data to the national database.

STRATEGIES FOR CHANGE

The intervention included (1) a coordinator who could mediate in case of problems; (2) participation of an opinion leader; (3) a predefined plan of action communicated to all departments (including feedback of results during implementation); (4) connection with existing hospital databases; (5) provision of software and a helpdesk; and (6) an instrument based on nationwide standards.

EFFECTS OF CHANGE

Implementation increased from 18% to 34% in 1.5 years. The main reason for not implementing the system was that the Information Computer Technology (ICT) department did not link data with the hospital information system (lack of time, finances, low priority). Only 5% of the departments exported data to the national database. Export of data was hindered mainly by slow implementation of the reporting system (so that departments did not have data to export) and by concerns regarding data quality and public availability of data from individual hospitals.

LESSONS LEARNED

Hospitals need incentives to realise implementation. Important factors are financial support, sufficient manpower, adequate ICT linkage of data, and clarity with respect to public availability of data.

Patient safety and human factors in pediatric cardiac surgery

The patient safety movement and human factors studies are becoming an increasingly important part of everyday clinical practice. Pediatric cardiac surgery is a high-risk field that is very much dependent on safe practices and continuous research into improvement of outcomes. This article reviews the main research frameworks, methods used, and current findings in the area of patient safety and human factors within pediatric cardiac surgery.

Surgical risk factors, morbidity, and mortality in elderly patients

BACKGROUND

The aging population of the United States results in increasing numbers of surgical operations on elderly patients. This study observed aging related to morbidity, mortality, and their risk factors in patients undergoing major operations.

STUDY DESIGN

We reviewed our institution's American College of Surgeons National Surgical Quality Improvement Program database from February 24, 2002, through June 30, 2005, including standardized preoperative, intraoperative, and 30-day postoperative data points. This required review and analysis of the prospectively collected data. We examined patient demographics, preoperative risk factors, intraoperative risk factors, and 30-day outcomes with a focus on those aged 80 years and older.

RESULTS

A total of 7,696 surgical procedures incurred a 28% morbidity rate and 2.3% mortality rate, although those older than 80 years of age had a morbidity of 51% and mortality of 7%. Hypertension and dyspnea were the most frequent risk factors in those aged 80 years and older. Preoperative transfusion, emergency operation, and weight loss best predicted morbidity for those 80 years of age and older. Operative duration predicted "other" postoperative occurrences and emergent case status predicted respiratory occurrences across all age groups. Preoperative impairment of activities of daily living, emergency operation, and increased American Society of Anesthesiology classification predicted mortality across all age groups. A 30-minute increment of operative duration increased the odds of mortality by 17% in patients older than 80 years. Postoperative morbidity and mortality increased progressively with increasing age. Age was statistically significantly associated with morbidity (wound, p = 0.021; renal, p = 0.001; cardiovascular, p = 0.0004; respiratory, p < 0.0001) and mortality (p = 0.001).

CONCLUSIONS

Although several risk factors for postoperative morbidity and mortality increase with age, increasing age itself remains an important risk factor for postoperative morbidity and mortality.

Morbidity of Lung Resection After Prior Lobectomy: Results from the Veterans Affairs National Surgical Quality Improvement Program

BACKGROUND

Lobectomy is the current standard operation for localized lung cancer. Patients who undergo lobectomy have a 1% to 2% chance per year of developing a second lung cancer. The risks of repeat lung resection have not been well quantified or analyzed. We used a national, prospectively recorded database to evaluate the complication rate and risk factors in this population.

METHODS

The Veterans Affairs National Surgical Quality Improvement Program Database was queried for all patients who underwent lobectomy, followed by an additional lung resection, between 1994 and 2002. Preoperative variables, intraoperative variables, and complications were analyzed. Pulmonary function data were not collected.

RESULTS

Excluding 17 patients who underwent repeat resection for complications of lobectomy, 186 patients underwent 191 repeat resections. The 30-day mortality was 11%; the complication rate was 19%. Mortality for pneumonectomy was 34%, lobectomy, 7%; segmentectomy, 0%; and wedge resection, 6%. The most frequent complications were pneumonia (9%), reintubation (8%), ventilator dependence (6%), cardiac arrest (3%), dysrhythmia (3%), and sepsis (3%). Multivariate analysis revealed that operative time exceeding 2 hours, preoperative dyspnea at rest or with minimal exertion, and white blood cell count of more than 10,000/mm3 were predictors of complication. Presence of a contaminated/infected case, pneumonectomy, and intraoperative transfusion were predictors of death. Age, complications from prior lobectomy, time interval between lobectomy and repeat resection, smoking history, other comorbidities, and preoperative laboratory values were not independent predictors.

CONCLUSIONS

Repeat lung resection after lobectomy carries an 11% overall mortality predicted by the presence of a contaminated/infected case, need for intraoperative transfusion, and pneumonectomy versus a lesser resection.

Performance of endovascular aortic aneurysm repair in high-risk patients: Results from the Veterans Affairs National Surgical Quality Improvement Program

OBJECTIVE

Recent results after endovascular abdominal aortic aneurysm repair (EVAR) have brought into question its value in patients deemed at high-risk for surgical intervention. The Department of Veteran Affairs (VA) National Surgical Quality Improvement Program (NSQIP) is the largest prospectively collected and validated United States surgical database representing current clinical practice. The purpose of our study was to evaluate outcomes after elective EVAR performed in high-risk veterans.

METHODS

Using NSQIP data from 123 participating VA hospitals, we retrospectively evaluated patients who underwent elective aneurysm repair from May 2001 to December 2004. High-risk criteria were used to identify a cohort for analysis (EVAR, n = 788; open, n = 1580). High-risk criteria analyzed included age > or =60 years, American Society of Anesthesiology (ASA) classification 3 or 4, and the comorbidity variables of history of cardiac, respiratory, or hepatic disease, cardiac revascularization, renal insufficiency, and low serum albumin level. Our primary end points were 30-day and 1-year all-cause mortality, and we evaluated a secondary end point of perioperative complications. Statistical analysis included univariate analysis and multivariate modeling.

RESULTS

Veterans who were classified as high-risk underwent elective EVAR with significantly lower 30-day (3.4% vs 5.2%, P = .047) and 1-year all-cause mortality (9.5% vs 12.4%, P = .038) than patients having open repair. EVAR was associated with a decrease in 30-day postoperative mortality (adjusted odds ratio [OR], 0.65; 95% confidence interval [CI], 0.42 to 1.03; P = .067) as well as 1-year mortality (adjusted OR, 0.68; 95% CI, 0.51 to 0.91; P = .0094) despite the presence of severe comorbid conditions. The risk of perioperative complications was significantly lower after EVAR (16.2% vs 31.0%; P < .0001; adjusted OR, 0.41; 95% CI, 0.33 to 0.52; P < .0001). A subset analysis of higher-risk patients (ASA 4 and the above comorbidity variables) still demonstrated an acceptable 30-day mortality rate.

CONCLUSION

In veterans deemed high-risk for surgical therapy, outcomes after elective EVAR are excellent, and the procedure is relatively safe in this special patient population. Our retrospective data demonstrate that patients with considerable medical comorbidities and infrarenal abdominal aortic aneurysms benefit from and should be considered for primary EVAR.

A rationale for developing benchmarks for the treatment of muscle-invasive bladder cancer

Benchmarks are established standards of operation developed by a given group or industry generally designed to improve outcomes. The health care industry is increasingly required to develop such standards and document adherence to meet demands of regulatory bodies. Although established practice patterns exist for the treatment of invasive bladder cancer, there is significant treatment variation. This article provides a rationale for the development of benchmarks in the treatment of invasive bladder cancer. Such benchmarks may permit advances in treatment application and potentially improve patient outcomes.

Toward optimal recording of surgical complications: Concurrent tracking compared to the discharge data set

BACKGROUND

Information extracted from the hospital discharge data set is used increasingly for outcomes research and for benchmarking hospital and provider performance. The accuracy of these data in detecting vascular complications has never been validated.

METHODS

We compared morbidity and mortality data derived from the hospital discharge data set to similar data recorded concurrently by our Surgical Activity Tracking System (SATS) for 1 year on the vascular surgery service.

RESULTS

Of 798 total admissions, no complications were detected by either system in 598 admissions (75%). In 200 admissions (25%), there were 335 complications, including 24 deaths (3.0%), that occurred either in-hospital or within 30 days of the date of operation or the date of discharge for nonoperative admissions. Of the 335 complications, 180 (53.7%) were recorded by both systems; the SATS missed 59 complications recorded in the hospital discharge data set (17.6%), whereas the hospital discharge data set missed 96 complications recorded in the SATS (28.7%, P = .003). Of the 289 in-hospital complications, the SATS recorded 230 (79.5%), whereas the hospital discharge data set recorded 229 (79.2%). Of the 24 deaths, the hospital discharge data set missed 6 that occurred after discharge but within the 30-day reporting period

CONCLUSIONS

Both systems are not completely accurate for tracking inpatient complications. The SATS was more representative than the hospital discharge data set in capturing 30-day morbidity and mortality. An amalgamation of the 2 systems would provide more optimal tracking of complications.

NEW SURGICAL CONSULTANTS: IS THERE A LEARNING CURVE?

The purpose of this study was to determine whether newly established surgeons who have completed dedicated post-fellowship training are able to achieve surgical outcomes comparable to their more experienced peers. A cross-sectional study of consecutive patients undergoing total thyroidectomy (TT) or completion thyroidectomy was carried out. Outcomes measured included unplanned return to the operating theatre, postoperative infection, permanent recurrent laryngeal nerve (RLN) injury and permanent hypoparathyroidism. Outcomes were categorized according to whether surgery was carried out by an established surgeon (ES) or a newly appointed surgeon (NAS). Eight hundred and nine TT and completion thyroidectomy procedures were carried out in the period January 2002 to December 2004. Of these, 515 (64%) were carried out by ES and 294 (36%) were carried out by NAS. The overall rate of permanent hypoparathyroidism and RLN injury was 1.4% (12/809) and 0.6% (5/809), respectively. The rate of permanent hypoparathyroidism was not significantly different between the two categories of surgeon (ES 1.35% vs NAS 1.7%; P = 0.7). The incidence of permanent RLN injury was not different between the two groups (ES 0.8% vs NAS 0.3%; P = 0.4). For NAS, the rate of permanent RLN injury for the first two years of independent practice did not differ significantly from 3 to 4 years of practice (0/123 vs 1/171; P = 0.4). Indications for surgery between the two groups were similar, with ES carrying out TT for benign goitre in 42% and cancer in 28%, and NAS 44 and 32%, respectively. Surgical outcomes for the newly established endocrine surgeon following subspecialty training are equivalent to those achieved by more experienced surgeons.

Who pays for biliary complications following liver transplant? A business case for quality improvement

We use biliary complication following liver transplantation to quantify the financial implications of surgical complications and make a case for surgical improvement initiatives as a sound financial investment. We reviewed the medical and financial records of all liver transplant patients at the UMHS between July 1, 2002 and June 30, 2005 (N = 256). The association of donor, transplant, recipient and financial data points was assessed using both univariable (Student's t-test, a chi-square and logistic regression) and multivariable (logistic regression) methods. UMHS made a profit of $6822 +/- 39087 on patients without a biliary complication while taking a loss of $5742 +/- 58242 on patients with a biliary complication (p = 0.04). Reimbursement by the payer was $5562 higher in patients with a biliary complication compared to patients without a biliary complication (p = 0.001). Using multivariable logistic regression analysis, the two independent risk factors for a negative margin included private insurance (compared to public) (OR 1.88, CI 1.10-3.24, p = 0.022) and biliary leak (OR = 2.09, CI 1.06-4.13, p = 0.034). These findings underscore the important impact of surgical complications on transplant finances. Medical centers have a financial interest in transplant surgical quality improvement, but payers have the most to gain with improved surgical outcomes.

Timely Administration of Prophylactic Antibiotics for Major Surgical Procedures

BACKGROUND

Prophylactic antibiotics (PA) given within 60 minutes before surgical incision decrease risk of subsequent surgical site infection. Nationwide quality improvement initiatives have focused on improving the proportion of patients who receive timely prophylactic antibiotics.

STUDY DESIGN

This is a cohort study of major surgical procedures performed in 108 Veterans Affairs hospitals between January and December 2005. Using data from the External Peer Review Program and the National Surgical Quality Improvement Program, we examined factors associated with timely PA administration. Univariate and multivariable analyses were performed.

RESULTS

There were 8,137 major surgical procedures: cardiac (2,664), hip and knee arthroplasty (3,603), colon (1,142), arterial vascular (606), and hysterectomy (122). Timely PA occurred in 76.2% of patients, 18.2% received them too early, and 5.4% received them too late. Early administration accounted for 79% of untimely PA. Differences in timeliness were seen by procedure type (68% to 87%; p < 0.0001), admission status (67% to 80%; p < 0.0001), and antibiotic class (65% to 89%; p < 0.0001). PA administration occurred in the operating room for 63.5% of patients. When PA administration occurred in the operating room, they were timely in 89% of patients, compared with 54% of patients where administration was outside the operating room (odds ratio, 7.74; 95% CI = 6.49 to 9.22).

CONCLUSIONS

Early PA administration accounted for the majority of inappropriately timed PA. Efforts to improve performance on this measure should focus on administering antibiotics in the operating room.

Risk adjusted surgical audit in gynaecological oncology: P-POSSUM does not predict outcome

AIMS

To assess the Physiological and Operative Severity Score for the enumeration of mortality and morbidity (POSSUM) and its validity for use in gynaecological oncology surgery.

METHODS

All patients undergoing gynaecological oncology surgery at the Northern Gynaecological Oncology Centre (NGOC) Gateshead, UK over a period of 12months (2002-2003) were assessed prospectively. Mortality and morbidity predictions using the Portsmouth modification of the POSSUM algorithm (P-POSSUM) were compared to the actual outcomes. Performance of the model was also evaluated using the Hosmer and Lemeshow Chi square statistic (testing the goodness of fit).

RESULTS

During this period 468 patients were assessed. The P-POSSUM appeared to over predict mortality rates for our patients. It predicted a 7% mortality rate for our patients compared to an observed rate of 2% (35 predicted deaths in comparison to 10 observed deaths), a difference that was statistically significant (H&L chi(2)=542.9, d.f. 8, p<0.05).

CONCLUSION

The P-POSSUM algorithm overestimates the risk of mortality for gynaecological oncology patients undergoing surgery. The P-POSSUM algorithm will require further adjustments prior to adoption for gynaecological cancer surgery as a risk adjusted surgical audit tool.

Development of Quality Indicators for Patients Undergoing Colorectal Cancer Surgery

BACKGROUND

Colorectal cancer is the second most common cancer type among new cancer diagnoses in the United States. Attention to the quality of surgical care for colorectal cancer is of particular importance given the increasing numbers of colorectal cancer resections performed in the aging population. A National Cancer Institute-sponsored consensus panel produced guidelines for colorectal cancer surgery in 2000. We have updated and extended that work by using a formal process to identify and rate quality indicators as valid for care during the preoperative, intraoperative, and postoperative periods.

METHODS

Using a modification of the RAND/UCLA Appropriateness Methodology, we carried out structured interviews with leaders in the field of colorectal cancer surgery and systematic reviews of the literature to identify candidate quality indicators addressing perioperative care for patients undergoing surgery for colorectal cancer. A panel of 14 colorectal surgeons, general surgeons, and surgical oncologists then evaluated and formally rated the indicators using the modified Delphi method to identify valid indicators.

RESULTS

A total of 142 candidate indicators were identified in six broad domains: privileging (which addresses surgical credentials), preoperative evaluation, patient-provider discussions, medication use, intraoperative care, and postoperative management. The expert panel rated 92 indicators as valid. These indicators address all domains of perioperative care for patients undergoing surgery for colorectal cancer.

CONCLUSIONS

The RAND/UCLA Appropriateness Methodology can be used to identify and rate indicators of high-quality perioperative care for patients undergoing surgery for colorectal cancer. The indicators can be used as quality performance measures and for quality-improvement programs.

Differences and similarities between rural and urban operations

BACKGROUND

The importance of rural operations is magnified by super-specialization, uneven geographic distribution, and special educational needs. Definition of practice patterns and quality measures are needed.

METHODS

A statewide network of 60 operative specialists studied costs, quality, and outcomes in 17,319 patients undergoing 46 different specialty operations between 1998 and 2003, comparing 9,544 rural to 7,775 urban patients. These data are augmented by additional data from 5,339 operative patients in 2004.

RESULTS

Both high volume rural and urban surgeons achieved fewer deaths than less frequent practitioners of colon or rectal resections (2/309 vs 5/167). Urban surgeons had sicker patients undergoing more extensive procedures, and used fewer consultations, but had more complications and reoperations. Laparoscopic cholecystectomy had similar outcomes with 5 deaths among 1,788 patients. Urban surgeons converted to an open procedure more frequently, whereas rural surgeons used hepatobiliary iminodiacetic acid (HIDA) scans as indication for cholecystectomy more often (P < .01). Indications for upper and lower endoscopy varied, but abnormalities were noted in 64%; only 11 of 6,938 patients undergoing endoscopy were admitted for complications, 5 required operations, 3 due to totally obstructing cancers. Hysterectomy, urologic procedures, and tympanostomy had admission/readmission rates as low as 1/400. Documented patient preoperative education occurred in 94% of both groups. Overall, performance measures were addressed more consistently by rural surgeons (P < .001).

CONCLUSIONS

Operative practice reaches high standards in both settings; indications for operations vary, and rural practice is broader than urban practice. Rural surgeons exceed their urban colleagues on some quality process measures.

The effects of the type of anesthesia on outcomes of lower extremity infrainguinal bypass

OBJECTIVE

Three main types of anesthesia are used for infrainguinal bypass: general endotracheal anesthesia (GETA), spinal anesthesia (SA), and epidural anesthesia (EA). We analyzed a large clinical database to determine whether the type of anesthesia had any effect on clinical outcomes in lower extremity bypass.

METHODS

This study is an analysis of a prospectively collected database by the National Surgical Quality Improvement Program (NSQIP) of the Veterans Affairs Medical Centers. All patients from 1995 to 2003 in the NSQIP database who underwent infrainguinal arterial bypass were identified via Current Procedural Terminology codes. The 30-day morbidity and mortality outcomes for various types of anesthesia were compared by using univariate analysis and multivariate logistic regression to control for confounders.

RESULTS

The NSQIP database identified 14,788 patients (GETA, 9757 patients; SA, 2848 patients; EA, 2183 patients) who underwent a lower extremity infrainguinal arterial bypass during the study period. Almost all patients (99%) were men, and the mean age was 65.8 years. The type of anesthesia significantly affected graft failure at 30 days. Compared with SA, the odds of graft failure were higher for GETA (odds ratio, 1.43; 95% confidence interval [CI], 1.16-1.77; P = .001). There was no statistically significant difference in 30-day graft failure between EA and SA. Regarding cardiac events, defined as postoperative myocardial infarction or cardiac arrest, patients with normal functional status (activities of daily living independence) and no history of congestive heart failure or stroke did worse with GETA than with SA (odds ratio, 1.8; 95% CI, 1.32-2.48; P < .0001). There was no statistically significant difference between EA and SA in the incidence of cardiac events. GETA, when compared with SA and EA, was associated with more cases of postoperative pneumonia (odds ratio: 2.2 [95% CI, 1.1-4.4; P = .034]. There was no significant difference between EA and SA with regard to postoperative pneumonia. Compared with SA, GETA was associated with an increased odds of returning to the operating room (odds ratio, 1.40; 95% CI, 1.20-1.64; P < .001), as was EA (odds ratio, 1.17; 95% CI, 1.05-1.31; P = .005). GETA was associated with a longer surgical length of stay on univariate analysis, but not after controlling for confounders. There was no significant difference in 30-day mortality among the three groups with univariate or multivariate analyses.

CONCLUSIONS

Although GETA is the most common type of anesthesia used in infrainguinal bypasses, our results suggest that it is not the best strategy, because it is associated with significantly worse morbidity than regional techniques.

Safety, Quality, and the National Surgical Quality Improvement Program

The Institute of Medicine 1999 publication, To Err is Human, focused attention on preventable provider errors in surgery, and prompted numerous new national initiatives to improve patient safety. It is uncertain whether these initiatives have actually improved patient safety, mainly because of the lack of a quantitative metric for the assessment of patient safety in surgery. A 15-year experience with the National Surgical Quality Improvement Program, which originated in the Veteran's Administration in 1991 and was recently made available to the private sector, prompts the surgical community to place patient safety in surgery within a much larger conceptual framework than that of the Institute of Medicine report, and provides a quantitative metric for the assessment of patient safety initiatives. This conceptual framework defines patient safety in surgery as safety from all adverse outcomes (not only preventable errors and sentinel events); regards safety as an integral part of quality of surgical care; recognizes that adverse outcomes, and hence patient safety, are primarily determined by quality of systems of care; and uses comparative risk-adjusted outcome data as a metric for the identification of system problems and for the assessment and improvement of patient safety from adverse outcomes.

The Surgical Infection Prevention and Surgical Care Improvement Projects: Promises and Pitfalls

Variations in outcomes for patients who have surgery are well known, and there is extensive evidence that failure to apply standards of care known to prevent adverse events results in patient harm. Infections and postoperative sepsis, cardiovascular complications, respiratory complications, and thromboembolic complications represent some of the most common adverse events that occur after surgery. Patients who experience postoperative complications have increased hospital length of stay, readmission rates, and mortality rates; in addition, costs of care are increased for patients, hospitals, and payers. In 2002, the Centers for Medicare and Medicaid Services, in collaboration with the Centers for Disease Control and Prevention, implemented the Surgical Infection Prevention Project to decrease the morbidity and mortality associated with postoperative surgical site infections. More recently, the Surgical Care Improvement Project, a national quality partnership of organizations committed to improving the safety of surgical care has been implemented. Although the Surgical Care Project does not focus on the complete set of important surgical quality issues, it does provide the incentive and infrastructure for national data collection and quality improvement activities for hospitals. There is now a strong national commitment to measure processes and outcomes of care for surgery in the United States.

The Holy Grail of Surgical Quality Improvement: Process Measures or Risk-Adjusted Outcomes?

Quality of care in surgery has garnered increased attention. Focus on the structure, processes of care, and use of risk-adjusted outcomes has offered different possible solutions. Volume-outcome studies have consistently demonstrated relationships between higher surgeon and hospital volume and favorable outcomes. The policy implications for quality improvement remain unclear. Recent efforts have focused on the use of risk-adjusted outcomes, such as the American College of Surgeons National Surgical Quality Improvement Program, to drive quality improvement. Conversely, large efforts, mandated by the Center for Medicare and Medicaid Services, have focused on process measures, such as perioperative complication prevention. For the future of surgical quality improvement, the combination of process measures and risk-adjusted outcomes are essential. It is only through the combined use of improved understanding of the relationship of processes of care and outcomes that we will make surgical care safer and improve quality.

Preoperative and Intraoperative Risk Factors Associated With 30-Day Morbidity Following Urological Surgery: The National Surgical Quality Improvement Program

PURPOSE

The National Surgical Quality Improvement Program was established in 1994 to measure and enhance of the quality of surgical care. Since its inception, 30-day postoperative morbidity after major surgery in the Veterans Administration has decreased by 45%. We performed a pilot study to assess risk factors associated with 30-day morbidity using National Surgical Quality Improvement Program indicators in a private setting.

MATERIALS AND METHODS

A total of 643 subjects were accrued by a trained surgical reviewer from our institution between December 2003 and December 2004. Patient preoperative, intraoperative and nonNational Surgical Quality Improvement Program data elements were abstracted from clinical records. Bivariate relationships between preoperative risk factors, intraoperative process measures and 30-day postoperative morbidity were determined. Multiple variable logistic regression analysis was used to identify patient preoperative and intraoperative risk factors associated with 30-day morbidity.

RESULTS

On multivariate analysis the preoperative risk factors history of congestive heart failure (OR 14.42, 95% CI 2.66 to 78.30), diabetes with end organ damage (OR 12.56, 95% CI 2.09 to 75.53), angioplasty (OR 2.75, 95% CI 1.27 to 5.93), quadriplegia (OR 4.39, 95% CI 1.36 to 14.14), low albumin (OR 2.49, 95% CI 1.18 to 5.24) and hydronephrosis (OR 2.51, 95% CI 1.11 to 5.69) were statistically significant predictors of 30-day postoperative morbidity. Intraoperative process measures, that is operative time in hours (OR 1.24, 95% CI 1.12 to 1.37) and transfusion (OR 3.11, 95% CI 1.49 to 6.50), were also significant contributors to postoperative morbidity.

CONCLUSIONS

We found that patient preoperative risk factors and intraoperative process measures were important determinants of postoperative morbidity. Implementation of the National Surgical Quality Improvement Program in urology may be used to measure processes of care that are associated with surgical outcomes and, thereby, improve the quality of urological care.

Reducing surgical site infections through a multidisciplinary computerized process for preoperative prophylactic antibiotic administration

BACKGROUND

Surgical site infections (SSIs) result in significant postoperative morbidity and mortality. Although many of these infections can be prevented by timely administration of preoperative antibiotics, data suggest that many patients do not receive such therapy.

METHODS

A multidisciplinary team was convened that reviewed published guidelines, made antibiotic recommendations, and addressed administration issues. Responsibility for antibiotic administration was shifted from preoperative nursing staff to the anesthetist. Electronic quick orders were developed to encourage appropriate antibiotic selection and simplify order creation.

RESULTS

Timely administration of preoperative antibiotics improved from 51% to 98% from February 2005 to February 2006. Appropriate antibiotic administered improved from 78% to 94%. The clean wound infection rate decreased from 2.7% to 1.4% over the same time period.

CONCLUSION

A multidisciplinary approach to prophylactic antibiotic use, including computer-guided decision support, facilitates appropriate preoperative antibiotic use, resulting in a significant decrease in surgical wound infections.

Comparing performance of Morbidity and Mortality Conference and National Surgical Quality Improvement Program for detection of complications after urologic surgery

OBJECTIVES

The detection of postoperative complications is a necessary quality-of-care endeavor. Despite its historical role, the Morbidity and Mortality (M&M) Conference depends on voluntary reporting and may be an insufficient mechanism for comprehensive complication surveillance. In response to this concern, we compared the concordance between complications voluntarily reported at the M&M Conference and those identified prospectively by the National Surgical Quality Improvement Program (NSQIP).

METHODS

For a single calendar year (2004), we compiled a comprehensive list of complications that were either identified and voluntarily entered into our department's electronic M&M Conference database and/or identified prospectively (from an explicit sample of cases) by a trained research associate-based NSQIP protocol. For analytic purposes, we treated NSQIP as the reference standard for the detection of complications. We then determined the sensitivity of the M&M Conference for the identification of complications at a patient and event level. Logistic regression modeling was used to evaluate for an association between complication category (ie, organ system affected) and detection by the M&M Conference.

RESULTS

The NSQIP detected 347 complications in 176 patients. Using this reference standard, the patient-level and event-level sensitivity of the M&M Conference was 25% (44 of 176) and 14% (47 of 347), respectively. The sensitivity of the M&M Conference varied by NSQIP complication category (P = 0.08). Circulatory events were 11 times more likely to be reported at the M&M Conference than urinary complications (odds ratio 11.3, 95% confidence interval 2.4 to 53.7).

CONCLUSIONS

Compared with the NSQIP, the M&M Conference has a low (but variable) sensitivity for the detection of postoperative complications. Therefore, despite its limitations, the NSQIP may provide a better foundation for urologic quality improvement endeavors.

Propensity score analysis in observational studies: outcomes after abdominal aortic aneurysm repair

OBJECTIVE

Large databases composed of well-designed prospectively collected cohort data provide an opportunity to examine and compare healthcare treatments in actual clinical practice settings. Because the analysis of these data often leads to a retrospective cohort design, it is essential to adequately adjust for lack of balance in patient characteristics when making treatment comparisons. We used matched propensity scoring in a cohort of patients undergoing elective aneurysm repair as an illustrative example of this important statistical method that adjusts for baseline characteristics and selection bias by matching covariables.

METHODS

By using prospectively collected clinical data from the National Surgical Quality Improvement Program of the Department of Veterans Affairs, we studied 30-day mortality, 1-year survival, and postoperative complications in 1904 patients who underwent elective AAA repair (endovascular aneurysm repair [EVAR], n=717 (37.7%); open aneurysm repair, n=1187 [62.3%]) at 123 Veterans Health Administration's hospitals between May 1, 2001, and September 30, 2003. In bivariate analysis, patient characteristics and operative and hospital variables were associated with both type of surgery and outcomes of surgery. Therefore, the predicted probability of receiving EVAR was tabulated for all patients by using multiple logistic regression to control for 32 independent demographic and clinical characteristics and then stratified into 5 groups. Patients were matched within strata based on similar levels of the independent measures (a propensity score technique), creating a pseudo-randomized control design. The proportion of patients with the morbidity and mortality outcomes was then compared between the EVAR and open procedures within strata to control for selection.

RESULTS

Patients undergoing EVAR had significantly lower unadjusted 30-day (3.1% versus 5.6%, P=.01) and 1-year mortality (8.7% versus 12.1%, P=.018) than patients undergoing open repair. By using propensity scoring, the proportions of EVAR patients experiencing 30-day mortality were equal or less than patients undergoing open procedures for all levels of probability and decreased as the probability of EVAR increased. Furthermore, propensity scoring also showed that patients having EVAR had lower 1-year mortality and experienced fewer perioperative complications.

CONCLUSIONS

We used a propensity score approach to examine outcomes after elective AAA repair to statistically control for many factors affecting both treatment selection and outcome. Patients who underwent elective EVAR had substantially lower perioperative mortality and morbidity rates compared with patients having open repair, which was not explained solely by patient selection in an observational dataset.

Past accomplishments and future directions: risk prevention in anesthesia and surgery

Anesthesiology has served as a model for patient safety in health care and was the first medical profession to treat patient safety as an independent problem. Anesthesiology has implemented widely accepted guidelines on basic monitoring, conducted long-term analyses of closed malpractice claims, developed patient simulators as meaningful training tools, and addressed problems of human error. The National Surgical Quality Improvement Program is the first national, validated, and peer-controlled program that uses risk-adjusted outcomes for the comparative assessment and improvement of the quality of surgical care. The program has reduced postoperative complications in the Veterans Administration, at both national and local levels. It is becoming more evident that processes and events during surgery can be important determinants of long-term outcomes after anesthesia and surgery.

Identification of surgical complications and deaths: an assessment of the traditional surgical morbidity and mortality conference compared with the American College of Surgeons-National Surgical Quality Improvement Program

BACKGROUND

Despite advances by surgeons in assessing quality and safety, the traditional surgical morbidity and mortality (M&M) conference has mostly remained unchallenged and unchanged. The goal of this study was to compare data as reported in a traditional M&M conference to data collected using the American College of Surgeons-National Surgical Quality Improvement Program (ACS-NSQIP) techniques.

STUDY DESIGN

A retrospective study was performed comparing data from the M&M conference in a general surgery division, in which complications and deaths were identified by residents or attendings, to data compiled by a nationally audited nurse reviewer from the ACS-NSQIP from July 1, 2002, to June 30, 2003.

RESULTS

Mortality rates calculated by traditional M&M conference (53 deaths in 5,905 patients), compared with the ACS-NSQIP nurse reviewer (28 deaths in 1,439 patients; 24% sample), were 0.9% versus 1.9%, respectively (p=0.001). Complication rates reported in M&M were 6.4% versus 28.9% ACS-NSQIP (p<0.0001). Subgroup analyses showed that mortality rates, as reported in conference, were substantially lower for both in-hospital and postdischarge patients, when compared with ACS-NSQIP. All subclassifications of complications, as presented in conference, were also lower, compared with ACS-NSQIP.

CONCLUSIONS

Traditional surgical M&M reporting considerably underreports both in-hospital and postdischarge complications and deaths as compared with ACS-NSQIP. Approximately one of two deaths and three of four complications were not reported in the M&M conference at our institution. A Web-based reporting system based on an ACS-NSQIP platform was created to automate, facilitate, and standardize data on surgical morbidity and mortality.

Laparoscopic versus open gastric bypass for morbid obesity: a multicenter, prospective, risk-adjusted analysis from the National Surgical Quality Improvement Program

OBJECTIVE

To compare laparoscopic versus open gastric bypass procedures with respect to 30-day morbidity and mortality rates, using multi-institutional, prospective, risk-adjusted data.

SUMMARY BACKGROUND DATA

Laparoscopic Roux-en-Y gastric bypass for weight loss is being performed with increasing frequency, partly driven by consumer demand. However, there are no multi-institutional, risk-adjusted, prospective studies comparing laparoscopic and open gastric bypass outcomes.

METHODS

A multi-institutional, prospective, risk-adjusted cohort study of patients undergoing laparoscopic and open gastric bypass procedures was performed from hospitals (n = 15) involved in the Private Sector Study of the National Surgical Quality Improvement Program (NSQIP). Data points have been extensively validated, are based on standardized definitions, and were collected by nurse reviewers who are audited for accuracy.

RESULTS

From 2000 to 2003, data from 1356 gastric bypass procedures was collected. The 30-day mortality rate was zero in the laparoscopic group (n = 401), and 0.6% in the open group (n = 955) (P = not significant). The 30-day complication rate was significantly lower in the laparoscopic group as compared with the open group: 7% versus 14.5% (P < 0.0001). Multivariate logistic regression analysis was performed to control for potential confounding variables and showed that patients undergoing an open procedure were more likely to develop a complication, as compared with patients undergoing an laparoscopic procedure (odds ratio = 2.08; 95% confidence interval, 1.33-3.25). Propensity score modeling revealed similar results. A prediction model was derived, and variables that significantly predict higher complication rates after gastric bypass included an open procedure, a high ASA class (III, IV, V), functionally dependent patient, and hypertension as a comorbid illness.

CONCLUSIONS

Multicenter, prospective, risk-adjusted data show that laparoscopic gastric bypass is safer than open gastric bypass, with respect to 30-day complication rate.

The impact of the 80-hour resident workweek on surgical residents and attending surgeons

OBJECTIVE

To assess the impact of the 80-hour resident workweek restrictions on surgical residents and attending surgeons.

SUMMARY BACKGROUND DATA

The ACGME mandated resident duty hour restrictions have required a major workforce restructuring. The impact of these changes needs to be critically evaluated for both the resident and attending surgeons, specifically with regards to the impact on motivation, job satisfaction, the quality of surgeon training, the quality of the surgeon's life, and the quality of patient care.

METHODS

Four prospective studies were performed at a single academic surgical program with data collected both before the necessary workforce restructuring and 1 year after, including: 1) time cards to assess changes in components of daily activity; 2) Web-based surveys using validated instruments to assess burnout and motivation to work; 3) structured, taped, one-on-one interviews with an external PhD investigator; and 4) statistical analyses of objective, quantitative data.

RESULTS

After the work-hour changes, surgical residents have decreased "burnout" scores, with significantly less "emotional exhaustion" (Maslach Burnout Inventory: 29.1 "high" vs. 23.1 "medium," P = 0.02). Residents have better quality of life both in and out of the hospital. They felt they got more sleep, have a lighter workload, and have increased motivation to work (Herzberg Motivation Dimensions). We found no measurable, statistically significant difference in the quality of patient care (NSQIP data). Resident training and education objectively were not statistically diminished (ACGME case logs, ABSITE scores). Attending surgeons perceived that their quality of their life inside and outside of the hospital was "somewhat worse" because of the work-hour changes, as they had anticipated. Many concerns were identified with regards to the professional development of future surgeons, including a change toward a shift-worker mentality that is not patient-focused, less continuity of care with a loss of critical information with each handoff, and a decrease in the patient/doctor relationship.

CONCLUSION

Although the mandated restriction of resident duty hours has had no measurable impact on the quality of patient care and has led to improvements for the current quality of life of residents, there are many concerns with regards to the training of professional, responsible surgeons for the future.

Veterans Health Administration patients' use of the private sector for coronary revascularization in New York: opportunities to improve outcomes by directing care to high-performance hospitals

OBJECTIVE

We sought to quantify Veterans Health Administration (VA) patients' utilization of coronary revascularization in the private sector and to assess the potential impact of directing this care to high-performance hospitals.

METHODS

Using VA and New York State administrative and clinical databases, we conducted a retrospective cohort study examining residents of New York State who were enrolled in the VA and underwent either coronary artery bypass graft (CABG) surgery or percutaneous coronary intervention (PCI) in 1999 or 2000 (n=6562) in either the VA or the private sector. We first calculated the proportion of revascularizations obtained in the VA and the private sector. We then identified the private sector hospitals in which these men obtained revascularizations and determined potential changes in mortality and travel burden associated with directing private sector care to high performance hospitals.

RESULTS

VA patients in New York were much more likely to undergo revascularization in the private sector than in VA hospitals: 83% of CABGs (2341/2829) and 87% of PCIs (4054/4665) were obtained in the private sector. Private sector utilization was distributed evenly across high- and low-mortality hospitals. Directing private-sector CABG surgery to high-performance hospitals could have reduced expected mortality by 24% (from 2.3% to 1.7%) and would only increase median travel time from 21 to 30 minutes. The benefit of redirecting PCI care is minimal.

CONCLUSIONS

For high-mortality procedures that veterans frequently obtain in the private sector, like CABG, directing care to high-performance hospitals may be an effective way to improve outcomes for veterans.

Risk factors for anastomotic leak after recto-sigmoid resection for ovarian cancer

OBJECTIVES

Anastomotic leak after recto-sigmoid (RS) resection for ovarian cancer (OC) is a life-threatening complication. Selection of patients for protective diverting stomas has been based on observations from the colorectal literature. Our objective was to identify primary risk factors for anastomotic leak in OC patients undergoing RS resection to better determine who would most benefit from protective diversion.

METHODS

All patients with OC or primary peritoneal cancer who underwent a debulking procedure with RS resection between January 1999 and December 2004 were included. Retrospective chart review including review of operative notes, pathology reports, and medical records including follow-up visits was done. Cases with inadequate postoperative follow-up, primary end colostomies, or diverting stomas were excluded.

RESULTS

177 patients form our study cohort. There were a total of 12/177 anastomotic leaks (6.8%). The mean time to diagnosis of anastomotic leak was 19 days (range 4-32). The leak rate for primary debulking operations was 8.7% (10/115), whereas the leak rate in secondary debulking procedures was 3.2% (2/62) (NS, P = 0.22). In univariate analysis, only perioperative serum albumin was significantly associated with an increased risk of anastomotic leak (mean 3.4 g/dL vs. 2.4 g/dL, P = 0.002). Based on serum albumin, the leak rate was 6/29 (21%) for levels <3.0 g/dL and 2/58 (3.4%) for patients with albumin greater than or equal to 3.0 g/dL (OR 7.3, 95% CI 1.37-38.87).

CONCLUSIONS

Low serum albumin is associated with an increased risk of anastomotic leak after RS resection for OC. Patients with a low albumin level may benefit from a protective diverting colostomy/ileostomy.

The surgical infection prevention and surgical care improvement projects: national initiatives to improve outcomes for patients having surgery

Among the most common complications that occur after surgery are surgical site infections and postoperative sepsis, cardiovascular complications, respiratory complications (including postoperative pneumonia), and thromboembolic complications. Patients who experience postoperative complications have dramatically increased hospital length of stay, hospital costs, and mortality rates. The Centers for Medicare & Medicaid Services, in collaboration with the Centers for Disease Control and Prevention, has implemented the Surgical Infection Prevention Project to decrease the morbidity and mortality associated with postoperative surgical site infections. More recently, the Surgical Care Improvement Project, a national quality partnership of organizations committed to improving the safety of surgical care, has been announced. This review will provide an update from the Surgical Infection Prevention Project and provide an introduction to the Surgical Care Improvement Project.

Who Pays for Poor Surgical Quality? Building a Business Case for Quality Improvement

BACKGROUND

Both providers and payors bear the financial risk associated with complications of poor quality care. But the stakeholder who bears the largest burden of this risk has a strong incentive to support quality improvement activities. The goal of the present study was to determine whether hospitals or payors incur a larger burden of increased hospital costs associated with complications.

STUDY DESIGN

We merged clinical data for 1,008 surgical patients from the private sector National Surgical Quality Improvement Program to the internal cost-accounting database of a large university hospital. We then determined the marginal costs of surgical complications from the perspective of both hospitals (changes in profit and profit margin) and payors (increase in reimbursement paid to the hospital). In our analyses of cost and reimbursement, we adjusted for procedure complexity and patient characteristics using multivariate linear regression.

RESULTS

Reimbursement for patients without complications ($14,266) exceeded hospital costs ($10,978), generating an average hospital profit of $3,288 and a profit margin of 23%. When complications occurred, hospitals still received reimbursement in excess of their costs, but the profit margin declined: reimbursement ($21,911) exceeded hospital costs ($21,156), yielding an average profit of $755 and a profit margin of 3.4%. Complications were always associated with an increase in costs to health-care payors: complications were associated with an average increase in reimbursement of $7,645 (54%) per patient.

CONCLUSIONS

Hospitals and payors both suffer financial consequences from poor-quality health care, but the greater burden falls on health-care payors. Strong incentives exist for health-care payors to become more involved in supporting quality improvement activities.

Risk factors for adverse outcomes following surgery for small bowel obstruction

OBJECTIVE

To construct risk indices predicting adverse outcomes following surgery for small bowel obstruction (SBO).

METHODS

The VA National Surgical Quality Improvement Program contains prospectively collected data on more than 1 million patients. Patients undergoing adhesiolysis only or small bowel resection for SBO from 1991 to 2002 were selected. Independent variables included 68 presurgical and 12 intraoperative risk factors; dependent variables were 21 adverse outcomes including death. Stepwise logistic regression was used to construct models predicting 30-day morbidity and mortality and to derive risk index values. Patients were then divided into risk classes.

RESULTS

Of the 2002 patients, 1650 underwent adhesiolysis only and 352 underwent small bowel resection. Thirty-seven percent undergoing adhesiolysis only and 47% undergoing small bowel resection had more than 1 complication (P < 0.001). The overall 30-day mortality was 7.7% and did not differ significantly between the groups. Odds of death were highest for dirty or infected wounds, ASA class 4 or 5, age >80 years, and dyspnea at rest. Morbidity ranged from 22%, among patients with 0 to 7 risk points, to 62% for those with >19 risk points. Mortality ranged from 2% among patients with 0 to 12 risk points to 28% for those with >31 risk points.

CONCLUSIONS

Morbidity and mortality after surgery for SBO in VA hospitals are comparable with those in other large series. The morbidity rate, but not the mortality rate, is significantly higher in patients requiring small bowel resection compared with those requiring adhesiolysis only (P < 0.001). The risk indices presented provide an easy-to-use tool for clinicians to predict outcomes for patients undergoing surgery for SBO.

Evaluating individual surgeons based on total hospital costs: evidence for variation in both total costs and volatility of costs

BACKGROUND

There is increasing interest in evaluating quality in health care, extending to the assessment of outcomes, including costs, for individual surgeons.

STUDY DESIGN

Surgical patients entered in the private sector National Surgical Quality Improvement Program at the University of Michigan Medical Center between September 2003 and September 2004 were included. Patient level characteristics and outcomes measures were combined with internal hospital cost data. Analysis was performed at the individual surgeon level using hospital costs as the outcomes variable, controlling for patient case-mix variables and procedural complexity. We used an econometric statistical model combining ordinary least squares and quantile regression methods, which allowed us to examine the effect of individual surgeons on costs.

RESULTS

Considerable variation in costs across surgeons is demonstrated, holding patient case mix and procedural complexity constant. This is shown for mean estimates (p<0.001) and estimates of 10th (p=0.001), 50th (p<0.001), and 90th (p=0.013) percentiles. Examining the 10th to 90th interquantile range also demonstrates substantial variation in the ranges of costs for surgeons (p=0.005), implying volatility in costs across providers, again holding patient case mix and procedural complexity constant. In dollar terms, 6 of 28 surgeons differ from a reference surgeon by 39% or more.

CONCLUSIONS

Individual surgeons appear to have statistically and clinically significant differences in their costs and volatility of costs when holding patient factors and procedural complexity constant. Implications for quality improvement and incentive programs are discussed.

Risk factors for adverse outcomes after transurethral resection of bladder tumors

BACKGROUND

Risk factors for adverse outcomes after transurethral resection of bladder tumors (TURBT) have not been identified to date. Such information would facilitate preoperative risk stratification and case-mix-adjusted outcome comparison, and lead to the development of processes of care directed at improving outcomes and ultimately the quality of care for bladder carcinoma patients.

METHODS

The National Surgical Quality Improvement Program (NSQIP) is a prospective quality management initiative of 123 Veterans Affairs Medical Centers nationwide. Since 1991, a total of 21,515 TURBTs have been prospectively registered by the NSQIP; these cases compose the current study population. Using multivariable logistic regression, the authors determined the independent association between preoperative patient risk factors and perioperative elements of structure/process and morbidity, mortality, and prolonged length of stay (LOS) outcomes.

RESULTS

The postoperative complication, 30-day, and 90-day mortality rates were 4.3%, 1.3%, and 3.3%, respectively. The median, 75th percentile, and 90th percentile for LOS among patients undergoing TURBT was 2 days, 3 days, and 8 days, respectively. Robust preoperative patient risk factors that were found to be uniformly associated with all adverse outcomes included the presence of disseminated disease (odds ratio [OR], 1.9-5.2) weight loss (OR, 1.8-3.8), low serum albumin (OR, 2.3-7.1), elevated serum creatinine (OR, 1.3-2.9), a dependent functional status (OR, 1.5-2.7), and emergent case status (OR, 1.8-3.1). Compared with models using preoperative patient factors alone, models including perioperative structure and process measures explained further variation in surgical outcomes (each likelihood ratio test, P < .0001).

CONCLUSIONS

The findings of the current study highlight the fact that there are a wide array of patient risk factors that are associated with adverse outcomes after TURBT. Validation of those processes implemented to modify such elements can provide a basis for quality metrics in the context of TURBT.

Predictive indices of morbidity and mortality after liver resection

OBJECTIVE

To determine if use of Model for End-Stage Liver Disease (MELD) scores to elective resections accurately predicts short-term morbidity or mortality.

SUMMARY BACKGROUND DATA

MELD scores have been validated in the setting of end-stage liver disease for patients awaiting transplantation or undergoing transvenous intrahepatic portosystemic shunt procedures. Its use in predicting outcomes after elective hepatic resection has not been evaluated.

METHODS

Records of 587 patients who underwent elective hepatic resection and were included in the National Surgical Quality Improvement Program Database were reviewed. MELD score, CTP score, Charlson Index of Comorbidity, American Society of Anesthesiology classification, and age were evaluated for their ability to predict short-term morbidity and mortality. Morbidity was defined as the development of one or more of the following complications: pulmonary edema or embolism, myocardial infarction, stroke, renal failure or insufficiency, pneumonia, deep venous thrombosis, bleeding, deep wound infection, reoperation, or hyperbilirubinemia. The analysis was repeated with patients divided according to their procedure and their primary diagnosis. Parametric or nonparametric analyses were performed as appropriate. Also, a new index was developed by dividing the patients into a development and a validation cohort, to predict morbidity and mortality in patients undergoing elective hepatic resection. ROC curves were also constructed for each of the primary indices.

RESULTS

CTP and ASA scores were superior in predicting outcome. Also, patients undergoing resection of primary malignancies had a higher rate of mortality but no difference in morbidity.

CONCLUSION

MELD scores should not be used to predict outcomes in the setting of elective hepatic resection.

Impact of Changing the Statistical Methodology on Hospital and Surgeon Ranking

BACKGROUND

Risk adjustment is central to the generation of health outcome report cards. It is unclear, however, whether risk adjustment should be based on standard logistic regression, fixed-effects or random-effects modeling.

OBJECTIVE

The objective of this study was to determine how robust the New York State (NYS) Coronary Artery Bypass Graft (CABG) Surgery Report Card is to changes in the underlying statistical methodology.

METHODS

Retrospective cohort study based on data from the NYS Cardiac Surgery Reporting System on all patient undergoing isolated CABG surgery in NYS and who were discharged between 1997 and 1999 (51,750 patients). Using the same risk factors as in the NYS models, fixed-effects and random-effects models were fitted to the NYS data. Quality outliers were identified using 1) the ratio of observed-to-expected mortality rates (O/E ratio) and confidence intervals (CIs) calculated using both parametric (Poisson distribution) and nonparametric (bootstrapping) techniques; and 2) shrinkage estimators.

RESULTS

At the surgeon level, the standard logistic regression model, the fixed-effects model, and the fixed-effects component of the random-effects model demonstrated near-perfect agreement on the identity of quality outliers using a quality indicator based on the O/E ratio and the Poisson distribution. Shrinkage estimators identified the fewest outliers, whereas the O/E ratios with bootstrap CI identified the greatest number of outliers. The results were similar for hospitals, except that the fixed-effects model identified more outliers than either the NYS model or the fixed-effects component of the random-effects model.

CONCLUSION

Shrinkage estimators based on random-effects models are slightly more conservative in identifying quality outliers compared with the traditional approach based on fixed-effects modeling and standard regression. Explicitly modeling surgeon provider effect (fixed-effects and random-effects models) did not significantly alter the distribution of quality outliers when compared with standard logistic regression (which does not model provider effect). Compared with the standard parametric approach, the use of a bootstrap approach to construct 95% confidence interval around the O/E ratio resulted in more providers being identified as quality outliers.

A call for a national transplant surgical quality improvement program

The severity of illness in transplant patients and the complexity of transplant operations results in significant postoperative morbidity and mortality. Remarkable efforts have been made by transplant physicians to study and improve organ allocation, graft and patient survival, immunosuppression and the long-term management of post-transplant complications. Less effort has been spent studying the actual transplant operation and systems of acute transplant care. The National Surgical Quality Improvement Program (NSQIP) has provided a standardized approach to quality improvement and has demonstrated significant potential for a reduction in postoperative morbidity and mortality in other surgical disciplines. Medical centers are under increasing pressure to measure surgical quality and the nexus of transplant surgical quality improvement should not lie in the hands of CMS or JACHO, but rather it should be created and developed within the transplant community. The time has come for a national transplant surgical quality improvement program based on the NSQIP infrastructure. Such a proactive approach toward quality improvement from the transplant community is an excellent investment for patients, providers and health care payers.

Renewal of surgical quality and safety initiatives: a multispecialty challenge

The quality and safety movement in surgical specialty practice is gaining momentum. On the basis of risk-adjusted outcomes of coronary artery surgery and the improved risk assessment in the Veterans Affairs system, a growing array of surgical specialists has focused on recognition of legitimate risk factors, identification of performance measures that are valid surrogates for better practices, and refinement of risk-adjusted outcomes. Recognition of educational needs, personal practice patterns, and systems deficiencies now permits a broad-based application of long-standing primarily medical issues to elective surgical procedures in an organized and Integrated fashion. Approximately 85,000 patients per day undergo elective operations in the United States. A platform based on physician involvement and leadership has been tested in the Surgical Care Improvement Project, funded by a subcontract from the Centers for Medicare and Medicaid Services. This effort has defined factors worthy of further verification and provides a framework for an ethical and valid pay-for-performance scheme.

Defining the high-risk patient for carotid endarterectomy: An analysis of the prospective National Surgical Quality Improvement Program database

BACKGROUND

Carotid endarterectomy (CEA) is the gold standard for the treatment of carotid stenosis, but carotid angioplasty and stenting has been advocated in high-risk patients. The definition of such a population has been elusive, particularly because the data are largely retrospective. Our study examined results for CEA in the National Surgical Quality Improvement Program database (both Veterans Affairs and private sector).

METHODS

National Surgical Quality Improvement Program data were gathered prospectively for all patients undergoing primary isolated CEA during the interval 2000 to 2003 at 123 Veterans Affairs and 14 private sector academic medical centers. Study end points included the 30-day occurrence of any stroke, death, or cardiac event. A variety of clinical, demographic, and operative variables were assessed with multivariate models to identify risk factors associated with the composite (stroke, death, or cardiac event) end point. Adjudication of end points was by trained nurse reviewers (previously validated).

RESULTS

A total of 13,622 CEAs were performed during the study period; 95% were on male patients, and 91% of cases were conducted within the Veterans Affairs sector. The average age was 68.6 +/- 0.1 years, and 42.1% of the population had no prior neurologic event. The composite stroke, death, or cardiac event rate was 4.0%; the stroke/death rate was 3.4%. Multivariate correlates of the composite outcome were (odds ratio, P value) as follows: deciles of age (1.13, .018), insulin-requiring diabetes (1.73, <.001), oral agent-controlled diabetes (1.39, .003), decade of pack-years smoking (1.04, >.001), history of transient ischemic attack (1.41, >.001), history of stroke (1.51, >.001), creatinine >1.5 mg/dL (1.48, >.001), hypoalbuminemia (1.49, >.001), and fourth quartile of operative time (1.44, >.001). Cardiopulmonary comorbid features did not affect the composite outcome in this model. Regional anesthesia was used in 2437 (18%) cases, with a resultant relative risk reduction for stroke (17%), death (24%), cardiac event (33%), and the composite outcome (31%; odds ratio, 0.69; P = .008).

CONCLUSIONS

Carotid endarterectomy results across a spectrum of Veterans Affairs and private sector hospitals compare favorably to contemporary studies. These data will assist in selecting patients who are at an increased risk for adverse outcomes. Use of regional anesthetic significantly reduced perioperative complications in a risk-adjusted model, thus suggesting that it is the anesthetic of choice when CEA is performed in high-risk patients.

The volume-outcome relationship: don't believe everything you see

This paper investigates methodological limitations of the volume-outcome relationship. A brief overview of quality measurement is followed by a discussion of two important aspects of the relationship.

Comparative Analysis of Vagotomy and Drainage Versus Vagotomy and Resection Procedures for Bleeding Peptic Ulcer Disease: Results of 907 Patients from the Department of Veterans Affairs National Surgical Quality Improvement Program Database

BACKGROUND

The purpose of this study was to determine postoperative outcomes and risk factors for morbidity and mortality in patients requiring surgery for bleeding peptic ulcer disease (PUD). Vagotomy and drainage procedures are technically simpler but are usually associated with higher ulcer recurrence rates. In contrast, vagotomy and resection approaches offer lower ulcer recurrences but represent much more challenging operations and are associated with considerable morbidity and mortality.

STUDY DESIGN

Data collected through the Department of Veterans Affairs National Surgical Quality Improvement Program database from 1991 to 2001 were submitted for stepwise logistic regression analysis for prediction of 30-day postoperative morbidity and mortality, rebleeding, and postoperative length of stay. The study population included all patients operated on for bleeding PUD within an 11-year period.

RESULTS

The 30-day morbidity, mortality, and rebleeding rates were comparable between surgical groups. Age, American Society of Anesthesiologists class, presence of ascites, coma, diabetes, functional status, hemiplegia, and history of steroid use were predictors of postoperative death. Risk factors for rebleeding included dependent functional status, history of congestive heart failure, smoking, steroid use, and preoperative transfusions. Having a resective procedure, American Society of Anesthesiologists class, hemiplegia, history of COPD, and requiring ventilator-assisted respirations before surgery were positively associated with increased length of hospital stay.

CONCLUSIONS

No differences were observed in 30-day mortality, morbidity, or rebleeding rates between surgical groups. Having a resective procedure was a predictor of prolonged postoperative stay. Dependent status and chronic use of steroids were predictors of both rebleeding and postoperative mortality.

The New England Colorectal Cancer Quality Project: A Prospective Multi-Institutional Feasibility Study

BACKGROUND

The need for risk-adjusted databases to benchmark quality is well recognized. Data entry is typically performed by physician surrogates who are variably involved in patient care and might be unable to capture key elements of patient care known only to the operating surgeon. The primary purpose of this study was to assess the feasibility of developing a multi-institutional, prospective, surgeon-initiated database and, secondarily, to compare the data collected with chart review.

STUDY DESIGN

The New England Colorectal Society project registry was a prospective, multi-institutional regional database of consecutive patients undergoing operation for colorectal cancer at 13 participating institutions from July 2003 to June 2004. Three sites were chosen for case entry compliance and a random 10% sampling of cases was selected for chart review.

RESULTS

Five hundred sixty-nine patients were entered by 26 surgeons at 13 study sites. Two hundred nineteen complications were reported in 168 patients including 6 deaths (1.1%). Case entry compliance ranged from 45% to 100% by site and 25.5% to 100% by surgeon. There was at least one discrepancy between surgeon entry and chart review in 96% of cases; intraoperative complications and key surgical details reported by the surgeon were frequently absent from the chart.

CONCLUSIONS

Surgeons will participate in a collaborative, multi-institutional quality database. Compliance was variable, indicating that surgeon data entry cannot reliably replace other means of data collection. The surgeon might be able to provide key pieces of data, not otherwise available, that can be critical to understanding and improving outcomes.