1
|
Howard RA, Thelen AE, Chen X, Gates R, Krumm AE, Millis MA, Gupta T, Brown CS, Bandeh-Ahmadi H, Wnuk GM, Yee CC, Ryan AM, Mukherjee B, Dimick JB, George BC. Mortality and Severe Complications Among Newly Graduated Surgeons in the United States. Ann Surg 2024; 279:555-560. [PMID: 37830271 PMCID: PMC10939969 DOI: 10.1097/sla.0000000000006128] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/14/2023]
Abstract
OBJECTIVE To evaluate severe complications and mortality over years of independent practice among general surgeons. BACKGROUND Despite concerns that newly graduated general surgeons may be unprepared for independent practice, it is unclear whether patient outcomes differ between early and later career surgeons. METHODS We used Medicare claims for patients discharged between July 1, 2007 and December 31, 2019 to evaluate 30-day severe complications and mortality for 26 operations defined as core procedures by the American Board of Surgery. Generalized additive mixed models were used to assess the association between surgeon years in practice and 30-day outcomes while adjusting for differences in patient, hospital, and surgeon characteristics. RESULTS The cohort included 1,329,358 operations performed by 14,399 surgeons. In generalized mixed models, the relative risk (RR) of mortality was higher among surgeons in their first year of practice compared with surgeons in their 15th year of practice [5.5% (95% CI: 4.1%-7.3%) vs 4.7% (95% CI: 3.5%-6.3%), RR: 1.17 (95% CI: 1.11-1.22)]. Similarly, the RR of severe complications was higher among surgeons in their first year of practice compared with surgeons in their 15th year of practice [7.5% (95% CI: 6.6%-8.5%) versus 6.9% (95% CI: 6.1%-7.9%), RR: 1.08 (95% CI: 1.03-1.14)]. When stratified by individual operation, 21 operations had a significantly higher RR of mortality and all 26 operations had a significantly higher RR of severe complications in the first compared with the 15th year of practice. CONCLUSIONS Among general surgeons performing common operations, rates of mortality and severe complications were higher among newly graduated surgeons compared with later career surgeons.
Collapse
Affiliation(s)
- Ryan A Howard
- Department of Surgery, University of Michigan, Ann Arbor, MI
- Center for Healthcare Outcomes and Policy, University of Michigan, Ann Arbor, MI
- Department of Surgery, Center for Surgical Training and Research, University of Michigan, Ann Arbor, MI
| | - Angela E Thelen
- Department of Surgery, University of Michigan, Ann Arbor, MI
- Center for Healthcare Outcomes and Policy, University of Michigan, Ann Arbor, MI
- Department of Surgery, Center for Surgical Training and Research, University of Michigan, Ann Arbor, MI
| | - Xilin Chen
- Department of Surgery, Center for Surgical Training and Research, University of Michigan, Ann Arbor, MI
| | - Rebecca Gates
- Department of Surgery, Center for Surgical Training and Research, University of Michigan, Ann Arbor, MI
| | - Andrew E Krumm
- Department of Surgery, University of Michigan, Ann Arbor, MI
- Department of Surgery, Center for Surgical Training and Research, University of Michigan, Ann Arbor, MI
- Department of Learning Health Sciences, University of Michigan, Ann Arbor, Michigan American Board of Surgery, Philadelphia, PA
| | - Michael Andrew Millis
- Department of Surgery, University of Michigan, Ann Arbor, MI
- Center for Healthcare Outcomes and Policy, University of Michigan, Ann Arbor, MI
| | - Tanvi Gupta
- Department of Surgery, Center for Surgical Training and Research, University of Michigan, Ann Arbor, MI
| | - Craig S Brown
- Department of Surgery, University of Michigan, Ann Arbor, MI
- Center for Healthcare Outcomes and Policy, University of Michigan, Ann Arbor, MI
| | - Hoda Bandeh-Ahmadi
- Department of Surgery, University of Michigan, Ann Arbor, MI
- Department of Surgery, Center for Surgical Training and Research, University of Michigan, Ann Arbor, MI
| | - Greg M Wnuk
- Department of Surgery, University of Michigan, Ann Arbor, MI
- Department of Surgery, Center for Surgical Training and Research, University of Michigan, Ann Arbor, MI
| | - Chia Chye Yee
- Department of Surgery, Center for Surgical Training and Research, University of Michigan, Ann Arbor, MI
| | - Andrew M Ryan
- Department of Biostatistics and Epidemiology, School of Public Health, University of Michigan, Ann Arbor, MI
- Center for Evaluating Health Reform, University of Michigan, Ann Arbor, MI
| | - Bhramar Mukherjee
- Department of Biostatistics and Epidemiology, School of Public Health, University of Michigan, Ann Arbor, MI
| | - Justin B Dimick
- Department of Surgery, University of Michigan, Ann Arbor, MI
- Center for Healthcare Outcomes and Policy, University of Michigan, Ann Arbor, MI
| | - Brian C George
- Department of Surgery, University of Michigan, Ann Arbor, MI
- Center for Healthcare Outcomes and Policy, University of Michigan, Ann Arbor, MI
- Department of Surgery, Center for Surgical Training and Research, University of Michigan, Ann Arbor, MI
- Department of Learning Health Sciences, University of Michigan, Ann Arbor, Michigan American Board of Surgery, Philadelphia, PA
| |
Collapse
|
2
|
George BC, Thelen AE, Howard RA, Kendrick DE, Chen X, Clark MJ, Gupta T, Brown CS, Bandeh-Ahmadi H, Luckoski JL, Wnuk GM, Fan Z, Krumm AE, Ryan AM, Buyske J, Mukherjee B, Dimick JB. Evaluating Educational Outcomes Using Patient Outcomes of New Surgeons Performing Partial Colectomy Compared to Cholecystectomy. Acad Med 2023; 98:S143-S148. [PMID: 37983406 DOI: 10.1097/acm.0000000000005368] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 08/11/2023]
Abstract
PURPOSE Despite ongoing efforts to improve surgical education, surgical residents face gaps in their training. However, it is unknown if differences in the training of surgeons are reflected in the patient outcomes of those surgeons once they enter practice. This study aimed to compare the patient outcomes among new surgeons performing partial colectomy-a common procedure for which training is limited-and cholecystectomy-a common procedure for which training is robust. METHOD The authors retrospectively analyzed all adult Medicare claims data for patients undergoing inpatient partial colectomy and inpatient cholecystectomy between 2007 and 2018. Generalized additive mixed models were used to investigate the associations between surgeon years in practice and risk-adjusted rates of 30-day serious complications and death for patients undergoing partial colectomy and cholecystectomy. RESULTS A total of 14,449 surgeons at 4,011 hospitals performed 340,114 partial colectomy and 355,923 cholecystectomy inpatient operations during the study period. Patients undergoing a partial colectomy by a surgeon in their 1st vs 15th year of practice had higher rates of serious complications (5.22% [95% CI, 4.85%-5.60%] vs 4.37% [95% CI, 4.22%-4.52%]; P < .01) and death (3.05% [95% CI, 2.92%-3.17%] vs 2.83% [95% CI, 2.75%-2.91%]; P < .01). Patients undergoing a cholecystectomy by a surgeon in their 1st vs 15th year of practice had similar rates of 30-day serious complications (4.11% vs 3.89%; P = .11) and death (1.71% vs 1.70%; P = .93). CONCLUSIONS Patients undergoing partial colectomy faced a higher risk of serious complications and death when the operation was performed by a new surgeon compared to an experienced surgeon. Conversely, patient outcomes following cholecystectomy were similar for new and experienced surgeons. More attention to partial colectomy during residency training may benefit patients.
Collapse
Affiliation(s)
- Brian C George
- B.C. George is associate professor of surgery and director, Center for Surgical Training and Research, Department of Surgery, University of Michigan, Ann Arbor, Michigan
| | - Angela E Thelen
- A.E. Thelen is a surgical education research fellow, Center for Surgical Training and Research, University of Michigan, Ann Arbor, Michigan
| | - Ryan A Howard
- R.A. Howard is a research fellow, Center for Health Outcomes and Policy, Department of Surgery, University of Michigan, Ann Arbor, Michigan
| | - Daniel E Kendrick
- D.E. Kendrick was a surgical education research fellow, Center for Surgical Training and Research, University of Michigan, Ann Arbor, Michigan, and is currently assistant professor, Department of Surgery, University of Minnesota, Minneapolis, Minnesota
| | - Xilin Chen
- X. Chen is a data analyst, Center for Surgical Training and Research, Department of Surgery, University of Michigan, Ann Arbor, Michigan
| | - Michael J Clark
- M.J. Clark is a statistician lead, Center for Statistical Consultation and Research, University of Michigan, Ann Arbor, Michigan
| | - Tanvi Gupta
- T. Gupta is a data analyst, Center for Surgical Training and Research, Department of Surgery, University of Michigan, Ann Arbor, Michigan
| | - Craig S Brown
- C.S. Brown is a general surgery resident and research fellow, Center for Health Outcomes and Policy, Department of Surgery, University of Michigan, Ann Arbor, Michigan
| | - Hoda Bandeh-Ahmadi
- H. Bandeh-Ahmadi is director of social research, Center for Surgical Training and Research, Department of Surgery, University of Michigan, Ann Arbor, Michigan
| | - John L Luckoski
- J.L. Luckoski is a surgical education research fellow, Center for Surgical Training and Research, University of Michigan, Ann Arbor, Michigan
| | - Greg M Wnuk
- G.M. Wnuk is program manager, Center for Surgical Training and Research, University of Michigan, Ann Arbor, Michigan
| | - Zhaohui Fan
- Z. Fan is a data analyst, Center for Health Outcomes and Policy, Department of Surgery, University of Michigan, Ann Arbor, Michigan
| | - Andrew E Krumm
- A.E. Krumm is assistant professor of learning health sciences, University of Michigan, Ann Arbor, Michigan
| | - Andrew M Ryan
- A.M. Ryan is professor of health services, policy, and practice, Brown University School of Public Health, Providence, Rhode Island
| | - Jo Buyske
- J. Buyske is president and chief executive officer, American Board of Surgery, Philadelphia, Pennsylvania
| | - Bhramar Mukherjee
- B. Mukherjee is professor of epidemiology and chair of biostatistics, Department of Biostatistics and Epidemiology, School of Public Health, University of Michigan, Ann Arbor, Michigan
| | - Justin B Dimick
- J.B. Dimick is professor and chair, Department of Surgery, University of Michigan, Ann Arbor, Michigan
| |
Collapse
|
3
|
Kendrick DE, Thelen AE, Chen X, Gupta T, Yamazaki K, Krumm AE, Bandeh-Ahmadi H, Clark M, Luckoscki J, Fan Z, Wnuk GM, Ryan AM, Mukherjee B, Hamstra SJ, Dimick JB, Holmboe ES, George BC. Association of Surgical Resident Competency Ratings With Patient Outcomes. Acad Med 2023; 98:813-820. [PMID: 36724304 DOI: 10.1097/acm.0000000000005157] [Citation(s) in RCA: 3] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/18/2023]
Abstract
PURPOSE Accurate assessment of clinical performance is essential to ensure graduating residents are competent for unsupervised practice. The Accreditation Council for Graduate Medical Education milestones framework is the most widely used competency-based framework in the United States. However, the relationship between residents' milestones competency ratings and their subsequent early career clinical outcomes has not been established. It is important to examine the association between milestones competency ratings of U.S. general surgical residents and those surgeons' patient outcomes in early career practice. METHOD A retrospective, cross-sectional study was conducted using a sample of national Medicare claims for 23 common, high-risk inpatient general surgical procedures performed between July 1, 2015, and November 30, 2018 (n = 12,400 cases) by nonfellowship-trained U.S. general surgeons. Milestone ratings collected during those surgeons' last year of residency (n = 701 residents) were compared with their risk-adjusted rates of mortality, any complication, or severe complication within 30 days of index operation during their first 2 years of practice. RESULTS There were no associations between mean milestone competency ratings of graduating general surgery residents and their subsequent early career patient outcomes, including any complication (23% proficient vs 22% not yet proficient; relative risk [RR], 0.97, [95% CI, 0.88-1.08]); severe complication (9% vs 9%, respectively; RR, 1.01, [95% CI, 0.86-1.19]); and mortality (5% vs 5%; RR, 1.07, [95% CI, 0.88-1.30]). Secondary analyses yielded no associations between patient outcomes and milestone ratings specific to technical performance, or between patient outcomes and composites of operative performance, professionalism, or leadership milestones ratings ( P ranged .32-.97). CONCLUSIONS Milestone ratings of graduating general surgery residents were not associated with the patient outcomes of those surgeons when they performed common, higher-risk procedures in a Medicare population. Efforts to improve how milestones ratings are generated might strengthen their association with early career outcomes.
Collapse
Affiliation(s)
- Daniel E Kendrick
- D.E. Kendrick is assistant professor, Department of Surgery, University of Minnesota, Minneapolis, Minnesota
| | - Angela E Thelen
- A.E. Thelen is research fellow, Center for Surgical Training and Research, Department of Surgery, University of Michigan, Ann Arbor, Michigan
| | - Xilin Chen
- X. Chen is research analyst, Center for Surgical Training and Research, Department of Surgery, University of Michigan, Ann Arbor, Michigan
| | - Tanvi Gupta
- T. Gupta is research analyst, Center for Surgical Training and Research, Department of Surgery, University of Michigan, Ann Arbor, Michigan
| | - Kenji Yamazaki
- K. Yamazaki is senior data analyst, Accreditation Council for Graduate Medical Education, Chicago, Illinois
| | - Andrew E Krumm
- A.E. Krumm is assistant professor, Department of Learning Health Sciences, University of Michigan, Ann Arbor, Michigan
| | - Hoda Bandeh-Ahmadi
- H. Bandeh-Ahmadi is project manager, Center for Surgical Training and Research, Department of Surgery, University of Michigan, Ann Arbor, Michigan
| | - Michael Clark
- M. Clark is a biostatistician, Consulting for Statistics, Computing, and Analytics Research, University of Michigan, Ann Arbor, Michigan
| | - John Luckoscki
- J. Luckoscki is research fellow, Center for Surgical Training and Research, Department of Surgery, University of Michigan, Ann Arbor, Michigan
| | - Zhaohui Fan
- Z. Fan is research analyst, Center for Healthcare Outcomes and Policy, Department of Surgery, University of Michigan, Ann Arbor, Michigan
| | - Greg M Wnuk
- G.M. Wnuk is program manager, Center for Surgical Training and Research, Department of Surgery, University of Michigan, Ann Arbor, Michigan
| | - Andrew M Ryan
- A.M. Ryan is professor, Department of Health Management and Policy, School of Public Health, University of Michigan, Ann Arbor, Michigan
| | - Bhramar Mukherjee
- B. Mukherjee is professor and chair, Division of Biostatistics, School of Public Health, University of Michigan, Ann Arbor, Michigan
| | - Stanley J Hamstra
- S.J. Hamstra is professor, Department of Surgery, University of Toronto, Toronto, Ontario, Canada
| | - Justin B Dimick
- J.B. Dimick is professor and chair, Department of Surgery, University of Michigan, Ann Arbor, Michigan
| | - Eric S Holmboe
- E.S. Holmboe is chief research, Milestone Development, and evaluation officer, Accreditation Council for Graduate Medical Education, Chicago, Illinois
| | - Brian C George
- B.C. George is director, Center for Surgical Training and Research, and assistant professor, Department of Surgery, University of Michigan, Ann Arbor, Michigan
| |
Collapse
|