|
|
||||||||
Ann Thorac Surg 1996;61:17-20
© 1996 The Society of Thoracic Surgeons
Denver Veterans Affairs Medical Center, Divisions of Cardiothoracic Surgery, Internal Medicine, and Cardiology, University of Colorado School of Medicine, Denver, Colorado, and Department of Statistics, Catholic University of Chile, Santiago, Chile
Accepted for publication August 23, 1995.
| Abstract |
|---|
|
|
|---|
Methods. From April 1987 to September 1992, expected mortality rates were calculated for 23,986 coronary artery bypass grafting procedures performed at 44 different Veterans Affairs hospitals.
Results. This study found a statistically significant relationship between annual hospital coronary artery bypass grafting volume and observed mortality rates (p < 0.02). However, no statistically significant relationship between coronary artery bypass grafting volume and risk-adjusted operative mortality was found (p = 0.10). Using analysis of variance on hospital-level data, hospitals with 100 or less cases per year have higher observed to expected mortality ratios than hospitals performing more than 100 cases per year (p = 0.03). Using Poisson regression models, however, a volume threshold could not be found.
Conclusions. These findings are consistent with the current Veterans Affairs policy requirements to periodically review quality at low-volume hospitals.
| Introduction |
|---|
|
|
|---|
volume hospitals have been reported to have better surgical outcomes than low-volume hospitals.
Recent studies by Hannan and colleagues [12, 13] indicated that hospital volume is an independent predictor of cardiac surgical mortality, even after adjustment for patient clinical risk factors using logistic regression analysis. The policy implications of these findings suggest that either CABG program regionalization or selective referral of CABG procedures to low-mortality hospitals may be used as strategies to improve the quality of patient care for cardiac surgery patients.
To explore the potential policy implications of these previous research findings within the Department of Veterans Affairs (VA), this study was designed to determine whether risk-adjusted CABG mortality rates for patients operated in VA medical centers are significantly related to CABG surgical procedure volume.
| Material and Methods |
|---|
|
|
|---|
As logistic regression requires that complete data be available for every variable used in the analysis, 1,965 records (6.8%) were dropped from the multivariate analysis performed. In general, this represents a fairly high completeness rate of data (93.2%) across the seven key fields. Thus, data imputation techniques to adjust for missing data were not used in this analysis.
The hospital's annual CABG volume was added to the CABG predictive model as an independent variable to determine whether a relationship between hospital volume and CABG risk-adjusted mortality existed at the patient-level unit of analysis. The purpose of this special analysis was to determine in a multivariate context whether volume was a statistically significant predictor of outcome. Also, the relationship between unadjusted mortality and age-adjusted mortality rates and hospital volume was explored. The c-index, a performance measure of a risk model's predictive power, was calculated [17]. The c-index represents the area under the receiver operating characteristic curve (which reflects the relative specificity and sensitivity of the model in predicting risk of operative death). Theoretically, the c-index may range from 0 to 1. The actual range is between 0.5 and 1.0, where a model with a c-index of 0.5 is useless for prediction purposes and a model with a c-index of 1.0 provides a perfect prediction.
Finally, patient data were aggregated to the hospital unit of analysis. The observed to expected mortality ratio (O/E) was calculated for each hospital for each year. Hospitals were classified according to their CABG annual procedure volume. A threshold analysis was performed to determine whether a volume O/E breakpoint could be identified [18]. The threshold analysis searched for the optimal volume breakpoint that maximized the difference in risk-adjusted mortality rates (O/E ratio) between low- and high-volume hospitals using a sequential analysis of variance technique. Analysis of variance is a classic method to compare differences in the means (in this case O/E ratio means) across multiple samples (in this case high/low volume groups of hospitals).
Poisson additive models were used to model the functional relationship between O/E ratio and hospital volume for each of the 5 years included in this study [19]. This analysis has several advantages compared with classic regression techniques such as linear regression models. Classic regression models assume that the observations have constant variance and all relevant tests associated with classic models assume that the response variable, in this case the O/E ratio, has a normal distribution. In examining the distribution of O/E ratio versus hospital volume, both assumptions are clearly violated, invalidating the posterior conclusions of such an analysis.
The Poisson additive models assume that the response variable is count data and the variance changes proportionally to the mean response. The observed number of deaths were modeled as count data using volume as a covariate, and the expected number of deaths were accounted in the model as an offset term on the logarithmic scale of the Poisson model.
Another advantage of the Poisson additive model is that flexible curves may be used to fit the data, rather than forcing linear or exponential decay relationships to risk-adjusted morality rates and volume data. The Poisson additive models will be more sensitive to a gradual and smooth change in the relationship between risk-adjusted mortality rates and volume, whereas the threshold analysis requires a sharp distinct change in this relationship.
Poisson additive models were fitted considering volume as the only covariable for each of the 5 years of the study. Initially, models were fit by forcing a linear and logarithmic effect of volume. In addition, models were fitted using two linear lines that allowed a break in the slope to determine whether a volume threshold existed.
| Results |
|---|
|
|
|---|
Hospital Unit of Analysis
The threshold analysis using sequential analysis of variance indicates that hospitals with CABG volume of 100 cases or less per year have significantly higher O/E ratios (mean O/E ratio, 1.26) in comparison with hospitals with more than 100 cases per year (mean O/E ratio, 0.95) (p = 0.03). Although other breakpoints were explored, classifying hospitals by CABG volume at the breakpoint of 100 patients per year exhibited the maximal statistical significance between groups.
The prevalence of the risk factors predictive of operative death were compared between the two hospital volume groups (Table 1
). A greater frequency of occurrence for all patient risk characteristics associated with higher risk of operative death was observed in the low-volume hospital group. The largest difference was observed for the urgent/emergent patient risk characteristic. These summary data, therefore, indicate that the low-volume hospitals perform CABG procedures on generally higher risk patients as well as exhibit generally higher operative mortality rates.
|
0.05). This result was found to be attributable to two influential observations. When these two observations were removed from the analysis, the relationship was no longer significant. For all other years, the O/E ratio did not exhibit either a linear or an exponential decay relationship with volume. Finally, a second set of Poisson regression models were developed with two linear lines with a change in slope at volume of 100. None of these second models using two lines demonstrated a statistically significantly better fit than the initial Poisson models using volume as a linear term (where statistical significance is defined as p
0.05). In summary, neither set of Poisson regression analyses indicated that O/E ratio changed with volume or that a threshold existed at 100 cases per year. | Comment |
|---|
|
|
|---|
This study found a statistically significant relationship between both unadjusted mortality rates and age-only adjusted mortality rates with annual CABG volume. However, this study did not identify a statistically significant relationship between risk-adjusted mortality rates and hospital volume. As part of a search to determine a threshold for quality review, a break point of 100 cases per hospital per year was found using analysis of variance. However, alternative analytic techniques using Poisson regression analysis did not support this finding.
In examining Figure 1
, it is evident that several low-volume hospitals performed equivalent to or better than the high-volume hospitals based on their annual O/E ratios. In contrast, some low-volume hospitals performed worse than the high-volume hospitals. This inconsistency in performance among the group of low-volume hospitals warrants continued monitoring to assure acceptable quality of cardiac surgical care. Hence, the existing VA policies established by the Cardiac Surgery Consultants Committee (where cardiac surgical programs with less than 100 cardiac surgical cases per year for a consecutive 2-year period may be subject to a site visit to assess their quality performance) appear appropriate.
|
The findings of this study imply that different degrees of risk adjustment may potentially lead to divergent conclusions regarding the volume-outcome relationship for CABG. This study, however, has several important limitations that may restrict the generalizability of these findings. A very small percentage of VA hospitals perform less than 100 cases per year due to existing quality assurance review policies. In addition, the volume of CABG procedures performed at a VA hospital may reflect only a portion of the cardiac surgeon's (ie, faculty's and resident's) workload as surgeons usually operate at the affiliated university center. Finally, we have not collected physician-specific identifier information and cannot assess whether physician-volume and risk-adjusted mortality are related.
Given the increased raw and risk-adjusted operative mortality rates at VA centers performing 100 or less CABG procedures per year, the existing VA criteria and standards (related to the minimum volume requirement of 100 cases/year) appear to be appropriate. Given the conflicting results of the different analytic methods used to determine whether a volume threshold exists, caution should be used in the application of minimum volume requirements as a measure to assure quality of care. We believe that volume criteria are more appropriately used as a screening measure to initiate a more careful, in-depth review of provider quality.
| Acknowledgments |
|---|
|
|
|---|
| Footnotes |
|---|
|
|
|---|
| References |
|---|
|
|
|---|
Related Articles
This article has been cited by other articles:
![]() |
D. M. Shahian, F. H. Edwards, V. A. Ferraris, C. K. Haan, J. B. Rich, S.-L. T. Normand, E. R. DeLong, S. M. O'Brien, C. M. Shewan, R. S. Dokholyan, et al. Quality Measurement in Adult Cardiac Surgery: Part 1--Conceptual Framework and Measure Selection Ann. Thorac. Surg., April 1, 2007; 83(4_Supplement): S3 - S12. [Full Text] [PDF] |
||||
![]() |
H.-C. Wen, C.-H. Tang, H.-C. Lin, C.-S. Tsai, C.-S. Chen, and C.-Y. Li Association Between Surgeon and Hospital Volume in Coronary Artery Bypass Graft Surgery Outcomes: A Population-Based Study Ann. Thorac. Surg., March 1, 2006; 81(3): 835 - 842. [Abstract] [Full Text] [PDF] |
||||
![]() |
M. E. Plomondon, A. W. Casebeer, L. M. Schooley, B. D. Wagner, G. K. Grunwald, G. O. McDonald, F. L. Grover, and A. L. W. Shroyer Exploring the Volume-Outcome Relationship for Off-Pump Coronary Artery Bypass Graft Procedures Ann. Thorac. Surg., February 1, 2006; 81(2): 547 - 553. [Abstract] [Full Text] [PDF] |
||||
![]() |
K. F. Welke Invited commentary Ann. Thorac. Surg., February 1, 2006; 81(2): 553 - 554. [Full Text] [PDF] |
||||
![]() |
B. K. Nallamothu, K. A. Eagle, V. A. Ferraris, and R. M. Sade Should Coronary Artery Bypass Grafting Be Regionalized? Ann. Thorac. Surg., November 1, 2005; 80(5): 1572 - 1581. [Full Text] [PDF] |
||||
![]() |
L. G. Glance, A. W. Dick, T. M. Osler, and D. B. Mukamel The Relation Between Surgeon Volume and Outcome Following Off-Pump vs On-Pump Coronary Artery Bypass Graft Surgery Chest, August 1, 2005; 128(2): 829 - 837. [Abstract] [Full Text] [PDF] |
||||
![]() |
A. Zacharias, T. A. Schwann, C. J. Riordan, S. J. Durham, A. Shah, T. J. Papadimos, M. Engoren, and R. H. Habib Is Hospital Procedure Volume a Reliable Marker of Quality for Coronary Artery Bypass Surgery? A Comparison of Risk and Propensity Adjusted Operative and Midterm Outcomes Ann. Thorac. Surg., June 1, 2005; 79(6): 1961 - 1969. [Abstract] [Full Text] [PDF] |
||||
![]() |
P. Narayan, M. Caputo, C.A. Rogers, H. Alwair, B. Mahesh, G.D. Angelini, and A.J. Bryan Early and mid-term outcomes of surgery of the ascending aorta/arch: is there a relationship with caseload? Eur. J. Cardiothorac. Surg., May 1, 2004; 25(5): 676 - 682. [Abstract] [Full Text] [PDF] |
||||
![]() |
E. D. Peterson, L. P. Coombs, E. R. DeLong, C. K. Haan, and T. B. Ferguson Procedural Volume as a Marker of Quality for CABG Surgery JAMA, January 14, 2004; 291(2): 195 - 201. [Abstract] [Full Text] [PDF] |
||||
![]() |
D. M. Shahian Improving Cardiac Surgery Quality--Volume, Outcome, Process? JAMA, January 14, 2004; 291(2): 246 - 248. [Full Text] [PDF] |
||||
![]() |
L. G. Glance, A. W. Dick, D. B. Mukamel, and T. M. Osler Is the hospital volume-mortality relationship in coronary artery bypass surgery the same for low-risk versus high-risk patients? Ann. Thorac. Surg., October 1, 2003; 76(4): 1155 - 1162. [Abstract] [Full Text] [PDF] |
||||
![]() |
E. L. Hannan, C. Wu, T. J. Ryan, E. Bennett, A. T. Culliford, J. P. Gold, A. Hartman, O. W. Isom, R. H. Jones, B. McNeil, et al. Do Hospitals and Surgeons With Higher Coronary Artery Bypass Graft Surgery Volumes Still Have Lower Risk-Adjusted Mortality Rates? Circulation, August 19, 2003; 108(7): 795 - 801. [Abstract] [Full Text] [PDF] |
||||
![]() |
D. M. Shahian and S.-L. T. Normand The volume-outcome relationship: from Luft to Leapfrog Ann. Thorac. Surg., March 1, 2003; 75(3): 1048 - 1058. [Abstract] [Full Text] [PDF] |
||||
![]() |
V. A. Ferraris and S. P. Ferraris Risk Stratification and Comorbidity Card. Surg. Adult, January 1, 2003; 2(2003): 187 - 224. [Full Text] |
||||
![]() |
E. A. Halm, C. Lee, and M. R. Chassin Is Volume Related to Outcome in Health Care? A Systematic Review and Methodologic Critique of the Literature Ann Intern Med, September 17, 2002; 137(6): 511 - 520. [Abstract] [Full Text] [PDF] |
||||
![]() |
C. Mavroudis and J. P. Jacobs Congenital heart disease outcome analysis: Methodology and rationale J. Thorac. Cardiovasc. Surg., January 1, 2002; 123(1): 6 - 7. [Full Text] [PDF] |
||||
![]() |
F. L. Grover, J. C. Cleveland Jr, and L. W. Shroyer Quality Improvement in Cardiac Care Arch Surg, January 1, 2002; 137(1): 28 - 36. [Abstract] [Full Text] [PDF] |
||||
![]() |
B. K. Nallamothu, S. Saint, S. D. Ramsey, T. P. Hofer, S. Vijan, and K. A. Eagle The role of hospital volume in coronary artery bypass grafting: is more always better? J. Am. Coll. Cardiol., December 1, 2001; 38(7): 1923 - 1930. [Abstract] [Full Text] [PDF] |
||||
![]() |
D. M. Shahian, G. J. Heatley, and G. A. Westcott Relationship of hospital size, case volume, and cost for coronary artery bypass surgery: Analysis of 12,774 patients operated on in Massachusetts during fiscal years 1995 and 1996 J. Thorac. Cardiovasc. Surg., July 1, 2001; 122(1): 53 - 64. [Abstract] [Full Text] [PDF] |
||||
![]() |
B. J. Harlan Statewide reporting of coronary artery surgery results: A view from California J. Thorac. Cardiovasc. Surg., March 1, 2001; 121(3): 409 - 417. [Full Text] [PDF] |
||||
![]() |
R. S. Hartz, A. V. Rao, M. E. Plomondon, F. L. Grover, and A. L. W. Shroyer Effects of race, with or without gender, on operative mortality after coronary artery bypass grafting: a study using The Society of Thoracic Surgeons national database Ann. Thorac. Surg., February 1, 2001; 71(2): 512 - 520. [Abstract] [Full Text] [PDF] |
||||
![]() |
R. A. Dudley, K. L. Johansen, R. Brand, D. J. Rennie, and A. Milstein Selective Referral to High-Volume Hospitals: Estimating Potentially Avoidable Deaths JAMA, March 1, 2000; 283(9): 1159 - 1166. [Abstract] [Full Text] [PDF] |
||||
![]() |
G. L. Early and S. R. Roberts Excellence and low case volume: an example of the inapplicability of volume-based credentialing Ann. Thorac. Surg., January 1, 2000; 69(1): 146 - 150. [Abstract] [Full Text] [PDF] |
||||
![]() |
K. A. Eagle, R. A. Guyton, R. Davidoff, G. A. Ewy, J. Fonger, T. J. Gardner, J. P. Gott, H. C. Herrmann, R. A. Marlow, W. C. Nugent, et al. ACC/AHA guidelines for coronary artery bypass graft surgery: A report of the American College of Cardiology/ American Heart Association task force on Practice Guidelines (Committee to revise the 1991 Guidelines for Coronary Artery Bypass Graft Surgery) J. Am. Coll. Cardiol., October 1, 1999; 34(4): 1262 - 1347. [Full Text] [PDF] |
||||
![]() |
J. H. Burack, P. Impellizzeri, P. Homel, and J. N. Cunningham Jr Public reporting of surgical mortality: a survey of New York State cardiothoracic surgeons Ann. Thorac. Surg., October 1, 1999; 68(4): 1195 - 1200. [Abstract] [Full Text] [PDF] |
||||
![]() |
S. B. Pett Jr, R. E. Clark, A. L. W. Shroyer, B. A. Warner, F. L. Grover, and K. E. Hammermeister Coronary Artery Bypass Grafting Volume and Mortality Ann. Thorac. Surg., September 1, 1996; 62(3): 941 - 943. [Full Text] |
||||
![]() |
F. L. Grover The Bright Future of Cardiothoracic Surgery in the Era of Changing Healthcare Delivery Ann. Thorac. Surg., February 1, 1996; 61(2): 499 - 510. [Abstract] [Full Text] |
||||
![]() |
F. A. Crawford Jr, R. P. Anderson, R. E. Clark, F. L. Grover, N. T. Kouchoukos, J. A. Waldhausen, and B. R. Wilcox Volume Requirements for Cardiac Surgery Credentialing: A Critical Examination Ann. Thorac. Surg., January 1, 1996; 61(1): 12 - 16. [Abstract] [Full Text] |
||||
![]() |
R. E. Clark Outcome as a Function of Annual Coronary Artery Bypass Graft Volume Ann. Thorac. Surg., January 1, 1996; 61(1): 21 - 26. [Abstract] [Full Text] |
||||
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| HOME | HELP | FEEDBACK | SUBSCRIPTIONS | ARCHIVE | SEARCH | TABLE OF CONTENTS |
| ANN THORAC SURG | ASIAN CARDIOVASC THORAC ANN | EUR J CARDIOTHORAC SURG |
| J THORAC CARDIOVASC SURG | ICVTS | ALL CTSNet JOURNALS |