|
|
||||||||
Ann Thorac Surg 2005;80:2106-2113
© 2005 The Society of Thoracic Surgeons
a Department of Surgery, Caritas St. Elizabeth's Medical Center, Boston, Massachusetts
b Department of Cardiac Surgery, Massachusetts General Hospital, Boston, Massachusetts
c Department of Cardiac Surgery, Boston University Medical Center, Boston, Massachusetts
d Division of Cardiac Surgery, Brigham and Women's Hospital, Boston, Massachusetts
e Department of Health Care Policy, Harvard Medical School, and Department of Biostatistics, Harvard School of Public Health, Boston, Massachusetts
Accepted for publication June 28, 2005.
* Address correspondence to Dr Shahian, Department of Surgery, Caritas St. Elizabeth's Medical Center, 736 Cambridge St, Boston, MA 02135 (Email: david.shahian{at}caritaschristi.org).
BACKGROUND: Choice of statistical methodology may significantly impact the results of provider profiling, including cardiac surgery report cards. Because of sample size and clustering issues, logistic regression may overestimate systematic interprovider variability, leading to false outlier classification. Theoretically, the use of hierarchical models should result in more accurate representation of provider performance.
METHODS: Extensively validated and audited data were available for all 4,603 isolated coronary artery bypass grafting procedures performed at 13 Massachusetts hospitals during 2002. To produce the official Massachusetts cardiac surgery report card, a 19-variable predictor set and a hierarchical generalized linear model were employed. For the current study, this same analysis was repeated with the 14 predictors used in the New York Cardiac Surgery Reporting System. Two additional analyses were conducted using each set of predictor variables and applying standard logistic regression. For each of the four combinations of predictors and models, the point estimates of risk-adjusted 30-day mortality, 95% confidence or probability intervals, and outlier status were determined for each hospital.
RESULTS: Overall unadjusted mortality for coronary bypass operations was 2.19%. For most hospitals, there was wide variability in the point estimates and confidence or probability intervals of risk-adjusted mortality depending on statistical model, but little variability relative to the choice of predictors. There were no hospital outliers using hierarchical models, but there was one outlier using logistic regression with either predictor set.
CONCLUSIONS: When used to compare provider performance, logistic regression increases the possibility of false outlier classification. The use of hierarchical models is recommended.
This article has been cited by other articles:
![]() |
D. M. Shahian, F. H. Edwards, J. P. Jacobs, R. L. Prager, S.-L. T. Normand, C. M. Shewan, S. M. O'Brien, E. D. Peterson, and F. L. Grover Public reporting of cardiac surgery performance: part 2-implementation. Ann. Thorac. Surg., September 1, 2011; 92(3 Suppl): S12 - S23. [Abstract] [Full Text] [PDF] |
||||
![]() |
T. Trauer The Public Reporting of Organizational Performance in Mental Health: Coming Soon to a Mental Health Service Near You Australian and New Zealand Journal of Psychiatry, June 1, 2011; 45(6): 432 - 443. [Full Text] [PDF] |
||||
![]() |
H. C. Lee, A. T. Chien, N. S. Bardach, T. Clay, J. B. Gould, and R. A. Dudley The Impact of Statistical Choices on Neonatal Intensive Care Unit Quality Ratings Based on Nosocomial Infection Rates Arch Pediatr Adolesc Med, May 1, 2011; 165(5): 429 - 434. [Abstract] [Full Text] [PDF] |
||||
![]() |
P. Cram, X. Lu, P. J. Kaboli, M. S. Vaughan-Sarrazin, X. Cai, B. R. Wolf, and Y. Li Clinical Characteristics and Outcomes of Medicare Patients Undergoing Total Hip Arthroplasty, 1991-2008 JAMA, April 20, 2011; 305(15): 1560 - 1567. [Abstract] [Full Text] [PDF] |
||||
![]() |
F. S. Resnic, S.-L. T. Normand, T. C. Piemonte, S. J. Shubrooks, K. Zelevinsky, A. Lovett, and K. K. L. Ho Improvement in Mortality Risk Prediction After Percutaneous Coronary Intervention Through the Addition of a "Compassionate Use" Variable to the National Cardiovascular Data Registry CathPCI Dataset: A Study From the Massachusetts Angioplasty Registry J. Am. Coll. Cardiol., February 22, 2011; 57(8): 904 - 911. [Abstract] [Full Text] [PDF] |
||||
![]() |
D. L. Brown Measuring Outcomes of Coronary Artery Bypass Surgery: What Is Important and to Whom? Arch Intern Med, July 26, 2010; 170(14): 1189 - 1190. [Full Text] [PDF] |
||||
![]() |
J. Chen, H. M. Krumholz, Y. Wang, J. P. Curtis, S. S. Rathore, J. S. Ross, S.-L. T. Normand, G. C. Schreiner, G. Mulvey, and B. K. Nallamothu Differences in Patient Survival After Acute Myocardial Infarction by Hospital Capability of Performing Percutaneous Coronary Intervention: Implications for Regionalization Arch Intern Med, March 8, 2010; 170(5): 433 - 439. [Abstract] [Full Text] [PDF] |
||||
![]() |
H.F. Lingsma, E.W. Steyerberg, M.J.C. Eijkemans, D.W.J. Dippel, W.J.M. Scholte Op Reimer, H.C. Van Houwelingen, and The Netherlands Stroke Survey Investigators Comparing and ranking hospitals based on outcome: results from The Netherlands Stroke Survey QJM, February 1, 2010; 103(2): 99 - 108. [Abstract] [Full Text] [PDF] |
||||
![]() |
M. D. Howell A 37-Year-Old Man Trying to Choose a High-Quality Hospital: Review of Hospital Quality Indicators JAMA, December 2, 2009; 302(21): 2353 - 2360. [Abstract] [Full Text] [PDF] |
||||
![]() |
D. A. Asch, S. Nicholson, S. Srinivas, J. Herrin, and A. J. Epstein Evaluating Obstetrical Residency Programs Using Patient Outcomes JAMA, September 23, 2009; 302(12): 1277 - 1283. [Abstract] [Full Text] [PDF] |
||||
![]() |
A. A. Kramer and J. E. Zimmerman Predicting Outcomes for Cardiac Surgery Patients After Intensive Care Unit Admission Seminars in Cardiothoracic and Vascular Anesthesia, September 1, 2008; 12(3): 175 - 183. [Abstract] [PDF] |
||||
![]() |
D. M. Shahian and S.-L. T. Normand Low-volume coronary artery bypass surgery: Measuring and optimizing performance. J. Thorac. Cardiovasc. Surg., June 1, 2008; 135(6): 1202 - 1209. [Full Text] [PDF] |
||||
![]() |
D. M. Shahian and S.-L. T. Normand Comparison of "Risk-Adjusted" Hospital Outcomes Circulation, April 15, 2008; 117(15): 1955 - 1963. [Abstract] [Full Text] [PDF] |
||||
![]() |
V. A. Ferraris, F. H. Edwards, D. M. Shahian, and S. P. Ferraris Risk Stratification and Comorbidity Card. Surg. Adult, January 1, 2008; 3(2008): 199 - 246. [Full Text] |
||||
![]() |
G. J. Stukenborg, D. P. Wagner, F. E. Harrell Jr, M. N. Oliver, S. W. Heim, A. L. Price, C. K. Han, A. M. D. Wolf, and A. F. Connors Jr Which Hospitals Have Significantly Better or Worse Than Expected Mortality Rates for Acute Myocardial Infarction Patients?: Improved Risk Adjustment With Present-at-Admission Diagnoses Circulation, December 18, 2007; 116(25): 2960 - 2968. [Abstract] [Full Text] [PDF] |
||||
![]() |
S. Westaby, N. Archer, N. Manning, S. Adwani, C. Grebenik, O. Ormerod, R. Pillai, and N. Wilson Comparison of hospital episode statistics and central cardiac audit database in public reporting of congenital heart surgery mortality BMJ, October 13, 2007; 335(7623): 759 - 759. [Abstract] [Full Text] [PDF] |
||||
![]() |
J. A. Suaya, D. S. Shepard, S.-L. T. Normand, P. A. Ades, J. Prottas, and W. B. Stason Use of Cardiac Rehabilitation by Medicare Beneficiaries After Myocardial Infarction or Coronary Bypass Surgery Circulation, October 9, 2007; 116(15): 1653 - 1662. [Abstract] [Full Text] [PDF] |
||||
![]() |
E. H. Livingston, A. C. Elliott, L. S. Hynan, and E. Engel When Policy Meets Statistics: The Very Real Effect That Questionable Statistical Analysis Has on Limiting Health Care Access for Bariatric Surgery Arch Surg, October 1, 2007; 142(10): 979 - 987. [Abstract] [Full Text] [PDF] |
||||
![]() |
D. M. Shahian, T. Silverstein, A. F. Lovett, R. E. Wolf, and S.-L. T. Normand Comparison of Clinical and Administrative Data Sources for Hospital Coronary Artery Bypass Graft Surgery Report Cards Circulation, March 27, 2007; 115(12): 1518 - 1527. [Abstract] [Full Text] [PDF] |
||||
![]() |
H. M. Krumholz, Y. Wang, J. A. Mattera, Y. Wang, L. F. Han, M. J. Ingber, S. Roman, and S.-L. T. Normand An Administrative Claims Model Suitable for Profiling Hospital Performance Based on 30-Day Mortality Rates Among Patients With an Acute Myocardial Infarction Circulation, April 4, 2006; 113(13): 1683 - 1692. [Abstract] [Full Text] [PDF] |
||||
![]() |
H. M. Krumholz, Y. Wang, J. A. Mattera, Y. Wang, L. F. Han, M. J. Ingber, S. Roman, and S.-L. T. Normand An Administrative Claims Model Suitable for Profiling Hospital Performance Based on 30-Day Mortality Rates Among Patients With Heart Failure Circulation, April 4, 2006; 113(13): 1693 - 1701. [Abstract] [Full Text] [PDF] |
||||
| HOME | HELP | FEEDBACK | SUBSCRIPTIONS | ARCHIVE | SEARCH | TABLE OF CONTENTS |
| ANN THORAC SURG | ASIAN CARDIOVASC THORAC ANN | EUR J CARDIOTHORAC SURG |
| J THORAC CARDIOVASC SURG | ICVTS | ALL CTSNet JOURNALS |