ATS
HOME HELP FEEDBACK SUBSCRIPTIONS ARCHIVE SEARCH TABLE OF CONTENTS
QUICK SEARCH:   [advanced]


     

This Article
Right arrow Full Text
Right arrow Full Text (PDF)
Right arrow Alert me when this article is cited
Right arrow Alert me if a correction is posted
Right arrow Citation Map
Services
Right arrow Email this article to a friend
Right arrow Similar articles in this journal
Right arrow Similar articles in PubMed
Right arrow Alert me to new issues of the journal
Right arrow Add to Personal Folders
Right arrow Download to citation manager
Right arrow Author home page(s):
David M. Shahian
David F. Torchiana
Richard J. Shemin
James D. Rawn
Right arrow Permission Requests
Citing Articles
Right arrow Citing Articles via HighWire
Right arrow Citing Articles via Google Scholar
Google Scholar
Right arrow Articles by Shahian, D. M.
Right arrow Articles by Normand, S.-L. T.
Right arrow Search for Related Content
PubMed
Right arrow PubMed Citation
Right arrow Articles by Shahian, D. M.
Right arrow Articles by Normand, S.-L. T.
Related Collections
Right arrow Professional affairs

Ann Thorac Surg 2005;80:2106-2113
© 2005 The Society of Thoracic Surgeons

Original article: Cardiovascular

Massachusetts Cardiac Surgery Report Card: Implications of Statistical Methodology

David M. Shahian, MD a , * , David F. Torchiana, MD b , Richard J. Shemin, MD c , James D. Rawn, MD d , Sharon-Lise T. Normand, PhD e

a Department of Surgery, Caritas St. Elizabeth's Medical Center, Boston, Massachusetts
b Department of Cardiac Surgery, Massachusetts General Hospital, Boston, Massachusetts
c Department of Cardiac Surgery, Boston University Medical Center, Boston, Massachusetts
d Division of Cardiac Surgery, Brigham and Women's Hospital, Boston, Massachusetts
e Department of Health Care Policy, Harvard Medical School, and Department of Biostatistics, Harvard School of Public Health, Boston, Massachusetts

Accepted for publication June 28, 2005.

* Address correspondence to Dr Shahian, Department of Surgery, Caritas St. Elizabeth's Medical Center, 736 Cambridge St, Boston, MA 02135 (Email: david.shahian{at}caritaschristi.org).

BACKGROUND: Choice of statistical methodology may significantly impact the results of provider profiling, including cardiac surgery report cards. Because of sample size and clustering issues, logistic regression may overestimate systematic interprovider variability, leading to false outlier classification. Theoretically, the use of hierarchical models should result in more accurate representation of provider performance.

METHODS: Extensively validated and audited data were available for all 4,603 isolated coronary artery bypass grafting procedures performed at 13 Massachusetts hospitals during 2002. To produce the official Massachusetts cardiac surgery report card, a 19-variable predictor set and a hierarchical generalized linear model were employed. For the current study, this same analysis was repeated with the 14 predictors used in the New York Cardiac Surgery Reporting System. Two additional analyses were conducted using each set of predictor variables and applying standard logistic regression. For each of the four combinations of predictors and models, the point estimates of risk-adjusted 30-day mortality, 95% confidence or probability intervals, and outlier status were determined for each hospital.

RESULTS: Overall unadjusted mortality for coronary bypass operations was 2.19%. For most hospitals, there was wide variability in the point estimates and confidence or probability intervals of risk-adjusted mortality depending on statistical model, but little variability relative to the choice of predictors. There were no hospital outliers using hierarchical models, but there was one outlier using logistic regression with either predictor set.

CONCLUSIONS: When used to compare provider performance, logistic regression increases the possibility of false outlier classification. The use of hierarchical models is recommended.




This article has been cited by other articles:


Home page
 JAMAHome page
D. A. Asch, S. Nicholson, S. Srinivas, J. Herrin, and A. J. Epstein
Evaluating Obstetrical Residency Programs Using Patient Outcomes
JAMA, September 23, 2009; 302(12): 1277 - 1283.
[Abstract] [Full Text] [PDF]

Home page
 SEMIN CARDIOTHORAC VASC ANESTHHome page
A. A. Kramer and J. E. Zimmerman
Predicting Outcomes for Cardiac Surgery Patients After Intensive Care Unit Admission
Seminars in Cardiothoracic and Vascular Anesthesia, September 1, 2008; 12(3): 175 - 183.
[Abstract] [PDF]

Home page
 J. Thorac. Cardiovasc. Surg.Home page
D. M. Shahian and S.-L. T. Normand
Low-volume coronary artery bypass surgery: Measuring and optimizing performance.
J. Thorac. Cardiovasc. Surg., June 1, 2008; 135(6): 1202 - 1209.
[Full Text] [PDF]

Home page
 CirculationHome page
D. M. Shahian and S.-L. T. Normand
Comparison of "Risk-Adjusted" Hospital Outcomes
Circulation, April 15, 2008; 117(15): 1955 - 1963.
[Abstract] [Full Text] [PDF]

Home page
 Card Surg AdultHome page
V. A. Ferraris, F. H. Edwards, D. M. Shahian, and S. P. Ferraris
Risk Stratification and Comorbidity
Card. Surg. Adult, January 1, 2008; 3(2008): 199 - 246.
[Full Text]

Home page
 CirculationHome page
G. J. Stukenborg, D. P. Wagner, F. E. Harrell Jr, M. N. Oliver, S. W. Heim, A. L. Price, C. K. Han, A. M. D. Wolf, and A. F. Connors Jr
Which Hospitals Have Significantly Better or Worse Than Expected Mortality Rates for Acute Myocardial Infarction Patients?: Improved Risk Adjustment With Present-at-Admission Diagnoses
Circulation, December 18, 2007; 116(25): 2960 - 2968.
[Abstract] [Full Text] [PDF]

Home page
 BMJHome page
S. Westaby, N. Archer, N. Manning, S. Adwani, C. Grebenik, O. Ormerod, R. Pillai, and N. Wilson
Comparison of hospital episode statistics and central cardiac audit database in public reporting of congenital heart surgery mortality
BMJ, October 13, 2007; 335(7623): 759 - 759.
[Abstract] [Full Text] [PDF]

Home page
 CirculationHome page
J. A. Suaya, D. S. Shepard, S.-L. T. Normand, P. A. Ades, J. Prottas, and W. B. Stason
Use of Cardiac Rehabilitation by Medicare Beneficiaries After Myocardial Infarction or Coronary Bypass Surgery
Circulation, October 9, 2007; 116(15): 1653 - 1662.
[Abstract] [Full Text] [PDF]

Home page
 Arch SurgHome page
E. H. Livingston, A. C. Elliott, L. S. Hynan, and E. Engel
When Policy Meets Statistics: The Very Real Effect That Questionable Statistical Analysis Has on Limiting Health Care Access for Bariatric Surgery
Arch Surg, October 1, 2007; 142(10): 979 - 987.
[Abstract] [Full Text] [PDF]

Home page
 CirculationHome page
D. M. Shahian, T. Silverstein, A. F. Lovett, R. E. Wolf, and S.-L. T. Normand
Comparison of Clinical and Administrative Data Sources for Hospital Coronary Artery Bypass Graft Surgery Report Cards
Circulation, March 27, 2007; 115(12): 1518 - 1527.
[Abstract] [Full Text] [PDF]

Home page
 CirculationHome page
H. M. Krumholz, Y. Wang, J. A. Mattera, Y. Wang, L. F. Han, M. J. Ingber, S. Roman, and S.-L. T. Normand
An Administrative Claims Model Suitable for Profiling Hospital Performance Based on 30-Day Mortality Rates Among Patients With an Acute Myocardial Infarction
Circulation, April 4, 2006; 113(13): 1683 - 1692.
[Abstract] [Full Text] [PDF]

Home page
 CirculationHome page
H. M. Krumholz, Y. Wang, J. A. Mattera, Y. Wang, L. F. Han, M. J. Ingber, S. Roman, and S.-L. T. Normand
An Administrative Claims Model Suitable for Profiling Hospital Performance Based on 30-Day Mortality Rates Among Patients With Heart Failure
Circulation, April 4, 2006; 113(13): 1693 - 1701.
[Abstract] [Full Text] [PDF]


HOME HELP FEEDBACK SUBSCRIPTIONS ARCHIVE SEARCH TABLE OF CONTENTS
ANN THORAC SURG ASIAN CARDIOVASC THORAC ANN EUR J CARDIOTHORAC SURG
J THORAC CARDIOVASC SURG ICVTS ALL CTSNet JOURNALS
Copyright © 2005 by The Society of Thoracic Surgeons.