HOME HELP FEEDBACK SUBSCRIPTIONS ARCHIVE SEARCH TABLE OF CONTENTS		QUICK SEARCH:   [advanced] Author: Keyword(s): Year:  Vol:  Page:

This Article Full Text Full Text (PDF) Alert me when this article is cited Alert me if a correction is posted Citation Map Services Email this article to a friend Similar articles in this journal Similar articles in PubMed Alert me to new issues of the journal Add to Personal Folders Download to citation manager Author home page(s): David M. Shahian Fred H. Edwards Victor A. Ferraris Constance K. Haan Jeffrey B. Rich Cynthia M. Shewan Richard P. Anderson Eric D. Peterson Permission Requests Citing Articles Citing Articles via HighWire Citing Articles via Google Scholar Google Scholar Articles by O’Brien, S. M. Articles by Peterson, E. D. Search for Related Content PubMed PubMed Citation Articles by O’Brien, S. M. Articles by Peterson, E. D. Related Collections Education Professional affairs

Ann Thorac Surg 2007;83:S13-S26
© 2007 The Society of Thoracic Surgeons

---

Report of the STS Quality Measurement Task Force

Quality Measurement in Adult Cardiac Surgery: Part 2—Statistical Considerations in Composite Measure Scoring and Provider Rating

Sean M. O’Brien, PhD^a, David M. Shahian, MD^b,,_*, Elizabeth R. DeLong, PhD^a, Sharon-Lise T. Normand, PhD^c, Fred H. Edwards, MD^d, Victor A. Ferraris, MD^e, Constance K. Haan, MD^d, Jeffrey B. Rich, MD^f, Cynthia M. Shewan, PhD^g, Rachel S. Dokholyan, MPH^a, Richard P. Anderson, MD^h, Eric D. Peterson, MD, MPH^a

^a Duke Clinical Research Institute, Durham, North Carolina
^b Tufts University School of Medicine, Boston, Massachusetts
^c Department of Health Care Policy, Harvard Medical School, and ^cDepartment of Biostatistics, Harvard School of Public Health, Boston, Massachusetts
^d Division of Cardiothoracic Surgery, University of Florida, Jacksonville, Florida
^e Division of Cardiovascular & Thoracic Surgery, University of Kentucky Chandler Medical Center, Lexington, Kentucky
^f Sentara Cardiovascular Research Institute, Norfolk, Virginia
^g The Society of Thoracic Surgeons, Chicago, Illinois
^h The Society of Thoracic Surgeons, Seattle, Washington

Accepted for publication January 12, 2007.

^_* Address correspondence to Dr Shahian, The Society of Thoracic Surgeons, 633 N Saint Clair St, Suite 2320, Chicago, IL 60611 (Email: shahian@comcast.net).

The first 300 words of the full text of this article appear below.

	Executive Summary

 
There is increasing interest among payers, patients, regulators, and providers to measure and compare cardiac surgery quality. The Society of Thoracic Surgeons (STS) Quality Measurement Task Force (QMTF) was established to develop comprehensive, summary performance measures encompassing multiple domains of quality. This report describes statistical considerations relevant to combining multiple measures into an overall composite score and then using such scores to rate providers.

The QMTF evaluated various options for combining 11 National Quality Forum (NQF)–endorsed process and outcome measures, both within and across the four domains of care chosen by the Task Force (Perioperative Medical Care, Operative Care, Risk-Adjusted Operative Mortality, and Postoperative Risk-Adjusted Major Morbidity). These methods included simple or weighted averaging, a composite opportunity model similar to that used by the Centers for Medicare & Medicaid Services (CMS), "all or none" scoring, scaled combinations, and latent variable models. Each method was illustrated using actual 2004 STS data from 133,149 coronary artery bypass procedures. Provider performance was estimated using Bayesian random-effects approaches to account for small sample size and to incorporate risk adjustment for outcomes.

Latent variable modeling failed to provide accurate estimates of provider performance when tested with actual STS data. Most other methods of combining individual measures within a given domain produced similar and consistent estimates of performance (Spearman rank correlations 0.95 to 0.98), and an all or none approach was selected.

Combining scores across domains was accomplished by rescaling and then adding the domain-specific estimates. When this methodology is applied to actual STS data, a one percentage point improvement in mortality has the same impact on the overall composite score as does an 8% improvement in the morbidity rate, an 11% improvement in the frequency of internal mammary artery usage, or a 28% change in the frequency of using all four NQF-recommended medications.

The QMTF . . . [Full Text of this Article]

This article has been cited by other articles:

				J. P. Drozda Jr, E. P. Hagan, M. J. Mirro, E. D. Peterson, and J. S. Wright ACCF 2008 Health Policy Statement on Principles for Public Reporting of Physician Performance Data: A Report of the American College of Cardiology Foundation Writing Committee to Develop Principles for Public Reporting of Physician Performance Data J. Am. Coll. Cardiol., May 20, 2008; 51(20): 1993 - 2001. [Full Text] [PDF]