ATS
HOME HELP FEEDBACK SUBSCRIPTIONS ARCHIVE SEARCH TABLE OF CONTENTS
 QUICK SEARCH:   [advanced]


     


Ann Thorac Surg 2009;87:587-588. doi:10.1016/j.athoracsur.2008.12.001
© 2009 The Society of Thoracic Surgeons

This Article
Right arrow Full Text (PDF)
Right arrow Alert me when this article is cited
Right arrow Alert me if a correction is posted
Right arrow Citation Map
Services
Right arrow Email this article to a friend
Right arrow Similar articles in this journal
Right arrow Similar articles in PubMed
Right arrow Alert me to new issues of the journal
Right arrow Add to Personal Folders
Right arrow Download to citation manager
Right arrow Author home page(s):
Jeffrey Phillip Jacobs
David M. Shahian
Marshall L. Jacobs
Constantine Mavroudis
Right arrow Permission Requests
Citing Articles
Right arrow Citing Articles via HighWire
Right arrow Citing Articles via Google Scholar
Google Scholar
Right arrow Articles by Jacobs, J. P.
Right arrow Articles by Mavroudis, C.
Right arrow Search for Related Content
PubMed
Right arrow PubMed Citation
Right arrow Articles by Jacobs, J. P.
Right arrow Articles by Mavroudis, C.
Related Collections
Right arrow Congenital - cyanotic
Right arrowRelated Article


Original Articles: Pediatric Cardiac

Invited Commentary

Jeffrey Phillip Jacobs, MDa, David M. Shahian, MDb, Marshall L. Jacobs, MDc, Constantine Mavroudis, MDd

a Cardiac Surgery, The Congenital Heart Institute of Florida (CHIF), Cardiac Surgical Associates of Florida (CSAOF), All Children's Hospital and Children's Hospital of Tampa, 603 7th St S, Ste 450, St. Petersburg, FL 33701
b Department of Surgery, Massachusetts General Hospital, Boston, Massachusetts
c Cardiothoracic Surgery, Drexel University College of Medicine, Newtown Square, Pennsylvania
d Pediatric and Congenital Heart Surgery, Cleveland Clinic Lerner College of Medicine, Case Western Reserve University, Cleveland, Ohio

(Email: jeffjacobs{at}msn.com).

The report by Tsang and associates in this issue of The Annals of Thoracic Surgery is another important contribution to surgical performance monitoring by a group whose senior member introduced the concept of cumulative sum (CUSUM) charts into cardiothoracic surgery in 1994 [1]. This resulted in the early identification of a suboptimal trend of performance in arterial switch surgery, and appropriate modifications in technique and management were successfully instituted [2].

Monitoring of performance in pediatric cardiac surgery has historically been challenged by two issues: the large number of unique operative procedures mandated by the diverse spectrum of congenital cardiac malformations, and the relatively small numbers of any particular operation at any given hospital. As a result, development of risk adjustment strategies has been more challenging than in adult cardiac surgery, where coronary artery bypass grafting (CABG) and valve operations are useful index procedures that are performed frequently, validating their use as indicators of performance.

The challenge of true risk modeling in pediatric heart surgery gave rise to the development of systems that stratified operative procedures by complexity, based in part on subjective expert opinion (the Risk Adjustment in Congenital Heart Surgery-1 system and the Aristotle Complexity Score). As the Society of Thoracic Surgeons (STS) and the European Association for Cardio-Thoracic Surgery (EACTS) Congenital Heart Surgery Databases during the last decade have catalogued the outcomes of more than 150,000 operations, the subjective element of these tools is about to be supplanted by true risk modeling based on empirical data.

Still, in pediatric cardiac surgery, even when aggregating data for several years, case numbers for most operations may be inadequate to discriminate among good, bad, and average providers with any degree of statistical certainty. This problem of "small numbers" was elegantly illustrated by Dimick and associates [3]. Among relatively common, complex surgical procedures, including pediatric cardiac surgery, only CABG was performed with sufficient frequency at most hospitals to detect a doubling of the mortality rate using 3-year aggregate data. This problem of small numbers was also the basis for the funnel plot, as described by Spiegelhalter [4], which plots the rates of mortality of institutions or surgeons on a graph in conjunction with 95% and 99% binomial confidence intervals centered around the average population mortality. This graphic technique, adopted in 2008 for use in the Reports of the STS Congenital Database, explicitly demonstrates the substantial random sampling variation that occurs at low volumes and the difficulty in distinguishing levels of performance. As a consequence, low volume surgeons or institutions are protected from inappropriate conclusions about their data.

To monitor performance and to demonstrate definitive differences among providers of rare services such as congenital heart surgery, rates of mortality may have to be collected for many years. The requirement of several years' aggregate data means that any risk model must periodically be recalibrated to avoid obsolescence as quality improvement occurs [5]. As an alternative to such batch processing, deLeval and colleagues applied to congenital heart surgery the concept of CUSUM charts, which had initially been used for industrial quality control. This form of sequential, real-time monitoring of cumulative performance has had multiple iterations, including the Variable Life Adjusted Display (VLAD) used here by Tsang and associates. These authors have further advanced the concept of using CUSUM methodology to monitor the results of pediatric heart surgery. And in the same exercise they have reinforced the importance of regular periodic recalibration of any predictive risk model.


    References
 Top
 References
 

  1. Tsang VT, Brown KL, Synnergren MJ, et al. Monitoring risk-adjusted outcomes in congenital heart surgery: does the appropriateness of a risk model change with time? Ann Thorac Surg 2009;87:584-588.[Abstract/Free Full Text]
  2. de Leval MR, Francois K, Bull C, Brawn W, Spiegelhalter D. Analysis of a cluster of surgical failures. Application to a series of neonatal arterial switch operations. J Thorac Cardiovasc Surg 1994;107:914-923.[Abstract/Free Full Text]
  3. Dimick JB, Welch HG, Birkmeyer JD. Surgical mortality as an indicator of hospital quality: the problem with small sample size JAMA 2004;292:847-851.[Abstract/Free Full Text]
  4. Spiegelhalter DJ. Funnel plots for comparing institutional performance Stat Med 2005;24:1185-1202.[Medline]
  5. Ivanov J, Tu JV, Naylor CD. Ready-made, recalibrated, or remodeled?. Issues in the use of risk indexes for assessing mortality after coronary artery bypass graft surgery. Circulation 1999;99:2098-2104.[Abstract/Free Full Text]

Related Article

Monitoring Risk-Adjusted Outcomes in Congenital Heart Surgery: Does the Appropriateness of a Risk Model Change With Time?
Victor T. Tsang, Katherine L. Brown, Mats Johanssen Synnergren, Nicholas Kang, Marc R. de Leval, Steve Gallivan, and Martin Utley
Ann. Thorac. Surg. 2009 87: 584-587. [Abstract] [Full Text] [PDF]



This article has been cited by other articles:


Home page
World Journal for Pediatric and Congenital Heart SurgeryHome page
J. M. Giroud, J. P. Jacobs, D. Spicer, C. Backer, G. R. Martin, R. C. G. Franklin, M. J. Beland, O. N. Krogmann, V. D. Aiello, S. D. Colan, et al.
Report From The International Society for Nomenclature of Paediatric and Congenital Heart Disease: Creation of a Visual Encyclopedia Illustrating the Terms and Definitions of the International Pediatric and Congenital Cardiac Code
World Journal for Pediatric and Congenital Heart Surgery, October 1, 2010; 1(3): 300 - 313.
[Abstract] [Full Text] [PDF]


This Article
Right arrow Full Text (PDF)
Right arrow Alert me when this article is cited
Right arrow Alert me if a correction is posted
Right arrow Citation Map
Services
Right arrow Email this article to a friend
Right arrow Similar articles in this journal
Right arrow Similar articles in PubMed
Right arrow Alert me to new issues of the journal
Right arrow Add to Personal Folders
Right arrow Download to citation manager
Right arrow Author home page(s):
Jeffrey Phillip Jacobs
David M. Shahian
Marshall L. Jacobs
Constantine Mavroudis
Right arrow Permission Requests
Citing Articles
Right arrow Citing Articles via HighWire
Right arrow Citing Articles via Google Scholar
Google Scholar
Right arrow Articles by Jacobs, J. P.
Right arrow Articles by Mavroudis, C.
Right arrow Search for Related Content
PubMed
Right arrow PubMed Citation
Right arrow Articles by Jacobs, J. P.
Right arrow Articles by Mavroudis, C.
Related Collections
Right arrow Congenital - cyanotic
Right arrowRelated Article


HOME HELP FEEDBACK SUBSCRIPTIONS ARCHIVE SEARCH TABLE OF CONTENTS
ANN THORAC SURG ASIAN CARDIOVASC THORAC ANN EUR J CARDIOTHORAC SURG
J THORAC CARDIOVASC SURG ICVTS ALL CTSNet JOURNALS