|
|
||||||||
Ann Thorac Surg 2003;76:436-443
© 2003 The Society of Thoracic Surgeons
a Department of Surgery, Catholic Medical Center, Manchester, New Hampshire, USA
b Departments of Medicine, Surgery, and Community and Family Medicine, and The Center For Evaluative Clinical Sciences, Dartmouth-Hitchcock Medical Center, Hanover, New Hampshire, USA
c Department of Surgery, Maine Medical Center, Portland, Maine, USA
d Department of Surgery, Fletcher Allen Health Care, Burlington, Vermont, USA
e Department of Surgery, Eastern Maine Medical Center, Bangor, Maine, USA
Accepted for publication March 10, 2003.
* Address reprint requests to Dr Charlesworth, Catholic Medical Center, 100 McGregor St, Manchester, NH 03102, USA
e-mail: charlesworth{at}nhheart.com
| Abstract |
|---|
|
|
|---|
METHODS: We performed a regional observational study of 33,062 consecutive patients undergoing isolated CABG surgery in northern New England between 1992 and 2001. The regional stroke rate was 1.61% (532 strokes). We developed a preoperative stroke risk prediction model using logistic regression analysis, and validated the model using bootstrap resampling techniques. We assessed the models fit, discrimination, and stability.
RESULTS: The final regression model included the following variables: age, gender, presence of diabetes, presence of vascular disease, renal failure or creatinine greater than or equal to 2 mg/dL, ejection fraction less than 40%, and urgent or emergency. The model significantly predicted (
2 [14 d.f.] = 258.72, p < 0.0001) the occurrence of stroke. The correlation between the observed and expected strokes was 0.99. The risk prediction model discriminated well, with an area under the relative operating characteristic curve of 0.70 (95% CI, 0.67 to 0.72). In addition, the model had acceptable internal validity and stability as seen by bootstrap techniques.
CONCLUSIONS: We developed a robust risk prediction model for stroke using seven readily obtainable preoperative variables. The risk prediction model performs well, and enables a clinician to estimate rapidly and accurately a CABG patients preoperative risk of stroke.
| Introduction |
|---|
|
|
|---|
Case reports and series have documented the association of numerous patient risk factors with the development of perioperative stroke, including: increased patient age, vascular disease, arteriosclerosis, congestive heart failure, diabetes mellitus, prior CABG surgery, and post-operative atrial fibrillation [68]. In addition, research has associated strokes with processes of care, such as prolonged cardiopulmonary bypass [9, 10]. Inferences from these reports are traditionally limited by small sample sizes, which provide unstable estimates of risk of stroke after CABG surgery. In addition, the identification of preoperative risk factors is of limited value without a mechanism to implement it in daily clinical practice.
The Northern New England Cardiovascular Disease Study Group (NNECDSG) is a voluntary research consortium, composed of clinicians, research scientists, and hospital administrators, representing all medical centers in Maine, Vermont, and New Hampshire, and one medical center in Massachusetts where CABG surgery is performed. Since 1987, the NNECDSG has maintained a prospective registry of all patients undergoing cardiac surgery in the region. The group fosters continuous improvement in the quality of care of patients with cardiovascular disease in the region through the pooling of process and outcome data and the timely feedback of data to clinicians.
Outcomes data on 33,062 consecutive isolated CABG procedures performed in this region, from 1992 to 2001, provided an opportunity to identify patient and disease factors associated with stroke, and to develop and validate internally a risk prediction model to estimate the risk of perioperative stroke.
| Patients and methods |
|---|
|
|
|---|
Previous publications by the NNECDSG have discussed in detail our data collection methodology and definitions [11]. In short, we prospectively collected the following preoperative variables: age, gender, diabetes, vascular disease (cerebrovascular disease: prior stroke, prior transient ischemic attack, prior carotid surgery, carotid stenosis or bruit; lower extremity disease: claudication, amputation, prior lower extremity bypass, absent pedal pulses, or lower extremity ulcers), congestive heart failure (this or prior admission), renal failure requiring dialysis, preoperative serum creatinine, treated chronic obstructive pulmonary disease, left main stenosis, preoperative ejection fraction (EF), left ventricular end diastolic pressure (LVEDP), number of diseased coronary arteries, history of cardiac surgery, recent myocardial infarction (< 1 week), and current unstable angina [12]. The cardiothoracic surgeons, using definitions previously described, assessed priority of surgery (elective, urgent, emergency) [11].
We defined a stroke as a new focal neurologic deficit that appears and is still at least partially evident more than 24 hours after its onset, occurring during or after the CABG procedure and established before discharge.
Statistical analysis
To compare the characteristics of patients having a stroke to those free from stroke, we used standard statistical methods (
2 for categorical data and t tests for continuous variables). Multivariate logistic regression was used to explore the association between strokes and potential risk factors and to adjust for potentially confounding variables; it was performed using the STATA 7.0 program (Stata Coroporation, College Station, TX) [13]. The logistic regression model predicts the probability of an event (stroke), conditional on patient and disease characteristics specified by the analyst. Using this logistic regression model, we calculated the predicted risk of stroke for an individual with any combination of demographic or disease characteristics.
We tested our models discrimination via the relative operating characteristic (ROC) curve. The ROC curve graphically represents the relationship between the true-positive rate (ie, the sensitivity of the test) and the false-positive rate (ie, the specificity of the test). A suitable single-valued measure of test accuracy is the area of the graph lying beneath the curve. In a review by Swets of ROC curves, a test with a ROC score of 0.50 "can achieve that performance by chance alone." Such a test has no discrimination, and "the true- and false-positive proportions are equal." A test with a ROC score of 1.0 has perfect discrimination [14].
After development of the multivariate risk prediction model, we calculated each patients predicted risk of stroke, and internally validated the model using bootstrap techniques [15]. We developed the multivariate model on the entire data set, and randomly drew with replacement 200 samples of 100%. We then calculated the ROC curve area for each sample.
A clinical risk assessment tool was developed from the multivariate risk prediction model and was scored by rounding the adjusted odds ratio for each variable (see Fig 5). These weights were then summed. The relationship between this clinical risk score and the probability calculated from the risk prediction model was read from a graph. This risk assessment tool therefore approximates the risk that would have been calculated from the risk prediction model.
|
2 uniquely associated with each factor [16]. | Results |
|---|
|
|
|---|
|
|
|
|
2 [14 d.f.] = 258.72, p < 0.0001) predicted the occurrence of stroke in this data set. This final model was then compared with the full model, which included all variables found significantly associated with stroke in univariate analyses) through the respective ROC curves (full model = 0.71, final model = 0.70). The discrimination did not change appreciably between the models.
|
2 [8 d.f.] = 6.31, p = 0.6129), indicating that there was no statistically significant departure from a perfect fit (Fig 3).
|
The relative importance of each patient and disease characteristic in predicting the risk of perioperative stroke is summarized in Figure 4. We grouped the variables in our model into three categories: patient characteristics, patient presentation, and comorbidities. We calculated the percentage of total explainable preoperative risk for each of these categories. Patient characteristics (age and gender) contributed 52% of the total predictive ability of the model. Comorbidities (diabetes, renal failure, or creatinine greater than or equal to 2 mg/dL, and vascular disease) contributed 32%. Patient presentation (priority of surgery and EF) contributed 16% of the predictive ability of the model.
|
| Comment |
|---|
|
|
|---|
There are a few limitations to this study. Aortic and carotid imaging studies are not performed routinely in our region. This is similar to the experience reported by Mickleborough and colleagues [17]. In our registry, information on carotid disease is combined with other vascular disease. Our definition of vascular disease includes lower extremity, aortic, and carotid disease. We believe that if one were to separate the carotid disease from the lower extremity and aortic disease, this variable would remain an independent predictor of stroke. In data reported by Mickleborough and colleagues, 65% of patients with carotid disease had other manifestations of vascular disease [17].
Birkmeyer and colleagues, in an extensive medical record review of 2,871 consecutive patients discharged alive after CABG surgery, noted that vascular disease is a marker for more systemic arteriosclerosis [18]. He linked this registry information with the National Death Index to examine the long-term mortality risk of vascular disease. He found that those with vascular disease were at a higher risk of mortality than those without vascular disease. In addition, those with multilevel vascular disease had an almost 1.5 times higher odds of death than those without multilevel arteriosclerosis. These findings suggest that a diagnosis of ones vascular disease is sufficient for knowing information regarding a patients carotid disease and extent of lower extremity disease. In our current study, we had information concerning the presence or location of vascular disease for 54% of our patients. Of those with vascular disease, 36.6% had cerebrovascular disease, 29.4% had lower extremity disease, 19.4% had both, and 15% had vascular disease with insufficient information concerning its location. This large overlap between types of vascular disease suggests that our strategy of using a broad definition of vascular disease captures much of the same information contained in carotid imaging studies. These findings are in agreement with work done by Long and colleagues, who quantified the association between peripheral arterial disease and carotid occlusive disease [19]. Long and colleagues found that, among patients who underwent noninvasive testing for peripheral arterial and carotid disease and who did not have surgical interventions on either their leg or carotid arteries, there was a significant correlation between peripheral arterial disease and the number of diseased carotid arteries (> 50% stenosis).
Our data set, though large, was collected from eight medical centers in a single region of the United States. We are confident that our findings are representative of the experience at other centers around the country, as the NNECDSG definition for stroke is quite similar to the definitions used by other large registries, such as the Society for Thoracic Surgeons (STS) [20]. In addition, our rate of stroke is comparable with rates reported by the STS. It was our intent to address some of the limitations in the peer-reviewed literature concerning unstable estimates of preoperative risk factors, by undertaking a multicenter prospective observational study of more than 30,000 consecutive CABG surgeries.
Several other multivariate analyses of risk factors for stroke have been performed. Wareing and colleagues reported on 1,200 consecutive patients more than 50 years of age undergoing CABG surgery [21]. They found an association between perioperative stroke and the following: increasing age, presence of arteriosclerosis of the ascending aorta, and severe carotid artery disease. DAgostino and colleagues reported on 1,835 consecutive patients undergoing isolated CABG, with 42 patients (2.5%) having a perioperative stroke [22]. Multivariate analysis revealed associations between perioperative stroke and postinfarction angina, vascular disease, history of stroke or transient ischemic attack (TIA), duration of cardiopulmonary bypass, aortic arteriosclerosis, use of amrinone or epinephrine, and postoperative atrial fibrillation. Newman and colleagues presented a report of a multicenter preoperative stroke risk index for patients undergoing CABG [1]. Using a systematic sampling interval unlike our consecutive series, they enrolled 2,417 patients at 24 US academic medical centers. The perioperative neurologic complication rate was 3.2% (including major neurologic events, stroke, TIA, or persistent coma). Using logistic regression techniques, they developed a multivariate risk prediction model that included age, unstable angina, history of neurologic disease, prior CABG, diabetes, history of vascular disease, and history of pulmonary disease. This method showed good discrimination (ROC area = 0.78) and was validated using bootstrap techniques. Differences in our model versus the one presented by Newman and colleagues reside in the definition of a neurologic deficit. Newman and colleagues had a higher complication rate due in part to the inclusion of comas and TIAs, whereas we have chosen to include only focal deficits. Although Newman and colleagues did not present 95% confidence limits for their ROC area, we presume that our models ROC (0.70) would be included within that range. Mickelborough and colleagues reported risk factors for stroke among 1,631 CABG patients at a single medical center [17]. Among these, 170 patients were screened for carotid disease. Multivariate analyses revealed vascular disease, carotid artery occlusion, advanced age and history of prior stroke as significant preoperative predictors of perioperative stroke. Roach and colleagues reported results of data on 2,108 patients at 24 US medical institutions [2]. Of these, 3.1% had focal central nervous system injury, stupor, or coma at discharge. Roach and colleagues identified predictors of both type 1 (death due to stroke or encephalopathy, nonfatal stroke, TIA, stupor, or coma before discharge) and type 2 (nonfocal neurologic decline or deficit). Predictors of type 1 deficits were proximal aortic arteriosclerosis, history of neurologic disease, and age. Predictors of type 2 deficits were age, systolic hypertension noted at admission, pulmonary disease, and extreme alcohol consumption. Stamou and colleagues reported results from 16,528 consecutive patients undergoing CABG surgery over 10 years at a single institution. Multivariate analyses included preoperative (chronic renal insufficiency, recent MI, previous stroke, carotid disease, hypertension, diabetes, age > 75 years, EF < 34%) and postoperative (low cardiac output and atrial fibrillation) variables [23]. Because the postoperative variables may have occurred after some of the strokes, the inclusion of these as predictor variables is held in doubt. Discrepancies between our model and Stamou and colleagues may reside in differing definitions for stroke, a single institutions experience, and the use of postoperative variables as predictors of stroke.
Female gender has previously been found significantly associated with neurologic injury secondary to CABG surgery. Hogue and colleagues examined this relationship in The Society of Thoracic Surgery National Cardiac Surgery Database [24]. In this data set, females accounted for 32% of the population. Neurologic outcomes were classified as new permanent global or focal deficits, transient ischemic attacks, or coma. Female gender was associated univariately with a 57% increased risk of neurologic injury (p < 0.001). After adjusting for 22 preoperative risk factors, female gender remained a significant predictor of neurologic injury (OR, 1.22; p < 0.001). Much of the difference in risk may be attributed to the difference in the identified outcome. We predicted the risk of a stroke (rate of 1.6%), whereas Hogue and colleagues predicted the risk of one of three neurologic events (rate of 3.3%) and did not separate out the association between gender and each type of neurologic event.
There is general agreement in the observational literature that increasing age, the presence of arteriosclerosis, and in some studies, the presence of diabetes, are associated with increased risk of perioperative stroke [25]. However, as acute strokes are a contraindication for surgery, processes of clinical care (namely intra- and postoperative factors) in part create perioperative strokes. Possible culprits may include low preoperative hematocrit, duration of cardiopulmonary bypass, the application of the aortic cross clamp, and low cardiac output syndrome. The development and validation of a risk prediction model for stroke provides quantitative knowledge of the associations between patient and disease risk factors and incidence of stroke. This work on preoperative risk factors has paved the way for future work aimed at understanding the effects of processes of clinical care on the incidence of perioperative stroke.
Clinicians may use this model, which uses seven easily obtainable preoperative variables, to link clinical outcomes not only to patient consultations through the framing of discussions, but also to operative care through improvement of surgical outcomes using preoperative patient risk predictions. In our region, surgeons use a pocket-sized risk prediction card (developed out of our preoperative stroke model) (Fig 5) in counseling patients through the accurate preoperative prediction of their risk. Accurate prediction of stroke may be used for studying treatment factors associated with the development of perioperative stroke, and may serve as a benchmark for quality improvement processes locally and nationally.
This study was supported in part by an Individual NRSA Post-Doctoral Fellowship Award (F32 HL68357-01) to DS Likosky.
| References |
|---|
|
|
|---|
This article has been cited by other articles:
![]() |
K. Nishiyama, M. Horiguchi, S. Shizuta, T. Doi, N. Ehara, R. Tanuguchi, Y. Haruna, Y. Nakagawa, Y. Furukawa, M. Fukushima, et al. Temporal Pattern of Strokes After On-Pump and Off-Pump Coronary Artery Bypass Graft Surgery. Ann. Thorac. Surg., June 1, 2009; 87(6): 1839 - 1844. [Abstract] [Full Text] [PDF] |
||||
![]() |
R. C. Groom, R. D. Quinn, P. Lennon, D. J. Donegan, J. H. Braxton, R. S. Kramer, P. W. Weldner, L. Russo, S. D. Blank, A. A. Christie, et al. Detection and Elimination of Microemboli Related to Cardiopulmonary Bypass Circ Cardiovasc Qual Outcomes, May 1, 2009; 2(3): 191 - 198. [Abstract] [Full Text] [PDF] |
||||
![]() |
F. Biancari, O.-P. Kangasniemi, M. AliAsim Mahar, E. Rasinaho, A. Satomaa, V. Tiozzo, M. Niemela, and M. Lepojarvi Changing risk of patients undergoing coronary artery bypass surgery Interactive CardioVascular and Thoracic Surgery, January 1, 2009; 8(1): 40 - 44. [Abstract] [Full Text] [PDF] |
||||
![]() |
F. Biancari, M. A. A. Mahar, M. Mosorin, J. Heikkinen, M. Pokela, P. Taskinen, V. Anttila, J. Lahtinen, and M. Lepojarvi Immediate and Intermediate Outcome After Off-Pump and On-Pump Coronary Artery Bypass Surgery in Patients With Unstable Angina Pectoris Ann. Thorac. Surg., October 1, 2008; 86(4): 1147 - 1152. [Abstract] [Full Text] [PDF] |
||||
![]() |
T. C. Lisle, K. M. Barrett, L. M. Gazoni, B. R. Swenson, C. D. Scott, A. Kazemi, J. A. Kern, B. B. Peeler, I. L. Kron, and K. C. Johnston Timing of Stroke After Cardiopulmonary Bypass Determines Mortality Ann. Thorac. Surg., May 1, 2008; 85(5): 1556 - 1563. [Abstract] [Full Text] [PDF] |
||||
![]() |
G. Silvay, J. G. Castillo, J. Chikwe, B. Flynn, and F. Filsoufi Cardiac Anesthesia and Surgery in Geriatric Patients Seminars in Cardiothoracic and Vascular Anesthesia, March 1, 2008; 12(1): 18 - 28. [Abstract] [PDF] |
||||
![]() |
M. A. Albert, N. Halevy, and E. M. Antman Preoperative Evaluation for Cardiac Surgery Card. Surg. Adult, January 1, 2008; 3(2008): 261 - 280. [Full Text] |
||||
![]() |
A. F. Merry Focus on Thrombin: Alternative Anticoagulants Seminars in Cardiothoracic and Vascular Anesthesia, December 1, 2007; 11(4): 256 - 260. [Abstract] [PDF] |
||||
![]() |
A. C. Anyanwu, F. Filsoufi, S. P. Salzberg, D. J. Bronster, and D. H. Adams Epidemiology of stroke after cardiac surgery in the current era. J. Thorac. Cardiovasc. Surg., November 1, 2007; 134(5): 1121 - 1127. [Abstract] [Full Text] [PDF] |
||||
![]() |
M. Selim Perioperative Stroke N. Engl. J. Med., February 15, 2007; 356(7): 706 - 713. [Full Text] [PDF] |
||||
![]() |
F. Biancari, M. Mosorin, E. Rasinaho, J. Lahtinen, J. Heikkinen, E. Niemela, V. Anttila, M. Lepojarvi, and T. Juvonen Postoperative stroke after off-pump versus on-pump coronary artery bypass surgery J. Thorac. Cardiovasc. Surg., January 1, 2007; 133(1): 169 - 173. [Abstract] [Full Text] [PDF] |
||||
![]() |
Y. Takami and H. Masumoto Brain magnetic resonance angiography-based strategy for stroke reduction in coronary artery bypass grafting Interactive CardioVascular and Thoracic Surgery, August 1, 2006; 5(4): 383 - 386. [Abstract] [Full Text] [PDF] |
||||
![]() |
T. F. Floyd, P. N. Shah, C. C. Price, F. Harris, S. J. Ratcliffe, M. A. Acker, J. E. Bavaria, H. Rahmouni, B. Kuersten, S. Wiegers, et al. Clinically Silent Cerebral Ischemic Events After Cardiac Surgery: Their Incidence, Regional Vascular Occurrence, and Procedural Dependence Ann. Thorac. Surg., June 1, 2006; 81(6): 2160 - 2166. [Abstract] [Full Text] [PDF] |
||||
![]() |
Risk-scoring methods for prediction of postoperative stroke after coronary artery bypass surgery. J. Thorac. Cardiovasc. Surg., March 1, 2006; 131(3): 734 - 735. |
||||
![]() |
G. M. McKhann, M. A. Grega, L. M. Borowicz Jr, W. A. Baumgartner, and O. A. Selnes Stroke and Encephalopathy After Cardiac Surgery: An Update Stroke, February 1, 2006; 37(2): 562 - 571. [Abstract] [Full Text] [PDF] |
||||
![]() |
A. D. Grayson, R. K. Pai, and D. M. Pullan Incidence of Stroke Following Coronary Surgery Without Cardiopulmonary Bypass: Does the Avoidance of Aortic Manipulation Make a Difference? Ann. Thorac. Surg., December 1, 2005; 80(6): 2422 - 2422. [Full Text] [PDF] |
||||
![]() |
A. Budaj, K. Flasinska, J. M. Gore, F. A. Anderson Jr, O. H. Dabbous, F. A. Spencer, R. J. Goldberg, K. A.A. Fox, and for the GRACE Investigators Magnitude of and Risk Factors for In-Hospital and Postdischarge Stroke in Patients With Acute Coronary Syndromes: Findings From a Global Registry of Acute Coronary Events Circulation, June 21, 2005; 111(24): 3242 - 3247. [Abstract] [Full Text] [PDF] |
||||
![]() |
D. S. Likosky, W. C. Nugent, and C. S. Ross Improving Outcomes of Cardiac Surgery Through Cooperative Efforts: The Northern New England Experience Seminars in Cardiothoracic and Vascular Anesthesia, June 1, 2005; 9(2): 119 - 121. [Abstract] [PDF] |
||||
![]() |
L. J. Dacey, D. S. Likosky, B. J. Leavitt, S. J. Lahey, R. D. Quinn, F. Hernandez Jr, H. B. Quinton, J. P. Desimone, C. S. Ross, G. T. O'Connor, et al. Perioperative Stroke and Long-Term Survival After Coronary Bypass Graft Surgery Ann. Thorac. Surg., February 1, 2005; 79(2): 532 - 536. [Abstract] [Full Text] [PDF] |
||||
![]() |
E. I. Kapetanakis, S. C. Stamou, M. K.C. Dullum, P. C. Hill, E. Haile, S. W. Boyce, A. S. Bafi, K. R. Petro, and P. J. Corso The Impact of Aortic Manipulation on Neurologic Outcomes After Coronary Artery Bypass Surgery: A Risk-Adjusted Study Ann. Thorac. Surg., November 1, 2004; 78(5): 1564 - 1571. [Abstract] [Full Text] [PDF] |
||||
![]() |
R C Groom, D S Likosky, R J Forest, G T O'Connor, J R Morton, C S Ross, C Clark, and R Kramer A model for cardiopulmonary bypass redesign Perfusion, July 1, 2004; 19(4): 257 - 261. [Abstract] [PDF] |
||||
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| HOME | HELP | FEEDBACK | SUBSCRIPTIONS | ARCHIVE | SEARCH | TABLE OF CONTENTS |
| ANN THORAC SURG | ASIAN CARDIOVASC THORAC ANN | EUR J CARDIOTHORAC SURG |
| J THORAC CARDIOVASC SURG | ICVTS | ALL CTSNet JOURNALS |