|
|
||||||||
Papworth Hospital NHS Trust and MRC Biostatistics Unit, Institute of Public Health, Cambridge University, Cambridge, United Kingdom
Accepted for publication March 18, 2008.
* Address correspondence to Dr Shuhaiber, 6 Grassmount, Taymount Rise, London, SE 23 3UW, United Kingdom (Email: jeffrey01{at}mac.com).
Presented at the Forty-fourth Annual Meeting of The Society of Thoracic Surgeons, Fort Lauderdale, FL, Jan 28–30, 2008.
| Abstract |
|---|
|
|
|---|
Methods: This observational cohort study analyzed data from cardiac operations between April 1996 and March 2006 at a single institution. In-hospital mortality and other outcomes were compared between operations done during months of major change in resident staff rotation (July, August, January, February, n = 5,517) and the rest of the year (n = 10,773). We also compared outcomes at the beginning and end of surgical rotation for cardiothoracic residents. Adjustment was made for EuroSCORE (European System for Cardiac Operative Risk Evaluation), year of operation, and surgeon resident status. Analyses were done within surgery procedure subgroups of isolated coronary artery bypass graft surgery (CABG) and complex operations (CABG combined with other procedures).
Results: Patient populations in the groups were similar. After risk adjustment, there was a significant increase in hospital mortality for the complex cases during months of resident staff change compared with rest of the year (odds ratio 1.3, 95% confidence interval: 1.3, 1.4; p = 0.02). There was, however, no significant difference in mortality for the CABG only cases (odds ratio 1.1, 95% confidence interval: 0.8, 1.4; p = 0.61). Risk-adjusted mortality after operations done by residents was the same at the start and finish of their surgical rotation. During the change months, the surgery time was 2.2 minutes longer on average in CABG operations (95% confidence interval: 0.3, 4.0; p = 0.02), and no different in combined cases.
Conclusions: Periods of major change in resident surgical staff are associated with increased risk-adjusted in-hospital mortality after complex cardiac operations but not after CABG alone.
| Introduction |
|---|
|
|
|---|
In most teaching institutions in the United Kingdom, January, February, July, and August witness the departure of existing cardiothoracic residents and the arrival of new residents for surgical training. A similar experience occurs during the month of July in the United States as medical students take on the role of junior residents. In surgery, first year general surgery residents have been reportedly associated with worse surgical outcomes in some studies [7, 8] but not all [9, 10]. Furthermore, the beginning and end of a rotation are periods of change as departing resident hand over their experience and patient issues to the incomers. During this period, the continuity of care may be briefly interrupted, patients may be vulnerable, and this may adversely influence surgical outcome. If periods of change of surgical rotation are related to changes in patient care that decrease survival, increased attention to patient care during times of resident turnover would be important. In this study, we examined the influence of cardiothroacic resident turnover and residents starting training on cardiac surgical outcomes for coronary artery bypass graft surgery (CABG) and complex cardiac surgery.
| Material and Methods |
|---|
|
|
|---|
All patient data were compiled prospectively as part of a comprehensive, ongoing audit of cardiac procedures. Catheter-based reinterventions and surgical closure of atrial septal defects were excluded. The status of the operating surgeon as resident or attending surgeon (consultant in the United Kingdom) is recorded. A resident case was defined as a case in which the cardiothoracic resident performed the entire surgical procedure with the consultant surgeon assisting. Cardiothoracic residents performed cases that were selected by the consultant surgeon with whom they were working. In the United Kingdom, residents require at least 6 years of training affiliated with a regional deanery governed by its members and the Royal College of Surgeons. This time period may follow prior nonaccredited training in the same institution or elsewhere with time for research or other clinical activities. The cardiothoracic resident (also called registrar in the United Kingdom) usually spends 6 months or multiples thereof on a rotation before changing rotations. The number of those registrars on the training scheme is relatively small All cases were performed by registrars who were either on or not on the training scheme. These surgeons could have been fellows from overseas, locum registrars (training positions that fill the gap in clinical service and on- call rotation), and those on the training scheme approved by the deanery. Nonetheless, all these cases were done in the direct presence of the consultant surgeon (attending surgeon).
The consultant in charge would have adequately assessed the relative difference in experience of resident in training versus fellow for him or her either before allowing the cardiothoracic resident to assist or perform the cardiac case.
Virtually all rotation changes take place at the end of January and July for cardiothoracic trainees and at the end of February and August for junior noncardiothoracic trainees. The junior trainees are not registrars and do not perform cardiothoracic surgery cases. This subset of doctors was not analyzed in our study. They are considered senior house officers in the English system. The role of these noncardiothroacic trainees is one of second assisting in surgery, harvesting vein, and taking care of patients on the ward. The residents are gradually exposed to increasing levels of responsibility commensurate with their experience. In our study, we only reviewed the cardiothoracic trainees (equivalent to thoracic residents in the United States) and excluded the noncardiothoracic trainees. These cardiothoracic trainees either first assist in surgery or directly operate as surgeon under the direct supervision of the consultant. They take on-call duty as well as help take care of intensive care unit patients under the consultant intensivist direction. The intensive care unit is closed unit under the care of the anesthetic department with patient care provided by the attending cardiothoracic anesthetist, cardiothoracic anesthetist resident, as well cardiothoracic surgery resident. Noncardiothroacic trainees do not participate in the intensive care unit.
The primary outcome of interest was risk-adjusted hospital mortality, which was analyzed separately for two groups: CABG only surgery versus complex cardiac surgery (CABG plus another cardiac procedure or valve, aortic, adult congenital, or arrhythmia surgery). Two analyses were performed. The first analyzed the effect of the biannual change of doctors by designating operations occurring within months during which cardiothoracic residents were changing (January, February, July and August) into one group and operations occurring in other months as the comparison group. The second analysis was for resident-only cases studied in a similar fashion. Within this subset of operations, months when residents commenced training (July and February) were compared with months when residents completed training (June and January). These periods of change are well defined at our institution. Secondary endpoints of interest were intensive care unit length of stay (ICU-LOS), hospital length of stay (LOS), and time in surgery.
Analysis
Continuous variables were reported as mean and standard deviation or median and interquartile range (IQR), while categorical variables were reported as frequencies and proportions. The relationship between change months and variables of interest was examined in a univariate analysis using Student's t, Mann-Whitney U, Pearson
2 tests, or Fisher's exact tests as appropriate.
The relationship between change months and hospital mortality was studied further using multiple logistic regression models. The EuroSCORE (European System for Cardiac Operative Risk Evaluation), year of surgery, and whether or not the operation was performed by a resident were included in models to adjust for presurgery risk, changes over time, and the difference in type of operations performed by cardiothoracic residents. In the case of resident start and finish months, adjustment was made for EuroSCORE and year of surgery. For this analysis among residents only, there was an insufficient number of events to study the CABG and complex surgery groups separately, so mortality was studied for all operations combined.
The relationship between change months and ICU-LOS were examined using general linear models. The natural logarithm of ICU stay and hospital stay in days were used because of the skewed nature of these distributions. Patients who died in ICU were removed from the analysis of ICU-LOS; similarly, patients dying before discharge from hospital were excluded from analysis of LOS. As in the case of hospital mortality, EuroSCORE, year of surgery, and resident status were included in change month models, while EuroSCORE and year of surgery were included in the resident start and finish month models, and separate models were run for the two surgery groups. General linear models with the same adjusting variables were also used to study the relationship between change and training months and surgery time; however, in this case, no transformation was made.
| Results |
|---|
|
|
|---|
|
|
|
|
|
|
|
|
|
| Comment |
|---|
|
|
|---|
In this study, we found that risk-adjusted outcomes of more complex cardiac surgery (such as valve surgery plus CABG) resulted in a 34% increase in the odds of hospital death during periods of change for surgical residents. This suggests that working patterns of cardiac surgical residents has an influence on the mortality of complex cardiac surgical procedures. When working pattern and periods of change were analyzed for the CABG procedure, the outcomes of surgical procedures during periods of change were as good as any other time periods. One potential explanation is that some patients undergoing more complex procedures have more than one surgical or medical problem requiring careful postoperative follow-up and monitoring. This may not always capture the attention of the caring team. The medical vigilance of incoming residents may be still evolving as they adjust to their new rotation, working environment, patient case mix, and style of their instructor. Flux in nurse staffing and other allied health professionals could contribute to these findings as well, although this was not studied here [13, 14]. Seasonal variation in all-cause mortality has been documented to increase during the cold winter seasons, which in part could explain increased mortality during the change months as these included January and February [15, 16]. Acute coronary syndromes peak during the winter season. This may be related to seasonal variation in blood pressure, lipid levels, and changes in the activity of the coagulation cascade or prevalence of infectious pneumonia [17, 18].
The second major outcome of interest was to determine if risk-adjusted hospital mortality differed at the beginning and end of the academic year for residents. Our denominator encompassed all cardiac procedures that were performed by the resident surgeons. We found no differences in hospital mortality, ICU-LOS, or LOS in either surgery group between resident doctor start and finish months.
Our findings are in agreement with previous studies suggesting that resident experience (beginning versus end of rotation) does not make a significant impact on patient outcomes during critical care and trauma surgery training [10, 19]. However, in a recent observational multi-institutional study from the United States on 20,254 patients by Englesbe and colleagues [7] from the University of Michigan Health System, surgical resident experience was a predictor for mortality. Using the National Surgical Quality Improvement Program (NSQIP)–Patient Safety to compare 30-day mortality rates of surgical patients between two periods of care—early group (July 1 to August 30) and late group (April 15 to June 15)—they witnessed a 41% higher risk for mortality in the early group (odds ratio 1.41, CI: 1.11 to 1.80; p = 0.005; c-index 0.938). However, they did not fully control for the urgency of the operation, and the study group encompassed a heterogeneous case mix with all major general surgical as well vascular procedures recruited from 14 academic and 4 community medical centers, which could explain why their results differed from ours.
We further examined the process of individual measures such as surgery time. Time from skin incision to closure of wound was slightly longer in the change months and at the beginning versus the end of training, possibly as a result of relative inexperience or other nonsignificant factors.
This study of more 16,000 patients having cardiac operations at our center, adjusting for the validated EuroSCORE and looking within operation type, revealed no difference in ICU-LOS either during resident period of change nor during start and finish months of the academic year for residents. Our finding was not surprising given that postoperative ICU management is run by fast-track protocols under the direct instruction of the attending intensivist in liaison with attending surgeon. Few prior studies have examined differences in LOS outcomes during different months of the year. In the study by Buchwald and colleagues [20], there was no significant difference in LOS. In contrast, a study by Rich and coworkers [21] showed that LOS decreased as house staff experience increased, and that LOS after surgery actually increased over the academic year. These studies included patients with a number of different diagnoses and factors such as functional status, mental health, social support, and health insurance may have confounded the interpretation of their data with respect to the outcomes observed.
It is possible that the lack of resident experience or optimal instruction could have contributed to our findings, but other system-related processes, attending coverage, nursing staff shifts, as well as team debriefing and in-service introduction need to be examined. The current study does not take into the consideration other measurable or immeasurable factors [22–24] because such variables are not collected prospectively and recorded in our hospital registry. We did not adjust for the number of years in training, as this variable was not readily available. It is possible that some residents had more years than their peers who performed the same risk-adjusted procedure. This may be more important for complex cases as opposed to the CABG.
In recent years, there has been increasing interest in recruiting nonmedically qualified practitioners in surgical care, partly to ensure year-round consistency in knowledge and care [25, 26]. Such staff may help maintain similar process by improving consistency of care during periods of change of residents, in the context of a busy rotation. The role of such surgical assistants at our center is being extended to involve direct patient contact and service with feedback to consultants as well as advice and feedback to junior doctors. Further study will be needed to understand the impact of adding this new group of allied health professionals on surgical outcomes.
Despite our significant findings, our study has limitations. Although the database is comprehensive and data are entered and maintained prospectively, these are not data specifically collected for research and may therefore be subject to entry errors. We do not collect data on variables such as the number of postgraduate years of training for each cardiothoracic residents. However, these residents would have been already assessed by the attending in charge to agree who is able and who is not able to carry out the procedure. It is possible that in relative terms some consultants are willing to teach and train more than others. This means that there may be residual confounding of among the consultants themselves. Furthermore, other potential bias could be incorporated by the differential care of nurse–patient ratios as well as the influence of noncardiothoracic junior trainees. Their impact of the latter group in terms postoperative care on the ward could have an influence bearing a potential confounding risk factor for the final outcome. Other factors such as seasonal variation of staffing protocols, nonmedical allied health care individuals, and level of supervision are also potential confounders.
In conclusion, periods of major change in resident surgical staff are associated with increased risk-adjusted in-hospital mortality after complex cardiac operations but not after CABG alone. This emphasizes the importance of careful patient handover and meticulous monitoring of patients during these periods.
Further research should be conducted in other surgical specialties such as pediatric cardiac surgery and thoracic surgery. This is greatly needed especially as we try to meet the demand of improving surgical outcomes in a challenging educational environment for our future surgeons with reduced working hours and variable apprenticeship.
| Discussion |
|---|
|
|
|---|
DR SHUHAIBER: I agree with you. I think the period of handover is not the main culprit for this. But it is a culprit. And the reason we say that, first of all, we adjusted for all the EuroSCORE variables. And not only that, we also adjusted for the person who is doing the case. We also adjusted for the year of surgery. But other things, for example, like nursing staff patient ratio, working pattern, protocols specific to a particular ICU, could also influence the final outcome. All the patients went to an ICU that was fast-tracked by an intensivist. So we can say that there are quite a few factors that are quite stable at this stage. And when we risk adjust them, even then we found that during the periods of change, residents coming and going, there was a statistically and clinically significant increase in hospital death.
And I can't say that handover is the only mechanism, but it is one that has to come in mind given that we, as surgeons, are always careful and apprehensive when we have new residents coming onto our services. And that's something more like bringing up to the level of awareness and exploration of thought rather than saying, well, this is the only mechanism, at this stage. By such studies we can understand why other non-EuroSCORE or STS-like variable predictors have an external impact even though we cannot measure them precisely at this stage. The area of human factors is difficult to understand but one that we should be aware of constantly. I hope I answered your question.
DR SUNDT: It's certainly important, but I'm still concerned that there may be other kinds of errors. Error is very complex. There may be knowledge-based errors or skill-based errors by the individual that actually have nothing to do with the information transfer. But it's a valid point. Information transfer is a critical element.
DR SHUHAIBER: I agree with you entirely.
DR DARRYL M. HOFFMAN (New York, NY): You could conclude that your study has shown that a well-supervised registrar or resident is an effective effector arm of the consultant supervising him. And I think that's an important point. It perhaps also suggests that you're looking at the wrong metric. Should we be looking at the near misses, which is a lesson we learned from the aviation industry and from other commercial activities, and retrospectively, it's almost impossible to determine those. And perhaps the division of the internal mammary artery by registrar was saved by timely intervention from his consultant.
DR SHUHAIBER: Thank you for your question. I can't really say a lot about near misses. I mean, our endpoints were very defined and discrete. We looked at hospital mortality. I think, to dwell on an area at the beginning, one would like to find out what you're treading onto. And so by finding the statistics and observation that were consistent over a period of 10 years, it was dumbfounding to us and we were very surprised. I think the next step, yes, we would like to look into that. I think one area that Dr Sundt mentioned was very valuable. We could look at cause of death in future research.
| References |
|---|
|
|
|---|
This article has been cited by other articles:
![]() |
F. G. Bakaeen, J. Huh, S. A. LeMaire, J. S. Coselli, S. Sansgiry, P. V. Atluri, and D. Chu The July effect: impact of the beginning of the academic cycle on cardiac surgical outcomes in a cohort of 70,616 patients. Ann. Thorac. Surg., July 1, 2009; 88(1): 70 - 75. [Abstract] [Full Text] [PDF] |
||||
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| HOME | HELP | FEEDBACK | SUBSCRIPTIONS | ARCHIVE | SEARCH | TABLE OF CONTENTS |
| ANN THORAC SURG | ASIAN CARDIOVASC THORAC ANN | EUR J CARDIOTHORAC SURG |
| J THORAC CARDIOVASC SURG | ICVTS | ALL CTSNet JOURNALS |