|
|
||||||||
Ann Thorac Surg 2004;78:287-291
© 2004 The Society of Thoracic Surgeons
a Division of Cardiothoracic Surgery, Chicago, Illinois, USA
b Northwestern Institute for Minimally Invasive Surgery and Technology, Chicago, Illinois, USA
c Department of Surgery, Northwestern Memorial Hospital, Chicago, Illinois, USA
Accepted for publication November 25, 2003.
* Address reprint requests to Dr Blum, 201 E Huron St, Chicago, IL 60611, USA
e-mail: mblum{at}nmh.org
Presented at the Thirty-ninth Annual Meeting of The Society of Thoracic Surgeons, San Diego, CA, Jan 31Feb 2, 2003.
| Abstract |
|---|
|
|
|---|
METHODS: Three groups of surgical residents were evaluated while performing an intraoperative flexible bronchoscopy. First year (PGY1) residents were randomly assigned to perform bronchoscopy either with (n = 5) or without (n = 5) preprocedural bronchoscopic simulator training (PreOp flexible bronchoscopic simulator, Immersion Medical, Gaithersburg, MD). Residents PGY2 to 3 (n = 3) with prior bronchoscopic experience (
10 bronchoscopies) underwent evaluation without simulator training. Subjects were required to complete a systematic airway examination through a laryngeal mask airway with patients under general anesthesia. Evaluation criteria included procedure time, number of verbal and physical interventions by evaluator, and a rating of exam thoroughness, proficiency, and confidence.
RESULTS: The PGY1 subjects who trained on the simulator required significantly fewer verbal (6.2 ± 1.6 vs 3.2 ± 0.8) and physical (1.6 ± 0.2 vs 0.2 ± 0.4) cues and performed more systematic examinations (2.6 ± 0.5 vs 4.4 ± 0.9 on scale 1 to 5) than those who did not use the trainer. The skill level of PGY1 subjects who worked with the simulator was similar to that of PGY2 to 3 residents experienced in bronchoscopy. Procedural times were not different between groups as the evaluator maintained the pace of the examination using verbal and physical assistance.
CONCLUSIONS: One hour of training with the bronchoscopic simulator effectively taught residents basic bronchoscopy and familiarity with airway anatomy. Residents using the trainer performed first-time bronchoscopy nearly as competently as residents experienced with bronchoscopy.
| Introduction |
|---|
|
|
|---|
Greater sophistication and realism in computer simulation has resulted in simulators that can be meaningfully integrated into skills training [1]. Currently available technology can accurately simulate bronchoscopy on a conscious patient with basic airway pathology allowing trainees to gain meaningful experience that can be translated to the clinical setting. Guidelines for conducting competent bronchoscopy training have been published [2]. Many of these objectives are taught using the PreOp flexible bronchoscopic simulator (Immersion Medical, Gaithersburg, MD). Colt and colleagues [3] reported on their experience training five pulmonary-critical care residents using the Pre-Op endoscopy simulator. After a total of eight hours of training, the previously inexperienced group performed technically as well as board certified or eligible pulmonologists with more than 200 bronchoscopies each. Simulator training also improved proficiency of anesthesiology residents in conducting fiberoptic intubations [4].
Bronchoscopy skills needed by the junior surgical resident are different than those of pulmonologists and rarely involve fiberoptic intubation. Typical general surgical applications of the bronchoscope include assessing the main airways for traumatic disruption and toilet bronchoscopy for secretion management. Training for general surgeons should primarily emphasize bronchoscope control and normal lobar anatomy. Identifying subsegmental bronchial anatomy and unusual pathology are of secondary importance. This study was designed to determine how well a bronchoscopic training device could teach basic bronchoscopic skills.
| Material and methods |
|---|
|
|
|---|
All PGY 1 residents went to the Northwestern Institute for Minimally Invasive Surgery and Technology (NIMIST) skills laboratory. They were instructed on the design of the study and randomized to the study group (trained) or PGY1 control group (naïve). The study group underwent instruction and training on the bronchoscopic simulator (PreOp flexible bronchoscopic simulator, Immersion Medical, Gaithersburg, MD) (Fig 1) while the naïve group received no simulator training. Randomization and simulator instructions were given by the technician in the NIMIST. The surgeon who evaluated the residents during the intraoperative bronchoscopy was blinded to the results of randomization.
|
Simulator training
The bronchoscopy simulator includes a computer with a monitor, software, a realistic proxy bronchoscope (connected to the computer) (Fig 2)
, and a patient simulator interface with a mounted faceplate. The faceplate is designed to simulate inserting the bronchoscope device into the nasal passage and airways. Realistic bronchoscope motions (tip flexion and extension, rotation of the bronchoscope, and depth of bronchoscope advancement) simulate the experience of an actual fiberoptic bronchoscopy. Sensors in the patient simulator detect the position of the bronchoscope tip and relay the information to the computer. The computer generates a real-time virtual image of the appropriate airway anatomy. Buttons on the bronchoscope device can be pressed to simulate suction and capture images of anatomy and pathology. A foot pedal can be depressed to simulate administration of lidocaine for maintenance of airway anesthesia and saline solution for washing.
|
Software programs for the simulator include an interactive anatomy model with video clips demonstrating and describing an actual fiberoptic bronchoscopy procedure. Nine adult practice cases were available for further training.
Residents assigned to receive training on the bronchoscopy simulator were instructed to focus on familiarizing themselves with the bronchoscope and navigating the airway in a systematic fashion while proceeding through the bronchoscopy practice cases. They were allowed to spend as much time as they desired with the simulator. They all were required to complete the anatomy module and at least one practice case.
Intraoperative bronchoscopic evaluation
All patients were undergoing preoperative bronchoscopy immediately before a thoracic procedure. There was no attempt to randomize or select the patient population further. All patients underwent general anesthesia and placement of a laryngeal mask airway for bronchoscopy. Because the patients were under general anesthesia, they did not require topical anesthetic. A single thoracic surgeon served as the examiner.
Residents undergoing intraoperative bronchoscopic evaluation were instructed to complete a thorough examination of all bronchi to the segmental level. They were asked to name relevant anatomy if they knew it but not to slow the exam if they were unsure of the name of the airway branch anatomy. Time was kept from the moment the subject inserted the bronchoscope into the laryngeal mask airway until completion of the examination. The number of times lobar bronchi were redundantly explored was recorded.
Efficiency was assessed by noting the number of verbal or physical prompts required, the thoroughness of the exam, and the total time to completion. Both the examiner and subject were asked to separately evaluate, on a scale of zero to five (five being the best), the level of confidence and the proficiency of the bronchoscopist. The examiner additionally rated the thoroughness of the bronchoscopy on a scale of zero to five. To control for previous endoscopic experience, subjects were asked to indicate the number of endoscopic and bronchoscopic procedures observed and performed before this study. Statistical analysis was done by the Mann-Whiney U test.
The project was approved by the Institutional Review Board of Northwestern University the Feinberg School of Medicine on October 5, 2001. Informed consent was received by all study subjects.
| Results |
|---|
|
|
|---|
The numbers of endoscopic and bronchoscopic procedures observed and performed were no different between the naïve and trained groups. (Table 1) The experienced group had all done ten or more bronchoscopies before evaluation.
|
|
| Comment |
|---|
|
|
|---|
This study was only intended to test the simulator's ability to familiarize untrained residents with basic bronchoscopy. The training modules used in this study did not emphasize teaching the segmental anatomy, nor were the trainees asked to concentrate on learning it. However, the training modules that emphasize segmental anatomy may be useful for training thoracic surgery residents. We use the simulator to rapidly familiarize residents with basic bronchoscopy. Additional bronchoscopy skills and anatomy are subsequently taught in the clinical setting. The trainer does not adequately simulate secretion management. It would also not likely be beneficial in training management of problems that require rigid bronchoscopy.
Our simulator is maintained as part of a minimally invasive surgery training center; it is simple to operate and does not require a technician for maintenance. The bronchoscopy simulator is part of an endoscopic training system that can also simulate flexible sigmoidoscopy. The $35,000 cost of the device could thus be shared by surgery, pulmonary, and GI divisions.
Residents rotating through the thoracic intensive care unit (ICU) surgery service one year after their training continued to exhibit excellent handling of the flexible bronchoscope for common ICU applications. We have now implemented the trainer as part of the thoracic surgery rotation for PGY1 residents. Junior residents who train for as little as 60 minutes on the bronchoscopy simulator perform relaxed, efficient, and thorough basic clinical bronchoscopy.
| Acknowledgments |
|---|
|
|
|---|
| Discussion |
|---|
|
|
|---|
At a recent 2-day symposium last year of surgeons, educators, engineers and experts in educational testing sponsored by the American College of Surgeons, the group concluded that improvement of patient safety is a vital need of today's surgeons, and simulation technology may play a role in advancing this goal. And the College is dedicating itself to improving the safety of surgical patients, in part through its use of medical simulation, which it is anticipated will facilitate: (1) screening surgeons, both young and old, for demonstrable aptitude in new technologies; (2) initial surgical training in various areas, correcting for case mix inequalities, which are inevitable in our training programs; (3) continuing education of surgeons through a consistently reproducible process; (4) periodic assessment of acquired surgical skills; and finally (5) maintenance of proficiency by allowing rehearsal of complex patient-specific procedures.
You have heard many times at this meeting that the old days are gone. And it is probably better that future thoracic surgeons first learn on a simulator how to do subclavian vein cannulations, chest tube insertions, and even vascular anastomoses, which can now be done virtually, rather than on patients. But as we swallow this hook of simulation technology and the wonders of computer applications to this field, it is vital that we as surgeons validate that clinically useful learning is resulting from the use of a simulator.
So, Dr Blum, I have a few specific questions. The bronchoscopy simulator is a wonderful learning tool. I have used it. I have taught residents bronchoscopy with it. Can you comment on the cost of this equipment for the audience?
In addition, can you comment on the statistical validity of your study? In the abstract the N was four. It has now grown to five residents receiving preprocedural bronchoscopy training. I am concerned that the small number of the study group might negate the value of the reported data and will need to be defended under the scrutiny of peer review. So I assume your experience with this continues to grow.
I commend you on your methodical attempt to validate the usefulness of the bronchoscopy simulator in resident education. We are really at the dawning of a new age, not only in resident education, and certainly not just for bronchoscopy, but in our own continuing surgical education for the specialty at large as well. Thank you.
DR CHARLES R. BRIDGES (Philadelphia, PA): One of my concerns about the methodology also, to add to Dr Orringer's point, were the examiners blinded? Obviously you may not be able to be blinded with respect to the experienced residents because I would imagine they would be people you might know, but with respect to those who either had undergone the training or those who hadn't, it would seem to me it would be an important adjunct to your methodology to ensure that the examiner didn't know which type of student he was evaluating.
DR BLUM: I will take the last question first. The randomization was done by the technologist in the laboratory. The residents were specifically instructed not to tell the examiner in the operating room, which was me, to which group they had been randomized. However, usually within about 30 seconds to a minute of the performing bronchoscopy I could tell whether or not they had used the simulator just because the trained group had obviously superior skills.
The obvious difference in bronchoscopic skills goes back to the idea of the statistical validity. I think statistically certainly the numbers are small. We have been adding to those numbers and I would like to continue to add to them. The interns may be pulled off of our service, so we may have some troubles getting higher numbers. Certainly while the statistics on a subject that is difficult to objectively quantify with small number of subjects are going to be weak, the subjective difference in terms of the ability of people to handle a bronchoscope after having worked with this trainer is very obvious. A similar study involving pulmonary fellows training with a simulator for 4 hours, and comparing them to pulmonologists who had performed over 200 bronchoscopies, showed basically the same thing. The comparison between these two groups was done using a separate simulator system (not actual patients), but they found no difference between those groups. So I think even though the statistical power of the study is small, the actual power of the simulator is high, and we will just have to continue to do what I can with the statistics.
The cost of the equipment is somewhere in the neighborhood of $40,000 to $45,000. This system can also be used with the proper software and a different anatomic simulator plate (not a face plate) to simulate sigmoidoscopy. There is not an esophagoscopy or a colonoscopy tool yet, but that probably will be forthcoming.
| References |
|---|
|
|
|---|
This article has been cited by other articles:
![]() |
J. M. De Raet, J. Arroyo, S. Buchner, S. Siregard, M. Andreas, F. Halvorsen, A. Grabosch, and M. Stubbendorff How to build your own coronary anastomosis simulator from scratch Interact CardioVasc Thorac Surg, June 1, 2013; 16(6): 772 - 776. [Abstract] [Full Text] [PDF] |
||||
![]() |
D. O. Kessler, G. Arteaga, K. Ching, L. Haubner, G. Kamdar, A. Krantz, J. Lindower, M. Miller, M. Petrescu, M. V. Pusic, et al. Interns' Success With Clinical Procedures in Infants After Simulation Training Pediatrics, March 1, 2013; 131(3): e811 - e811. [Abstract] [Full Text] [PDF] |
||||
![]() |
T. B. Jang, W. C. Coates, and Y. T. Liu The Competency-Based Mandate for Emergency Bedside Sonography Training and a Tale of Two Residency Programs J. Ultrasound Med., April 1, 2012; 31(4): 515 - 521. [Full Text] [PDF] |
||||
![]() |
G. M. Tan A Medical Crisis Management Simulation Activity for Pediatric Dental Residents and Assistants J Dent Educ., June 1, 2011; 75(6): 782 - 790. [Abstract] [Full Text] [PDF] |
||||
![]() |
M. K. Mittal, S. Dhuper, C. Siva, J. L. Fresen, M. Petruc, and C. R. Velazquez Assessment of email communication skills of rheumatology fellows: a pilot study JAMIA, November 1, 2010; 17(6): 702 - 706. [Abstract] [Full Text] [PDF] |
||||
![]() |
S. Di Domenico, C. Simonassi, and L. Chessa Inexpensive anatomical trainer for bronchoscopy Interact CardioVasc Thorac Surg, August 1, 2007; 6(4): 567 - 569. [Abstract] [Full Text] [PDF] |
||||
![]() |
R Aggarwal and A Darzi Training in the operating theatre: is it safe? Thorax, April 1, 2006; 61(4): 278 - 279. [Full Text] [PDF] |
||||
![]() |
E. Sinz Simulation-Based Education for Cardiac, Thoracic, and Vascular Anesthesiology Seminars in Cardiothoracic and Vascular Anesthesia, December 1, 2005; 9(4): 291 - 307. [Abstract] [PDF] |
||||
![]() |
M. P. Eason Simulation Devices in Cardiothoracic and Vascular Anesthesia Seminars in Cardiothoracic and Vascular Anesthesia, December 1, 2005; 9(4): 309 - 323. [Abstract] [PDF] |
||||
![]() |
J. C. BERSCHBACK, P. C. AMADIO, C. ZHAO, M. E. ZOBITZ, and K. N. AN Providing Quantitative Feedback When Teaching Tendon Repair: A New Tool J Hand Surg Eur Vol., December 1, 2005; 30(6): 626 - 632. [Abstract] [Full Text] [PDF] |
||||
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| HOME | HELP | FEEDBACK | SUBSCRIPTIONS | ARCHIVE | SEARCH | TABLE OF CONTENTS |
| ANN THORAC SURG | ASIAN CARDIOVASC THORAC ANN | EUR J CARDIOTHORAC SURG |
| J THORAC CARDIOVASC SURG | ICVTS | ALL CTSNet JOURNALS |