|
|
||||||||
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Ann Thorac Surg 1999;67:297
© 1999 The Society of Thoracic Surgeons
a Department of Cardio-Thoracic Surgery, Leiden University Medical Center, P.O. Box 9600, 2300 RC Leiden, The Netherlands
To the Editor
We read with interest the recent article by Kneebone and colleagues [1] and agree with their criticism on the frequent use of the standard deviation (SD) method for defining deterioration in a patients neuropsychological test performance after cardiac surgical procedures. According to this method, a decline in test performance is considered significant if a patients preoperative to postoperative test score decrement is at least one SD, the SD being generally determined on the distribution of the preoperative scores in the patient sample. The one SD criterion can be critized because it does not address two common aspects of neuropsychological testing: measurement error (ie, imperfect reliability of test scores) and practice effects (ie, improvement of test performance at retesting because of familiarity with the test). When these two aspects are not taken into account, both overestimation and underestimation of postoperative neuropsychological deficits may occur.
To reliably define a preoperative to postoperative change in a patients neuropsychological test scores, Kneebone and coworkers [1] recommend applying a method that was proposed by Chelune and colleagues [2]. In this method, measurement error is dealt with by using the standard error of the difference between the preoperative and postoperative scores of the patient sample (SEdiff). Practice effects are controlled for by subtracting the mean practice effect observed in a control group from the preoperative to postoperative change score. A score change (after correction for practice) exceeding 1.64 SEdiff is considered to exceed chance fluctuations caused by test unreliability (ie, 90% confidence interval) and is therefore said to be statistically significant. This criterion seems to be a more appropriate index than the one SD criterion. However, as we have recently discussed, there are still two cautions against using it [3].
First, the method of Chelune and associates [2] does not correct for all effects of measurement error because it examines the wrong score distribution. This method focuses on the distribution of the difference between the actual preoperative and the actual postoperative score observed for the patient. Yet, to deal with unreliability of both the preoperative and the postoperative test score, a confidence interval should refer to the difference between the estimated true preoperative and the estimated true postoperative score. In fact, both the change score and its standard error should refer to estimated true change.
Second, the method of Chelune and colleagues [2] does not adequately correct for practice effects. In healthy populations, there is ample evidence of marked differences between individuals in the magnitude of test score improvement at retesting. Therefore, it is counterintuitive to correct individual change scores for practice effects by using the mean change score of a control group. Because estimated true change scores are in general found to show a strong linear relation to initial test scores, it seems more appropriate to take into account a patients preoperative score and to correct for practice effects by relating the patients change score to the change score of control subjects with a similar pretest score as the patient.
In view of the above cautions, we have presented an index that takes into account estimated true change and a patients preoperative score in controlling for measurement error and practice effects [3]. Comparison of the results of our index and that of Chelune and coworkers [2] teaches us that using the method of Chelune and associates, similar to the one SD method, may lead to overestimation and underestimation of neuropsychological deficits (Table 1).
|
Related Article
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| HOME | HELP | FEEDBACK | SUBSCRIPTIONS | ARCHIVE | SEARCH | TABLE OF CONTENTS |
| ANN THORAC SURG | ASIAN CARDIOVASC THORAC ANN | EUR J CARDIOTHORAC SURG |
| J THORAC CARDIOVASC SURG | ICVTS | ALL CTSNet JOURNALS |