|
|
||||||||
Ann Thorac Surg 2005;79:375-382
© 2005 The Society of Thoracic Surgeons
a Department of Cardiothoracic Surgery, Rotterdam, The Netherlands
b Department of Epidemiology and Biostatistics, Erasmus MC, Rotterdam, The Netherlands
* Address reprint requests to Dr Kappetein, Department of Cardiothoracic Surgery, Room BD 156, Erasmus Medical Center Rotterdam, PO Box 2040, Rotterdam 3000 CA, the Netherlands (E-mail: a.kappetein{at}erasmusmc.nl).
| Abstract |
|---|
|
|
|---|
| Introduction |
|---|
|
|
|---|
In the last decade, attention has focused on positron emission tomography (PET), a new noninvasive imaging modality using 2-[18F]-fluoro-2-deoxy-D-glucose (FDG); this method has demonstrated increased glucose metabolism in malignant cells and pulmonary malignancies [5]. The principal mechanism for which it is based was an observation made in 1930. Warburg [6] observed that cancer cells are characterized by higher glycolitic rate than normal cells. The glucose analogue FDG undergoes membrane transport and phosphorylation by hexokinase and is trapped intracellularly. Therefore, intracellular FDG concentration reflects intracellular glucose metabolism and permits differentiation between benign and malignant tissue. The FDG PET imaging is performed in the fasting state to minimize competitive inhibition of FDG uptake by glucose. Several studies have addressed the diagnostic accuracy of FDG PET for detecting mediastinal lymph node metastases, but most studies have enrolled a small numbers of patients. The purpose of this study is to perform a meta-analysis to estimate the diagnostic accuracy of FDG PET versus CT imaging on detecting mediastinal lymph node metastases in patients with NSCLC.
| Material and Methods |
|---|
|
|
|---|
Study Eligibility
Two investigators (ÖB, APK) independently evaluated potential English language studies for inclusion and subsequently resolved disagreements by discussion. To be eligible for this analysis, reports had to have primary nonsmall cell lung cancer cases only, have enrolled at least 15 patients, have evaluated the correlation of FDG PET and mediastinal lymph node metastases, have evaluated the correlation of CT imaging and mediastinal lymph node metastases, have presented sufficient data to allow calculation of sensitivity and specificity for malignancy, and had to have been published as a full article in the English language peer-reviewed literature. Abstracts were excluded from this analysis because of insufficient data to evaluate the methodological quality and to allow the calculation of sensitivity and specificity.
Study Quality
We designed criteria to assess the quality of the different studies. The trial quality was assessed according to the information provided in the publication. Each trial was read and scored independently by two investigators (ÖB, APK), and disagreements were subsequently resolved by discussion. To identify high-quality studies, we selected criteria for methodological quality from a checklist for reporting diagnostic accuracy studies proposed by the STARD (Standards for Reporting of Diagnostic Accuracy)
group [7]. The STARD checklist consists of 25 items. We selected eight general quality criteria covering eight dimensions: (1) descriptions of the study population, (2) cohort assembly, and (3) study design, (4) a clear description of CT technique, (5) a clear description of FDG PET technique, (6) a technical quality of the reference standard, (7) a clear definition of cut-off levels, and (8) interpretation of both FDG PET and CT scans independent of each other and without knowledge of histology. A value between 0 and 2 was attributed to each dimension (2 = adequate and complete description or prospective design, 1 = partial or not optimal description or retrospective design, and 0 = not performed or not mentioned), giving a maximum possible score of 16.
Statistical Analysis
The raw data were summarized according to a method described previously by Irwig and associates [8]. For each study, sensitivity, specificity and diagnostic odds ratios (DOR) were calculated from the 2 x 2 tables of true-positive, true-negative, false-positive, and false-negative results. The DOR is a simple statistic to express the discriminative power of a test. It is defined as the ratio of sensitivity/(1-sensitivity) over (1-specificity)/specificity. In simpler terms, the DOR is the odds of a positive test result if mediastinal lymph nodes are involved with cancer, divided by the odds of a positive test result if mediastinal lymph nodes are free from cancer. A DOR greater than 1 indicates that a test has discriminative power, which increases with the magnitude of the DOR. To prevent division by 0 when calculating the DOR, the conventional correction by adding 0.5 to each cell in the 2 x 2 tables was applied [9]. The DOR was analyzed using a random effect meta-analysis model for the logarithm of the DOR, leading to an overall estimate of the DOR and a corresponding 95% confidence interval (95% CI), taking possible heterogeneity between studies into account [10]. Sensitivity and specificity were analyzed in an analogous way, using the logit transformation.
The models contained study as random factor and did not contain fixed factors, except for a constant. These analyses were carried out with SAS proc mixed as described by van Houwelingen and colleagues [10].
To quantitatively summarize the diagnostic test performance of FDG PET and CT imaging, we also used a meta-analytic method to construct summary receiver operating characteristic (ROC) curves [11, 12]. Receiver operating characteristic curves illustrate the trade-off between sensitivity and specificity as the threshold for defining a positive test that varies from the most stringent to the least stringent. Construction of a summary ROC curve involves calculation of the sum and difference of the logit transforms of the true-positive and false-positive rates for each study [8]. Our method assumes that each individual study represents a unique point on a common ROC curve. To construct the common ROC curves, we applied the equally weighted least squares method described by Moses and colleagues [11]. We defined the maximum joint sensitivity and specificity as the intersection point of the ROC curve and the diagonal line that runs from the top left corner to the bottom right corner of the ROC diagram. This point Q*, at which sensitivity and specificity are equal, is a global measure of test accuracy, similar to the area under the ROC curve. The maximum joint sensitivity and specificity of a perfect test is 1.0, and a maximum joint sensitivity and specificity of a test that has no discriminative ability is 0.5, meaning that probability of correctly identifying disease would be 50%. We calculated Q* and its corresponding standard error by the method described by Moses and colleagues [11]. A larger value of Q* means that the ROC curve tends to be positioned more towards the left upper corner and the better is the test [13, 14]. The analysis was carried out with SPSS.
To assess publication bias, funnel plots were made accompanied by the linear regression test on symmetry [15].
| Results |
|---|
|
|
|---|
Study Description
The main characteristics of the 17 eligible studies are outlined in Table 1. The total number of patients included was 833, ranging from 18 to 102 patients by report. There were no data reported on age in 11 studies. The sex distribution was only reported in three studies. Five studies evaluated the role of whole-body FDG PET and CT imaging in the staging of NSCLC (pulmonary nodules, lymph node metastases, and distant metastases) [25, 3336], three studies assessed the role of FDG PET and CT imaging on detecting pulmonary nodules and mediastinal metastases [22, 27, 32], three studies evaluated lymph node metastases [30, 37, 38], and six trials only assessed mediastinal lymph node staging of NSCLC [23, 24, 26, 28, 29, 31]. The patients included in the studies were found operable on CT scan findings if mediastinal lymph nodes were
10 mm in diameter. If mediastinal lymph nodes were larger, patients underwent mediastinoscopy before surgery. All patients underwent FDG PET imaging. Histology was confirmed by mediastinoscopy or thoracotomy, or both. Thirty-two patients (in two studies, respectively in 1 and 31 patients [23, 35]) were followed-up with CT scan. Lymph nodes were recorded as pathologic if there was a substantial growth in size. Studies did not report which and how many patients underwent mediastinoscopy on FDG PET findings before thoracotomy. Only six studies [30, 31, 33, 35, 38] described a differentiation between N2 and N3 disease. Two studies [30, 37] reported results by using lymph nodes as the unit of analysis and differentiated between single versus multiple nodes. The results of the remaining studies were reported by using the patient as the unit of analysis.
|
|
p < 0.05). Table 1 shows accuracy results expressed in terms of DOR. The DOR ranged from 1.0 to 23.2 for CT imaging, and from 11.5 to 1089.0 for FDG PET. In all studies the DOR was higher for FDG PET than for CT imaging. The overall estimate of the DOR was 5.4 (95% CI, 3.3 to 8.8) for CT imaging and 76.4 (95% CI, 41.2 to 141.7) for FDG PET. For both methods, there was no statistical significant heterogeneity found in the DOR. The summary ROC curves for the compared diagnostic modalities are shown in Figure 1. The point on the ROC curve with equal sensitivity and specificity for CT imaging was Q* = 0.70 (95% CI, 0.65 to 0.75) and for FDG PET it was 0.90 (95% CI, 0.86 to 0.95). The difference was highly significant (p < 0.0001). Funnel plots and linear regression tests on the symmetry of them did not show evidence of publication bias.
|
| Comment |
|---|
|
|
|---|
This meta-analysis, which pooled all the studies we found evaluating and comparing the diagnostic accuracy of FDG PET and CT imaging on detecting mediastinal lymph node metastases, showed that FDG PET was more accurate than CT imaging. The high negative predictive value of FDG PET for mediastinal lymph node metastases can be used as an advantage in the approach to patients with NSCLC, because the necessity of invasive procedures can be questioned in a patient with negative findings on FDG PET. However, even with optimal current technology, FDG PET fails to identify microscopic N2 disease; therefore nowadays mediastinoscopy is still warranted in some FDG PET negative patients with certain clinical factors, such as size and location of the tumor, which can be predictive for mediastinal lymph node metastases. A lower positive predictive value of FDG PET, mostly due to inflammatory processes, means that patients in whom mediastinal metastases are found on FDG PET will need to undergo a cervical mediastinoscopy as part of the work-up for NSCLC, to be sure that no single patient with N0 or N1 disease is denied the chance of cure by direct surgical resection based on a false-positive FDG PET.
Dwamena and colleagues [42] stated in their meta-analysis that they found a high accuracy of FDG PET versus CT imaging. However this meta-analysis also included studies evaluating CT scanning only and studies evaluating N1 lymph nodes. Because N1 disease is generally considered operable for treatment decision it is more essential to know whether FDG PET is more accurate to detect N2 or N3 lymph node disease.
In addition to the higher accuracy of FDG PET in detecting mediastinal lymph nodes, it is also accurate in detecting metastatic disease and residual disease after induction therapy. Studies comparing the ability to detect metastases within the liver and adrenal gland demonstrated that FDG PET has a higher sensitivity and specificity than CT scans [43, 44], and it has been found to be superior to bone scintigraphy [45, 46]. Conventional imaging techniques do not provide tumor-specific information. For example, it is difficult to distinguish residual disease from necrosis or fibrotic tissue after induction therapy. The FDG PET has been proven to be more accurate than CT scans in monitoring tumor response to chemotherapy or irradiation [4749].
The main drawback of FDG PET is the limited ability for precise anatomic localization. Therefore, correlation between the FDG PET images and a recent CT scan of the chest is needed for precise localization of mediastinal lymph nodes. Image registration and image fusion have been used for combining anatomic information from CT scans and metabolic information from FDG PET images [50, 51]. However, computerized fusion of the two types of images currently seemed to be only marginally more beneficial than simple visual correlation of the FDG PET scan and CT imaging in terms of pinpointing metastases in lymph nodes. Whether the benefit of computerized fusion of FDG PET and CT imaging will progress has yet to be proven in further investigation.
Policy-level decisions regarding dissemination of FDG PET must consider not only diagnostic accuracy but also clinical outcome and costs. The high cost is one of the reasons limiting its widespread utilization. Gambhir and coworkers [52] developed a cost to benefit model that demonstrated a significant cost savings by including FDG PET imaging in the staging of lung cancer. They found that a conservative strategy of using chest CT imaging plus FDG PET imaging showed potential cost savings of $1,154 per patient without a loss of life expectancy. This strategy would involve taking biopsy specimens from all positive findings with either CT scan or FDG PET imaging that may indicate nonresectability malignancy so that 100% of surgical candidates are identified definitively. The major cost savings of FDG PET is mainly the result of a patient with unresectable disease who is not undergoing an unnecessary surgery [53].
We attempted to identify all studies that examined functional imaging with FDG PET and CT scans for diagnosis of mediastinal lymph node metastases in patients with NSCLC, and we attempted to prevent biases. However all potential biases cannot be prevented. This review was restricted to articles published in English, because other languages such as Japanese or French were not accessible for the readers. This selection could favor the positive studies, as positive studies are often published in English, whereas negative studies, if at all published, tend to be reported in native languages [54].
Another possible source of confusion is the use of the same cohort of patients in different publications. It may be difficult to avoid the same patients being included more than once in the meta-analysis, although publications in which this seems to be the case have to be excluded. We included two publications by Scott and coworkers [22, 26] on different cohorts.
For most studies, the patient was the unit of analysis. For two studies [30, 37], the results were reported by using lymph nodes as the unit of analysis. Analysis of individual lymph nodes can be a source of bias. In these studies, observations are not statistically independent (ie, if a given patient has one positive lymph node, then that patient is more likely to have other positive lymph nodes). In addition, it is important to note that the clinically relevant unit of analysis is the patient, and treatment decisions depend on the presence or absence of lymph node involvement rather than the number of involved nodes.
The fact that mainly operable patients were included in all studies could be a source of work-up bias. In addition, doctors sometimes rely more on the results of the FDG PET scan compared with the CT scan, resulting in more mediastinoscopies performed in patients with a positive FDG PET scan. In all of our studies, no information was given on which and how many patients underwent mediastinoscopy based on FDG PET results before thoracotomy.
The techniques and specialists' reviews that were used to detect mediastinal lymph node metastases may also be potential sources of bias, as nowadays FDG PET scan technology is disseminated to centers with less experience.
In conclusion, our meta-analysis indicates that FDG PET is more accurate than CT imaging for the detection of mediastinal lymph node metastases in patients with NSCLC. However, the main drawback of FDG PET is the limited ability for precise anatomic localization. Therefore, correlation between the FDG PET images and a recent CT scan is needed for precise localization of mediastinal lymph nodes. Nowadays, the FDG PET image is not yet able to replace the CT scan as a staging procedure, but it does provide essential additional information. Advances in FDG PET technology, including the refinements of computerized fusion of FDG PET and CT scan, may overcome the limitations in the future. As more accurate staging should lead to more appropriate therapy, FDG PET may lead to improvements in both patient quality of life and in savings of healthcare costs.
| References |
|---|
|
|
|---|
Related Article
This article has been cited by other articles:
![]() |
S. Kligerman and S. Digumarthy Staging of Non-Small Cell Lung Cancer Using Integrated PET/CT Am. J. Roentgenol., November 1, 2009; 193(5): 1203 - 1211. [Full Text] [PDF] |
||||
![]() |
L. Varela-Lema, A. Fernandez-Villar, and A. Ruano-Ravina Effectiveness and safety of endobronchial ultrasound-transbronchial needle aspiration: a systematic review Eur. Respir. J., May 1, 2009; 33(5): 1156 - 1164. [Abstract] [Full Text] [PDF] |
||||
![]() |
G. Melloni, M. Casiraghi, A. Bandiera, P. Ciriaco, A. Carretta, L. Libretti, and P. Zannini Transbronchial needle aspiration in lung cancer patients suitable for operation with positive mediastinal positron emission tomography. Ann. Thorac. Surg., February 1, 2009; 87(2): 373 - 378. [Abstract] [Full Text] [PDF] |
||||
![]() |
W. De Wever, S. Stroobants, J. Coolen, and J. A. Verschakelen Integrated PET/CT in the staging of nonsmall cell lung cancer: technical aspects and clinical integration Eur. Respir. J., January 1, 2009; 33(1): 201 - 212. [Abstract] [Full Text] [PDF] |
||||
![]() |
S. S. Groth, B. A. Whitson, J. D'Cunha, M. A. Maddaus, M. Alsharif, and R. S. Andrade Endobronchial Ultrasound-Guided Fine-Needle Aspiration of Mediastinal Lymph Nodes: A Single Institution's Early Learning Curve Ann. Thorac. Surg., October 1, 2008; 86(4): 1104 - 1110. [Abstract] [Full Text] [PDF] |
||||
![]() |
F.-X. Hanin, M. Lonneux, J. Cornet, P. Noirhomme, C. Coulon, J. Distexhe, and A. J. Poncelet Prognostic value of FDG uptake in early stage non-small cell lung cancer Eur. J. Cardiothorac. Surg., May 1, 2008; 33(5): 819 - 823. [Abstract] [Full Text] [PDF] |
||||
![]() |
J. W. Fletcher, B. Djulbegovic, H. P. Soares, B. A. Siegel, V. J. Lowe, G. H. Lyman, R. E. Coleman, R. Wahl, J. C. Paschold, N. Avril, et al. Recommendations on the Use of 18F-FDG PET in Oncology J. Nucl. Med., March 1, 2008; 49(3): 480 - 508. [Abstract] [Full Text] [PDF] |
||||
![]() |
H. Melek, M. Z. Gunluoglu, A. Demir, H. Akin, A. Olcmen, and S. I. Dincer Role of positron emission tomography in mediastinal lymphatic staging of non-small cell lung cancer Eur. J. Cardiothorac. Surg., February 1, 2008; 33(2): 294 - 299. [Abstract] [Full Text] [PDF] |
||||
![]() |
Y. C. Ung, D. E. Maziak, J. A. Vanderveen, C. A. Smith, K. Gulenchyn, C. Lacchetti, W. K. Evans, and Lung Cancer Disease Site Group of Cancer Care Onta 18Fluorodeoxyglucose Positron Emission Tomography in the Diagnosis and Staging of Lung Cancer: A Systematic Review J Natl Cancer Inst, December 5, 2007; 99(23): 1753 - 1767. [Abstract] [Full Text] [PDF] |
||||
![]() |
D. Hellwig, T. P. Graeter, D. Ukena, A. Groeschel, G. W. Sybrecht, H.-J. Schaefers, and C.-M. Kirsch 18F-FDG PET for Mediastinal Staging of Lung Cancer: Which SUV Threshold Makes Sense? J. Nucl. Med., November 1, 2007; 48(11): 1761 - 1766. [Abstract] [Full Text] [PDF] |
||||
![]() |
F. C Detterbeck Evolution and science, progress and change Thorax, August 1, 2007; 62(8): 654 - 655. [Full Text] [PDF] |
||||
![]() |
P. De Leyn, D. Lardinois, P. E. Van Schil, R. Rami-Porta, B. Passlick, M. Zielinski, D. A. Waller, T. Lerut, and W. Weder ESTS guidelines for preoperative lymph node staging for non-small cell lung cancer Eur. J. Cardiothorac. Surg., July 1, 2007; 32(1): 1 - 8. [Abstract] [Full Text] [PDF] |
||||
![]() |
B. E. Lee, D. von Haag, T. Lown, D. Lau, R. Calhoun, and D. Follette Advances in positron emission tomography technology have increased the need for surgical staging in non-small cell lung cancer J. Thorac. Cardiovasc. Surg., March 1, 2007; 133(3): 746 - 752. [Abstract] [Full Text] [PDF] |
||||
![]() |
F. J. F. Herth, A. Ernst, R. Eberhardt, P. Vilmann, H. Dienemann, and M. Krasnik Endobronchial ultrasound-guided transbronchial needle aspiration of lymph nodes in the radiologically normal mediastinum Eur. Respir. J., November 1, 2006; 28(5): 910 - 914. [Abstract] [Full Text] [PDF] |
||||
![]() |
C. Schimmer, K. Neukam, and O. Elert Staging of non-small cell lung cancer: clinical value of positron emission tomography and mediastinoscopy Interactive CardioVascular and Thoracic Surgery, August 1, 2006; 5(4): 418 - 423. [Abstract] [Full Text] [PDF] |
||||
![]() |
P. Goldstraw Selection of Patients for Surgery After Induction Chemotherapy for N2 Non-Small-Cell Lung Cancer J. Clin. Oncol., July 20, 2006; 24(21): 3317 - 3318. [Full Text] [PDF] |
||||
![]() |
P. De Leyn, S. Stroobants, W. De Wever, T. Lerut, W. Coosemans, G. Decker, P. Nafteux, D. Van Raemdonck, L. Mortelmans, K. Nackaerts, et al. Prospective Comparative Study of Integrated Positron Emission Tomography-Computed Tomography Scan Compared With Remediastinoscopy in the Assessment of Residual Mediastinal Lymph Node Disease After Induction Chemotherapy for Mediastinoscopy-Proven Stage IIIA-N2 Non-Small-Cell Lung Cancer: A Leuven Lung Cancer Group Study J. Clin. Oncol., July 20, 2006; 24(21): 3333 - 3339. [Abstract] [Full Text] [PDF] |
||||
![]() |
D. Lardinois New Horizons in Staging for Non-Small-Cell Lung Cancer J. Clin. Oncol., April 20, 2006; 24(12): 1785 - 1787. [Full Text] [PDF] |
||||
![]() |
J. L. Port, R. S. Andrade, M. A. Levin, R. J. Korst, P. C. Lee, D. E. Becker, and N. K. Altorki Positron emission tomographic scanning in the diagnosis and staging of non-small cell lung cancer 2 cm in size or less J. Thorac. Cardiovasc. Surg., December 1, 2005; 130(6): 1611 - 1615. [Abstract] [Full Text] [PDF] |
||||
![]() |
O. Birim, A. P. Kappetein, and A. J.J.C. Bogers Reply Ann. Thorac. Surg., November 1, 2005; 80(5): 1980 - 1981. [Full Text] [PDF] |
||||
![]() |
F. C. Detterbeck Relearning the Lessons of the Past: Are We Making Progress? Ann. Thorac. Surg., November 1, 2005; 80(5): 1979 - 1980. [Full Text] [PDF] |
||||
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| HOME | HELP | FEEDBACK | SUBSCRIPTIONS | ARCHIVE | SEARCH | TABLE OF CONTENTS |
| ANN THORAC SURG | ASIAN CARDIOVASC THORAC ANN | EUR J CARDIOTHORAC SURG |
| J THORAC CARDIOVASC SURG | ICVTS | ALL CTSNet JOURNALS |