|World J Mens Health. 2020 Apr;38(2):208-219. English.|
Published online Apr 03, 2019. https://doi.org/10.5534/wjmh.180124
|Copyright © 2020 Korean Society for Sexual Medicine and Andrology|
|Hui Wu,1,2,* Ting Xu,3,* Xiao Wang,1,2 Yong-Bo Yu,1,2 Zhong-Yuan Fan,1,2 Dan-Xia Li,1,2 Lei Luo,1,2 Xue-Cheng Yang,1,2 Wei Jiao,1,2 and Hai-Tao Niu1,2|
1Department of Urology, Affiliated Hospital of Qingdao University, Qingdao, China.|
2Key Laboratory of Urinary System Diseases, Qingdao, China.|
3Department of Geratology, The 971th Hospital of PLA, Qingdao, China.|
Correspondence to: Hai-Tao Niu. Department of Urology, Affiliated Hospital of Qingdao University, 16 Jiangsu Road, Shinan district, Qingdao, 266000, China. Tel: +86-18661803117, Fax: +86-053282911825,
Correspondence to: Wei Jiao. Department of Urology, Affiliated Hospital of Qingdao University, 16 Jiangsu Road, Shinan district, Qingdao, 266000, China. Tel: +86-15990997666, Fax: +86-053282911825,
*These authors contributed equally to this work as co-first authors.
|Received December 18, 2018; Revised January 12, 2019; Accepted February 10, 2019.|
This is an Open Access article distributed under the terms of the Creative Commons Attribution Non-Commercial License (http://creativecommons.org/licenses/by-
To compare the diagnostic efficiency of 68Gallium labelled prostate-specific membrane antigen positron emission tomography (68Ga-PSMA PET) and magnetic resonance imaging (MRI) for staging the lymph node metastases (LNMs) in the prostate cancer.
Materials and Methods
A broad search of scientific databases including PubMed, EMBASE, Web of Science, Cochrane Database, and Chinese Biomedicine Literature Database (updated prior to November 1st, 2018) was conducted systematically by two reviewers. In this paper, we evaluated the methodological quality of each included article independently and performed a systematic review and meta-analysis to reveal the summary of the diagnostic performance of 68Ga-PSMA PET and MRI in properly identifying LNMs of intermediate- and/or high-risk prostate cancer.
Thirteen eligible articles comprising 1,597 patients were included. For LNMs detection, the pooled sensitivity and specificity of 68Ga-PSMA PET were 0.65 (95% confidence interval [CI]: 0.49–0.79) and 0.94 (95% CI: 0.88–0.97), respectively, while the corresponding values of MRI were 0.41 (95% CI: 0.26–0.57) and 0.92 (95% CI: 0.86–0.95). The area under the symmetric receiver-operating characteristic (SROC) curve for 68Ga-PSMA PET and MRI were 0.92 and 0.83, respectively.
In intermediate- or high-risk pre-treatment prostate cancer, 68Ga-PSMA PET had a higher sensitivity and a slightly different specificity in probing the LNMs when comparing with MRI. Moreover, the area under the SROC curve indicated that 68Ga-PSMA PET was a more effective weapon for predicting the LNMs prior to radical surgery.
Magnetic resonance imaging; Metastasis; Meta-analysis; Positron-emission tomography; Prostate cancer
Prostate cancer, the most frequent solid malignancy among men, has become the third leading cause of cancer-associated deaths worldwide [1, 2]. An accurate preoperative assessment of the tumor stage plays an crucial role for therapy planning, and radical prostatectomy is a extensively used potentially curative strategy . While the detection of serum prostate specific antigen (PSA) levels has led to earlier diagnosis of prostate cancer , the conventional imaging modalities, including computed tomography (CT), magnetic resonance imaging (MRI), choline-based positron emission tomography (PET)/CT as well as 99mTc-methylene diphosphate bone scan, are more likely to be used for evaluating local tumor stage, seminal vesicle invasion, lymph node metastases (LNMs), and skeleton metastatic lesions. However, regardless of promising results that the conventional imaging techniques including MRI have performed, a wide range of reported sensitivities and specificities still exhibit their limitations in the current clinical scenarios .
Prostate-specific membrane antigen (PSMA), a transmembrane protein over-expressed in prostate cancer, has increasingly attracted the interest as a newly emerging approach for clinical imaging. Evidences have shown that the expression of PSMA in prostate cancer is 100- to 1,000-fold higher than that in normal tissues [6, 7], and higher levels of PSMA expression have been demonstrated to be associated with increasing stage, Gleason grade and PSA level in prostate cancer [6, 8]. To date, various PET ligands have been applied for the detection of prostate cancer , and despite the most common ligands 11 C- or 18 F-choline, a late-model probe named 68Gallium labelled prostate-PSMA ligands (68Ga-PSMA) recently has drawn a concentration of researchers [10, 11]. It has been well reported that 68Ga-PSMA-PET has superior sensitivity and specificity when comparing with choline-based PET . Besides, a rising number of evidence has suggested that this targeted modality may provide more precise imaging for detecting prostate cancer [13, 14].
Perera et al  have previously performed a systematic review and meta-analysis to identify the sensitivity and specificity in advanced prostate cancer, indicating its high level of accuracy as a predictor. However, no relevant systematical review and meta-analysis over the comparison between 68Ga-PSMA-PET and the conventional imaging modalities has been yet published. The utility of 68Ga-PSMA PET imaging in intermediate- and high-risk prostate cancer outlined in studies were systematically reviewed. Hence, we decided to perform this meta-analysis. Because the data from multi-central randomized control trials was rare, we collected as many literatures as possible to systematically evaluate the diagnostic accuracy of Ga-PSMA PET imaging and conventional imaging modalities. The aim of our study was to complete a meta-analysis comparing the diagnostic performance of 68Ga-PSMA-PET and the conventional imaging modalities MRI in the detection of LNMs in intermediate- and high-risk preoperative prostate cancer patients.
MATERIALS AND METHODS
1. Data sources and search strategies
A systematic review and meta-analysis was conducted according to Preferred Reporting Items for Systematic Review and Meta-analysis (PRISMA) guidelines .
The scientific databases (PubMed, EMBASE, Web of Science, Cochrane Database, Chinese Biomedicine Literature Database) were searched by two authors independently to pick out eligible published articles (up to November 2018) using the combination of several keywords, including: (1) “prostate neoplasms” or “prostatic neoplasm” or “prostate cancer” or “cancer of the prostate” or “prostate malignancy”, (2) “prostate specific membrane antigen” or “PSMA”, (3) “positron emission tomography” or “PET”, (4) “magnetic resonance imaging” or “MRI”. Besides, additional studies were identified from the references of original articles and reviews related to this topic.
2. Study selection criteria
Following were the inclusion criteria: (1) patients should have undergone 68Ga-PSMA PET and/or MRI. (2) Patients should not receive radical prostatectomy or other non-surgical treatment before accepting the imaging modalities above. (3) Patients should have been biopsy-proven intermediate- or high-risk prostate cancer. (4) Histopathology (treated with pelvic lymph node dissection or extended pelvic lymph node dissection) as a golden standard for lymph node detection. (5) A minimum of 10 patients should be included in the study. (6) The numbers of true-positive (TP), false-positive (FP), true-negative (TN), and false-negative (FN) results can be calculated, (7) language of inclusion studies should be either English or Chinese.
Duplicated articles, case reports, review articles, editorials, clinical conference abstracts, cell and animal articles, meta-analysis were excluded to ensure the accuracy of the data.
3. Quality assessment
In order to evaluate the methodological quality of the eligible studies, the Quality Assessment Tool for Diagnostic Accuracy Studies version 2 (QUADAS-2) were used by two evaluators independently , and any discrepancies were discussed and resolved. The tool assesses the following four domains: patient selection, index test, reference standard, as well as the timing of reference test. The four domains above are all assessed in terms of risk of bias when we also assessed the degree of applicability of first three. Finally, we used Review Manager 5.3 software to evaluate the methodological quality and draw the figures.
4. Data extraction and statistical analysis
The extracted data from the enrolled studies should obtain following basal characteristics: author, year of publication, location, study design, the number of patients, age, pre-PET PSA level, Gleason scores, histopathologic data, rates of imaging modalities (68Ga-PSMA PET and MRI) positivity, the stage and size of tumor. If available, the numbers of TP, FP, FN, and TN from each paper would also be calculated. The numbers were used to measure sensitivity, specificity as well as a corresponding confidence interval (CI). If needed, we would contact the corresponding author for further details and the study would be excluded if there was no response.
To synthesize the data extracted, we used the bivariate mixed-effects regression model  in our meta-analysis. Based on the two-dimensional model, we obtained logit sensitivity and specificity with their 95% CIs. Then, pooled analysis of sensitivity, specificity and diagnostic odds ratios (DORs) for 68Ga-PSMA PET and MRI with corresponding 95% CIs was performed. Next, a summary receiver-operating characteristic (SROC) curve was back-transformed from the obtaining summary sensitivity, specificity and DORs. All the data was analyzed through MIDAS module for Stata software version 14.0.
5. Heterogeneity and publication bias
The chi-square test were used to analyze the heterogeneity between the eligible studies. I2 were measured as it lies between 0% and 100%. The respective value were approximately divided into 0%, 25%, 50%, 75%, which indicate no, low, moderate and high heterogeneity . We would choose the random-effects models when I2 was superior to 50%; on the contrary, we preferred to choose the fixed-effects models when I2 was less than 50%. To validate if there existed a threshold which was thought as one of main source of heterogeneity, we performed Spearman correlation coefficients. If the p-value >0.05, there was no threshold.
To test the publication bias in each study, we used the Stata 14.0 software (STATA Corp., College Station, TX, USA) to analyze all included studies according to the Deek's test .
6. Ethics statement
All analyses were based on previous published studies, thus no ethical approval and patient consent are required.
1. Study selection and the characteristics
We systematically retrieved through the scientific database (PubMed, EMBASE, Web of Science, Cochrane Database, Chinese Biomedicine Literature Database), which identified 3,044 citations. Additional 4 citations were from the references of the eligible articles. Then, 730 duplicated and 2,130 irrelevant studies were excluded by the abstracts screening. The remaining 188 studies were assessed in detail and 175 of them were excluded because (1) the study type was review, case report, comment or meta-analysis (n=70); (2) the language was not English or Chinese (n=1); (3) the raw data could not be extracted from the articles (n=30); (4) the golden standard was not histopathology (n=7); (5) the patients accepted surgery or hormone therapy (n=67). Finally, 13 eligible articles met the inclusion criteria. The flow diagram of the study selection process was shown in.
Thirteen eligible studies containing 1,597 patients who suffered biopsy-proven intermediate- or high-risk prostate cancer were included in our meta-analysis. All the patients were prior to surgery and non-treated with hormone therapy when undergoing the imaging examination method. The age of the patients was ranging from 42 to 84 years; the PSA level from 0.3 to 737 ng/mL; and the patient number ranged from 12 to 922. In total, seven of the eligible studies were retrospective, and the remaining five studies were prospective. Among these studies, 3 were from Australia, 2 were from Germany, and 1 of each was from China, Turkey, Korea, India, France, Sweden, Norway and Belgium. Other critical information is summarized in.
2. Methodological quality assessment
Referring to the QUADAS-2 quality assessment tool, seven studies enrolled consecutive patients. The index test was prior to surgery, while postoperative pathology was the only golden standard in all eligible articles, which indicated the reference standard barely influenced the result of the index test. According to the result of assessment, the overall quality of included research was credible. The summary of risk of bias and quality assessment is shown in.
In 68Ga-PSMA PET/CT group, we included eight studies [14, 21, 22, 23, 24, 25, 26, 27] which represented 485 patients to identify its efficiency. The forest plot exhibited the results that the sensitivity for 68Ga-PSMA PET/CT ranged from 0.33 to 1.00, as the specificity ranged from 0.69 to 1.00 ( ). The summary pooled parameters in 68Ga-PSMA PET/CT group were as follows: sensitivity: 0.65 (95% CI: 0.49–0.79); specificity: 0.94 (95% CI: 0.88–0.97); positive likelihood ratio (LR+): 10.6 (95% CI: 5.1–21.9); negative likelihood ratio (LR−): 0.37 (95% CI: 0.24–0.58); DOR: 29 (95% CI: 10–80).
Meanwhile, in MRI group, ten articles [14, 21, 22, 23, 24, 28, 29, 30, 31, 32] represented 1,487 patients were evaluated. The corresponding values in the forest plot ranged from 0.14 to 0.93 and 0.57 to 0.96 ( ). The summary pooled parameters in MRI group were as follows: sensitivity: 0.41 (95% CI: 0.26–0.57); specificity: 0.92 (95% CI: 0.86–0.95); LR+: 4.9 (95% CI: 3.1–7.6); LR−: 0.65 (95% CI: 0.51–0.83); DOR: 8 (95% CI: 4–13).
Comparing the pooled data between 68Ga-PSMA PET/CT and MRI, the overall sensitivity was 0.65 (95% CI: 0.49–0.79) versus 0.41 (95% CI: 0.26–0.57); the overall specificity was 0.94 (95% CI: 0.88–0.97) versus 0.92 (95% CI: 0.86–0.95), respectively; the overall LR+ was 10.6 (95% CI: 5.1–21.9) versus 4.9 (95% CI: 3.1–7.6); the overall LR- was 0.37 (95% CI: 0.24–0.58) versus 0.65 (95% CI: 0.51–0.83); and the DOR was 29 (95% CI: 10–80) versus 8 (95% CI: 4–13). 68Ga-PSMA PET/CT had a higher pooled sensitivity (0.65 versus 0.41) and a close pooled specificity (0.94 versus 0.92) when comparing with MRI. The results above were shown inand .
Moreover, we performed the SROC curve of 68Ga-PSMA PET/CT and MRI (). The area under the curve (AUC) of 68Ga-PSMA PET/CT was larger than that of MRI (0.92 versus 0.83), which suggested 68Ga-PSMA PET/CT a more efficient imaging modality when comparing with MRI.
4. Heterogeneity test
According to the result of the forest plot, the heterogeneity of 68Ga-PSMA PET/CT and MRI was high in both sensitivity (I2=61.08% and 82.84%, respectively) and specificity (I2=58.15% and 86.02%, respectively). For MRI group, meta-regression was used to find out the source of heterogeneity. Subsequently, we found the heterogeneity of specificity might come from the electric field strength (1.5 T or 3.0 T), and the results of meta-regression showed the p-value of specificity in electric field strength was 0.03. However, there was no significant differences between the 1.5 T group and 3.0 T group when we performed a sub-group analysis. Therefore, our results of MRI were reliable. As for 68Ga-PSMA PET/CT, lacking enough included studies (n=8) for meta-regression, we decided to choose a random effects model to pool the data of 68Ga-PSMA PET/CT.
Stata 14.0 software was used to analyze the diagnostic threshold, indicating that the Spearman correlation coefficient was 0.26 and the p-value was 0.07 for 68Ga-PSMA PET/CT. Meanwhile, the corresponding index for MRI was -0.85 and 0.73. No evidence revealed a significant threshold effect existing in our meta-analysis.
5. Publication bias
The results of Deek's funnel plot test revealed that the p-values for 68Ga-PSMA PET/CT and MRI were 0.98 and 0.78, which indicated that there existed no severe publication bias. The results of Deek's funnel plot was shown in.
Appropriate preoperative evaluation for the LNMs is critical for planning the most efficient prostate-cancer therapy strategy . In the recent clinical scenarios, MRI has been widely applied to predict the primary staging of the patients with prostate cancer. As a standard modality, MRI is indispensable in current practice guidelines, but it still has many deficiencies. In general, MRI excessively relies on pathological changes such as morphological information and the sizes of lymph nodes. By defining pelvic lymph nodes lager than 8 to 10 mm as suspicious lesions [34, 35], the fact that approximately 80% of them in prostate cancer are smaller than 8 mm  results in the low sensitivity of LNMs detection for MRI. Hence, there is an urgent need for a more accurate implement.
As a novel targeted imaging modality, 68Ga-PSMA PET/CT has been well used in numerous published studies. However, in most of outlined data, the utility of 68Ga-PSMA PET just served as a predictor for the secondary staging with biochemical recurrence (BCR). The published studies setting of primary staging without therapy are still limited. Budäus et al  previously reported the initial experience on 68Ga-PSMA PET/CT predicting the LNMs in the patients with prostate cancer who were prior to radical surgery. The authors retrospectively analyzed 30 patients and concluded the sensitivity and specificity of 0.33 and 1.00. Later on, in 2017, Gupta et al  published a research, indicating the sensitivity and specificity for detection of metastatic lymph nodes were 66.7% and 98.9%. In the same year, Zhang et al , a research team from China, delivered the results that the corresponding values changed into 93.3% and 96.6%. However, there are few multicentre prospective randomized studies. A clinical trial protocol for the comparation between 68Ga-PSMA PET and the conventional imaging modalities, which was published by Hofman et al , may help promote more research and offer beneficial evidence. According to the varied results, we performed this meta-analysis to identify the true efficiency of 68Ga-PSMA PET/CT.
In our meta-analysis which included 13 studies comprising 1,597 patients, we compared the sensitivity and specificity of 68Ga-PSMA PET/CT and MRI. Previous studies reported the varied sensitivity and specificity of 68Ga-PSMA PET/CT and MRI. For 68Ga-PSMA PET/CT, sensitivity and specificity ranged from 0.33 to 1.00 and 0.82 to 1.00, respectively. The corresponding values of MRI ranged from 0.14 to 0.93 and 0.76 to 0.99, respectively. The pooled results of the eligible studies highlighted that 68Ga-PSMA PET/CT has a higher sensitivity than that of MRI (0.65 versus 0.39), and a comparable specificity (0.94 versus 0.92). When comparing the SROC curve, the results of AUC indicated that 68Ga-PSMA PET/CT was a more effective predictor for LNMs detection in intermediate- and high-risk prostate cancer.
Our results of 68Ga-PSMA PET/CT are different from those of a previously published meta-analysis performed by Perera et al . In this article, they enrolled 16 articles with 1,309 patients, obtaining a pooled sensitivity and specificity of 0.86 and 0.86 for 68Ga-PSMA PET/CT, respectively. Moreover, they constructed the SROC curve, indicating 68Ga-PSMA PET/CT a valuable diagnostic method.
Despite the similar result of AUC, we are not surprised by the difference between the two meta-analysis, because the different inclusion criteria resulted in the different pooled data. Specifically, in the patient selection, we only enrolled the preoperative patients without hormone therapy, however, Perera et al  included a result of mixed staging patients including primary staging and secondary staging patients with BCR. With regard to the patients with BCR, several previous articles revealed a high sensitivity of LNMs detection, ranging from 77.9% to 98.8% [38, 39, 40]. The results above prompted us that 68Ga-PSMA PET/CT probably had a superior detection rate in the patients with BCR. Therefore, there is no doubt that the pooled sensitivity of Perera's study  is higher than that of our meta-analysis. In addition, referring to the results mentioned above, we conferred that hormone therapy and surgery might influence the exploration ability of 68Ga-PSMA. Hence, we excluded the patients who accepted hormone therapy or radical prostatectomy to dispel the confounding factors which might lead to a potentially rising bias.
As for MRI, dating back to 2008, Hövels et al  had already reported a meta-analysis which included 10 studies comprising 628 patients, with a result that the pooled sensitivity and specificity of LNMs detection in prostate cancer were 0.39 (95% CI: 0.19–0.56) and 0.82 (95% CI: 0.73–0.83), respectively. The outlined results above are similar to those in our study, suggesting MRI possess bounded ability in LNMs detection in prostate cancer. Also, MRI has its own advantages when comparing with 68Ga-PSMA PET/CT. On the one hand, the anatomic discriminative resolution of MRI is higher than that of 68Ga-PSMA PET/CT. On the other hand, the price of the two imaging techniques are not comparable. A modest price of MRI makes it a more acceptable diagnostic method for Chinese patients.
In addition, according to the result of I2 value, the heterogeneity of 68Ga-PSMA PET/CT and MRI is high in our study. Therefore, we performed meta-regression and sub-group analysis for MRI, dividing it into 1.5 T MRI and 3.0 T MRI groups, finding no significant differences between the patients receiving 3.0 T MRI and 1.5 T MRI, which demonstrated our results reliable for MRI. As for 68Ga-PSMA PET/CT group, as a result of limited statistical method to explore heterogeneity, we finally choose a random-effect model. Besides, the differences between included studies in both 68Ga-PSMA PET/CT and MRI thresholds for positivity may become the potential source of heterogeneity.
There are a few limitations in our study.
First, without a sufficient evidence from prospective studies, a majority of the included studies for the meta-analysis were providing a small, retrospective data. As what was mentioned above, the multicentre prospective randomized studies will help accelerate the research. Meanwhile, there was still limited data for more subgroup analysis of different characteristics, such as race (black, white and yellow race) or PSA level. Undoubtedly, additional data will be of benefit for consummating the sub-group analysis.
Second, some criteria or definition in our included literature may not conform the same standard, such as imaging protocol or the definition of sensitivity.
Third, we only enrolled published English articles, leaving out non-English or unpublished studies, which might give rise to selection bias.
Our meta-analysis suggested that, when comparing with MRI, 68Ga-PSMA PET had a higher sensitivity and a comparable specificity for staging the preoperative LNMs in the intermediate- and high-risk prostate cancer. The area under the SROC curve indicated that 68Ga-PSMA PET was potentially a more effective and appropriate imaging modality to predict the LNMs prior to a surgery strategy.
Disclosure:The authors have no potential conflicts of interest to disclose.
Conceptualization: HW, TX.
Data curation: XW, YBY, ZYF.
Formal analysis: DXL, LL, XCY.
Funding acquisition: HTN.
Project administration: HTN, WJ.
Resources: HW, TX.
Supervision: HTN, WJ.
Validation: XW, ZYF.
Writing—original draft: HW, TX.
Writing—review & editing: HTN, WJ.
This study was financially supported by the National Natural Science Foundation of China (81772713, 81472411, 81372752, 81401899), Taishan Scholar Program of Shandong Province (tsqn20161077), Natural Science Foundation of Shandong Province (ZR2014HM088), Key Research and Development Program of Shandong Province (2018GSF118197), China Postdoctoral Science Foundation (2017M622144), Qingdao Postdoctoral Application Research Project and Qingdao Young Scientist Applied Basic Research Fund (15-9-1-51-jch).