Skip to main content
  • Research article
  • Open access
  • Published:

A pair-wise meta-analysis highlights circular RNAs as potential biomarkers for colorectal cancer



Circular RNAs (circRNAs) have emerged as a special subset of endogenous RNAs that are implicated in tumorigenesis and cancer progression. Herein we aim to carry out a meta-analysis to evaluate the clinicopathologic, diagnostic and prognostic significance of circRNA expression in colorectal cancer (CRC).


A systematic search of online databases was performed for original articles published in English, which investigated the diagnostic accuracy, prognostic utility, and clinicopathologic association of circRNA(s) in CRC. Data were strictly extracted and study bias was judged using the Quality Assessment for Studies of Diagnostic Accuracy II (QUADAS II) and Newcastle-Ottawa Scale (NOS) checklists.


A total of 13 studies, involving 1430 patients with CRC, were included in the meta-analysis. The clinicopathologic study showed that abnormally expressed circRNAs were correlated with tumor diameter (P = 0.0350), differentiation (P = 0.0038), lymphatic metastasis (P = 0.0119), distant metastasis (P < 0.0001), TNM stage (P = 0.0002), and depth of invasion (P = 0.001) in patients with CRC. The summary area under the curve (AUC) of circRNA for the discriminative efficacy between patients with and without CRC was estimated to be 0.79, corresponding to a weighted sensitivity of 0.77 [95% confidence interval (CI): 0.74–0.79], specificity of 0.67 (95%CI: 0.64–0.70), and diagnostic odds ratio (DOR) of 7.52 (95%CI: 4.66–12.12). Survival analysis showed that highly expressed circRNAs were correlated with significantly worse overall survival (OS) [hazard ratio (HR) = 2.66, 95%CI: 2.03–3.50, P = 0.000; X2 = 4.34, P = 0.740, I2 = 0.0%], whereas lower expression of circRNAs was associated with prolonged OS (weighted HR = 0.30, 95%CI: 0.17–0.53, P = 0.000; X2 = 1.34, P = 0.909, I2 = 0.0%). Stratified analysis in circRNA expression status, and test matrix also showed robust results.


Abnormally expressed circRNAs may be auxiliary biomarkers facilitating CRC diagnosis, and promising prognostic biomarkers in predicting the survival of CRC patients.

Peer Review reports


Colorectal cancer (CRC) is a leading cause of cancer-related morbidity and mortality worldwide [1]. In China, the incidence and mortality rate of CRC are ranked fourth and third of all malignant tumors, respectively, and the incidence rate of CRC is increasing year by year [2]. Patients with CRC have an unfavorable prognosis; however, the prognosis of CRC is better when the disease is diagnosed in the early stages [3]. Routine blood biomarkers are not powerful enough to aid diagnosis or predict prognosis in patients with CRC [4]. Therefore, the development of novel diagnostic and prognostic biomarkers is crucial to reduce CRC-related deaths.

Recent advances in novel genetic and epigenetic biomarkers for the management of CRC have provided new research perspectives. Circular RNAs (circRNAs) are non-coding RNA molecules that lack a 5′-terminal cap and 3′-terminal poly A tail [5]. CircRNAs are abundant in cells and tissues and their unique sequences endow them with special biological properties such as cytoplasmic microRNA sponges, attaching elements of RNA-binding proteins, or nuclear transcriptional regulators [6, 7]. The formation of a covalently closed continuous loop also makes circRNAs more stable than linear mRNAs [8]. In recent years, circRNAs have been highlighted as novel biomarkers for the management of CRC [9,10,11,12,13,14,15,16,17,18,19,20,21], but the findings remain controversial. The present study summarizes the clinicopathologic, diagnostic, and prognostic significance of circRNAs in CRC patients via a meta-analysis.


Literature search

This study was conducted in accordance with the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) Checklist issued in 2009 [22]. Online databases including PubMed, EMBASE, Web of Science, SCOPUS, and Chinese National Knowledge Infrastructure (CNKI) were searched for eligible studies that evaluated the diagnostic, prognostic or clinicopathologic significance of circRNA(s) in CRC. The following search terms were used with different combinations in different databases: “colorectal cancer”, “colorectal carcinoma”, “colorectal neoplasms”, “carcinoma of colon”, “circular RNA”, “circRNA”, “hsa circ”, “clinicopathologic feature”, “clinicopathological characteristics”, “clinicopathological parameters”, “diagnosis”, “diagnoses”, “sensitivity”, “specificity”, “area under the curve”, “AUC”, “ROC curve”, “prognosis”, “prognoses”, “hazard ratio”, “overall survival”, “OS”, and “HR”. Patients with CRC were considered the “case group”, whereas those with benign lesions or healthy individuals were considered the “control group or controls”.

Study selection

Inclusion criteria were: (1) original research reporting the diagnostic accuracy, or prognostic utility, or clinicopathologic association of single or parallel circRNAs in CRC; (2) the diagnosis of CRC was histopathologically confirmed; and (3) studies investigating the clinical utility of circRNA(s) in CRC, with sufficient data to plot the 2X2 table, or with available HR values and 95% confidence interval (CI), or available P values for clinicopathologic associations. Exclusion criteria were: (1) articles not published in English; (2) reviews, basic studies, comments, meta-analyses, letters or case reports; and (3) studies defined as low quality.

Data extraction

Two authors each assessed the eligibility of all studies and extracted the data. The following data were extracted from each study: (1) baseline information including name of first author, date of publication, number of cases, control source, test matrix, method, reference gene, cut-off point, circRNA(s) type and expression status; (2) clinicopathologic information (as P values) regarding circRNA(s) expression and age, gender, cancer location, tumor diameter, differentiation, serosal invasion, lymphatic metastasis, distant metastasis, and TNM stage; (3) diagnostic data including sensitivity, specificity, area under the curve (AUC) value, or the true positive (TP), false positive (FP), false negative (FN), and true negative (TN) values; and (4) prognostic data including duration of follow-up, HR value and 95%CI for OS.

Quality assessment

Study quality in relation to diagnosis was rated in accordance with the Quality Assessment for Studies of Diagnostic Accuracy II (QUADAS II) checklist, which comprises seven questions regarding patient selection, index tests, reference standards, flow, and timing [23]. Risk of bias was rated as “no”, “yes”, or “unclear”, and only an answer of “yes” received a score of 1, otherwise no score was awarded. Study quality in relation to prognosis was judged by the Newcastle-Ottawa Scale (NOS) [24], wherein the risk regarding study selection, comparability, and outcome were assessed. A study was deemed to be of high quality when the QUADAS II score was ≥4 stars, and ≥ 6 stars for the NOS checklist [25].

Statistical analysis

STATA software (version 12.0) was used to analyze the clinicopathologic and prognostic significance. Meta-Disc (version 1.4) was utilized to summarize the weighted diagnostic parameters including sensitivity, specificity, positive likelihood ratio (PLR), negative likelihood ratio (NLR), overall diagnostic odds ratio (DOR) and AUC. Heterogeneity among studies was assessed by the X2 and inconsistency I2 (I-square) tests, and the cut-off point was set as P < 0.05 in the X2 test or I2 > 50%. Associations between circRNA expression and clinicopathologic parameters were determined using the P values combined with Fisher’s test [26]. HR and 95%CI were combined based on multivariate Cox hazard regression analysis, and the random effect model was chosen when significant heterogeneity was observed. Sensitivity and meta-regression tests were used to identify the underlying causes of heterogeneity [25]. Publication bias was quantitatively judged by Deeks’ funnel plot asymmetry test, Begg’s and Egger’s tests, and P < 0.05 was considered statistically significant.


Search results

The study selection procedure is shown in Fig. 1. In the initial search, a total of 439 publications retrieved from PubMed, EMBASE, Web of Science, SCOPUS, and Chinese National Knowledge Infrastructure (CNKI) databases seemed to meet the inclusion criteria. Of these, 303 publications were identified as duplicates and were eliminated. After reading article titles and abstracts, 120 records were eliminated as no association between circRNA expression and CRC was described or the articles were reviews. In the full-text verification, 16 articles were excluded as the studies were out of topic or lacked sufficient data. Finally, 13 studies were included in the quantitative meta-analysis.

Fig. 1
figure 1

Flow chart of the study search strategies

Study characteristics and study quality

The included 13 studies comprised eight studies on clinicopathologic parameters [9,10,11, 13, 14, 16, 19, 20], nine on diagnosis [9,10,11,12,13,14, 16, 19, 20], and seven on prognosis [10, 12, 14, 15, 17, 18, 21]. The baseline characteristics of all included studies are summarized in Tables 1 and 2. All 13 studies were carried out in Asia. A total of 1430 CRC cases were included, and the sample size ranged from 32 to 318. All CRC cases were diagnosed by histological and pathological examinations. The tissue samples were obtained prior to clinical treatment. circRNA expression level was determined using quantitative real-time polymerase chain reaction (qRT-PCR) or RNA sequencing, and the reference genes included GAPDH [10,11,12,13,14,15,16,17,18, 20, 21], 18S rRNA [9], and U6 [19]. Six types of circRNAs were recognized as tumor promoters [12, 15, 16, 18, 19, 21], and seven were tumor suppressors [9,10,11, 13, 14, 17, 20]. For survival analysis, the follow-up period was available in two studies, and three articles contained data on HR and 95% CI, whereas HR values in the remaining four articles were unclear and were calculated indirectly.

Table 1 Main characteristics of the meta-analysis for diagnostic performance and clinicopathologic association of circRNAs in CRC
Table 2 Mian characteristics of the meta-analysis for prognosis and clinicopathologic association of circRNAs in CRC

Study bias and quality assessed by QUADAS II and NOS checklists are shown in Tables 3 and 4. The rating scores of all eligible studies for diagnosis ranged from 4 to 6, and for prognosis ranged from 6 to 8, indicating high methodological quality in all included studies.

Table 3 Study quality of the diagnostic studies, as judged by the QUADAS II checklist
Table 4 Study quality and bias in the retrospective cohort studies judged by the Newcastle-Ottawa Scale (NOS) checklist

Meta-analysis of clinical parameters

The association between circRNAs and clinicopathologic features in patients with CRC is shown in Table 5. Altered expression of circRNAs was markedly associated with poor clinicopathologic parameters (tumor diameter: pooled P = 0.0350; differentiation: pooled P = 0.0038; lymphatic metastasis: pooled P = 0.0119; distant metastasis: pooled P < 0.0001; TNM stage: pooled P = 0.0002; depth of invasion: pooled P = 0.0016). In contrast, no significant correlations were observed for age (pooled P = 0.3141), gender (pooled P = 0.5696), tumor location (pooled P = 0.8627), as well as levels of carcinoembryonic antigen (CEA) (pooled P = 0.2047), and carbohydrate antigen (CA) 19–9 (pooled P = 0.7954).

Table 5 Associations between circRNAs expression and clinicopathological features in CRC analyzed by Fisher’s test

Diagnostic performance

The weighted diagnostic parameters of circRNAs in distinguishing CRC from non-tumor controls were as follows: sensitivity of 0.77 (95%CI: 0.70–0.82), specificity of 0.81 (95%CI 0.73–0.86), PLR of 4.00 (95%CI 2.80–5.60), NLR of 0.29 (95%CI 0.22–0.38), DOR of 14.0 (95%CI 8.0–24.0), and AUC of 0.86. Forest plots of the pooled sensitivity, specificity, DOR and summary receiver operating characteristic (ROC) curve of circRNAs in diagnosing CRC are shown in Fig. 2.

Fig. 2
figure 2

a Forest plots of the combined sensitivity, (b) specificity, (c) DOR, and (d) AUC for circRNAs expression in diagnosing CRC

Stratified analysis showed that the performance of up-regulated circRNAs (function as tumor promoters) for CRC detection was significantly superior to that of down-regulated circRNAs (function as tumor suppressors) (AUC: 0.86 vs. 0.75; DOR: 10.63 vs. 6.55). When analyzed based on test matrix, these results showed that tissue-based circRNA testing achieved higher diagnostic efficacy than plasma-based analysis (AUC: 0.79 vs. 0.50; DOR: 7.68 vs. 7.13).

Overall survival

Survival analysis showed that oncogenic circRNAs predict worse prognosis in terms of OS in patients with CRC (HR = 2.66, 95%CI: 2.03–3.50, P = 0.000; Chi2 = 4.34, P = 0.740, I2 = 0.0%) (Fig. 3). We identified one outlier study in the combined effect of decreased circRNAs by sensitivity analysis (Fig. 4), and the outlier data were eliminated. The weighted effect showed that decreased circRNAs expression (function as tumor suppressors) in patients with CRC was associated with favorable OS (weighted HR = 0.30, 95%CI: 0.17–0.53, P = 0.000; X2 = 1.34, P = 0.909, I2 = 0.0%) (Fig. 3).

Fig. 3
figure 3

Forest plots of the combined HRs with 95%CIs respectively for the (a) up-regulated and (b) down-regulated circRNA profiles in predicting the overall survival (OS) of patients with CRC

Fig. 4
figure 4

Sensitivity analysis of the outlier data for (a) the overall diagnostic studies, (b) the down-regulated circRNA profiles for diagnosis, as well as (c) the up-regulated, and (d) down-regulated circRNA expression signature in predicting the OS in CRC

Sensitivity analysis and meta-regression

Results of the sensitivity analysis showed that the effect did not alter when omitting studies one by one in relation to the combined diagnostic effect and prognostic effect of oncogenic circRNAs (Fig. 4).

To identify the causes of heterogeneity, meta-regression of the pooled diagnostic effect in terms of the specified covariates such as sample size, text matrix, circRNA signature, expression status, reference gene, and quality score was conducted. The results showed that circRNA expression status (pooled DOR = 3.67, 95%CI: 1.10–12.28, P = 0.0386), and reference gene (pooled DOR = 0.29, 95%CI: 0.09–0.91, P = 0.0383) were likely to be the sources of heterogeneity (detailed data not shown).

Publication bias

Deeks’ funnel plot asymmetry test showed that no evidence of publication bias (P = 0.37) existed for diagnostic analyses (Fig. 5a and b). Begg’s and Egger’s tests were also performed to assess publication bias among the eligible articles. There was no obvious publication bias in the prognostic effects according to Begg’s test (P = 0.129, or 0.266) (Fig. 5c and d), and Egger’s test (detailed data not shown). Therefore, we excluded the possibility of publication bias.

Fig. 5
figure 5

Publication bias assessed by the Deek’s funnel plot for (a) the overall diagnostic effect, and (b) the down-regulated circRNA profiles for diagnosis. Begg’s test for the (c) up-regulated, and (d) down-regulated circRNA expression profiling in predicting the OS in CRC


CRC is a major cause of cancer-related deaths worldwide [1,2,3,4]. The development of novel diagnostic and prognostic biomarkers to aid the clinical management of CRC is crucial. CircRNAs have been widely recommended as novel diagnostic and prognostic biomarkers in cancers, especially in CRC [9,10,11,12,13,14,15,16,17,18,19,20,21]. However, there are no relevant meta-analyses focused on circRNAs expression in CRC. This study systematically analyzed the clinical, diagnostic, and prognostic significance of abnormally expressed circRNAs in CRC.

Studies have suggested a marked relationship between circRNAs expression and CRC [9,10,11, 13, 14, 16, 19, 20]. In the present study, abnormally expressed circRNAs were found to be associated with tumor diameter, differentiation, lymphatic metastasis, distant metastasis, TNM stage, and depth of invasion, suggesting that dysregulated circRNAs are implicated in the progression of CRC. Significant correlations were not found for age, gender, tumor location, CEA and CA19–9 levels.

The ROC curve is a comprehensive index, which reflects the sensitivity and specificity of continuous variables [27, 28]. Our summary outcomes revealed a moderate diagnostic efficacy for circRNAs expression in CRC, and diagnostic sensitivity was estimated to be 0.77, and specificity was 0.67. The pooled AUC of circRNAs indicated that 78% of randomly chosen CRC patients would have lower or higher levels of circRNA(s) than normal controls. The pooled DOR is also an important indicator that facilitates formal meta-analysis of studies on diagnostic test performance [29, 30]. In the present study, a pooled DOR of 7.52 (higher than 1.0) was obtained, suggesting that dysregulation of circRNA expression is a powerful predictive biomarker for CRC diagnosis. As circRNAs with different expression status may exert different functions in CRC, we conducted subgroup analyses. Stratified analysis based on circRNA expression status showed that circRNAs, which function as tumor promoters, yielded higher efficacy than tumor suppressors, and tissue-based circRNA analysis showed higher diagnostic efficacy than plasma-based analysis. However, the sample size was reduced in the subgroup analyses; thus, the accuracy was compromised. Moreover, when taking conserved sequences and stable structures into consideration, circRNAs may serve as novel noninvasive biomarkers in CRC detection.

Studies have documented that circRNAs with dysregulated expression are emerging as independent risk factors for OS in cancer [31, 32]. Consistent with these data, our pooled effect sizes demonstrated that oncogenic circRNAs overexpression was strongly correlated with decreased OS time in patients with CRC (HR = 2.66, P = 0.000). With regard to the prognostic significance of down-regulated circRNAs (may function as tumor suppressors), we identified one outlier study in the combined effects of decreased circRNAs by sensitivity analysis, and the weighted effect showed that decreased circRNAs expression was associated with improved OS in patients with CRC (HR = 0.30, P = 0.000).

To identify the cause of study heterogeneity, we first performed sensitivity analysis. The results showed that studies were relatively homogeneous in the overall combined diagnostic effect and prognostic effect of oncogenic circRNAs. However, we identified an outlier study in the pooled prognostic significance of down-regulated circRNAs; thus, the effect size was weighted. On the one hand, the meta-regression test further showed that circRNA expression status and the reference gene were likely to be the sources of heterogeneity. We included 13 types of circRNAs with a different expression status in CRC, and the quantitative analysis was based on different reference genes (GAPDH, 18S rRNA, or U6); therefore, the heterogeneity was generated in the pooled effects. On the other hand, neither the Deeks’ funnel plot asymmetry test nor the Egger test and Begg’s funnel plot revealed obvious publication bias for the diagnostic and prognostic meta-analyses, suggesting that all pooled effect sizes were reliable.

Several limitations should be acknowledged in our study. Firstly, although we combined individual studies and increased the number of cases, heterogeneity was observed in some combined effects. Secondly, the small sample size in sub-group analyses as well as the indirectly extracted HR values may increase the insufficiency of statistical power. Finally, population bias may exist in our analyses as most of the studies were conducted in China.


In summary, the results of the meta-analysis revealed that circRNAs are promising diagnostic and prognostic biomarkers in patients with CRC, and may therefore serve as therapeutic target(s). Further prospective studies on more types of circRNAs are warranted in the future.

Availability of data and materials

The data that support the findings of this study are available on request from the corresponding author.



Area under the curve


Colorectal cancer


Diagnostic odds ratio


Hazard ratio


Negative likelihood ratio


Newcastle-Ottawa Scale


Overall survival


Positive likelihood ratio


Quality Assessment for Studies of Diagnostic Accuracy


  1. Siegel RL, Miller KD, Jemal A. Cancer statistics, 2016. CA Cancer J Clin. 2016;66(1):7–30.

    Article  Google Scholar 

  2. Chen W, Zheng R, Baade PD, Zhang S, Zeng H, Bray F, Jemal A, Yu XQ, He J. Cancer statistics in China, 2015. CA Cancer J Clin. 2016;66(2):115–32.

    Article  Google Scholar 

  3. Marventano S, Forjaz M, Grosso G, Mistretta A, Giorgianni G, Platania A, Gangi S, Basile F, Biondi A. Health related quality of life in colorectal cancer patients: state of the art. BMC Surg. 2013;13(Suppl 2):S15.

    Article  Google Scholar 

  4. Vacante M, Borzi AM, Basile F, Biondi A. Biomarkers in colorectal cancer: current clinical utility and future perspectives. World J Clin Cases. 2018;6(15):869–81.

    Article  Google Scholar 

  5. Memczak S, Jens M, Elefsinioti A, Torti F, Krueger J, Rybak A, Maier L, Mackowiak SD, Gregersen LH, Munschauer M, et al. Circular RNAs are a large class of animal RNAs with regulatory potency. Nature. 2013;495(7441):333–8.

    Article  CAS  Google Scholar 

  6. Ebbesen KK, Kjems J, Hansen TB. Circular RNAs: identification, biogenesis and function. Biochim Biophys Acta. 2016;1859(1):163–8.

    Article  CAS  Google Scholar 

  7. Suzuki H, Tsukahara T. A view of pre-mRNA splicing from RNase R resistant RNAs. Int J Mol Sci. 2014;15(6):9331–42.

    Article  CAS  Google Scholar 

  8. Chen S, Li T, Zhao Q, Xiao B, Guo J. Using circular RNA hsa_circ_0000190 as a new biomarker in the diagnosis of gastric cancer. Clin Chim Acta. 2017;466:167–71.

    Article  CAS  Google Scholar 

  9. Wang J, Li X, Lu L, He L, Hu H, Xu Z. Circular RNA hsa_circ_0000567 can be used as a promising diagnostic biomarker for human colorectal cancer. J Clin Lab Anal. 2018;32(5):e22379.

    Article  Google Scholar 

  10. Wang F, Wang J, Cao X, Xu L, Chen L. Hsa_circ_0014717 is downregulated in colorectal cancer and inhibits tumor growth by promoting p16 expression. Biomed Pharmacother. 2018;98:775–82.

    Article  CAS  Google Scholar 

  11. Wang X, Zhang Y, Huang L, Zhang J, Pan F, Li B, Yan Y, Jia B, Liu H, Li S, et al. Decreased expression of hsa_circ_001988 in colorectal cancer and its clinical significances. Int J Clin Exp Pathol. 2015;8(12):16020–5.

    CAS  PubMed  PubMed Central  Google Scholar 

  12. Hsiao KY, Lin YC, Gupta SK, Chang N, Yen L, Sun HS, Tsai SJ. Noncoding effects of circular RNA CCDC66 promote Colon Cancer growth and metastasis. Cancer Res. 2017;77(9):2339–50.

    Article  CAS  Google Scholar 

  13. Zhang P, Zuo Z, Shang W, Wu A, Bi R, Wu J, Li S, Sun X, Jiang L. Identification of differentially expressed circular RNAs in human colorectal cancer. Tumour Biol. 2017;39(3):1010428317694546.

    PubMed  Google Scholar 

  14. Li J, Ni S, Zhou C, Ye M. The expression profile and clinical application potential of hsa_circ_0000711 in colorectal cancer. Cancer Manag Res. 2018;10:2777–84.

    Article  CAS  Google Scholar 

  15. Zeng K, Chen X, Xu M, Liu X, Hu X, Xu T, Sun H, Pan Y, He B, Wang S. CircHIPK3 promotes colorectal cancer growth and metastasis by sponging miR-7. Cell Death Dis. 2018;9(4):417.

    Article  Google Scholar 

  16. Ji W, Qiu C, Wang M, Mao N, Wu S, Dai Y. Hsa_circ_0001649: a circular RNA and potential novel biomarker for colorectal cancer. Biochem Biophys Res Commun. 2018;497(1):122–6.

    Article  CAS  Google Scholar 

  17. Yuan Y, Liu W, Zhang Y, Zhang Y, Sun S. CircRNA circ_0026344 as a prognostic biomarker suppresses colorectal cancer progression via microRNA-21 and microRNA-31. Biochem Biophys Res Commun. 2018;503(2):870–5.

    Article  CAS  Google Scholar 

  18. Fang G, Ye BL, Hu BR, Ruan XJ, Shi YX. CircRNA_100290 promotes colorectal cancer progression through miR-516b-induced downregulation of FZD4 expression and Wnt/beta-catenin signaling. Biochem Biophys Res Commun. 2018;504(1):184–9.

    Article  CAS  Google Scholar 

  19. Li XN, Wang ZJ, Ye CX, Zhao BC, Huang XX, Yang L. Circular RNA circVAPA is up-regulated and exerts oncogenic properties by sponging miR-101 in colorectal cancer. Biomed Pharmacother. 2019;112:108611.

    Article  CAS  Google Scholar 

  20. Zhuo F, Lin H, Chen Z, Huang Z, Hu J. The expression profile and clinical significance of circRNA0003906 in colorectal cancer. Onco Targets Ther. 2017;10:5187–93.

    Article  Google Scholar 

  21. Weng W, Wei Q, Toden S, Yoshida K, Nagasaka T, Fujiwara T, Cai S, Qin H, Ma Y, Goel A. Circular RNA ciRS-7-a promising prognostic biomarker and a potential therapeutic target in colorectal Cancer. Clin Cancer Res. 2017;23(14):3918–28.

    Article  CAS  Google Scholar 

  22. Moher D, Liberati A, Tetzlaff J, Altman DG. Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. J Clin Epidemiol. 2009;62(10):1006–12.

    Article  Google Scholar 

  23. Whiting PF, Rutjes AW, Westwood ME, Mallett S, Deeks JJ, Reitsma JB, Leeflang MM, Sterne JA, Bossuyt PM. QUADAS-2: a revised tool for the quality assessment of diagnostic accuracy studies. Ann Intern Med. 2011;155(8):529–36.

    Article  Google Scholar 

  24. Stang A. Critical evaluation of the Newcastle-Ottawa scale for the assessment of the quality of nonrandomized studies in meta-analyses. Eur J Epidemiol. 2010;25(9):603–5.

    Article  Google Scholar 

  25. Wang Y, Jiang T, Jiang M, Gu S. Appraising growth differentiation factor 15 as a promising biomarker in digestive system tumors: a meta-analysis. BMC Cancer. 2019;19(1):177.

    Article  Google Scholar 

  26. Lei L, Wang J, Zhang L, Chen Y, Yuan P, Liu D. Meta-analysis of the clinical value of abnormally expressed long non-coding RNAs for pancreatic cancer. Oncotarget. 2017;8(51):89149–59.

    Article  Google Scholar 

  27. Li S, Ning Y. Estimation of covariate-specific time-dependent ROC curves in the presence of missing biomarkers. Biometrics. 2015;71(3):666–76.

    Article  Google Scholar 

  28. Liu D, Zhou XH. Semiparametric estimation of the covariate-specific ROC curve in presence of ignorable verification bias. Biometrics. 2011;67(3):906–16.

    Article  Google Scholar 

  29. Bohning D, Holling H, Patilea V. A limitation of the diagnostic-odds ratio in determining an optimal cut-off value for a continuous diagnostic test. Stat Methods Med Res. 2011;20(5):541–50.

    Article  Google Scholar 

  30. Glas AS, Lijmer JG, Prins MH, Bonsel GJ, Bossuyt PM. The diagnostic odds ratio: a single indicator of test performance. J Clin Epidemiol. 2003;56(11):1129–35.

    Article  Google Scholar 

  31. Huang X, Zhang W, Shao Z. Prognostic and diagnostic significance of circRNAs expression in hepatocellular carcinoma patients: a meta-analysis. Cancer Medicine. 2019;8(3):1148–56.

    Article  CAS  Google Scholar 

  32. Huang X, Zhang W, Shao Z. Prognostic and diagnostic significance of circRNAs expression in lung cance r. J Cell Physiol. 2019;234(10):18459-65.

Download references


The authors would like to thank Dr. Panke Su for the useful suggestions to this article.



Author information

Authors and Affiliations



CL and WZZ designed the study; CL, XLH and LLZ collected the literature and conducted the analysis of pooled data; LYL helped to draft the manuscript; CL wrote the manuscript; WZZ proofread, revised and final approved the manuscript; all authors have approved the version to be published.

Corresponding author

Correspondence to Wenzhao Zhao.

Ethics declarations

Ethics approval and consent to participate

Not applicable

Consent for publication

Not applicable

Competing interests

All authors have no competing interests to declare.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (, which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver ( applies to the data made available in this article, unless otherwise stated.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Li, C., He, X., Zhang, L. et al. A pair-wise meta-analysis highlights circular RNAs as potential biomarkers for colorectal cancer. BMC Cancer 19, 957 (2019).

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: