- Primary research
- Open Access
Integrated nomogram based on five stage-related genes and TNM stage to predict 1-year recurrence in hepatocellular carcinoma
Cancer Cell International volume 20, Article number: 140 (2020)
The primary tumor, regional lymph nodes and distant metastasis (TNM) stage is an independent risk factor for 1-year hepatocellular carcinoma (HCC) recurrence but has insufficient predictive efficiency. We attempt to develop and validate a nomogram to predict 1-year recurrence in HCC and improve the predictive efficiency of the TNM stage.
A total of 541 HCC patients were enrolled in the study. The risk score (RS) model was established with the logistic least absolute shrinkage and selector operation algorithm. The predictive nomogram was further validated in the internal testing cohort and external validation cohort. The area under the receiver operating characteristic curves (AUCs), decision curves and clinical impact curves were used to evaluate the predictive accuracy and clinical value of the nomogram.
In the training cohort, we identified a RS model consisting of five stage-related genes (NUP62, EHMT2, RANBP1, MSH6 and FHL2) for recurrence at 1 year. The 1-year disease-free survival of patients was worse in the high-risk group than in the low-risk group (P < 0.0001), and 1-year recurrence was more likely in the high-risk group (Hazard ratio: 3.199, P < 0.001). The AUC of the nomogram was 0.739, 0.718 and 0.693 in the training, testing and external validation cohort, respectively, and these values were larger than the corresponding AUC of the TNM stage (0.681, 0.688 and 0.616, respectively).
A RS model consisting of five stage-related genes was successfully identified for predicting 1-year HCC recurrence. Then, a novel nomogram based on the RS model and TNM stage to predict 1-year HCC recurrence was also developed and validated.
Primary liver cancer is predicted to be the sixth leading diagnosed cancer and the fourth leading cause of cancer-related death worldwide. In 2018, an estimated 841,080 new cases of liver cancer (4.7% of all sites) occurred around the world, while approximately 781,631 deaths (8.2%) occurred. Hepatocellular carcinoma (HCC) is the most common pathological type (75–85%) of primary liver cancer . Currently, surgical resection is considered the dominant curative treatment for resectable HCC, compared with other treatments, such as radiofrequency ablation (RFA), transcatheter arterial chemoembolization (TACE) and transplantation . Although the overall survival (OS) of HCC patients could be improved by surgical resection, approximately 60% of patients experience recurrence or distant metastasis after surgery [3, 4]. Postoperative recurrence can be categorized as early or late; the former is much more common and indicates a worse prognosis along with aggressive biological characteristics of the tumor . Early recurrence (< 1 year) after liver resection for HCC is the leading cause of death during the first 2 years  and represents an risk factor for poor survival . Therefore, it is essential to determine available predictors of early recurrence so that therapeutic and follow-up management strategies can be adjusted to possibly prevent HCC relapse.
According to the seventh edition cancer staging manual of the American Joint Committee on Cancer (AJCC), the stage of HCC samples ranges from stage I to stage IV with increasing malignancy . The primary tumor, regional lymph nodes and distant metastasis (TNM) stage has been found to have predictive value for early recurrence . However, The Cancer Genome Atlas (TCGA) liver hepatocellular carcinoma (LIHC) cohort shows that the predictive efficiency of the TNM stage, which is an independent risk factor for early HCC recurrence, is still insufficient, resulting in limited utility of the TNM stage as a predictor for early recurrence. Therefore, a risk score (RS) model for 1-year HCC recurrence was developed by the logistic least absolute shrinkage and selector operation (LASSO) algorithm in our study, as the four-gene signature for HCC successfully identified in our previous study . The nomogram is a clear and simple computing model that is used to change the weight of risk factors for the study endpoint into visually linear points . To date, no nomogram combining an RS model and the TNM stage has been applied to predict 1-year HCC recurrence. Therefore, we used HCC samples from the TCGA to establish the RS model and nomogram. In addition, to illustrate the clinical utility of the model, decision curve analysis (DCA) and clinical impact curve analysis were implemented.
Nowadays, the detective methods have become more and more abundant, such as the development of primer kits for some specific genes or non-coding RNAs, and the application of RNA sequencing or gene microarray technology. All of them could have important roles for predicting the prognosis of patients. However, because of the longer time and higher cost of RNA sequencing or microarray, HCC patients would rather to choose a detective method which is faster, more economical and more feasible. Through the screening of global public data, five genes that significant for 1-year recurrence of HCC recurrence were found. By establishing a RS model and constructing a nomogram, we could predict 1-year recurrence of HCC patients and visualize it in a simple way.
Our study aimed to establish a validated, novel nomogram based on the RS model and TNM stage to predict 1-year recurrence in HCC and improve the predictive efficiency of the TNM stage.
Patients and data collection
The discovery cohort contained 60 HCC samples from Iizuka liver 2, a dataset of the Oncomine database (https://www.oncomine.org). We downloaded the mRNA high-throughput sequencing data and clinical data of 374 HCC samples and 50 normal samples from the TCGA (https://portal.gdc.cancer.gov/). After excluding samples with missing information, such as the disease-free survival (DFS) time, TNM stage and histological grade, the remaining number of samples in the entire TCGA LIHC cohort was 274. The samples were randomly assigned to a training cohort with N × q samples and a testing cohort with N × (1 − q) samples (q = 2/3). We further searched for an external validation cohort and used 107 HCC samples with recurrence-free survival data from GSE76427 to validate our results. Microarray data and patient clinical information of GSE76427 were downloaded from the Gene Expression Omnibus database (GEO, https://www.ncbi.nlm.nih.gov/geo/).
Identification of differentially expressed genes (DEGs)
We downloaded the DEGs related to recurrence at 1 year (P < 0.01) and advanced stages (P < 0.01) from the Oncomine database, Iizuka liver 2. The DEGs related to recurrence at 1 year were generated from the microarray data of 20 patients with 1-year recurrence versus 40 patients without 1-year recurrence. Similarly, the DEGs related to advanced stages consisted of the microarray data of 10 patients with stage III disease versus 50 patients with stage I/II disease. All upregulated and downregulated genes filtered by combinational analysis of DEGs related to recurrence at 1 year and advanced stages were defined as DEGs related to recurrence at 1 year and advanced stages. In addition, tumor/normal DEGs were identified as those showing a fold change (FC) ≥ 1.5 and P value < 0.05 among the 374 tumor tissues and 50 normal tissues in the TCGA LIHC cohort. We identified tumor/normal DEGs using gene expression profiling interactive analysis (GEPIA, http://gepia.cancer-pku.cn/). Finally, the DEGs screened by 1-year DFS analysis (P < 0.05) were identified as stage-related genes. All DEGs were listed in Additional file 1: Table S1.
Survival analysis and gene set enrichment analysis (GSEA)
One-year DFS analysis (Kaplan–Meier analysis) in the training cohort and determination of the best cutoff value of the RS were both performed in X-tile (version 3.6.1). SangerBox (version 1.0.9) was used for the GSEA of different Kyoto Encyclopedia of Genes and Genomes (KEGG) pathways (P < 0.05) between the high-risk group and the low-risk group.
Development of the RS model
To illustrate significant values for the 16 stage-related genes, we used the LASSO algorithm to filter candidate genes that were reliably associated with 1-year HCC recurrence in the training cohort. LASSO penalized regression was conducted in R studio (version 3.6.1) with the glmnet package. The RS was calculated using the sum of the screened stage-related gene expression values weighted by the coefficients (β) from the LASSO regression model. We calculated the prognostic RS for each patient according to the following formula [12, 13]:
Construction and validation of nomogram
We used univariate and multivariate Cox analyses to identify independent risk factors for predicting 1-year HCC recurrence in the training cohort. The nomogram was constructed in R studio (Version 3.6.1) with the rms, foreign, nricens and ROCR packages [14, 15]. The term “Points” represents the score of each variable under different values, while “Total Points” means the total score of the collection after the sum of the corresponding individual fractions of all variables. And the term “Linear Predictor” is a coordinate axis of the linear predicted value. The linear predicted value is converted to the corresponding probability value by a certain transformation function. The testing cohort and external validation cohort were used to evaluate the predictive reliability and accuracy of the nomogram. The predictive performance of the nomogram was measured by receiver operating characteristic (ROC) curve analysis, DCA and clinical impact curve analysis. ROC curve analysis was performed by MedCalc (version 15.6.1), while DCA and clinical impact curve analysis were also accomplished in R studio with the rmda package. The clinical utility of the nomogram was determined by DCA after calculating the net benefits at each risk threshold probability [16, 17]. Additionally, we plotted the clinical impact curve of the nomogram in all three cohorts to demonstrate the significance of the nomogram .
Univariate and multivariate Cox regression analyses were performed in IBM SPSS Statistics (version 24), which was also used to generate hazard ratios (HRs) and 95% confidence intervals (CIs). All variables were screened using the forward stepwise selection method in a multivariate binary logistic regression model . Kaplan–Meier survival curves were used to estimate 1-year DFS, and survival differences were assessed by a two-sided log-rank test in GraphPad Prism (version 6.0). All statistical tests were two-sided, and a P-value < 0.05 was considered statistically significant.
Independent risk factors for 1-year recurrence
First, we calculated the rate of 1-year recurrence, 2-year recurrence and overall recurrence in the TCGA HCC samples with DFS data (n = 274). A total of 33.9% (93/274) of the samples showed HCC recurrence at 1 year, 45.6% (125/274) showed HCC recurrence at 2 years, and the overall rate of HCC recurrence was 54.4% (149/274). Among 149 samples that showed recurrence, more samples showed recurrence within 1 year (62.4%, 93/149) than between 1 and 2 years (21.4%, 32/149). In these 149 samples, the time to recurrence ranged from 0.12 to 90.08 months, and the median time to recurrence was 8.75 months (Fig. 2a). Therefore, we considered that it was more suitable and accurate to define early recurrence by recurrence at 1 year in the TCGA cohort.
To identify risk factors for 1-year recurrence in the TCGA LIHC samples, we evaluated clinical characteristics by univariate Cox analysis (Additional file 1: Table S2) and plotted them, as shown in Fig. 2b. We found that the TNM stage was the only risk factor for 1-year recurrence with a significant difference. Compared with stage I, the HR (95% CI) of stage II, stage III and stage IV was 1.964 (1.301–2.965), 2.778 (1.898–4.065) and 5.787 (1.396–23.979), respectively. All of the P-values were less than 0.05. However, the area under the ROC curves (AUC) of the TNM stage in predicting 1-year recurrence was 0.651, which was still considered to represent low predictive efficacy (Fig. 2c). Therefore, different analyses of DEGs, as shown in the flowchart (Fig. 1), were performed in our study with the aim of enhancing the predictive efficacy of the TNM stage.
Stage-related gene identification
First, we downloaded DEGs related to recurrence at 1 year (P < 0.01) and advanced stages (P < 0.01) from the Oncomine database, Iizuka liver 2. After combinational analyses of the upregulated and downregulated DEGs, there were 32 upregulated and 30 downregulated genes related to recurrence at 1 year and advanced stages (Fig. 2d) in the discovery cohort. Next, we used GEPIA to analyze DEGs between tumors and normal tissues among the 374 tumor tissues and 50 normal tissues in the TCGA LIHC cohort (Fig. 2e). Twenty-seven tumor/normal DEGs remained after screening by FC ≥ 1.5 and P-value < 0.05. For predicting 1-year recurrence more precisely, every single DEG involved in subsequent analysis should be correlated with 1-year DFS in the TCGA training cohort (n = 182). The clinical characteristics of the training and testing cohorts are shown in Table 1, and there were no significant differences in characteristics between the two cohorts. The high expression of upregulated DEGs was considered to be positively correlated with poor 1-year DFS, as was the low expression of downregulated DEGs. Finally, 16 stage-related genes, including 13 upregulated genes and three downregulated genes, were identified by significant differences (P < 0.05) in the 1-year DFS analysis. All DEG lists are shown in Additional file 1: Table S1.
RS model building in the training cohort
Sixteen stage-related genes were identified after the combinational analysis, differential expression analysis of tumor/normal samples and 1-year DFS analysis. Then, the LASSO regression model was used to further identify candidate genes associated with 1-year HCC recurrence in the TCGA training cohort. As a result, 5 genes were identified: NUP62, EHMT2, RANBP1, MSH6 and FHL2 (Fig. 3a, b). Among them, NUP62, EHMT2, RANBP1 and MSH6 were upregulated stage-related genes, while FHL2 was a downregulated stage-related gene. We further established an RS model with each gene coefficient weighted by LASSO regression. The RS was calculated for each patient in the training cohort as follows:
After evaluating the RS for each patient in the training cohort, we used X-tile to determine the best cutoff value for the RS (9.251). A total of 112 HCC samples were assigned to the low-risk group, while the high-risk group contained 70 samples. Patients in the high-risk group exhibited worse 1-year DFS than those in the low-risk group, as shown in Fig. 3c (P < 0.0001). In addition, the expression levels of NUP62, EHMT2, RANBP1 and MSH6 were higher in the high-risk group than in the low-risk group, while FHL2 exhibited lower expression in the high-risk group (Fig. 3d). Moreover, the DEGs (P < 0.05) between the high-risk group and the low-risk group were screened for further GSEA of different KEGG pathways. There were five GSEA reports with a significant difference [False discovery rate (FDR) < 0.05], including DNA replication, cell cycle, mismatch repair, oocyte meiosis and homologous recombination (Additional file 2: Figure S1a–d). Among them, the DNA replication KEGG pathway possessed the highest enrichment score (ES) (Fig. 3e).
Development of nomogram based on TNM stage and RS
Although the RS could successfully distinguish good or poor 1-year DFS between the high-risk group and the low-risk group, the most important purpose of our study was to enhance the predictive efficacy for 1-year recurrence of the TNM stage. It was necessary to perform univariate and multivariate Cox analyses of 1-year recurrence in the training cohort (Table 2). We found that sex (male vs female), TNM stage (stage II vs stage I, stage III vs stage I and stage IV vs stage I) and RS (high vs low) were independent risk factors for 1-year recurrence. However, sex (HR: 0.670, 95% CI 0.397–1.129), stage II (1.949, 0.962–3.949) and stage IV (6.424, 0.816–50.602) were censored in the multivariate Cox analysis (P = 0.132, 0.064 and 0.077). The RS exhibited a similar contribution (HR: 3.199, 95% CI 1.891–5.411) as stage III (2.911, 1.616–5.243). Therefore, we developed a nomogram to predict 1-year HCC recurrence based on the TNM stage and RS, as identified in the multivariate Cox analysis (Fig. 4). According to the nomogram, more total points indicates a greater probability of 1-year DFS. Point assignments and predictive scores for each factor in the nomogram were calculated, as shown in Additional file 1: Table S3. The total points range from zero to 143.6 and the 1-year disease-free probability ranges from 0.3 to 0.9. On the basis of high RS and stage IV both corresponding to zero point, the HCC patient with high-risk of RS and stage IV of TNM stage would gain a total point of “0” which represented the 1-year disease-free probability were as worst as 0.3. On the contrary, the low RS and stage I mean higher point, so that the HCC patient with low-risk of RS and stage I of TNM stage would possess a 1-year disease-free probability which more than 0.9.
Nomogram validation and clinical utility
Validation was also necessary after development of the nomogram. First, to compare the predictive values for 1-year recurrence of the nomogram, i.e., the TNM stage and RS, we applied ROC curve analysis. In the plotted ROC curves of the training cohort (Fig. 5a), the AUC of the nomogram was 0.739 (95% CI 0.669–0.801), larger than the AUC of the TNM stage (0.681, 0.608–0.748) and RS (0.667, 0.593–0.735). DCA was performed for the nomogram and TNM stage (Fig. 5d) in the training cohort. A high-risk threshold of 0–0.7 was the most beneficial for predicting 1-year recurrence with our nomogram, which was better than that of the TNM stage. In addition, based on the nomogram DCA, we further plotted curves to evaluate the clinical impact of the nomogram to help us more intuitively understand their substantial value. Clinical impact curves of the nomogram in the training cohort (Fig. 5g) illustrated that the model had remarkable predictive power: the predicted number of high-risk patients was always greater than the number of high-risk patients with 1-year recurrence when the high-risk threshold was in the range of 0–0.7, and the cost–benefit ratio would be acceptable in the same range. In addition, the RS of each patient in the testing cohort and the external validation cohort was also calculated and divided into two groups by the best cutoff value. The AUC of the nomogram in the testing cohort (0.718, 0.615–0.807) and the external validation cohort (0.693, 0.597–0.779), as well as the training cohort, was larger than that of the TNM stage and RS (Fig. 5b, c). We considered that the predictive efficacy of the nomogram was better than that of the TNM stage and RS, and it was successful in enhancing the predictive efficacy of the TNM stage for 1-year recurrence. Compared with the TNM stage, the nomogram showed more benefits in predicting 1-year recurrence by DCA (Fig. 5e, f). However, the high-risk threshold in the external validation cohort ranged from 0 to 0.57, which was smaller than the high-risk threshold in the testing cohort (0–0.8). Clinical impact curves revealed remarkable predictive power for the nomogram. We could declare that the novel nomogram to predict 1-year recurrence was reliably validated by internal and external validation cohorts and had good clinical utility.
Liver cancer ranked sixth in terms of incidence but third in terms of mortality worldwide in 2018, notably ranking fifth in terms of global cases and second in terms of deaths among males . The high mortality rate of HCC is partly due to the incidence of recurrence, among which early recurrence is more common. Nonetheless, there is no consensus regarding the term “early recurrence”. In some previous studies, a period ranging from 6 months to 2 years after curative hepatectomy has been used as a cutoff to define early and late recurrence [20,21,22]. A study aiming to clarify the optimal duration of early and late recurrence of HCC claimed that 17 months was the best cutoff value , which is in contrast with another paper noting that early recurrence likely occurs earlier than previously thought, at 1 or 2 years after hepatectomy . In this case, we decided to determine which threshold was more suitable and accurate in the TCGA cohort.
In our study, almost two-thirds of the samples (62.4%) showed recurrence at 1 year among 149 samples from the overall TCGA cohort with recurrence. The time to recurrence ranged from 0.12 to 90.08 months, and the median time to recurrence was 8.75 months in the 149 samples showing recurrence. These data strongly support the definition of early recurrence as recurrence by 1 year in the TCGA cohort.
Our univariate Cox analysis showed that the TNM stage was a significant independent risk factor for 1-year HCC recurrence. The predictive ability of the TNM stage for tumor recurrence has already been assessed in several types of cancer, such as eyelid carcinoma , thymic epithelial tumors  and lung cancer , and a model has been established combining the TNM stage and tumor size to predict recurrence among HCC patients . However, the AUC of the TNM stage to predict 1-year recurrence in our study demonstrated low predictive efficacy. As a result, we analyzed DEGs related to 1-year recurrence and advanced stages in the Oncomine database. Sixteen stage-related genes were identified after combinational analysis, differential expression analysis of tumor/normal samples and 1-year DFS analysis.
Using the LASSO regression model, an optimal subset of gene-based signatures associated with 1-year HCC recurrence in the TCGA training cohort was selected, among which NUP62, EHMT2, RANBP1, and MSH6 were upregulated and FHL2 was downregulated. NUP62 can promote cell proliferation in squamous cell carcinoma , EHMT2 contributes to tumor aggressiveness , RANBP1 affects the mitotic microtubule activity and Taxol sensitivity of cancer cells , and MSH6 is associated with a poor prognosis in several types of cancer , while FHL2 is a negative regulator of TGF-β1 transcription in the liver and plays a suppressive role in HCC metastasis [33, 34]. Based on these previous studies and the RS model established with each gene coefficient weighted by LASSO regression, we considered that the four upregulated genes are likely tumor promoters and that the remaining downregulated gene is a protective gene in HCC.
There have also been several studies on predicting 1-year recurrence in HCC. Zhen Zhang and his group constructed a radiomic nomogram based on gadoxetic acid-enhanced MRI for predicting early postoperative recurrence in HCC . Ying Zhou et al.  built a CT-based radiomic signature to identify potential biomarkers for the preoperative prediction of early recurrence in HCC. Another study concluded that tissue miR-125b-5p expression and intrahepatic metastasis were useful for stratifying patients at risk of early HCC recurrence after curative resection . To date, no nomograms based on an RS and the TNM stage have been established for predicting 1-year HCC recurrence.
Therefore, a nomogram was constructed and validated to enhance the predictive efficacy for 1-year recurrence of the TNM stage by incorporating both the RS and TNM stage. The nomogram demonstrated better diagnostic efficiency, as shown by ROC curves and DCA, than the TNM stage and RS in the training and testing cohorts, as well as the external validation cohort. Clinical impact curves also showed that the nomogram had remarkable predictive power and exhibited good clinical utility. In addition, the high-risk threshold of our nomogram ranged from 0 to 0.7 in the training cohort, 0–0.8 in the testing cohort, and 0–0.57 in the external validation cohort according to the nomogram DCA.
Our nomogram based on the RS of five stage-related genes and the TNM stage, a combination of clinical variables and genetic markers, is a novel, reliable and validated model for predicting 1-year recurrence after hepatectomy in HCC. Since TNM stage is an acknowledged staging system worldwide for HCC, and the patients enrolled in our study contain different races and different nationalities such as Japan, America and Singapore. We considered that the nomogram itself had a popularity to some extent. However, we further believed that the nomogram might be applied and validated in different institutions with a larger sample size, so as to truly demonstrate its general applicability. Fortunately, the TNM stage is the basic diagnostic information that can be acquired conveniently, and the expression levels of genes are also easy to be detected. Our nomogram has the potential to become convenient and feasible in clinical practice. However, since the training and testing cohorts in our study were derived from the same TCGA dataset, this could lead to overfitting of the model. And the insufficient of sample size was considered as a significant factor in our nomogram. Additional validation at our hospital or another institution should be performed to verify the availability and accuracy of our model.
In conclusion, after different analyses of DEGs in the Oncomine dataset based on expression and survival, we screened 16 stage-related genes related to 1-year recurrence. We further applied the LASSO algorithm to develop an RS model consisting of five stage-related genes, which showed an excellent capacity to distinguish 1-year DFS between the high-risk group and the low-risk group. A nomogram based on the RS model and TNM stage for predicting 1-year recurrence was constructed in the training cohort. Moreover, the AUC of the nomogram in the internal testing cohort and the external validation cohort demonstrates that it performs well and has acceptable accuracy and reliability. Our nomogram was demonstrated to be clinically useful by DCA and clinical impact curve analysis. We believe that our nomogram could help clinicians provide improved individual treatment and make clinical decisions, as well as guide follow-up management strategies, for HCC patients who are predicted to have a high probability of 1-year recurrence.
Availability of data and materials
The data downloaded from the Oncomine database was needed a paid personal account. The other data were available in the LIHC dataset from the TCGA database and the GSE76427 dataset from the GEO database.
Transcatheter arterial chemoembolization
American Joint Committee on Cancer
Primary tumor, regional lymph nodes and distant metastasis
The Cancer Genome Atlas
Liver hepatocellular carcinoma
Least absolute shrinkage and selector operation
Decision curve analysis
Gene Expression Omnibus
Different expression genes
Gene Expression Profiling Interactive Analysis
Gene set enrichment analysis
Receiver operating characteristic
Area under the receiver operating characteristic curve
False discovery rate
Bray F, Ferlay J, Soerjomataram I, Siegel RL, Torre LA, Jemal A. Global cancer statistics 2018: gLOBOCAN estimates of incidence and mortality worldwide for 36 cancers in 185 countries. CA Cancer J Clin. 2018;68(6):394–424.
Forner A, Reig M, Bruix J. Hepatocellular carcinoma. Lancet. 2018;391(10127):1301–14.
Tabrizian P, Jibara G, Shrager B, Schwartz M, Roayaie S. Recurrence of hepatocellular cancer after resection. Ann Surg. 2015;261(5):947–55.
Bruix J, Gores GJ, Mazzaferro V. Hepatocellular carcinoma: clinical frontiers and perspectives. Gut. 2014;63(5):844–55.
Poon RT. Differentiating early and late recurrences after resection of HCC in cirrhotic patients: implications on surveillance, prevention, and treatment strategies. Ann Surg Oncol. 2009;16(4):792–4.
Shah SA, Greig PD, Gallinger S, Cattral MS, Dixon E, Kim RD, Taylor BR, Grant DR, Vollmer CM. Factors associated with early recurrence after resection for hepatocellular carcinoma and outcomes. J Am Coll Surg. 2006;202(2):275–83.
Poon RT-P, Fan S-T, Ng IO-L, Lo C-M, Liu C-L, Wong J. Different risk factors and prognosis for early and late intrahepatic recurrence after resection of hepatocellular carcinoma. Am Cancer Soc. 2000;89:500–7.
Edge SB, Cancer. A.J.C.o., and Society. A.C. AJCC cancer staging handbook: from the AJCC cancer staging manual. 7th ed. New York: Springer; 2010.
Cheng Z, Yang P, Qu S, Zhou J, Yang J, Yang X, Xia Y, Li J, Wang K, Yan Z, Wu D, Zhang B, Huser N, Shen F. Risk factors and management for early and late intrahepatic recurrence of solitary hepatocellular carcinoma after curative resection. HPB (Oxford). 2015;17(5):422–7.
Yan Y, Lu Y, Mao K, Zhang M, Liu H, Zhou Q, Lin J, Zhang J, Wang J, Xiao Z. Identification and validation of a prognostic four-genes signature for hepatocellular carcinoma: integrated ceRNA network analysis. Hep Intl. 2019;13(5):618–30.
Yan Y, Liu H, Mao K, Zhang M, Zhou Q, Yu W, Shi B, Wang J, Xiao Z. Novel nomograms to predict lymph node metastasis and liver metastasis in patients with early colon carcinoma. J Transl Med. 2019;17(1):193.
Friedman J, Hastie T, Tibshirani R. Regularization paths for generalized linear models via coordinate descent. J Stat Softw. 2010;33(1):1–22.
Tibshirani R, Bien J, Friedman J, Hastie T, Simon N, Taylor J, Tibshirani RJ. Strong rules for discarding predictors in lasso-type problems. J R Stat Soc B. 2012;74:1–22.
Sauerbrei W, Boulesteix AL, Binder H. Stability investigations of multivariable regression models derived from low- and high-dimensional data. J Biopharm Stat. 2011;21(6):1206–31.
Collins GS, Reitsma JB, Altman DG, Moons KG. Transparent reporting of a multivariable prediction model for individual prognosis or diagnosis (TRIPOD): the TRIPOD statement. BMJ. 2015;350:g7594.
Vickers AJ, Elkin EB. Decision curve analysis: a novel method for evaluating prediction models. Med Decis Mak. 2006;26(6):565–74.
Vickers AJ, Cronin AM, Elkin EB, Gonen M. Extensions to decision curve analysis, a novel method for evaluating diagnostic tests, prediction models and molecular markers. BMC Med Inform Decis Mak. 2008;8:53.
Kerr KF, Brown MD, Zhu K, Janes H. Assessing the clinical impact of risk prediction models with decision curves: guidance for correct interpretation and appropriate use. J Clin Oncol. 2016;34(21):2534–40.
Gao J, Kwan PW, Shi D. Sparse kernel learning with LASSO and Bayesian inference algorithm. Neural Netw. 2010;23(2):257–64.
Hirokawa F, Hayashi M, Asakuma M, Shimizu T, Inoue Y, Uchiyama K. Risk factors and patterns of early recurrence after curative hepatectomy for hepatocellular carcinoma. Surg Oncol. 2016;25(1):24–9.
Lu X, Zhao H, Yang H, Mao Y, Sang X, Miao R, Xu Y, Du S, Xu H, Chi T, Yang Z, Zhong S, Huang J. A prospective clinical study on early recurrence of hepatocellular carcinoma after hepatectomy. J Surg Oncol. 2009;100(6):488–93.
Colecchia A, Schiumerini R, Cucchetti A, Cescon M, Taddia M, Marasco G, Festi D. Prognostic factors for hepatocellular carcinoma recurrence. World J Gastroenterol. 2014;20:5935–50.
Yamamoto Y. Optimal duration of the early and late recurrence of hepatocellular carcinoma after hepatectomy. World J Gastroenterol. 2015;21(4):1207–15.
Lee KF, Chong CCN, Fong AKW, Fung AKY, Lok HT, Cheung YS, Wong J, Lai PBS. Pattern of disease recurrence and its implications for postoperative surveillance after curative hepatectomy for hepatocellular carcinoma: experience from a single center. Hepatobil Surg Nutr. 2018;7(5):320–30.
Sun MT, Andrew NH, O’Donnell B, McNab A, Huilgol SC, Selva D. Periocular Squamous cell carcinoma: TNM staging and recurrence. Ophthalmology. 2015;122(7):1512–6.
Yun JK, Lee GD, Kim HR, Kim DK, Zo JI, Shim YM, Kang CH, Kim YT, Paik HC, Chung KY, other members of the Korean Association for Research on the T. A nomogram for predicting recurrence after complete resection for thymic epithelial tumors based on the TNM classification: a multi-institutional retrospective analysis. J Surg Oncol. 2019;119(8):1161–9.
Pepek JM, Chino JP, Marks LB, D’Amico TA, Yoo DS, Onaitis MW, Ready NE, Hubbs JL, Boyd J, Kelsey CR. How well does the new lung cancer staging system predict for local/regional recurrence after surgery? A comparison of the TNM 6 and 7 systems. J Thoracic Oncol. 2011;6(4):757–61.
Zhang Y, Chen SW, Liu LL, Yang X, Cai SH, Yun JP. A model combining TNM stage and tumor size shows utility in predicting recurrence among patients with hepatocellular carcinoma after resection. Cancer Manag Res. 2018;10:3707–15.
Hazawa M, Lin DC, Kobayashi A, Jiang YY, Xu L, Dewi FR, Mohamed MS, Nakada M, Meguro-Horike M, Horike SI, Koeffler HP. ROCK-dependent phosphorylation of NUP62 regulates p63 nuclear transport and squamous cell carcinoma proliferation. EMBO Rep. 2017;19(1):73–88.
Mayr C, Helm K, Jakab M, Ritter M, Shrestha R, Makaju R, Wagner A, Pichler M, Beyreis M, Staettner S, Jaeger T, Klieser E, Kiesslich T, Neureiter D. The histone methyltransferase G9a: a new therapeutic target in biliary tract cancer. Hum Pathol. 2018;72:117–26.
Amato R, Scumaci D, D’Antona L, Iuliano R, Menniti M, Di Sanzo M, Faniello MC, Colao E, Malatesta P, Zingone A, Agosti V, Costanzo FS, Mileo AM, Paggi MG, Lang F, Cuda G, Lavia P, Perrotti N. Sgk1 enhances RANBP1 transcript levels and decreases taxol sensitivity in RKO colon carcinoma cells. Oncogene. 2013;32(38):4572–8.
Cheng DD, Lin HC, Li SJ, Yao M, Yang QC, Fan CY. CSE1L interaction with MSH6 promotes osteosarcoma progression and predicts poor patient survival. Sci Rep. 2017;7:46238.
Dahan J, Levillayer F, Xia T, Nouët Y, Werts C, d’Andon MF, Adib-Conquy M, Cassard-Doulcier AM, Khanna V, Chen J, Tordjmann T. Lim-only protein Fhl2 is a negative regulator of transforming growth factor Β1 expression. Mol Cell Biol. 2017;37(10):e00636–16.
Shao C, Qiu Y, Liu J, Feng H, Shen S, Saiyin H, Yu W, Wei Y, Yu L, Su W, Wu J. PARP12 (ARTD12) suppresses hepatocellular carcinoma metastasis through interacting with FHL2 and regulating its stability. Cell Death Dis. 2018;9(856):1–14.
Zhang Z, Jiang H, Chen J, Wei Y, Cao L, Ye Z, Li X, Ma L, Song B. Hepatocellular carcinoma: radiomics nomogram on gadoxetic acid-enhanced MR imaging for early postoperative recurrence prediction. Cancer Imag. 2019;19(1):22.
Zhou Y, He L, Huang Y, Chen S, Wu P, Ye W, Liu Z, Liang C. CT-based radiomics signature: a potential biomarker for preoperative prediction of early recurrence in hepatocellular carcinoma. Abdom Radiol (NY). 2017;42(6):1695–704.
Shimagaki T, Yoshizumi T, Harimoto N, Yoshio S, Naito Y, Yamamoto Y, Ochiya T, Yoshida Y, Kanto T, Maehara Y. MicroRNA-125b expression and intrahepatic metastasis are predictors for early recurrence after hepatocellular carcinoma resection. Hepatol Res. 2018;48(4):313–21.
We thank the Oncomine dataset (Iizuka liver 2), TCGA database and GEO dataset (GSE76427) for providing platforms and valuable data sets.
This work was supported by the National Natural Science Foundation of China (No. 81572407, 81602112, 81672405, 81702404); Science and Technology Program of Guangdong Province, China (No.2015A030313096, 2016A030313184, 2017A030313536, 2019A1515011418, 2019A1515011195); Young teachers training program of Sun Yat-sen University (19ykpy112); Grant 163 from Key Laboratory of Malignant Tumor Molecular Mechanism and Translational Medicine of Guangzhou Bureau of Science and Information Technology; Grant KLB09001 from the Key Laboratory of Malignant Tumor Gene Regulation and Target Therapy of Guangdong Higher Education Institutes. Grant from Guangdong Science and Technology Department (2017B030314026).
Ethics approval and consent to participate
The data obtained in this study were rooted mainly in the public Oncomine, TCGA and GEO databases, which are open access.
Consent for publication
The authors declare that they have no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
About this article
Cite this article
Liu, H., Yan, Y., Chen, R. et al. Integrated nomogram based on five stage-related genes and TNM stage to predict 1-year recurrence in hepatocellular carcinoma. Cancer Cell Int 20, 140 (2020). https://doi.org/10.1186/s12935-020-01216-9
- Hepatocellular carcinoma
- 1-year recurrence
- Risk score model
- TNM stage