Letter regarding “Association of liver abnormalities with in-hospital mortality in patients with COVID-19”
Authors: Meng-Si Luo, Guan-Jiang Huang
Journal: Journal of Hepatology (2021)

Association of liver abnormalities with in-hospital mortality in patients with COVID-19Journal of HepatologyVol. 74Issue 6PreviewThe evolution and clinical significance of abnormal liver chemistries and the impact of hepatitis B infection on outcome in patients with COVID-19 is not well characterized. This study aimed to explore these issues. Full-Text PDF Reply to: Comments on "Association of liver abnormalities with in-hospital mortality in patients with COVID-19"Journal of HepatologyVol. 75Issue 3PreviewWe thank Singh et al., Horvath et al., and Luo et al. for their comments on our recent study.1 In this study, we focused on investigating the association between abnormal liver chemistries at admission and in-hospital death, rather than the etiology of liver injury in COVID-19. We agree with comments from Singh et al. that liver injury in COVID-19 may not be attributable to COVID-19 infection alone, and associations of hypoxia, systemic inflammation, and hepatotoxic drugs with liver injury were explored in another study from our institute. Full-Text PDF With great enthusiasm, we read a breakthrough study demonstrating the association of liver abnormalities with in-hospital mortality in patients with COVID-19.1Ding Z.Y. Li G.X. Chen L. Shu C. Song J. Wang W. et al.Association of liver abnormalities with in-hospital mortality in patients with COVID-19.J Hepatol. 2021; 74: 1295-1302Abstract Full Text Full Text PDF PubMed Scopus (90) Google Scholar Integrating 10 candidate predictor parameters determined by multivariate regression analyses, Ding and colleagues formulated a novel prognostic nomogram to predict the survival of patients with COVID-19. However, several crucial pitfalls should be taken into account. In the study of Ding et al.,1Ding Z.Y. Li G.X. Chen L. Shu C. Song J. Wang W. et al.Association of liver abnormalities with in-hospital mortality in patients with COVID-19.J Hepatol. 2021; 74: 1295-1302Abstract Full Text Full Text PDF PubMed Scopus (90) Google Scholar a total of 2,073 patients with COVID-19 were involved. Subsequently, 10 candidate predictor parameters (including age, severe pneumonia, lymphocyte count, PLT, CRP, D-dimer, creatinine, cTnl, AST, and D-Bil) were selected to construct the prognostic model and plot the nomogram. However, is the limited sample size large enough to establish the prediction model which can predict the overall survival probability of patients with COVID-19? As a matter of fact, we are skeptical about the reliability of this nomogram. In the authoritative methodological research published in the journal of BMJ, Riley et al.2Riley R.D. Ensor J. Snell K. Harrell F.J. Martin G.P. Reitsma J.B. et al.Calculating the sample size required for developing a clinical prediction model.BMJ. 2020; 368m441Crossref PubMed Scopus (806) Google Scholar pointed out that a robust prediction model should be constructed based on the required sample size that is large enough to sufficiently target precious model prediction and minimize model overfitting. Thus, the required sample size of Ding et al. was calculated according to formulas of Riley et al.2Riley R.D. Ensor J. Snell K. Harrell F.J. Martin G.P. Reitsma J.B. et al.Calculating the sample size required for developing a clinical prediction model.BMJ. 2020; 368m441Crossref PubMed Scopus (806) Google Scholar,3Riley R.D. Snell K.I. Ensor J. Burke D.L. Harrell F.J. Moons K.G. et al.Minimum sample size for developing a multivariable prediction model: PART II–binary and time-to-event outcomes.Stat Med. 2019; 38: 1276-1296Crossref PubMed Scopus (423) Google Scholar Firstly, lnLnull is −5.605(0.010×100×ln(0.010)−0.010×100), and max(R2CS) is 0.106(1−exp(2×(−5.605)100)). Secondly, the conservative value of R2cs is 0.106×8%=0.008. Thirdly, we inputed a key time point to predict the overall survival probability (14 days = 0.038 year), alongside the number of candidate predictor parameters (n = 10), the anticipated mean follow-up (37.81 days = 0.104 year), the mortality rate (0.096), and the conservative value of R2cs (0.008). Finally, the minimum required sample size of 14-day survival prediction for Ding et al.'s study was calculated in Stata software with the following codes: pmsampsize, type(s) rsquared(0.008) parameters(10) rate(0.096) timepoint(0.038) meanfup(0.104) The result is shown in Fig. 1A, indicating that at least 11,200 patients are required for 14-day survival prediction, corresponding to 1,164.8 deaths and an EPP (events per candidate predictor parameter) of 11.18. In addition, the minimum required sample sizes of 21-day and 28-day survival prediction were also calculated (Fig. 1B and C). Therefore, the minimum required sample size to construct the prognostic nomogram should be 11,200 patients, which is much larger than the sample size (2,073 patients) of Ding et al.'s study. Moreover, though the calibration curve showed good consistency, the ROC (receiver operating characteristic) curve and DCA (decision curve analysis) curves were eagerly warranted.4Cook N.R. Use and misuse of the receiver operating characteristic curve in risk prediction.Circulation. 2007; 115: 928-935Crossref PubMed Scopus (1665) Google Scholar,5Vickers A.J. Elkin E.B. Decision curve analysis: a novel method for evaluating prediction models.Med Decis Making. 2006; 26: 565-574Crossref PubMed Scopus (3008) Google Scholar The ROC curve can evaluate the discriminative ability of the nomogram, while the DCA curve can evaluate the clinical usefulness of the nomogram. Furthermore, Ding et al.'s nomogram would be more valuable if they applied the disease-specific survival to establish the prognostic nomogram.6Burke H.B. Overall survival vs disease-specific survival.JAMA Oncol. 2018; 4: 586Crossref PubMed Scopus (6) Google Scholar After all, the overall survival may be impacted by other factors except for COVID-19. We appreciate Ding et al. for their vital thoughts on the association between liver abnormalities and COVID-19, which has paved a novel way to predict the overall survival probability of patients with COVID-19. However, the minimum required sample size to construct the prognostic nomogram in Ding et al.'s study should be 11,200 patients. The discriminative ability and the clinical usefulness of the nomogram were definitely necessary. Consequently, these above issues may strongly impact the reliability and applicability of Ding et al.'s nomogram. The authors received no financial support to produce this manuscript. G-J.H and M-S.L designed the letter; M-S.L wrote the letter; G-J.H revised the letter. The authors declare no conflicts of interest that pertain to this work. Please refer to the accompanying ICMJE disclosure forms for further details. We are grateful to Dr. Hui-Zi Li for his professional support. We are grateful to Dr. Li-Lan Lei (my English teacher), Dr. Ling-Jun Wang, and Dr. Chen-Yang Huang for proofreading and editing. The following is the supplementary data to this article: Download .pdf (.15 MB) Help with pdf files Multimedia component 1