# Comparison of seven comorbidity scores on four-month survival of lung cancer patients

Hélène Pluchart, Sébastien Bailly, Sébastien Chanoine, Denis Moro-Sibilot, Pierrick Bedouch, Anne-Claire Toffart

► To cite this version:

Hélène Pluchart, Sébastien Bailly, Sébastien Chanoine, Denis Moro-Sibilot, Pierrick Bedouch, et al. Comparison of seven comorbidity scores on four-month survival of lung cancer patients. BMC Medical Research Methodology, 2023, 23 (1), pp.256. 10.1186/s12874-023-01994-6. hal-04813079

HAL Id: hal-04813079

https://hal.science/hal-04813079v1

Submitted on 15 Dec 2024

HAL is a multi-disciplinary open access
archive for the deposit and dissemination of sci-
entific research documents, whether they are pub-
lished or not. The documents may come from
teaching and research institutions in France or
abroad, or from public or private research centers.

L'archive ouverte pluridisciplinaire HAL, est
destinée au dépôt et à la diffusion de documents
scientifiques de niveau recherche, publiés ou non,
émanant des établissements d'enseignement et de
recherche français ou étrangers, des laboratoires
publics ou privés.

<figure><img src="image_1.png" /></figure>

Distributed under a Creative Commons Attribution 4.0 International License
RESEARCH

Open Access

<figure><img src="image_2.png" /></figure>

Check for
updates

# Comparison of seven comorbidity scores on four-month survival of lung cancer patients

Hélène Pluchart<fnref n="1" />,<fnref n="2" />,<fnref n="3" />* , Sébastien Bailly<fnref n="4" />, Sébastien Chanoine<fnref n="1" />,<fnref n="2" />,<fnref n="5" />, Denis Moro-Sibilot<fnref n="2" />,<fnref n="5" />,<fnref n="6" />, Pierrick Bedouch<fnref n="1" />,<fnref n="2" />,<fnref n="3" /> and Anne-Claire Toffart<fnref n="2" />,<fnref n="5" />,<fnref n="6" />

**Abstract**

**Background** The comorbidity burden has a negative impact on lung-cancer survival. Several comorbidity scores have been described and are currently used. The current challenge is to select the comorbidity score that best reflects their impact on survival. Here, we compared seven usable comorbidity scores (Charlson Comorbidity Index, Age adjusted Charlson Comorbidity Index, Charlson Comorbidity Index adapted to lung cancer, National Cancer Institute combined index, National Cancer Institute combined index adapted to lung cancer, Elixhauser score, and Elixhauser adapted to lung cancer) with coded administrative data according to the tenth revision of the International Statistical Classification of Diseases and Related Health Problems to select the best prognostic index for predicting four-month survival.

**Materials and methods** This cohort included every patient with a diagnosis of lung cancer hospitalized for the first time in the thoracic oncology unit of our institution between 2011 and 2015. The seven scores were calculated and used in a Cox regression method to model their association with four-month survival. Then, parameters to compare the relative goodness-of-fit among different models (Akaike Information Criteria, Bayesian Information Criteria), and discrimination parameters (the C-statistic and Harrell's c-statistic) were calculated. A sensitivity analysis of these parameters was finally performed using a bootstrap method based on 1,000 samples.

**Results** In total, 633 patients were included. Male sex, histological type, metastatic status, CCI, CCI-lung, Elixhauser score, and Elixhauser-lung were associated with poorer four-month survival. The Elixhauser score had the lowest AIC and BIC and the highest c-statistic and Harrell's c-statistic. These results were confirmed in the sensitivity analysis, in which these discrimination parameters for the Elixhauser score were significantly different from the other scores.

**Conclusions** Based on this cohort, the Elixhauser score is the best prognostic comorbidity score for predicting four-month survival for hospitalized lung cancer patients.

**Keywords** Lung cancer, Comorbidity, Survival

Hélène Pluchart
helene.pluchart@sfr.fr

<footnote>*Correspondence:</footnote>

<footnote n="1">¹Pôle Pharmacie, Centre Hospitalier Universitaire Grenoble Alpes,
Grenoble, France</footnote>

<footnote n="2">²Université Grenoble Alpes, Grenoble, France</footnote>

<footnote n="3">³Univ. Grenoble Alpes, CNRS, Grenoble INP, Centre Hospitalier
Universitaire Grenoble Alpes, TIMC UMR5525, Grenoble 38000, France</footnote>

<footnote n="4">⁴Univ. Grenoble Alpes, Inserm, Centre Hospitalier Universitaire Grenoble
Alpes, HP2, Grenoble 38000, France</footnote>

<footnote n="5">⁵Institute for Advanced Biosciences, UGA/INSERM U1209/CNRS 5309,
Université Grenoble Alpes, Grenoble, France</footnote>

<footnote n="6">⁶Clinique de Pneumologie, Unité d'Oncologie Thoracique, Pôle Thorax
et Vaisseaux, Centre Hospitalier Universitaire Grenoble Alpes, Grenoble,
France</footnote>
## Background

The median age at lung cancer diagnosis is 70 years [1]. Given the increasing probability of developing comorbidities with age, the prevalence of comorbidity is higher in lung cancer than in other cancers, with at least 50 to 70% of patients having at least one comorbidity at diagnosis [2, 3].

The negative affect of comorbidities on patient survival are well described [4–6]. Since the development of the Charlson Comorbidity Index (CCI) [7], several comorbidity scores have been developed and are currently used. They all differ by the origin of the initial data source (administrative data or physician-reported data), their purpose (measuring comorbidity, measuring the impact of comorbidity and physical function), and comorbidity measures (organ or system-based approaches, counts of individual conditions and weighted indices) [8] (Table S1 Supplementary Materials 1). Some have been developed using lung cancer patient cohorts [9–11]. Despite the large number of comorbidity scores available, the CCI is the most studied and used comorbidity index in the medical literature [12, 13].

Certain comorbidity scores are based on the International Statistical Classification of Diseases and Related Health Problems (ICD-10), as Quan et al. published ICD-10 codes relative to comorbidities in 2005 [14]. They include the CCI (updated by Quan et al. in 2011 [7, 15]), CCI for lung cancer (named later CCI-lung) (Klabunde et al. in 2007) [16], age-adjusted CCI (ACCI) [17], Elixhauser score (updated in 2009 by Van Wallraven et al. [18, 19]), Elixhauser for lung cancer (Elixhauser-lung) (Mehta et al. [20]), National Cancer Institute Combined Index (NCI) [1], and NCI for lung cancer (NCI-lung) (Klabunde et al. in 2007 [16, 21]). They differ in terms of the type of comorbidities considered, the cohort used for validation, and their initial purpose [22].

Yang et al. found that the ACCI was better at predicting three-year overall survival than the CCI and Elixhauser score in a cohort of resected lung-cancer patients [23] based on administrative data coded using the ICD-9. However, they only compared the ACCI, CCI, and Elixhauser score. More recently, Mehta et al. proposed an Elixhauser score adapted to the cancer type (breast, lung, prostate, and colorectal). The cancer-specific Elixhauser score appears to be a better prognostic score for two-year survival than the cancer-specific NCI (developed by Klabunde et al.) [20].

Although the CCI is the most widely used comorbidity score, it would be informative to assess which score is more predictive of mortality in cohorts with administrative data. Here, we compared the seven comorbidity scores available using administrative data coded using the ICD-10 in predicting four-month survival of our cohort of hospitalized lung-cancer patients.

## Materials and methods

### Data source and population

We included patients hospitalized in the Thoracic Oncology Unit of Grenoble Alpes University Hospital from 2011 to 2015 described in an earlier publication [24]. Lung-cancer patients were included at their first hospitalization during the studied period.

The study was approved by our institutional review board and ethics approval was obtained on September 1, 2021 (CECIC Rhône-Alpes-Auvergne, Clermont-Ferrand, IRB 5891).

The database contains information on individuals including their age, gender, lung cancer' TNM staging, performance status at their first presentation case in multidisciplinary concertation meetings, and the histological type of the lung cancer.

### Outcome and covariates

The outcome was median overall survival. Survival data were obtained from our district cancer registry, including the date of the last follow-up and the vital status at the last follow-up. Right censored date point was defined by median overall survival.

Age, gender, lung cancer metastatic status, histologic type, age at hospitalization, and age at diagnosis were included as covariates.

### Comorbidity scores

Data concerning comorbidities were obtained by the Health Information Services Department and coded using the ICD-10. The diagnoses for comorbidities were recorded at the patients' discharge in our medical unit. Seven comorbidity scores were calculated: CCI, ACCI, CCI-lung, NCI, NCI-lung, Elixhauser, and Elixhauser-lung. We did not record metastatic solid tumors and lung cancer as comorbid conditions. The seven scores are summarized in Table 1.

### Statistical analyses

For descriptive analysis, quantitative variables are expressed as medians [Interquartile ranges] and qualitative variables as n (%).

Comorbidity scores were calculated and survival estimated as the time between the day of hospitalization and the date of last follow-up (cut off at cohort's estimated median overall survival which was our right censored date point). The Kaplan Meier estimator was used to estimate the probability of survival. Log-rank tests were used to compare the probability of the event (death) between populations. The model was adjusted for each score. A Cox proportional hazards regression model was used to perform multivariable analyses of prognostic factors and calculate hazard ratios (HRs) and 95% confidence intervals (95% CI) for median survival
<table><caption>**Table 1** Summary of differences between the seven comorbidity scores used</caption><thead><tr><th>Score</th><th>Number of conditions</th><th>Scoring method</th><th>Score range</th></tr></thead><tbody><tr><td>Updated CCI<br>(15)</td><td>12 conditions</td><td>Based on 1-year-all-cause mortality<br>Sum of weighted indices (derived based on hazards ratios)<br>Updated by Quan et al. (15)</td><td>0 to 24</td></tr><tr><td>CCI-lung<br>(16)</td><td>10 conditions</td><td>Based on the impact on 2-year non-cancer mortality<br>Sum of weighted indices (derived based on hazards ratios)</td><td>0 to 15</td></tr><tr><td>ACCI<br>(17)</td><td>12 conditions</td><td>Based on 1-year-all-cause mortality<br>Age-adjusted CCI is equal to the CCI score but 1 point has to be added for each decade above 50 years</td><td>CCI + 1<br>point<br>added<br>for each<br>decade<br>above 50<br>years old</td></tr><tr><td>NCI<br>(1)</td><td>14 conditions</td><td>Based on the impact on 2-yr non-cancer mortality<br>Sum of weighted indices (derived from hazards ratios, available on the NCI website)</td><td>0 to 21.14</td></tr><tr><td>NCI-lung<br>(16)</td><td>13 conditions</td><td>Based on the impact on 2-yr non-cancer mortality<br>Sum of weighted indices (derived from beta coefficients)</td><td>-0.143 to<br>4.243</td></tr><tr><td>Updated<br>Elixhauser<br>(19)</td><td>21 conditions</td><td>Used initially as a count (30 conditions) but modified by Van Walraven et al. Based on in-hospital mortality as the sum of the weighted score (hazards ratios derived from beta coefficients divided by the coefficient in the model with the smallest absolute value) (19)</td><td>-19 to 89</td></tr><tr><td>Elixhauser-lung<br>(20)</td><td>16 conditions</td><td>Based on the impact on 2-yr non-cancer mortality<br>Sum of the weighted indices (derived from the beta coefficient x 10)</td><td>-2 to 28</td></tr></tbody></table>

for the seven comorbidity scores. A median cut-off was used for continuous variables in the multivariate analysis. Proportional hazards assumptions were verified using the Martingale method [25]. Only covariables with a p-value<0.2 were retained for multivariable analysis.

To compare comorbidity scores, Akaike Information Criteria (AIC), Bayesian Information Criteria (BIC) were used to compare the relative goodness-of-fit among different models. Then, a discrimination analysis using the c-statistic, Harrell's c-statistic, sensitivity, specificity was performed from a base model containing significant covariables from the multivariate analysis. Sensitivity and specificity were respectively calculated as follow: (True positive=Death estimated by the model) / (True positive+false negative (=patient estimated as non-dead by the model although they are dead)); and (true negative=non-dead patients estimated by the model) / (true negative+false positive=estimated dead by the model although they are not).

The impact of the scores was compared using the base model (significant covariables in multivariable analysis) plus each index score alone by multivariable Cox regression. The model with the lowest AIC and BIC indicates which model was the best fit for the data and the highest c statistic and Harrell's c statistic was considered to be the best predictive model.

A sensitivity analysis using a bootstrap method for each statistical indicator, with 1,000 samples from two thirds of the cohort, was performed. Each indicator (AIC, BIC, c-statistic, and Harrell's c-statistic) was calculated for the 1,000 samples. Boxplots were generated for the four parameters.

All statistical analyses were performed using SAS 9.4 for Windows (SAS Institute, Inc., Cary, NC, USA). A p-value<0.05 was considered significant.

## Results

### Descriptive analyses and adjusted hazard ratios for four-month survival using the seven comorbidity scores

In total, 633 patients were enrolled in the study. The demographic characteristics of the population are presented in Table 2. The median age [IQ25%;IQ75%] at diagnosis was 65 [58–72] years and 540 (71%) of the patients were men. The median survival from hospital admission was 4 [1; 11] months. A Kaplan Meier curve of follow-up time (which corresponds to survival) in this cohort (cut off at 4 months as 4 months was median overall survival) is represented in supplementary materials (Figure S1). Among the cohort, 428 patients (74%) had metastatic lung cancer and 295 (47%) had adenocarcinoma. The diagnosis of cancer was made before hospitalization for most of the patients (518, 82%).

In multivariable analysis, only the presence of metastases, male gender, and histological type were prognostic factors of four-month survival.

We assessed the prevalence of each comorbidity that contributed to the score for each comorbidity score (Table 3 for the Elixhauser score and Elixhauser-lung and Tables S2 and S3 in Supplementary Materials for CCI, CCI-lung, NCI, and NCI-lung). For the Elixhauser score, weight loss, fluid and electrolyte disorders, and chronic pulmonary disease were the three most common comorbidities, whereas weight loss, chronic pulmonary disease, and peripheral vascular disease were the most common
<table><caption>**Table 2** Baseline characteristics and adjusted hazard ratios of four-month survival in the cohort (n = 633)</caption><thead><tr><th rowspan="2">Characteristics</th><th colspan="2">Univariate analysis</th><th colspan="2">Multivariate analysis</th><th rowspan="2">Type 3 P Value</th></tr><tr><th>HR [95% CI]</th><th>P value</th><th>HR [95% CI]</th><th>P value</th></tr></thead><tbody><tr><td>Overall survival, months</td><td>4 [1; 11]</td><td></td><td></td><td></td><td></td></tr><tr><td>Length of stay in the hospital (days)</td><td>11 [6; 20]</td><td></td><td></td><td></td><td></td></tr><tr><td>Performance status at the first case presentation in multidisciplinary concertation meetings*</td><td></td><td></td><td></td><td></td><td></td></tr><tr><td>PS 0–1</td><td>212 (53.1)</td><td></td><td></td><td></td><td></td></tr><tr><td>PS 2</td><td>126 (31.6)</td><td></td><td></td><td></td><td></td></tr><tr><td>PS 3–4</td><td>61 (15.3)</td><td></td><td></td><td></td><td></td></tr><tr><td>Men</td><td>540 (71.0)</td><td>1.3 [1.0; 1.6]</td><td>0.07</td><td>1.3 [1.0; 1.7]</td><td>0.03</td></tr><tr><td>Metastasis</td><td>428 (74.2)</td><td>2.0 [1.5; 2.6]</td><td>&lt; 0.01</td><td>1.9 [1.3; 2.9]</td><td>&lt; 0.01</td></tr><tr><td>Histological type</td><td></td><td></td><td></td><td></td><td>&lt; 0.01</td></tr><tr><td>Adenocarcinoma</td><td>295 (46.6)</td><td>1</td><td></td><td>1</td><td></td></tr><tr><td>Squamous-cell carcinoma</td><td>103 (16.3)</td><td>0.9 [0.6; 1.2]</td><td>0.40</td><td>1.0 [0.7; 1.4]</td><td>0.87</td></tr><tr><td>Undifferentiated carcinoma</td><td>67 (10.6)</td><td>0.4 [1.2; 0.8]</td><td>0.40</td><td>1.2 [0.8; 1.7]</td><td>0.33</td></tr><tr><td>Small-cell lung cancer</td><td>132 (20.9)</td><td>0.7 [0.5; 0.9]</td><td>&lt; 0.01</td><td>0.7 [0.5; 0.9]</td><td>&lt; 0.01</td></tr><tr><td>Other types</td><td>36 (5.7)</td><td>1.9 [1.2; 2.8]</td><td>&lt; 0.01</td><td>1.9 [1.3; 2.9]</td><td>&lt; 0.01</td></tr><tr><td>Age during hospitalization</td><td>66 [58;73]</td><td>1.1 [0.9; 1.3]</td><td>0.54</td><td></td><td></td></tr><tr><td>Age at diagnostic</td><td>65 [58;72]</td><td>1.1 [0.9; 1.3]</td><td>0.60</td><td></td><td></td></tr><tr><td>Time of cancer diagnosis</td><td></td><td></td><td></td><td></td><td></td></tr><tr><td>Diagnosis before hospitalization</td><td>518 (81.8)</td><td>1</td><td></td><td></td><td></td></tr><tr><td>Diagnosis during or after hospitalization</td><td>115 (18.2)</td><td>0.9 [0.7; 1.2]</td><td>0.47</td><td></td><td></td></tr></tbody></table>

Quantitative variables are expressed as medians [Interquartile range], qualitative variables are expressed as n (%)

*Missing data: n = 234

<table><caption>**Table 3** Description of comorbidity in the population according to the Elixhauser score and Elixhauser-lung</caption><thead><tr><th>Population (n = 633)</th><th>Elixhauser</th><th>Elixhauser-lung</th></tr></thead><tbody><tr><td>Congestive Heart Failure</td><td>46 (7.3)</td><td>46 (7.3)</td></tr><tr><td>Cardiac arrhythmias</td><td>77 (12.2)</td><td></td></tr><tr><td>Vascular disease</td><td>22 (3.5)</td><td>22 (3.5)</td></tr><tr><td>Pulmonary circulation disorders</td><td>40 (6.3)</td><td>40 (6.3)</td></tr><tr><td>Peripheral vascular disorders</td><td>48 (7.6)</td><td>48 (7.6)</td></tr><tr><td>Paralysis</td><td>46 (7.3)</td><td>46 (7.3)</td></tr><tr><td>Neurodegenerative disorders</td><td>42 (6.6)</td><td>42 (6.6)</td></tr><tr><td>Chronic pulmonary disease</td><td>91 (14.4)</td><td>91 (14.4)</td></tr><tr><td>Renal failure</td><td>26 (4.1)</td><td>26 (4.1)</td></tr><tr><td>Liver disease</td><td>19 (3.0)</td><td></td></tr><tr><td>Lymphoma</td><td>4 (0.6)</td><td></td></tr><tr><td>Cancer*</td><td>65 (10.3)</td><td></td></tr><tr><td>Coagulopathy</td><td>27 (4.3)</td><td>27 (4.3)</td></tr><tr><td>Obesity</td><td>11 (1.7)</td><td>11 (1.7)</td></tr><tr><td>Weight loss</td><td>345 (54.5)</td><td>345 (54.5)</td></tr><tr><td>Fluid and electrolyte disorders</td><td>91 (14.4)</td><td></td></tr><tr><td>Blood loss anemia</td><td>6 (1.0)</td><td></td></tr><tr><td>Deficiency anemia</td><td>14 (2.2)</td><td></td></tr><tr><td>Drug abuse</td><td>8 (1.3)</td><td></td></tr><tr><td>Depression</td><td>29 (4.6)</td><td>29 (4.6)</td></tr><tr><td>Diabetes with complications</td><td></td><td>11 (1.7)</td></tr><tr><td>Hypothyroidism</td><td></td><td>17 (2.7)</td></tr><tr><td>Rheumatological disorders</td><td></td><td>4 (0.6)</td></tr><tr><td>Psychosis</td><td></td><td>9 (1.4)</td></tr></tbody></table>

Qualitative variables are expressed as n (%)

*excluding lung cancer and metastatic solid tumor

comorbidities for Elixhauser-lung. The common thread between the Elixhauser score, Elixhauser-lung, CCI, CCI-lung, NCI, and NCI-lung was the high prevalence of chronic pulmonary disease, which was among the three most common comorbidities in the cohort.

Among the seven scores, in terms of the p value and type 3 p value, an ACCI≥5, Elixhauser score>11, and Elixhauser-lung≥4 were associated with lower survival. However, neither the CCI, CCI-lung, NCI, nor NCI-lung were associated with poorer survival (Table 4).

### Model comparison and discrimination analyses between the seven scores and the bootstrap method

We calculated the AIC, BIC, c-statistic, Harrell's c-statistic, sensitivity and specificity (Table 5). The Elixhauser score had the lowest AIC and BIC. It also had highest c-statistic and Harrell's c-statistic as discriminative parameters, indicating that this score is the best predictive model for estimating four-month survival in our cohort.

We confirmed this trend by generating boxplots from the sensitivity analyses of the AIC, BIC, c-statistics, and Harrell's c-statistic (Supplementary Figures S2).

### Discussion

The CCI has been shown to be associated with poorer survival for all TNM stage lung-cancer patients [12, 26] and is the most widely used comorbidity score. Here, we
<table><caption>**Table 4** Adjusted hazard ratios for four-month survival among the population (n = 633)</caption><thead><tr><th>Comorbidity score</th><th>Median [Interquartile range]</th><th>HR [95% CI]</th><th>P value</th><th>Type 3 P value</th></tr></thead><tbody><tr><td>CCI</td><td>0.0 [0.0; 2.0]</td><td></td><td></td><td>0.1</td></tr><tr><td>0</td><td></td><td>1</td><td></td><td></td></tr><tr><td>1 or 2</td><td></td><td>1.1 [0.8; 1.4]</td><td>0.63</td><td></td></tr><tr><td>≥ 3</td><td></td><td>1.4 [1.0; 2.1]</td><td>0.04</td><td></td></tr><tr><td>ACCI*</td><td>3.0 [2.0; 4.0]</td><td></td><td></td><td><strong>&lt; 0.05</strong></td></tr><tr><td>≤ 2</td><td></td><td>1</td><td></td><td></td></tr><tr><td>3</td><td></td><td>1.0 [0.8; 1.4]</td><td>0.88</td><td></td></tr><tr><td>4</td><td></td><td>1.3 [0.9; 1.7]</td><td>0.13</td><td></td></tr><tr><td>≥ 5</td><td></td><td><strong>1.6 [1.1; 2.1]</strong></td><td><strong>&lt; 0.01</strong></td><td></td></tr><tr><td>CCI-lung</td><td>0.0 [0.0; 1.0]</td><td></td><td></td><td>0.08</td></tr><tr><td>0</td><td></td><td>1</td><td></td><td></td></tr><tr><td>1 ≤ CCI-lung ≤ 2</td><td></td><td>1.1 [0.9; 1.5]</td><td>0.31</td><td></td></tr><tr><td>≥ 3</td><td></td><td><strong>1.5 [1.0; 2.2]</strong></td><td><strong>0.03</strong></td><td></td></tr><tr><td>NCI*</td><td>0.0 [0.0; 1.7]</td><td></td><td></td><td>0.47</td></tr><tr><td>0 &lt; NCI ≤ 1</td><td></td><td>1</td><td></td><td></td></tr><tr><td>1 &lt; NCI ≤ 2</td><td></td><td>1.2 [0.9; 1.5]</td><td>0.30</td><td></td></tr><tr><td>2 &lt; NCI &lt; 3</td><td></td><td>1.1 [0.7; 1.7]</td><td>0.63</td><td></td></tr><tr><td>NCI ≥ 3</td><td></td><td>1.3 [0.9; 1.8]</td><td>0.16</td><td></td></tr><tr><td>NCI-lung</td><td>0.0 [0.0; 0.33]</td><td></td><td></td><td>0.22</td></tr><tr><td>&lt; 0</td><td></td><td>1</td><td></td><td></td></tr><tr><td>0 = NCI ≤ 0.2</td><td></td><td>1.3 [0.7; 2.3]</td><td>0.50</td><td></td></tr><tr><td>0.2 &lt; NCI ≤ 0.4</td><td></td><td>1.6 [0.8; 3.2]</td><td>0.14</td><td></td></tr><tr><td>NCI &gt; 0.4</td><td></td><td>1.4 [0.8; 2.7]</td><td>0.26</td><td></td></tr><tr><td>Elixhauser</td><td>6.0 [2.0; 11.0]</td><td></td><td></td><td><strong>&lt; 0.01</strong></td></tr><tr><td>Elixhauser ≤ 0 to Elixhauser ≤ 5</td><td></td><td>1</td><td></td><td></td></tr><tr><td>6 ≤ Elixhauser ≤ 11</td><td></td><td>1.4 [1.0; 1.8]</td><td>0.02</td><td></td></tr><tr><td>Elixhauser &gt; 11</td><td></td><td><strong>1.6 [1.2; 2.1]</strong></td><td><strong>&lt; 0.01</strong></td><td></td></tr><tr><td>Elixhauser-lung*</td><td>3.0 [0.0; 5.0]</td><td></td><td></td><td><strong>&lt; 0.01</strong></td></tr><tr><td>≤ 0</td><td></td><td>1</td><td></td><td></td></tr><tr><td>1 ≤ Elixhauser-lung ≤ 3</td><td></td><td>1.2 [0.9; 1.7]</td><td>0.14</td><td></td></tr><tr><td>4 ≤ Elixhauser-lung ≤ 5</td><td></td><td><strong>2.1 [1.5; 3.0]</strong></td><td><strong>&lt; 0.01</strong></td><td></td></tr><tr><td>Elixhauser-lung &gt; 5</td><td></td><td><strong>1.5 [1.1; 2.0]</strong></td><td><strong>0.02</strong></td><td></td></tr></tbody></table>

Adjusted for sex, presence of metastases, and histological type. Quantitative variables are expressed as medians [Interquartile range]; In bold: *p* < 0.05

*sex is no longer significantly different in multivariate analysis with this score

<table><caption>**Table 5** Model comparison with AIC, BIC and discrimination parameters between the seven comorbidity scores</caption><thead><tr><th></th><th>AIC</th><th>BIC</th><th>Harrell's c-statistic</th><th>C-statistic</th><th>Sensitivity (%)</th><th>Specificity (%)</th></tr></thead><tbody><tr><td>Base model*</td><td>4755.8721</td><td>4758.0284</td><td>0.6141</td><td>0.649</td><td>62.84</td><td>59.68</td></tr><tr><td>Base model + CCI</td><td>4753.5483</td><td>4755.7528</td><td>0.6189</td><td>0.657</td><td>61.34</td><td>61.88</td></tr><tr><td>Base model + ACCI</td><td>4745.7800</td><td>4747.9845</td><td>0.6249</td><td>0.663</td><td>63.23</td><td>61.99</td></tr><tr><td>Base model + CCI-lung</td><td>4752.0853</td><td>4754.2898</td><td>0.6209</td><td>0.658</td><td>61.27</td><td>61.95</td></tr><tr><td>Base model + NCI</td><td>4751.9881</td><td>4754.1925</td><td>0.6194</td><td>0.656</td><td>62.69</td><td>59.52</td></tr><tr><td>Base model + NCI-lung</td><td>4749.9826</td><td>4752.1871</td><td>0.6236</td><td>0.658</td><td>60.90</td><td>61.37</td></tr><tr><td>Base model + Elixhauser</td><td><strong>4744.7953</strong></td><td><strong>4746.9998</strong></td><td><strong>0.6314</strong></td><td><strong>0.673</strong></td><td><strong>64.66</strong></td><td><strong>62.57</strong></td></tr><tr><td>Base model + Elixhauser-lung</td><td>4749.5804</td><td>4751.7849</td><td>0.6251</td><td>0.669</td><td>63.84</td><td>61.05</td></tr></tbody></table>

*Adjusted for sex, metastasis, and histological type

performed the first study to compare seven comorbidity scores on a cohort of lung-cancer patients. Sarfati et al. suggested that the CCI, cancer-specific NCI, and Elixhauser score may be the preferred comorbidity scores

when using administrative data [22]. In this study, we used the ICD-10 to identify comorbidity from administrative data and found the Elixhauser score to be the best score for predicting four-month mortality.
The Elixhauser score has already been compared to the CCI for patients with cancers other than lung cancer and found to be a better prognosis score for colorectal and oral cancer patients [27, 28]. Mehta et al. found that the lung cancer-specific Elixhauser performed better than the lung cancer-specific NCI and Elixhauser score [29]. The outcome of the aforementioned study was two-year non-cancer mortality, which had a consequence on the statistical analyses because the authors had to consider competing risks. In addition, they studied comorbidities prior to the lung cancer diagnosis. More interestingly, they also compared these scores to the individual Charlson and Elixhauser comorbidity scores. The Elixhauser individual comorbidity scores performed better than the Charlson individual comorbidity scores. However, scores have been shown to be good substitutes for individual comorbidity variables in health services research [30]. In a paper published by Yang et al., the ACCI predicted overall three-year survival better than the CCI or Elixhauser score [23]. In contrast to Mehta et al., they did not discriminate between death from cancer and other causes, but they did consider comorbidities prior to the diagnosis of lung cancer.

These scores differ not only in the way they were constructed (origin of the cohort and outcome chosen), but also in the weight assigned to each comorbidity; some use the beta coefficient obtained from the regression and others the hazard ratio. The beta coefficients and hazard ratios are related to each other by an exponential relationship, and although the use of beta coefficients is preferred when using a summary score [31], we calculated the comorbidity scores as they were described and published in the original papers.

There are several possible explanations concerning the better performance of the Elixhauser score. The Elixhauser score was developed using a short-term outcome: in-hospital mortality. The median overall survival in our cohort was four months, which is short relative to the other scores (i.e., the CCI), which were constructed using a long-term outcome, such as one- or two-year mortality. This result corroborates another publication concerning in-hospital mortality of non-cancer patients, in which the Elixhauser score outperformed the CCI [32]. Another possibility is the number of comorbidities taken into account in the Elixhauser score, which is more than for the other scores. Lung cancer patients have the most comorbidities at diagnosis relative to patients with other types of cancer, especially due to tobacco exposure [3, 33]. This could explain why the Elixhauser score best fit our cohort in predicting four-month mortality.

This study had several limitations. We assessed comorbidities that occurred both before and after lung cancer diagnosis and did not distinguish between death from lung cancer and that from other causes. Extension of this

paper results should be done with one caution. Despite we had 71% of men and 74.2% of patients with metastatic status at diagnosis, which is similar to literature, age have a non-significant effect on survival. This may be due to the inclusion criteria which is hospitalized patients and therefore frailty ones with the shortest survivals, and high comorbidity burden (Median Elixhauser score of 6). Because performance test has been performed on the same data used to train the model there will be a need for external validity of the results. There may have also been unknown confounders. Moreover, this was a retrospective monocentric study.

The use of ICD-10 codes to identify the comorbidities was a strength of our study, as they can be used to query easily available structured datasets and allow the comparison of comorbidity scores, as well as sensitivity analyses, which confirmed the superiority of the Elixhauser score for estimating four-month survival in our cohort.

## Conclusions

Despite the extensive use of the CCI in the literature, other comorbidity scores are available, including scores based on administrative data coded using the ICD-10. In this original study, in which we compared seven comorbidity scores using administrative data, the Elixhauser score was the comorbidity score best suited to hospitalized lung-cancer patients for predicting four-month mortality. It could be informative to repeat these analyses with a longer follow-up of the patients.

### Abbreviations

<table><tr><td>ACCI</td><td>Age-adapted Charlson Comorbidity Index</td></tr><tr><td>AIC</td><td>Akaike Information Criteria</td></tr><tr><td>BIC</td><td>Bayesian Information Criteria</td></tr><tr><td>CCI</td><td>Charlson Comorbidity Index</td></tr><tr><td>CCI-lung</td><td>Charlson Comorbidity Index adapted to lung cancer</td></tr><tr><td>CIRS</td><td>Cumulative Illness Rating Scale</td></tr><tr><td>CIRS-G</td><td>Cumulative Illness Rating Scale adapted for geriatric population</td></tr><tr><td>Elixhauser</td><td>Elixhauser score</td></tr><tr><td>Elixhauser-lung</td><td>Elixhauser score adapted to lung cancer</td></tr><tr><td>KFI</td><td>Kaplain Feinstein Index</td></tr><tr><td>NCI</td><td>National Cancer Institute combined index</td></tr><tr><td>NCI-lung</td><td>National Cancer Institute combined index adapted to lung cancer</td></tr><tr><td>SCI</td><td>Simplified Comorbidity Index</td></tr></table>

## Supplementary Information

The online version contains supplementary material available at https://doi.org/10.1186/s12874-023-01994-6.

Supplementary Material 1: Table S1

Supplementary Material 2: Figure S1

Supplementary Material 3: Table S2

Supplementary Material 4: Table S3

Supplementary Material 5: Figure S2
## Acknowledgements

The authors thank Alex Edelman & Associates for providing language help and writing assistance.

## Author contributions

All authors reviewed the manuscript and revised it critically before submission. All authors have seen and approved the final version of the manuscript. They agreed to be accountable for all aspects of the work.

## Funding

This study was supported by the Association pour la Recherche et l'Information Scientifique et Thérapeutique en Oncologie Thoracique (ARISTOT).

## Data Availability

The datasets generated and/or analysed during the current study are not publicly available due to privacy restrictions but are available from the corresponding author on reasonable request. The description of their content and how it has been obtained is described in the protocol cited above [24].

## Declarations

### Ethics approval and consent to participate

This study was approved by our institutional review board, respecting reference methodology No. 004 (MR004), which concerns research not involving human subjects (studies and evaluations in the health field). Study ethics approval was obtained on 01 september 2021 (Comité d'Ethique des Centres d'Investigation Clinique Rhône-Alpes-Auvergne, Clermont-Ferrand, IRB 5891). At the time of this study, French law did not require the consent of participants, since no intervention was evaluated (Commission nationale de l'informatique et des libertés law of June 20 2018 number 2018-493, NOR: JUSC1732261L, Journal Officiel de la République Française number 0141, June 21 2018). An information and non-objection letter has been sent to living patients in the cohort.

All relevant permissions were obtained to access the raw data and all methods were performed in accordance with the relevant guidelines and regulations.

### Consent for publication

Not applicable.

### Competing interests

HP, SB, SC, PB have nothing to disclose. ACT received personal fees and non-financial support from Astra Zeneca, BMS, MSD, Novartis, Boehringer Ingelheim, Roche, Pfizer. DMS received grants from Roche, Astra Zeneca, BMS, Boehringer Ingelheim, Abbvie, Pfizer; received personal fees from Roche, Astra Zeneca, BMS, MSD, Lilly, Takeda, Boehringer Ingelheim, Abbvie, Becton Dickinson, Pfizer, Novartis; received non-financial support from Roche, Astra Zeneca, BMS, MSD, Lilly, Takeda, Boehringer Ingelheim and Pfizer.

Received: 8 August 2022 / Accepted: 20 July 2023

Published online: 03 November 2023

## References

1. Noone AM, Howlader N, Krapcho M, Miller D, Brest A, Yu M et al. SEER Cancer Statistics Review, 1975-2015, National Cancer Institute [Internet]. [cited 2018 Jul 30]. Available from: https://seer.cancer.gov/csr/1975_2015/sections.html.

2. Edwards BK, Noone AM, Mariotto AB, Simard EP, Boscoe FP, Henley SJ et al. Annual Report to the Nation on the status of cancer, 1975-2010, featuring prevalence of comorbidity and impact on survival among persons with lung, colorectal, breast, or prostate cancer. Cancer. 2014;120(9):1290-314.

3. Islam KMM, Jiang X, Anggondowati T, Lin G, Ganti AK. Comorbidity and Survival in Lung Cancer Patients. Cancer Epidemiol Biomark Prev Publ Am Assoc Cancer Res Cosponsored Am Soc Prev Oncol. 2015;24(7):1079-85.

4. Moro-Sibilot D, Aubert A, Diab S, Lantuejoul S, Fourneret P, Brambilla E, et al. Comorbidities and Charlson score in resected stage I nonsmall cell lung cancer. Eur Respir J. 2005;26(3):480-6.

5. Seigneurin A, Delafosse P, Trétarre B, Woronoff AS, Velten M, Grosclaude P et al. Are comorbidities associated with long-term survival of lung cancer? A population-based cohort study from French cancer registries. BMC Cancer [Internet]. 2018 Dec [cited 2019 Feb 13];18(1). Available from: https://bmccancer.biomedcentral.com/articles/https://doi.org/10.1186/s12885-018-5000-7.

6. Leduc C, Antoni D, Charloux A, Falcoz PE, Quoix E. Comorbidities in the management of patients with lung cancer. Eur Respir J. 2017;49(3).

7. Charlson ME, Pompei P, Ales KL, MacKenzie CR. A new method of classifying prognostic comorbidity in longitudinal studies: development and validation. J Chronic Dis. 1987;40(5):373-83.

8. Sarfati D. Review of methods used to measure comorbidity in cancer populations: no gold standard exists. J Clin Epidemiol. 2012;65(9):924-33.

9. Tammemagi CM. Comorbidity and Survival Disparities among Black and White patients with breast Cancer. JAMA. 2005;294(14):1765.

10. Tammemagi CM, Neslund-Dudas C, Simoff M, Kvale P. Impact of comorbidity on lung cancer survival. Int J Cancer. 2003;103(6):792-802.

11. Colinet B, Jacot W, Bertrand D, Lacombe S, Bozonnat MC, Daurès JP, et al. A new simplified comorbidity score as a prognostic factor in non-small-cell lung cancer patients: description and comparison with the Charlson's index. Br J Cancer. 2005;93(10):1098-105.

12. Moro-Sibilot D, Aubert A, Diab S, Lantuejoul S, Fourneret P, Brambilla E, et al. Comorbidities and Charlson score in resected stage I nonsmall cell lung cancer. Eur Respir J. 2005;26(3):480-6.

13. Bannay A, Chaignot C, Blotière PO, Basson M, Weill A, Ricordeau P, et al. The best use of the Charlson Comorbidity Index with Electronic Health Care Database to Predict Mortality. Med Care. 2016;54(2):188-94.

14. Quan H, Sundararajan V, Halfon P, Fong A, Burnand B, Luthi JC, et al. Coding algorithms for defining comorbidities in ICD-9-CM and ICD-10 administrative data. Med Care. 2005;43(11):1130-9.

15. Quan H, Li B, Couris CM, Fushimi K, Graham P, Hider P, et al. Updating and validating the Charlson Comorbidity Index and score for Risk Adjustment in Hospital discharge abstracts using data from 6 countries. Am J Epidemiol. 2011;173(6):676-82.

16. Klabunde CN, Legler JM, Warren JL, Baldwin LM, Schrag D. A refined comorbidity measurement algorithm for claims-based studies of breast, prostate, colorectal, and lung cancer patients. Ann Epidemiol. 2007;17(8):584-90.

17. Charlson M, Szatrowski TP, Peterson J, Gold J. Validation of a combined comorbidity index. J Clin Epidemiol. 1994;47(11):1245-51.

18. Elixhauser A, Steiner C, Harris DR, Coffey RM. Comorbidity measures for use with administrative data. Med Care. 1998;36(1):8-27.

19. van Walraven C, Austin PC, Jennings A, Quan H, Forster AJ. A modification of the Elixhauser comorbidity measures into a point system for hospital death using administrative data. Med Care. 2009;47(6):626-33.

20. Mehta HB, Sura SD, Adhikari D, Andersen CR, Williams SB, Senagore AJ, et al. Adapting the Elixhauser comorbidity index for cancer patients. Cancer. 2018;124(9):2018-25.

21. Klabunde CN, Potosky AL, Legler JM, Warren JL. Development of a comorbidity index using physician claims data. J Clin Epidemiol. 2000;53(12):1258-67.

22. Sarfati D. Review of methods used to measure comorbidity in cancer populations: no gold standard exists. J Clin Epidemiol. 2012;65(9):924-33.

23. Yang CC, Fong Y, Lin LC, Que J, Ting WC, Chang CL, et al. The age-adjusted Charlson comorbidity index is a better predictor of survival in operated lung cancer patients than the Charlson and Elixhauser comorbidity indices. Eur J Cardiothorac Surg. 2018;53(1):235-40.

24. Pluchart H, Bailly S, Fauconnier J, Delafosse P, Chanoine S, Dumas I et al. Study protocol to assess polypharmacy and comorbidities in lung cancer. Respir Med Res. 2021;100861.

25. Therneau TM, Grambsch PM, Fleming TR. Martingale-based residuals for survival models. Biometrika. 1990;77(1):147-60.

26. Zhao L, Leung LH, Wang J, Li H, Che J, Liu L, et al. Association between Charlson comorbidity index score and outcome in patients with stage IIIB-IV non-small cell lung cancer. BMC Pulm Med. 2017;17(1):112.

27. Lieffers JR, Baracos VE, Winget M, Fassbender K. A comparison of charlson and elixhauser comorbidity measures to predict colorectal cancer survival using administrative health data. Cancer. 2011;117(9):1957-65.

28. Chang HJ, Chen PC, Yang CC, Su YC, Lee CC. Comparison of Elixhauser and Charlson Methods for Predicting oral Cancer survival: Medicine (Baltimore). 2016;95(7):e2861.

29. Mehta HB, Sura SD, Adhikari D, Andersen CR, Williams SB, Senagore AJ, et al. Adapting the Elixhauser comorbidity index for cancer patients. Cancer. 2018;124(9):2018-25.
30. Austin SR, Wong YN, Uzzo RG, Beck JR, Egleston BL. Why Summary Comorbidity Measures such as the Charlson Comorbidity Index and Elixhauser score work. Med Care. 2015;53(9):e65-72.

31. Mehta HB, Mehta V, Girman CJ, Adhikari D, Johnson ML. Regression coefficient-based scoring system should be used to assign weights to the risk index. J Clin Epidemiol. 2016;79:22-8.

32. Sharma N, Schwendimann R, Endrich O, Ausserhofer D, Simon M. Comparing Charlson and Elixhauser comorbidity indices with different weightings to predict in-hospital mortality: an analysis of national inpatient data. BMC Health Serv Res. 2021;21(1):13.

33. Edwards BK, Noone AM, Mariotto AB, Simard EP, Boscoe FP, Henley SJ et al. Annual Report to the Nation on the status of cancer, 1975-2010, featuring prevalence of comorbidity and impact on survival among persons with lung, colorectal, breast, or prostate cancer. Cancer. 2014;120(9):1290-314.

**Publisher’s Note**

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.