<figure><img src="image_1.png" /></figure>

HAL
open science

# Prognostic model for traumatic death due to bleeding: cross-sectional international study

Francois-Xavier Ageron, Angele Gayet-Ageron, Ewout Steyerberg, Pierre Bouzat, Ian Roberts

► To cite this version:

Francois-Xavier Ageron, Angele Gayet-Ageron, Ewout Steyerberg, Pierre Bouzat, Ian Roberts. Prognostic model for traumatic death due to bleeding: cross-sectional international study. BMJ Open, 2019, 9 (5), pp.e026823. 10.1136/bmjopen-2018-026823. hal-04821377

HAL Id: hal-04821377

https://hal.science/hal-04821377v1

Submitted on 7 Jan 2025

HAL is a multi-disciplinary open access
archive for the deposit and dissemination of sci-
entific research documents, whether they are pub-
lished or not. The documents may come from
teaching and research institutions in France or
abroad, or from public or private research centers.

L'archive ouverte pluridisciplinaire HAL, est
destinée au dépôt et à la diffusion de documents
scientifiques de niveau recherche, publiés ou non,
émanant des établissements d'enseignement et de
recherche français ou étrangers, des laboratoires
publics ou privés.

<figure><img src="image_2.png" /></figure>

Distributed under a Creative Commons Attribution 4.0 International License
# BMJ Open Prognostic model for traumatic death due to bleeding: cross-sectional international study

Francois-Xavier Ageron,¹,² Angele Gayet-Ageron,¹,³ Ewout Steyerberg,⁴,⁵
Pierre Bouzat,⁶ Ian Roberts¹

**To cite:** Ageron F-X, Gayet-Ageron A, Steyerberg E, et al. Prognostic model for traumatic death due to bleeding: cross-sectional international study. *BMJ Open* 2019;9:e026823. doi:10.1136/bmjopen-2018-026823

► Pre-publication history and additional material is published online only. To view please visit the journal online (http://dx.doi.org/10.1136/bmjopen-2018-026823).

Received 21 September 2018
Revised 12 April 2019
Accepted 30 April 2019

## ABSTRACT

**Objective** To develop and validate a prognostic model and a simple model to predict death due to bleeding in trauma patients.

**Design** Cross-sectional study with multivariable logistic regression using data from two large trauma cohorts.

**Setting** 274 hospitals from 40 countries in the Clinical Randomisation of Anti-fibrinolytic in Significant Haemorrhage (CRASH-2) trial and 24 hospitals in the Northern French Alps Trauma registry.

**Participants** 13 485 trauma patients in the CRASH-2 trial and 9945 patients in the Northern French Alps Trauma registry who were admitted to hospital within 3 hours of injury.

**Main outcome measure** In-hospital death due to bleeding within 28 days.

**Results** There were 815 (6%) deaths from bleeding in the CRASH-2 trial and 102 (1%) in the Northern French Alps Trauma registry. The full model included age, systolic blood pressure (SBP), Glasgow Coma Scale (GCS), heart rate, respiratory rate and type of injury (penetrating). The simple model included age, SBP and GCS. In a cross-validation procedure by country, discrimination and calibration were adequate (pooled C-statistic 0.85 (95% CI 0.81 to 0.88) for the full model and 0.84 (95% CI 0.80 to 0.88) for the simple model).

**Conclusion** This prognostic model can identify trauma patients at risk of death due to bleeding in a wide range of settings and can support prehospital triage and trauma audit, including audit of tranexamic acid use.

## Strengths and limitations of this study

► While there are models that predict all-cause mortality for trauma, this prognostic model is the first to identify trauma patients from a wide range of settings at risk of death due to bleeding.

► We used a rigorous innovative method to develop and validate this prognostic model with an internal–external cross-validation method based on data from 41 countries to ensure that the result is widely applicable.

► This model can support clinical decision-making for prehospital triage and for identifying population to audit to help implementation of effective intervention such as tranexamic acid.

► As the objective of this model was to identify the population at risk of death due to bleeding, discrimination showed a good ability and homogenous results across countries.

► Due to narrow range in the case-mix of some countries, we observed statistical heterogeneity in terms of calibration.

not receive it.⁸ There are many ways to increase adherence to guidelines, ranging from education to financial incentives and regulation.⁹ Audit and feedback are particularly effective and have helped increase the timely use of reperfusion therapies in patients with myocardial infarction and stroke.¹⁰⁻¹³ Audit and feedback are also important in trauma care.¹⁴⁻¹⁶ Prognostic models estimate the risk of death for each patient and allow us to target the population to audit. We can also calculate a clinical score that can be used for initial triage. To allow the audit of tranexamic acid use in trauma patients, we developed and validated a prognostic model to predict the risk of death due to bleeding based on information available at the first clinical assessment.

## INTRODUCTION

Traumatic haemorrhage is responsible for about 2 million deaths each year and is a leading cause of preventable death in trauma.¹⁻³ Early administration of tranexamic acid given within 3 hours of injury reduces death due to bleeding by about one-third.⁴ Tranexamic acid is widely included in trauma care guidelines.⁵,⁶

Nevertheless, many trauma patients who might benefit from tranexamic acid are not treated or are not treated soon enough.⁷ Despite an increase in tranexamic acid use after regionalisation of trauma services in England, 42% of bleeding trauma patients did

## METHODS

### Study population

We used data from two large multicentre studies to develop a widely applicable

<figure><img src="image_3.png" /></figure>

Check for updates

© Author(s) (or their employer(s)) 2019. Re-use permitted under CC BY-NC. No commercial re-use. See rights and permissions. Published by BMJ.

For numbered affiliations see end of article.

**Correspondence to**
Francois-Xavier Ageron;
fxageron@gmail.com
prognostic model for death due to bleeding in trauma patients: an international randomised control trial (The Clinical Randomisation of Anti-fibrinolytic in Significant Haemorrhage [CRASH-2] trial) and the Northern French Alps Trauma registry.¹⁷ ¹⁸

The CRASH-2 trial included patients from 274 hospitals in 40 countries from 2005 to 2010. Patients with or at risk of significant bleeding within 8 hours of injury were included. Since tranexamic acid is effective only within 3 hours of injury, we excluded patients treated beyond 3 hours.

The Northern French Alps trauma registry, part of the Northern French Alps trauma system (TRENAU), includes 24 hospitals and 16 prehospital mobile intensive care units from 3 emergency medical service systems. Patients, from 2009 to 2016, with major trauma according to the triage rules of the American College of Surgeons were included.¹⁹ We excluded patients with cardiac arrest at the scene of the injury.

## Outcome and variable selection

The primary outcome was in-hospital death due to bleeding within 28 days. In the CRASH-2 trial, the clinician responsible recorded the cause of death. In the Northern French Alps registry, two trauma surgeons and two emergency physicians reviewed the records of all patients who died to determine the cause of death. We selected potential predictors from the CRASH-2 trial data collected before randomisation. We focused on the data available in the prehospital setting or on hospital admission in the Northern French Alps Trauma registry. These data included demographic characteristics (age, sex), physiological parameters (systolic blood pressure (SBP), heart rate (HR), respiratory rate (RR), Glasgow coma scale (GCS)) and the mechanism of injury (blunt or penetrating). All variables could be assessed at the first clinical assessment and were available in hospital records. Physiological variables were the first measures recorded. We also included treatment by tranexamic acid and country income level (high, middle or low income). Treatment by tranexamic acid was included in the equation for statistical adjustment. The coefficient for tranexamic acid treatment was constrained in the model equation to obtain a prediction before treatment at the first clinical assessment. Therefore, we used the entire dataset and not just the placebo arm of the CRASH-2 randomised trial. We assessed the importance of each predictor with the partial R² statistic that estimates the variability of the outcome explained by the predictor. We developed two models. A full model that included all potential predictors and a simple model.

## Model development

We used multivariable logistic regression with random effects by country to identify predictors of death due to bleeding. Continuous variables were included in the model as linear terms. We assessed departures from linearity by plotting the risk of death against continuous variables

and added quadratic and cubic terms to the model for all continuous variables that showed a non-linear relationship graphically. The GCS was used as a continuous variable. We used a backward stepwise method by including all variables, quadratic and cubic terms and plausible interactions between the mechanism of injury and SBP, between the mechanism of injury and GCS, and between age and SBP. We then removed, one at a time, variables for which there was no evidence of association (p>0.05) from the Wald test. We also used the Least Absolute Shrinkage and Selecting Operator (LASSO) method to check that variable selection obtained by the ordinary least squares method was similar.²⁰

## Model performance

We assessed the model performance in terms of discrimination and calibration. Discrimination was assessed with the C-statistic and the receiving operating characteristic curve.²¹ Calibration was assessed as the difference between mean observed and predicted probabilities (calibration in the large) and by plotting observed outcome and predicted probabilities by decile of the predicted risk of death and with a non-parametric smooth function.²² We estimated the calibration slope based on the linear predictor of each model. A calibration slope of 1 and an intercept of 0 indicates perfect calibration. The overall calibration was summarised by the ratio of expected and observed number of events (E/O) with an ideal value of 1.²³ A value <1 indicates an underprediction and a value > 1 indicates an overprediction.

## Model validation

We performed internal validation to estimate the statistical optimism of the final model. We drew 200 bootstrapped samples of 23 402 patients. We developed a model in each bootstrapped sample including variable selection. We estimated the C-statistic in each bootstrapped sample and assessed the performance of each model in the original sample. Optimism was estimated as the mean of the difference between the C-statistic of the bootstrap sample and the C-statistic in the original sample. We subtracted optimism from the C-statistic of the model developed in the original sample to obtain the optimism-corrected C-statistic.

We also conducted an internal-external validation.²⁴⁻²⁶ We performed a cross-validation procedure where we selected countries with a sample size > 300.²⁵ ²⁷ We left out one country in turn and developed models using the same predictors in the remaining countries and estimated the discrimination and calibration in the omitted country. C-statistics, calibration slope and overall calibration for each country were pooled with random effects. We assessed heterogeneity with I² statistics and by testing interaction between calibration slope and country.

## Missing data

There was no loss to follow-up in the CRASH-2 trial and <0.3% in the Northern French Alps Trauma registry.
<figure><img src="image_4.png" /></figure>

<table><caption>**Table 1** Characteristics of the CRASH-2 trial patients</caption><thead><tr><th></th><th>Missing (%)</th><th>All patients n=13485</th><th>Alive n=11404</th><th>All causes of death n=2081</th><th>Death due to bleeding n=815</th></tr></thead><tbody><tr><td>Age, median (IQR)</td><td>0</td><td>30 (24–42)</td><td>30 (23–41)</td><td>34 (25–46)</td><td>32 (25–45)</td></tr><tr><td>SBP, median (IQR)</td><td>2</td><td>90 (80–110)</td><td>95 (80–110)</td><td>80 (70–100)</td><td>77 (60–90)</td></tr><tr><td>HR, median (IQR)</td><td>1</td><td>106 (92–120)</td><td>105 (90–120)</td><td>112 (98–128)</td><td>116 (100–130)</td></tr><tr><td>RR, median (IQR)</td><td>1</td><td>22 (20–26)</td><td>22 (20–26)</td><td>24 (20–30)</td><td>24 (20–30)</td></tr><tr><td>GCS, n (%)</td><td>0</td><td></td><td></td><td></td><td></td></tr><tr><td>3–8</td><td></td><td>2125 (16%)</td><td>1030 (9%)</td><td>1094 (53%)</td><td>360 (35%)</td></tr><tr><td>9–12</td><td></td><td>1784 (13%)</td><td>1451 (13%)</td><td>332 (16%)</td><td>171 (21%)</td></tr><tr><td>13–15</td><td></td><td>9578 (71%)</td><td>8918 (78%)</td><td>654 (31%)</td><td>360 (44%)</td></tr><tr><td>Penetrating Injury, n (%)</td><td>0</td><td>6874 (51%)</td><td>5958 (52%)</td><td>916 (44%)</td><td>485 (60%)</td></tr></tbody></table>

CRASH-2, Clinical Randomisation of Anti-fibrinolytic in Significant Haemorrhage; GCS, Glasgow Coma Scale; HR, heart rate (bpm); RR, respiratory rate (bpm); SBP, systolic blood pressure (mm Hg).

There were 0% to 2% missing values for predictors in the CRASH-2 trial and 0% to 5% in the Northern French Alps Trauma registry. We performed multiple imputation by chained equations to fill in the missing values of predictors.²⁸ We generated 20 imputed datasets. We imputed 2253 missing values (1.6%) for 1317 incomplete observations.

## Patient and public involvement statement

Patients were not involved in the research question and in the design of the study.

All analyses were performed using STATA software V.14.0; and R software V.3.4.3 (R foundation for statistical computing).

## RESULTS

We included 23 430 trauma patients in the study (13 485 in the CRASH-2 trial and 9945 in the Northern French Alps registry, tables 1 and 2). In both the CRASH-2 and Northern French Alps cohorts, the patients were mostly men with a median age of 30 and 35 years respectively. Patients who died from bleeding had lower SBP, lower GCS scores and higher HRs. Penetrating injury was more frequent in the CRASH-2 trial patients (51%) than in the Northern French Alps (5%). Eight hundred and fifteen patients (6%) died from bleeding in the CRASH-2 trial and 102 (1%) in the Northern French Alps cohorts (table 3). Half of the Northern French Alps patients had

<table><caption>**Table 2** Characteristics of the Northern French Alps registry</caption><thead><tr><th></th><th>Missing (%)</th><th>All patients n=9945</th><th>Alive n=9256</th><th>All causes of death n=661</th><th>Death due to bleeding n=102</th></tr></thead><tbody><tr><td>Age, median (IQR)</td><td>&lt;1</td><td>36 (22–53)</td><td>35 (22–51)</td><td>58 (31–73)</td><td>51 (31–68)</td></tr><tr><td>SBP, median (IQR)</td><td>3</td><td>124 (110–140)</td><td>125 (111–140)</td><td>116 (80–140)</td><td>83 (60–110)</td></tr><tr><td>HR, median (IQR)</td><td>4</td><td>84 (74–100)</td><td>85 (75–100)</td><td>84 (60–110)</td><td>97 (60–120)</td></tr><tr><td>RR, median (IQR)</td><td>4</td><td>16 (15–20)</td><td>16 [15–20]</td><td>15 (14–20)</td><td>17 (11–25)</td></tr><tr><td>GCS, n (%)</td><td>3</td><td></td><td></td><td></td><td></td></tr><tr><td>3–8</td><td></td><td>1170 (12)</td><td>718 (8)</td><td>449 (70)</td><td>51 (52)</td></tr><tr><td>9–12</td><td></td><td>500 (5)</td><td>452 (5)</td><td>48 (7)</td><td>10 (10)</td></tr><tr><td>13–15</td><td></td><td>7984 (83)</td><td>7813 (87)</td><td>148 (23)</td><td>37 (38)</td></tr><tr><td>Penetrating injury</td><td>&lt;1</td><td>554 (6)</td><td>508 (6)</td><td>45 (7)</td><td>16 (16)</td></tr><tr><td>Injury severity Score, n (%)</td><td>2</td><td></td><td></td><td></td><td></td></tr><tr><td>0–8</td><td></td><td>2738 (28)</td><td>2723 (30)</td><td>14 (2)</td><td>1 (1)</td></tr><tr><td>9–15</td><td></td><td>2480 (26)</td><td>2450 (27)</td><td>26 (4)</td><td>6 (6)</td></tr><tr><td>16–24</td><td></td><td>2081 (21)</td><td>2008 (22)</td><td>68 (11)</td><td>15 (15)</td></tr><tr><td>25–34</td><td></td><td>1778 (18)</td><td>1453 (16)</td><td>316 (49)</td><td>36 (36)</td></tr><tr><td>&gt;35</td><td></td><td>686 (7)</td><td>465 (5)</td><td>221 (34)</td><td>41 (41)</td></tr></tbody></table>

GCS, Glasgow Coma Scale; HR, heart rate (bpm); RR, respiratory rate (bpm); SBP, systolic blood pressure (mm Hg).
<figure><img src="image_5.png" /><figcaption>**Table 3** Risk of death and intervention</figcaption></figure>

<table><thead><tr><th></th><th>CRASH-2<br>n (%)</th><th>Northern French<br>Alps Trauma<br>registry n (%)</th></tr></thead><tbody><tr><td>Death due to bleeding</td><td>815 (6)</td><td>102 (1)</td></tr><tr><td>Overall death</td><td>2081 (15)</td><td>661 (7)</td></tr><tr><td>Admission in ICU</td><td>5354 (40)</td><td>4205 (42)</td></tr><tr><td>Surgical procedure</td><td>6608 (49)</td><td>2691 (27)</td></tr><tr><td>Surgical procedure for<br>bleeding</td><td>916 (7)</td><td>1251 (12)*</td></tr><tr><td>Blood transfusion,</td><td>6506 (48)</td><td>1054 (11)</td></tr><tr><td>ICU median day (IQR)</td><td>3 (1–7)</td><td>4 (2–10)</td></tr></tbody></table>

*including embolisation
CRASH-2, Clinical Randomisation of Anti-fibrinolytic in Significant Haemorrhage; ICU, intensive care unit.

an Injury Severity Score (ISS) of 16 or more and three quarters had an ISS of 9 or more.

Figure 1 shows the relationships between the potential predictors and death due to bleeding. The risk of death due to bleeding was higher with higher age, lower SBP and lower GCS. HR and RR showed U-shaped relations. The predictors included in the full model were age, SBP, GCS, HR, RR and the mechanism of injury. Sex and country income were not associated with death due to bleeding in multivariable analysis (online supplementary 1 and 2). The LASSO method gave similar results. Age, SBP and GCS had the strongest prognostic value according to partial R². The performance of the model development showed good discrimination with C-statistics of 0.88 (0.87 to 0.89) and 0.87 (0.86 to 0.88) for the full and simple models respectively (table 4). Calibration was good with no differences between observed and predicted deaths due to bleeding, except for high-risk

<figure><img src="image_6.png" /><figcaption>**Figure 1** Relationship between death due to bleeding and potential predictors.</figcaption></figure>
<figure><img src="image_7.png" /></figure>

<table><caption>Table 4 Model performance, internal and internal-external validation.</caption><thead><tr><th rowspan="2"></th><th colspan="2">Full model</th><th colspan="2">Simple model</th></tr><tr><th>Development</th><th>Internal-external validation*</th><th>Development</th><th>Internal-external validation*</th></tr></thead><tbody><tr><td></td><td>n=23 402</td><td>n=22 422</td><td>n=23 402</td><td>n=22 422</td></tr><tr><td>C- statistic (AUC)</td><td>0.88 (0.87-0.89)</td><td>0.85 (0.81-0.88)</td><td>0.87 (0.86-0.88)</td><td>0.84 (0.80-0.88)</td></tr><tr><td>Calibration-in-the-large†</td><td>&lt;0.1</td><td>&lt;0.1</td><td>&lt;0.1</td><td>0.3 (0.1-0.6)</td></tr><tr><td>Calibration slope</td><td>1.01 (0.96-1.07)</td><td>1.07 (0.91-1.14)</td><td>1.04 (0.98-1.09)</td><td>1.12 (0.95-1.29)</td></tr><tr><td>E/O</td><td>1.02 (0.96-1.08)</td><td>0.93 (0.71-1.15)</td><td>0.98 (0.92-1.04)</td><td>0.91 (0.82-0.99)</td></tr></tbody></table>

*Internal-external validation based on pooled data with random effect obtained by cross validation from 13 countries (each with n≥300). Every country is left out once for validation of a model based on the remaining countries.

†Calibration-in-the-large showed difference between observed and predicted death due to bleeding.

AUC, area under the curve (C-statistic); E/O: expected/observed number of deaths due to bleeding.

patients (n=138) in whom the risk was over-estimated above a predicted probability of 0.5 (figure 2). Bootstrap resampling showed negligible model optimism of 0.0023 and gave an optimism-corrected performance that was unchanged with a C-statistic of 0.88 and 0.87 for the full and simple models. At internal-external cross-validation, the C-statistic ranged from 0.80 to 0.94, except for India with a C-statistic of 0.72 (figure 3). The pooled C-statistics were 0.85 (0.81 to 0.88) and 0.84 (0.80 to 0.88) for the full and simple models respectively (table 4). Pooled calibration slope was 1.07 (0.91 to 1.24) and 1.12 (0.95 to 1.29). Calibration slope and overall calibration showed heterogeneity, especially for Iraq, Georgia and Indonesia (figures 4 and 5). We found a significant interaction between calibration slope and country (p<0.001).

# DISCUSSION

## Main findings

We developed and internationally validated a prognostic model to predict death due to bleeding in trauma patients. The model showed good discrimination and calibration in a wide range of settings. By using clinical parameters that can be assessed at the site of injury and available in hospital records, we can accurately estimate the risk of death due to bleeding in a population with major trauma.

# STRENGTHS AND LIMITATIONS

This study has several strengths. We used data from well-described inception cohorts of bleeding trauma

<figure><img src="image_8.png" /><figcaption>**Figure 2** Calibration curves for model development. AUC, area under the curve.</figcaption></figure>
<figure><img src="image_9.png" /></figure>

<figure><img src="image_10.png" /><figcaption>**Figure 3** Internal-external cross-validation C-statistics by countries. AUC, area under the curve.</figcaption></figure>
<figure><img src="image_11.png" /></figure>

<figure><img src="image_12.png" /></figure>

<figure><img src="image_13.png" /><figcaption>**Figure 4** Internal–external cross-validation of calibration slope by countries.</figcaption></figure>
<figure><img src="image_14.png" /></figure>

<figure><img src="image_15.png" /><figcaption>**Figure 5** Internal-external cross-validation overall calibration expected and observed number of deaths due to bleeding (E/O) by countries.</figcaption></figure>
patients with or at risk of significant haemorrhage. Prognostic factors collected correspond to the first measure recorded after injury. Unlike previous studies, loss to follow-up was minimal.²⁹ We used a well-defined outcome at a fixed time point after injury. These strengths help ensure the internal validity of the model.

We developed our model in a large international cohort with patients from 40 countries and a large trauma registry. This helps to ensure that our results are widely applicable. We did not split the data randomly or use separate derivation and validation cohorts. Because the number of outcome events is the limiting factor in prognostic studies, we used the full dataset with more than 900 traumatic deaths due to bleeding to ensure accurate prediction and strengthen internal validity. Splitting the data could have led to a pessimistic and unstable estimate of performance.³⁰ For this reason, we did not perform split-sample validation and preferred to perform internal-external cross-validation that has been recommended for assessing generalisability.²⁴ We also performed boostraping that helps to estimate the model optimism. However, we welcome further external validation in different trauma cohorts by different authors.³¹

Our study also has limitations. We cannot rule out misclassification of the outcome. The cause of death can be difficult to determine, especially in late bleeding deaths that could be confused with thrombotic disseminated intravascular coagulation (DIC).⁶ If deaths due to DIC were misclassified as deaths due to bleeding, this might underestimate the effect of SBP, HR or RR in this model.

Another limitation was the potential for measurement error in prognostic factors. The use of a single measurement for blood pressure rather than the average of several measurements could lead to error and regression dilution bias.³² The regression line between outcome and predictor is fitted in order to minimise the distance between each point and the line. The random error of the predictor increases the distance to the regression line and underestimates the effect of the predictor by flattening the regression line.³³ This may explain the over-prediction in high risk patients. Patients with haemorrhagic shock and haemodynamic instability are more likely to have blood pressure variation and, hence, measurement error. This over-prediction occurred only for trauma patients with a very high predicted risk of death due to bleeding (above 0.45), representing <0.6% of the study population (n=138). In these very high-risk patients, precise quantification of the risk of death is unlikely to influence clinical decisions. On the other hand, accurate prediction is clinically important in low-risk patients, as, for example, it may determine who receives tranexamic acid.

Finally, we observed heterogeneity of performance across countries. We note that the discriminative ability is affected by miscalibration and case-mix.²⁶ The relatively poor C-statistic in India could be explained by the combination of calibration slope below 1 and a relatively homogeneous case-mix. On the other hand, the high C-statistic in

France reflected that the Northern French Alps trauma registry selected a more heterogeneous case-mix population with major trauma. We acknowledge that this model is suitable for a population similar to that used in this study, such as a population with major trauma.

## Implications of study

Our prognostic model provides a way of identifying trauma patients with or at risk of significant haemorrhage based on predicted probabilities of death due to bleeding. Quality improvement programmes could use this model to estimate the individual risks of death due to bleeding in a trauma population. Based on these predictions, a trauma audit could determine a threshold for patients with 'significant haemorrhage' who should be treated with tranexamic acid. The threshold used may depend on effectiveness, cost and safety considerations. According to European guidelines for the management of traumatic bleeding, tranexamic acid is supported by the highest level of evidence (grade 1A).⁵ Tranexamic acid costs about one pound per patient and has no serious adverse effects. For these reasons, a low predicted risk of bleeding death might be used in trauma audit.

An internet application has been prepared using our simple model for use in the prehospital setting (www.evidencio.com). This could help paramedics decide who should receive tranexamic acid at the scene of injury. It could also be useful in prehospital triage. Some previously proposed trauma scores predict all-cause mortality or massive transfusion.²⁹ ³⁴ ³⁵ Ours is the only model that predicts death due to bleeding. Because bleeding is the leading cause of preventable death, the model might become an essential tool for identifying patients needing urgent interventions such as damage control surgery and multispeciality critical care. It could also help identify patients who need to be transported directly to a regional trauma centre or for whom massive transfusion protocol needs to be activated before they arrive at the hospital.

A prognostic model predicting all-cause mortality was developed previously using CRASH-2 data.³⁶ However, traumatic deaths can result from many different pathophysiological mechanisms. For example, both high and low SBP predict death from all causes but only low blood pressure predicts death due to bleeding. The association of high blood pressure with all-cause mortality is likely to reflect deaths from traumatic brain injury. By combining different mechanisms of death, predictions based on all-cause mortality could misclassify the risk of death from bleeding.

## FUTURE STUDIES

Our models may facilitate stratification of clinical trial populations into risk categories at baseline. Future studies may examine if and how the effect of tranexamic acid varies with baseline risk and model the health impact of different treatment strategies.
**Author affiliations**

¹Clinical Trials Unit, London School of Hygiene & Tropical Medicine, London, UK

²Emergency Department and Northern French Alps Emergency Network, Hospital Annecy Genevois, Annecy, France

³Clinical Research Center and Division of Clinical Epidemiology, Department of Health and Community Medicine, University Hospital Geneva, Geneva, Switzerland

⁴Department of Biomedical Data Sciences, Leiden University Medical Center, Leiden, Rotterdam, The Netherlands

⁵Department of Public Health, Erasmus MC, Rotterdam, The Netherlands

⁶Grenoble Alpes Trauma Center, Pôle Anesthésie-Réanimation, CHU Grenoble Alpes, Grenoble, France

**Contributors** FXA, IR designed the study. FXA, PB, IR designed and monitored the data collection from which this paper was developed. FXA, AGA analysed the data. PB gave feedback about the clinical use. ES gave feedback and statistical advice. FXA, IR wrote the first draft. FXA, AGA, ES, PB, IR contributed to write and revised the paper.

**Funding** The authors have not declared a specific grant for this research from any funding agency in the public, commercial or not-for-profit sectors.

**Competing interests** None declared.

**Patient consent for publication** Not required.

**Ethics approval** The CRASH-2 trial received ethics committee approval from the London School of Hygiene & Tropical Medicine, UK and the ethics committees of all participating hospitals. The Northern French Alps Trauma Registry was approved by the ethics committee of the university hospital of Clermont-Ferrand, France.

**Provenance and peer review** Not commissioned; externally peer reviewed.

**Data sharing statement** Data from the CRASH-2 trial is available via freeBIRD (free bank of injury and emergency research data), hosted by the Clinical Trial Unit of the London School of Hygiene and Tropical Medicine. More information at.

**Open access** This is an open access article distributed in accordance with the Creative Commons Attribution Non Commercial (CC BY-NC 4.0) license, which permits others to distribute, remix, adapt, build upon this work non-commercially, and license their derivative works on different terms, provided the original work is properly cited, appropriate credit is given, any changes made indicated, and the use is non-commercial. See: http://creativecommons.org/licenses/by-nc/4.0/.

**REFERENCES**

1. GBD 2013 Mortality and Causes of Death Collaborators. Global, regional, and national age-sex specific all-cause and cause-specific mortality for 240 causes of death, 1990–2013: a systematic analysis for the Global Burden of Disease Study 2013. *The Lancet* 2013;2015:117–71.

2. Esposito TJ, Sanddal TL, Reynolds SA, et al. Effect of a voluntary trauma system on preventable death and inappropriate care in a rural state. *J Trauma* 2003;54:663–70. discussion 669-670.

3. Kleber C, Giesecke MT, Tsokos M, et al. Trauma-related preventable deaths in Berlin 2010: need to change prehospital management strategies and trauma management education. *World J Surg* 2013;37:1154–61.

4. Roberts I, Shakur H, Afolabi A, et al. CRASH-2 collaborators. The importance of early treatment with tranexamic acid in bleeding trauma patients: an exploratory analysis of the CRASH-2 randomised controlled trial. *Lancet* 2011;377:1096–101. 1101.e1-2.

5. Rossaint R, Bouillon B, Cerny V, et al. The European guideline on management of major bleeding and coagulopathy following trauma: fourth edition. *Crit Care* 2016;20:100.

6. Ciesla DJ, Pracht EE, Tepas JJ, et al. Measuring trauma system performance: Right patient, right place-Mission accomplished? *J Trauma Acute Care Surg* 2015;79:263–8.

7. Coats TJ, Fragoso-Iñiguez M, Roberts I. Implementation of tranexamic acid for bleeding trauma patients: a longitudinal and cross-sectional study. *Emerg Med J* 2019;36:78–81.

8. Metcalfe D, Perry DC, Bouamra O, et al. Regionalisation of trauma care in England. *Bone Joint J* 2016;98-B:1253–61.

9. Angus DC, Black N. Improving care of the critically ill: institutional and health-care system approaches. *Lancet* 2004;363:1314–20.

10. Jamtvedt G, Young JM, Kristoffersen DT, et al. Does telling people what they have been doing change what they do? A systematic review of the effects of audit and feedback. *Qual Saf Health Care* 2006;15:433–6.

11. Ivers N, Jamtvedt G, Flottorp S, et al. Audit and feedback: effects on professional practice and healthcare outcomes. *Cochrane Database Syst Rev* 2012:CD000259.

12. Ludman PF, de Belder MA, McLenachan JM, et al. The importance of audit to monitor applications of procedures and improve primary angioplasty results. *EuroIntervention* 2012;8(Suppl P):P62–P70.

13. Strbian D, Michel P, Ringleb P, et al. Relationship Between Onset-to-Door Time and Door-to-Thrombolysis Time. *Stroke* 2013;44:2808–13.

14. McDermott FT. Trauma audit and quality improvement. *Aust NZ J Surg* 1994;64:147–54.

15. Patel HC, Bouamra O, Woodford M, et al. Trends in head injury outcome from 1989 to 2003 and the effect of neurosurgical care: an observational study. *The Lancet* 2005;366:1538–44.

16. Shafi S, Barnes SA, Rayan N, et al. Compliance with recommended care at trauma centers: association with patient outcomes. *J Am Coll Surg* 2014;219:189–98.

17. Shakur H, Roberts I, Bautista R, et al. Effects of tranexamic acid on death, vascular occlusive events, and blood transfusion in trauma patients with significant haemorrhage (CRASH-2): a randomised, placebo-controlled trial. *Lancet Lond Engl* 2010;376:23–32.

18. Bouzat P, Ageron FX, Brun J, et al. A regional trauma system to optimize the pre-hospital triage of trauma patients. *Crit Care* 2015;19:111.

19. Sasser SM, Hunt RC, Faul M, et al. Guidelines for field triage of injured patients: recommendations of the National Expert Panel on Field Triage, 2011. *MMWR Recomm Rep Morb Mortal Wkly Rep Recomm Rep Cent Dis Control* 2012;61(RR-1):1–20.

20. Tibshirani R. Regression Shrinkage and Selection Via the Lasso. *J R Stat Soc Ser B Methodol* 1996;58:267–88.

21. Royston P, Altman DG. Visualizing and assessing discrimination in the logistic regression model. *Stat Med* 2010;29:2508–20.

22. Steyerberg EW, Vickers AJ, Cook NR, et al. Assessing the performance of prediction models: a framework for traditional and novel measures. *Epidemiology* 2010;21:128–38.

23. Riley RD, Ensor J, Snell KI, et al. External validation of clinical prediction models using big datasets from e-health records or IPD meta-analysis: opportunities and challenges. *BMJ* 2016;353:i3140.

24. Steyerberg EW, Harrell FE. Prediction models need appropriate internal, internal-external, and external validation. *J Clin Epidemiol* 2016;69:245–7.

25. Royston P, Parmar MK, Sylvester R. Construction and validation of a prognostic model across several studies, with an application in superficial bladder cancer. *Stat Med* 2004;23:907–26.

26. Austin PC, van Klaveren D, Vergouwe Y, et al. Validation of prediction models: examining temporal and geographic stability of baseline risk and estimated covariate effects. *Diagn Progn Res* 2017;1:12.

27. Steyerberg EW, Mushkudiani N, Perel P, et al. Predicting outcome after traumatic brain injury: development and international validation of prognostic scores based on admission characteristics. *PLoS Med* 2008;5:e165.

28. White IR, Royston P, Wood AM. Multiple imputation using chained equations: Issues and guidance for practice. *Stat Med* 2011;30:377–99.

29. Rehn M, Perel P, Blackhall K, et al. Prognostic models for the early care of trauma patients: a systematic review. *Scand J Trauma Resusc Emerg Med* 2011;19:17.

30. Austin PC, Steyerberg EW, variable Eper. Events per variable (EPV) and the relative performance of different strategies for estimating the out-of-sample validity of logistic regression models. *Stat Methods Med Res* 2017;26:796–808.

31. Siontis GC, Tzoulaki I, Castaldi PJ, et al. External validation of new risk prediction models is infrequent and reveals worse prognostic discrimination. *J Clin Epidemiol* 2015;68:25–34.

32. MacMahon S, Peto R, Collins R, et al. Blood pressure, stroke, and coronary heart disease. *The Lancet* 1990;335:765–74.

33. Hutcheon JA, Chiolero A, Hanley JA. Random measurement error and regression dilution bias. *BMJ* 2010;340:c2289.

34. Sartorius D, Le Manach Y, David JS, et al. Mechanism, glasgow coma scale, age, and arterial pressure (MGAP): a new simple prehospital triage score to predict mortality in trauma patients. *Crit Care Med* 2010;38:831–7.

35. Yücel N, Lefering R, Maegele M, et al. Trauma Associated Severe Hemorrhage (TASH)-Score: probability of mass transfusion as surrogate for life threatening hemorrhage after multiple trauma. *J Trauma* 2006;60:1228–37. discussion 1236-1237.

36. Perel P, Prieto-Merino D, Shakur H, et al. Predicting early death in patients with traumatic bleeding: development and validation of prognostic model. *BMJ* 2012;345:e5166.