# Ensemble bias correction of climate simulations: preserving internal variability

Pradeebane Vaittinada Ayar, Mathieu Vrac, Alain Mailhot

<figure><img src="image_1.png" /></figure>

## To cite this version:

Pradeebane Vaittinada Ayar, Mathieu Vrac, Alain Mailhot. Ensemble bias correction of climate simulations: preserving internal variability. Scientific Reports, 2021, 11 (1), 10.1038/s41598-021-82715-1. hal-03146401

HAL Id: hal-03146401

https://hal.science/hal-03146401

Submitted on 1 Mar 2021

HAL is a multi-disciplinary open access
archive for the deposit and dissemination of sci-
entific research documents, whether they are pub-
lished or not. The documents may come from
teaching and research institutions in France or
abroad, or from public or private research centers.

L'archive ouverte pluridisciplinaire HAL, est
destinée au dépôt et à la diffusion de documents
scientifiques de niveau recherche, publiés ou non,
émanant des établissements d'enseignement et de
recherche français ou étrangers, des laboratoires
publics ou privés.

<figure><img src="image_2.png" /></figure>

Distributed under a Creative Commons Attribution 4.0 International License
<figure><img src="image_3.png" /></figure>

Check for updates

OPEN

# Ensemble bias correction of climate simulations: preserving internal variability

Pradeebane Vaittinada Ayar<fnref n="1" />✉, Mathieu Vrac² & Alain Mailhot<fnref n="1" />

Climate simulations often need to be adjusted (i.e., corrected) before any climate change impacts studies. However usual bias correction approaches do not differentiate the bias from the different uncertainties of the climate simulations: scenario uncertainty, model uncertainty and internal variability. In particular, in the case of a multi-run ensemble of simulations (i.e., multiple runs of one model), correcting, as usual, each member separately, would mix up the model biases with its internal variability. In this study, two ensemble bias correction approaches preserving the internal variability of the initial ensemble are proposed. These "Ensemble bias correction" (EnsBC) approaches are assessed and compared to the approach where each ensemble member is corrected separately, using precipitation and temperature series at two locations in North America from a multi-member regional climate ensemble. The preservation of the internal variability is assessed in terms of monthly mean and hourly quantiles. Besides, the preservation of the internal variability in a changing climate is evaluated. Results show that, contrary to the usual approach, the proposed ensemble bias correction approaches adequately preserve the internal variability even in changing climate. Moreover, the climate change signal given by the original ensemble is also conserved by both approaches.

Bias correction of climate model simulations is often needed prior to impact studies<fnref n="1" />. Indeed, impact models (e.g., in hydrology, ecology, agriculture) are usually calibrated with observations. The models usually present discrepancies (or biases) from these observations and using raw climate models outputs in impact models may result in meaningless results (e.g., for hydrological model²). Biases in climate models are often characterised by differences in statistical distributions between observed and simulated series. Many statistical bias correction (BC) methods have been developed to correct biases in simulations and get simulated series with appropriate statistical properties. Currently, a large majority of BC methods aims at adjusting the mean, the variance and quantiles of a given climate variable distribution. Multiple quantile-based BC methods are actually available³⁻⁷.

However, when using a single climate model simulation to calibrate a BC method, what is assimilated to a bias may actually be uncertainties. This should thus be treated in a different way. There are various sources of uncertainty in climate models: emission scenario uncertainty, model uncertainty, and climate internal variability⁸. Emission scenario (also called forcing scenario) uncertainty is related to the inability to foresee the greenhouse gas emissions in the future. It is usually evaluated with climate projections generated for different representative concentration pathway (RCP) obtained from various socioeconomic projections⁹. Model uncertainty is related to the various responses resulting from the different model representations of the Earth climate system¹⁰. For a given forcing scenario, model uncertainties can combine general circulation models (GCMs) and other models such as downscaling models (Regional Climate Models, RCMs and/or statistical downscaling methods, e.g., Vaittinada Ayar et al.¹¹) as well as impact models (e.g., hydrological models) uncertainties.

Model uncertainty can be estimated using different modelling chains, combining for instance different climate, downscaling, and impact models (IPCC¹²). The internal variability represents the natural variability of the climate due to its chaotic and nonlinear nature and can be present even in transient climate¹³,¹⁴. Whereas forcing scenario and model uncertainties should be reduced with adjustments to future emissions and improvements our knowledge in the representations of the earth system models, climate internal variability is related to the chaotic nature of the climate system and remains irreducible¹⁴,¹⁵. Many studies have estimated these different uncertainties using simulation ensembles, run with different forcing scenarios, various GCM or RCM models and more rarely with multiple initial and/or boundary conditions⁸,¹⁶,¹⁷.

<footnote n="1">¹Institut national de la recherche scientifique, Centre Eau Terre Environnement, Quebec G1K 9A9, Canada. ²Laboratoire des Sciences du Climat et l'Environnement (LSCE-IPSL) CNRS/CEA/UVSQ, UMR8212, Université Paris-Saclay, 91190 Gif-sur-Yvette, France. ✉email: pradeebane@laposte.net</footnote>
When applying BC methods to adjust the simulations, the different sources of uncertainties contributing to the biases are not differentiated. Thus, the question is: should all the bias components should be treated indiscriminately? More precisely, should bias due to model uncertainties and bias related to internal variability (the latter being hereafter referred to as IV) be treated at the same time? For instance, the IV of an RCM can be obtained by a multi-member simulation ensemble of that RCM i.e., which consist of a set of RCM simulations using different initial or boundary conditions called members. Such an ensemble can be very insightful to perform sensitivity analyses on a hydrological model or generate an ensemble of hydrological simulations¹⁸. However such ensemble needs to be bias-corrected before it can be used for hydrological modelling. However, one caveat of actually available quantile-based BC approaches is that they are not able to discriminate the respective contributions to total bias originating from model uncertainties and those associated to internal variability. Therefore, correcting each member separately, i.e., without taking into consideration IV, would reduce (or at least change) the IV of the bias-corrected ensemble, which could be inappropriate for impact studies where the impact of IV needs to be assessed.

The aim of this study is to develop a BC method that preserves the IV of the ensemble. The proposed method is based on the “Cumulative Distribution Function-transform” (CDF-t) initially developed to downscale wind¹⁹, and later applied to correct and/or downscale univariate simulated distribution. Many applications of the approach have been made since²⁰⁻²³, and variant versions also developed²⁴,²⁵. Inspired from CDF-t, two ensemble BC methods are implemented and compared at two sites, Chicago and New York where observed and multi-member RCM simulated precipitation and temperature series are available.

Section “Model and reference data” presents the observational and simulated datasets used in this study. The methodology is presented in section “Ensemble bias correction: EnsBC”. The results are shown in section “Results” and summarised and discussed in section “Conclusions and discussions”.

## Model and reference data

The “Climate change and hydrological Extremes” (ClimEx) project has produced a large ensemble (LE) of 50 high-resolution RCM simulations over two domains, North-eastern North America and Europe, at 0.11° × 0.11° spatial resolution (~12 km; for details see Leduc et al.²⁶).

Boundary conditions used to drive those high-resolution RCM simulations were provided by the Canadian Fourth generation Atmospheric Global Climate Model (CanESM2²⁷,²⁸). The 50 independent CanESM2-LE runs²⁹,³⁰ were simulated under the Representative Concentration Pathway 8.5 (RCP8.5) emission scenario⁹. Random perturbations of the initial state of cloud-overlap parameters were applied to generate the 50 ensemble members with all the other settings (e.g., forcing scenario and model parameters) unchanged³⁰. This 50-member ensemble has been generated over the period 1950–2099 by the 5th generation Canadian Regional Climate Model (CRCM5³¹,³²) and is hereafter referred to as the CRCM5 Large-Ensemble (CRCM5-LE). A four-year spin up period was discarded from each CRCM5-LE member resulting in 146-year series (1954–2099) at each of the 280 × 280 grid points of North-America. Specific details about CRCM5 dynamics, the sub-grid model parametrisation and the ClimEx experiment set-up and validation have been thoroughly described²⁶,³³. Various studies using the CRCM5-LE have been carried out in historical and future climate²⁶,³⁴⁻³⁶.

Records from weather stations part of the HadISD³⁷,³⁸ database (HadISD data product version 3.1.1.202004p) located in the simulation domain are used as reference datasets. Hourly series are selected according to data availability over the period 1961–1990. Only stations with at least 20 years with less than 5% annual missing values are considered. Two stations are finally selected, one located at Chicago O’Hare airport and the second one at New York LaGuardia airport.

For each station, the precipitation and temperature time series of the CRCM5 grid-cell containing the stations are extracted. In the following, the 1961–1990 period will be used as the calibration period.

## Ensemble bias correction: EnsBC

The proposed methods are based on the “Cumulative Distribution Function-transform” (CDF-t) bias correction (BC) method¹⁹. The CDF-t method consists in relating the CDF of the simulated (CRCM5-LE) variable to the CDF of the reference (station) variable (i.e., here precipitation or temperature recorded series at Chicago or New York stations). CDF-t is a quantile–quantile method that takes into account the potential change in the modelled CDF from the calibration (i.e. historical) period to the projected time period. This is done through the definition of a transfer function T, linking the simulated and reference CDFs.

Let $F_{SC}(x)$ and $F_{MC}(x)$ define respectively the CDFs of variable $x$ (e.g. temperature or precipitation) at one station (here Chicago or New-York) for the observed and simulated series over the calibration period, and $F_{SP}(x)$ end $F_{MP}(x)$ the corresponding CDFs over the projection period.

The transfer function T is defined by:

$$T(F_{MC}(x)) = F_{SC}(x) \Leftrightarrow T(u) = F_{SC}(F_{MC}^{-1}(u)) \quad (1)$$

with $u$ in [0, 1]. As T is assumed to be valid even in a climate different from the calibration one, it can be applied to link the simulated and reference CDFs in the projection period:

$$T(F_{MP}(x)) = F_{SP}(x). \quad (2)$$

Combining (1) and (2) allows to estimate the CDF for the bias corrected variable $x$ for each individual member $m$ (BCIND) over the projection period, $\hat{F}_{S_p}^{(m)}(x)$, using the expression:
$$ (\text{BCIND}) \quad \hat{F}_{S_p^{(m)}}(x) = F_{S_C} \left( F_{M_C^{(m)}}^{-1} \left( F_{M_p^{(m)}}(x) \right) \right). \quad (3) $$

Based on this explicit formulation of $\hat{F}_{S_p^{(m)}}$, a quantile mapping between $\hat{F}_{S_p^{(m)}}(x)$ and $F_{M_p^{(m)}}(x)$ can then be performed to derive the bias-corrected data over the projection period. The modelled bias-corrected quantile, $\hat{x}_{S_p^{(m)}}$, is obtained by applying the inverse CDF estimated in Eq. (3):

$$ \hat{x}_{S_p^{(m)}} = \hat{F}_{S_p^{(m)}}^{-1} \left( F_{M_p^{(m)}}(x_{M_p^{(m)}}) \right). \quad (4) $$

While the traditional quantile-mapping approach will use the formulation $\hat{x}_{S_p^{(m)}} = F_{S_C}^{-1} \left( F_{M_C^{(m)}}(x_{M_p^{(m)}}) \right)$ (i.e., based on two distributions characterising the calibration period), the CDF-t method relies on two distribution distributions characterising the projection period (Eq. (4)). Thus, CDF-t takes into account the potential evolutions (or non-stationarities) of the model distribution between the calibration and projection periods. This property stands for all the ensemble BC methods further presented. Additional details can be found in Vrac et al.⁵.

In the following, this formulation of the CDF-t method is used to bias-correct temperature. A slightly different version is applied for precipitation. A “threshold adaptation” (TA) technique is first applied to correct the frequency of rain occurrence followed by the application of the CDF-t method to the strictly positive precipitation intensities²⁵.

This method is applied to each member $m$ of the CRCM5-LE and is hereafter referred to as BCIND. Note that BCIND is the classical way to correct biases of ensembles of RCM simulations and is considered as the reference to which two proposed methods of ensemble bias correction (EnsBC) are compared.

In a first version, in order to preserve the IV in the BC results, the CDF of the variable of interest over the reference period and for each member $m$ of the CRCM5-LE, $F_{M_C^{(m)}}$ in Eq. (1), is replaced by the CDF of the entire ensemble over the reference period $F_{M-Ens_C}$. This approach is labelled as BCENS hereafter and Eq. (3) thus becomes:

$$ (\text{BCENS}) \quad \tilde{F}_{S_p^{(m)}}(x) = F_{S_C} \left( F_{M-Ens_C}^{-1} \left( F_{M_p^{(m)}}(x) \right) \right). \quad (5) $$

where $\tilde{F}_{S_p^{(m)}}(x)$ is the CDF for the bias corrected variable $x$ for each member $m$ taking into account the variability among the various members by using the ensemble distribution.

The second version is a slight modification of BCIND in which, for each member $m$ of the CRCM5-LE, the modelled bias-corrected quantile, $\hat{x}_{S_p^{(m)}}$ obtained in Eq. (4), is modified in order to account for the IV over the historical period. Assuming a stationary climate over the 30-year reference period, a difference $\Delta$ is explicitly added to $\hat{x}_{S_p^{(m)}}$. For the given probability $F_{M_p^{(m)}}(x_{M_p^{(m)}})$ over the projection period, this difference $\Delta$ corresponds to the absolute difference between the quantile of the member $m$ and that of the entire ensemble quantile over the calibration period:

$$ \Delta = F_{M_C^{(m)}}^{-1} \left( F_{M_p^{(m)}}(x_{M_p^{(m)}}) \right) - F_{M-Ens_C}^{-1} \left( F_{M_p^{(m)}}(x_{M_p^{(m)}}) \right). $$

$\Delta$ allows to “reintroduce” the IV of the original CRCM5-LE lost (or changed) with BCIND for each quantile. Hence, the following expression, for the approach hereafter referred to as BCIV, is derived for each member $m$ of the CRCM5-LE:

$$ (\text{BCIV}) \quad \left\{ \begin{array}{l} \tilde{x}_{S_p^{(m)}} = \hat{x}_{S_p^{(m)}} + \Delta \\ \Leftrightarrow = \hat{F}_{S_p^{(m)}}^{-1} \left( F_{M_p^{(m)}}(x_{M_p^{(m)}}) \right) + F_{M_C^{(m)}}^{-1} \left( F_{M_p^{(m)}}(x_{M_p^{(m)}}) \right) - F_{M-Ens_C}^{-1} \left( F_{M_p^{(m)}}(x_{M_p^{(m)}}) \right) \end{array} \right. \quad (6) $$

Note that for precipitation, the “occurrence-intensity” separation is also performed via the threshold adaptation technique for both BCENS and BCIV approaches. In addition, Eq. (6) is valid for intensive variables such as temperature. For extensive variables such as precipitation, the addition/subtraction operators in the previous equation must be replaced by multiplication/division operators to define a function preserving the ensemble variability in quantiles.

## Results

The three bias correction approaches, BCIND, BCENS, and BCIV, are applied at both stations, Chicago and New York, for both variables, temperature and precipitation, on hourly series but on a month-by-month basis. Five projection periods are considered: 1961–1990 (reference period), 1991–2019, 2020–2039, 2040–2069, and 2070–2099. However, for the sake of brevity, the results are mostly focused on the calibration (1961–1990) and the 2040–2069 periods.

**Monthly mean and internal variability.** The performance of the different EnsBC methods are first assessed through the hourly monthly mean. Figure 1 shows the boxplots of the 50-member ensemble monthly mean hourly temperature and precipitation in January and July at Chicago and New York.

The size of the boxplots measures the internal variability for raw and bias-corrected CRCM5-LE while the medians correspond to the bias of the CRCM5-LE and bias corrected ensembles. As expected, IV is almost
<figure><img src="image_4.png" /><figcaption>**Figure 1.** January (**a**,**c**,**e**,**g**) and July (**b**,**d**,**f**,**h**) monthly mean of hourly precipitation (top) and temperature (bottom) for Chicago (**a**–**d**) and New York (**e**–**h**) over the 1961–1990 period for the original (blue) and bias-corrected 50-member CRCM5-LE (purple: BCIND, green: BCENS and yellow: BCIV). Dashed lines represent the observed mean.</figcaption></figure>

<figure><img src="image_5.png" /><figcaption>**Figure 2.** Monthly CVs of hourly mean precipitation (top) and temperature SD (bottom) for Chicago (**a**,**c**,**e**,**g**) and New York (**b**,**d**,**f**,**h**) over the 1961–1990 (**a**–**d**) and 2040–2069 (**e**–**h**) periods. The blue, purple, green and yellow lines respectively represent the CV (for precipitation) and SD (for temperature) of the original (RAW) and the BCIND, BCENS and BCIV corrected ensembles.</figcaption></figure>

completely eliminated (no dispersion of bias corrected values) by the classical BCIND method. These results advocate for the use of EnsBC methods. The values for all months are given in Fig. S1 to S4 of the Supplementary material for the calibration and 2040–2069 periods along with the monthly probability and mean of hours with precipitation (> 0 mm).

In order to thoroughly compare the IV of each ensemble, the coefficient of variability (CV) of the monthly mean precipitation, defined as the standard deviation divided by the median of the ensemble) and standard deviation (SD) of the temperature are computed. Figure 2 shows the monthly precipitation CV and temperature SD for the raw CRCM5-LE and bias-corrected ensembles over the 1961–1990 and 2040–2069 periods for Chicago and New York.

Whether for precipitation or for temperature, BCIND almost completely wipes out the IV of the CRCM5-LE. This was expected since all members are bias-corrected separately using a common reference dataset. However,
<figure><img src="image_6.png" /><figcaption>**Figure 3.** Hourly precipitation amount (top) and temperature (bottom) quantile-quantile plots at Chicago (a–d) and New York (e–h) over the 1961–1990 periods for January (a,c,e,g) and July (b,d,f,h). The blue, purple, green and yellow solid lines represent respectively the original and the BCIND, BCENS and BCIV corrected ensembles median of the simulated quantiles associated to the same probability. For each ensemble, the spread of the simulated quantiles associated to same probability is represented by dashed lines for precipitation and colour shades for temperature.</figcaption></figure>

surprisingly, IV for the 2040–2069 period after applying BCIND method is larger than the raw ensemble for both temperature and precipitation. This can be related to overfitting issues. Indeed, in BCIND, each member is corrected separately which only accounts for the variability of only one member. Thus, a part of the variability is blended to the signal of change in future projections. Hence, the BCIND corrections mixed the climate change signal and the internal variability, resulting in a larger IV in future climate. On the contrary, BCENS and BCIV preserve the IV efficiently, BCIV slightly outperforming BCENS for precipitation in reference period, while it is the opposite for the future period. For temperature, both methods give very good results as projected IV is similar to the projected IV of the original CRCM5-LE.

For precipitation, the CV are in general slightly overestimated (except for BCIV over the calibration period) but remain close to the CV of the CRCM5-LE. These differences may be explained by the large discrepancies between CRCM5-LE and bias-corrected probabilities of occurrence of hourly precipitation (cf. Fig. S1–S4 of the supplementary material). In August for the future period there is a drop of performance in Chicago for BCIV while there is almost no bias in rainfall occurrence (cf. Fig. S1). BCIV is a variant of BCIND and therefore it “inherits” its larger IV over projection period. For precipitation the ratio,

$$ \Delta = \frac{F_{M_C^{(m)}}^{-1}(F_{M_p^{(m)}}(x_{M_p^{(m)})})}{F_{M-EnSC}^{-1}(F_{M_p^{(m)}}(x_{M_p^{(m)})})}, $$

is supposed to correct this feature. However, August precipitation intensities in Chicago present the largest biases and very small amount and spread for the raw ensemble. This makes Δ really close to 1 and unable to correct the over-dispersion of BCIND.

**Hourly quantiles and internal variability.** The capability of the EnsBC methods to reproduce the original IV is then assessed at a quantile level. Figure 3 presents quantile-quantile plots the January and July hourly precipitation and temperature over the calibration period.

The results show that the precipitation quantile spread of the ensemble simulated precipitation quantiles associated to a same probability are located below and above contains the first bisector, except for the BCIND corrected ensemble, for which the bisector is below the spread. For temperature, the bias-corrected ensemble matches the first bisector but it is hard to visually assess the variability of the simulated quantiles since the quantile spreads are much smaller.

To assess more precisely the quantile IV, the CV (resp. SD) of the simulated precipitation (resp. temperature) quantile associated to each given probability are computed and represented against the corresponding observed quantiles in Fig. 4.

As expected from the analysis of the quantile-quantile plots, BCIND clearly fails to reproduce the ensemble quantile variability for both stations and both variables. Losing this variability removes the most important
<figure><img src="image_7.png" /><figcaption>**Figure 4.** Precipitation CV (top) and temperature SD (bottom) of the simulated hourly quantile associated to the same probability over the 1961–1990 period of in function of the observed quantiles associated to the same probability at Chicago (a–d) and New York (e–h) for January (a,c,e,g) and July (b,d,f,h). The blue, purple, green and yellow solid lines represent respectively the raw and the BCIND, BCENS and BCIV corrected ensembles. Vertical dashed lines represent the observed 95th, 97.5th, 99th, 99.5th and 99.99th precipitation percentiles and the first, 25th, 50th, 75th and 99th temperature percentiles).</figcaption></figure>

added-value of a multi-member ensemble, even though the bias is corrected. BCENS and BCIV are better performing to preserve the quantile IV for precipitation and temperature. BCIV has a clear advantage for the extreme quantile, i.e., both low- and high-probability CVs for precipitation and SDs for temperature are much closer to raw ensemble corresponding CV and SD than the BCENS corrected ensemble. Figure S5 of the supplementary material gives the equivalent to Fig. 4 but for monthly quantiles. The conclusions are the same as for the hourly quantiles.

**Climate change signal and internal variability.** As previously mentioned, the individual CRCM5-LE ensemble members are constrained by boundary conditions with identical radiative forcing and parametrisation. Only the initial state of cloud-overlap parameters are different. After the spin-up period, each member evolves chaotically and the spread is resulting from the IV alone. The total trends stemming from the individual model realisations can be partitioned into contributions from the response to the external forcing and the IV. In order to illustrate if the EnsBC methods have actually preserved the contribution of the IV to climate change signal, the signal-to-noise ratios (SNR) have been calculated. SNR is defined as the ratio between the mean and the standard deviation of the trends from each member of the ensemble³⁹:

$$SNR = \frac{\text{mean}(\text{trends})}{\text{sd}(\text{trends})}.$$

The trends are estimated using the non-parametric Theil–Sen estimator⁴⁰ which considers the median of the slopes over all pairs of sample points as a good estimator of the slope of a linear trend over a given period. Figure 5 represents the SNR estimated for each 20-year sliding window (shifted every five years) over the 1961–2099 period for annual total precipitation and mean annual temperature for the raw and bias-corrected ensembles. The SNR variations of the raw ensemble are well preserved by all the bias corrected ensembles for both variables and both stations. The dashed lines representing the maximum and minimum SNR boundaries defined respectively as $\max(\text{trends})$ and $\min(\text{trends})$ also show a good preservation of the raw ensemble SNR boundary variations by all the bias corrected ensembles. In order to assess the reproduction of the SNR for extremes, the same exercise has been conducted for annual maximum precipitation and temperature instead of annual total precipitation and mean temperature. The same as Figure 5 for the maxima are given Figure S6 of the supplementary material. The conclusions for the maxima are the same. This means that the three tested BC approaches preserve the IV contribution to the trend of the raw simulations. If this was expected for BCIND with the CDF-t method²², this result also indicates that accounting for the IV in the BCENS and BCIV EnsBC approaches still allows the corrections to preserve the main climate change signal and the trends.
<figure><img src="image_8.png" /><figcaption>**Figure 5.** SNR for annual total precipitation (a,b) and mean temperature (c,d) over the 1961–2099 period for Chicago (a,c) and New York (b,d). The blue, purple, green and yellow solid lines represent respectively the raw and the BCIND, BCENS and BCIV corrected ensembles SNR for each 20-year periods. The dashed lines represent the maximum and minimum SNR boundaries defined respectively as $\max(\text{trends})$ and $\min(\text{trends})$.</figcaption></figure>

## Conclusions and discussions

The aim of this study is to develop ensemble bias correction (EnsBC) methods that preserve the internal variability of a multi-member ensemble after the corrections. Such BC methods are interesting in the purpose of using these simulations to feed impacts models whilst benefiting from the added-value of an multi-member ensemble. To this end, three strategies of EnsBC – both relying on an arbitrarily chosen BC method (here, CDF-t) – are implemented: (i) the BC is performed for each member individually (BCIND), which is the classical way to perform an EnsBC; (ii) the BC is performed for each member using the CDF of the entire ensemble as calibration model CDF (BCENS); and (iii) the BC is performed for each member, explicitly accounting for the internal variability (BCIV). An application of the different EnsBC strategies is performed to correct precipitation and temperature time series simulated from the CRCM5-LE ensemble, with respect to two weather station time series on station data at Chicago and New York. Their ability to reproduce the IV is assessed regarding the variability of the monthly mean and that of quantiles. The preservation of the trends after the corrections is also evaluated.

Results show that the BCIND approach completely fails in the preservation of the ensemble internal variability, both in terms of monthly mean and quantiles, while BCENS and BCIV are successful to provide bias corrections respecting the ensemble IV. BCIV is only slightly better than BCENS but has a clear advantage regarding the preservation of the variability for extreme quantiles. The three EnsBC strategies preserve the IV contribution to climate change signal of the raw ensemble. Based on these conclusions, BCIV seems to be the most suited approach to perform an EnsBC.

However, the main results of this study could be further investigated in various ways. First, the EnsBC strategies proposed in this paper are only based on one univariate BC approach, CDF-t. The same methodology has to be tested for other univariate but also for multi-variate BC methods to better understand the contribution of
the specific BC method to the robustness our our findings. Multivariate BC corrects the inter-variable, spatial and/or temporal correlation in addition to the distributional properties (cf. François et al.⁷, and the reference therein for more insights on BC).

Moreover, the methodology developed in this study is only applied to one multi-member ensemble to pre-
serve its IV. The question is still open for the inter-model variability in the case of a multi-model ensemble. For
discussion purposes, let us consider that there are many multi-member ensembles. EnsBC can be applied either
(i) to all the simulations of all the ensemble together, or (ii) to each ensemble separately. In the first case, the gap
between each ensemble would be maintained, which means that part of the biases due to the model uncertainties
would remain untouched. In the second case (what is done in this study), the median of each ensemble matches
the observations (over the calibration period), which implicitly means that biases are fully comprised in the
model uncertainties. Both cases are not necessarily desirable. A way to evaluate what is actually corrected by BC
methods and what has to be corrected is needed.

Also, the evaluation of the EnsBC results could be done through ensemble variability partitioning and esti-
mation using, for instance, "Analysis of variance" (ANOVA¹⁷). Such analyses before and after BC would help to
quantify the contribution of the different uncertainties and which ones of them are reduced after EnsBC.

Last but not least, since RCMs simulations are eventually meant to be used as inputs in impact models, added-
value and/or any undesired effect of EnsBC methods can be assessed, for instance through hydrological models.
Combining a variability analysis and impacts modelling should give insights on what needs to be corrected or not.

Received: 2 September 2020; Accepted: 21 December 2020

Published online: 04 February 2021

References

1. Christensen, J. H., Boberg, F., Christensen, O. B. & Lucas-Picher, P. On the need for bias correction of regional climate change projections of temperature and precipitation. *Geophys. Res. Lett.* **35**, L20-709 (2008).

2. Grouillet, B., Ruelland, D., Vaittinada Ayar, P. & Vrac, M. Sensitivity analysis of runoff modeling to statistical downscaling models in the western Mediterranean. *Hydrol. Earth Syst. Sci.* **20**, 1031–1047 (2016).

3. Déqué, M. Frequency of precipitation and temperature extremes over France in an anthropogenic scenario: Model results and statistical correction according to observed values. *Glob. Planet. Chang.* **57**, 16–26 (2007).

4. Gudmundsson, L., Bremnes, J. B., Haugen, J. E. & Engen-Skaugen, T. Technical Note: Downscaling RCM precipitation to the station scale using statistical transformations—a comparison of methods. *Hydrol. Earth Syst. Sci.* **16**, 3383–3390 (2012).

5. Vrac, M. et al. Dynamical and statistical downscaling of the French Mediterranean climate: Uncertainty assessment. *Nat. Hazards Earth Syst. Sci.* **12**, 2769–2784 (2012).

6. Cannon, A. J., Sobie, S. R. & Murdock, T. Q. Bias correction of GCM precipitation by quantile mapping: How well do methods preserve changes in quantiles and extremes?. *J. Clim.* **28**, 6938–6959 (2015).

7. François, B., Vrac, M., Cannon, A. J., Robin, Y. & Allard, D. Multivariate bias corrections of climate simulations: Which benefits for which losses?. *Earth Syst. Dyn.* **11**, 537–562 (2020).

8. Evin, G. et al. Partitioning uncertainty components of an incomplete ensemble of climate projections using data augmentation. *J. Clim.* **32**, 2423–2440 (2019).

9. van Vuuren, D. P. et al. The representative concentration pathways: An overview. *Clim. Change* **109**, 5–31 (2011).

10. Knutti, R. & Sedláček, J. Robustness and uncertainties in the new CMIP5 climate model projections. *Nat. Clim. Change* **3**, 369–373 (2013).

11. Vaittinada Ayar, P. et al. Intercomparison of statistical and dynamical downscaling models under the EURO- and MED-CORDEX initiative framework: present climate evaluations. *Clim. Dyn.* **46**, 1301–1329 (2016).

12. Stocker, T. et al. *Summary for Policymakers, Book Section SPM 1–30* (Cambridge University Press, Cambridge, 2013).

13. Deser, C., Phillips, A., Bourdette, V. & Teng, H. Uncertainty in climate change projections: The role of internal variability. *Clim. Dyn.* **38**, 527–546 (2012).

14. Lafaysse, M., Hingray, B., Mezghani, A., Gailhard, J. & Terray, L. Internal variability and model uncertainty components in future hydrometeorological projections: The Alpine Durance basin. *Water Resour. Res.* **50**, 3317–3341 (2014).

15. Fatichi, S. et al. Uncertainty partition challenges the predictability of vital details of climate change. *Earth's Future* **4**, 240–251 (2016).

16. Paeth, H. et al. Quantifying the evidence of climate change in the light of uncertainty exemplified by the Mediterranean hot spot region. *Glob. Planet. Change* **151**, 144–151 (2017).

17. Hingray, B., Blanchet, J., Evin, G. & Vidal, J.-P. Uncertainty component estimates in transient climate projections. *Clim. Dyn.* (2019).

18. Troin, M., Caya, D., Velázquez, J. A. & Brissette, F. Hydrological response to dynamical downscaling of climate model outputs: A case study for western and eastern snowmelt-dominated Canada catchments. *J. Hydrol. Reg. Stud.* **4**, 595–610 (2015).

19. Michelangeli, P.-A., Vrac, M. & Loukos, H. Probabilistic downscaling approaches: Application to wind cumulative distribution functions. *Geophys. Res. Lett.* https://doi.org/10.1029/2009GL038401 (2009).

20. Colette, A., Vautard, R. & Vrac, M. Regional climate downscaling with prior statistical correction of the global climate forcing. *Geophys. Res. Lett.* **39**, L13707 (2012).

21. Tobin, I. et al. Assessing climate change impacts on European wind energy from ENSEMBLES high-resolution climate projections. *Clim. Change* **128**, 99–112 (2015).

22. Vrac, M. & Vaittinada Ayar, P. Influence of bias correcting predictors on statistical downscaling models. *J. Appl. Meteorol. Climatol.* **56**, 5–26 (2017).

23. Famien, A. M. et al. A bias-corrected CMIP5 dataset for Africa using the CDF-t method—A contribution to agricultural impact studies. *Earth Syst. Dyn.* **9**, 313–338 (2018).

24. Kallache, M., Vrac, M., Naveau, P. & Michelangeli, P.-A. Nonstationary probabilistic downscaling of extreme precipitation. *J. Geophys. Res. Atmos.* **116**, 05113 (2011).

25. Vrac, M., Noël, T. & Vautard, R. Bias correction of precipitation through singularity stochastic removal: Because occurrences matter. *J. Geophys. Res. Atmos.* **121**, 5237–5258 (2016).

26. Leduc, M. et al. The ClimEx Project: A 50-member ensemble of climate change projections at 12-km resolution over Europe and Northeastern North America with the Canadian Regional Climate Model (CRCM5). *J. Appl. Meteorol. Climatol* **58**, 663–693 (2019).

27. Arora, V. K. et al. Carbon emission limits required to satisfy future representative concentration pathways of greenhouse gases. *Geophys. Res. Lett.* **38** (2011).
28. von Salzen, K. et al. The Canadian Fourth Generation Atmospheric Global Climate Model (CanAM4). Part I: Representation of physical processes. *Atmosphere-Ocean* **51**, 104–125 (2013).

29. Sigmond, M. & Fyfe, J. C. Tropical Pacific impacts on cooling North American winters. *Nat. Clim. Change* **6**, 970–974 (2016).

30. Fyfe, J. C. et al. Large near-term projected snowpack loss over the western United States. *Nat. Commun.* **8**, 14996 (2017).

31. Martynov, A. et al. Reanalysis-driven climate simulation over CORDEX North America domain using the Canadian Regional Climate Model, version 5: model performance evaluation. *Clim. Dyn.* **41**, 2973–3005 (2013).

32. Šeparović, L. et al. Present climate and climate change over North America as simulated by the fifth-generation Canadian regional climate model. *Clim. Dyn.* **41**, 3167–3201 (2013).

33. Lucas-Picher, P., Laprise, R. & Winger, K. Evidence of added value in North American regional climate model hindcast simulations using ever-increasing horizontal resolutions. *Clim. Dyn.* **48**, 2611–2633 (2017).

34. Innocenti, S., Mailhot, A., Leduc, M., Cannon, A. J. & Frigon, A. Projected changes in the probability distributions, seasonality, and spatiotemporal scaling of daily and subdaily extreme precipitation simulated by a 50-member ensemble over northeastern north america. *J. Geophys. Res. Atmos.* **124**, 10427–10449 (2019a).

35. Innocenti, S., Mailhot, A., Frigon, A., Cannon, A. J. & Leduc, M. Observed and Simulated Precipitation over Northeastern North America: How do daily and subdaily extremes scale in space and time?. *J. Clim.* **32**, 8563–8582 (2019b).

36. Martel, J.-L., Mailhot, A. & Brissette, F. Global and regional projected changes in 100-yr subdaily, daily, and multiday precipitation extremes estimated from three large ensembles of climate simulations. *J. Clim.* **33**, 1089–1103 (2020).

37. Dunn, R. J. H. et al. Hadisd: A quality-controlled global synoptic report database for selected variables at long-term stations from 1973–2011. *Clim. Past* **8**, 1649–1679 (2012).

38. Dunn, R. J. H., Willett, K. M., Parker, D. E. & Mitchell, L. Expanding HadISD: Quality-controlled, sub-daily station data from 1931. *Geosci. Instrum. Methods Data Syst.* **5**, 473–491 (2016).

39. Deser, C., Phillips, A. S., Alexander, M. A. & Smoliak, B. V. Projecting North American climate over the next 50 years: Uncertainty due to internal variability. *J. Clim.* **27**, 2271–2296 (2014).

40. Sen, P. K. Estimates of the regression coefficient based on Kendall's Tau. *J. Am. Stat. Assoc.* **63**, 1379–1389 (1968).

## Acknowledgements

MV would like to acknowledge support from the EUPHEME and CoCliServ projects, both part of ERA4CS, an ERA-NET initiated by JPI Climate and co-funded by the European Union (grant no. 690462). The CRCM5-LE dataset for the north eastern North America domain can be obtained at https://www.climex-project.org/en/data-access. Station data from the HadISD database are available at https://www.metoffice.gov.uk/hadobs/hadisd/v311_202007p/download.html. PV scholarship was partly provided by the MITACS Accelerate program. AM thanks the Discovery Grants Program from the Natural Science and Engineering Research Council of Canada (NSERC) for providing financial support of this project. The authors thank the consortium Ouranos who gives access to the CRCM5-LE. The ClimEx project was financed by the Bavarian State Ministry for the Environment and Consumer Protection. CRCM5 simulations were run by SuperMUC supercomputer at Leibniz Supercomputing Centre (LRZ) of the Bavarian Academy of Sciences and Humanities and funded via the Gauss Centre for Supercomputing (GCS) by the German Federal Ministry of Education and Research and the Bavarian State Ministry of Education, Science and the Arts. The CRCM5 was developed by the ESCER centre Université du Quebec à Montreal (UQAM) in collaboration with Environment and Climate Change Canada. The Canadian Centre for Climate Modelling and Analysis (CCCMa) executed and made available the CanESM2-LE for the ClimEx project. The authors would like to thank Guillaume Talbot for his technical helps.

## Author contributions

P.V. conceived the study, prepared part of the data, conducted the analysis and wrote the original manuscript, M.V. contributed to improving the methodology, M.V. and A.M. helped to improving the analysis and interpretation and editing the manuscript. All authors discussed and commented the manuscript.

## Competing interests

The authors declare no competing interests.

## Additional information

**Supplementary Information** The online version contains supplementary material available at https://doi.org/10.1038/s41598-021-82715-1.

**Correspondence** and requests for materials should be addressed to P.V.A.

**Reprints and permissions information** is available at www.nature.com/reprints.

**Publisher's note** Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

<figure><img src="image_9.png" /></figure>

**Open Access** This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.

© The Author(s) 2021