# Deep learning applied to glacier evolution modelling

Jordi Bolibar, Antoine Rabatel, Isabelle Gouttevin Gouttevin, Clovis Galiez, Thomas Condom, Eric Sauquet

► To cite this version:

Jordi Bolibar, Antoine Rabatel, Isabelle Gouttevin Gouttevin, Clovis Galiez, Thomas Condom, et al. Deep learning applied to glacier evolution modelling. The Cryosphere, 2020, 14 (2), pp.565-584. 10.5194/tc-14-565-2020. hal-02914563

HAL Id: hal-02914563

https://hal.science/hal-02914563

Submitted on 22 Jan 2021

HAL is a multi-disciplinary open access
archive for the deposit and dissemination of sci-
entific research documents, whether they are pub-
lished or not. The documents may come from
teaching and research institutions in France or
abroad, or from public or private research centers.

L'archive ouverte pluridisciplinaire HAL, est
destinée au dépôt et à la diffusion de documents
scientifiques de niveau recherche, publiés ou non,
émanant des établissements d'enseignement et de
recherche français ou étrangers, des laboratoires
publics ou privés.

<figure><img src="image_1.png" /></figure>
# Deep learning applied to glacier evolution modelling

Jordi Bolibar<fnref n="1" />,<fnref n="2" />, Antoine Rabatel<fnref n="1" />, Isabelle Gouttevin<fnref n="3" />, Clovis Galiez<fnref n="4" />, Thomas Condom<fnref n="1" />, and Eric Sauquet<fnref n="2" />

**Correspondence:** Jordi Bolibar (jordi.bolibar@univ-grenoble-alpes.fr)

Received: 8 July 2019 – Discussion started: 26 July 2019

Revised: 16 January 2020 – Accepted: 18 January 2020 – Published: 13 February 2020

**Abstract.** We present a novel approach to simulate and reconstruct annual glacier-wide surface mass balance (SMB) series based on a deep artificial neural network (ANN; i.e. deep learning). This method has been included as the SMB component of an open-source regional glacier evolution model. While most glacier models tend to incorporate more and more physical processes, here we take an alternative approach by creating a parameterized model based on data science. Annual glacier-wide SMBs can be simulated from topo-climatic predictors using either deep learning or Lasso (least absolute shrinkage and selection operator; regularized multilinear regression), whereas the glacier geometry is updated using a glacier-specific parameterization. We compare and cross-validate our nonlinear deep learning SMB model against other standard linear statistical methods on a dataset of 32 French Alpine glaciers. Deep learning is found to outperform linear methods, with improved explained variance (up to +64% in space and +108% in time) and accuracy (up to +47% in space and +58% in time), resulting in an estimated r<fnref n="2" /> of 0.77 and a root-mean-square error (RMSE) of 0.51 m w.e. Substantial nonlinear structures are captured by deep learning, with around 35% of nonlinear behaviour in the temporal dimension. For the glacier geometry evolution, the main uncertainties come from the ice thickness data used to initialize the model. These results should encourage the use of deep learning in glacier modelling as a powerful nonlinear tool, capable of capturing the nonlinearities of the climate and glacier systems, that can serve to reconstruct or simulate SMB time series for individual glaciers in a whole region for past and future climates.

## 1 Introduction

Glaciers are arguably one of the most important icons of climate change, being climate proxies which can depict the evolution of climate for the global audience (IPCC, 2018). In the coming decades, mountain glaciers will be some of the most important contributors to sea level rise and will most likely drive important changes in the hydrological regime of glacierized catchments (Beniston et al., 2018; Vuille et al., 2018; Hock et al., 2019). The reduction in ice volume may produce an array of hydrological, ecological and economic consequences in mountain regions which require being properly predicted. These consequences will strongly depend on the future climatic scenarios, which will determine the timing and magnitude for the transition of hydrological regimes (Huss and Hock, 2018). Understanding these future transitions is key for societies to adapt to future hydrological and climate configurations.

Glacier and hydro-glaciological models can help answer these questions, giving several possible outcomes depending on multiple climate scenarios. (a) Surface mass balance (SMB) and (b) glacier dynamics both need to be modelled to understand glacier evolution on regional and sub-regional scales. Models of varying complexity exist for both processes. In order to model these processes at a large scale (i.e. on several glaciers at a catchment scale), some compromises need to be made, which can be approached in different ways.

<footnote n="1">¹Univ. Grenoble Alpes, CNRS, IRD, G-INP, Institut des Géosciences de l'Environnement (IGE, UMR 5001), Grenoble, France</footnote>

<footnote n="2">²INRAE, UR RiverLy, Villeurbanne, Lyon, France</footnote>

<footnote n="3">³Univ. Grenoble Alpes, Université de Toulouse, Météo-France, CNRS, CNRM, Centre d'Études de la Neige, Grenoble, France</footnote>

<footnote n="4">⁴Univ. Grenoble Alpes, CNRS, Grenoble INP, LJK, Grenoble, France</footnote>
a. Regarding SMB, the following apply:

1. Empirical models, like the temperature-index model (e.g. Hock, 2003), simulate glacier SMB through empirical relationships between air temperature and melt and snow accumulation.

2. Statistical or machine learning models describe and predict glacier SMB based on statistical relationships found in data from a selection of topographical and climate predictors (e.g. Martin, 1974; Steiner et al., 2005).

3. Physical and surface energy balance (SEB) models take into account all energy exchanges between the glacier and the atmosphere and can simulate the spatial and temporal variability in snowmelt and the changes in albedo (e.g. Gerbaux et al., 2005).

b. Regarding glacier dynamics, the following apply:

1. Parameterized models do not explicitly resolve any physical processes but implicitly take them into account using parameterizations, based on statistical or empirical relationships, in order to modify the glacier geometry. This type of model ranges from very simple statistical models (e.g. Carlson et al., 2014) to more complex ones based on different approaches, such as a calibrated equilibrium-line altitude (ELA) model (e.g. Zemp et al., 2006), a glacier retreat parameterization specific to glacier size groups (Huss and Hock, 2015), or volume and length-area scaling (e.g. Marzeion et al., 2012; Radić et al., 2014).

2. Process-based models, like GloGEMflow (e.g. Zekollari et al., 2019) and the Open Global Glacier Model (OGGM; e.g. Maussion et al., 2019), approximate a number of glacier physical processes involved in ice flow dynamics using the shallow ice approximation.

3. Physics-based models, like the finite-element Elmer/Ice model (e.g. Gagliardini et al., 2013), approach glacier dynamics by explicitly simulating physical processes and solving the full Stokes equations (e.g. Jouvet et al., 2009; Réveillet et al., 2015).

At the same time, the use of these different approaches strongly depends on available data, whose spatial and temporal resolutions have an important impact on the results' quality and uncertainties (e.g. Réveillet et al., 2018). Parameterized glacier dynamics models and empirical and statistical SMB models require a reference or training dataset to calibrate the relationships, which can then be used for projections with the hypothesis that relationships remain stationary in time. On the contrary, process-based and specially physics-based glacier dynamics and SMB models have the

advantage of representing physical processes, but they require larger datasets at higher spatial and temporal resolutions with a consequently higher computational cost (Réveillet et al., 2018). For SMB modelling, meteorological reanalyses provide an attractive alternative to sparse point observations, although their spatial resolution and suitability to complex high-mountain topography are often not good enough for high-resolution physics-based glacio-hydrological applications. However, parameterized models are much more flexible, equally dealing with fewer and coarser meteorological data as well as the state-of-the-art reanalyses, which allows them to work at resolutions much closer to the glaciers' scale and to reduce uncertainties. The current resolution of climate projections is still too low to adequately drive most glacier physical processes, but the ever-growing datasets of historical data are paving the way for the training of parameterized machine learning models.

In glaciology, statistical models have been applied for more than half a century, starting with simple multiple linear regressions on few meteorological variables (Hoinkes, 1968; Martin, 1974). Statistical modelling has made enormous progress in the last decades, especially thanks to the advent of machine learning. Compared to other fields in geosciences, such as oceanography (e.g. Ducournau and Fablet, 2016; Lguensat et al., 2018), climatology (e.g. Rasp et al., 2018; Jiang et al., 2018) and hydrology (e.g. Marçais and de Dreuzy, 2017; Shen, 2018), we believe that the glacio-logical community has not yet exploited the full capabilities of these approaches. Despite this fact, a number of studies have taken steps towards statistical approaches. Steiner et al. (2005) pioneered the very first study to use artificial neural networks (ANNs) in glaciology to simulate mass balances of the Great Aletsch Glacier in Switzerland. They showed that a nonlinear model is capable of better simulating glacier mass balances compared to a conventional stepwise multiple linear regression. Furthermore, they found a significant nonlinear part within the climate-glacier mass balance relationship. This work was continued in Steiner et al. (2008) and Nussbaumer et al. (2012) for the simulation of glacier length instead of mass balances. Later on, Maussion et al. (2015) developed an empirical statistical downscaling tool based on machine learning in order to retrieve glacier surface energy and mass balance (SEB-SMB) fluxes from large-scale atmospheric data. They used different machine learning algorithms, but all of them were linear, which is not necessarily the most suitable for modelling the nonlinear climate system (Houghton et al., 2001). Nonetheless, more recent developments in the field of machine learning and optimization enabled the use of deeper network structures than the three-layer ANN of Steiner et al. (2005). These deeper ANNs, which remain unexploited in glaciology, allow us to capture more nonlinear structures in the data even for relatively small datasets (Ingrassia and Morlini, 2005; Olson et al., 2018).

Here, we present a parameterized regional open-source glacier model: the ALpine Parameterized Glacier Model
(ALPGM; Bolibar, 2019). While most glacier evolution models tend to incorporate more and more physical processes in SMB or ice dynamics (e.g. Maussion et al., 2019; Zekolari et al., 2019), ALPGM takes an alternative approach based on data science for SMB modelling and parameterizations for glacier dynamics simulation. ALPGM simulates annual glacier-wide SMB and the evolution of glacier volume and surface area over timescales from a few years to a century at a regional scale. Glacier-wide SMBs are computed using a deep ANN, fed by several topographical and climatic variables, an approach which is compared to different linear methods in the present paper. In order to distribute these annual glacier-wide SMBs and to update the glacier geometry, a refined version of the Δh methodology (e.g. Huss et al., 2008) is used, for which we dynamically compute glacier-specific Δh functions. In order to validate this approach, we use a case study with 32 French Alpine glaciers for which glacier-wide annual SMBs are available over the period 1984–2014 and 1959–2015 for certain glaciers. High-resolution meteorological reanalyses for the same time period are used (SAFRAN; Durand et al., 2009), while the initial ice thickness distribution of glaciers is taken from Farinotti et al. (2019), for which we performed a sensitivity analysis based on field observations.

In the next section, we present an overview of the proposed glacier evolution model framework with a detailed description of the two components used to simulate the annual glacier-wide SMB and the glacier geometry update. Then, a case study using French Alpine glaciers is presented, which enables us to illustrate an example of application of the proposed framework, including a rich dataset, the parameterized functions, and the results and their performance. In the end, several aspects regarding machine and deep learning modelling in glaciology are discussed, from which we make some recommendations and draw the final conclusions.

## 2 Model overview and methods

In this section we present an overview of ALPGM. Moreover, the two components of this model are presented in detail: the Glacier-wide SMB Simulation component and the Glacier Geometry Update component.

### 2.1 Model overview and workflow

ALPGM is an open-source glacier model coded in Python. The source code of the model is accessible in the project repository (see Code and data availability). It is structured in multiple files which execute specific separate tasks. The model can be divided into two main components: (1) the Glacier-wide SMB Simulation and (2) the Glacier Geometry Update. The Glacier-wide SMB Simulation component is based on machine learning, taking both meteorological and topographical variables as inputs. The Glacier Geometry Update component generates the glacier-specific parameterized functions and modifies annually the geometry of the glacier (e.g. ice thickness distribution, glacier outline) based on the glacier-wide SMB models generated by the Glacier-wide SMB simulation component.

Figure 1 presents ALPGM’s basic workflow. The workflow execution can be configured via the model interface, allowing the user to run or skip any of the following steps:

1. The meteorological forcings are preprocessed in order to extract the necessary data closest to each glacier’s centroid. The meteorological features are stored in intermediate files in order to reduce computation times for future runs, automatically skipping this preprocessing step when the files have already been generated.

2. The SMB machine learning component retrieves the preprocessed climate predictors from the stored files, retrieves the topographical predictors from the multi-temporal glacier inventories and assembles the training dataset by combining all the necessary topo-climatic predictors. A machine learning algorithm is chosen for the SMB model, which can be loaded from a previous run, or it can be trained again with a new dataset. Then, the SMB model or models are trained with the full topo-climatic dataset. These models are stored in intermediate files, allowing the user to skip this step for future runs.

3. Performances of the SMB models can be evaluated with a leave-one-glacier-out (LOGO) or a leave-one-year-out (LOYO) cross validation. This step can be skipped when using already-established models. Basic statistical performance metrics are given for each glacier and model as well as plots with the simulated cumulative glacier-wide SMBs compared to their reference values with uncertainties for each of the glaciers from the training dataset.

4. The Glacier Geometry Update component starts with the generation of the glacier-specific parameterized functions, using a raster containing the difference of the two preselected digital elevation models (DEMs) covering the study area for two separate dates as well as the glacier contours. These parameterized functions are then stored in individual files to be used in the final simulations.

5. Once all previous steps have been run, the glacier evolution simulations are launched. For each glacier, the initial ice thickness and DEM rasters and the glacier geometry update function are retrieved. Then, in a loop, for every glacier and year, the topographical data are computed from these raster files. The climate predictors at the glacier’s current centroid are retrieved from the climate data (e.g. reanalysis or projections), and with all this data the input topo-climatic data for the
<figure><img src="image_2.png" /><figcaption>Figure 1. ALPGM structure and workflow.</figcaption></figure>

glacier-wide SMB model are assembled. Afterwards, the glacier-wide SMB for this glacier and year is simulated, which, combined with the glacier-specific geometry update function, allows us to update the glacier's ice thickness and DEM rasters. This process is repeated in a loop, therefore updating the glacier's geometry with an annual time step and taking into account the glacier's morphological and topographical changes in the glacier-wide SMB simulations. For the simulation of the following year's SMB, the previously updated ice thickness and DEM rasters are used to recompute the topographical parameters, which in turn are used as input topographical predictors for the glacier-wide SMB machine learning model. If all the ice thickness raster pixels of a glacier become zero, the glacier is considered to have disappeared and is removed from the simulation pipeline. For each year, multiple results are stored in data files as well as the raster DEM and ice thickness values for each glacier.

## 2.2 Glacier-wide surface mass balance simulation

Annual glacier-wide SMBs are simulated using machine learning. Due to the regional characteristics and specificities of topographical and climate data, this glacier-wide SMB modelling method is, for now, a regional approach.

### 2.2.1 Selection of explanatory topographical and climatic variables

In order to narrow down which topographical and climatic variables best explain glacier-wide SMB in a given study area, a literature review as well as a statistical sensitivity analysis are performed. Typically used topographical predictors are longitude, latitude, glacier slope and mean altitude. As for meteorological predictors, cumulative positive degree days (CPDDs) but also mean monthly temperature, snowfall and possibly other variables that influence the surface energy budget are often used in the literature. Examples of both topographic and meteorological predictors can be found in the case study in Sect. 3. A way to prevent biases when making predictions with different climate data is to work with anomalies, calculated as differences of the variable with respect to its average value over a chosen reference period.

For the machine learning training, the relevant predictors must be selected, so we perform a sensitivity study of the annual glacier-wide SMB to topographical and climatic variables over the study training period. This can be performed with individual linear regressions between each variable and glacier-wide SMB data. After identification of the topographical and climatic variables that can potentially explain annual glacier-wide SMB variability for the region of interest, a training dataset is built. An effective way of expanding the training dataset in order to dig deeper into the available data
<figure><img src="image_3.png" /><figcaption>Figure 2. Glacier-wide SMB simulation component workflow. Machine learning models are dynamically created based on training data.</figcaption></figure>

is to combine the climatic and topographical input variables (Weisberg, 2014). Such combinations can be expressed following Eq. (1):

$$SMB_{g,y} = f(\hat{\Omega}, \hat{C}) + \varepsilon_{g,y}, \quad (1)$$

where $\hat{\Omega}$ is a vector of the selected topographical predictors, $\hat{C}$ is a vector with the selected climatic features and $\varepsilon_{g,y}$ is the residual error for each annual glacier-wide SMB value, SMB$_{g,y}$.

Once the training dataset is created, different algorithms f (two linear and one nonlinear, for the case of this study) can be chosen to create the SMB model: (1) OLS (ordinary-least-square) all-possible multiple linear regressions, (2) Lasso (least absolute shrinkage and selection operator; Tibshirani, 1996) and (3) a deep ANN. ALPGM uses some of the most popular machine learning Python libraries: statsmodels (Seabold and Perktold, 2010), scikit-learn (Pedregosa et al., 2011) and Keras (Chollet, 2015) with a TensorFlow backend. The overall workflow of the machine learning glacier-wide SMB model production in ALPGM is summarized in Fig. 2.

### 2.2.2 All-possible multiple linear regressions

With the OLS all-possible multiple linear regressions, we attempt to find the best subset of predictors in Eq. (1) based on the resulting $r^2$ adjusted while at the same time avoiding overfitting (Hawkins, 2004) and collinearity and limiting the complexity of the model. As its name indicates, the goal is to minimize the residual sum of squares for each subset of predictors (Hastie et al., 2009). n models are produced by selecting all possible subsets of k predictors. It is advisable to narrow down the number of predictors for each subset in the search to reduce the computational cost. Models with low performance are filtered out, keeping only models with the highest $r^2$ adjusted possible, a variance inflation factor (VIF) < 1.2 and a p value < 0.01/n (in order to ensure the Bonferroni correction). Retained models are combined by averaging their predictions, thereby avoiding the pitfalls related to stepwise single-model selection (Whittingham et al., 2006). These criteria ensure that the models explain as much vari-

ability as possible, avoid collinearity and are statistically significant.

### 2.2.3 Lasso

The Lasso (Tibshirani, 1996) is a shrinkage method which attempts to overcome the shortcomings of the simpler stepwise and all-possible regressions. In these two classical approaches, predictors are discarded in a discrete way, giving subsets of variables which have the lowest prediction error. However, due to its discrete selection, these different subsets can exhibit high variance, which does not reduce the prediction error of the full model. The Lasso performs a more continuous regularization by shrinking some coefficients and setting others to zero, thus producing more interpretable models (Hastie et al., 2009). Because of its properties, it strikes a balance between subset selection (like all-possible regressions) and ridge regression (Hoerl and Kennard, 1970). All input data are normalized by removing the mean and scaling to unit variance. In order to determine the degree of regularization applied to the coefficients used in the linear OLS regression, an alpha-parameter needs to be chosen using cross validation. ALPGM performs different types of cross validations to choose from: the Akaike information criterion (AIC), the Bayesian information criterion (BIC) and a classical cross validation with iterative fitting along a regularization path (used in the case study). Alternatively, a Lasso model with least-angle regression, also known as Lasso Lars (Tibshirani et al., 2004), can also be chosen with a classical cross validation.

### 2.2.4 Deep artificial neural network

ANNs are nonlinear statistical models inspired by biological neural networks (Fausett, 1994; Hastie et al., 2009). A neural network is characterized by (1) the architecture or pattern of connections between units and the number of layers (input, output and hidden layers), (2) the optimizer, which is the method for determining the weights of the connections between units, and (3) its (usually nonlinear) activation functions (Fausett, 1994). When ANNs have more than one hidden layer (e.g. Fig. 3), they are referred to as deep ANNs or deep learning. The description of neural networks is beyond the scope of this study, so for more details and a full explanation, please refer to Fausett (1994), Hastie et al. (2009) and Steiner et al. (2005, 2008), where the reader can find a thorough introduction to the use of ANNs in glaciology. ANNs gained recent interest thanks to improvements of optimization algorithms allowing the training deep neural networks, which lead to better representation of complex data patterns. As their learnt parameters are difficult to interpret, ANNs are adequate tools when the quality of predictions prevails over the interpretability of the model (the latter likely involving causal inference, sensitivity testing or modelling of ancillary variables). This is precisely the case in our study context
here, where abundant knowledge about glacier physics further helps in choosing adequate variables as input to deep learning. Their ability to model complex functions of the input parameters makes them particularly suitable for modelling complex nonlinear systems such as the climate system (Houghton et al., 2001) and glacier systems (Steiner et al., 2005).

ALPGM uses a feed-forward fully connected ANN (Fig. 3). In such an architecture, the processing units – or neurons – are grouped into layers, where all the units of a given layer are fully connected to all units of the next layer. The flow of information is directional, from the input layer (i.e. in which each neuron corresponds to one of the *N* explanatory variables) to the output neuron (i.e. corresponding to the target variable of the model, the SMB). For each connection of the ANN, weights are initialized in a random fashion following a specific distribution (generally centred around 0). In each unit of each hidden layer, the weighted values are summed before going through a nonlinear activation function, responsible for introducing the nonlinearities in the model. Using a series of iterations known as epochs, the ANN will try to minimize a specific loss function (the mean-squared error – MSE – in our case), comparing the processed values of the output layer with the ground truth (y). In order to avoid falling into local minima of the loss function, some regularization is needed to prevent the ANN from overfitting (Hastie et al., 2009). To prevent overfitting during the training process (i.e.. to increase the ability of the model to generalize to new data), we used a classical regularization method called dropout, consisting of training iteratively smaller subparts of the ANN by randomly disconnecting a certain number of connections between units. The introduction of Gaussian noise at the input of the ANN also helped to generalize, as it performs a similar effect to data augmentation. The main consequence of regularization is generalization, for which the produced model is capable of better adapting to different configurations of the input data.

The hyperparameters used to configure the ANN are determined using cross validation in order to find the best-performing combination of number of units, hidden layers, activation function, learning rate and regularization method. Due to the relatively small size of our dataset, we encountered the best performances with a quite small deep ANN, with a total of six layers (four hidden layers) with a (*N*, 40, 20, 10, 5, 1) architecture (Fig. 3), where *N* is the number of selected features. Since the ANN already performs all the possible combinations between features (predictors), we use a reduced version of the training matrix from Eq. (1), with no combination of climatic and topographical features. Due to the relatively small size of the architecture, the best dropout rates are small (Srivastava et al., 2014) and range between 0.3 and 0.01, depending on the number of units of each hidden layer. Leaky ReLUs have been chosen as the activation function because of their widespread reliability and the fact that they help prevent the “dead RELU” problem, where certain

neurons can stop “learning” (Xu et al., 2015). The He uniform initialization (He et al., 2015) was used, as it is shown to work well with Leaky ReLUs, and all unit bias were initialized to zero. In order to optimize the weights of the gradient descent, we used the RMSprop optimizer, for which we fine-tuned the learning rate, obtaining the best results at 0.0005 in space and 0.02 in time. Each batch was normalized before applying the activation function in order to accelerate the training (Ioffe and Szegedy, 2015).

Like for many other geophysical processes found in nature, extreme annual glacier-wide SMB values occur much less often than average values, approximately following an unbounded Gumbel-type distribution (Thibert et al., 2018). From a statistical point of view, this means that ANN will “see” few extreme values and will accord less importance to them. For future projections in a warmer climate, extreme positive glacier-wide SMB balances should not be the main concern of glacier models. However, extreme negative annual glacier-wide SMB values should likely increase in frequency, so it is in the modeller’s interest to reproduce them as well as possible. Setting the sample weights as the inverse of the probability density function during the ANN training can partly compensate for the imbalance of a dataset. This boosts the performance of the model for the extreme values at the cost of sacrificing some performance on more average values, which can be seen as a $r^2$-RMSE trade-off (see Figs. 6 and 9 from the case study). The correct setting of the sample weights allows the modeller to adapt the ANN to each dataset and application.

## 2.3 Glacier geometry update

Since the first component of ALPGM simulates annual glacier-wide SMBs, these changes in mass need to be redistributed over the glacier surface area in order to reproduce glacier dynamics. This redistribution is applied using the $\Delta h$ parameterization. The idea was first developed by Jóhannesson et al. (1989) and then adapted and implemented by Huss et al. (2008). The main idea behind it is to use two or more DEMs covering the study area. These DEMs should have dates covering a period long enough (which will be later discussed in detail). By subtracting them, the changes in glacier surface elevation over time can be computed, which corresponds to a change in thickness (considering no basal erosion). Then, these thickness changes are normalized and considered to be a function of the normalized glacier altitude. This $\Delta h$ function is specific to each glacier and represents the normalized glacier thickness evolution over its altitudinal range. One advantage of such a parameterized approach is that it implicitly considers the ice flow which redistributes the mass from the accumulation to the ablation area. In order to make the glacier volume evolve in a mass-conserving fashion, we apply this function to the annual glacier-wide SMB values in order to scale and distribute its change in volume.
<figure><img src="image_4.png" /><figcaption>Figure 3. Deep artificial neural network architecture used in ALPGM. The numbers indicate the number of neurons in each layer.</figcaption></figure>

As discussed in Vincent et al. (2014), the time period between the two DEMs used to calibrate the method needs to be long enough to show important ice thickness differences. The criteria will of course depend on each glacier and each period, but it will always be related to the achievable signal-to-noise ratio. Vincent et al. (2014) concluded that for their study on the Mer de Glace glacier (28.8 km²; mean altitude of 2868 m.a.s.l.) in the French Alps, the 2003–2008 period was too short due to the delayed response of glacier geometry to a change in surface mass balance. Indeed, the results for that 5-year period diverged from the results from longer periods. Moreover, the period should be long enough to be representative of the glacier evolution, which will often encompass periods with strong ablation and others with no retreat or even with positive SMBs.

Therefore, by subtracting the two DEMs, the ice thickness difference is computed for each specific glacier. These values can then be classified by altitude, thus obtaining an average glacier thickness difference for each pixel altitude. As a change to previous studies (Vincent et al., 2014; Huss and Hock, 2015; Hanzer et al., 2018; Vincent et al., 2019), we no longer work with altitudinal transects but with individual pixels. In order to filter noise and artefacts coming from the DEM raster files, different filters are applied to remove outliers and pixels with unrealistic values, namely at the border of glaciers or where the surface slopes are high (refer to Supplement for detailed information). Our methodology thus allows us to better exploit the available spatial information based on its quality and not on an arbitrary location within transects.

# 3 Case study: French Alpine glaciers

## 3.1 Data

All data used in this case study are based on the French Alps (Fig. 4), located in the westernmost part of the European Alps, between 44 and 46°13′N, 5.08 and 7.67°E. This region is particularly suited for the validation of a glacier evolution model because of the wealth of available data. Moreover, ALPGM has been developed as part of a hydro-glaciological study to understand the impact of the retreat of French Alpine glaciers in the Rhône river catchment (97 800 km²).

### 3.1.1 Glacier-wide surface mass balance

An annual glacier-wide SMB dataset, reconstructed using remote-sensing based on changes in glacier volume and the snow line altitude, is used (Rabatel et al., 2016). This dataset is constituted by annual glacier-wide SMB values for 30 glaciers in the French Alps (Fig. 4) for 31 years, between 1984 and 2014. The great variety in topographical characteristics of the glaciers included in the dataset, with good coverage of the three main clusters or groups of glaciers in the French Alps (Fig. 4), makes them an ideal training dataset for the model. Each of the clusters represents a different setup of glaciers with different contrasting latitudes (Écrins and Mont-Blanc), longitudes (Écrins and Vanoise), glacier size (smaller glaciers in Écrins and Vanoise vs. larger ones in Mont-Blanc) and climatic characteristics, with a Mediterranean influence towards the south of the study region. For more details regarding this dataset refer to Rabatel et al. (2016). Data from the Mer de Glace, Saint-Sorlin, Sarennes and Argentière glaciers are also used, coming from field observations from the GLACIOCLIM observatory. For some of these glaciers, glacier-wide SMB values have been available since 1949, although only values from 1959 onwards were used to match the meteorological reanalysis. This makes a total of 32 glaciers (Argentière and Saint-Sorlin glaciers belonging to the two datasets), representing 1048 annual glacier-wide SMB values (taking into account some gaps in the dataset).

### 3.1.2 Topographical glacier data and altimetry

The topographical data used for the training of the glacier-wide SMB machine learning models are taken from the multitemporal inventory of the French Alps glaciers (e.g. Gardent et al., 2014), partly available through the GLIMS Glacier Database (NSIDC, 2005). We worked with the 1967,
<figure><img src="image_5.png" /><figcaption>**Figure 4.** French Alpine glaciers used for model training and validation and their classification into three clusters or regions (Écrins, Vanoise, Mont-Blanc). Coordinates of bottom left map corner: 44°32′N, 5°40′E. Coordinates of the top right map corner: 46°08′N, 7°17′E.</figcaption></figure>

1985, 2003 and 2015 inventories (Gardent et al., 2014, with 2015 update). Between these dates, the topographical predictors are linearly interpolated. On the other hand, in the glacier evolution component of ALPGM (Fig. 1; step 5), the topographical data are recomputed every year for each glacier from the evolving and annually updated glacier-specific ice thickness and DEM rasters (Sect. 3.1.3). Since these raster files are estimates for the year 2003 (Farinotti et al., 2019 for the ice thickness), the full glacier evolution simulations can start on this date at the earliest. For the computation of the glacier-specific geometry update functions, two DEMs covering the whole French Alps have been used: (1) one from 2011 generated from SPOT5 stereo-pair images, acquired on 15 October 2011, and (2) a 1979 aerial photogrammetric DEM from the French National Geographic Institute (Institut Géographique National – IGN), processed from aerial photographs taken around 1979. Both DEMs have an accuracy between 1 and 4 m (Rabatel et al., 2016), and their uncertain-

ties are negligible compared to many other parameters in this study.

### 3.1.3 Glacier ice thickness

Glacier ice thickness data come from Farinotti et al. (2019), hereafter F19, based on the Randolph Glacier Inventory v6.0 (RGI; Consortium, 2017). The ice thickness values represent the latest consensus estimate, averaging an ensemble of different methods based on the principles of ice flow dynamics to invert the ice thickness from surface characteristics.

We also have ice thickness data acquired by diverse field methods (seismic, ground-penetrating radar or hot-water drilling; Rabatel et al., 2018) for four glaciers of the GLACIOCLIM observatory. We compared these in situ thickness data with the simulated ice thicknesses from F19 (refer to Supplement for detailed information). Although differences can be found (locally up to 100% in the worst cases), no systematic biases were found with respect to glacier local slope or glacier altitude; therefore, no systematic correction was applied to the dataset. The simulated ice thicknesses for Saint-Sorlin (2 km²; mean altitude of 2920 m a.s.l.; Écrins cluster) and Mer de Glace (28 km²; mean altitude of 2890 m a.s.l.; Mont-Blanc cluster) glaciers are satisfactorily modelled by F19. Mer de Glace's tongue presents local errors of about 50 m, peaking at 100 m (30% error) at around 2000–2100 m a.s.l., but the overall distribution of the ice is well represented. Saint-Sorlin Glacier follows a similar pattern, with maximum errors of around 20 m (20% error) at 2900 m a.s.l. and a good representation of the ice distribution. The ice thicknesses for Argen tière Glacier (12.8 km²; mean altitude of 2808 m a.s.l.; Mont-Blanc cluster) and Glacier Blanc (4.7 km²; mean altitude of 3196 m a.s.l.; Écrins cluster) are underestimated by F19, with an almost constant bias with respect to altitude, as seen in Rabatel et al. (2018). Therefore, a manual correction was applied to the F19 datasets for these two glaciers based on the field observations from the GLACIOCLIM observatory. A detailed plot (Fig. S2) presenting these results can be found in the Supplement.

### 3.1.4 Climate data

In our French Alps case study, ALPGM is forced with daily mean near-surface (2 m) temperatures, daily cumulative snowfall and rain. The SAFRAN dataset is used to provide these data close to the glaciers' centroids. SAFRAN meteorological data (Durand et al., 2009) are a reanalysis of weather data including observations from different networks and specific to the French mountain regions (Alps, Pyrenees and Corsica). Instead of being structured as a grid, data are provided at the scale of massifs, which are in turn divided into altitude bands of 300 m and into five different aspects (north, south, east, west and flat).
## 3.2 Glacier-wide surface mass balance simulations: validation and results

In this section, we go through the selection of SMB predictors, we introduce the procedure for building machine learning SMB models, we assess their performance in space and time and we show some results of simulations using the French Alpine glacier dataset.

### 3.2.1 Selection of predictors

Statistical relationships between meteorological and topographical variables with respect to glacier-wide SMB are frequent in the literature for the European Alps (Hoinkes, 1968). Martin (1974) performed a sensitivity study on the SMB of the Saint-Sorlin and Sarennes glaciers (French Alps) with respect to multi-annual meteorological observations for the 1957–1972 period. Martin (1974) obtained a multiple linear regression function based on annual precipitation and summer temperatures, and he concluded that it could be further improved by differentiating winter and summer precipitation. Six and Vincent (2014) studied the sensitivity of the SMB to climate change in the French Alps from 1998 to 2014. They found that the variance in summer SMB is responsible for over 90% of the variance in the annual glacier-wide SMB. Rabatel et al. (2013); Rabatel et al. (2016) performed an extensive sensitivity analysis of different topographical variables (slope of the lowermost 20% of the glacier area, mean elevation, surface area, length, minimum elevation, maximum elevation, surface area change and length change) with respect to glacier ELA and annual glacier-wide SMBs of French Alpine glaciers. Together with Huss (2012), who performed a similar study with SMB, the most significant statistical relationships were found for the lowermost 20% area slope, the mean elevation, glacier surface area, aspect and easting, and northing. Rabatel et al. (2013) also determined that the climatic interannual variability is mainly responsible for driving the glacier equilibrium-line altitude temporal variability, whereas the topographical characteristics are responsible for the spatial variations in the mean ELA.

Summer ablation is often accounted for by means of CPDDs. However, in the vast majority of studies, accumulation and ablation periods are defined between fixed dates (e.g. 1 October–30 April for the accumulation period in the northern mid-latitudes) based on optimizations. As discussed in Zekollari and Huybrechts (2018), these fixed periods may not be the best to describe SMB variability through statistical correlation. Moreover, the ablation season will likely evolve in the coming century due to climate warming. In order to overcome these limitations, we dynamically calculate each year the transition between accumulation and ablation seasons (and vice versa) based on a chosen quantile in the CPDD (Fig. S3). We found higher correlations between annual SMB and ablation-period CPDD calculated using this dynamical ablation season. On the other hand, this was not

the case for the separation between summer and winter snowfall. Therefore, we decided to keep constant periods to account for winter (1 October–1 May) and summer (1 May–1 October) snowfalls and to keep them dynamical for the CPDD calculation.

Following this literature review, vectors $\hat{\Omega}$ and $\hat{C}$ from (Eq. 1) read as

$$ \hat{\Omega} = [ \bar{Z} \ Z_{\max} \ \alpha_{20\%} \ \text{Area} \ \text{Lat} \ \text{Lon} \ \Phi ], \quad (2) $$

$$ \hat{C} = [ \Delta\text{CPDD} \ \Delta\text{WS} \ \Delta\text{SS} \ \Delta\bar{T}_{\text{mon}} \ \Delta\bar{S}_{\text{mon}} ], \quad (3) $$

where $\bar{Z}$ is the mean glacier altitude, $Z_{\max}$ is the maximum glacier altitude, $\alpha_{20\%}$ is the slope of the lowermost 20% glacier altitudinal range, “Area” is the glacier surface area, “Lat” is glacier latitude, “Lon” is glacier longitude, $\Phi$ is the cosine of the glacier’s aspect (north is 0°), $\Delta\text{CPDD}$ is the CPDD anomaly, $\Delta\text{WS}$ is the winter snow anomaly, $\Delta\text{SS}$ is the summer snow anomaly, $\Delta\bar{T}_{\text{mon}}$ is the average temperature anomaly for each month for the hydrological year and $\Delta\bar{S}_{\text{mon}}$ is the average snowfall anomaly for each month for the hydrological year.

For the linear machine learning model training, we chose a function $f$ that linearly combines $\hat{\Omega}$ and $\hat{C}$, generating new combined predictors (Eq. 4). In $\hat{C}$, only $\Delta\text{CPDD}$, $\Delta\text{WS}$ and $\Delta\text{SS}$ are combined to avoid generating an unnecessary number of predictors with the combination of $\hat{\Omega}$ with $\Delta\bar{T}_{\text{mon}}$ and $\Delta\bar{S}_{\text{mon}}$:

$$ \begin{aligned} \text{SMB}_{\text{g,y}} = & ((a_1 \bar{Z} + a_2 Z_{\max} + a_3 \alpha_{20\%} + a_4 \text{Area} \\ & + a_5 \text{Lat} + a_6 \text{Lon} + a_7 \Phi + a_8) \Delta\text{CPDD} \\ & + (b_1 \bar{Z} + b_2 Z_{\max} + b_3 \alpha_{20\%} + b_4 \text{Area} + b_5 \text{Lat} \\ & + b_6 \text{Lon} + b_7 \Phi + b_8) \Delta\text{SS} + (c_1 \bar{Z} + c_2 Z_{\max} \\ & + c_3 \alpha_{20\%} + c_4 \text{Area} + c_5 \text{Lat} + c_6 \text{Lon} + c_7 \Phi \\ & + c_8) \Delta\text{WS} + d_1 \bar{Z} + d_2 Z_{\max} + d_3 \alpha_{20\%} + d_4 \text{Area} \\ & + d_5 \text{Lat} + d_6 \text{Lon} + d_7 \Phi + d_8 + d_n \Delta\bar{T}_{\text{mon}} \\ & + d_m \Delta\bar{S}_{\text{mon}} + \varepsilon)_{\text{g,y}}. \end{aligned} \quad (4) $$

Thirty-two glaciers over variable periods between 31 and 57 years result in 1048 glacier-wide SMB ground truth values. For each glacier-wide SMB value, 55 predictors were produced following Eq. (4): 33 combined predictors, with $\Delta\bar{T}_{\text{mon}}$ and $\Delta\bar{S}_{\text{mon}}$ accounting for 12 predictors each, one for each month of the year. All these values combined produce a 1048 × 55 matrix, given as input data to the OLS and Lasso machine learning libraries. Early Lasso tests (not shown here) using only the predictors from Eqs. (2) and (3) demonstrated the benefits of expanding the number of predictors, as is later shown in Fig. 5. For the training of the ANN, no combination of topo-climatic predictors is done as previously mentioned (Sect. 2.2.4), since it is already done internally by the ANN.
## 3.2.2 Causal analysis

By running the Lasso algorithm on the dataset based on Eqs. (2) and (3), we obtain the contribution of each predictor in order to explain the annual glacier-wide SMB variance. Regarding the climatic variables, accumulation-related predictors (winter snowfall; summer snowfall; and several winter, spring and even summer months) appear to be the most important predictors. Ablation-related predictors also seem to be relevant, mainly with CPDD and summer- and shoulder-season months (Fig. 5). Interestingly, meteorological conditions in the transition months are crucial for the annual glacier-wide SMB in the French Alps. (1) October temperature is determinant for the transition between the ablation and the accumulation season, favouring a lengthening of melting when temperature remains positive or conversely allowing snowfalls that protect the ice and contribute to the accumulation when temperatures are negative. (2) March snowfall has a similar effect: positive anomalies contribute to the total accumulation at the glacier surface, and a thicker snowpack will delay the snow-ice transition during the ablation season, leading to a less negative ablation rate (e.g. Fig. 6b; Réveillet et al., 2018). Therefore, meteorological conditions of these transition months seem to strongly impact the annual glacier-wide SMB variability, since their variability oscillates between positive and negative values, unlike the months in the heart of summer or winter.

In a second term, topographical predictors do play a role, albeit a secondary one. The slope of the 20% lowermost altitudinal range, the glacier area, the glacier mean altitude and aspect help to modulate the glacier-wide SMB signal, which, unlike point or altitude-dependent SMB, partially depends on glacier topography (Huss et al., 2012). Moreover, latitude and longitude are among the most relevant topographical predictors, which for this case study are likely to be used as bias correctors of precipitation of the SAFRAN climate reanalysis. SAFRAN is suspected of having a precipitation bias, with higher uncertainties for high-altitude precipitation (Vionnet et al., 2016). Since the French Alps present an altitudinal gradient, with higher altitudes towards the eastern and the northern massifs, we found that the coefficients linked to latitude and longitude enhanced glacier-wide SMBs with a north-east gradient.

## 3.2.3 Spatial predictive analysis

In order to evaluate the performance of the machine learning SMB models in space, we perform a LOGO (leave-one-glacier-out) cross validation. For relatively small datasets like the one used in this study, cross validation ensures that the model is validated on the full dataset. Such validation aims at understanding the model's performance for predictions on other glaciers for the same time period as during the training.

<figure><img src="image_6.png" /><figcaption>**Figure 5.** Contribution to the total variance in the 30 top topoclimatic predictors out of 55 predictors using Lasso. Green bars indicate predictors including topographical features, blue ones include accumulation-related features and red ones include ablation-related features.</figcaption></figure>

An important aspect is the comparison between the linear and nonlinear machine learning algorithms used in this study. Steiner et al. (2005) already proved that a nonlinear ANN improved the results with respect a classic stepwise multiple linear regression. Here, we draw a similar comparison using more advanced methods for a larger dataset: OLS and Lasso as linear machine learning algorithms and a deep ANN as a nonlinear one. We observed significant differences between OLS, Lasso and deep learning in terms of both explained variance ($r^2$) and accuracy (RMSE) of predicted glacier-wide SMBs. On average, we found improvements between +55% and +61% in the explained variance (from 0.49 to 0.76–0.79) using the nonlinear deep ANN compared to Lasso, whereas the accuracy was improved up to 45% (from 0.74 to 0.51–0.62). This means that 27% more variance is explained with a nonlinear model in the spatial dimension for glacier-wide SMB in this region. See Fig. 6 for a full summary of the results. An interesting consequence of the nonlinearity of the ANN is the fact that it captures extreme SMB values better compared to a linear model. A
linear model can correctly approximate the main cluster of values around the median, but the linear approximation performs poorly for extreme annual glacier-wide SMB values. The ANN solves this problem, with an increased explained variance which translates into a better accuracy for extreme SMB values, even without the use of sample weights (Fig. 6).

As a consequence, the added value of deep learning is especially relevant on glaciers with steeper annual changes in glacier-wide SMB (Fig. 7a). The use of sample weights can scale this factor up or down, thus playing with a performance trade-off depending on how much one wants to improve the model's behaviour for extreme SMB values.

Overall, deep learning results in a lower error throughout all the glaciers in the dataset when evaluated using LOGO cross validation (Fig. 8). Moreover, the bias is also systematically reduced, but it is strongly correlated to the one from Lasso.

### 3.2.4 Temporal predictive analysis

In order to evaluate the performance of the machine learning SMB models in time, we perform a LOYO (leave-one-year-out) cross validation. This validation serves to understand the model's performance for past or future periods outside the training time period. The best results achieved for Lasso make no use of any monthly average temperature or snowfall, suggesting that these features are not relevant for temporal predictions unlike the spatial case.

As in Sect. 3.2.3, the results between the linear and nonlinear machine learning algorithms were compared. Interestingly, using LOYO, the differences between the different models were even greater than for spatial validation, revealing the more complex nature of the information in the temporal dimension. As illustrated by Fig. 9, we found remarkable improvements between the linear Lasso and the nonlinear deep learning in both the explained variance (between +94% and +108%) and accuracy (between +32% and +58%). This implies that 35% more variance is explained using a nonlinear model in the temporal dimension for glacier-wide SMB balance in this region. Deep learning manages to keep very similar performances between the spatial and temporal dimensions, whereas the linear methods see their performance affected most likely due to the increased nonlinearity of the SMB reaction to meteorological conditions.

A more detailed year-by-year analysis reveals interesting information about the glacier-wide SMB data structure. As seen in Fig. 10, the years with the worst deep learning precision are 1984, 1985 and 1990. All three hydrological years present high spatial variability in observed (or remotely sensed) SMBs: very positive SMB values in general for 1984 and 1985, with few slightly negative values, and extremely negative SMB values in general for 1990, with few almost neutral values. These complex configurations are clearly outliers within the dataset which push the limits of the nonlinear patterns found by the ANN. The situation becomes even

more evident with Lasso, which struggles to resolve these complex patterns and often performs poorly where the ANN succeeds (e.g. years 1996, 2012 or 2014). The important bias present only with Lasso is representative of its lack of complexity towards nonlinear structures, which results in an underfitting of the data. The average error is not bad, but it shows a high negative bias for the first half of the period, which mostly has slightly negative glacier-wide SMBs, and a high positive bias for the second half of the period, which mostly has very negative glacier-wide SMB values.

### 3.2.5 Spatiotemporal predictive analysis

Once the specific performances in the spatial and temporal dimensions have been assessed, the performance in both dimensions at the same time is evaluated using leave-some-years-and-glaciers-out (LSYGO) cross validation. Sixty-four folds were built, with test folds being comprised of data for two random glaciers on two random years and train folds of all the data except the two years (for all glaciers) and the two glaciers (for all years) present in the test fold. These combinations are quite strict, implying that for every four tested values, we need to drop between 123 and 126 values for training, depending on the glacier and year, to respect the spatiotemporal independence (Roberts et al., 2017).

The performance of LSYGO is similar to LOYO, with a RMSE of 0.51 m w.e. $a^{-1}$ and a coefficient of determination of 0.77 (Fig. S5). This is reflected in the fact that very similar ANN hyperparameters were used for the training. This means that the deep learning SMB model is successful in generalizing, and it does not overfit the training data.

## 3.3 Glacier geometry evolution: validation and results

As mentioned in Sect. 2.3, the $\Delta h$ parameterization has been widely used in many studies (e.g. Huss et al., 2008, 2010; Vincent et al., 2014; Huss and Hock, 2015, 2018; Hanzer et al., 2018; Vincent et al., 2019). It is not in the scope of this study to evaluate the performance of this method, but we present the approach developed in ALPGM to compute the $\Delta h$ functions and show some examples for single glaciers to illustrate how these glacier-specific functions perform compared to observations. For the studied French Alpine glaciers, the 1979–2011 period is used. This period was proved by Vincent et al. (2014) to be representative of Mer de Glace’s secular trend. Other sub-periods could have been used, but it was shown that they did not necessarily improve the performance. In addition, the 1979 and 2011 DEMs are the only ones available that cover all the French Alpine glaciers. Within this period, some years with neutral to even positive surface mass balances in the late 1970s and early 1980s can be found as well as a remarkable change from 2003 onward with strongly negative surface mass balances, following the heatwave that severely affected the western Alps in summer 2003.
<figure><img src="image_7.png" /><figcaption>**Figure 6.** Evaluation of modelled annual glacier-wide SMB against the ground truth SMB data (both in m w.e. $a^{-1}$) using leave-one-glacier-out cross validation. The colour (purple-orange for linear; blue-green for nonlinear) indicates frequency based on the probability density function. The black line indicates the reference one-to-one line. (a) Scatter plot of the OLS model results. (b) Scatter plot of the Lasso linear model results. Scatter plots of the deep artificial neural network nonlinear models without (c) and with (d) sample weights.</figcaption></figure>

<figure><img src="image_8.png" /><figcaption>**Figure 7.** Examples of cumulative glacier-wide SMB (m w.e.) simulations against the ground truth SMB data. The pink envelope indicates the accumulated uncertainties from the ground truth data. The deep learning SMB model has not been trained with sample weights in these illustrations.</figcaption></figure>
<figure><img src="image_9.png" /><figcaption>**Figure 8.** Mean average error (MAE) and bias (vertical bars) for each glacier of the training dataset structured by clusters for the 1984–2014 LOGO glacier-wide SMB simulation. No clear regional error patterns arise.</figcaption></figure>

<figure><img src="image_10.png" /><figcaption>**Figure 9.** Evaluation of modelled annual glacier-wide SMB against the ground truth SMB data (both in m w.e. $a^{-1}$) using leave-one-year-out cross validation. The colour (purple–orange for linear; blue–green for nonlinear) indicates frequency based on the probability density function. The black line indicates the reference one-to-one line. (a) Scatter plot of the OLS model results. (b) Scatter plot of the Lasso linear model results. Scatter plots of the deep artificial neural network nonlinear models without (c) and with (d) sample weights.</figcaption></figure>
<figure><img src="image_11.png" /><figcaption>**Figure 10.** Mean average error (MAE) and bias (vertical bars) for each year of the training dataset for the 1984–2014 LOYO glacier-wide SMB simulation.</figcaption></figure>

The glacier-specific $\Delta h$ functions are computed for glaciers $\ge$ 0.5 km$^2$, which represented about 80% of the whole glacierized surface of the French Alps in 2015 (some examples are illustrated in the Supplement Fig. S4). For the rest of very small glaciers (< 0.5 km$^2$), a standardized flat function is used in order to make them shrink equally at all altitudes. This is done to simulate the fact that generally, the equilibrium line of very small glaciers surpasses the glacier's maximum altitude, thus shrinking from all directions and altitudes in summer. Moreover, due to their reduced size and altitudinal range, the ice flow no longer has the same importance as for larger- or medium-sized glaciers.

In order to evaluate the performance of the parameterized glacier dynamics of ALPGM, coupled with the glacier-wide SMB component, we compared the simulated glacier area of the 32 studied glaciers with the observed area in 2015 from the most up-to-date glacier inventory in the French Alps. Simulations were started in 2003, for which we used the F19 ice thickness dataset. In order to take into account the ice thickness uncertainties, we ran three simulations with different versions of the initial ice thickness: the original data and -30% and +30% of the original ice thickness, in agreement with the uncertainty estimated by the authors. Moreover, in order to take into account the uncertainties in the $\Delta h$ glacier geometry update function computation, we added a $\pm$10% variation in the parameterized functions (Fig. 11).

Overall, the results illustrated in Fig. 11 show good agreement with the observations. Even for a 12-year period, the initial ice thickness still has the largest uncertainty, with almost all glaciers falling within the observed area when taking it into account. The mean error in simulated surface area was 10.7% with the original F19 ice thickness dataset. Other studies using the $\Delta h$ parameterization already proved that the initial ice thickness is the most important uncertainty in glacier evolution simulations, together with the choice of a

global climate model (GCM) for future projections (Huss and Hock, 2015).

# 4 Discussion and perspectives

## 4.1 Linear methods still matter

Despite the fact that deep learning often outperforms linear machine learning and statistical methods, there is still a place for such methods in modelling. Indeed, unlike ANNs, simpler regularized linear models such as Lasso allow an easy interpretation of the coefficients associated to each input feature, which helps to understand the contribution of each of the chosen variables to the model. This means that linear machine learning methods can be used for both prediction and causal analysis. Training a linear model in parallel with an ANN therefore has the advantage of providing a simpler linear alternative which can be used to understand the dataset. Moreover, seeing the contribution of each coefficient, one can reduce the complexity of the dataset by keeping only the most significant predictors. Finally, a linear model also serves as a reference to highlight and quantify the nonlinear gains obtained by deep learning.

## 4.2 Training deep learning models with spatiotemporal data

The creation and training of a deep ANN requires a certain knowledge and strategy with respect to the data and study focus. When working with spatiotemporal data, the separation between training and validation becomes tricky. The spatial and temporal dimensions in the dataset cannot be ignored and strongly affect the independence between training and validation data (Roberts et al., 2017; Oliveira et al., 2019). Depending on how the cross validation is performed, the obtained performance will be indicative of one of these two di-
<figure><img src="image_12.png" /><figcaption>**Figure 11.** Simulated glacier areas for the 2003–2015 period for the 32 study glaciers using a deep learning SMB model without weights. Squares indicate the different F19 initial ice thicknesses used, taking into account their uncertainties, and triangles indicate the uncertainties linked to the glacier-specific geometry update functions. For better visualization, the figure is split into two, with the two largest French glaciers on the right.</figcaption></figure>

mensions. As is shown in Sect. 3.2.3, the ANNs and espe-
cially the linear modelling approaches had more success in
predicting SMB values in space than in time. This is mostly
due to the fact that the glacier-wide SMB signal has a greater
variability and nonlinearities in time than in space, with cli-
mate being the main driver of the annual fluctuations in SMB,
whereas geography, and in particular the local topography,
modulates the signal between glaciers (Huss, 2012; Raba-
tel et al., 2016; Vincent et al., 2017). Consequently, linear
models find it easier to make predictions in a given period of
time for other glaciers elsewhere in space than for time peri-
ods outside the training. Nonetheless, the deep learning SMB
models were capable of equally capturing the complex non-
linear patterns in both the spatial and temporal dimensions.

In order to cope with the specific challenges related to
each type of cross validation, there are several hyperparam-
eters that can be modified to adapt the ANN's behaviour.
Due to the long list of hyperparameters intervening in an
ANN, it is not advisable to select them using brute force
with a grid search or cross validation. Instead, initial tests
are performed in a subset of random folds to narrow down
the range of best-performing values before moving to the
full final cross validations for the final hyperparameter se-
lection. Moreover, the ANN architecture plays an important
role: the number of neurons as well as the number of hidden
layers will determine the ANN's complexity and its capabil-
ities to capture hidden patterns in the data. But the larger the
architecture, the higher the chances are to overfit the data.
This undesired effect can be counterbalanced using regular-
ization. The amount of regularization (dropout and Gaussian
noise in our case; see Sect. 2.2.4) used in the training of
the ANN necessarily introduces some trade-offs. The greater
the dropout, the more we will constrain the learning of the
ANN, so the higher the generalization will be, until a cer-
tain point, where relevant information will start to become

lost and performance will drop. On the other hand, the learn-
ing rate to compute the stochastic gradient descent, which
tries to minimize the loss function, also plays an important
role: smaller learning rates generally result in a slower con-
vergence towards the absolute minima, thus producing mod-
els with better generalization. By balancing all these different
effects, one can achieve the ratio of accuracy to generaliza-
tion that best suits a certain dataset and model in terms of
performance. Nonetheless, one key aspect in machine learn-
ing models is data: expanding the training dataset in the fu-
ture will allow us to increase the complexity of the model and
its performance. Consequently, machine learning models see
their performance improved as time goes by, with new data
becoming available for training.

Although the features used as input for the model are
classical descriptors of the topographical and meteorological
conditions of the glaciers, it is worth mentioning that apply-
ing the model in different areas or with different data sources
would likely require a re-training of the model due to pos-
sible biases: different regions on the globe may have other
descriptors of importance, but also different measuring tech-
niques will likely have different biases.

4.3 Perspectives on future applications of deep learning
in glaciology

The currently used meteorological variables in the deep ANN
of ALPGM's SMB component are based on the classic
degree-day approach, which relies only on temperature and
precipitation. However, the model could be trained with vari-
ables involved in more complex models, such as SEB-type
models, for which the longwave and shortwave radiation as
well as the turbulent fluxes and albedo intervene. The cur-
rent model framework allows flexibility in the choice and
number of input variables that can reflect different degrees
of complexity for the resolved processes. Despite the fact
that it has been shown that for glaciers in the European Alps
there is almost no added value in transitioning from a sim-
ple degree day to a SEB model for annual glacier-wide SMB
simulations (e.g. Réveillet et al., 2017), it could be an in-
teresting way to expand the training dataset for glaciers in
tropical and subtropical regions, where shortwave radiation
plays a much more important role (Benn and Evans, 2014).
Maussion et al. (2015) followed a similar approach with lin-
ear machine learning in order to calibrate a regression-based
downscaling model that linked local SEB–SMB fluxes to at-
mospheric reanalysis variables.

In this work, we also evaluated the resilience of the deep
learning approach: since many glacierized regions in the
world do not have the same number of data used in this
study, we trained an ANN only with monthly average tem-
perature and snowfall, without any topographical predictors,
to see until which point the algorithm is capable of learn-
ing from minimal data. The results were quite interesting,
with a coefficient of determination of 0.68 (against 0.76 from
the full model) and a RMSE of 0.59 m w.e. a⁻¹ (against 0.51
from the full model). These results indicate that meteorolog-
ical data are the primary source of information, determin-
ing the interannual high-frequency variability in the glacier-
wide SMB signal. On the other hand, the “bonus” of topo-
graphical data helps to modulate the high-frequency climate
signal by adding a low-frequency component to better dif-
ferentiate glaciers and the topographical characteristics in-
cluded in the glacier-wide SMB data (Huss et al., 2012).
The fact that glacier-wide SMB is influenced by glacier to-
pography poses the question of determining if the simulated
glacier geometries can correctly reproduce topographical ob-
servations, needed to represent the topographical feedback
present in glacier-wide SMB signals. These aspects are anal-
ysed and discussed in Sect. S3 of the Supplement, showing
small differences between the observed and simulated topo-
graphical parameters for the 2003–2015 period (Table S1).
Additionally, the simulated glacier-wide SMBs using simu-
lated topographical parameters show very small differences
(0.069 m w.e. a⁻¹ on average) compared to simulations us-
ing topographical observations (Fig. S6). Since glacier ice
thickness estimates date from the year 2003 (Farinotti et al.,
2019), our validation period can only encompass 12 years.
According to all the available data for validation, our model
seems to be able to correctly reproduce the glacier geometry
evolution, but since the 2003–2015 validation period is quite
short, the validation performance might not be representa-
tive when dealing with future glacier evolution projections
of several decades. Consequently, these aspects will have to
be taken into account for future studies using this modelling
approach for projections. Moreover, the cross-validation re-
sults of the SMB model or models (Figs. 6–10) are represen-
tative of the performance of predictions using topographical
observations. Despite the small differences found between
simulated and observed topographical parameters, the SMB

model's performance might be slightly different than the per-
formance found in the cross-validation analysis. Therefore, it
would be interesting for future studies to investigate the use
of point SMB data, which could avoid the complexities re-
lated to the influence of glacier topography in glacier-wide
SMB.

A nonlinear deep learning SMB component like the one
used for ALPGM could provide an interesting alternative to
classical SMB models used for regional modelling. The com-
parison with other SMB models is beyond the scope of this
study, but it would be worth investigating to quantify the spe-
cific gains that could be achieved by switching to a deep
learning modelling approach. Nonetheless, the linear ma-
chine learning models trained with the CPDD and cumulative
snowfall used in this study behave in a similar way to a cali-
brated temperature-index model. Even so, we believe that fu-
ture efforts should be taken towards physics-informed data-
science glacier SMB and evolution modelling. Adding phys-
ical constraints in ANNs, with the use of physics-based loss
functions and/or architectures (e.g. Karpatne et al., 2018),
would allow us to improve our understanding and confidence
in predictions, to reduce our dependency on big datasets, and
to start bridging the gap between data science and physi-
cal methods (Karpatne et al., 2017; de Bezenac et al., 2018;
Lguensat et al., 2019; Rackauckas et al., 2020). Deep learn-
ing can be of special interest once applied in the reconstruc-
tion of SMB time series. More and more SMB data are be-
coming available thanks to the advances in remote sensing
(e.g. Brun et al., 2017; Zemp et al., 2019; Dussaillant et al.,
2019), but these datasets often cover limited areas and the
most recent time period in the studied regions. An interesting
way of expanding a dataset would be to use a deep learning
approach to fill the data gaps based on the relationships found
in a subset of glaciers as in the case study presented here. Past
SMB time series of vast glacierized regions could thereby be
reconstructed, with potential applications in remote glacier-
ized regions such as the Andes or High Mountain Asia.

5 Conclusions

We presented a novel approach to simulate and reconstruct
glacier-wide SMB series using deep learning for individ-
ual glaciers at a regional scale. This method has been in-
cluded as a SMB component in ALPGM (Bolibar, 2019),
a parameterized regional glacier evolution model, follow-
ing an alternative approach to most physical and process-
based glacier models. The data-driven glacier-wide SMB
modelling component is coupled with a glacier geometry
update component, based on glacier-specific parameterized
functions. Deep learning is shown to outperform linear meth-
ods for the simulation of glacier-wide SMB with a case study
of French Alpine glaciers. By means of cross validation,
we demonstrated how important nonlinear structures (up to
35%) coming from the glacier and climate systems in both
the spatial and temporal dimensions are captured by the deep ANN. Taking into account that this nonlinearity substantially improved the explained variance and accuracy compared to linear statistical models, especially in the more complex temporal dimension. As we have shown in our case study, deep ANNs are capable of dealing with relatively small datasets, and they present a wide range of configurations to generalize and prevent overfitting. Machine learning models benefit from the increasing number of available data, which makes their performance constantly improve as time goes by.

Deep learning should be seen as an opportunity by the glaciology community. Its good performance for SMB modelling in both the spatial and temporal dimensions shows how relevant it can be for a broad range of applications. Combined with in situ or remote-sensing SMB estimations, it can serve to reconstruct SMB time series for regions or glaciers with already-available data for past and future periods, with potential applications in remote regions such as the Andes or the High Mountain Asia. Moreover, deep learning can be used as an alternative to classical SMB models, as is done in ALPGM: important nonlinearities from the glacier and climate systems are potentially ignored by these mostly linear models, which could give an advantage to deep learning models in regional studies. It might still be too early for the development of such models in certain regions which lack consistent datasets with good spatial and temporal coverage. Nevertheless, upcoming methods adding physical knowledge to constrain neural networks (e.g. Karpatne et al., 2018; Rackauckas et al., 2020) could provide interesting solutions to the limitations of our current method. By incorporating prior physical knowledge into neural networks, the dependency on big datasets would be reduced, and it would allow transitioning towards more interpretable physics-informed data-science models.

*Code and data availability.* The source code of ALPGM is available at https://github.com/JordiBolibar/ALPGM (last access: February 2020) with its DOI (https://doi.org/10.5281/zenodo.3609136, Bolibar, 2020) for the v1.1 release. All scripts used to generate plots and results are included in the repository. The detailed information regarding glaciers used in the case study and the SMB model performance per glacier are included in the Supplement.

*Supplement.* The supplement related to this article is available online at: https://doi.org/10.5194/tc-14-565-2020-supplement.

*Author contributions.* JB developed ALPGM, analysed the results and wrote the paper. AR conducted the glaciological analysis, contributed with the remote-sensing SMB data and conceived the study, together with IG, TC and JB. CG and JB developed the deep and machine learning modelling approach, and ES contributed in the

statistical analysis. All authors discussed the results and helped with developing the paper.

*Competing interests.* The authors declare that they have no conflict of interest.

*Acknowledgements.* This study has been possible through funding from the ANR VIP_Mont-Blanc (ANR-14 CE03-0006-03), the BERGER project (Pack Ambition Recherche funded by the Région Auvergne-Rhône-Alpes, the LabEx OSUG@2020 (Investissements d'avenir – ANR10 LABX56), and the CNES via the KALEIDOS-Alpes and ISIS (Initiative for Space Innovative Standard) projects. Data have been provided by Météo-France (SAFRAN dataset) and the GLACIOCLIM National Observation Service (in situ glaciological data). The authors would like to thank Eduardo Pérez-Pellitero (Max Planck Institute for Intelligent Systems) for the interesting discussions regarding deep learning, Benjamin Renard (Irstea Lyon) for his insightful comments on statistics, and Fabien Maussion and an anonymous reviewer for their constructive review comments which have helped to improve the overall quality and clarity of the paper.

*Financial support.* This research has been supported by the ANR VIP_Mont-Blanc (grant no. ANR-14 CE03-0006-03), the Pack Ambition Recherche funded by the AuRA region (BERGER project grant), the LabEx OSUG@2020 (grant no. ANR10 LABX56) and the CNES (KALEIDOS-Alpes and ISIS projects grants).

*Review statement.* This paper was edited by Valentina Radic and reviewed by Fabien Maussion and one anonymous referee.

## References

Beniston, M., Farinotti, D., Stoffel, M., Andreassen, L. M., Cop-pola, E., Eckert, N., Fantini, A., Giacona, F., Hauck, C., Huss, M., Huwald, H., Lehning, M., López-Moreno, J.-I., Magnusson, J., Marty, C., Morán-Tejéda, E., Morin, S., Naaim, M., Proven-zale, A., Rabatel, A., Six, D., Stötter, J., Strasser, U., Terzago, S., and Vincent, C.: The European mountain cryosphere: a review of its current state, trends, and future challenges, The Cryosphere, 12, 759–794, https://doi.org/10.5194/tc-12-759-2018, 2018.

Benn, D. I. and Evans, D. J. A.: Glaciers & glaciation, Routledge, New York, NY, USA, 2nd edn., available at: http://www.imperial.eblib.com/EBLWeb/patron/?target=patron&extendedid=P_615876_0 (last access: February 2020), oCLC: 878863282, 2014.

Bolibar, J.: JordiBolibar/ALPGM: ALPGM v1.0, https://doi.org/10.5281/zenodo.3269678, 2019.

Bolibar, J.: JordiBolibar/ALPGM: ALPGM v1.1, https://doi.org/10.5281/zenodo.3609136, 2020.

Brun, F., Berthier, E., Wagnon, P., Kääb, A., and Treichler, D.: A spatially resolved estimate of High Mountain Asia glacier
mass balances from 2000 to 2016, Nature Geosci., 10, 668–673,
https://doi.org/10.1038/ngeo2999, 2017.

Carlson, B. Z., Georges, D., Rabatel, A., Randin, C. F., Renaud, J., Delestrade, A., Zimmermann, N. E., Choler, P., and Thuiller, W.: Accounting for tree line shift, glacier retreat and primary succession in mountain plant distribution models, Diversity and Distributions, 20, 1379–1391, https://doi.org/10.1111/ddi.12238, 2014.

Chollet, F.: Keras, available at: https://keras.io (last access: February 2020), 2015.

Consortium, R. G. I.: Randolph Glacier Inventory 6.0,
https://doi.org/10.7265/N5-RGI-60, type: dataset, 2017.

de Bezenac, E., Pajot, A., and Gallinari, P.: Deep Learning for Physical Processes: Incorporating Prior Scientific Knowledge, arXiv:1711.07970 [cs, stat], http://arxiv.org/abs/1711.07970, arXiv: 1711.07970, 2018.

Ducournau, A. and Fablet, R.: Deep learning for ocean remote sensing: an application of convolutional neural networks for super-resolution on satellite-derived SST data, in: 2016 9th IAPR Workshop on Pattern Recognition in Remote Sensing (PRRS), 1–6, IEEE, Cancun, Mexico, https://doi.org/10.1109/PRRS.2016.7867019, 2016.

Durand, Y., Laternser, M., Giraud, G., Etchevers, P., Lesafre, B., and Mérindol, L.: Reanalysis of 44 Yr of Climate in the French Alps (1958–2002): Methodology, Model Validation, Climatology, and Trends for Air Temperature and Precipitation, J. Appl. Meteorol. Climatol., 48, 429–449, https://doi.org/10.1175/2008JAMC1808.1, 2009.

Dussaillant, I., Berthier, E., Brun, F., Masiokas, M., Hugonnet, R., Favier, V., Rabatel, A., Pitte, P., and Ruiz, L.: Two decades of glacier mass loss along the Andes, Nature Geosci., https://doi.org/10.1038/s41561-019-0432-5, 2019.

Farinotti, D., Huss, M., Fürst, J. J., Landmann, J., Machguth, H., Maussion, F., and Pandit, A.: A consensus estimate for the ice thickness distribution of all glaciers on Earth, Nature Geosci., 12, 168–173, https://doi.org/10.1038/s41561-019-0300-3, 2019.

Fausett, L. V.: Fundamentals of neural networks: architectures, algorithms, and applications, Prentice Hall, Englewood Cliffs, N.J., oCLC: 28215780, 1994.

Gagliardini, O., Zwinger, T., Gillet-Chaulet, F., Durand, G., Favier, L., de Fleurian, B., Greve, R., Malinen, M., Martín, C., Råback, P., Ruokolainen, J., Sacchettini, M., Schäfer, M., Seddik, H., and Thies, J.: Capabilities and performance of Elmer/Ice, a new-generation ice sheet model, Geosci. Model Dev., 6, 1299–1318, https://doi.org/10.5194/gmd-6-1299-2013, 2013.

Gardent, M., Rabatel, A., Dedieu, J.-P., and Deline, P.: Multitemporal glacier inventory of the French Alps from the late 1960s to the late 2000s, Global Planet. Change, 120, 24–37, https://doi.org/10.1016/j.gloplacha.2014.05.004, 2014.

Gerbaux, M., Genthon, C., Etchevers, P., Vincent, C., and Dedieu, J.: Surface mass balance of glaciers in the French Alps: distributed modeling and sensitivity to climate change, J. Glaciol., 51, 561–572, https://doi.org/10.3189/172756505781829133, 2005.

Hanzer, F., Förster, K., Nemec, J., and Strasser, U.: Projected cryospheric and hydrological impacts of 21st century climate change in the Ötztal Alps (Austria) simulated using a physically based approach, Hydrol. Earth Syst. Sci., 22, 1593–1614, https://doi.org/10.5194/hess-22-1593-2018, 2018.

Hastie, T., Tibshirani, R., and Friedman, J.: The Elements of Statistical Learning, Springer Series in Statistics, Springer New York, New York, NY, https://doi.org/10.1007/978-0-387-84858-7, 2009.

Hawkins, D. M.: The Problem of Overfitting, Journal of Chemical Information and Computer Sciences, 44, 1–12, https://doi.org/10.1021/ci0342472, 2004.

He, K., Zhang, X., Ren, S., and Sun, J.: Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification, 2015 IEEE International Conference on Computer Vision (ICCV), https://doi.org/10.1109/iccv.2015.123, 2015.

Hock, R.: Temperature index melt modelling in mountain areas, J. Hydrol., 282, 104–115, https://doi.org/10.1016/S0022-1694(03)00257-9, 2003.

Hock, R., Bliss, A., Marzeion, B., Giesen, R. H., Hirabayashi, Y., Huss, M., Radić, V., and Slangen, A. B. A.: Glacier-MIP – A model intercomparison of global-scale glacier mass-balance models and projections, J. Glaciol., 65, 453–467, https://doi.org/10.1017/jog.2019.22, 2019.

Hoerl, A. E. and Kennard, R. W.: Ridge Regression: Biased Estimation for Nonorthogonal Problems, Technometrics, 12, 55–67, https://doi.org/10.1080/00401706.1970.10488634, 1970.

Hoinkes, H. C.: Glacier Variation and Weather, J. Glaciol., 7, 3–18, https://doi.org/10.3189/S00221430000203084, 1968.

Houghton, J. T., Ding, Y., Griggs, D. J., Noguer, M., van der Linden, P. J., Dai, X., Maskell, K., and Johnson, C.: Climate change 2001: the scientific basis, The Press Syndicate of the University of Cambridge, 2001.

Huss, M.: Extrapolating glacier mass balance to the mountain-range scale: the European Alps 1900–2100, The Cryosphere, 6, 713–727, https://doi.org/10.5194/tc-6-713-2012, 2012.

Huss, M. and Hock, R.: A new model for global glacier change and sea-level rise, Front. Earth Sci., 3, https://doi.org/10.3389/feart.2015.00054, 2015.

Huss, M. and Hock, R.: Global-scale hydrological response to future glacier mass loss, Nature Clim. Change, 8, 135–140, https://doi.org/10.1038/s41558-017-0049-x, 2018.

Huss, M., Farinotti, D., Bauder, A., and Funk, M.: Modelling runoff from highly glacierized alpine drainage basins in a changing climate, Hydrol. Process., 22, 3888–3902, https://doi.org/10.1002/hyp.7055, 2008.

Huss, M., Jouvet, G., Farinotti, D., and Bauder, A.: Future high-mountain hydrology: a new parameterization of glacier retreat, Hydrol. Earth Syst. Sci., 14, 815–829, https://doi.org/10.5194/hess-14-815-2010, 2010.

Huss, M., Hock, R., Bauder, A., and Funk, M.: Conventional versus reference-surface mass balance, J. Glaciol., 58, 278–286, https://doi.org/10.3189/2012JoG11J216, 2012.

Ingrassia, S. and Morlini, I.: Neural Network Modeling for Small Datasets, Technometrics, 47, 297–311, https://doi.org/10.1198/004017005000000058, 2005.

Ioffe, S. and Szegedy, C.: Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift, 2015.

IPCC: Climate Change 2013: The Physical Science Basis. Contribution of Working Group I to the Fifth Assessment Report of the Intergovernmental Panel on Climate Change, 2018.

Jiang, G.-Q., Xu, J., and Wei, J.: A Deep Learning Algorithm of Neural Network for the Parameterization of Typhoon-Ocean
Feedback in Typhoon Forecast Models, Geophys. Res. Lett., 45, 3706–3716, https://doi.org/10.1002/2018GL077004, 2018.

Jouvet, G., Huss, M., Blatter, H., Picasso, M., and Rap-
paz, J.: Numerical simulation of Rhonegletscher from
1874 to 2100, J. Comput. Phys., 228, 6426–6439,
https://doi.org/10.1016/j.jcp.2009.05.033, 2009.

Jóhannesson, T., Raymond, C., and Waddington, E.: Time-Scale for Adjustment of Glaciers to Changes in Mass Balance, J. Glaciol., 35, 355–369, https://doi.org/10.3189/S002214300000928X, 1989.

Karpatne, A., Atluri, G., Faghmous, J. H., Steinbach, M., Banerjee, A., Ganguly, A., Shekhar, S., Samatova, N., and Kumar, V.: Theory-Guided Data Science: A New Paradigm for Scientific Discovery from Data, IEEE Transactions on Knowledge and Data Engineering, 29, 2318–2331, https://doi.org/10.1109/TKDE.2017.2720168, 2017.

Karpatne, A., Watkins, W., Read, J., and Kumar, V.: Physics-guided Neural Networks (PGNN): An Application in Lake Temperature Modeling, arXiv:1710.11431 [physics, stat], http://arxiv.org/abs/1710.11431, arXiv: 1710.11431, 2018.

Lguensat, R., Sun, M., Fablet, R., Tandeo, P., Mason, E., and Chen, G.: EddyNet: A Deep Neural Network For Pixel-Wise Classification of Oceanic Eddies, in: IGARSS 2018–2018 IEEE International Geoscience and Remote Sensing Symposium, 1764–1767, IEEE, Valencia, https://doi.org/10.1109/IGARSS.2018.8518411, 2018.

Lguensat, R., Sommer, J. L., Metref, S., Cosme, E., and Fa-
blet, R.: Learning Generalized Quasi-Geostrophic Models Us-
ing Deep Neural Numerical Models, arXiv:1911.08856 [physics,
stat], http://arxiv.org/abs/1911.08856, arXiv: 1911.08856, 2019.

Martin, S.: Correlation bilans de masse annuels-facteurs météorologiques dans les Grandes Rousses, Zeitschrift für Gletscherkunde und Glazialgeologie, 1974.

Marzeion, B., Jarosch, A. H., and Hofer, M.: Past and future sea-
level change from the surface mass balance of glaciers, The
Cryosphere, 6, 1295–1322, https://doi.org/10.5194/tc-6-1295-
2012, 2012.

Marçais, J. and de Dreuzy, J.-R.: Prospective Interest of Deep
Learning for Hydrological Inference, Groundwater, 55, 688–692,
https://doi.org/10.1111/gwat.12557, 2017.

Maussion, F., Gurgiser, W., Großhauser, M., Kaser, G., and Marzeion, B.: ENSO influence on surface energy and mass balance at Shallap Glacier, Cordillera Blanca, Peru, The Cryosphere, 9, 1663–1683, https://doi.org/10.5194/tc-9-1663-
2015, 2015.

Maussion, F., Butenko, A., Champollion, N., Dusch, M., Eis, J., Fourteau, K., Gregor, P., Jarosch, A. H., Landmann, J., Oesterle, F., Recinos, B., Rothenpieler, T., Vlug, A., Wild, C. T., and Marzeion, B.: The Open Global Glacier Model (OGGM) v1.1, Geosci. Model Dev., 12, 909–931, https://doi.org/10.5194/gmd-
12-909-2019, 2019.

NSIDC: Global Land Ice Measurements from Space glacier database. Compiled and made available by the international GLIMS community and the National Snow and Ice Data Center, 2005.

Nussbaumer, S., Steiner, D., and Zumbühl, H.: Réseau neuronal et fluctuations des glaciers dans les Alpes occidentales, available at: https://www.researchgate.net/publication/281755751_

Reseau_neuronal_et_fluctuations_des_glaciers_dans_le_
AlpesOccidentales (last access: February 2020) 2012.

Oliveira, M., Tongo, L., and Santos Costa, V.: Evaluation Procedures for Forecasting with Spatio-Temporal Data, in: Machine Learning and Knowledge Discovery in Databases, edited by: Berlingerio, M., Bonchi, F., Gärtner, T., Hurley, N., and Ifrim, G., vol. 11051, pp. 703–718, Springer International Publishing, Cham, https://doi.org/10.1007/978-3-030-10925-7_43, 2019.

Olson, M., Wyner, A. J., and Berk, R.: Modern Neural Networks Generalize on Small Data Sets, NeurIPS, NIPS Proceedings, available at: https://papers.nips.cc/ (last access: February 2020), 2018.

Pedregosa, F., Varoquaux, G., Gramfort, A., Michel, V., Thirion, B., Grisel, O., Blondel, M., Prettenhofer, P., Weiss, R., Dubourg, V., Vanderplas, J., Passos, A., Cournapeau, D., Brucher, M., Perrot, M., Duchesnay, E., and Louppe, G.: Scikit-learn: Machine Learning in Python, Journal of Machine Learning Research, 12, 2825–2830, 2011.

Rabatel, A., Letrégully, A., Dedieu, J.-P., and Eckert, N.: Changes in glacier equilibrium-line altitude in the western Alps from 1984 to 2010: evaluation by remote sensing and modeling of the morpho-topographic and climate controls, The Cryosphere, 7, 1455–1471, https://doi.org/10.5194/tc-7-1455-2013, 2013.

Rabatel, A., Dedieu, J. P., and Vincent, C.: Spatio-temporal changes in glacier-wide mass balance quantified by optical remote sensing on 30 glaciers in the French Alps for the period 1983–2014, J. Glaciol., 62, 1153–1166, https://doi.org/10.1017/jog.2016.113, 2016.

Rabatel, A., Sanchez, O., Vincent, C., and Six, D.: Estimation of
Glacier Thickness From Surface Mass Balance and Ice Flow
Velocities: A Case Study on Argentière Glacier, France, Front.
Earth Sci., 6, https://doi.org/10.3389/feart.2018.00112, 2018.

Rackauckas, C., Ma, Y., Martensen, J., Warner, C., Zubov, K., Su-
pekar, R., Skinner, D., and Ramadhan, A.: Universal Differential
Equations for Scientific Machine Learning, arXiv:2001.04385
[cs, math, q-bio, stat], http://arxiv.org/abs/2001.04385, arXiv:
2001.04385, 2020.

Radić, V., Bliss, A., Beedlow, A. C., Hock, R., Miles, E., and Cogley, J. G.: Regional and global projections of twenty-first century glacier mass changes in response to climate scenarios from global climate models, Clim. Dynam., 42, 37–58, https://doi.org/10.1007/s00382-013-1719-7, 2014.

Rasp, S., Pritchard, M. S., and Gentine, P.: Deep learning to repre-
sent subgrid processes in climate models, P. Natl. Acad. Sci., 115,
9684–9689, https://doi.org/10.1073/pnas.1810286115, 2018.

Roberts, D. R., Bahn, V., Ciuti, S., Boyce, M. S., Elith, J., Guillera-
Arroita, G., Hauenstein, S., Lahoz-Monfort, J. J., Schröder, B.,
Thuiller, W., Warton, D. I., Wintle, B. A., Hartig, F., and Dor-
mann, C. F.: Cross-validation strategies for data with temporal,
spatial, hierarchical, or phylogenetic structure, Ecography, 40,
913–929, https://doi.org/10.1111/ecog.02881, 2017.

Réveillet, M., Rabatel, A., Gillet-Chaulet, F., and Soruco, A.: Simulations of changes to Glaciar Zongo, Bolivia (16° S), over the 21st century using a 3-D full-Stokes model and CMIP5 climate projections, Ann. Glaciol., 56, 89–97, https://doi.org/10.3189/2015AoG70A113, 2015.

Réveillet, M., Vincent, C., Six, D., and Rabatel, A.: Which empir-
ical model is best suited to simulate glacier mass balances?, J.
Glaciol., 63, 39–54, https://doi.org/10.1017/jog.2016.110, 2017.
Réveillet, M., Six, D., Vincent, C., Rabatel, A., Dumont, M., Lafaysse, M., Morin, S., Vionnet, V., and Litt, M.: Relative performance of empirical and physical models in assessing the seasonal and annual glacier surface mass balance of Saint-Sorlin Glacier (French Alps), The Cryosphere, 12, 1367–1386, https://doi.org/10.5194/tc-12-1367-2018, 2018.

Seabold, S. and Perktold, J.: Statsmodels: Econometric and Statistical Modeling with Python, Proc. of the 9th Python in Science Conf., 2010.

Shen, C.: A Transdisciplinary Review of Deep Learning Research and Its Relevance for Water Resources Scientists, Water Resour. Res., 54, 8558–8593, https://doi.org/10.1029/2018WR022643, 2018.

Six, D. and Vincent, C.: Sensitivity of mass balance and equilibrium-line altitude to climate change in the French Alps, J. Glaciol., 60, 867–878, https://doi.org/10.3189/2014JoG14J014, 2014.

Srivastava, N., Hinton, G., Krizhevsky, A., Sutskever, I., and Salakhutdinov, R.: Dropout: a simple way to prevent neural networks from overfitting, J. Mach. Learn. Res., 15, 1929–1958, 2014.

Steiner, D., Walter, A., and Zumbühl, H.: The application of a non-linear back-propagation neural network to study the mass balance of Grosse Aletschgletscher, Switzerland, J. Glaciol., 51, 313–323, https://doi.org/10.3189/172756505781829421, 2005.

Steiner, D., Pauling, A., Nussbaumer, S. U., Nesje, A., Luterbacher, J., Wanner, H., and Zumbühl, H. J.: Sensitivity of European glaciers to precipitation and temperature – two case studies, Clim. Change, 90, 413–441, https://doi.org/10.1007/s10584-008-9393-1, 2008.

Thibert, E., Dkengne Sielenou, P., Vionnet, V., Eckert, N., and Vincent, C.: Causes of Glacier Melt Extremes in the Alps Since 1949, Geophys. Res. Lett., 45, 817–825, https://doi.org/10.1002/2017GL076333, 2018.

Tibshirani, R.: Regression Shrinkage and Selection via the Lasso, J. Roy. Stat. Soc. B, 58, 267–288, 1996.

Tibshirani, R., Johnstone, I., Hastie, T., and Efron, B.: Least angle regression, Ann. Stat., 32, 407–499, https://doi.org/10.1214/009053604000000067, 2004.

Vincent, C., Harter, M., Gilbert, A., Berthier, E., and Six, D.: Future fluctuations of Mer de Glace, French Alps, assessed using a parameterized model calibrated with past thickness changes, Ann. Glaciol., 55, 15–24, https://doi.org/10.3189/2014AoG66A050, 2014.

Vincent, C., Fischer, A., Mayer, C., Bauder, A., Galos, S. P., Funk, M., Thibert, E., Six, D., Braun, L., and Huss, M.: Common climatic signal from glaciers in the European Alps over the last 50 years: Common Climatic Signal in the Alps, Geophys. Res. Lett., 44, 1376–1383, https://doi.org/10.1002/2016GL072094, 2017.

Vincent, C., Peyaud, V., Laarman, O., Six, D., Gilbert, A., Gillet-Chaulet, F., Berthier, E., Morin, S., Verfaillie, D., Rabatel, A., Jourdain, B., and Bolibar, J.: Déclin des deux plus grands glaciers des Alpes françaises au cours du XXIe siècle: Argentière et Mer de Glace, La Météorologie, p. 49, https://doi.org/10.4267/2042/70369, 2019.

Vionnet, V., Dombrowski-Etchevers, I., Lafaysse, M., Quéno, L., Seity, Y., and Bazile, E.: Numerical Weather Forecasts at Kilometer Scale in the French Alps: Evaluation and Application for Snowpack Modeling, J. Hydrometeorol., 17, 2591–2614, https://doi.org/10.1175/JHM-D-15-0241.1, 2016.

Vuille, M., Carey, M., Huggel, C., Buytaert, W., Rabatel, A., Jacobsen, D., Soruco, A., Villacis, M., Yarleque, C., Elison Timm, O., Condom, T., Salzmann, N., and Sicart, J.-E.: Rapid decline of snow and ice in the tropical Andes – Impacts, uncertainties and challenges ahead, Earth-Sci. Rev., 176, 195–213, https://doi.org/10.1016/j.earscirev.2017.09.019, 2018.

Weisberg, S.: Applied linear regression, Wiley series in probability and statistics, Wiley, Hoboken, NJ, fourth edition edn., 2014.

Whittingham, M. J., Stephens, P. A., Bradbury, R. B., and Freckleton, R. P.: Why do we still use stepwise modelling in ecology and behaviour?: Stepwise modelling in ecology and behaviour, J. Anim. Ecol., 75, 1182–1189, https://doi.org/10.1111/j.1365-2656.2006.01141.x, 2006.

Xu, B., Wang, N., Chen, T., and Li, M.: Empirical Evaluation of Rectified Activations in Convolutional Network, CoRR, abs/1505.00853, available at: http://arxiv.org/abs/1505.00853 (last access: February 2020), 2015.

Zekollari, H. and Huybrechts, P.: Statistical modelling of the surface mass-balance variability of the Morteratsch glacier, Switzerland: strong control of early melting season meteorological conditions, J. Glaciol., 64, 275–288, https://doi.org/10.1017/jog.2018.18, 2018.

Zekollari, H., Huss, M., and Farinotti, D.: Modelling the future evolution of glaciers in the European Alps under the EUROCORDEX RCM ensemble, The Cryosphere, 13, 1125–1146, https://doi.org/10.5194/tc-13-1125-2019, 2019.

Zemp, M., Haeberli, W., Hoelzle, M., and Paul, F.: Alpine glaciers to disappear within decades?, Geophys. Res. Lett., 33, https://doi.org/10.1029/2006GL026319, 2006.

Zemp, M., Huss, M., Thibert, E., Eckert, N., McNabb, R., Huber, J., Barandun, M., Machguth, H., Nussbaumer, S. U., Gärtner-Roer, I., Thomson, L., Paul, F., Maussion, F., Kutuzov, S., and Cogley, J. G.: Global glacier mass changes and their contributions to sea-level rise from 1961 to 2016, Nature, 568, 382–386, https://doi.org/10.1038/s41586-019-1071-0, 2019.