<figure><img src="image_1.png" /></figure>

<figure><img src="image_2.png" /></figure>

# Assessment of NBSs effectiveness for flood risk management: The Isar River case study

Francesco Pugliese IDa,*, Gerardo Caroppi IDb, Aude Zingraff-Hamed Id,c,d, Gerd Luppc and Carlo Gerundo Id,e

<figure><img src="image_3.png" /></figure>

FP, 0000-0001-5845-3326; GC, 0000-0002-0454-8474; AZ-H, 0000-0001-7602-7830; CG, 0000-0003-1208-016X

## ABSTRACT

Nature-based solutions (NBSs) are increasingly implemented to mitigate natural risks in urban and rural contexts, from coastal to mountainous areas. Nevertheless, the lack of quantitative approaches to assess NBSs' effectiveness limits their technical, social and cultural acceptance. Within the PHUSICOS project (EU H2020 Innovation Action; Grant Agreement nr. 776681) a comprehensive assessment framework tool (AFT) has been developed to fill this gap. This paper presents an *ex-post* analysis with the PHUSICOS AFT applied to the Isar River case study. The restoration of the urban reach of the Isar River, in the city of Munich, was implemented in the early 2000s and represents a successful example of ecosystem and user-friendly flood risk management plan. The performance of the NBS measures implemented to manage the flood risk and improve the ecological status of the river (NBS scenario) is assessed in comparison with an alternative scenario with traditional hard engineering measures (grey scenario, GS). Results underscore the NBS as a competitive alternative. The *ex-post* analysis shows the potential of the PHUSICOS AFT for NBS performance assessment, providing guidance on indicator selection, stakeholders' management and performance assessment. The application discussed here is expected to aid professionals and researchers involved in the design, implementation, monitoring and evaluation of NBSs.

**Key words:** assessment framework tool (AFT), flooding risk, Isar River restoration, Living Lab, nature-based solutions (NBSs), PHUSICOS project

## HIGHLIGHTS

* PHUSICOS project aims to assess the effectiveness of NBSs against natural hazard in rural and mountainous areas.

* The proposed assessment framework tool allows evaluating the NBS features through a comprehensive approach.

* The Isar River restoration is an effective case study to test the tool reliability.

* The Living Lab can be intended as a fruitful tool to involve the stakeholders in the decision making.

## ABBREVIATIONS

AFT Assessment framework tool

DRR Disaster risk reduction

DS Design scenario

GS Grey scenario

KPI Key performance indicator

MCDA Multi-criteria decision analysis

NBS Nature-based solution

NNBF Natural and nature-based feature

NGO Non-governmental organization

SH Stakeholder

This is an Open Access article distributed under the terms of the Creative Commons Attribution Licence (CC BY 4.0), which permits copying, adaptation and
redistribution, provided the original work is properly cited (http://creativecommons.org/licenses/by/4.0/).

<footnote>aDepartment of Civil, Architectural and Environmental Engineering, University of Naples Federico II, Via Claudio 21, Naples 80125, Italy</footnote>

<footnote>bDepartment of Built Environment, Aalto University School of Engineering, Tietotie 1 E, Espoo 02150, Finland</footnote>

<footnote>cChair for Strategic Landscape Planning and Management, Technical University of Munich, Freising 85354, Germany</footnote>

<footnote>dUMR Cités, TERitoires, Environnement et Sociétés, L'UMR 7324 CITERES, University of Tours, Tours 37200, France</footnote>

<footnote>eDepartment of Civil, Architectural and Environmental Engineering, University of Naples Federico II, Piazzale Tecchio 80, Naples 80125, Italy</footnote>

<footnote>*Corresponding author. E-mail: francesco.pugliese2@unina.it</footnote>
# 1. INTRODUCTION

Extreme natural hazards, such as floods, droughts, landslides, are more frequently occurring throughout the world, enhanced by climate change and uncontrolled land use (Wilby & Keenan 2012; Edwards et al. 2021; Feldmeyer et al. 2021). Considering the impact, cost and massiveness of grey traditional solutions for dealing with disaster risk reduction (DRR), natural and eco-friendly alternatives are encouraging more sustainable approaches in urban (Shafique & Kim 2015; De Paola et al. 2018a, 2018b), rural and mountainous areas (Ingold et al. 2010; Scarano 2017; Bhatt et al. 2020). The European Commission fosters the development of ecosystem approaches and, namely, of nature-based solutions (NBSs), to promote DRR while enhancing the restoration and conservation of biodiversity, safeguarding human well-being and health (Faivre et al. 2018).

NBSs are intended as ‘solutions that are inspired and supported by nature, which are cost-effective, simultaneously provide environmental, social and economic benefits and help build resilience’ (European Commission 2016). The NBS application fosters the citizens’ participation, instilling trust among stakeholders (SHs) during both their implementation and operations (Kumar et al. 2020). Thus, they represent a living solution, inspired by nature, resulting in economic viability and enhancing socio-economic and environmental benefits (Maes & Jacobs 2015). NBSs can be classified as green, blue or hybrid when based on vegetative, waterbody or combined with grey infrastructure, respectively (Debele et al. 2019). Differently from grey solutions, usually having mono-functional features, NBSs are able to address socio-economic challenges supporting the reduction of economic vulnerability and developing a sense of place (Lupp et al. 2021). NBSs implicitly allow increasing the sense of identity, fostering the promotion and safeguard of the ecosystem services (Rowiński et al. 2018). In comparison to grey solutions, properly designed NBSs can balance lower performances with cheaper maintenance costs, with greater cost-effectiveness and efficiency in the long-term horizon (Naumann et al. 2014).

Finally, investments in NBSs can boost sustainable tourism and lead to new green jobs for operators, entrepreneurs and local producers (Boyle & Kuhl 2021).

One of the main concerns for the assessment of NBSs' effectiveness relates to the monitoring stage of their performances. It can be achieved by comparing the results against predefined targets, adequating the design and maintenance activities in cooperation with policymakers, actively involved in the decision-making process (Kumar et al. 2021). The monitoring represents a crucial stage at both the *ex-ante* and the *ex-post* project assessment, through the coupling of record datasets from public authorities, statistical databases, literature reviews and workshops with technical, environmental and socio-economic parameters (Andrés et al. 2021). In the literature, several sets of indicators have been proposed as a function of the territorial context (Nicholson et al. 2020), the monitoring instrument (Li et al. 2019) and the applied technique (Vinten et al. 2019).

Owing to their multi-functional nature, the design of NBSs for DRR cannot neglect the assessment of the related co-benefits, by implementing tools for the quantitative evaluation of their effectiveness under different perspectives: technical, socio-economic and environmental (Albert et al. 2020).

Several procedures have been proposed to assess the NBS performances in urban areas (Liquete et al. 2016; EKLIPSE 2017; Narayan et al. 2017; Raymond et al. 2017; Zölch et al. 2017; Calliari et al. 2019), remarking upon the strict connection between the NBS effectiveness and the urban (Figurek 2021) and biophysical (Pinto et al. 2021) characteristics of the area. Moreover, many governmental agencies have been developing protocols and methods to evaluate strategies, plans, programmes and projects where different types of solutions (including grey and also nature-based) are considered in public investments' decision-making process, in order to compare the effects relative to the environmental, economic, and social goals (Interior 2013; King et al. 2021). Among them, the U.S. Army Corps of Engineers (USACE) developed criteria and guidelines to design and manage natural and nature-based features (NNBFs) against flood risk reduction. Such guidelines focus on how to effectively include natural solutions into planning and policy rules. There, NNBFs are considered as stand-alone solutions or as integrated with other structural and nonstructural measures (Carter & Lipiec 2020).

In the frame of the NBS application against natural hazards, the PHUSICOS project pays specific attention to rural mountainous areas, for which peculiar technical, environmental and socio-economic features can be identified (Baills et al. 2021; Strout et al. 2021). Indeed, these environments deal with natural hazards such as flooding, landslide, rockfall, snow avalanche (Haritashya et al. 2006; Keiler & Fuchs 2018). Moreover, differently from urban areas, rural and mountainous areas show specific socio-economic and environmental features, caused by depopulation and limited economic development. The NBS approaches may thus provide proper co-benefits to take on these challenges (Solheim et al. 2021). Furthermore, while few pieces of research on NBS focus on the mountainous landscape (Palomo et al. 2021), crucial and exposed transportation routes, lifelines and critical infrastructures are located in these areas.
Many governance models may enable NBS implementation, however, the most effective approach to plan, design and implement NBSs entails the application of polycentric and collaborative planning (Zingraff-Hamed et al. 2020a; Dumitru et al. 2021), by involving experts and SHs' dialogues (Scolobig et al. 2016). Indeed, several studies have pointed out that such participative approaches may enhance the effective NBSs' implementation (Pauleit et al. 2017; Frantzeskaki et al. 2019; Zingraff-Hamed et al. 2020b). The PHUSICOS project tests the Living Lab approach to select, implement, monitor and assess nature-based and hybrid solutions in mountainous and rural areas (Fohlmeister et al. 2017a, 2017b; Lupp et al. 2021).

Owing to the multi-functional nature of NBSs, their effectiveness assessment requires the application of multi-criteria decision analysis (MCDA) (Ishizaka & Nemery 2013; Ruangpan et al. 2020). MCDA allows different co-benefits to be managed and to include the SH involvement in both the weighting and assessment processes. However, studies showed that many methods include only ecological and risk mitigation features while neglecting economic and social indicators (Perosa et al. 2021b). Furthermore, the assessment of suitable solutions before their implementation is essential to support the decision-making process (Zingraff-Hamed et al. 2018; Perosa et al. 2021a).

Within the frame of the PHUSICOS project, a multi-level assessment tool was developed (Autuori et al. 2019), aimed at applying a MCDA for evaluating the effectiveness of nature-based, hybrid and grey solutions. The assessment framework tool (AFT) was addressed at the planning, design, implementation and monitoring of design scenarios (DS) through a multi-stakeholder involvement and a multi-disciplinary approach. Owing to its flexible structure, it can be customized and refined for several operative fields and socio-economic and environmental contexts.

In this paper, the PHUSICOS AFT was tested on the Isar River case study, for an *ex-post* assessment. The aim of this work is two-fold: (i) to present the PHUSICOS AFT and its application for a real case study; (ii) to assess whether the NBSs implemented at the Isar River were competitive relative to more common traditional grey solutions. The DS of the river flood risk management plan, implemented in the areas surrounding the Municipality of Munich in the early 2000s, was analysed and compared with a hypothetical grey scenario (GS). Results allow observation of the benefits or detriments of the post-intervention scenario, in comparison with the pre-intervention configuration (baseline scenario).

Section 2 reports the features and the structure of the AFT. Section 3 introduces the Isar River case study and the application of the AFT. Section 4 discusses the results of the assessment. Section 5 provides the summary and the concluding remarks.

## 2. THE PHUSICOS PROJECT ASSESSMENT FRAMEWORK TOOL (AFT)

The AFT is composed of a set of key performance indicators (KPIs) used to assess the effectiveness of the DSs (e.g., nature-based, hybrid and grey solutions) from different perspectives: technical, environmental, social and economic. KPIs are selected and used to properly evaluate key ecosystem services, co-benefits and costs. The assessment is based on the KPIs' estimation, to be selected and quantified to evaluate their features at different DSs. Once the KPIs are quantified, by applying a multi-level aggregative and weighting approach, the score of each DS is calculated as a numerical scoring of its overall performance. Once a score is evaluated for each alternative DS, the alternatives can be quantitatively compared, and the results can aid the selection of the best-suited option (Figure 1).

<figure><img src="image_4.png" /><figcaption>**Figure 1** | Conceptual scheme for project scenarios' comparative performance assessment.</figcaption></figure>
## 2.1. AFT structure

The AFT has a multi-level hierarchic structure composed of KPIs suitable for rural and mountainous areas. Differently from the urban contexts, rural and mountainous areas have specific features in terms of forcing natural hazards, and socio-economic and environmental characteristics. These areas are usually more susceptible to flooding, rockfall and landslide hazards. From the socio-economic perspective, they are affected by youth drain, limited infrastructural services and accessibility.

Within the PHUSICOS AFT, KPIs are grouped in hierarchically ordered categories. Such categories are ambits (first level), criteria (second level), sub-criteria (third level) and the actual KPIs (fourth level). In the application of the AFT, KPIs are selected using a top-down approach, based on the introduced hierarchic structure. The ambits were identified to assess (1) the DS performance against one or multiple natural risks (Ambit 1: risk reduction); (2) the DS affordability (Ambit 2: technical and feasibility aspects); (3) the environmental co-benefits of the DS (Ambit 3: environment and ecosystems); (4) the implications on the society (Ambit 4: society); (5) the impacts on the economy at the local scale (Ambit 5: local economy).

Each ambit is composed of one or more criteria, in turn including sub-criteria (Table 1). Each sub-criterion consists of one or more KPIs. Namely, the complete AFT includes 5 ambits, 14 criteria, 40 sub-criteria and 98 KPIs. For more details refer to the deliverable D4.1 of the H2020 PHUSICOS project (Autuori et al. 2019). However, KPIs and different categories can be included or customized depending on the specific features of the investigated case study.

The core of the AFT structure is a matrix of 13 columns with the number of rows corresponding to the number of considered indicators. Ambits, criteria and sub-criteria are reported in column 1, 2 and 3, respectively, whereas the KPIs are specified in column 4. The overall structure of the matrix is summarized in Table 2, whereas Table 3 shows a simplified sketch of the AFT matrix.

The AFT matrix may be intended as a flexible tool, to be properly tailored at each specific case study. Indeed, the KPIs, sub-criteria and criteria to be included in the assessment strictly depend on the specificity of the investigated case study, namely, setting status, type of risk faced and solutions suggested. Nevertheless, to ensure a comprehensive approach, at least one KPI per ambit, or better per criterion, should be included in the analysis. Specifically, the main natural hazards occurring in the area have to be identified, to exclude the non-relevant KPIs. Then, the data availability and the suitability of measuring and monitoring the KPIs at both the DSs and the baseline scenario have to be considered to select the spectrum of criteria to be included. In addition, the AFT tailoring depends on the chronological and climatic contexts wherein the assessment operates. To implement measures dealing with DRR, such as NBS, hybrid or grey solutions, two assessment stages can be considered: an ex-ante stage, before the design and implementation of the measure, and an ex-post stage, after the implementation, for monitoring the performance of the implemented interventions. The AFT application is different for the two stages. For the ex-ante stage, either a simplified matrix, with very few KPIs, useful for a quick and preliminary assessment of different DSs (NBS, hybrid or grey) or an extended matrix can be considered for assessing the effectiveness of a DS before its implementation. Conversely, at the ex-post stage, more KPIs are needed for the proper analysis of the robustness of the implemented DS either towards specific goals (assessment factor matrix) or for extensively monitoring its performances (extended matrix).

## 2.2. KPIs normalization, weighting and aggregation

The AFT is based on the KPIs' estimation at each DS, in comparison with their value at the baseline scenario. The performance of each DS is estimated by means of the overall scoring, quantified as the multi-level weighted sum of the KPI scores.

Owing to the heterogeneous features and metric of the KPIs, once each KPI is estimated, a normalization approach is applied, as detailed in the following.

Let us consider a set of n DSs $K_i$, with $i = 1, ..., n$, in which a set m indicators $KPI_j$ are accounted for, with $j = 1, ..., m$. To normalize the KPIs within the range from 0 to 100, Equations (1) and (2) are applied:

$$ \overline{KPI}_{j,i} = 100 \cdot \left( \frac{KPI_{j,i} - KPI_{j,min}}{KPI_{j,max} - KPI_{j,min}} \right) \quad \text{for KPI to be maximized (\to)} \quad (1) $$

$$ \overline{KPI}_{j,i} = 100 \cdot \left( \frac{KPI_{j,max} - KPI_{j,i}}{KPI_{j,max} - KPI_{j,min}} \right) \quad \text{for KPI to be minimized (\leftarrow)} \quad (2) $$

where $\overline{KPI}_{j,i}$ is the normalized value of the indicator $KPI_{j,i}$ and $KPI_{j,max}$ ($KPI_{j,min}$) is the maximum (minimum) value achievable by $KPI_i$ at the baseline scenario. Equation (1) is considered when the KPI is maximized for the optimization (\to symbol in column number 7 of the AFT matrix of Table 2), whereas Equation (2) when it is minimized (\leftarrow symbol in column
<table><caption>**Table 1** | Structure of the AFT with ambits, and selected criteria and sub-criteria</caption><thead><tr><th>Ambit</th><th>Criterion</th><th>Sub-criterion</th></tr></thead><tbody><tr><td rowspan="10">Risk reduction</td><td rowspan="4">Hazard</td><td>Landslide risk resilience</td></tr><tr><td>Flooding risk resilience</td></tr><tr><td>Snow avalanche risk resilience</td></tr><tr><td>Drought risk resilience</td></tr><tr><td rowspan="5">Exposure</td><td>Potential areas exposed to risks</td></tr><tr><td>Potential population exposed to risks</td></tr><tr><td>Potential species exposed to risks</td></tr><tr><td>Potential buildings exposed to risks</td></tr><tr><td>Potential infrastructures exposed to risks</td></tr><tr><td rowspan="3">Vulnerability</td><td>Potential population vulnerable to risks</td></tr><tr><td>Potential economic effects due to risks</td></tr><tr><td>Potential infrastructures vulnerable to risks</td></tr><tr><td>Technical and feasibility aspects</td><td>Technical feasibility</td><td>Cost-benefit analysis of the intervention<br>Application of suitable materials and technologies</td></tr><tr><td rowspan="14">Environment and ecosystems</td><td rowspan="2">Water</td><td>Effects on water quality</td></tr><tr><td>Effects on water quantity</td></tr><tr><td rowspan="2">Soil</td><td>Soil physical resilience</td></tr><tr><td>Stability of the soil communities and Derived environmental services</td></tr><tr><td rowspan="5">Vegetation</td><td>Soil fertility</td></tr><tr><td>Carbon sequestration in soil</td></tr><tr><td>Aboveground C cycle</td></tr><tr><td>Structural diversity</td></tr><tr><td>Stages of forest stand development</td></tr><tr><td rowspan="2">Landscape (Green Infrastructure)</td><td>Typical local species promotion and development</td></tr><tr><td>Moisture</td></tr><tr><td rowspan="2">Biodiversity</td><td>Flammability</td></tr><tr><td>Green infrastructure</td></tr><tr><td rowspan="3">Quality of life</td><td>Functional diversity</td></tr><tr><td>Forest habitat fragmentation</td></tr><tr><td>Protected areas</td></tr><tr><td rowspan="2">Community involvement and governance</td><td>Leisure and connections increasing</td></tr><tr><td>Social justice</td></tr><tr><td rowspan="2">Landscape and heritage</td><td>Ageing contrast</td></tr><tr><td>Participatory processes and partnerships</td></tr><tr><td rowspan="4">Local economy</td><td rowspan="2">Revitalization of marginal areas</td><td>Identity</td></tr><tr><td>Heritage accessibility</td></tr><tr><td rowspan="2">Local economy reinforcement</td><td>Landscape perception</td></tr><tr><td>Promotion of local socio-economic development of marginal areas</td></tr><tr><td rowspan="2"></td><td rowspan="2"></td><td>New areas for traditional resources</td></tr><tr><td>Enhancement of local socio-economic activities</td></tr></tbody></table>

number 7 of the AFT matrix of Table 2). Thus, the $\overline{KPI}_{j,i}$ parameter states the beneficial/detrimental extent provided by the i-th DS on the j-th KPI, in comparison with the baseline scenario.

A weighting procedure is then applied, in order to consider how some features, and in turn some KPIs, may be intended as having greater or lesser importance for the assessment process, depending on both the involved SHs and the case study specificity. To this aim, the AFT, developed in the frame of the PHUSICOS project, is based on a multi-level weighting procedure to assess the score of the j-th KPI at the i-th DS with Equation (3):

$$S_{j,i} = \overline{KPI}_{j,i} \cdot w_{I,j} \cdot w_{II,l} \cdot w_{III,a} \qquad (3)$$

$$\text{with: } \sum_{j=1}^{m} w_{I,j} = 1, \sum_{l=1}^{c} w_{II,l} = 1, \sum_{a=1}^{p} w_{III,a} = 1$$
<table><caption>**Table 2** | Key to read the 13 columns composing the AFT matrix</caption><thead><tr><th>Column number</th><th>Property</th><th>Symbol</th><th>Description</th></tr></thead><tbody><tr><td>1</td><td>Ambit</td><td>A</td><td>Main category representing the operative field of the KPI assessment</td></tr><tr><td>2</td><td>Criterion</td><td>C</td><td>Ambit sub-category representing the goal of the KPI evaluation</td></tr><tr><td>3</td><td>Sub-criterion</td><td>S-C</td><td>Sub-category representing the field wherein the KPI operates</td></tr><tr><td>4</td><td>Key performance indicator</td><td>KPI</td><td>Indicator to be evaluated for the assessment</td></tr><tr><td>5</td><td>Metric</td><td>Mt</td><td>KPI unit of measurement</td></tr><tr><td>6</td><td>Typology</td><td>Tp</td><td>Type of data for estimating the KPI: qualitative (QL), quantitative (QT), semi-quantitative (S-QT)</td></tr><tr><td>7</td><td>Direction</td><td>↔</td><td>Whether the optimization of KPI needs its maximization (max) or minimization (min)</td></tr><tr><td>8</td><td>Source</td><td>S</td><td>Source of data for assessing the KPI: survey (SV), numerical modeling (M), participatory process (PP), geographic information (GIS), statistical data (SD), sampling (SM)</td></tr><tr><td>9</td><td>Delta attribute</td><td>Δ</td><td>Whether the KPI at the design scenario may be compared to its value at the baseline scenario (Δ), or not (–)</td></tr><tr><td>10</td><td>Assessment factor</td><td>AF</td><td>KPI role in the assessment process: Effectiveness (E), feasibility (F), co-benefits (CB), resilience (R)</td></tr><tr><td>11</td><td>Time scale</td><td>TS</td><td>Time scale of the KPI impact: long-term (LT), medium-term (MT), short-term (ST)</td></tr><tr><td>12</td><td>Sendai Framework Disaster Risk Reduction</td><td>SFDRR</td><td>KPI compliance with one or more Sendai Framework Disaster Risk Reduction (SFDRR, Aitsi-Selmi et al. (2015))</td></tr><tr><td>13</td><td>UN Sustainable Development Goals</td><td>UNSDG</td><td>KPI compliance with one or more Development Goals (UNSDG, United Nations 2015)</td></tr></tbody></table>

<table><caption>**Table 3** | Structure of the framework matrix</caption><thead><tr><th>Ambit A</th><th>Criterion C</th><th>Sub-criterion S-C</th><th>Key performance indicator (KPI)</th><th>Mt</th><th>Tp</th><th>S</th><th>Δ</th><th>AF</th><th>TS</th><th>SFDRR</th><th>UNDSG</th></tr></thead><tbody><tr><td rowspan="4">Risk reduction</td><td rowspan="4">Hazard</td><td rowspan="4">Flooding risk resilience</td><td>Peak flow</td><td>m³/s</td><td>QT min</td><td>M</td><td>Δ</td><td>R</td><td>ST</td><td>-</td><td>13</td></tr><tr><td>Peak volume</td><td>m³</td><td>QT min</td><td>M/S</td><td>Δ</td><td>R</td><td>ST</td><td>-</td><td>13</td></tr><tr><td>Flooded area</td><td>ha</td><td>QT min</td><td>M/S</td><td>Δ</td><td>R</td><td>ST</td><td>-</td><td>13</td></tr><tr><td>...</td><td>...</td><td>...</td><td>...</td><td>...</td><td>...</td><td>...</td><td>...</td><td>...</td><td>...</td></tr><tr><td rowspan="4">Society</td><td rowspan="4">Landscape and heritage</td><td rowspan="4">Landscape perception</td><td>...</td><td>...</td><td>...</td><td>...</td><td>...</td><td>...</td><td>...</td><td>...</td><td>...</td></tr><tr><td>...</td><td>...</td><td>...</td><td>...</td><td>...</td><td>...</td><td>...</td><td>...</td><td>...</td></tr><tr><td>...</td><td>...</td><td>...</td><td>...</td><td>...</td><td>...</td><td>...</td><td>...</td><td>...</td></tr><tr><td>...</td><td>...</td><td>...</td><td>...</td><td>...</td><td>...</td><td>...</td><td>...</td><td>...</td></tr><tr><td></td><td></td><td></td><td>Viewshed</td><td>km²</td><td>QT max</td><td>G</td><td>Δ</td><td>CB</td><td>ST</td><td>-</td><td>3</td></tr><tr><td></td><td></td><td></td><td>Scenic sites and Landmarks created</td><td>nr.</td><td>QT max</td><td>M/G</td><td>-</td><td>CB</td><td>ST</td><td>-</td><td>3</td></tr><tr><td></td><td></td><td></td><td>Scenic Paths Created</td><td>km</td><td>QT max</td><td>M/G</td><td>-</td><td>CB</td><td>ST</td><td>-</td><td>3</td></tr><tr><td></td><td></td><td></td><td>...</td><td>...</td><td>...</td><td>...</td><td>...</td><td>...</td><td>...</td><td>...</td><td>...</td></tr><tr><td></td><td></td><td></td><td>...</td><td>...</td><td>...</td><td>...</td><td>...</td><td>...</td><td>...</td><td>...</td><td>...</td></tr></tbody></table>

where $w_{I,j}$, with $j = 1, ..., m$, is the weight of j-th $\overline{KPI}$ at the i-th DS (first level of weighting), $w_{II,l}$, with $l = 1, ..., c$ and $c$ the number of defined criteria, is the weight of the l-th criterion including the j-th KPI (second level of weighting) and $w_{III,a}$, with $a = 1, ..., p$ and $p$ is the number of considered ambits, is the weight of the a-th ambit (third level of weighting).

Owing to the different skills and backgrounds of SHs involved in the weighting procedure, the most suitable approach to set the multi-level weights entails coupling the Likert scale (Likert 1932) and the uniform weighting procedure. According to Likert's approach, SHs or specialists should rate the preferences (e.g., via surveys), giving a vote from 1 ('not at all important
to me') to 5 ('very important to me'), by making easier the comparison among each other. Once the preferences of all the voters are collected, the weights can be properly normalized for the final assessment. Given the significant number of KPIs and, in some cases, their technical specificity, not simply to be understood by heterogeneous groups of SHs, the Likert scale approach is actually suitable only for the second and the third level of weighting, namely, the criteria and the ambits. Whereas the uniform approach can be accounted for the fourth level, the KPIs, by assuming a uniform rate between all the objects belonging to the same level. The weight is thus estimated as the reciprocal of W, where W is the number of selected KPIs.

Nevertheless, alternative approaches can be chosen, such as the pairwise comparison (Kou et al. 2016), resulting in any cases not easily relevant when a significant number of objects W is included in the assessment.

Against the tool proposed by Autuori et al. (2019) in the PHUSICOS deliverable and applied by Pugliese et al. (2020), to properly assess the numerousness of KPIs belonging to each criterion and ambit, an improved version of the AFT was developed. The total score $R_i$ of the i-th scenario is thus estimated by summing up and averaging the weighted KPIs of each ambit (Equation (4)):

$$R_i = \sum_{a=1}^{p} \frac{\sum_{j=1}^{NA_a} \overline{KPI_{j,i}} \cdot w_{I,j} \cdot w_{II,j} \cdot w_{III,j}}{NA_a} \quad (4)$$

where $NA_a$ is the number of KPIs belonging to the a-th ambit, $w_{I,j}$ is the weight of the j-th KPI, $w_{II,j}$ and $w_{III,j}$ are the weights of the criterion and the ambit wherein the j-th KPI belongs to, respectively.

Owing to the multi-level weighting approach, the criterion score $R_{Ci}$ and the ambit score $R_{Ai}$ are calculated with Equations (5) and (6), respectively:

$$R_{Ci} = \frac{\sum_{j=1}^{NC_l} \overline{KPI_{j,i}} \cdot w_{I,j} \cdot w_{II,j} \cdot w_{III,j}}{NC_l} \quad (5)$$

$$R_{Ai} = \frac{\sum_{l=1}^{NCA_{l,a}} R_{Ci,l}}{NCA_{l,a}} \quad (6)$$

where $NC_l$ is the number of KPIs belonging to the l-th criterion and $NCA_{l,a}$ is the number of criteria belonging to the a-th ambit.

The hierarchic AFT can be applied to calculate the partial scores of DSs, while focusing the attention on specific ambits or criteria and thus performing the comparative analysis between alternatives of specific aspects (e.g., technical, environmental or socio-economic ambits).

# 3. CASE STUDY: THE AFT APPLICATION TO THE ISAR RIVER

## 3.1. The Isar River restoration

The Isar River is an alpine tributary of the Danube River. It sources in the Austrian Alps, flows north through southern Germany and joins after 292.3 km the Danube River in Deggendorf (Figure 2). The Isar's catchment area is 8,964.57 km² and precipitations in the Alps cause high rainfall volume and resulting floods during the summer. The Isar River has a nival regime with high discharge variability throughout the year. In Munich, discharges range between ~10 m³/s during drought periods and 1,050 m³/s during extreme flooding (www.hnd.bayern.de). Flooding of the Isar usually occurs within a few hours and recedes within a few days (Egger et al. 2019). Climate change models suggest an increase in extreme weather in the Alps. The rain volume will rise up to 25% and an increase of 12% in the 100-year return period maximum discharge of the alpine rivers is predicted (DKRZ 2017; Wagner et al. 2017). Owing to both the Isar's fast-flowing water with hydro-electrical potential and its furious and repetitive flooding patterns threatening human settlements, the river has been channellized and regulated. Hydromorphological modifications started in the late 19th century resulted in degraded morphological status of the river and related ecological and social losses. These triggered serious concerns and regrets from civil society that
<figure><img src="image_5.png" /><figcaption>**Figure 2** | Map of the Isar River restored area (courtesy of Marcelian Grace).</figcaption></figure>

demanded its restoration (Zingraff-Hamed et al. 2019). The first restoration plan was designed in 1970 but it took more than 40 years of intense efforts before the implementation of the Isar River restoration in Munich was completed. From 1970 to 1990, civil society and lobbyists demanded a near-natural river in Munich and pressured politicians with very little success at the beginning. Since 1985, they have gradually gained recognition.

The Isar restoration planning took a decisive turn with the result of hydraulic calculations investigating Munich's exposure to HQ100, indicating urgent actions to prevent damage by such flooding events (Döring & Binder 2010). All SHs were involved in a comprehensive planning process to design the 8 km-long Isar-Plan in Munich with a three-fold goal: mitigate flood risk, improve the recreational potential and provide suitable habitats for fauna and flora. It was clear that measures would not follow the conventional approach of heightening of dams and dykes for flood protection, but targeted a river ecological restoration. The implementation took 11 years (2000–2011) and the project had a cost of approximately 35 M€, funded by the State of Bavaria and the City of Munich. Reshaping the section of the river with lowered and near-natural banks allowed water-based recreation activities (Figure 3), new riparian gravel structures and typical riparian vegetation establishment, while higher water volumes could be retained compared to the former trapezoidal river morphology. The project won the first German award ‘Gewässerentwicklungspreis’ for river development (Binder 2010). The collaborative planning and especially the in-depth involvement of NGOs and the public authorities was a key success factor for the planning and implementation project. Even though the Isar River restoration is a famous ‘good practice’ to follow, until today, few investigations have assessed the overall success of this measure.
<figure><img src="image_6.png" /><figcaption>**Figure 3** | River floodplain after the urban-reach restoration. Caption of the reshaped banks of the Isar River (courtesy of Marcelian Grace).</figcaption></figure>

## 3.2. The weighting procedure through a Living Lab approach

The different groups of SHs involved in the co-creation processes of the Isar River Restoration participated in a workshop in January 2019 carry out to *ex-post* reflections on the measures designed, planned and implemented in Munich. The workshop was composed of different work blocks, e.g., ‘reflect about the Isar evolution and future’, ‘weight the goals of the Isar River restoration project’ and ‘assess project success’. Considering the weighting procedure, prior to the workshop, the list of all suggested criteria and KPIs was screened by the research team and their partners to reduce the full set to criteria relevant for the Isar case. This resulted in a selection of ten criteria distributed within the five ambits of the AFT. During the workshop, a total of 29 SHs from NGOs, public and private organizations weighted the ambits with the preselected criteria of each ambit using Likert scales from 1 to 5. The SHs had to use dot-stickers on posters fixed on a wall. Sticker colour depended on the belonging of the SH to one of the core SH groups. While the voting per sticker was anonymous, no discretion was set up and SHs were able to discuss when voting to exchange opinions and encourage the discussion.

## 3.3. AFT application to the Isar River case study

The AFT described in Section 2 was applied to the Isar River case study to carry out the *ex-post* performance assessment of the project. The effectiveness of the implemented river restoration project was evaluated in comparison with an alternative project scenario. Specifically, two alternative DSs were considered: (1) the NBS scenario, i.e., the implemented Isar River restoration project described in Section 3.1, and (2) a GS, consisting in the design of a 1.5 m-high dyke and the vegetation removal at the existing dykes, simulated as a low-cost traditional flood risk reduction measure. Data documenting the post-restoration status were collected from existing data repositories (Table 4). The data mining of baseline resulted from collection of published data documenting the status prior to restoration, with the exception of the flood protection capacity that was assumed as achieving the flood protection targets, namely, flood capacity of 1,200 m³/s. All the data were sourced from the monitoring procedure performed within the 8 km-long restored river reach.

Owing to the flexibility of the approach, the KPIs were selected depending on the site-specific characteristics. With reference to this case study of morphological restoration, the indicators should specifically address the aspects related to the hydromorphological assessment of riverine areas (González del Tánago *et al.* 2021). Thus, in the environment and ecosystems ambit, fish diversity and count, invertebrate count, sediment size, sinuosity, floodplain features and water quality
<table><caption>**Table 4** | Tailored AFT matrix for the Isar River case study</caption><thead><tr><th>Ambit</th><th>Criterion</th><th>Sub-criterion</th><th>Key performance indicator (KPI)</th><th>Unit</th><th>Sources</th></tr></thead><tbody><tr><td>Risk reduction</td><td>Hazard</td><td>Flooding risk resilience</td><td>Flood volume capacity of the riverbed</td><td>m³/s</td><td>Lang (2009)</td></tr><tr><td>Technical and feasibility aspects</td><td>Technical feasibility</td><td>Financial assessment</td><td>Initial cost</td><td>M€</td><td>Rädlinger et al. (2012) Döring & Binder (2010) and Sartori (2010)</td></tr><tr><td rowspan="2">Environment and ecosystems</td><td rowspan="2">Water</td><td rowspan="2">Water quality resilience</td><td>Water temperature</td><td>°C</td><td>Gauging site N° 16,005,701 (data available online www.gkd.bayern.de)</td></tr><tr><td>pH</td><td>pH</td><td>BNGF (2018)</td></tr><tr><td rowspan="2">Soil</td><td rowspan="2"></td><td rowspan="2">Typical soil type</td><td>River self-purification ability</td><td>Likert Scale</td><td>Zingraff-Hamed (2011)</td></tr><tr><td>Gravel bars number</td><td>#</td><td>Georeferenced aerial photos from 2000 and 2018</td></tr><tr><td rowspan="2">Vegetation</td><td rowspan="2"></td><td rowspan="2">Spatial forest continuity</td><td>Gravel bars surface</td><td>m²</td><td>Georeferenced aerial photos from 2000 and 2018</td></tr><tr><td>Successional stages</td><td>#</td><td>Georeferenced aerial photos from 2000 and 2018</td></tr><tr><td rowspan="4">Biodiversity</td><td rowspan="4"></td><td rowspan="2">Overall ecological assessment</td><td>Vegetation ecological quality</td><td>Likert scale</td><td>Zingraff-Hamed (2011)</td></tr><tr><td>Floodplain habitat diversity</td><td>Likert scale</td><td>Zingraff-Hamed (2011)</td></tr><tr><td>River ecological units</td><td>Overall ecological assessment</td><td>Likert scale</td><td>Zingraff-Hamed (2011)</td></tr><tr><td>River continuity</td><td>River ecological units</td><td>#</td><td>Zingraff-Hamed (2011)</td></tr><tr><td rowspan="10">Society</td><td rowspan="10">Quality of life</td><td rowspan="2">Leisure and connections increasing</td><td>River continuity</td><td>Likert scale</td><td>https://geoportal.bayern.de</td></tr><tr><td>Number of events</td><td>#</td><td>Web portals of Munich City and Munich Tourism, free Web search</td></tr><tr><td>New areas for recreational use</td><td>#</td><td>Georeferenced aerial photos from 2000 and 2018</td></tr><tr><td>Usability of river for recreation</td><td>Likert scale</td><td>Zingraff-Hamed (2011)</td></tr><tr><td>New pedestrian and cycling paths</td><td>m</td><td>Georeferenced aerial photos from 2000 and 2018</td></tr><tr><td rowspan="2">Social justice</td><td>Area easily accessible for people with disabilities</td><td>m²</td><td>Georeferenced aerial photos from 2000 and 2018</td></tr><tr><td>Increase rate of properties price</td><td>%</td><td>Rent indices https://2019.mietspiegel-muenchen.de</td></tr><tr><td rowspan="2">Community involvement and governance</td><td rowspan="2">Participatory process and partnership</td><td>Citizens involved</td><td>#</td><td>Zingraff-Hamed et al. (2021)</td></tr><tr><td>Public-private partnership activated</td><td>#</td><td>Zingraff-Hamed et al. (2021)</td></tr><tr><td rowspan="3">Landscape and heritage</td><td rowspan="3">Social active association</td><td>Isar cultural associations</td><td>#</td><td>Zingraff-Hamed (2011)</td></tr><tr><td>Landscape units</td><td>#</td><td>Zingraff-Hamed (2011)</td></tr><tr><td>Scenic sites</td><td>Likert scale</td><td>Zingraff-Hamed (2011)</td></tr><tr><td rowspan="4">Local economy</td><td rowspan="4">Revitalization of marginal areas</td><td rowspan="2">Economical development</td><td>Landmark created</td><td>#</td><td>Zingraff-Hamed (2011)</td></tr><tr><td>Companies creating jobs for the planning</td><td>#</td><td>Arzet & Joven (2005), Angerer et al. (2009), Schaufuß (2016) and Kiss (2018)</td></tr><tr><td rowspan="2">Touristic development</td><td>Companies creating jobs in construction and maintenance</td><td>#</td><td>City portal of Munich</td></tr><tr><td>New restaurants</td><td>#</td><td>City portal of Munich</td></tr></tbody></table>
were considered as relevant KPIs. Analogously, in the society ambit, the social acceptability, the political obstacles and the human recreation were included as KPIs. Moreover, further environmental aspects, such as the pollution from excavation machinery, mining riprap and transportation of materials to the site should be included in the assessment. Overall, considering the data availability limitations and the negligible variation of some indicators at the two considered DSs, a final matrix of 28 KPIs, as reported in Table 4, was considered in the assessment. The selected KPIs belonging to all the five ambits of the matrix, were identified and distributed between ten criteria and 15 sub-criteria. The sixth column of Table 4 reports the data source of the corresponding indicator.

As defined in Section 3.2, through a Living Lab approach, three different SH groups, namely, NGOs, public and private organizations, gave a rate from 1 to 5 to each ambit and criterion, according to the Likert (Likert 1932) scale, whereas the uniform criterion was applied to weight the KPIs. A fourth neutral SH group was included, whose weights were set equal to the overall average of all the SHs' weights.

## 4. RESULTS AND DISCUSSION

Tables 5 and 6 summarize the average weights of ambits and criteria, respectively.

The KPIs and the corresponding normalized values were estimated for the NBS and the GS, as reported in Table 7.

Equations (4)–(6) were applied to calculate the scenario, ambit and criterion scoring, respectively. Results of the ambit comparison are given in Table 8 and Figure 4.

For the NBS scenario, the NGO was the only SH group returning a greater score for the technical and feasibility aspects ambit, given the high weight provided to this category. The public, the private and the neutral SHs earned the highest score with the society ambit, instead. The risk reduction ambit earned the lowest value with all the SH groups, given the lower volume capability of the riverbed to convey the discharge, of about three times lower than that of the GS.

For the GS, both the environmental and ecosystems, and the society ambits earned negative scores, given the increase of temperature and the reduction of usability of the river for restoration, respectively, provoked by the simulated intervention. The technical and feasibility aspects ambit exhibited the highest value with all the SH groups, because of the initial

<table><caption>**Table 5** | Results of ambits' weighting procedure for the Isar River case study</caption><thead><tr><th>Ambit</th><th>NGO</th><th>Public O</th><th>Private O</th><th>Neutral</th></tr></thead><tbody><tr><td>Risk reduction</td><td>4.3</td><td>4.2</td><td>4.0</td><td>4.2</td></tr><tr><td>Technical and feasibility aspects</td><td>4.2</td><td>3.9</td><td>4.3</td><td>4.1</td></tr><tr><td>Environment and ecosystems</td><td>4.5</td><td>4.4</td><td>5.0</td><td>4.4</td></tr><tr><td>Society</td><td>4.7</td><td>4.4</td><td>5.0</td><td>4.6</td></tr><tr><td>Local economy</td><td>2.0</td><td>2.2</td><td>2.7</td><td>2.2</td></tr></tbody></table>

<table><caption>**Table 6** | Results of criteria weighting procedure for the Isar River case study</caption><thead><tr><th>Criterion</th><th>NGO</th><th>Public O</th><th>Private O</th><th>Neutral</th></tr></thead><tbody><tr><td>Hazard</td><td>3.5</td><td>4.0</td><td>4.0</td><td>3.8</td></tr><tr><td>Technical feasibility</td><td>4.0</td><td>3.0</td><td>4.0</td><td>3.6</td></tr><tr><td>Water</td><td>3.7</td><td>4.2</td><td>4.3</td><td>4.1</td></tr><tr><td>Soil</td><td>3.7</td><td>4.2</td><td>4.3</td><td>4.1</td></tr><tr><td>Vegetation</td><td>3.7</td><td>4.1</td><td>4.0</td><td>3.9</td></tr><tr><td>Biodiversity</td><td>3.8</td><td>4.5</td><td>4.3</td><td>4.2</td></tr><tr><td>Quality of life</td><td>4.5</td><td>4.4</td><td>5.0</td><td>4.6</td></tr><tr><td>Community involvement and governance</td><td>4.2</td><td>3.7</td><td>4.0</td><td>4.0</td></tr><tr><td>Landscape and heritage</td><td>2.7</td><td>2.8</td><td>3.7</td><td>3.0</td></tr><tr><td>Revitalization of marginal areas</td><td>1.2</td><td>1.6</td><td>2.0</td><td>1.5</td></tr></tbody></table>
<table><caption>**Table 7** | KPIs estimation at the baseline, NBS and GS for the Isar River case study</caption><thead><tr><th rowspan="2">Ambit</th><th rowspan="2">KPI</th><th rowspan="2">Metric</th><th colspan="4">KPI</th><th colspan="2">Normalized KPI</th></tr><tr><th>Baseline S</th><th>NBS DS</th><th>GS</th><th>Max/Min</th><th>NBS DS</th><th>GS</th></tr></thead><tbody><tr><td>Risk reduction</td><td>Flood volume capacity of the riverbed</td><td>[m³/s]</td><td>900</td><td>1,200</td><td>1,800</td><td>6,000</td><td>5.88</td><td>17.65</td></tr><tr><td rowspan="10">Technical and feasibility aspects<br>Environment and ecosystems</td><td>Initial cost</td><td>[M€]</td><td>0</td><td>35</td><td>12</td><td>40</td><td>87.5</td><td>30</td></tr><tr><td>Water temperature</td><td>[°C]</td><td>9.5</td><td>11</td><td>11</td><td>7.5</td><td>-75</td><td>-75</td></tr><tr><td>pH</td><td>[-]</td><td>7.95</td><td>7.95</td><td>7.95</td><td>8.5</td><td>0</td><td>0</td></tr><tr><td>River self-purification ability</td><td>[1÷5]</td><td>4.3</td><td>2.3</td><td>4.3</td><td>1</td><td>60.61</td><td>0</td></tr><tr><td>Gravel bars number</td><td>[-]</td><td>16</td><td>55</td><td>16</td><td>100</td><td>46.43</td><td>0</td></tr><tr><td>Gravel bars surface</td><td>[m²]</td><td>64,927</td><td>127,451</td><td>64,927</td><td>200,000</td><td>46.29</td><td>0</td></tr><tr><td>Successional stages</td><td>[-]</td><td>2</td><td>6</td><td>2</td><td>6</td><td>100</td><td>0</td></tr><tr><td>Vegetation ecological quality</td><td>[1÷5]</td><td>4.4</td><td>3.6</td><td>4.4</td><td>1</td><td>23.53</td><td>0</td></tr><tr><td>Floodplain habitat diversity</td><td>[1÷5]</td><td>2.8</td><td>2.3</td><td>2.8</td><td>1</td><td>27.78</td><td>0</td></tr><tr><td>Overall ecological assessment</td><td>[1÷5]</td><td>4.6</td><td>4.2</td><td>4.6</td><td>1</td><td>11.11</td><td>0</td></tr><tr><td rowspan="7">Society</td><td>River ecological units</td><td>[-]</td><td>2</td><td>6</td><td>2</td><td>6</td><td>100</td><td>0</td></tr><tr><td>River continuity</td><td>[1÷7]</td><td>5.8</td><td>1.8</td><td>5.8</td><td>1</td><td>83.33</td><td>0</td></tr><tr><td>Number of events</td><td>[-]</td><td>0</td><td>1</td><td>0</td><td>1</td><td>100</td><td>0</td></tr><tr><td>New areas for recreational use</td><td>[-]</td><td>0</td><td>7</td><td>0</td><td>7</td><td>100</td><td>0</td></tr><tr><td>Usability of river for recreation</td><td>[1÷5]</td><td>4</td><td>2.6</td><td>4.2</td><td>1</td><td>46.67</td><td>-6.67</td></tr><tr><td>New pedestrian and cycling path</td><td>[m]</td><td>10,030</td><td>25,422</td><td>10,030</td><td>30,000</td><td>77.07</td><td>0</td></tr><tr><td>Area easily accessible for people with disabilities</td><td>[m²]</td><td>4,650</td><td>23,501</td><td>4,650</td><td>30,000</td><td>74.36</td><td>0</td></tr><tr><td rowspan="10">Local economy</td><td>Rate of increase in properties price</td><td>[%]</td><td>0</td><td>7</td><td>0</td><td>7</td><td>100</td><td>0</td></tr><tr><td>Citizen involved</td><td>[-]</td><td>0</td><td>10,000</td><td>0</td><td>1,464,000</td><td>0.68</td><td>0</td></tr><tr><td>Public-private partnership activated</td><td>[-]</td><td>0</td><td>3</td><td>0</td><td>3</td><td>100</td><td>0</td></tr><tr><td>Isar cultural associations</td><td>[-]</td><td>1</td><td>3</td><td>1</td><td>3</td><td>100</td><td>0</td></tr><tr><td>Landscape units</td><td>[-]</td><td>3</td><td>5</td><td>3</td><td>5</td><td>100</td><td>0</td></tr><tr><td>Scenic sites</td><td>[1÷5]</td><td>4</td><td>2.1</td><td>4</td><td>1</td><td>63.33</td><td>0</td></tr><tr><td>Landmark created</td><td>[-]</td><td>0</td><td>1</td><td>0</td><td>1</td><td>100</td><td>0</td></tr><tr><td>Companies creating jobs for the planning</td><td>[-]</td><td>0</td><td>2</td><td>1</td><td>2</td><td>100</td><td>50</td></tr><tr><td>Companies creating jobs in construction and maintenance</td><td>[-]</td><td>0</td><td>2</td><td>1</td><td>2</td><td>100</td><td>50</td></tr><tr><td>Restaurants</td><td>[-]</td><td>10</td><td>10</td><td>10</td><td>100</td><td>0</td><td>0</td></tr></tbody></table>

<table><caption>**Table 8** | Ambits' scores of the NBS and GS for the Isar River case study</caption><thead><tr><th rowspan="2">Ambit</th><th rowspan="2">KPIs per ambit</th><th colspan="4">NBS DS</th><th colspan="4">GS</th></tr><tr><th>NGO</th><th>Public O</th><th>Private O</th><th>Neutral</th><th>NGO</th><th>Public O</th><th>Private O</th><th>Neutral</th></tr></thead><tbody><tr><td>Risk reduction</td><td>1</td><td>0.091</td><td>0.097</td><td>0.085</td><td>0.093</td><td>0.274</td><td>0.292</td><td>0.254</td><td>0.279</td></tr><tr><td>Technical and feasibility aspects</td><td>1</td><td>1.494</td><td>1.002</td><td>1.366</td><td>1.237</td><td>0.512</td><td>0.343</td><td>0.468</td><td>0.424</td></tr><tr><td>Environment and ecosystems</td><td>11</td><td>0.665</td><td>0.721</td><td>0.731</td><td>0.682</td><td>-0.115</td><td>-0.125</td><td>-0.133</td><td>-0.120</td></tr><tr><td>Society</td><td>12</td><td>1.446</td><td>1.285</td><td>1.585</td><td>1.396</td><td>-0.012</td><td>-0.011</td><td>-0.013</td><td>-0.011</td></tr><tr><td>Local economy</td><td>3</td><td>0.164</td><td>0.230</td><td>0.320</td><td>0.220</td><td>0.082</td><td>0.115</td><td>0.160</td><td>0.110</td></tr><tr><td>Total</td><td>28</td><td>3.860</td><td>3.335</td><td>4.087</td><td>3.628</td><td>0.741</td><td>0.615</td><td>0.737</td><td>0.682</td></tr></tbody></table>
<figure><img src="image_7.png" /></figure>

<figure><img src="image_8.png" /></figure>

<figure><img src="image_9.png" /></figure>

<figure><img src="image_10.png" /><figcaption>**Figure 4** | Ambits' comparison between NBS and GS for the Isar River case study.</figcaption></figure>

investment costs, resulting in being about three times lower than that of the NBS scenario. This ambit reached a score higher than the private organizations with the NGO stakeholders, given the greater relative weight.

Table 9 and Figure 5 show the criteria comparison between the two DSs. Notwithstanding the higher value of hazard score achieved by the GS, the NBS solution returned significantly greater scores with the remaining criteria, given the effectiveness of this solution in fostering the environmental and socio-economic co-benefits. Indeed, although the hazard score was three times lower, the benefits in terms of soil, vegetation and biodiversity were negligible for the grey solution. Moreover, the increase of a new area for recreational use, new pedestrian and cycling path, area easily accessible for people with disabilities and the increased rate of property values balanced the lower usability of the river for recreation. Concerning the revitalization of marginal areas criterion, the NBS solution doubled the benefits related to the implementation of the GS.

The comparison of the overall scenario scoring between the NBS and GS is plotted in Figure 6.

The NBS reached an overall scenario scoring significantly higher than the grey solution with all the considered SHs, resulting in being five times greater when considering each SH group. For all SHs, the NBS scenario racked up a total scenario scoring higher than the GS. It varied from 3.33 to 4.09, against the range between 0.61 and 0.74 of the grey solution (Figure 6). Indeed, given the relevant environmental and socio-economic co-benefits, despite the lower score of the risk reduction ambit, the NBS scenario was preferable in comparison with the GS. This result is interesting because it shows that GSs are perceived as having a higher risk mitigation capacity than NBS. However, as a matter of fact, the NBS and the GS have similar performance considering risk mitigation potential (Gerwien 2020).

It is worth noting that the comparison between the two DSs led to similar results with varying the SH group. The higher score was observed with the private organizations, given the higher weights provided to the environmental and ecosystems, society and local economy ambits. The discrepancies in scoring between SHs is due to the differences between both ambits and criteria scoring. Indeed, the private SHs gave a low ranking to the risk reduction aspects, whereas results between NGO and public SHs are comparable. This matches with studies in the literature showing that the non-public sector and, namely, civil society, is inclined to underestimate the flood risk more than NGO and public authorities (Baan & Klijn 2004). Conversely, they significantly take into consideration the effects on ecological and social co-benefits. Indeed, NBSs are more
<table><caption>**Table 9** | Criteria scores of the NBS and GS for the Isar River case study</caption><thead><tr><th rowspan="2">Criterion</th><th rowspan="2">KPIs per criterion</th><th colspan="4">NBS DS</th><th colspan="4">GS</th></tr><tr><th>NGO</th><th>Public O</th><th>Private O</th><th>Neutral</th><th>NGO</th><th>Public O</th><th>Private O</th><th>Neutral</th></tr></thead><tbody><tr><td>Hazard</td><td>1</td><td>0.091</td><td>0.097</td><td>0.085</td><td>0.093</td><td>0.274</td><td>0.292</td><td>0.254</td><td>0.279</td></tr><tr><td>Technical feasibility</td><td>1</td><td>1.494</td><td>1.002</td><td>1.366</td><td>1.237</td><td>0.512</td><td>0.343</td><td>0.468</td><td>0.424</td></tr><tr><td>Water</td><td>3</td><td>-0.081</td><td>-0.088</td><td>-0.094</td><td>-0.084</td><td>-0.423</td><td>-0.457</td><td>-0.488</td><td>-0.439</td></tr><tr><td>Soil</td><td>2</td><td>0.784</td><td>0.847</td><td>0.904</td><td>0.814</td><td>0.000</td><td>0.000</td><td>0.000</td><td>0.000</td></tr><tr><td>Vegetation</td><td>3</td><td>0.852</td><td>0.899</td><td>0.908</td><td>0.863</td><td>0.000</td><td>0.000</td><td>0.000</td><td>0.000</td></tr><tr><td>Biodiversity</td><td>3</td><td>1.145</td><td>1.268</td><td>1.264</td><td>1.179</td><td>0.000</td><td>0.000</td><td>0.000</td><td>0.000</td></tr><tr><td>Quality of life</td><td>6</td><td>1.786</td><td>1.573</td><td>1.869</td><td>1.694</td><td>-0.024</td><td>-0.021</td><td>-0.025</td><td>-0.023</td></tr><tr><td>Community involvement and governance</td><td>2</td><td>1.003</td><td>0.802</td><td>0.907</td><td>0.892</td><td>0.000</td><td>0.000</td><td>0.000</td><td>0.000</td></tr><tr><td>Landscape and heritage</td><td>4</td><td>1.158</td><td>1.095</td><td>1.499</td><td>1.202</td><td>0.000</td><td>0.000</td><td>0.000</td><td>0.000</td></tr><tr><td>Revitalization of marginal areas</td><td>3</td><td>0.164</td><td>0.230</td><td>0.320</td><td>0.220</td><td>0.082</td><td>0.115</td><td>0.160</td><td>0.110</td></tr><tr><td>Total</td><td>28</td><td>8.395</td><td>7.725</td><td>9.028</td><td>8.109</td><td>0.422</td><td>0.272</td><td>0.370</td><td>0.351</td></tr></tbody></table>

<figure><img src="image_11.png" /></figure>

<figure><img src="image_12.png" /><figcaption>**Figure 5** | Criteria comparison between (a) NBS and (b) GS for the Isar River case study.</figcaption></figure>

perceived as supporting biodiversity and wildlife, by assuring better air quality and climate regulation (Ferreira et al. 2020). Moreover, they are intended as limiting social inequalities more than traditional grey solutions, given the ability to promote recreational activities, sociocultural initiatives and quality of life (Conedera et al. 2015).

The local economy had no primary importance for all the categories of investigated SHs, instead, both the new job opportunities and the economic activities were perceived to be less evidently related to the application of a NBS approach. This is presumably due to the different time span and the order of magnitude having economic benefits, compared with those of the environmental and social effects.

Concerning the GS, the results of different SHs were comparable, given the few improvements that it showed on the local economy and the detrimental effects on the environment and the society co-benefits. This may be corroborated by the awareness knowledge of the effects of grey solutions in the long run, given the great amount of long-term implemented case studies. Indeed, against traditional grey applications, the NBSs can be intended as a relatively novel approach, making the assessment of their effectiveness mainly due to SH perception, rather than to strengthened lessons learned. As observed by further studies (Goeldner-Gianella et al. 2015; Potočki et al. 2021), when high perceived risks occur, the lack of evidence, novelty and complexity of NBS tend to favour traditional grey approaches for risk reduction.
<figure><img src="image_13.png" /><figcaption>**Figure 6** | NBS and GS scoring for the Isar River case study.</figcaption></figure>

The AFT application to the Isar River case study showed some limitations of the implemented approach. The dependency on the data availability for the assessment of both the baseline and the DSs was remarked. The data extension allows estimation of more KPIs belonging to the different criteria, aimed at limiting the susceptibility of the assessment by the numerousness of considered indicators. The limitation of available data at both the NBS and the design ones forced the neglect of some KPIs which could result in being relevant for the assessment. In this case study, specific indicators of the environmental and socio-economic properties of the site (e.g., fish diversity and number, water, quality, political obstacles, pollution from excavation machinery) were thus not included. The criteria to select the KPIs from the overall matrix should properly account for the robustness of the available datasets and the specificity of the investigated site. Indeed, the KPIs can be tailored as a function of both the occurring hazards and the environmental and socio-economic features of the site. Nevertheless, the effectiveness of the assessment needs specific evaluation on the biases arising from the input data of the model.

Moreover, results were shown to be slightly sensitive by the SH weighting. The interaction between SHs during the Living Lab session, open to exchange opinions and stimulate discussion, positively affected the familiarity of participants with the nomenclature and the meaning of ambits and criteria to be voted upon. Their different backgrounds and skills would not allow them to correctly understand all indicators, justifying the choice to apply the uniform weighting to the KPI level.

However, to limit the biases between scorings, the involvement of wider SH groups may improve the robustness of the weighting outcomes. In addition, as observed in previous studies (Giordano et al. 2020), coupling the Living Lab experience with effective territory control, through the implementation of complementary socio-institutional actions, could improve the SHs' awareness limiting the different perceptions of heterogeneous SH groups.

## 5. SUMMARY AND CONCLUSIONS

NBSs are increasingly considered as competitive alternatives for managing natural risks in urban, rural and mountainous areas, given their potential to reduce risk while providing socio-economic and environmental co-benefits. The performance assessment of NBSs still represents a critical step towards their spreading. In the frame of the H2020 PHUSICOS project, an AFT was developed to quantitatively assess the effectiveness of NBSs, hybrid and GSs via a comprehensive multi-criteria approach.

In this paper, the results of one of the first studies in the literature focused on the quantitative estimation of the effectiveness of Isar River restoration are provided, by analysing the strength/weak points of this measure through a multi-disciplinary comprehensive approach. This case study is the first application of the PHUSICOS AFT to an *ex-post* analysis, providing a deeper insight into the framework reliability at the monitoring stage of designed NBS measures. The results were illustrated and
discussed, with a specific focus on the inclusion of SHs into the evaluation process. The tool was tailored based on the avail-
able data and the site-specific hazards. In greater detail, the preferences of three different SH categories, coupled with a fourth
neutral SH category, were surveyed through a Living Lab approach and the results were integrated within the weighting pro-
cedure. For the *ex-post* performance assessment, two DSs, a NBS and a grey one, were compared, by estimating 28 KPIs,
belonging to all the ambits of the PHUSICOS AFT.

Comparable results were observed between the different SH groups, resulting in the NBS scenario being the most advisable
solution with an overall score of about three times higher, regardless of the SHs' weighting. Specifically, the NGO stakeholder
category achieved a total score of 3.86 at the NBS DS against 0.74 at the grey one. The public organizations returned an NBS
score of 3.34 against 0.61 of the GS, whereas the public SHs totalled 4.09 versus 0.74. The differences in SH scores for the
NBS scenario were mainly due to the relevant weights given by these categories to both the environment and ecosystems and
the local economy ambits. Thus, the higher score provided by the private SH group, the greater score achieved by this
category.

Nevertheless, despite the lower benefits in terms of risk reduction capability, the NBS approach attained the highest scores
with the environmental and societal ambits. The GS provided only higher technical benefits, reaching ambit scores of about
three times higher than the NBS ones with all the SH categories, as a consequence of the greater volume capacity of the riv-
erbed against the flooding events than the prior solution. An increase of water capacity of 100% was indeed estimated for the
GS, against 33% of the NBS one. Conversely, the NBS selection was mainly sustained by the higher relevance provided to the
quality of life, environment and ecosystem, landscape and heritage improvement criteria in addition to the flood protection,
showing that the NBS approach was the best trade-off between the technical outcomes and the environmental and socio-
economic ones. Even if scores of all the SHs' categories empathized the inclination to select the NBS scenario, biases
between SHs' results were observed, given the variable weighting of the different framework categories.

This is, on one hand, a limitation of the proposed approach due to not providing a univocal solution for decision-makers.
On the other hand, it can represent a strength of the method because it allows a quantitative viewpoint to be obtained from
different social categories, providing guidance on indicator selection, SHs' management and performance estimation. This
application is thus expected to aid professionals and researchers involved in the design, implementation, monitoring and
evaluation of NBSs. The involvement of a wider set of SHs could allow the robustness of the procedure to be assessed, against
the SH weighting, limiting the biases observed in this study. As a preliminary swift assessment, considering the neutral SH
category, obtained by averaging the weights of the SHs can be intended as an effective solution for prompt decision-
making. Indeed, in this work, the simulated neutral SH gave sight of a good trade-off, by handling the diversity in perception
of the different surveyed SH groups. It can be thus considered for the final evaluation, providing the comprehensive result of
the AFT, including the SHs' weighting.

A further limitation of the approach concerns the KPI selection and estimation. The consistency of the observed results
can be surely improved by including more KPIs in the assessment. However, the availability of data to estimate the KPIs
at both the NBS and the designed ones can enhance further modelling activities to limit the gap between different percep-
tions. On the other side, given the relevant flexibility of the framework, the selection of the KPIs can be properly
customized as a function of the site specificity and the data availability.

The framework application to the Isar River case study was useful to assess the framework effectiveness for an *ex-post*
analysis, providing relevant support to further approaches available in the literature. Indeed, the tool is able to couple a sys-
tematic quantitative multi-criteria analysis with the flexibility of including the perception of different SH categories. One of
the most relevant peculiarities of the framework is being devoted to mountainous and rural areas, presenting specific environ-
mental and socio-economic features.

Finally, given the multi-criteria approach, the AFT does not make easier inter-temporal comparisons. To distinguish the
impacts during the project construction from those at the operational stage, a discounting analytic technique may thus be
accounted by comparing benefits and costs occurring in different time spans. In addition, several causal interactions and
the environmental and socio-economic co-benefits may be analysed with different time scales, providing the robust inclusion
of the temporal dimension, aimed at properly analysing the processes, related to the NBS effectiveness, evolving over time.

In the next steps of the research, further improvements will thus focus on the analysis of the different time scales charac-
terizing the AFT indicators.
## ACKNOWLEDGEMENTS

The authors would like to thank Prof. M. Giugni, Prof. G. Urciuoli, Prof. M. Stanganelli, Prof. Stephan Pauleit, Prof. F. De Paola, Prof. P. Budetta, Prof. A. Corniello, Dr Silvia Autuori, the PHUSICOS project coordinator A. Oen and all the partners of the PHUSICOS consortium for their support in the development of this study. The authors would like to express sincere appreciation to all who contributed time, experience, and knowledge to support the development of this contribution and especially Marcelian Grace for providing illustrations. The authors especially wish to thank the local stakeholders that invested time in participating in weighting procedure.

## CONFLICTS OF INTEREST

The authors declare no conflict of interest.

## FUNDING

This research was funded by the H2020 Innovation Action ‘PHUSICOS – According to Nature’ (Grant Agreement No. 776681).

## DATA AVAILABILITY STATEMENT

All relevant data are included in the paper or its Supplementary Information.

## REFERENCES

Aitsi-Selmi, A., Egawa, S., Sasaki, H., Wannous, C. & Murray, V. 2015 The Sendai Framework for Disaster Risk Reduction: renewing the global commitment to people's resilience, health, and well-being. *Int. J. Disaster Risk Sci.* **6**, 164–176. https://doi.org/10.1007/s13753-015-0050-9.

Albert, C., Brillinger, M., Guerrero, P., Gottwald, S., Henze, J., Schmidt, S., Ott, E. & Schröter, B. 2020 Planning nature-based solutions: principles, steps, and insights. *Ambio* **50**, 1446–1461. https://doi.org/10.1007/S13280-020-01365-1.

Andrés, P., Doblas-Miranda, E., Mattana, S., Molowny-Horas, R., Vayreda, J., Guardiola, M., Pino, J. & Gordillo, J. 2021 A battery of soil and plant indicators of NBS environmental performance in the context of global change. *Sustainability* **13**, 1913. https://doi.org/10.3390/SU13041913.

Angerer, J., Henseli, M., Schnabel, S., Schmid, M. & Stoffner, F. 2009 Assessment of the Isar plan. S. Kirner (ed.), Plan&Project GmbH, Munich, Germany, pp. 81.

Arzet, K. & Joven, S. 2005 The Isar Experience – Urban River Restoration in Munich. Available from: https://www.wwa-m.bayern.de/fluesse_seen/massnahmen/isarplan/doc/the_isarexperience.pdf.

Autuori, S., Caroppi, G., De Paola, F., Giugni, M., Pugliese, F., Stanganelli, M. & Urciuoli, G. 2019 Deliverable D4.1 Comprehensive Framework for NBS Assessment. Available from: https://phusicos.eu/wp-content/uploads/2019/05/D4.1_Task4.1_UNINA_14052019_Final_withAppendicies.pdf.

Baan, P. J. A. & Klijn, F. 2004 Flood risk perception and implications for flood risk management in the Netherlands. *Int. J. River Basin Manag.* **2**, 113–122. https://doi.org/10.1080/15715124.2004.9635226.

Baills, A., Garcin, M. & Bernardie, S. 2021 Platform dedicated to nature-based solutions for risk reduction and environmental issues in hilly and mountainous lands. *Sustainability* **13**, 1094.

Bhatt, I. D., Negi, V. S. & Rawal, R. S. 2020 Promoting nature-based solution (NbS) through restoration of degraded landscapes in the Indian Himalayan Region. In: *Nature-based Solutions for Resilient Ecosystems and Societies, Disaster Resilience and Green Growth* (Dhyani, S., Gupta, A. & Karki, M., eds). Springer, Singapore, pp. 197–211. Available from: https://doi.org/10.1007/978-981-15-4712-6_12.

Binder, W. 2010 The restoration of the Isar south of Munich. *Wasserwirtschaft* **100**, 15–19.

BNGF 2018 Aquatic ecology expertise report on applying for the re-awarding of the water permit for the discharge of cooling and wastewater in the Isar (in German). Available from: SSRN: https://www.landkreis-muenchen.de/fileadmin/files/news/Wasserrechtliche_Verfahren_2/G7_Gewaesseroekologisches_Gutachten_zur_Einleitung_von_Kuehl-_und_Abwasser_in_die_Isar.pdf.

Boyle, A. & Kuhl, L. 2021 Nature-based Solutions are Job and Livelihood Solutions. *Nature-based Solution Policy Briefs*. Available from: SSRN: https://ssrn.com/abstract=3843420.

Calliari, A., Staccione, A. & Mysiak, J. 2019 An assessment framework for climate-proof nature-based solutions. *Sci. Total Environ.* **656**, 691–700. https://doi.org/10.1016/j.scitotenv.2018.11.341.

Carter, N. T. & Lipiec, E. 2020 Flood Risk Reduction From Natural and Nature-Based Features: Army Corps of Engineers Authorities. Congressional Research Service, Washington, DC, USA.

Conedera, M., Del Biaggio, A., Seeland, K., Moretti, M. & Home, R. 2015 Residents' preferences and use of urban and peri-urban Green spaces in a Swiss mountainous region of the Southern Alps. *Urban For. Urban Green.* **14**, 139–147. https://doi.org/10.1016/j.ufug.2015.01.003.
Debele, S. E., Kumar, P., Sahani, J., Marti-Cardona, B., Mickovski, S. B., Leo, L. S., Porcù, F., Bertini, F., Montesi, D., Vojinovic, Z. & Di Sabatino, S. 2019 *Nature-based solutions for hydro-meteorological hazards: revised concepts, classification schemes and databases*. *Environ. Res.* **179**, 108799. https://doi.org/10.1016/J.ENVRES.2019.108799.

De Paola, F., Giugni, M. & Pugliese, F. 2018a *A harmony-based calibration tool for urban drainage systems*. *Proc. Inst. Civ. Eng. Water Manag.* **171**, 30–41. https://doi.org/10.1680/jwama.16.00057.

De Paola, F., Giugni, M., Pugliese, F. & Romano, P. 2018b *Optimal design of LIDs in urban stormwater systems using a harmony-search decision support system*. *Water Resour. Manag.* **32**, 4933–4951. https://doi.org/10.1007/s11269-018-2064-8.

DKRZ 2017 Simulations for the international climate model comparison project CMIP5 and for the fifth climate assessment report of the United Nations (IPCC AR5) (in German). Available from: SSRN: https://www.dkrz.de/de/kommunikation/klimasimulationen/de-cmip5-ipcc-ar5.

Döring, N. & Binder, W. 2010 In: *The new Isar Renaturation, Cultural Opening and the Flow of Ideas, Both Historical and Literary* (Satori, R., ed.). Buch & Media, Munich, Germany. ISBN: 978-3-86520-381-6, 191 p.

Dumitru, A., Wendling, L., Palomo, L., Wandewojestije, S., Caroppi, G., Gerundo, C., Giugni, M., Capobianco, V., Nadim, F., Pugliese, F. & Oen, A. 2021 *Evaluating the Impacts of Nature-Based Solutions. A Handbook for Practitioners*. European Commission, Luxembourg.

Edwards, B., Gray, M. & Borja, J. B. 2021 *Measuring natural hazard-related disasters through self-reports*. *Int. J. Disaster Risk Sci.* **12**, 540–552. https://doi.org/10.1007/S13753-021-00359-1.

Egger, G., Graber, L., Reich, M., Komposch, C., Dister, E., Schneider, E. & Muller, N. 2019 Ecosystem Alpine river – permanent change. In: *Rivers of the Alps – Diversity in Nature and Culture* (Muhar, S., Muhar, A., Egger, G. & Siegrist, D., eds). Haupt, Bern, Germany. ISBN: 978-3-258-08117-5, 511.

EKLIPSE. 2017 *An Impact Evaluation Framework to Support Planning and Evaluation of Nature-Based Solutions Projects*. EKLIPSE Expert Working Group, Centre for Ecology and Hydrology, Wallingford, UK.

European Commission (EU) 2016 Communication from the Commission to the European Parliament, the Council, the European Economic and Social Committee and the Committee of The Regions Next Steps for a Sustainable European future – European Action for Sustainability. COM/2016/0739.

Faivre, N., Sgobbi, A., Happaerts, S., Raynal, J. & Schmidt, L. 2018 *Translating the Sendai Framework into action: the EU approach to ecosystem-based disaster risk reduction*. *Int. J. Disaster Risk Reduct.* **32**, 4–10. https://doi.org/10.1016/j.ijdrr.2017.12.015.

Feldmeyer, D., Nowak, W., Jamshed, A. & Birkmann, J. 2021 *An open resilience index: crowdsourced indicators empirically developed from natural hazard and climatic event data*. *Sci. Total Environ.* **774**, 145734. https://doi.org/10.1016/J.SCITOTENV.2021.145734.

Ferreira, V., Barreira, A. P., Loures, L., Antunes, D. & Panagopoulos, T. 2020 *Stakeholders’ engagement on nature-based solutions: a systematic literature review*. *Sustainability* **12**, 640.

Figurek, A. 2021 *Socio-Economical Aspects of NBS*. 1–16. https://doi.org/10.1007/698_2021_764.

Fohlmeister, S., Augenstein, I., Jones, C., Ramirez, D. & Lupp, G. 2017a *Starter Toolbox for Stakeholder Knowledge Mapping to Co-Design Nature-Based Solutions at Case Study Sites*. Deliverable D 3.2. PHUSICOS, H2020 Grant Agreem No 776681.

Fohlmeister, S., Zingraff-Hamed, A., Lupp, G. & Pauleit, S. 2017b *Guiding Framework for Tailored Living Lab Establishment at Concept and Demonstrator Case Study Sites*. Deliverable 3.1. PHUSICOS, H2020 Grant Agreem No 776681. https://doi.org/10.1163/9789004397354_006.

Frantzeskaki, N., McPhearson, T., Collier, M. J., Kendal, D., Bulkeley, H., Dumitru, A., Walsh, C., Noble, K., Van Wyk, E., Ordóñez, C., Oke, C. & Pintér, L. 2019 *Nature-based solutions for urban climate change adaptation: linking science, policy, and practice communities for evidence-based decision-making*. *Bioscience* **69**, 455–466. https://doi.org/10.1093/biosci/biz042.

Gerwien, V. 2020 *Ex-post Evaluation of Urban River Restoration: the Case of the Isarplan in Munich*. TUM School of Life Science, Freising, Germany.

Giordano, R., Pluchinotta, I., Pagano, A., Scrieciu, A. & Nanu, F. 2020 *Enhancing nature-based solutions acceptance through stakeholders’ engagement in co-benefits identification and trade-offs analysis*. *Sci. Total Environ.* **713**, 136552. https://doi.org/10.1016/j.scitotenv.2020.136552.

Goeldner-Gianella, L., Bertrand, F., Oiry, A. & Grancher, D. 2015 *Depolderisation policy against coastal flooding and social acceptability on the French Atlantic coast: the case of the Arcachon Bay*. *Ocean Coast Manag.* **116**, 98–107. https://doi.org/10.1016/j.ocecoaman.2015.07.001.

González del Tánago, M., Martínez-Fernández, V., Aguiar, F. C., Bertoldi, W., Dufour, S., García de Jalón, D., Garófano-Gómez, V., Mandzukovski, D. & Rodríguez-González, P. M. 2021 *Improving river hydromorphological assessment through better integration of riparian vegetation: scientific evidence and guidelines*. *J. Environ. Manag.* **292**, 112730. https://doi.org/10.1016/J.JENVMAN.2021.112730.

Haritashya, U. K., Singh, P., Kumar, N. & Singh, Y. 2006 *Hydrological importance of an unusual hazard in a mountainous basin: flood and landslide*. *Hydrol. Process.* **20**, 3147–3154. https://doi.org/10.1002/hyp.6397.

Ingold, K., Balsiger, J. & Hirschi, C. 2010 *Climate change in mountain regions: how local communities adapt to extreme events*. *Local Environ.* **15**, 651–661. https://doi.org/10.1080/13549839.2010.498811.

Interior, U. S. D. 2013 *Principles and Requirements for Federal Investments in Water Resources*. U.S. Department of the Interior Publishing, Washington DC. Available from: SSRN: https://www.doi.gov/sites/doi.gov/files/uploads/principles_and_requirements_march_2013.pdf.
Ishizaka, A. & Nemery, P. 2013 *Multi-Criteria Decision Analysis: Methods and Software*. John Wiley and Sons Ltd, Chichester, UK.

Keiler, M. & Fuchs, S. 2018 *Challenges for Natural Hazard and Risk Management in Mountain Regions of Europe*. Oxford University Press, Oxford, UK. https://doi.org/10.1093/ACREFORE/9780199389407.013.322.

King, J., Holmes, R., Burkholder, S., Holzman, J. & Suedel, B. 2021 *Advancing nature-based solutions by leveraging Engineering with Nature® strategies and landscape architectural practices in highly collaborative settings*. *Integr. Environ. Assess. Manag.* **00**, 1–7. https://doi.org/10.1002/IEAM.4473.

Kiss, B. 2018 *Snapshot – Munich: The restoration of the Isar river*. **4**. Retrieved from: https://naturvation.eu/sites/default/files/munich_snapshot.pdf.

Kou, G., Ergu, D., Lin, C. & Chen, Y. 2016 *Pairwise comparison matrix in multiple criteria decision making*. *Technol. Econ. Dev. Econ.* **22**, 738–765.

Kumar, P., Debele, S. E., Sahani, J., Aragão, L., Barisani, F., Basu, B., Bucchignani, E., Charizopoulos, N., Di Sabatino, S., Domeneghetti, A., Edo, A. S., Finér, L., Gallotti, G., Juch, S., Leo, L. S., Loupis, M., Mickovski, S. B., Panga, D., Pavlova, I., Pilla, F., Prats, A. L., Renaud, F. G., Rutzinger, M., Basu, A. S., Shah, M. A. R., Soini, K., Stefanopoulou, M., Toth, E., Ukonmaanaho, L., Vranic, S. & Zieher, T. 2020 *Towards an operationalisation of nature-based solutions for natural hazards*. *Sci. Total Environ.* **731**, 138855. https://doi.org/10.1016/J.SCITOTENV.2020.138855.

Kumar, P., Debele, S. E., Sahani, J., Rawat, N., Marti-Cardona, B., Alfieri, S. M., Basu, B., Basu, A. S., Bowyer, P., Charizopoulos, N., Jaakko, J., Loupis, M., Menenti, M., Mickovski, S. B., Pfeiffer, J., Pilla, F., Pröll, J., Pulvirenti, B., Rutzinger, M., Sannigrahi, S., Spyrou, C., Tuomenvirta, H., Vojinovic, Z. & Zieher, T. 2021 *An overview of monitoring methods for assessing the performance of nature-based solutions against natural hazards*. *Earth-Sci. Rev.* **217**, 103603. https://doi.org/10.1016/J.EARSCIREV.2021.103603.

Lang, T. 2009 *The Sylvenstein Reservoir*. Available from: https://www.wwa-wm.bayern.de/fluesse_seen/gewaesserportraits/sylvensteinspeicher/doc/2009_broschuere_sylvenstein_klein.pdf (accessed 13 November 2021).

Li, T., Guo, S., An, D. & Nametso, M. 2019 *Study on water and salt balance of plateau salt marsh wetland based on time-space watershed analysis*. *Ecol. Eng.* **138**, 160–170. https://doi.org/10.1016/J.ECOLENG.2019.07.027.

Likert, R. 1932 *A technique for the measurement of attitudes*. *Arch Psychol.* **140**, 55.

Liquete, C., Udias, A., Conte, G., Grizzetti, B. & Masi, F. 2016 *Integrated valuation of a nature-based solution for water pollution control. Highlighting hidden benefits*. *Ecosyst. Serv.* **22**, 392–401. https://doi.org/10.1016/j.ecoser.2016.09.011.

Lupp, G., Zingraff-Hamed, A., Huang, J. J., Oen, A. & Pauleit, S. 2021 *Living labs – A concept for co-designing nature-based solutions*. *Sustainability* **13**, 188.

Maes, J. & Jacobs, S. 2015 *Nature-based solutions for Europe’s sustainable development*. *Conserv. Lett.* **10**, 121–124. https://doi.org/10.1111/conl.12216.

Narayan, S., Beck, M. W., Wilson, P., Thomas, C. J., Guerrero, A., Shepard, C. C., Reguero, B. G., Franco, G., Ingram, J. C. & Trespalacios, D. 2017 *The value of coastal wetlands for flood damage reduction in the Northeastern USA*. *Sci. Rep.* **7**, 9463. https://doi.org/10.1038/s41598-017-09269-z.

Naumann, S., Kaphengst, T., McFarland, K. & Stadler, J. 2014 *Nature-Based Approaches for Climate Change Mitigation and Adaptation in the Challenge of Climate Change-Partnering with Nature*. The Challenges of Climate Change-Partnering with Nature. German Federal Agency for Nature Conservation, Bonn, Germany.

Nicholson, A. R., O'Donnell, G. M., Wilkinson, M. E. & Quinn, P. F. 2020 *The potential of runoff attenuation features as a Natural Flood Management approach*. *J. Flood Risk Manag.* **13**, e12565. https://doi.org/10.1111/JFR3.12565.

Palomo, I., Locatelli, B., Otero, I., Colloff, M., Crouzat, E., Cuni-Sanchez, A., Gómez-Baggethun, E., González-García, A., Grêt-Regamey, A., Jiménez-Aceituno, A., Martín-López, B., Pascual, U., Zafra-Calvo, N., Bruley, E., Fischborn, M., Metz, R. & Lavorel, S. 2021 *Assessing nature-based solutions for transformative change*. *One Earth* **4**, 730–741. https://doi.org/10.1016/J.OONEAR.2021.04.013.

Pauleit, S., Zölch, T., Hansen, R., Randrup, T. B. & Konijnendijk van den Bosch, C. 2017 *Nature-based solutions and climate change – four shades of green*. In: Kabisch N., Korn H., Stadler J., Bonn A. (eds). *Nature-Based Solutions to Climate Change Adaptation in Urban Areas. Theory and Practice of Urban Sustainability Transitions*. Springer, Cham. https://doi.org/10.1007/978-3-319-56091-5_3.

Peroosa, F., Fanger, S., Zingraff-Hamed, A. & Disse, M. 2021a *A meta-analysis of the value of ecosystem services of floodplains for the Danube River Basin*. *Sci. Total Environ.* **777**, 146062. https://doi.org/10.1016/j.scitotenv.2021.146062.

Peroosa, F., Gelhaus, M., Zwirglmaier, V., Arias-Rodriguez, L. F., Zingraff-Hamed, A., Cyffka, B. & Disse, M. 2021b *Integrated valuation of nature-based solutions using tessa: three floodplain restoration studies in the Danube catchment*. *Sustainability* **13**, 1–22. https://doi.org/10.3390/su13031482.

Pinto, L. V., Pereira, P., Gazdic, M., Ferreira, A. & Ferreira, C. S. S. 2021 *Assessment of NBS Impact on Pluvial Flood Regulation Within Urban Areas: A Case Study in Coimbra, Portugal*. In: Ferreira, C. S. S., Kalantari, Z., Hartmann, T. & Pereira, P. (eds). *The Handbook of Environmental Chemistry Series*. Springer, Berlin, Heidelberg, pp. 1–24. https://doi.org/10.1007/698_2021_769.

Potočki, K., Bekić, D., Bonacci, O. & Kulić, T. 2021 *Hydrological Aspects of Nature-Based Solutions in Flood Mitigation in the Danube River Basin in Croatia: Green vs. Grey Approach*. In: Ferreira, C. S. S., Kalantari, Z., Hartmann, T. & Pereira, P. (eds). *The Handbook of Environmental Chemistry Series*. Springer, Berlin, Heidelberg, pp. 1–26. https://doi.org/10.1007/698_2021_770.

Pugliese, F., Caroppi, G., Zingraff-Hamed, A., Lupp, G. & Giugni, M. 2020 *Nature-based solutions (NBSs) application for hydro-environment enhancement*. A case study of the Isar River (DE). *Environ. Sci. Proc.* **2**, 30. https://doi.org/10.3390/environsciproc2020002030.
Rädlinger, C., Hafner, K., Junge, M. & Nebl, A. 2012 *Geschichte der Isar in München. Munich, Ger Schiermeier* (History of the Isar in Munich). Munich City Archives, Munich. ISBN: 978-3-943866-11-7.

Raymond, C. M., Frantzeskaki, N., Kabisch, N., Berry, P., Breil, M., Razvan, M., Geneletti, D. & Calfapietra, C. 2017 A framework for assessing and implementing the co-benefits of nature-based solutions in urban areas. *Environ. Sci. Policy* **77**, 15–24. https://doi.org/10.1016/j.envsci.2017.07.008.

Rowiński, P. M., Västilä, K., Aberle, J., Järvelä, J. & Kalinowska, M. B. 2018 How vegetation can aid in coping with river management challenges: a brief review. *Ecohydrol. Hydrobiol.* **18**, 1–10. https://doi.org/10.1016/j.ecohyd.2018.07.003.

Ruangpan, L., Vojinovic, Z., Di Sabatino, S., Sandra Leo, L., Capobianco, V., Oen, A., McClain, M. E. & Lopez-Gunn, E. 2020 Nature-based solutions for hydro-meteorological risk reduction: a state-of-the-art review of the research area. *Nat. Hazards Earth Syst. Sci.* **20**, 243–270. https://doi.org/10.5194/nhess-20-243-2020.

Sartori, R. 2010 *The new Isar/2 -Renaturation, Cultural Opening and Flow of Ideas, Both Historical and Literary*. Buch & Media, Munich, Germany. (in German), 192p. ISBN: 3865203817.

Scarano, F. R. 2017 Ecosystem-based adaptation to climate change: concept, scalability and a role for conservation science. *Perspect. Ecol. Conserv.* **15**, 65–73.

Schaufuß, D. 2016 Isar-Plan – Water management plan and restoration of the Isar River, Munich (Germany). Retrieved from Brussel, Belgium. Available from: https://climate-adapt.eea.europa.eu/metadata/case-studies/isar-plan-2013-water-management-plan-and-restoration-of-the-isar-river-munich-germany (accessed 13 November 2021).

Scolobig, A., Thompson, M. & Linnerooth-Bayer, J. A. 2016 Compromise not consensus: designing a participatory process for landslide risk mitigation. *Nat. Hazards* **81**, 45–68. https://doi.org/10.1007/s11069-015-2078-y.

Shafique, M. & Kim, R. 2015 Low impact development practices: a review of current research and recommendations for future directions. *Ecol. Chem. Eng.* **S. 20** (1), 543–563.

Solheim, A., Capobianco, V., Oen, A., Kalsnes, B., Wullf-Knutsen, T., Olsen, M., Del Seppia, N., Arauzo, I., Garcia Balaguer, E. & Strout, J. M. 2021 Implementing nature-based solutions in rural landscapes: barriers experienced in the PHUSICOS project. *Sustainability* **13**, 1461.

Strout, J. M., Oen, A. M. P., Kalsnes, B. G., Solheim, A., Lupp, G., Pugliese, F. & Bernardie, S. 2021 Innovation in NBS co-design and implementation. *Sustainability* **13**, 1–10. https://doi.org/10.3390/su13020986.

UN General Assembly. 2015 Transforming our world: the 2030 Agenda for Sustainable Development, 21 October 2015, A/RES/70/1, available at: https://www.refworld.org/docid/57b6e3e44.html (accessed 24 November 2021).

Vinten, A., Kuhfuss, L., Shortall, O., Stockan, J., Ibiyemi, A., Pohle, I., Gabriel, M., Gunn, I. & May, L. 2019 Water for all: towards an integrated approach to wetland conservation and flood risk reduction in a lowland catchment in Scotland. *J. Environ. Manag.* **246**, 881–896. https://doi.org/10.1016/j.JENVMAN.2019.05.135.

Wagner, T., Themeßl, M., Schüppel, A., Gobiet, A., Stigler, H. & Birk, S. 2017 Impacts of climate change on stream flow and hydro power generation in the Alpine region. *Environ. Earth Sci.* **76**, 4. https://doi.org/10.1007/s12665-016-6318-6.

Wilby, R. L. & Keenan, R. 2012 Adapting to flood risk under climate change. *Prog. Phys. Geogr.* **36**, 348–378.

Zingraff-Hamed, A. 2011 Habitat protection and recreational use enhancement of urban river – the case of Munich and Angers. Pauleit and Davodeau (eds.), (in German), Angers, France, 255.

Zingraff-Hamed, A., Noack, M., Greulich, S., Schwarzwälder, K., Pauleit, S. & Wantzen, K. M. 2018 Model-based evaluation of the effects of river discharge modulations on physical fish habitat quality. *Water (Switzerland)* **10**, 374. https://doi.org/10.3390/w10040374.

Zingraff-Hamed, A., Martin, J., Lupp, G., Linnerooth-Bayer, J. & Pauleit, S. 2019 Designing a resilient waterscape using a living Lab and catalyzing polycentric governance. *Landsc. Archit. Front.* **7**, 15–19. https://doi.org/10.15302/j-laf-1-020003.

Zingraff-Hamed, A., Hüesker, F., Albert, C., Brillinger, M., Huang, J., Lupp, G., Scheuer, S., Schlätel, M. & Schröter, B. 2020a Governance models for nature-based solutions: seventeen cases from Germany. *Ambio* **50**, 1610–1627. https://doi.org/10.1007/s13280-020-01412-x.

Zingraff-Hamed, A., Hüesker, F., Lupp, G., Begg, C., Huang, J., Oen, A., Vojinovic, Z., Kuhlicke, C. & Pauleit, S. 2020b Stakeholder mapping to co-create nature-based solutions: who is on board? *Sustainability* **12**, 8625. https://doi.org/10.3390/su12208625.

Zingraff-Hamed, A., Lupp, G., Bäumler, K., Huang, J. & Pauleit, S. 2021 The Isar River: Social pride as a driver of river restoration. In: *River Culture – Life as a Dance to the Rhythm of the Waters* (Wantzen, K. M., ed.). UNESCO Publishing, Paris, France, pp. 609–634.

Zölch, T., Henze, L., Keilholz, P. & Pauleit, S. 2017 Regulating urban surface runoff through nature-based solutions – an assessment at the micro-scale. *Environ. Res.* **157**, 135–144. https://doi.org/10.1016/j.envres.2017.05.023.

First received 1 July 2021; accepted in revised form 24 October 2021. Available online 24 November 2021