pELECTRE-Tri: Probabilistic ELECTRE-Tri
Method-Application for the Energy Renovation of
Buildings

Majid Baseer, Christian Ghiaus, Roxane Viala, Ninon Gauthier, Souleymane

Daniel

► To cite this version:

Majid Baseer, Christian Ghiaus, Roxane Viala, Ninon Gauthier, Souleymane Daniel. pELECTRE-Tri: Probabilistic ELECTRE-Tri Method-Application for the Energy Renovation of Buildings. Energies, 2023, 16 (14), pp.5296. 10.3390/en16145296. [hal-04338961]

HAL Id: hal-04338961

https://hal.science/hal-04338961v1

Submitted on 12 Dec 2023

HAL is a multi-disciplinary open access
archive for the deposit and dissemination of sci-
entific research documents, whether they are pub-
lished or not. The documents may come from
teaching and research institutions in France or
abroad, or from public or private research centers.

L'archive ouverte pluridisciplinaire HAL, est
destinée au dépôt et à la diffusion de documents
scientifiques de niveau recherche, publiés ou non,
émanant des établissements d'enseignement et de
recherche français ou étrangers, des laboratoires
publics ou privés.

<figure><img src="image_1.png" /></figure>

Distributed under a Creative Commons CC BY 4.0 - Attribution - International License
<figure><img src="image_2.png" /></figure>

energies

IMPACT
FACTOR
3.2

CITESCORE
5.5

Article

Editor's Choice

pELECTRE-Tri: Probabilistic
ELECTRE-Tri Method—Application
for the Energy Renovation of
Buildings

Majid Baseer, Christian Ghiaus, Roxane Viala, Ninon Gauthier and Souleymane Daniel

<figure><img src="image_3.png" /></figure>

<figure><img src="image_4.png" /></figure>
Article

pELECTRE-Tri: Probabilistic ELECTRE-Tri
Method—Application for the Energy Renovation of Buildings

Majid Baseer, Christian Ghiaus *ID, Roxane Viala ID, Nинon Gauthier and Souleymane Daniel ID

CETHIL UMR 5008, CNRS, INSA Lyon, Université Claude Bernard Lyon 1, Université de Lyon,
F-69621 Villeurbanne, France; majidbaseer@insa-lyon.fr (M.B.); roxane.viala@insa-lyon.fr (R.V.);
ninin.gauthier@insa-lyon.fr (N.G.); souleymane.daniel@insa-lyon.fr (S.D.)

* Correspondence: christian.ghiausl@insa-lyon.fr

**Abstract:** This paper proposes the method pELECTRE Tri, a novel probabilistic Multi-Criteria Decision Making (MCDM) method using the traditional ELECTRE Tri, probability distribution, and Monte Carlo simulation to support informed decision-making in complex and uncertain decision environments. The proposed method is illustrated through a case study involving the renovation of three social housing buildings. The paper provides new insights into the application of probabilistic sorting MCDM in the context of energy efficiency in buildings and highlights the benefits of using probabilities rather than crisp values to categorize alternatives enabling stakeholders to make better use of available resources, especially when dealing with a large dataset of energy measures with different features. The methodology implemented in Python (DOI: 10.5281/zenodo.7967655) is available as an open source.

**Keywords:** multi-criteria decision making; ELECTRE Tri; energy retrofitting; sustainability

# 1. Introduction

Most of the energy in the building sector is consumed by existing buildings, while only 1–3% of existing buildings are replaced by new buildings annually [1,2]. According to the International Energy Agency, the building sector is a highly cost-effective area for reducing energy consumption. As part of the efforts to decrease energy usage and carbon dioxide emissions, 25 policy recommendations have been published focusing on energy efficiency. If these recommendations are adopted globally, it could result in annual savings of 7.6 giga tons of carbon dioxide emissions and 1950 million tons of the oil equivalent in annual energy consumption by the year 2030 [3,4].

Building retrofitting is a process which includes the removal, installation, replacement, and rearrangement of components that the existing building did not possess when constructed initially [5]. Energy use can be reduced significantly in existing buildings through proper retrofitting, ranging from 50% to 85% [6–10]. Building retrofit evaluations are challenging to initiate because the building and its environment are complex systems with multiple criteria to consider. These criteria are related to economic, technical, ecological, social, comfort, and aesthetical aspects in which all subsystems can influence overall energy efficiency and interdependence between subsystems, which plays a significant role [11].

Energy retrofitting typically reduces the energy consumption of a building through energy efficiency measures such as improved thermal insulation, thermal load reduction, solar shading, the replacement of inefficient equipment, and the implementation of renewable energy technologies. Building energy retrofitting benefits the environment, the economy, and the society. Environmental benefits include reduced greenhouse emissions, social benefits include improved occupant health and comfort, and economic benefits can be a cost-effective way of increasing the asset value of an existing building rather than constructing a new building. Existing building retrofitting presents numerous challenges and opportunities. A key challenge is the presence of numerous uncertainties, including

<figure><img src="image_5.png" /></figure>

check for
updates

**Citation:** Baseer, M.; Ghiaus, C.; Viala, R.; Gauthier, N.; Daniel, S. pELECTRE-Tri: Probabilistic ELECTRE-Tri Method—Application for the Energy Renovation of Buildings. *Energies* **2023**, *16*, 5296. https://doi.org/10.3390/en16145296

Academic Editor: Jonas Šaparauskas

Received: 26 May 2023

Revised: 19 June 2023

Accepted: 28 June 2023

Published: 11 July 2023

<figure><img src="image_6.png" /></figure>

**Copyright:** © 2023 by the authors.
Licensee MDPI, Basel, Switzerland.
This article is an open access article
distributed under the terms and
conditions of the Creative Commons
Attribution (CC BY) license (https://
creativecommons.org/licenses/by/
4.0/).
climate change, service change, human behavior, and government policy change, all of which have a direct impact on the choice of retrofit technologies and the project outcome. Other difficulties may include financial constraints and barriers, perceived long payback periods, and operational interruptions. Buildings' subsystems are highly interdependent. On a technical level, different retrofit measures may have varying effects on the associated building subsystems. The quantitative and qualitative nature of various criteria adds to the complexity of the analysis [12–15]. There are trade-offs between retrofitting project benefit categories due to the diverse interests and goals of stakeholders. For example, reducing life-cycle carbon emissions may be the priority of the local government but not the interest of the other stakeholders. When discussing the effectiveness of a retrofit intervention, improving the occupant's comfort, specifically thermal, visual, and acoustic comforts, is frequently an issue. As a result, when discussing building energy retrofits, it is necessary to consider the trade-offs between these objectives in terms of embodied emissions, operational emissions, occupant comfort, and investment costs [16–20]. The energy retrofitting of a residential building in Orlando, USA was carried out with the help of several energy efficiency measures and the results indicated an annual energy saving of up to 29% [21]. In a case study conducted in Australia to convert an existing residential house to a net zero energy house, the results indicated a 50% increase in the thermal efficiency [22].

The multi-criteria decision making (MCDM) approach is gaining popularity in energy retrofit decision processes because of its adaptability and potential to reach a tradeoff among various conflicting criteria and to foster communication among stakeholders [23]. An important challenge is to deal with the probabilistic nature of much data considered in the decision process.

Section 2 provides a review of the literature on the use of MCDM methods in decision-making problems in energy retrofitting of existing buildings and shows the necessity of using probabilistic values in MCDM. Section 3 describes the methodology used to introduce the probabilistic ELECTRE Tri approach. Section 4 illustrates the implementation of the methodology in a real-world case study of a social housing project [24]. Section 5 discusses the results of using the probabilistic ELECTRE Tri method to categorize various energy alternatives in terms of probabilities. Finally, the paper ends with conclusions.

## 2. Literature Review

Multi-criteria decision making is a subfield of operational research that is used to aid decision making in complex scenarios with opposing and conflicting criteria [25–27]. It enables the systematic integration of both quantitative and qualitative analyses to attain informed decisions [28]. When different MCDM methods are applied to the same problem, they produce different results because they deal differently with performance measures and criteria weights. Furthermore, in MCDM problems, the best compromise solution is recommended based on the information available in the given decision situation, rather than the “true” result, as some engineering methods would provide [29,30].

During the last few decades, several new types of MCDM have been developed and the maturity of the existing ones has improved, thus increasing their application to real-world problems. The main differences between these methods are related to the complexity of the problems that can be formulated and solved, the weighting methods of the criteria, the representation of thresholds, the possibility of uncertain data, and finally, the type of data aggregation [31,32]. MCDM shares a number of fundamental principles, which include outlining a set of actions aimed at addressing the problem at hand, establishing at least two different criteria to evaluate each action, the use of thresholds, and having a decision maker responsible for making the final decision [33]. Decisions made through MCDM are justifiable and clear because they are documented and traceable due to them being one of the widely used techniques to support sustainability assessment in the context of energy systems. The ability to consider multiple criteria and objectives at once make MCDM methods well accepted in the domain of energy retrofitting decision processes [34–36]. The ideal solution is a trade-off between a variety of energy and non-energy factors such as
economic, environmental, technical, social, and regulatory factors, among others. The social factors of a sustainable building are the most overlooked, though they are occasionally investigated. However, some studies mentioned building characteristics that promote social sustainability [37,38]. It is not expected of a building to exhibit the best environmental, economic, and social performance at the same time, as these are often contradictory. As a result, balancing the impacts on these dimensions over its entire life cycle is a critical factor in achieving sustainable buildings. Sustainability assessments are designed to collect and disseminate information to help with decision-making [39].

The application of the MCDM approach to energy building renovation has advantages in comparison to the traditional single criterion analysis method because it can give the comprehensive score/ranking of the alternatives under the effect of various multiple criteria, whereas the single criterion analysis is deemed insufficient [40,41]. The stakeholders are likely to turn to intuition in the event of a lack of well-defined practices in the use of decision-making tools [42]. MCDM methods decompose the problem of decision making into steps, compare the relative importance of the criteria, and select the optimal alternative from a set of alternatives in a fuzzy, uncertain, and risky environment [43]. The following steps can be used to describe decision-making [44]: problem identification, goal and objective outlining, criteria establishment, alternative identification, decision-making method selection, criterion assessment of alternatives, review, and outcome validation.

The existing MCDM approaches can be classified into two main school of thoughts [45,46]:

- aggregation methods or the American school of thought;

- outranking methods or the French school of thought.

## 2.1. Aggregation Methods

In the aggregation method, the view of the decision-maker is disaggregated in the sense that the decision-maker is assumed to have a complete preference system. This preference system allows them to express their preferences on all aspects of the decision problem and it can be derived by asking the decision-maker relevant questions.

The aggregation methods use a functional approach that base their methods on the use of value or usability. These approaches typically ignore the possibility of data inaccuracies or uncertainty, as well as decision-maker preferences. This set of methods is closely related to an operational approach that employs a single criterion for synthesis. The primary methods include the Multi-Attribute Value/Utility Theory (MAUT), Analytic Hierarchy Process (AHP), Analytic Network Process (ANP), Simple Multi-Attribute Rating Technique (SMART), Utility Additive (UTA), Measuring Attractiveness by a Categorical Based Evaluation Technique (MACBETH), and Technique for Order Preferences by Similarity to Ideal (TOPSIS) [47].

The MAUT method is based on the fundamental assumption that a single usability function, which takes into account all relevant criteria, can effectively capture the decision-maker's preferences. The MAUT aggregation method was used to evaluate five different energy production alternatives [48]. The method of the AHP is considered the most well-known and widely used functional method within the aggregation methods. The AHP enables decision-makers to prioritize their decision-making problems, whereas the ANP is a more complex variation that allows for the construction of a network model with links between criteria, variants, and feedback. The AHP is a compensatory method in which a high score on one criterion can compensate for a low score on another criterion. In the energy sector, the method of AHP is widely used. The AHP was used to propose an energy efficiency rating system based on criteria for existing buildings in Egypt [49]. The AHP was also used to show how experts prioritize various factors and contexts in their decisions to implement energy efficiency retrofits in the United States [50]. Additionally, the AHP technique was used to select the most suited scenario for electricity generation from four scenarios [51]. The AHP was also used to rank assessment themes and identify the stakeholders' priorities in Malaysia's refurbishment building assessment scheme [52]. In the SMART, the decision-maker uses a value function to mathematically
convert criteria values to a common internal scale. The SMART was used to determine
decision-makers preferences for subjective criteria related to the design of sustainable and
resilient buildings [53]. The UTA method extracts the decision-makers' preferences from
a reference set of variants. The MACBETH compares individual variants in a pairwise
comparison matrix and aggregates criterion preferences as a weighted average using qual-
itative evaluations. The fuzzy MACBETH model was used to explore the inefficiencies
and uncertainties related with South European solid waste management systems [54]. The
TOPSIS method is constructed on the assumption that the positive ideal alternatives have
the best level for all the criteria values and the negative ideal alternatives have the worst
level for the criteria values. In a geometrical sense, the optimal alternative should have the
shortest distance from the positive ideal solution while having the longest distance from
the negative ideal solution. Each criterion is expected to have an increasing or decreasing
monotonically utility, making it relatively easy to determine the positive ideal and negative
ideal solutions [55]. The TOPSIS was used to propose a novel approach for benchmarking
building energy performance using a number of criteria including energy consumption,
indoor comfort, and environmental impact [56]. A combination of the TOPSIS and pairwise
comparison method was used to rank and select the best renovation option for a given
building [57]. The TOPSIS and AHP were used to determine the optimum energy recovery
technologies based on financial, environmental, and technical criteria [58].

## 2.2. Outranking Methods

In the outranking method, the solution is closer to the human way of thinking. The
basic assumption is that the decision-maker explores the assertion that "alternative *i* is at
least as good as alternative *k*", and the only pre-existing preferences they have is an idea of
the relative importance of the criteria.

The outranking methods employ a relational model that makes use of the outranking
relation. This relationship involves comparing pairs of decision options and determining
whether one option significantly outperforms the other. The Preference Ranking Orga-
nization Method for Enrichment Evaluations (PROMETHEE) and ELimination et Choix
Traduisant la RÉalité (ELECTRE) methods are two prominent techniques [47].

The PROMETHEE method was first introduced by Brans as an outranking method
to rank and choose from a limited set of alternatives. Brans and Vincke further expanded
the original method. A finite set of predetermined alternatives is evaluated using multiple
criteria, with each criterion assigned a weight and a suitable preference function selected.
The preference function expresses the degree of preference for different evaluations [59].
Six methods, each with a specific purpose, have been developed within the PROMETHEE
family to solve MCDM problems. PROMETHEE I is intended for partial ranking of alterna-
tives, whereas PROMETHEE II is intended for full ranking. PROMETHEE III improves
indifferences by allowing them to rank alternatives based on overlapping intervals com-
puted from interval flows. PROMETHEE IV is used to rank alternatives completely or
partially when the set of viable solutions is continuous [60,61]. PROMETHEE V maximizes
the total outranking flow of alternatives for a continuous problem by using constraints [62].
PROMETHEE VI incorporates the decision maker preferences, resulting in variations in
criteria weights [63]. The PROMETHEE method was used to evaluate the thermal perfor-
mance of different building renovation alternatives based on multiple criteria, including
cost, energy efficiency, environmental impact, and social acceptance using a case study
of a masonry building in Algeria. The outcomes were used to rank the alternatives and
determine the best renovation option [64]. The PROMETHEE method was used to select
energy retrofit measures for buildings and districts in a district of Milan, Italy, involving
a comprehensive evaluation of the retrofit measures based on multiple criteria, such as
energy performance, cost, environmental impact, and social factors. The proposed method
is used to evaluate and rank different retrofit measures for buildings and the district as a
whole. The findings of the study indicate that the proposed method can effectively identify
the most appropriate retrofit measures for both individual buildings and the district, taking into account various criteria and stakeholder preferences [65].

ELECTRE is a family of MCDM that was developed in the 1960s by Bernard Roy and his colleagues at the European consultancy company SEMA [66]. The ELECTRE method, which was originally designed to select the best alternative from a given set, has evolved to address three key types of decision problems: choosing, ranking, and sorting [67]. Although there are several versions of the ELECTRE method, they are all based on the same fundamental concepts but differ in their procedures and purpose. For instance, ELECTRE I was developed to solve choice problems [68], whereas ELECTRE IS and ELECTRE IV were developed by introducing indifference and veto thresholds, respectively [66]. ELECTRE II, an updated version of ELECTRE I, addresses ranking problems by defining two outranking relations. The primary distinction between ELECTRE I and ELECTRE II is how the outranking relation is defined. ELECTRE II introduces two outranking relations: weak outranking and strong outranking, whereas ELECTRE I considers only one type of outranking. ELECTRE III, which can be thought of as a fuzzy outranking relation, was developed to address the ranking problem [69]. ELECTRE IV, a variant of ELECTRE III, was developed to deal with situations where criteria weights are difficult to define or are intentionally omitted [70]. The ELECTRE III and ELECTRE IV methods construct outranking relations using different preference domains. The primary difference between the two techniques, however, is found in their distillation procedures. ELECTRE IV uses the number of criteria in each preference domain, whereas ELECTRE III uses a membership function value. A methodology was proposed to assist municipalities in Portugal for improving their energy sustainability through the development of an Energy Action Plan (EAP) using ELECTRE III to evaluate 16 actions in the framework [71].

To address the sorting issue, the most recent members of the ELECTRE family, ELECTRE Tri [72], ELECTRE Tri-C [73], and ELECTRE Tri-nC [74], were developed. ELECTRE Tri was developed to sort and categorize alternatives based on their ability to satisfy specific conditions. It assigns alternatives to different categories based on their similarity between the alternatives and the reference profiles which must be defined properly to ensure a robust categorization process [72,75]. The ELECTRE Tri method was used to classify 16 distinct sustainable energy technologies for electricity generation based on their compliance with the Clean Development Mechanism (CDM) using six different economic, environmental, and social criteria to sort the sixteen alternatives into three priority categories [76]. A comparative evaluation was conducted by using ELECTRE Tri and the Data Envelopment Analysis (DEA) to evaluate 41 biogas industries in Austria. The industries were classified into four categories based on economic, environmental, and social criteria [77]. In Portugal, the ELECTRE Tri method was used to assess the energy efficiency of school buildings [78]. The ELECTRE Tri-nC technique was used to aid decision-making by categorizing alternative energy retrofit measures into three distinct categories for public buildings in the Apulia region of Italy [23].

A multi-criteria analysis is a suitable approach for comparing and defining a retrofit program in order to select alternatives for the renovation of social housing. In this context, the ELECTRE Tri method is regarded as the most appropriate approach due to the following reasons. It is well-suited for complex problems with multiple criteria and alternatives, and makes use of a variety of qualitative and quantitative evaluation scales. It categorizes alternatives based on performance, rather than ranking them from best to worst, which enables the decision-makers to rank them subjectivity. The use of boundary reference profiles and categorization provides information on overall performance, allowing for an absolute classification of each alternative. This characteristic is especially important when choosing an energy renovation alternative which should have a high overall performance rather than just relative performance. Finally, the ELECTRE Tri method incorporates various thresholds as well as a user-defined cutting level, which take into account uncertainties in calculations and performance evaluations while avoiding compensation.
Previous research typically used crisp values to represent alternative performance and assumed that evaluation data for decision-making remains constant. However, this assumption does not reflect reality as external factors often cause data to vary. A comprehensive criteria system may include both qualitative and quantitative data in the decision matrix, making it challenging to use crisp numbers to carry out subjective evaluations. Due to the inherent uncertainty of human cognitive capabilities, limited knowledge, data estimations, and the complex nature of environments, decision-makers may find it difficult to express their opinions using exact and definite values. For instance, economic uncertainties may arise due to the fluctuation of raw material prices while environmental uncertainties may be caused by the imprecise measuring of environmental impacts. Often, uncertainty is ignored for avoiding complications in decision-making, resulting in solutions which are far away from reality. In order to address these shortcomings, it is necessary to incorporate uncertainty into decision-making [79]. In practice, decision-making problems are often complex and uncertain, making it impossible to comprehensively understand and consider all aspects of the problem thoroughly. As a result, decision-makers may be presented with incomplete or imprecise information about alternative evaluations or the relative importance of each criterion for an in-depth analysis [80]. Given these complexities, imprecision, and uncertainties, there is a need for the MCDM method that can effectively address these issues in the context of energy systems, which are acceptable to all the stakeholders.

ELECTRE Tri deals with fuzziness by assigning alternatives to categories. A fuzzy value represents a value with a degree of membership or truth assigned to it. It reflects the level of certainty or ambiguity associated with the value. Fuzzy values are commonly used in fuzzy logic, which allows for the modeling of vagueness or uncertainty. For instance, in fuzzy sets, a value can be partially true or partially belong to a particular set based on its degree of membership. However, these values are crisp, not imprecise. An imprecise value is characterized by a lack of precision or specificity. It refers to a value that has limited detail or lacks exactness. Imprecise values can arise due to various reasons, such as evaluation errors, approximations, or incomplete information. Unlike fuzzy values, imprecise values do not inherently involve assigning degrees of membership or truth. They are more about expressing a range or uncertainty in the value itself. The precision can be expressed using a probability distribution function (PDF) or a probability density function which provides information about the likelihood of different values occurring within a given range.

Therefore, the main aim of this paper is to introduce imprecision in the expression of values by using probabilistic distributions.

### 3. Method

In this section, we provide an overview of the ELECTRE Tri method and Monte Carlo approach; then, the probabilistic extension of the ELECTRE Tri method, proposed in this paper, is explained. The flowchart of the proposed probabilistic ELECTRE Tri procedure is given in Figure 1.

#### 3.1. *Description of the ELECTRE Tri Method*

ELECTRE Tri is a decision-making method that uses an outranking approach to sort and categorize alternatives based on their ability to satisfy specific conditions. ELECTRE Tri does not require pairwise comparisons between alternatives since they do not compete with each other; instead, it assigns alternatives to different categories based on the similarity between the alternatives and the reference profiles which must be defined properly to ensure a robust categorization process [72,75]. To implement ELECTRE Tri methodology, two primary stages must be accomplished. The initial stage involves establishing an outranking relation between alternatives and reference profiles achieved by calculating concordance and discordance indices using the same computation process as ELECTRE III. The following stage involves assigning alternatives to categories based on the outranking relation established in the initial stage achieved by calculating the pessimistic and optimistic procedures [81]. In order to use ELECTRE Tri, it is necessary to establish distinct and non-
overlapping ordered categories, each of which is represented by reference profiles. These reference profiles serve as both the upper reference profile for a given category and the lower reference profile for the subsequent category [82].

<figure><img src="image_7.png" /><figcaption>**Figure 1.** Flowchart of the proposed probabilistic ELECTRE Tri method.</figcaption></figure>

Once the fundamental features of the ELECTRE Tri technique have been established, its application requires the following inputs and parameters [83]:

- Alternatives: The set of scenarios or options available from which the decision-maker can choose.

- Criteria: The attributes/factors used to evaluate the alternatives, which can be quantitative or qualitative.

- Weights: The relative importance of each criterion is determined by using weights.

- Performance matrix: A matrix displaying how each alternative performs against each criterion. In the case of a criterion with an increasing performance preference, the higher the evaluation of the alternative on this criterion, the better the alternative performs on this criterion. The criteria with decreasing performance preferences are multiplied by "-1" to align them with the other criteria's increasing performance preferences, thus unifying the calculation [84].

- Thresholds: Thresholds are used to determine the minimum acceptable performance level for each criterion. If an alternative does not meet the threshold value for a criterion, it is considered unacceptable.

- Preference threshold ($p$): The minimum degree of preference that an alternative must have over another alternative to be considered as outranking it.

- Indifference threshold ($q$): The maximum degree of difference between two alternatives that can be tolerated without affecting the preference relation between them.

- Veto threshold ($v$): The maximum degree of preference that can be given to an alternative despite its poor performance on some criteria.

- Cutting level ($\lambda$): The cutting level is defined as the smallest credibility index value that is consistent with the assertion alternative $a_i$ which is superior to reference profile $b_k$, noted $a_i S b_k$. The default value of the cutting level used in the ELECTRE Tri method is 0.75, but it can be adjusted to suit the specific case being studied. To determine the appropriate cutting level, factors such as the desired precision in
ranking the alternatives, the goals to be achieved, and the problem constraints need to be considered.

The steps of ELECTRE Tri method are:

Step 1: Calculate partial concordance indices.

The concordance index $c_i(a_i, b_k)$ expresses the degree in favor of the hypothesis that alternative $a_i$ is at least as good as reference profile $b_k$ [85]. The partial concordance is

$$c_i(a_i, b_k) = \begin{cases} 0 & \text{if } [g_j(b_k) - g_j(a_i)] \geq p_j(b_k) \\ 1 & \text{if } [g_j(b_k) - g_j(a_i)] \leq q_j(b_k) \\ \frac{p_j(b_k) + g_j(a_i) - g_j(b_k)}{p_j(b_k) - q_j(b_k)} & \text{otherwise} \end{cases} \quad (1)$$

where:

$g_j(b_k)$—the value of the reference profile $b_k$ for the criterion $j$;

$g_j(a_i)$—alternative $a_i$ evaluation on the criterion $j$;

$p_j(b_k)$—preference threshold indices for the criterion $j$ and reference profile $b_k$;

$q_j(b_k)$—indifference threshold indices for the criterion $j$ and reference profile $b_k$.

In order to consider the opposing assertion, and the performance of the reference profile $b_k$ with respect to alternative $a_i$, it is necessary to calculate the concordance indices in the reciprocal way $c_j(b_k, a_i)$.

Step 2: Calculate global concordance indices.

The global concordance index $c(a_i, b_k)$ can be calculated after computing the partial concordance index for all the criteria. The global concordance is

$$c(a_i, b_k) = \frac{\sum_{j=1}^{n} w_j \cdot c_j(a_i, b_k)}{\sum_{j=1}^{n} w_j} \quad (2)$$

where $w_j$ is the weight of the criterion $j$. It is necessary to calculate the global concordance indices in the reciprocal way ($b_k, a_i$).

Step 3: Calculate the discordance indices.

The discordance index expresses the degree of evidence against the hypothesis that alternative $a_i$ is at least as good as reference profile $b_k$ [85]. The discordance index is

$$d_j(a_i, b_k) = \begin{cases} 0 & \text{if } [g_j(b_k) - g_j(a_i)] \leq p_j(b_k) \\ 1 & \text{if } [g_j(b_k) - g_j(a_i)] > q_j(b_k) \\ \frac{g_j(b_k) - g_j(a_i) - p_j(b_k)}{v_j(b_k) - p_j(b_k)} & \text{otherwise} \end{cases} \quad (3)$$

where $v_j(b_k)$ are the veto threshold for the criterion $j$ and reference profile $b_k$. In order to consider the opposing assertion, it is necessary to calculate the discordance indices in the reciprocal way $d_j(b_k, a_i)$.

Step 4: Calculate the credibility index of the outranking relation.

In the ELECTRE Tri method, a degree of credibility is calculated to establish the relationship between the alternatives and the reference profiles. This value measures the proximity of each alternative to each reference profile and is compared to the cutting level $\lambda$ to ascertain if a preference for an alternative over a reference profile can be established or not [86]. The credibility index is

$$\sigma(a_i, b_k) = C(a_i, b_k) \prod_{j \in J} \frac{1 - D_j(a_i, b_k)}{1 - C(a_i, b_k)} \quad (4)$$
where *j* stands for all the criteria for which $D_j(a_i, b_k) \ge C(a_i, b_k)$.

When the decision-maker considers that it is not appropriate to define the veto threshold, the credibility index coincides with the global concordance index. Once all credibility indexes $\sigma(a_i, b_k)$ have been calculated, they are compared to the cutting level $\lambda$ which has a value in the range of [0.5 – 1.0] and must be greater than [1 – highest weight / total weight] [87,88]. This relationship allows the definition of the outranking relation that each alternative has with the reference profile.

The degree of credibility for $\sigma(b_k, a_i)$ is calculated from the global concordance $C(b_k, a_i)$ and the discordance $D(b_k, a_i)$.

There are four types of relationships that can be established between each performance alternative $a_i$ and each reference profile $b_k$ by the value of $\sigma(a_i, b_k)$, $\sigma(b_k, a_i)$, and $\lambda$, represented in Figure 2.

<figure><img src="image_8.png" /><figcaption>**Figure 2.** Schematic relationship between the alternative and the profile.</figcaption></figure>

- If $\sigma(a_i, b_k) > \lambda$ and $\sigma(b_k, a_i) > \lambda$, then $a_i < b_k$: $a_i$ is indifferent to $b_k$.

- If $\sigma(a_i, b_k) > \lambda$ and $\sigma(b_k, a_i) < \lambda$, then $a_i > b_k$: $a_i$ is preferred to $b_k$.

- If $\sigma(a_i, b_k) < \lambda$ and $\sigma(b_k, a_i) > \lambda$, then $a_i < b_k$: $a_i$ is not preferred to $b_k$.

- If $\sigma(a_i, b_k) < \lambda$ and $\sigma(b_k, a_i) < \lambda$, then $a_i > b_k$: $a_i$ is incomparable to $b_k$.

The second stage of the ELECTRE Tri method involves assigning alternatives to classes based on the outranking relation obtained in the first stage. The optimistic and pessimistic rules are the two assignment procedures proposed by ELECTRE Tri. The outcomes of the two procedures do not necessarily coincide. The optimistic rule assigns the alternative $a_i$ to the lowest class $C_h$ for which the upper profile $b_k$ is preferred to $a_i$, i.e., $b_k > a_i$. The pessimistic rule assigns the alternatives to the highest class such that $a_i$ outranks $b_k$, i.e., $a_i < b_k$.

## 3.2. *Description of the Monte Carlo Method*

The Monte Carlo method is a statistical technique for estimating operations in complex systems that rely on random sampling and statistical modeling. It can be used to apply a method to a set of probability functions by generating a set of data repeatedly. The method is applied to the generated data set; one data point is sampled from each distribution. By repeating this process a large number of times, the method generates results that are representative of the underlying distributions of the input data, allowing for the incorporation of the uncertainty present in the data into the decision-making process.

The Probability Density Function (PDF) is used to integrate data fluctuation into the performance matrix [89]. A probability density function is a mathematical expression that describes the probability distribution of a continuous random variable [90]. PDFs can be used to represent the distribution of various types of phenomena, including the normal,
uniform, Poisson, and exponential distributions. These curves allow the expression and measurement of knowledge of the input data based on their parameters. Although any PDF can be used, in what follows, the normal distribution is used without reducing the generality of the method. The decision to use the normal distribution is based on the following two main reasons:

- The normal distribution is commonly used to represent real-world values, especially in fields such as economics, social sciences, and natural sciences, where the true distribution of the data is unknown exactly.

- When a large number of samples are taken, the normal distribution is a frequent approximation for the distribution of data, even if it is not the true underlying distribution [91]. This has been demonstrated by statisticians such as Pierre-Simon Laplace through experimentation in various fields, where the normality of the data is observed to increase with sample size.

The normal distribution, noted N (μ, σ²), is described by two parameters: the mean value μ and the standard deviation σ. It is worth noting that the variance is v = σ². As a result, the calculations will be done with the mean value μ and the variance v as parameters.

The following steps need to be followed in order to implement the proposed method.

Step 1: Select values from Probability Distribution Functions (PDFs).

The underlying assumption is that the values are provided in the form of Probability Distribution Functions rather than crisp values. Therefore, the performance of each alternative with respect to each criterion is considered as a probability distribution, taking into consideration the data uncertainty. The performance of an alternative a regarding a criterion j is:

$$S_a(C_j) = F_j(x) \qquad (5)$$

where $F_j$ is the probability density function of the criterion j.

The first step is to select a value from each distribution. As a result, a new performance matrix is formed using the values selected from the distributions.

Step 2: ELECTRE Tri implementation.

Once the data set is obtained, ELECTRE Tri is used to calculate the optimistic and pessimistic ranking of each alternative. In the traditional ELECTRE Tri, the alternatives are assigned to a single category in the optimistic and pessimistic rankings (Table 1).

<table><caption>Table 1. Example of optimistic and pessimistic rankings obtained in single categories.</caption><thead><tr><th>Alternative</th><th>C1</th><th>C2</th><th>C3</th><th>C4</th><th>C5</th><th>Alternative</th><th>C1</th><th>C2</th><th>C3</th><th>C4</th><th>C5</th></tr></thead><tbody><tr><td>a1.1</td><td></td><td>X</td><td></td><td></td><td></td><td>a1.1</td><td></td><td></td><td>X</td><td></td><td></td></tr><tr><td>a1.2</td><td></td><td></td><td></td><td>X</td><td></td><td>a1.2</td><td></td><td></td><td></td><td>X</td><td></td></tr><tr><td>a1.3</td><td>X</td><td></td><td></td><td></td><td></td><td>a1.3</td><td>X</td><td></td><td></td><td></td><td></td></tr></tbody></table>

Step 3: Obtaining a set of outcomes.

The final step is to repeat the first two steps several times to generate a large number of optimistic and pessimistic rankings. The number of times each alternative is classified in each category is calculated by memorizing the ranking of each alternative. As a result, the outcomes are a distribution of alternatives in the categories. These two sets of rankings for each alternative are then converted into percentages to obtain tables that display the probability of each alternative ranking in each category (Table 2).
<table><caption>**Table 2.** Example of optimistic and pessimistic rankings obtained in multiple categories.</caption><thead><tr><th>Alternative</th><th>C1</th><th>C2</th><th>C3</th><th>C4</th><th>C5</th><th>Alternative</th><th>C1</th><th>C2</th><th>C3</th><th>C4</th><th>C5</th></tr></thead><tbody><tr><td>a1.1</td><td>10.2</td><td>25.9</td><td>63.9</td><td>0</td><td>0</td><td>a1.1</td><td>0</td><td>15.7</td><td>63.6</td><td>21</td><td>0</td></tr><tr><td>a1.2</td><td>0</td><td>0</td><td>100</td><td>0</td><td>0</td><td>a1.2</td><td>0</td><td>0</td><td>6.4</td><td>93.6</td><td>0</td></tr><tr><td>a1.3</td><td>0</td><td>2.5</td><td>45.7</td><td>39.3</td><td>12.5</td><td>a1.3</td><td>0</td><td>0</td><td>13.2</td><td>62.3</td><td>24.5</td></tr></tbody></table>

One of the primary benefits of the outlined procedure is the ability to obtain more detailed results. These tables not only categorize the alternatives, but also show their sensitivity to changes in the input data.

A computational algorithm has been developed to automate the probabilistic ELECTRE Tri method enabling rapid and efficient processing [92]. The method assigns alternatives into different ranking categories named as $C_k$, which are defined by upper and lower boundary reference profiles named as $B_k$. The decision makers have the flexibility to define the boundary reference profiles; their performance is used to establish the ranking categories. The Python programming language is selected for the implementation of the method due to its readability, user-friendliness, popularity, and versatility in terms of computer support.

# 4. Case Study

## 4.1. Description

The proposed methodology is illustrated by using a social housing project consisting of sixty-seven apartments made up of three adjacent buildings (called B1, B2 and B3) located in the region of Lyon, France and built in 1973. The apartments range in size from one to five rooms and cover a total living area of 4815 m² (Figures 3 and 4). An independent consultancy office carried out a thermal diagnosis (Figure 5), which involved calculating the primary energy consumption of the residences using a regulatory calculation approach. The buildings were classified with respect to regulatory energy and greenhouse gas emission labels. Prospective areas of improvement to enhance the energy label were identified by the consultants.

<figure><img src="image_9.png" /><figcaption>**Figure 3.** Overview of the social housing complex used to illustrate the methodology [24].</figcaption></figure>

The assessment of the thermal state of the residential buildings also revealed shortcomings in the envelope of all the three buildings (Figure 5). An estimation of the overall heat transfer coefficient, *H*, was conducted and compared to a reference coefficient $H_{max}$ which serves as a benchmark for the overall heat transfer coefficient relative to the envelope. The comparison clearly showed that the buildings are insufficiently insulated. The initial assessment revealed that the thermal losses of the three residential buildings were evenly distributed. The two most significant sources of loss were discovered to be air renewal and windows, which contributed 28% and 25%, respectively. This was due to the use of obsolete single-glazed wooden windows in the building's envelope and a high rate of air change
in the single-flow ventilation system with self-regulating extract units. Thermal bridges and external walls made the second most significant contribution, accounting for 21% and 19% of the losses, respectively. The thermal bridges are critical because the presence of an electric underfloor heating system causes major losses at the points where the walls and floors converge. According to the evaluation, the initial steps in any renovation project should include implementing passive measures to reduce heat loss. These measures are especially desirable as they are usually inexpensive and easy to implement. These measures may include thermal insulation enhancement, efficient ventilation system installation, or thermal bridge removal with external insulation.

<figure><img src="image_10.png" /><figcaption>Figure 4. Top view of the social housing complex [24].</figcaption></figure>

<figure><img src="image_11.png" /><figcaption>Figure 5. Heat loss distribution of the buildings [24].</figcaption></figure>

## 4.2. Identification of Potential Renovation Scenarios

Several renovation scenarios, consisting of elementary actions aimed at achieving specific goals, were considered. These elementary actions were chosen in collaboration with designers and manufacturers to ensure alignment with the project objectives. The
elementary actions were combined to create global renovation scenarios, with a particular emphasis on cohesion and compatibility. The goal is to create renovation scenarios that improve thermal comfort and usability for tenants while reducing energy consumption and greenhouse gas emissions. To accomplish this, the renovation options are divided into seven distinct classes, each with its own specific set of individual energy performance improvement actions, as outlined in the European Energy Performance of Buildings Directive 2010/31/EU and Energy Efficiency Directive 2012/27/EU.

Seven global renovation scenarios were created by combining various elementary renovation actions (Table 3) in a variety of coherent ways:

- S1: Maintain existing individual electric heating and domestic hot water systems.

- S2: Improve individual electric heating and domestic hot water systems in version 1.

- S3: Improve individual electric heating and domestic hot water systems in version 2.

- S4: Individual electric heating and individual thermodynamic domestic hot water.

- S5: Individual gas heating and domestic hot water.

- S6: Individual electric heating and collective thermodynamic domestic hot water.

- S7: Individual electric heating and collective solar domestic hot water.

<table><caption>**Table 3.** The basic elementary actions [24].</caption><thead><tr><th>Class</th><th>Options</th></tr></thead><tbody><tr><td>Existing electric floor heating</td><td>Connected<br>Disconnected<br>Existing electric radiant heater<br>Smart and connected electric radiant heater</td></tr><tr><td>Auxiliary heating</td><td>Smart and connected electric storage heater<br>Low temperature hot water radiators<br>Automated towel warmer<br>Existing individual electric hot water tank<br>Smart and connected individual electric hot water tank</td></tr><tr><td>Domestic hot water production</td><td>Smart and connected individual thermodynamic hot water tank<br>Individual condensing gas boiler<br>Collective thermodynamic<br>Individual solar hot water tank with centralized solar hot water tank</td></tr><tr><td>Ventilation system</td><td>Existing controlled mechanical ventilation<br>Controlled mechanical ventilation with single-flow and a humidity-sensitive extract unit<br>None</td></tr><tr><td>Local energy production</td><td>Roof photovoltaic solar panels<br>Roof thermal solar panels<br>Roof hybrid solar panels<br>None</td></tr><tr><td>External joinery replacement</td><td>All external joinery double glazing<br>All external joinery triple glazing<br>Only on the balcony windows double glazing<br>Existing wall insulation</td></tr><tr><td>External wall insulation</td><td>External thermal insulation</td></tr></tbody></table>

These seven classes of global renovation scenarios were further subdivided into four variants designated as $S_{i,1}$ to $S_{i,4}$ where $i = 1, 2, \dots, 7$. In order to analyze their effect on performance, in each variant, the type of renewable energy production and joineries were modified while the heating and domestic hot water systems remained the same. For example, in some renovation scenarios, the installation of solar photovoltaic energy production or only the replacement of balcony windows were considered, whereas in others, all exterior windows were replaced and solar thermal energy production was installed. A total of 28 possible scenarios were considered (Figure 6).
<table><caption>Figure 6. Identification of global renovation scenarios from the basic elementary actions [24].</caption><thead><tr><th rowspan="2">N°</th><th rowspan="2">Basic renovation actions</th><th colspan="16">Global renovation scenarios</th></tr><tr><th>S1.1</th><th>S1.2</th><th>S1.3</th><th>S1.4</th><th>S2.1</th><th>S2.2</th><th>S2.3</th><th>S2.4</th><th>S3.1</th><th>S3.2</th><th>S3.3</th><th>S3.4</th><th>S4.1</th><th>S4.2</th><th>S4.3</th><th>S4.4</th><th>S5.1</th><th>S5.2</th><th>S5.3</th><th>S5.4</th><th>S6.1</th><th>S6.2</th><th>S6.3</th><th>S6.4</th><th>S7.1</th><th>S7.2</th><th>S7.3</th><th>S7.4</th></tr></thead><tbody><tr><td>a₁</td><td>Existing electric floor heating</td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td></tr><tr><td>a₁.1</td><td>Connected</td><td></td><td>●</td><td>●</td><td>●</td><td>●</td><td>●</td><td>●</td><td>●</td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td></tr><tr><td>a₁.2</td><td>Disconnected</td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td>●</td><td>●</td><td>●</td><td>●</td><td>●</td><td>●</td><td>●</td><td>●</td><td>●</td><td>●</td><td>●</td><td>●</td><td>●</td><td>●</td><td>●</td><td>●</td><td>●</td><td>●</td><td>●</td><td>●</td></tr><tr><td>a₂</td><td>Auxillary heating</td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td></tr><tr><td>a₂.1</td><td>Existing electric radiant heater</td><td></td><td>●</td><td>●</td><td>●</td><td>●</td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td></tr><tr><td>a₂.2</td><td>Smart and connected electric radiant heater</td><td></td><td></td><td></td><td></td><td>●</td><td>●</td><td>●</td><td>●</td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td></tr><tr><td>a₂.3</td><td>Smart and connected electric storage heater</td><td></td><td></td><td></td><td></td><td></td><td>●</td><td>●</td><td>●</td><td>●</td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td></tr><tr><td>a₂.4</td><td>Low temperature hot water radiators</td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td></tr><tr><td>a₂.5</td><td>Automated towel warmer</td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td>●</td><td>●</td><td>●</td><td>●</td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td></tr><tr><td>a₃</td><td>Domestic hot water production</td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td></tr><tr><td>a₃.1</td><td>Existing individual electric hot water tank</td><td></td><td>●</td><td>●</td><td>●</td><td>●</td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td></tr><tr><td>a₃.2</td><td>Smart and connected individual electric hot water tank</td><td></td><td></td><td></td><td></td><td>●</td><td>●</td><td>●</td><td>●</td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td></tr><tr><td>a₃.3</td><td>Smart and connected individual thermodynamic hot water tank</td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td></tr><tr><td>a₃.4</td><td>Individual condensing gas boiler</td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td></tr><tr><td>a₃.5</td><td>Collective thermodynamic</td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td></tr><tr><td>a₃.6</td><td>Individual solar centralized hot water tank</td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td></tr><tr><td>a₄</td><td>Controlled mechanical ventilation system</td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td></tr><tr><td>a₄.1</td><td>Existing controlled mechanical ventilation</td><td></td><td>●</td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td></tr><tr><td>a₄.2</td><td>CMV with single flow and humidity-sensitive extract unit</td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td>●</td><td>●</td><td>●</td><td>●</td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td></tr><tr><td>a₅</td><td>Local energy production</td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td></tr><tr><td>a₅.1</td><td>None</td><td></td><td>●</td><td>●</td><td>●</td><td>●</td><td></td><td></td><td>●</td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td></tr><tr><td>a₅.2</td><td>Roof Photovoltaic solar panels</td><td></td><td></td><td></td><td></td><td></td><td>●</td><td>●</td><td>●</td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td></tr><tr><td>a₅.3</td><td>Roof Thermal solar panels</td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td></tr><tr><td>a₅.4</td><td>Roof Hybrid solar panels</td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td></tr><tr><td>a₆</td><td>Exterior joinery replacement</td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td></tr><tr><td>a₆.1</td><td>None</td><td></td><td>●</td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td></tr><tr><td>a₆.2</td><td>All exterior joinery double glazing</td><td></td><td>●</td><td>●</td><td>●</td><td>●</td><td></td><td></td><td>●</td><td>●</td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td></tr><tr><td>a₆.3</td><td>All exterior joinery triple glazing</td><td></td><td>●</td><td>●</td><td>●</td><td>●</td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td></tr><tr><td>a₆.4</td><td>Only on the balcony windows double glazing</td><td></td><td>●</td><td>●</td><td>●</td><td>●</td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td></tr><tr><td>a₇</td><td>External wall insulation</td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td></tr><tr><td>a₇.1</td><td>Maintaining the existing wall insulation</td><td></td><td>●</td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td></tr><tr><td>a₇.2</td><td>External thermal insulation</td><td></td><td>●</td><td>●</td><td>●</td><td>●</td><td></td><td></td><td>●</td><td>●</td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td></tr></tbody></table>

### 4.3. Identification and Weighting of the Evaluation Criteria

This step involves developing a comprehensive set of criteria to evaluate the performance of the compared scenarios in terms of achieving the project objectives. Table 4 contains a set of criteria divided into four categories: technical, economic, environmental, and social. Each criterion will be evaluated using qualitative, quantitative, or binary methods, depending on the evaluation unit. The decision-makers must decide on the criteria that will be used to evaluate the effectiveness of the compared scenarios. The criteria serve as performance indicators and they must be quantifiable in the sense that they can be measured, at least qualitatively, in order to assess the expected performance of each scenario in relation to the criterion under consideration. It is beneficial to classify the criteria into families, especially given their large number. This classification allows for a more in-depth investigation of the issue by emphasizing how the scenarios balance one another. It also simplifies the process of determining weights because weights can be allocated first between criteria within the same family and then between families themselves. Furthermore, grouping by family allows for the retention of a greater number of criteria for
a decision analysis. One of the difficulties in selecting criteria is that their number must be kept to a minimum in order to avoid introducing redundancy or repeatability phenomena. A sound decision should be based on few, distinct, complementary criteria [65,93].

<table><caption>**Table 4.** Identification of assessment criteria with their respective weights.</caption><thead><tr><th>Category</th><th>Weight</th><th>Criteria</th><th>Description</th><th>Units</th><th>Absolute Weight</th></tr></thead><tbody><tr><td rowspan="5">Economic</td><td rowspan="5">45%</td><td>g1.1</td><td>Investment cost</td><td>€ excl. taxes</td><td>12.27</td></tr><tr><td>g1.2</td><td>Reinvestment cost over a period of 30 years</td><td>€ excl. taxes</td><td>10.64</td></tr><tr><td>g1.3</td><td>Possibility of financial subsidy</td><td>€ excl. taxes</td><td>4.09</td></tr><tr><td>g1.4</td><td>Operating cost</td><td>€ excl. taxes</td><td>12.27</td></tr><tr><td>g1.5</td><td>Energy cost effectiveness of the solution</td><td>€/kWh/(m²·year)</td><td>5.73</td></tr><tr><td rowspan="4">Technical</td><td rowspan="4">25%</td><td>g2.1</td><td>Ease to integrate into existing building</td><td>5-point scale</td><td>7.14</td></tr><tr><td>g2.2</td><td>Implementation in occupied space</td><td>Yes/No</td><td>10.71</td></tr><tr><td>g2.3</td><td>Maintenance/Serviceability</td><td>5-point scale</td><td>3.57</td></tr><tr><td>g2.4</td><td>Ease of monitoring/Energy management</td><td>5-point scale</td><td>3.57</td></tr><tr><td rowspan="4">Social</td><td rowspan="4">25%</td><td>g3.1</td><td>Impact of the cost on the tenant</td><td>€ excl. taxes</td><td>6.14</td></tr><tr><td>g3.2</td><td>Level of thermal comfort</td><td>5-point scale</td><td>4.77</td></tr><tr><td>g3.3</td><td>Level of acoustic comfort</td><td>5-point scale</td><td>2.05</td></tr><tr><td>g3.4</td><td>Aesthetics and space requirements</td><td>5-point scale</td><td>2.05</td></tr><tr><td rowspan="3">Environmental</td><td rowspan="3">15%</td><td>g4.1</td><td>Energy consumption reduction</td><td>kWh/m²·year</td><td>7.50</td></tr><tr><td>g4.2</td><td>Carbon dioxide emissions avoided</td><td>Ton of CO₂/year</td><td>5.00</td></tr><tr><td>g4.3</td><td>Production place</td><td>Km</td><td>2.50</td></tr></tbody></table>

Once the assessment criteria have been defined, it is imperative to establish their relative importance in the context of decision-making. This involves determining whether criterion “A” is more important to the decision-maker’s final choice than criterion “B” and quantifying the ratio of prevalence between them. To accomplish this, weights must be assigned to each of the selected criteria in the multi-criteria analysis. There are several methods for determining the appropriate weight to be assigned to each criterion. The Simos procedure or card method is a popular method, particularly in the context of outranking methods [94]. This method allows decision-makers, even those without prior knowledge of the multi-criteria analysis, to express their preferences for weighing criteria in each context. It involves presenting a set of cards corresponding to each criterion and asking decision-makers or expert groups to rank the criteria on a grid in increasing order of importance. It is possible to group together several criteria of equal importance and leave gaps between two consecutive cards to indicate an importance difference. Following this ranking, normalized weightings are assigned to the criteria [95]. The Simos procedure was revised and renamed the SRF procedure in 2002. The updated method introduced the Z ratio, which represents the weight of the most important criterion in relation to the least important. The ratio Z allows the normalization of the obtained criterion weights. As a result, changes in Z cause changes in the criterion weights [96].

Three independent steps are involved in determining the weights of the criteria. The first step is to assign an absolute weight to each of the categories of criteria using the SRF weighting procedure. The second step involves independently ranking the sub-criteria within each family and assigning them a relative weight. Finally, the absolute weights of each criterion are determined by multiplying their relative weights with those of the corresponding family weights. This method ensured that the weights were normalized and the significance of each criterion in the decision-making process was reflected.

### 4.4. Performance Matrix

Twenty-eight energy retrofit scenarios were developed by combining elementary renovation measures. To determine the economic viability of each scenario, information was gathered from suppliers and maintenance companies on the purchase, installation, and
maintenance costs of each component. Furthermore, the reinvestment costs over a period of thirty years were calculated based on the average lifespan of each component in the scenarios. This thirty-year period corresponds to standard building maintenance intervals. Engineering and sociology consultants (specialists in building and energy transition) were consulted to assess the technical and social performance of the energy retrofit scenarios. Qualitative criteria were evaluated for each elementary action within the same system category (such as domestic hot water production) using a scoring system ranging from 0 to 5. This approach was used for all the classes of elementary actions and criteria to generate an overall score on a linear distribution scale for each scenario. This results in a score on a scale of 5 representing the performance of each scenario for the criteria g2.1, g2.3, g2.4, g3.2, g3.3, and g3.4.

Collaboration with engineering consultants was used to compare the energy performance of the scenarios. The modeling tool employed simulates the behavior of the building, its various components, and systems. Multiple simulations were run to determine the primary and final energy consumption of each scenario by varying the input parameters such as the heating system, domestic hot water production, window type, and local energy production.

The evaluation process, with the collaboration and assistance of technical equipment suppliers and installers, technical engineering offices, a specialized sociology firm, and rental management experts, enabled the construction of the performance matrix. It includes the evaluations of each global renovation scenario shown based on the various criteria.

The data uncertainty is accounted for by representing it as probability density functions, specifically the normal distribution. The mean value $μ$ and the variance $v = σ^2$ are required to define the normal distribution for each alternative related to each criterion. The mean value is derived from the performance matrix, whereas the variance fluctuates based on the criterion under consideration.

Variance is denoted by Var in the performance matrix in Tables 5 and 6. To ensure uniform treatment of uncertainty in the decision-making process, a variance value of 0.1 is applied to all criteria, which helps to maintain model consistency and minimizes complexity. The variance value can be reassessed using statistical models that consider the data's evolution over time.

<table><caption>**Table 5.** Performance matrix of the global renovation scenarios—(Part 1).</caption><thead><tr><th rowspan="3">Scenarios</th><th colspan="8">Economical</th><th colspan="4">Technical</th></tr><tr><th>g1.1</th><th>g1.2</th><th>g1.3</th><th>g1.4</th><th>g1.5</th><th>g2.1</th><th>g2.2</th><th>g2.3</th><th>g2.4</th></tr><tr><th>€ excl.</th><th>€ excl.</th><th>€ excl.</th><th>€ excl.</th><th>€/kwh/m²·year</th><th>0 ... 5</th><th>Yes/No</th><th>0 ... 5</th><th>0 ... 5</th></tr></thead><tbody><tr><td>S1.1</td><td>0.00</td><td>1,757,134</td><td>0.00</td><td>82,701</td><td>0.00</td><td>5.00</td><td>Yes</td><td>4.38</td><td>3.57</td></tr><tr><td>S1.2</td><td>1,008,654</td><td>551,661</td><td>952,088</td><td>41,346</td><td>5933</td><td>3.33</td><td>Yes</td><td>5.00</td><td>3.57</td></tr><tr><td>S1.3</td><td>1,260,874</td><td>711,361</td><td>991,697</td><td>36,119</td><td>6591</td><td>3.00</td><td>Yes</td><td>5.00</td><td>3.57</td></tr><tr><td>S1.4</td><td>905,165</td><td>551,661</td><td>917,604</td><td>42,268</td><td>5457</td><td>3.67</td><td>Yes</td><td>5.00</td><td>3.57</td></tr><tr><td>S2.1</td><td>1,239,757</td><td>551,661</td><td>955,885</td><td>40,971</td><td>6771</td><td>2.33</td><td>Yes</td><td>4.38</td><td>4.29</td></tr><tr><td>S2.2</td><td>1,397,247</td><td>625,566</td><td>996,168</td><td>28,230</td><td>6736</td><td>1.67</td><td>Yes</td><td>3.75</td><td>3.57</td></tr><tr><td>S2.3</td><td>1,636,981</td><td>785,266</td><td>1,035,489</td><td>23,290</td><td>7185</td><td>1.33</td><td>Yes</td><td>3.75</td><td>3.57</td></tr><tr><td>S2.4</td><td>1,282,394</td><td>390,966</td><td>995,521</td><td>28,762</td><td>6255</td><td>2.00</td><td>Yes</td><td>3.75</td><td>3.57</td></tr><tr><td>S3.1</td><td>1,344,232</td><td>610,011</td><td>957,187</td><td>41,692</td><td>7140</td><td>2.00</td><td>Yes</td><td>4.38</td><td>5.00</td></tr><tr><td>S3.2</td><td>1,522,330</td><td>683,916</td><td>1,031,776</td><td>28,197</td><td>7087</td><td>1.33</td><td>Yes</td><td>3.75</td><td>4.29</td></tr><tr><td>S3.3</td><td>1,751,844</td><td>843,616</td><td>1,070,386</td><td>23,760</td><td>7526</td><td>1.00</td><td>Yes</td><td>3.75</td><td>4.29</td></tr><tr><td>S3.4</td><td>1,385,515</td><td>449,316</td><td>1,030,933</td><td>28,758</td><td>6545</td><td>1.67</td><td>Yes</td><td>3.75</td><td>4.29</td></tr><tr><td>S4.1</td><td>1,531,907</td><td>775,596</td><td>1,070,213</td><td>32,638</td><td>6586</td><td>1.67</td><td>Yes</td><td>3.75</td><td>5.00</td></tr><tr><td>S4.2</td><td>1,635,756</td><td>849,501</td><td>1,110,816</td><td>19,664</td><td>6342</td><td>1.00</td><td>Yes</td><td>3.13</td><td>4.29</td></tr><tr><td>S4.3</td><td>1,899,185</td><td>1,009,201</td><td>1,149,305</td><td>15,369</td><td>6895</td><td>0.67</td><td>Yes</td><td>3.13</td><td>4.29</td></tr><tr><td>S4.4</td><td>1,517,360</td><td>614,901</td><td>1,109,597</td><td>20,507</td><td>5980</td><td>1.33</td><td>Yes</td><td>3.13</td><td>4.29</td></tr><tr><td>S5.1</td><td>1,427,140</td><td>787,239</td><td>1,124,178</td><td>26,341</td><td>5284</td><td>1.33</td><td>No</td><td>2.50</td><td>2.86</td></tr><tr><td>S5.2</td><td>1,555,978</td><td>861,144</td><td>1,131,706</td><td>12,639</td><td>5229</td><td>0.67</td><td>No</td><td>1.88</td><td>2.14</td></tr></tbody></table>
<table><caption>Table 5. *Cont.*</caption><thead><tr><th rowspan="3">Scenarios</th><th colspan="8">Economical</th><th colspan="4">Technical</th></tr><tr><th>g1.1</th><th>g1.2</th><th>g1.3</th><th>g1.4</th><th>g1.5</th><th>g2.1</th><th>g2.2</th><th>g2.3</th><th>g2.4</th></tr><tr><th>€ excl.</th><th>€ excl.</th><th>€ excl.</th><th>€ excl.</th><th>€/kwh/m²·year</th><th>0 ... 5</th><th>Yes/No</th><th>0 ... 5</th><th>0 ... 5</th></tr></thead><tbody><tr><td>S5.3</td><td>1,796,800</td><td>1,020,844</td><td>1,204,438</td><td>10,007</td><td>5867</td><td>0.33</td><td>No</td><td>1.88</td><td>2.14</td></tr><tr><td>S5.4</td><td>1,492,598</td><td>626,544</td><td>1,131,267</td><td>12,444</td><td>5027</td><td>1.00</td><td>No</td><td>1.88</td><td>2.14</td></tr><tr><td>S6.1</td><td>1,372,026</td><td>811,447</td><td>1,030,582</td><td>35,809</td><td>6507</td><td>1.67</td><td>Yes</td><td>3.13</td><td>2.86</td></tr><tr><td>S6.2</td><td>1,526,016</td><td>885,352</td><td>1,071,164</td><td>22,827</td><td>6466</td><td>1.00</td><td>Yes</td><td>2.50</td><td>2.14</td></tr><tr><td>S6.3</td><td>1,717,070</td><td>1,045,052</td><td>1,109,732</td><td>18,439</td><td>6767</td><td>0.67</td><td>Yes</td><td>2.50</td><td>2.14</td></tr><tr><td>S6.4</td><td>1,377,529</td><td>650,752</td><td>1,070,150</td><td>23,678</td><td>5934</td><td>1.33</td><td>Yes</td><td>2.50</td><td>2.14</td></tr><tr><td>S7.1</td><td>1,404,394</td><td>847,315</td><td>995,961</td><td>37,880</td><td>6790</td><td>1.00</td><td>No</td><td>0.63</td><td>0.71</td></tr><tr><td>S7.2</td><td>1,533,952</td><td>921,220</td><td>1,070,209</td><td>24,669</td><td>6603</td><td>0.33</td><td>No</td><td>0.00</td><td>0.00</td></tr><tr><td>S7.3</td><td>1,771,679</td><td>1,080,920</td><td>1,109,007</td><td>20,125</td><td>7057</td><td>0.00</td><td>No</td><td>0.00</td><td>0.00</td></tr><tr><td>S7.4</td><td>1,432,939</td><td>686,620</td><td>1,035,825</td><td>25,267</td><td>6251</td><td>0.67</td><td>No</td><td>0.00</td><td>0.00</td></tr><tr><td>Var</td><td>0.1</td><td>0.1</td><td>0.1</td><td>0.1</td><td>0.1</td><td>0.1</td><td>0.1</td><td>0.1</td><td>0.1</td></tr></tbody></table>

<table><caption>Table 6. Performance matrix of the global renovation scenarios—(Part 2).</caption><thead><tr><th rowspan="3">Scenarios</th><th colspan="6">Social</th><th colspan="2">Environmental</th></tr><tr><th>g3.1</th><th>g3.2</th><th>g3.3</th><th>g3.4</th><th>g4.1</th><th>g4.2</th><th>g4.3</th></tr><tr><th>€ excl.</th><th>0 ... 5</th><th>0 ... 5</th><th>0 ... 5</th><th>kWh/m²·Year</th><th>Ton of CO₂/Year</th><th>km</th></tr></thead><tbody><tr><td>S1.1</td><td>368</td><td>0.00</td><td>5.00</td><td>4.00</td><td>0.00</td><td>0.00</td><td>0.00</td></tr><tr><td>S1.2</td><td>182</td><td>2.78</td><td>5.00</td><td>4.00</td><td>170</td><td>65</td><td>418</td></tr><tr><td>S1.3</td><td>159</td><td>3.33</td><td>5.00</td><td>4.00</td><td>191</td><td>74</td><td>690</td></tr><tr><td>S1.4</td><td>186</td><td>2.22</td><td>5.00</td><td>4.00</td><td>166</td><td>64</td><td>418</td></tr><tr><td>S2.1</td><td>168</td><td>4.44</td><td>4.00</td><td>4.00</td><td>183</td><td>71</td><td>2368</td></tr><tr><td>S2.2</td><td>141</td><td>4.44</td><td>4.00</td><td>4.00</td><td>207</td><td>80</td><td>2448</td></tr><tr><td>S2.3</td><td>118</td><td>5.00</td><td>4.00</td><td>4.00</td><td>228</td><td>88</td><td>2720</td></tr><tr><td>S2.4</td><td>144</td><td>3.89</td><td>4.00</td><td>4.00</td><td>205</td><td>79</td><td>2448</td></tr><tr><td>S3.1</td><td>162</td><td>2.22</td><td>3.00</td><td>2.00</td><td>188</td><td>73</td><td>2368</td></tr><tr><td>S3.2</td><td>133</td><td>2.22</td><td>3.00</td><td>2.00</td><td>215</td><td>83</td><td>2448</td></tr><tr><td>S3.3</td><td>113</td><td>2.78</td><td>3.00</td><td>2.00</td><td>233</td><td>90</td><td>2720</td></tr><tr><td>S3.4</td><td>136</td><td>1.67</td><td>3.00</td><td>2.00</td><td>212</td><td>82</td><td>2448</td></tr><tr><td>S4.1</td><td>114</td><td>2.22</td><td>1.00</td><td>0.00</td><td>233</td><td>90</td><td>2314</td></tr><tr><td>S4.2</td><td>86</td><td>2.22</td><td>1.00</td><td>0.00</td><td>258</td><td>99</td><td>2394</td></tr><tr><td>S4.3</td><td>66</td><td>2.78</td><td>1.00</td><td>0.00</td><td>275</td><td>106</td><td>2666</td></tr><tr><td>S4.4</td><td>91</td><td>1.67</td><td>1.00</td><td>0.00</td><td>254</td><td>98</td><td>2394</td></tr><tr><td>S5.1</td><td>164</td><td>0.56</td><td>0.00</td><td>1.00</td><td>270</td><td>5</td><td>2425</td></tr><tr><td>S5.2</td><td>0</td><td>0.56</td><td>0.00</td><td>1.00</td><td>298</td><td>33</td><td>2505</td></tr><tr><td>S5.3</td><td>113</td><td>1.11</td><td>0.00</td><td>1.00</td><td>306</td><td>50</td><td>2777</td></tr><tr><td>S5.4</td><td>137</td><td>0.00</td><td>0.00</td><td>1.00</td><td>297</td><td>32</td><td>2505</td></tr><tr><td>S6.1</td><td>138</td><td>3.89</td><td>5.00</td><td>5.00</td><td>211</td><td>81</td><td>2618</td></tr><tr><td>S6.2</td><td>110</td><td>3.89</td><td>5.00</td><td>5.00</td><td>236</td><td>91</td><td>2698</td></tr><tr><td>S6.3</td><td>90</td><td>4.44</td><td>5.00</td><td>5.00</td><td>254</td><td>98</td><td>2970</td></tr><tr><td>S6.4</td><td>114</td><td>3.33</td><td>5.00</td><td>5.00</td><td>232</td><td>89</td><td>2698</td></tr><tr><td>S7.1</td><td>142</td><td>4.44</td><td>3.00</td><td>3.00</td><td>207</td><td>80</td><td>2548</td></tr><tr><td>S7.2</td><td>114</td><td>4.44</td><td>3.00</td><td>3.00</td><td>232</td><td>89</td><td>2628</td></tr><tr><td>S7.3</td><td>93</td><td>5.00</td><td>3.00</td><td>3.00</td><td>251</td><td>97</td><td>2900</td></tr><tr><td>S7.4</td><td>117</td><td>3.89</td><td>3.00</td><td>3.00</td><td>229</td><td>88</td><td>2628</td></tr><tr><td>Var</td><td>0.1</td><td>0.1</td><td>0.1</td><td>0.1</td><td>0.1</td><td>0.1</td><td>0.1</td></tr></tbody></table>

### 4.5. Identification of Thresholds

To compare each alternative based on each criterion, it is essential to establish thresholds. These thresholds determine whether an alternative is preferred, equivalent, inferior, or incomparable to a boundary reference profile. These thresholds take into account the imperfect nature of data when evaluating alternative performances, as well as the subjectivity
that may affect criterion definition. As a result, it is necessary to define these thresholds for each criterion.

The ELECTRE Tri method allows decision-makers to define these thresholds based on their preferences and the importance of performance gaps, such as investment costs. Decision-makers, on the other hand, may lack expertise in certain criteria and struggle to define these thresholds. These tolerance thresholds are expressed as a percentage of the average performance for each criterion. The decision was motivated by practical considerations such as the large number of criteria and the experimental nature of the methodology. The thresholds can easily be modified through the parameter adjustment $γ$, thereby facilitating the analysis of the impact on scenario rankings. The indifference threshold is

$$q_j = \gamma_q \cdot \mu_j \qquad (6)$$

where:

- $γ_q = 5\%$ is the indifference threshold;

- $μ_j$ represents the average performance of all the scenarios on a given criterion defined by

$$\mu_j = \mu(g_j) = \frac{\sum_{i=1}^{m} g_j(S_i)}{m} \qquad (7)$$

The preference threshold is

$$p_j = \gamma_p \cdot \mu_j \qquad (8)$$

where $γ_p = 15\%$ is the preference threshold.

The veto threshold is

$$v_j = \gamma_v \cdot \mu_j \qquad (9)$$

where $γ_v = 30\%$ is the veto threshold.

## 4.6. Identification of Boundary Reference Profiles

The ranking categories are defined by boundary reference profiles and are denoted by $b^0, b^1, \dots, b^k, \dots, b^q$. The boundary reference profiles represent the boundary between two consecutive ranking categories, thus the lower boundary reference profile of a better category is also the upper boundary reference profile of a worse consecutive category. It is important to note that $b^0$ is the lowest boundary reference profile and $b^q$ is the highest boundary reference profile.

Six boundary reference profiles have been identified: $B = \{b^0, b^1, b^2, b^3, b^4, b^5\}$ in order to establish and define five distinct categories: $C = \{C^1, C^2, C^3, C^4, C^5\}$, where $b^1$ is the boundary between $C^1$ and $C^2$ and $b^2$ is the boundary between $C^2$ and $C^3$, and so on. The set of boundary reference profiles is typically constructed through an interactive process between the analyst and the decision-maker, making the use of the ELECTRE Tri method more time-consuming and complex (Table 7).

## 4.7. Degree of Credibility Index

The degree of credibility is calculated to measure the proximity of each alternative to each boundary reference profile and is compared to a cutting level $λ$. Through trial and error, it was determined that a cutting level of $λ = 0.75$ was appropriate. It is worth noting that a higher cutting level may result in alternatives that cannot be compared.

## 4.8. Sorting Procedure

In the final step, two sorting procedures, specific to the ELECTRE Tri method, are carried out to assign the alternatives to ranking categories: the “pessimistic ranking” and the “optimistic ranking”. The treatment of the incomparability (R) relationship varies between the two procedures. In the optimistic ranking, an incomparability relationship moves an alternative to the next higher performance category, while in the pessimistic ranking, it moves an alternative to the next lower performance category (Table 8).
<table><caption>**Table 7.** Identification of the boundary reference profiles and thresholds.</caption><thead><tr><th>Criteria</th><th>b<sup>0</sup></th><th>b<sup>1</sup></th><th>b<sup>2</sup></th><th>b<sup>3</sup></th><th>b<sup>4</sup></th><th>b<sup>5</sup></th><th>q<sub>j</sub></th><th>p<sub>j</sub></th><th>v<sub>j</sub></th></tr></thead><tbody><tr><td>g1.1</td><td>-4,224,020</td><td>-1,667,495</td><td>-1,528,955</td><td>-1,418,833</td><td>-1,330,025</td><td>212,825</td><td>70,942</td><td>212,825</td><td>468,215</td></tr><tr><td>g1.2</td><td>-3,749,830</td><td>-928,689</td><td>-837,382</td><td>-680,856</td><td>-602,593</td><td>-273,185</td><td>39,260</td><td>117,781</td><td>259,118</td></tr><tr><td>g1.3</td><td>-304,916</td><td>963,728</td><td>1,031,134</td><td>1,071,156</td><td>1,111,178</td><td>1,356,896</td><td>50,819</td><td>152,458</td><td>335,408</td></tr><tr><td>g1.4</td><td>-174,020</td><td>-38,545</td><td>-28,729</td><td>-24,522</td><td>-18,913</td><td>-5698</td><td>1436</td><td>4309</td><td>9480</td></tr><tr><td>g1.5</td><td>-16,904</td><td>-6853</td><td>-6717</td><td>-6376</td><td>-5491</td><td>926</td><td>309</td><td>926</td><td>2037</td></tr><tr><td>g2.1</td><td>-0.46</td><td>0.71</td><td>1.20</td><td>1.54</td><td>2.09</td><td>5.00</td><td>0.08</td><td>0.23</td><td>0.51</td></tr><tr><td>g2.2</td><td>0.00</td><td>0.00</td><td>0.00</td><td>1.00</td><td>1.00</td><td>1.00</td><td>0.00</td><td>1.00</td><td>2.00</td></tr><tr><td>g2.3</td><td>-0.90</td><td>1.93</td><td>2.60</td><td>3.26</td><td>4.00</td><td>5.00</td><td>0.15</td><td>0.45</td><td>0.98</td></tr><tr><td>g2.4</td><td>-0.90</td><td>1.98</td><td>2.35</td><td>3.30</td><td>4.28</td><td>5.00</td><td>0.15</td><td>0.45</td><td>0.99</td></tr><tr><td>g3.1</td><td>-778</td><td>-160</td><td>-137</td><td>-115</td><td>-99</td><td>-46</td><td>7.00</td><td>21</td><td>45</td></tr><tr><td>g3.2</td><td>-0.86</td><td>1.78</td><td>2.23</td><td>3.74</td><td>4.19</td><td>5.00</td><td>0.14</td><td>0.43</td><td>0.94</td></tr><tr><td>g3.3</td><td>-0.90</td><td>1.00</td><td>2.10</td><td>3.36</td><td>4.08</td><td>5.00</td><td>0.15</td><td>0.45</td><td>0.99</td></tr><tr><td>g3.4</td><td>-0.82</td><td>0.59</td><td>1.87</td><td>3.14</td><td>4.41</td><td>5.00</td><td>0.14</td><td>0.41</td><td>0.90</td></tr><tr><td>g4.1</td><td>-66</td><td>194</td><td>223</td><td>234</td><td>257</td><td>340</td><td>11</td><td>33</td><td>74</td></tr><tr><td>g4.2</td><td>-22</td><td>60</td><td>74</td><td>82</td><td>90</td><td>117</td><td>4.00</td><td>11</td><td>24</td></tr><tr><td>g4.3</td><td>-6616</td><td>-2737</td><td>-2657</td><td>-2496</td><td>-2376</td><td>338</td><td>113</td><td>338</td><td>744</td></tr></tbody></table>

<table><caption>**Table 8.** Optimistic and pessimistic rankings obtained with the probabilistic ELECTRE Tri procedure.</caption><thead><tr><th>Alternative</th><th>C1</th><th>C2</th><th>C3</th><th>C4</th><th>C5</th><th>Total</th><th>Alternative</th><th>C1</th><th>C2</th><th>C3</th><th>C4</th><th>C5</th><th>Total</th></tr></thead><tbody><tr><td>S1.1</td><td></td><td>100</td><td></td><td></td><td></td><td>100</td><td>S1.1</td><td></td><td>100</td><td></td><td></td><td></td><td>100</td></tr><tr><td>S1.2</td><td></td><td>28.4</td><td>71</td><td>0.6</td><td></td><td>100</td><td>S1.2</td><td>28.4</td><td>71</td><td>0.6</td><td></td><td></td><td>100</td></tr><tr><td>S1.3</td><td></td><td>0.7</td><td>65.8</td><td>33.3</td><td>0.2</td><td>100</td><td>S1.3</td><td>0.7</td><td>65.8</td><td>33.3</td><td>0.2</td><td></td><td>100</td></tr><tr><td>S1.4</td><td></td><td>41.9</td><td>58</td><td>0.1</td><td></td><td>100</td><td>S1.4</td><td>41.9</td><td>58</td><td>0.1</td><td></td><td></td><td>100</td></tr><tr><td>S2.1</td><td></td><td>14.5</td><td>82.6</td><td>2.9</td><td></td><td>100</td><td>S2.1</td><td>14.5</td><td>82.6</td><td>2.9</td><td></td><td></td><td>100</td></tr><tr><td>S2.2</td><td></td><td>0.2</td><td>3.1</td><td>53.9</td><td>42.8</td><td>100</td><td>S2.2</td><td>0.2</td><td>3.1</td><td>53.9</td><td>42.8</td><td></td><td>100</td></tr><tr><td>S2.3</td><td></td><td>2.2</td><td>7.3</td><td>65.7</td><td>24.8</td><td>100</td><td>S2.3</td><td>2.2</td><td>7.3</td><td>65.7</td><td>24.8</td><td></td><td>100</td></tr><tr><td>S2.4</td><td></td><td>0.1</td><td>3</td><td>57.8</td><td>39.1</td><td>100</td><td>S2.4</td><td>0.1</td><td>3</td><td>57.8</td><td>39.1</td><td></td><td>100</td></tr><tr><td>S3.1</td><td></td><td>14.4</td><td>82.3</td><td>3.3</td><td></td><td>100</td><td>S3.1</td><td>14.4</td><td>82.3</td><td>3.3</td><td></td><td></td><td>100</td></tr><tr><td>S3.2</td><td></td><td>1.3</td><td>4.3</td><td>94.4</td><td></td><td>100</td><td>S3.2</td><td>1.3</td><td>4.3</td><td>94.4</td><td></td><td></td><td>100</td></tr><tr><td>S3.3</td><td></td><td>7.4</td><td>34.9</td><td>57.7</td><td></td><td>100</td><td>S3.3</td><td>7.4</td><td>34.9</td><td>57.7</td><td></td><td></td><td>100</td></tr><tr><td>S3.4</td><td></td><td></td><td>6.4</td><td>93.6</td><td></td><td>100</td><td>S3.4</td><td></td><td></td><td>6.4</td><td>93.6</td><td></td><td>100</td></tr><tr><td>S4.1</td><td></td><td></td><td>100</td><td></td><td></td><td>100</td><td>S4.1</td><td></td><td>100</td><td></td><td></td><td></td><td>100</td></tr><tr><td>S4.2</td><td></td><td>0.4</td><td>99.6</td><td></td><td></td><td>100</td><td>S4.2</td><td>0.4</td><td>99.6</td><td></td><td></td><td></td><td>100</td></tr><tr><td>S4.3</td><td></td><td>33</td><td>67</td><td></td><td></td><td>100</td><td>S4.3</td><td>33</td><td>67</td><td></td><td></td><td></td><td>100</td></tr><tr><td>S4.4</td><td></td><td></td><td>100</td><td></td><td></td><td>100</td><td>S4.4</td><td></td><td>100</td><td></td><td></td><td></td><td>100</td></tr><tr><td>S5.1</td><td></td><td>100</td><td></td><td></td><td></td><td>100</td><td>S5.1</td><td></td><td>100</td><td></td><td></td><td></td><td>100</td></tr><tr><td>S5.2</td><td></td><td>100</td><td></td><td></td><td></td><td>100</td><td>S5.2</td><td></td><td>100</td><td></td><td></td><td></td><td>100</td></tr><tr><td>S5.3</td><td></td><td>92.9</td><td>7.1</td><td></td><td></td><td>100</td><td>S5.3</td><td>92.9</td><td>7.1</td><td></td><td></td><td></td><td>100</td></tr><tr><td>S5.4</td><td></td><td>100</td><td></td><td></td><td></td><td>100</td><td>S5.4</td><td></td><td>100</td><td></td><td></td><td></td><td>100</td></tr><tr><td>S6.1</td><td></td><td>0.1</td><td>40.7</td><td>58.1</td><td>1.1</td><td>100</td><td>S6.1</td><td>0.1</td><td>40.7</td><td>58.1</td><td>1.1</td><td></td><td>100</td></tr><tr><td>S6.2</td><td></td><td>0.3</td><td>11.6</td><td>87.9</td><td>0.2</td><td>100</td><td>S6.2</td><td>0.3</td><td>11.6</td><td>87.9</td><td>0.2</td><td></td><td>100</td></tr><tr><td>S6.3</td><td></td><td>21.7</td><td>75.9</td><td>2.4</td><td></td><td>100</td><td>S6.3</td><td>21.7</td><td>75.9</td><td>2.4</td><td></td><td></td><td>100</td></tr><tr><td>S6.4</td><td></td><td>0.3</td><td>0.7</td><td>94</td><td>5</td><td>100</td><td>S6.4</td><td>0.3</td><td>0.7</td><td>94</td><td>5</td><td></td><td>100</td></tr><tr><td>S7.1</td><td></td><td>100</td><td></td><td></td><td></td><td>100</td><td>S7.1</td><td></td><td>100</td><td></td><td></td><td></td><td>100</td></tr><tr><td>S7.2</td><td></td><td>100</td><td></td><td></td><td></td><td>100</td><td>S7.2</td><td></td><td>100</td><td></td><td></td><td></td><td>100</td></tr><tr><td>S7.3</td><td></td><td>100</td><td></td><td></td><td></td><td>100</td><td>S7.3</td><td></td><td>100</td><td></td><td></td><td></td><td>100</td></tr><tr><td>S7.4</td><td></td><td>100</td><td></td><td></td><td></td><td>100</td><td>S7.4</td><td></td><td>100</td><td></td><td></td><td></td><td>100</td></tr></tbody></table>

## 5. Results and Discussion

The purpose of this section is to compare the results of the newly implemented procedure to those obtained by using the traditional ELECTRE Tri method. The results are presented in the form of percentage rankings of the alternatives in each category. Firstly, the results obtained with the new procedure will be compared to those of the traditional ELECTRE Tri method to determine the additional information provided and the appropriate
methods of analysis. Secondly, the impact of incorporating variance into the data will be investigated to determine if all alternatives are affected in the same way.

The resulting table shows the percentage of each alternative classified in each category. This new way of representing the results adds significant information. The results obtained with and without the new procedure are compared in Table 9. This was applied to the case study, with the emphasis on the optimistic sorting of the four scenarios: 'S2.1', 'S2.2', 'S2.3', and 'S2.4'. This analysis holds true for the other alternatives as well as for the pessimistic ranking.

<table><caption>**Table 9.** Optimistic ranking obtained with and without the probabilistic ELECTRE Tri procedure for four scenarios.</caption><thead><tr><th>Alternative</th><th>C1</th><th>C2</th><th>C3</th><th>C4</th><th>C5</th><th>Alternative</th><th>C1</th><th>C2</th><th>C3</th><th>C4</th><th>C5</th><th>Total</th></tr></thead><tbody><tr><td>S2.1</td><td></td><td></td><td>X</td><td></td><td></td><td>S2.1</td><td>0</td><td>14.5</td><td>82.6</td><td>2.9</td><td>0</td><td>100</td></tr><tr><td>S2.2</td><td></td><td></td><td></td><td></td><td>X</td><td>S2.2</td><td>0</td><td>0.2</td><td>3.1</td><td>53.9</td><td>42.8</td><td>100</td></tr><tr><td>S2.3</td><td></td><td></td><td>X</td><td></td><td></td><td>S2.3</td><td>0</td><td>2.2</td><td>7.3</td><td>65.7</td><td>24.8</td><td>100</td></tr><tr><td>S2.4</td><td></td><td></td><td>X</td><td></td><td></td><td>S2.4</td><td>0</td><td>0.1</td><td>3</td><td>57.8</td><td>39.1</td><td>100</td></tr></tbody></table>

The probabilistic results shown on the righthand side of Table 9 give useful information about the alternatives.

Focusing on the alternative S2.1, it is clear that it is classified in category 3 in the traditional ELECTRE Tri method (lefthand side of Table 9). The new probabilistic procedure demonstrates that, by incorporating data fluctuation, this alternative is classified as 82.6% in category 3, 14.5% in category 2, and 2.9% in category 4.

This probabilistic classification gives information on the possibility of ranking alternatives in the face of uncertainty and variance. When comparing two alternatives that appear to be ranked equally, the percentage of ranking in other categories allows for differentiation. Let us consider two alternatives classified in different categories, 'S2.2' and 'S2.4', by using the traditional ELECTRE Tri method. These two alternatives are also classified in categories 2, 3, and 5 due to the incorporation of fluctuation. However, the alternative 'S2.2' is classified in category 5 more frequently at 42.8% than the alternative 'S2.4', which is only 39.1% in C5. These findings may lead to the conclusion that the 'S2.2' alternative outperforms the 'S2.4' alternative, allowing decision-makers to distinguish between two alternatives that initially appeared to be identical. This allocation enables a more detailed examination of elementary actions. The alternatives are carefully constructed to examine the impact of elementary actions on rankings. This additional information allows us to determine whether an elementary action improves the overall performance of an alternative.

Table 10 summarizes the outcomes of four alternatives: S2.1, S2.2, S3.1, and S3.2. All Group 2 options include an electric radiant panel and an existing electric floor, while all Group 3 options include electric storage heating but not electric floor heating. Otherwise, these two families of alternatives are identical, with solar panels on the roof distinguishing the index 2 alternatives from the index 1 alternatives. Alternatives with index 1 do not have an autonomous energy system. By analyzing these results, it is clear that the alternatives, which include solar panels, are better classified.

<table><caption>**Table 10.** Optimistic ranking obtained for four scenarios.</caption><thead><tr><th>Alternative</th><th>C1</th><th>C2</th><th>C3</th><th>C4</th><th>C5</th><th>Total</th></tr></thead><tbody><tr><td>S2.1</td><td>0</td><td>14.5</td><td>82.6</td><td>2.9</td><td>0</td><td>100</td></tr><tr><td>S2.2</td><td>0</td><td>0.2</td><td>3.1</td><td>53.9</td><td>42.8</td><td>100</td></tr><tr><td>S3.1</td><td>0</td><td>14.4</td><td>82.3</td><td>3.3</td><td>0</td><td>100</td></tr><tr><td>S3.2</td><td>0</td><td>1.3</td><td>4.3</td><td>94.4</td><td>0</td><td>100</td></tr></tbody></table>

Alternatives do not respond uniformly to the distributions applied by criteria. Some alternatives have been classified into four distinct categories, whereas others have only
been classified into one. Table 11 corresponds to the optimistic sorting obtained with the new procedure for the alternatives of family 2: ‘S2.1’, ‘S2.2’, ‘S2.3’, and ‘S2.4’, and family 7: ‘S7.1’, ‘S7.2’, ‘S7.3’, and ‘S7.4’. Both alternative families were subjected to fluctuations with similar standard deviations.

<table><caption>**Table 11.** Optimistic ranking of the alternatives of family 2 and 7's global renovation scenarios.</caption><thead><tr><th>Alternative</th><th>C1</th><th>C2</th><th>C3</th><th>C4</th><th>C5</th><th>Total</th><th>Alternative</th><th>C1</th><th>C2</th><th>C3</th><th>C4</th><th>C5</th><th>Total</th></tr></thead><tbody><tr><td>S2.1</td><td>0</td><td>14.5</td><td>82.6</td><td>2.9</td><td>0</td><td>100</td><td>S7.1</td><td>0</td><td>100</td><td>0</td><td>0</td><td>0</td><td>100</td></tr><tr><td>S2.2</td><td>0</td><td>0.2</td><td>3.1</td><td>53.9</td><td>42.8</td><td>100</td><td>S7.2</td><td>0</td><td>100</td><td>0</td><td>0</td><td>0</td><td>100</td></tr><tr><td>S2.3</td><td>0</td><td>2.2</td><td>7.3</td><td>65.7</td><td>24.8</td><td>100</td><td>S7.3</td><td>0</td><td>100</td><td>0</td><td>0</td><td>0</td><td>100</td></tr><tr><td>S2.4</td><td>0</td><td>0.1</td><td>3</td><td>57.8</td><td>39.1</td><td>100</td><td>S7.4</td><td>0</td><td>100</td><td>0</td><td>0</td><td>0</td><td>100</td></tr></tbody></table>

Based on their fluctuation values, the alternatives of family 2 can be classified into four distinct categories, whereas the alternatives of family 7 are consistently classified in the same category. This classification discrepancy is influenced by a variety of factors, including the performance of the alternatives' proximity to the established thresholds. Even minor data deviations can cause the threshold to be exceeded, resulting in a different classification. Furthermore, the weight assigned to each criterion being evaluated is important, because a change in performance for a criterion with a high weight is more likely to affect the overall results.

## 6. Validation

It is necessary to ensure that the results obtained are consistent in order to validate the new procedure. To accomplish this, the results with a very low variance should be identical to those obtained by implementing only the crisp values. The algorithm was first implemented by using the traditional ELECTRE Tri method without the Monte Carlo procedure. The algorithm was then implemented a second time, this time incorporating the new procedure and using a very low variance ($v = 0.000001$) with a repetition number of 10,000. Because the variance was so low, each alternative was classified in the same category as the one obtained with the traditional ELECTRE Tri method.

## 7. Conclusions

Multi-criteria decision analysis (MCDA) methods provide a valuable tool for understanding complex environmental problems by taking into account a variety of evaluation criteria and the classification of different alternatives. Despite the availability of data, it is critical to recognize the inherent uncertainty and variability of this information. To account for these uncertainties, it is proposed that data in the analysis be represented by probability distributions. It is possible to effectively address these probability distributions and fluctuations in data by integrating multi-criteria decision analysis methods, such as ELECTRE Tri, with a Monte Carlo implementation, resulting in a more robust ranking of alternatives.

The proposed new procedure adds significant Information by providing the percentage of rankings for each alternative within each category, allowing for a more detailed differentiation of alternatives. This method also makes it easier to compare alternatives that were previously ranked at the same level, allowing for a more detailed examination of the performance of individual actions within scenarios. To fully reap the benefits of this method, decision-makers must first understand the process, including how different data and parameters affect the results.

Furthermore, because they use the same performance matrix to group the input data for the analysis process, this procedure can be combined effectively with other multi-criteria decision analysis methods to ensure that no important information is overlooked. This method allows for a more comprehensive understanding of the sensitivity of the results to the input data and can help identify a wider range of potential outcomes by generalizing the use of probability distributions rather than crisp values.
**Author Contributions:** Conceptualization, R.V., N.G., C.G. and S.D.; methodology, M.B., R.V., N.G. and S.D.; software, R.V. and N.G.; validation, C.G.; formal analysis, C.G.; resources, C.G.; data curation, M.B., R.V., N.G. and S.D.; writing—original draft preparation, M.B.; writing—review and editing, C.G.; supervision, C.G.; project administration, C.G.; funding acquisition, C.G. All authors have read and agreed to the published version of the manuscript.

**Funding:** This research was funded by ANRT (National Association for Technological Research) through a CIFRE (Industrial convention for training through research) framework under the founding number 2019/0596 and the company 3F-Immobilière Rhône Alpes. The APC was funded by the company 3F-Immobilière Rhône Alpes.

**Data Availability Statement:** The code implementing the pELECTRE Tri method is available as an open source on Zenodo at https://doi.org/10.5281/zenodo.7967656.

**Acknowledgments:** The project was carried out in part within the company 3F-Immobilière Rhône Alpes in collaboration with Jean-Michel Paris, Director of Patrimony and Urban Renewal, and Gaël Wiederkehr Project Manager Patrimony. This work was made possible by collaboration with the following structures: ALTEREA, a consulting company specializing in energy retrofitting and sustainable buildings; TIPEE, an engineering company specializing in energy and environmental performance; OGGA, a company specialized in the design, manufacturing, and marketing of energy measurement and management solutions for buildings; and GBS, a sociology firm specializing in the ecological and energy transition of buildings.

**Conflicts of Interest:** The authors declare no conflict of interest. The funders had no role in the design of the study; in the collection, analyses, or interpretation of data; in the writing of the manuscript; or in the decision to publish the results.

## References

1. Barlow, S.; Fiala, D. Occupant comfort in UK offices—How adaptive comfort theories might influence future low energy office refurbishment strategies. *Energy Build.* **2007**, *39*, 837–846. [CrossRef]

2. Roberts, S. Altering existing buildings in the UK. *Energy Policy* **2008**, *36*, 4482–4486. [CrossRef]

3. International Energy Agency. *Transition to Sustainable Buildings: Strategies and Opportunities to 2050*; Organization for Economic Paris, France, 2013.

4. Jollands, N.; Waide, P.; Ellis, M.; Onoda, T.; Laustsen, J.; Tanaka, K.; de T'Serclaes, P.; Barnsley, I.; Bradley, R.; Meier, A. The 25 IEA energy efficiency policy recommendations to the G8 Gleneagles Plan of Action. *Energy Policy* **2010**, *38*, 6409–6418. [CrossRef]

5. Jagarajan, R.; Abdullah Mohd Asmoni, M.N.; Mohammed, A.H.; Jaafar, M.N.; Lee Yim Mei, J.; Baba, M. Green retrofitting—A review of current status, implementations and challenges. *Renew. Sustain. Energy Rev.* **2017**, *67*, 1360–1368. [CrossRef]

6. Chidiac, S.E.; Catania, E.J.C.; Morofsky, E.; Foo, S. A screening methodology for implementing cost effective energy retrofit measures in Canadian office buildings. *Energy Build.* **2011**, *43*, 614–620. [CrossRef]

7. Mahlia, T.M.I.; Razak, H.A.; Nursahida, M.A. Life cycle cost analysis and payback period of lighting retrofit at the University of Malaya. *Renew. Sustain. Energy Rev.* **2011**, *15*, 1125–1132. [CrossRef]

8. Ozcan, T.; Çelebi, N.; Esnaf, Ş. Comparative analysis of multi-criteria decision making methodologies and implementation of a warehouse location selection problem. *Expert Syst. Appl.* **2011**, *38*, 9773–9779. [CrossRef]

9. Pohoryles, D.A.; Maduta, C.; Bournas, D.A.; Kouris, L.A. Energy performance of existing residential buildings in Europe: A novel approach combining energy with seismic retrofitting. *Energy Build.* **2020**, *223*, 110024. [CrossRef]

10. Prades-Gil, C.; Viana-Fons, J.D.; Masip, X.; Cazorla-Marín, A.; Gómez-Navarro, T. An agile heating and cooling energy demand model for residential buildings. Case study in a mediterranean city residential sector. *Renew. Sustain. Energy Rev.* **2023**, *175*, 113166. [CrossRef]

11. Kaklauskas, A.; Zavadskas, E.; Raslanas, S. Multivariant design and multiple criteria analysis of building refurbishments. *Energy Build.* **2005**, *37*, 361–372. [CrossRef]

12. Ma, Z.; Cooper, P.; Daly, D.; Ledo, L. Existing building retrofits: Methodology and state-of-the-art. *Energy Build.* **2012**, *55*, 889–902. [CrossRef]

13. Si, J.; Marjanovic-Halburd, L.; Nasiri, F.; Bell, S. Assessment of building-integrated green technologies: A review and case study on applications of Multi-Criteria Decision Making (MCDM) method. *Sustain. Cities Soc.* **2016**, *27*, 106–115. [CrossRef]

14. Rabani, M.; Bayera Madessa, H.; Mohseni, O.; Nord, N. Minimizing delivered energy and life cycle cost using Graphical script: An office building retrofitting case. *Appl. Energy* **2020**, *268*, 114929. [CrossRef]

15. Jafari, A.; Valentin, V. Sustainable impact of building energy retrofit measures. *J. Green Build.* **2017**, *12*, 69–84. [CrossRef]

16. Coggins, A.M.; Wemken, N.; Mishra, A.K.; Sharkey, M.; Horgan, L.; Cowie, H.; Bourdin, E.; McIntyre, B. Indoor air quality, thermal comfort and ventilation in deep energy retrofitted Irish dwellings. *Build. Environ.* **2022**, *219*, 109236. [CrossRef]
17. Apostolopoulos, V.; Giourka, P.; Martinopoulos, G.; Angelakoglou, K.; Kourtzanidis, K.; Nikolopoulos, N. Smart readiness indicator evaluation and cost estimation of smart retrofitting scenarios—A comparative case-study in European residential buildings. *Sustain. Cities Soc.* **2022**, *82*, 103921. [CrossRef]

18. Alonso, A.; Patricio, J.; Suárez, R.; Escandón, R. Acoustical retrofit of existing residential buildings: Requirements and recommendations for sound insulation between dwellings in Europe and other countries worldwide. *Build. Environ.* **2020**, *174*, 106771. [CrossRef]

19. Ikuzwe, A.; Ye, X.; Xia, X. Energy-maintenance optimization for retrofitted lighting system incorporating luminous flux degradation to enhance visual comfort. *Appl. Energy* **2020**, *261*, 114379. [CrossRef]

20. Ongpeng, J.; Rabe, B.I.; Razon, L.; Aviso, K.; Tan, R. A multi-criterion decision analysis framework for sustainable energy retrofit in buildings. *Energy* **2021**, *239*, 122315. [CrossRef]

21. Taylor, N.W.; Searcy, J.K.; Jones, P.H. Multifamily energy-efficiency retrofit programs: A Florida case study. *Energy Effic.* **2016**, *9*, 385–400. [CrossRef]

22. Miller, W.; Liu, L.A.; Amin, Z.; Gray, M. Involving occupants in net-zero-energy solar housing retrofits: An Australian sub-tropical case study. *Sol. Energy* **2018**, *159*, 390–404. [CrossRef]

23. Napoli, G.; Bottero, M.C.; Ciulla, G.; Dell'Anna, F.; Figueira, J.R.; Greco, S. Supporting public decision process in buildings energy retrofitting operations: The application of a Multiple Criteria Decision Aiding model to a case study in Southern Italy. *Sustain. Cities Soc.* **2020**, *60*, 102214. [CrossRef]

24. Daniel, S.; Ghiaus, C. Multi-Criteria Decision Analysis for Energy Retrofit of Residential Buildings: Methodology and Feedback from Real Application. *Energies* **2023**, *16*, 902. [CrossRef]

25. Løken, E. Use of multicriteria decision analysis methods for energy planning problems. *Renew. Sustain. Energy Rev.* **2007**, *11*, 1584–1595. [CrossRef]

26. Kumar, A.; Sah, B.; Singh, A.R.; Deng, Y.; He, X.; Kumar, P.; Bansal, R.C. A review of multi criteria decision making (MCDM) towards sustainable renewable energy development. *Renew. Sustain. Energy Rev.* **2017**, *69*, 596–609. [CrossRef]

27. Pagone, E.; Salonitis, K. Comparative Study of Multi-criteria Decision Analysis Methods in Environmental Sustainability. In *Proceedings of the International Conference on Sustainable Design and Manufacturing, Tbilisi, Georgia, 2–3 October 2023*; pp. 223–231.

28. Sitorus, F.; Cilliers, J.; Brito-Parada, P. Multi-Criteria Decision Making for the Choice Problem in Mining and Mineral Processing: Applications and Trends. *Expert Syst. Appl.* **2019**, *121*, 393–417. [CrossRef]

29. Tscheikner-Gratl, F.; Egger, P.; Rauch, W.; Kleidorfer, M. Comparison of Multi-Criteria Decision Support Methods for Integrated Rehabilitation Prioritization. *Water* **2017**, *9*, 68. [CrossRef]

30. Haddad, M.J.; Sanders, D.A. Selecting a Best Compromise Direction for a Powered Wheelchair Using PROMETHEE. *IEEE Trans. Neural Syst. Rehabil. Eng.* **2019**, *27*, 228–235. [CrossRef]

31. Baczkiewicz, A.; Watróbski, J.; Kizielewicz, B.; Sałabun, W. Towards Objectification of Multi-Criteria Assessments: A Comparative Study on MCDA Methods. In *Proceedings of the 16th Conference on Computer Science and Intelligence Systems, Warsaw, Poland, 17–20 September 2021*; pp. 417–425.

32. Krstic Srejovic, A.; Figueira, J.; Greco, S.; Ehrgott, M. Multicriteria Decision Analysis: State of the art Surveys, Springer-Verlag, New York, NY, 2016. *Ekon. Horiz.* **2018**, *20*, 189–191. [CrossRef]

33. Bisdorff, R.; Dias, L.C.; Meyer, P.; Mousseau, V.; Pirlot, M. *Evaluation and Decision Models with Multiple Criteria*; Springer: Berlin/Heidelberg, Germany, 2015.

34. Turkson, C.; Acquaye, A.; Liu, W.; Papadopoulos, T. Sustainability assessment of energy production: A critical review of methods, measures and issues. *J. Environ. Manag.* **2020**, *264*, 110464. [CrossRef]

35. Liu, Y.; Ren, J. Overview of Sustainability, Sustainable Development and Sustainability Assessment: Concepts and Methods. In *Energy Systems Evaluation (Volume 1)*; Springer: Berlin/Heidelberg, Germany, 2021; pp. 1–29.

36. Pinto, M.C.; Crespi, G.; Dell'Anna, F.; Becchio, C. Combining energy dynamic simulation and multi-criteria analysis for supporting investment decisions on smart shading devices in office buildings. *Appl. Energy* **2023**, *332*, 120470. [CrossRef]

37. Hyard, A. Cost-benefit analysis according to Sen: An application in the evaluation of transport infrastructures in France. *Transp. Res. Part A: Policy Pract.* **2012**, *46*, 707–719. [CrossRef]

38. Dempsey, N.; Bramley, G.; Power, S.; Brown, C. The Social Dimension of Sustainable Development: Defining Urban Social Sustainability. *Sustain. Dev.* **2011**, *19*, 289–300. [CrossRef]

39. Bragança, L.; Mateus, R.; Koukkari, H. Building Sustainability Assessment. *Sustainability* **2010**, *2*, 2010–2023. [CrossRef]

40. Nelms, C.; Russell, A.D.; Lence, B.J. Assessing the performance of sustainable technologies for building projects. *Can. J. Civ. Eng.* **2005**, *32*, 114–128. [CrossRef]

41. Ridha, H.; Gomes, C.; Hizam, H.; Ahmadipour, M.; Heidari, A.A.; Chen, H. Multi-objective optimization and multi-criteria decision-making methods for optimal design of standalone photovoltaic system: A comprehensive review. *Renew. Sustain. Energy Rev.* **2021**, *135*, 110202. [CrossRef]

42. Pan, W.; Dainty, A.; Gibb, A. Establishing and Weighting Decision Criteria for Building System Selection in Housing Construction. *J. Constr. Eng. Manag.* **2012**, *138*, 1239–1250. [CrossRef]

43. Komaragiri, S.R.; Kumar, D.N. Irrigation Planning using Genetic Algorithms. *Water Resour. Manag.* **2004**, *18*, 163–176. [CrossRef]
44. Haddad, M.J.M. A framework that uses sensitivity analysis to select multi criteria decision making methods. *J. Comput. Syst. Eng.* **2017**, *413–419*.

45. Grabisch, M.; Perny, P. Agrégation multicritère. *Log. Floue Princ. Aide Décis.* **2003**, *81–120*.

46. Mulliner, E.; Malys, N.; Maliene, V. Comparative analysis of MCDM methods for the assessment of sustainable housing affordability. *Omega* **2016**, *59*, 146–156. [CrossRef]

47. Sałabun, W.; Wątróbski, J.; Shekhovtsov, A. Are MCDA methods benchmarkable? A comparative study of TOPSIS, VIKOR, COPRAS, and PROMETHEE II methods. *Symmetry* **2020**, *12*, 1549. [CrossRef]

48. Yilan, G.; Kadirgan, M.A.N.; Çiftçioğlu, G.A. Analysis of electricity generation options for sustainable energy decision making: The case of Turkey. *Renew. Energy* **2020**, *146*, 519–529. [CrossRef]

49. AbdelAzim, A.I.; Ibrahim, A.M.; Aboul-Zahab, E.M. Development of an energy efficiency rating system for existing buildings using Analytic Hierarchy Process—The case of Egypt. *Renew. Sustain. Energy Rev.* **2017**, *71*, 414–425. [CrossRef]

50. Medal, L.; Sunitiyoso, Y.; Kim, A. Prioritizing Decision Factors of Energy Efficiency Retrofit for Facilities Portfolio Management. *J. Manag. Eng.* **2021**, *37*, 04020109. [CrossRef]

51. Tang, C.; Xu, D.; Chen, N. Sustainability prioritization of sewage sludge to energy scenarios with hybrid-data consideration: A fuzzy decision-making framework based on full consistency method and fusion ranking model. *Environ. Sci. Pollut. Res. Int.* **2021**, *28*, 5548–5565. [CrossRef]

52. Kamaruzzaman, S.N.; Lou, E.C.W.; Wong, P.F.; Wood, R.; Che-Ani, A.I. Developing weighting system for refurbishment building assessment scheme in Malaysia through analytic hierarchy process (AHP) approach. *Energy Policy* **2018**, *112*, 280–290. [CrossRef]

53. Mirzaee, S.; Fannon, D.; Ruth, M. A comparison of preference elicitation methods for multi-criteria design decisions about resilient and sustainable buildings. *Environ. Syst. Decis.* **2019**, *39*, 439–453. [CrossRef]

54. Pamučar, D.; Behzad, M.; Božanić, D.; Behzad, M. Designing a fuzzy decision support framework for assessing solid waste management in the South European region. *Environ. Sci. Pollut. Res.* **2022**, *29*, 42862–42882. [CrossRef]

55. Mousavi-Nasab, S.H.; Sotoudeh-Anvari, A. A comprehensive MCDM-based approach using TOPSIS, COPRAS and DEA as an auxiliary tool for material selection problems. *Mater. Des.* **2017**, *121*, 237–253. [CrossRef]

56. Wang, E. Benchmarking whole-building energy performance with multi-criteria technique for order preference by similarity to ideal solution using a selective objective-weighting approach. *Appl. Energy* **2015**, *146*, 92–103. [CrossRef]

57. Pinzon Amorocho, J.A.; Hartmann, T. A multi-criteria decision-making framework for residential building renovation using pairwise comparison and TOPSIS methods. *J. Build. Eng.* **2022**, *53*, 104596. [CrossRef]

58. Shahnazari, A.; Rafiee, M.; Rohani, A.; Bhushan Nagar, B.; Ebrahiminik, M.A.; Aghkhani, M.H. Identification of effective factors to select energy recovery technologies from municipal solid waste using multi-criteria decision making (MCDM): A review of thermochemical technologies. *Sustain. Energy Technol. Assess.* **2020**, *40*, 100737. [CrossRef]

59. Brans, J.-P.; Vincke, P.; Mareschal, B. How to select and how to rank projects: The PROMETHEE method. *Eur. J. Oper. Res.* **1986**, *24*, 228–238. [CrossRef]

60. Mareschal, B.; Brans, J.P.; Vincke, P. PROMETHEE: A New Family of Outranking Methods in Multicriteria Analysis; ULB—Universite Libre de Bruxelles: Brussels, Belgium, 1984.

61. Ziemba, P.; Wątróbski, J.; Zioło, M.; Karczmarczyk, A.J.E. Using the PROSA method in offshore wind farm location problems. *Energies* **2017**, *10*, 1755. [CrossRef]

62. Brans, J.P.; Mareschal, B. PROMETHEE V: MCDM problems with segmentation constraints. *INFOR Inf. Syst. Oper. Res.* **1992**, *30*, 85–96. [CrossRef]

63. Brans, J.-P.; Mareschal, B. The PROMETHEE VI procedure: How to differentiate hard from soft multicriteria problems. *J. Decis. Syst.* **1995**, *4*, 213–223. [CrossRef]

64. Seddiki, M.; Anouche, K.; Bennadji, A.; Boateng, P. A multi-criteria group decision-making method for the thermal renovation of masonry buildings: The case of Algeria. *Energy Build.* **2016**, *129*, 471–483. [CrossRef]

65. Dirutigliano, D.; Delmastro, C.; Torabi Moghadam, S. A multi-criteria application to select energy retrofit measures at the building and district scale. *Therm. Sci. Eng. Prog.* **2018**, *6*, 457–464. [CrossRef]

66. Figueira, J.; Greco, S.; Ehrgott, M. State of the art surveys. In *Multiple Criteria Decision Analysis; Springer: Berlin/Heidelberg, Germany, 2005*.

67. Roy, B. The outranking approach and the foundations of ELECTRE methods. *Theory Decis.* **1991**, *31*, 49–73. [CrossRef]

68. Roy, B. Classement et choix en présence de points de vue multiples. *Rev. Fr. D'inform. Rech. Opér.* **1968**, *2*, 57–75. [CrossRef]

69. Roy, B. ELECTRE III: Un algorithme de classements fondé sur une représentation floue des préférences en présence de critères multiples. *Cah. Du CERO* **1978**, *20*, 3–24.

70. Roy, B.; Hugonnard, J.-C. Ranking of suburban line extension projects on the Paris metro system by a multicriteria method. *Transp. Res. Part A Gen.* **1982**, *16*, 301–312. [CrossRef]

71. Neves, D.; Baptista, P.; Simões, M.; Silva, C.A.; Figueira, J.R. Designing a municipal sustainable energy strategy using multi-criteria decision analysis. *J. Clean. Prod.* **2018**, *176*, 251–260. [CrossRef]

72. Yu, W. ELECTRE TRI(aspects méthodologiques et manuel d'utilisation). *Doc.-Univ. Paris-Dauphine LAMSADE* **1992**, *74*, 1–80.

73. Almeida-Dias, J.; Figueira, J.R.; Roy, B. Electre Tri-C: A multiple criteria sorting method based on characteristic reference actions. *Eur. J. Oper. Res.* **2010**, *204*, 565–580. [CrossRef]
74. Almeida-Dias, J.; Figueira, J.R.; Roy, B. A multiple criteria sorting method where each category is characterized by several reference actions: The Electre Tri-nC method. *Eur. J. Oper. Res.* **2012**, *217*, 567–579. [CrossRef]

75. Ramezanian, R. Estimation of the profiles in posteriori ELECTRE TRI: A mathematical programming model. *Comput. Ind. Eng.* **2019**, *128*, 47–59. [CrossRef]

76. Karakosta, C.; Doukas, H.; Psarras, J. A Decision Support Approach for the Sustainable Transfer of Energy Technologies under the Kyoto Protocol. *Am. J. Appl. Sci.* **2008**, *5*, 1720–1729. [CrossRef]

77. Madlener, R.; Antunes, C.; Dias, L. Assessing the performance of biogas plants with multi-criteria and data envelopment analysis. *Eur. J. Oper. Res.* **2009**, *197*, 1084–1094. [CrossRef]

78. Bernardo, H.; Gaspar, A.; Antunes, C.H. An application of a multi-criteria decision support system to assess energy performance of school buildings. *Energy Procedia* **2017**, *122*, 667–672. [CrossRef]

79. An advanced dice similarity measure of generalized fuzzy numbers and its application in multicriteria decision making. *Arab. J. Basic Appl. Sci.* **2020**, *27*, 75–92. [CrossRef]

80. Çalı, S.; Balaman, Ş.Y. A novel outranking based multi criteria group decision making methodology integrating ELECTRE and VIKOR under intuitionistic fuzzy environment. *Expert Syst. Appl.* **2019**, *119*, 36–50. [CrossRef]

81. Mousseau, V.; Figueira, J.; Naux, J.P. Using assignment examples to infer weights for ELECTRE TRI method: Some experimental results. *Eur. J. Oper. Res.* **2001**, *130*, 263–275. [CrossRef]

82. Cailloux, O.; Meyer, P.; Mousseau, V. Eliciting ELECTRE TRI category limits for a group of decision makers. *Eur. J. Oper. Res.* **2012**, *223*, 133–140. [CrossRef]

83. Carpitella, S.; Certa, A.; Izquierdo, J.; La Cascia, M. Multi-criteria decision-making approach for modular enterprise resource planning sorting problems. *J. Multi-Criteria Decis. Anal.* **2021**, *28*, 234–247. [CrossRef]

84. Mousseau, V.; Slowinski, R.; Zielniewicz, P. ELECTRE TRI 2.0 a. methodological guide and user's manual. *Doc. Du LAMSADE 1999*, **111**, 263–275.

85. Mary, S.S.A.; Suganya, G. Multi-criteria decision making using ELECTRE. *Circuits Syst.* **2016**, *7*, 1008–1020. [CrossRef]

86. Martin, C.; Legret, M. La méthode multicritère ELECTRE III: Définitions, principe et exemple d'application à la gestion des eaux pluviales en milieu urbain. *Bull. Des Lab. Des Ponts Et Chaussées* **2005**, 258–259.

87. Roy, B.; Bouyssou, D. *Aide Multicritère à La Décision: Méthodes et Cas*; Economica Paris: Paris, France, 1993.

88. Merad, M.M.; Verdel, T.; Roy, B.; Kouniali, S. Use of multi-criteria decision-aids for risk zoning and management of large area subjected to mining-induced hazards. *Tunn. Undergr. Space Technol.* **2004**, *19*, 125–138. [CrossRef]

89. Van de Schoot, R.; Kaplan, D.; Denissen, J.; Asendorpf, J.B.; Neyer, F.J.; Van Aken, M.A. A gentle introduction to Bayesian analysis: Applications to developmental research. *Child Dev.* **2014**, *85*, 842–860. [CrossRef] [PubMed]

90. Cramér, H. *Random Variables and Probability Distributions*; Cambridge University Press: Cambridge, UK, 2004.

91. Lyon, A. Why are normal distributions normal? *Br. J. Philos. Sci.* **2014**, *65*, 621–649. [CrossRef]

92. Gauthier, N.; Viala, R. pELECTRE-Tri: Probabilistic ELECTRE-Tri method—Application to energy renovation of buildings. *Zenodo* **2023**. [CrossRef]

93. Wang, J.-J.; Jing, Y.-Y.; Zhang, C.-F.; Zhao, J.-H. Review on multi-criteria decision analysis aid in sustainable energy decision-making. *Renew. Sustain. Energy Rev.* **2009**, *13*, 2263–2278. [CrossRef]

94. Simos, J. *Evaluer L'impact Sur L'environnement: Une Approche Originale Par l'Analyse Multicritère et la Négociation*; Presses polytechniques et universitaires romandes: Lausanne, Switzerland, 1990; Volume 1015.

95. Maystre, L.Y.; Pictet, J.; Simos, J. *Méthodes Multicritères ELECTRE: Description, Conseils Pratiques et Cas D'application à La Gestion Environnementale*; PPUR presses polytechniques: Lausanne, Switzerland, 1994; Volume 8.

96. Figueira, J.; Roy, B. Determining the weights of criteria in the ELECTRE type methods with a revised Simos' procedure. *Eur. J. Oper. Res.* **2002**, *139*, 317–326. [CrossRef]

**Disclaimer/Publisher's Note:** The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.