# Odor characterization of white wines produced from indigenous greek grape varieties using the frequency of attribute citation method with trained assessors

Evangelia Nanou, Emorfili Mavridou, Fotios Milienos, Georgios Papadopoulos, Sophie Tempere, Yorgos Kotseridis

► To cite this version:

Evangelia Nanou, Emorfili Mavridou, Fotios Milienos, Georgios Papadopoulos, Sophie Tempere, et al.. Odor characterization of white wines produced from indigenous greek grape varieties using the frequency of attribute citation method with trained assessors. Foods, 2020, 9 (10), pp.1-19. 10.3390/foods9101396. hal-03013904

HAL Id: hal-03013904

https://hal.inrae.fr/hal-03013904

Submitted on 19 Nov 2020

HAL is a multi-disciplinary open access
archive for the deposit and dissemination of sci-
entific research documents, whether they are pub-
lished or not. The documents may come from
teaching and research institutions in France or
abroad, or from public or private research centers.

L'archive ouverte pluridisciplinaire HAL, est
destinée au dépôt et à la diffusion de documents
scientifiques de niveau recherche, publiés ou non,
émanant des établissements d'enseignement et de
recherche français ou étrangers, des laboratoires
publics ou privés.

<figure><img src="image_1.png" /></figure>

Distributed under a Creative Commons Attribution 4.0 International License
Article

# Odor Characterization of White Wines Produced from Indigenous Greek Grape Varieties Using the Frequency of Attribute Citation Method with Trained Assessors

Evangelia Nanou<fnref n="1" />,*, Emorfili Mavridou<fnref n="1" />,*, Fotios S. Milienos<fnref n="2" />,*, Georgios Papadopoulos<fnref n="3" />, Sophie Tempère<fnref n="4" /> and Yorgos Kotseridis<fnref n="1" />,*

Received: 7 August 2020; Accepted: 29 September 2020; Published: 2 October 2020

<figure><img src="image_2.png" /></figure>

check for
updates

**Abstract:** The aim of this study was to investigate the sensory aroma profiles of white wines of the indigenous Greek grape varieties Assyrtiko, Malagousia, Moschofilero, and Roditis. Twenty-three panelists evaluated 17 wines of the aforementioned varieties using the frequency of attribute citation method. Three indices were calculated to assess panel performance in terms of reproducibility. Correspondence analysis and cluster analysis were employed to investigate the sensory space of the wines. Samples of the Roditis variety were characterized mainly by Banana and Vanilla odors; Assyrtiko samples had Earthy, Mushroom, and Nutty odors, as well as Lemon and Honey for some of the samples. Malagousia wines were described as having Lemon, Grapefruit, and Citrus blossom character, and they shared some descriptors with Assyrtiko wines, such as Mushroom and Earthy, and some with Moschofilero samples, i.e., floral and citrus notes. All Moschofilero wines exhibited a floral odor profile: specifically, Rose, Jasmine, or more Citrus blossom-like. Moreover, some Moschofilero samples also revealed a Grapefruit, Lemon, and/or Earthy character, while others expressed Honey notes. In conclusion, despite common characteristics found within varieties, some samples of different varieties exhibited overlapping profiles, and in some cases, samples of the same variety were quite different from each other.

**Keywords:** frequency of attribute citation; CATA; trained panel; correspondence analysis; cluster analysis; sensory analysis; aroma profile; Greek wines

## 1. Introduction

In the last decade, the wine produced from indigenous Greek grape varieties has been increasingly appreciated in the global wine market [1]. Assyrtiko, Malagousia, Moschofilero, and Roditis, as white varieties, and Agiorgitiko and Xinomavro, as red varieties, are gaining ground among other prestigious international grape varieties [2]. Assyrtiko is the most well-known Greek grape variety and initiated the discussion about Greek wine throughout the wine world [3]. Furthermore, it is the first Greek grape variety planted for commercial purposes in other countries, such as Australia, Cyprus, and Lebanon,

<footnote n="1">¹ Laboratory of Oenology & Alcoholic Drinks (LEAD), Department of Food Science & Human Nutrition, Agricultural University of Athens, 75 Iera Odos, 11855 Athens, Greece; enanou@aua.gr (E.N.); emorfili.mvrd@gmail.com (E.M.)</footnote>

<footnote n="2">² Department of Sociology, Panteion University of Social and Political Sciences, 136 Syngrou Avenue, 17671 Athens, Greece; milienos@panteion.gr</footnote>

<footnote n="3">³ Laboratory of Plant Breeding and Biometry, Department of Crop Science, Agricultural University of Athens, 75 Iera Odos, 11855 Athens, Greece; gpapadop@aua.gr</footnote>

<footnote n="4">⁴ Unité de Recherche Oenologie, EA 4577, USC 1366 INRA, ISVV, Université de Bordeaux, Bordeaux INP, F33882 Villenave d'Ornon, France; sophie.tempere@u-bordeaux.fr</footnote>

<footnote>* Correspondence: ykotseridis@aua.gr</footnote>
while new plantings are growing in Italy, South Africa, and the USA. Assyrtiko is believed to have originated from the volcanic island of Santorini, but it has now been planted throughout Greece [3,4]. Assyrtiko wines have been described as having lime, passion fruit, beeswax, flint, and 'salty' aromas [5]. Malagousia is another relatively well-known white variety. This grape variety was saved from extinction: most growers have abandoned it because of its sensitivity to oidium, but its distinctive aroma contributed to its re-plantation. It is planted all over the country and not related to any Protected Designations of Origin (PDOs) [4]. The aromatic profile of its wines ranges from herbal, minty, and citrusy to peachy and tropical, as well as floral [3,6]. Moschofilero is a variety located in northern Peloponnese, and it is the unique variety of the single varietal PDO Mantinia. The aromatic profile of its wines ranges from honeydew, red apple skin, and cantaloupe to grapefruit zest, lemon, and lime [7]. It has also been described as having floral aromas, specifically that of rose petals [6]. Roditis is one of the most planted varieties in Greece, and its aroma has been characterized as citrusy [8], melon [6], and sometimes mineral [6,8].

Wine aroma is modulated by different viticultural parameters, such as the climate and soil of the vineyard; the variety and clone; viticultural practices; winemaking procedures, such as pre-fermentation processing, yeast strain, and alcoholic fermentation conditions; and wine treatments from fining to bottling [9]. However, despite all of these parameters, most wines exhibit a characteristic and distinctive odor according to the grape variety from which they are produced [9]. All of the previously mentioned parameters can enhance or reduce this character.

The aroma profiles of the wines of the aforementioned main Greek commercial grape varieties are described in popular sources, such as books [4,6] and internet blogs [3,7,8]. However, scientific research on the typical characteristics of these varieties is scarce or even lacking. In particular, the wines produced from the aforementioned white grape varieties lack scientific resources that depict their characteristic aromas. In contrast, the literature has focused mainly on the red grape variety Agiorgitiko [10–14]. Nonetheless, there is relatively abundant research on Greek wines in terms of physicochemical analyses that highlight significant characteristics of these wines [15–19].

Conventional descriptive analysis has been used widely in the sensory analysis of wines [20]. However, previous research has pointed out some disadvantages of applying this method to characterize wines. Wines have a very complex aromatic matrix, and it has been proven that people can only recognize a limited number of attributes in a complex matrix [21,22]. Furthermore, Lawless [23] reported that rating intensity is a very difficult task when applied to complex products, such as wines. Thus, in this study, we chose to apply the frequency of attribute citation method. In this method, trained panelists are asked to review a list of attributes and check those that characterize each sample. This method has been applied in the past [24,25] and more recently [26], and it has produced comparable results to those of other descriptive methods, such as sorting tasks, conventional descriptive analysis, and the pivot profile method [24–26]. Furthermore, as this method does not require a rating task, cognitive fatigue is reduced; thus, it can be easily applied to wines.

Our research is the first scientific attempt to investigate the aroma profiles of wines of the varieties Assyrtiko, Malagousia, Moschofilero, and Roditis. We focused on the odor characteristics of these varieties and conducted a rigorous scientific study with a trained panel. The aim of this study was to elucidate how these varieties are characterized and differentiated from each other in terms of odor attributes by means of descriptive sensory analysis. We hypothesized that wines of the same variety would share a common sensory space in terms of odor character and that this profile would be distinct for each variety. Finally, we aimed to propose a guide to evaluate the performance of a whole panel and individual panelists in the case of wine typicality evaluation.
## 2. Materials and Methods

### 2.1. Wine Samples

Seventeen commercial white wines from 4 different grape varieties were used for this study, namely, Assyrtiko (3 samples), Malagousia (4 samples), Moschofilero (7 samples), and Roditis (3 samples). Table 1 shows the details of each wine sample, along with their physicochemical characteristics. All of the samples were 2018 vintage, except for ASR4 (2016). Wine samples were chosen according to the suggestions of the National Inter-Professional Organization of Vine and Wine; different places of origin were chosen in order to cover a high degree of variability for each variety. The wines had no contact with wood during their elaboration process. Before the final sensory evaluation by the panel, the wines were controlled by a team of enologists for any flaws in the wine, and all of them were found to be normal. However, some of them were found to be rather ‘tired’ and to have ‘lost’ their character and were thus eliminated before evaluation. Samples were stored in the Laboratory of Oenology and Alcoholic Drinks of the Agricultural University of Athens, and the sensory evaluation took place in December 2019.
<table><caption>**Table 1.** Wine samples included in the study, along with their physicochemical characteristics *.</caption><thead><tr><th>Code</th><th>Variety</th><th>Origin</th><th>Vintage</th><th>Density (g/mL at 20 °C)</th><th>Total Alcoholic Strength by Volume (%vol at 20 °C)</th><th>Volatile Acidity (g/L Acetic Acid)</th><th>Total Acidity (g/L Tartaric Acid)</th><th>pH</th><th>Total SO<sub>2</sub> (mg/L)</th><th>Residual Sugars (g/L)</th></tr></thead><tbody><tr><td>ASR1</td><td>Assyrtiko</td><td>Santorini</td><td>2018</td><td>0.9894 ± 0.0002</td><td>13.7 ± 0.10</td><td>0.53 ± 0.04</td><td>5.81 ± 0.16</td><td>3.07 ± 0.06</td><td>73 ± 4</td><td>&lt;2</td></tr><tr><td>ASR3</td><td>Assyrtiko</td><td>Macedonia (Drama)</td><td>2018</td><td>0.9891 ± 0.0002</td><td>14 ± 0.20</td><td>0.34 ± 0.04</td><td>5.59 ± 0.11</td><td>3.36 ± 0.07</td><td>78 ± 3</td><td>&lt;2</td></tr><tr><td>ASR4</td><td>Assyrtiko</td><td>Macedonia (Drama)</td><td>2016</td><td>0.9882 ± 0.0002</td><td>14.4 ± 0.13</td><td>0.28 ± 0.03</td><td>5.32 ± 0.17</td><td>3.28 ± 0.08</td><td>71 ± 4</td><td>&lt;2</td></tr><tr><td>MLG1</td><td>Malagousia</td><td>Attica</td><td>2018</td><td>0.9906 ± 0.0003</td><td>12.7 ± 0.15</td><td>0.28 ± 0.03</td><td>5.85 ± 0.11</td><td>3.32 ± 0.06</td><td>85 ± 3</td><td>&lt;2</td></tr><tr><td>MLG2</td><td>Malagousia</td><td>Macedonia (Drama)</td><td>2018</td><td>0.9893 ± 0.0002</td><td>12.1 ± 0.09</td><td>0.52 ± 0.06</td><td>5.62 ± 0.15</td><td>3.11 ± 0.05</td><td>95 ± 4</td><td>&lt;2</td></tr><tr><td>MLG3</td><td>Malagousia</td><td>Macedonia (Katerini)</td><td>2018</td><td>0.9876 ± 0.0002</td><td>14 ± 0.18</td><td>0.30 ± 0.03</td><td>4.95 ± 0.23</td><td>3.4 ± 0.05</td><td>99 ± 7</td><td>&lt;2</td></tr><tr><td>MLG4</td><td>Malagousia</td><td>Evia</td><td>2018</td><td>0.9905 ± 0.0003</td><td>12.9 ± 0.11</td><td>0.24 ± 0.02</td><td>5.55 ± 0.21</td><td>3.49 ± 0.03</td><td>79 ± 8</td><td>&lt;2</td></tr><tr><td>MSF1</td><td>Moschofilero</td><td>Peloponnese (Arkadia)</td><td>2018</td><td>0.9901 ± 0.0004</td><td>12 ± 0.10</td><td>0.15 ± 0.01</td><td>6.19 ± 0.25</td><td>3.34 ± 0.06</td><td>72 ± 5</td><td>&lt;2</td></tr><tr><td>MSF3</td><td>Moschofilero</td><td>Peloponnese (Arkadia)</td><td>2018</td><td>0.9902 ± 0.0003</td><td>11.8 ± 0.16</td><td>0.11 ± 0.04</td><td>6.11 ± 0.16</td><td>3.31 ± 0.05</td><td>68 ± 4</td><td>&lt;2</td></tr><tr><td>MSF4</td><td>Moschofilero</td><td>Peloponnese (Mantineia)</td><td>2018</td><td>0.9891 ± 0.0002</td><td>12.2 ± 0.17</td><td>0.12 ± 0.03</td><td>5.47 ± 0.18</td><td>3.19 ± 0.03</td><td>75 ± 6</td><td>&lt;2</td></tr><tr><td>MSF7</td><td>Moschofilero</td><td>Peloponnese (Mantineia)</td><td>2018</td><td>0.9883 ± 0.0002</td><td>12.8 ± 0.18</td><td>0.23 ± 0.04</td><td>5.66 ± 0.17</td><td>3.17 ± 0.06</td><td>81 ± 5</td><td>&lt;2</td></tr><tr><td>MSF8</td><td>Moschofilero</td><td>Peloponnese (Mantineia)</td><td>2018</td><td>0.9905 ± 0.0002</td><td>11.4 ± 0.2</td><td>0.17 ± 0.05</td><td>6.45 ± 0.18</td><td>3.18 ± 0.05</td><td>75 ± 4</td><td>&lt;2</td></tr><tr><td>MSF9</td><td>Moschofilero</td><td>Peloponnese (Mantineia)</td><td>2018</td><td>0.9889 ± 0.0002</td><td>12.9 ± 0.19</td><td>0.34 ± 0.05</td><td>4.46 ± 0.13</td><td>3.63 ± 0.04</td><td>72 ± 6</td><td>&lt;2</td></tr><tr><td>MSF10</td><td>Moschofilero</td><td>Peloponnese (Mantineia)</td><td>2018</td><td>0.9899 ± 0.0002</td><td>12.8 ± 0.17</td><td>0.4 ± 0.05</td><td>5.73 ± 0.16</td><td>3.51 ± 0.05</td><td>72 ± 4</td><td>&lt;2</td></tr><tr><td>ROD1</td><td>Roditis</td><td>Peloponnese (Olympia)</td><td>2018</td><td>0.9895 ± 0.0002</td><td>12.8 ± 0.13</td><td>0.22 ± 0.03</td><td>4.5 ± 0.21</td><td>3.55 ± 0.07</td><td>81 ± 5</td><td>&lt;2</td></tr><tr><td>ROD3</td><td>Roditis</td><td>Peloponnese (Achaia)</td><td>2018</td><td>0.9911 ± 0.0004</td><td>12.5 ± 0.12</td><td>0.17 ± 0.03</td><td>5.21 ± 0.15</td><td>3.58 ± 0.03</td><td>89 ± 7</td><td>&lt;2</td></tr><tr><td>ROD4</td><td>Roditis</td><td>Peloponnese (Aigio)</td><td>2018</td><td>0.9900 ± 0.0003</td><td>11.8 ± 0.11</td><td>0.29 ± 0.04</td><td>5.21 ± 0.14</td><td>3.4 ± 0.05</td><td>95 ± 4</td><td>&lt;2</td></tr></tbody></table>

<footnote>* All parameters were measured in triplicate. Values are shown as means ± standard deviation.</footnote>
## 2.2. Panelists

Twenty-three panelists (16 females and 7 males; mean age: 43 years (age range: 21–63 years))— students and staff of the Agricultural University of Athens—participated in the study. They were recruited on the basis of their interest and availability to participate in the study. They were habitual consumers of white wine. All of them passed through a series of screening tests to confirm their ability to take part in wine sensory assessments. Panelists were not paid for their participation.

## 2.3. Training Process

In total, 21 training sessions of 45 min took place over a period of five months. Panelists were instructed to refrain from eating, drinking, and smoking for 1 h prior to the sessions. Furthermore, they were asked to avoid the use of perfumes or perfumed cosmetics. Panelists attended these sessions over a period of 4 months. Training included the smelling of odor reference standards and describing the odors of wines.

In particular, during the first 3 sessions, panelists smelled aroma reference standards from an aroma box (Pulltex, Barcelona, Spain) in order to become familiarized with odors that can be found in wine. Furthermore, in the 2nd and 3rd sessions, they described two wines in each session using the wine aroma wheel of Noble et al. [27]. From the 4th training session onwards, a predetermined descriptor list was given to the panelists. This list was compiled after searching the literature for the varieties used in this study. To the best of our knowledge, no previous scientific work investigating the typical aromas of these varieties has been published. Thus, we checked the available grey literature, including blogs [3,5,8], magazines [28], and books [4,6].

A common list of 28 descriptors for all varieties was compiled using the aforementioned sources. Furthermore, from the 4th session onwards, different reference standards were presented to the panelists to familiarize them with the vocabulary. In some cases, different recipes for the same attribute were presented in order to narrow the list down to the most appropriate terms for the panel. In sessions 4–11, the first part included reference smelling, and the second part entailed describing two wines. At the end of each session, the results were discussed, and the most cited attributes for each wine were highlighted by the panel leader. In session 12, panelists evaluated 5 wines in booths using Compusense Cloud (Compusense, Guelph, ON, Canada) in order to familiarize them with the evaluation procedure. In sessions 13–18, panelists smelled reference standards during the first part, while, during the second part, they described 2–3 wines that were similar to those used in the study using up to five descriptors. In this stage, they were allowed to modify the list, i.e., to add descriptors that they felt were missing or remove descriptors that they did not find relevant or did not use. Table 2 shows the final list of the 25 descriptors along with odor categories of the attributes that were created by the panel in order to make the list more intuitive. Reference standards are also described in Table 2. References made by natural products were prepared at the beginning of each day in order to maintain their freshness throughout the training session.

In training session 19, panelists were asked to identify blind-coded reference standards. In session 20, a pretest was conducted using 4 wines of the study in duplicate in order to evaluate their performance. Training session 21 included feedback on the previous sessions and the smelling of reference standards. After these last sessions, the panel was deemed successfully trained and continued with the evaluation of the wines.
<table><caption>**Table 2.** Reference standards used during training. The amounts shown were added to 100 mL of white base wine unless otherwise stated.</caption><thead><tr><th>Odor Category</th><th>Descriptor</th><th>Reference Standard</th><th>Amount</th></tr></thead><tbody><tr><td rowspan="4">Citrus fruit</td><td>Lemon</td><td>Lemon peel (fresh)</td><td>1 g</td></tr><tr><td>Grapefruit</td><td>Grapefruit peel (fresh)</td><td>1 g</td></tr><tr><td>Lime</td><td>Lime peel (fresh)</td><td>0.5 g</td></tr><tr><td>Orange</td><td>Orange peel (fresh)</td><td>1 g</td></tr><tr><td rowspan="3">Tropical fruit</td><td>Melon</td><td>Standard (Vioryl)</td><td>6.25 µL</td></tr><tr><td>Banana</td><td>Isoamyl acetate 1g/L (Acros Organics)</td><td>3.5 mL</td></tr><tr><td>Pineapple</td><td>Pineapple juice (Amita)</td><td>25 mL</td></tr><tr><td rowspan="4">Other fruit</td><td>Apple</td><td>Standard (Vioryl)</td><td>12 µL</td></tr><tr><td>Pear</td><td>Pear (fresh)</td><td>Four 2 cm² pieces *</td></tr><tr><td>Peach</td><td>Peach juice (Amita)</td><td>25 mL</td></tr><tr><td>Apricot</td><td>Apricot juice (Amita)</td><td>25 mL</td></tr><tr><td rowspan="3">Floral</td><td>Citrus blossoms</td><td>Citrus blossoms water (Alona)</td><td>1 mL</td></tr><tr><td>Rose</td><td>Rose water (Alikon)</td><td>2.5 mL</td></tr><tr><td>Jasmine</td><td>Jasmine essence (13% in jojoba oil)</td><td>2 drops</td></tr><tr><td rowspan="4">Vegetal/Herbaceous</td><td>Fresh-cut Grass</td><td>cis-3-hexen-1-ol 1g/L (Acros Organics)</td><td>4.5 mL</td></tr><tr><td>Mint</td><td>Mint (Fino)</td><td>1 teabag soaked in 100 mL of hot water for 15 min and then added to the base wine</td></tr><tr><td>Tea</td><td>Mountain tea (Evripos)</td><td>1 teabag soaked in 100 mL of hot water for 15 min and then added to the base wine</td></tr><tr><td>Chamomile</td><td>Chamomile (Evripos)</td><td>1 teabag soaked in 100 mL of hot water for 15 min and then added to the base wine</td></tr><tr><td>Nuts</td><td>Nuts</td><td>Hazelnuts (Sklavenitis)</td><td>5 g crushed</td></tr><tr><td rowspan="2">Earthy</td><td>Mushroom</td><td>1-octen-3-ol 1g/L (Sigma Aldrich)</td><td>3 mL</td></tr><tr><td>Earthy</td><td>Wet soil</td><td>1 tablespoon *</td></tr><tr><td rowspan="3">Caramelized</td><td>Honey</td><td>Honey (Attiki)</td><td>15 mL</td></tr><tr><td>Caramel</td><td>Caramel aroma (Vahine)</td><td>1.5 g</td></tr><tr><td>Vanilla</td><td>Vanille bourbon aroma (Vahine)</td><td>1.5 g</td></tr><tr><td>Spicy</td><td>Pepper</td><td>White pepper</td><td>3 grains ground *</td></tr></tbody></table>

## 2.4. Wine Evaluation

The evaluation of the wine samples (17 wines in two replicates, i.e., 34 samples in total) was divided into four sessions of 8 or 9 samples over a period of two weeks. Wine bottles were opened 30 min prior to the test session and were verified to be free of cork taint by the panel leader. Then, 30 mL was poured into transparent INAO wine glasses [29] covered by plastic Petri dishes in order to allow volatiles to move to the headspace. Samples were left to reach room temperature (20 ± 1 °C). The testing room was ventilated and air-conditioned. Samples were evaluated orthonasally in individual booths. Panelists were asked to check 2–5 descriptors from the list that applied to the sample in front of them. A 10 min break was mandatory after the first 5 samples in each session. Between samples, a 1 min break was enforced. Samples were presented with 3-digit blinding codes in a monadic sequence according

<footnote>* Not added to the base wine.</footnote>
to a Latin Square Design. Data were collected using Compusense Cloud, Academic Consortium (Compusense, Guelph, ON, Canada).

## 2.5. Data Analysis

### 2.5.1. Individual Panelist Performance

The analysis of panel performance was initially focused on assessing panelists' reproducibility. For carrying out this task, three indices were computed for each of the 23 panelists. Specifically, $n_1$ and $n_{.1}$ denote the numbers of descriptors chosen by the panelist in the first and second replicate, respectively, $n_{11}$ denotes the number of common descriptors chosen by the panelist in both replicates, and $n$ denotes the total number of tested wines. The indices are defined as (a) $R = n^{-1} \Sigma(2n_{11}/(n_1 + n_{.1}))$, wherein the sum is extended over $n$ wines; (b) $p_{11} = n^{-1}\Sigma(n_{11}/n_{.1})$; and (c) the average chi-square statistic (under the assumption of independence) from $n$ wines.

The first two indices (i.e., *R* and *p*₁₁) have values in the interval [0, 1], and values close to 1 indicate a high reproducibility; these indices mainly focus on the estimation of the probability of choosing a descriptor in the second replicate given that it was chosen at the first replicate. The index denoted by *R* was used previously by Campo et al. [25]. The last index is the mean value of the *n* chi-square distances under the independence assumption between the two replicates; analytically, after computing the values for each panelist and each wine, a contingency table (with two rows and two columns) that included the frequency distribution of the two replicates was generated; then, the chi-square statistic was computed under the assumption of independent evaluations. The index for each panelist is the mean value of *n* resulting chi-square statistics, with large values indicating a lack of independence (reproducibility) between the two replicates.

In order to identify poor performances among panelists and exclude their evaluations from the dataset, a descriptive analysis was carried out on the three indices, along with a set of statistical tests for detecting outliers (Dixon test, Chi-square test, and Grubbs test, provided by the "outlier" package in r-project [30–33]).

### 2.5.2. Overall Panel Performance

For assessing the overall panel performance, we took the following into account: (a) the effect of the replicate (reproducibility) and product (discrimination ability) on the selection of descriptors, (b) the average reproducibility for each wine, and (c) the distances between the two replications for each wine (reproducibility). A descriptive analysis and methods such as Friedman's test, Cochran's Q test [34], and the non-metric multidimensional scaling (Sammon's non-linear mapping [35,36]) were conducted.

### 2.5.3. Product Characterization

Products' sensory profiles were first evaluated by descriptive analysis, and for each wine, the most frequently selected descriptors by the panel were identified. Correspondence analysis on a contingency table containing the average citation frequency of descriptors (for the most selected descriptors) was conducted in order to visualize the product and descriptor space. Moreover, the coordinates derived from the correspondence analysis were submitted to cluster analysis. Analytically, the decision about the underlying number of clusters was based on the package "NbClust" [37] using five distance measures (Euclidean, Manhattan, maximum, Canberra, and Minkowski) and six clustering methods (kmeans, ward.D, ward.D2, single, complete, and average) and evaluating any solution in which the number of clusters ranged from 2 to 10. Among the suggested optimal clustering solutions (30 in total), we chose the one suggested by the most combinations (measures and methods). The sensory profile of the derived clusters was further examined by correspondence analysis. All data analyses were run using the R-project [38]. Finally, a spider diagram with the averaged citation proportion of the most cited odor attributes for each cluster was created using Microsoft Excel 2016 (www.microsoft.com,
Microsoft, Redmond, WA, USA). In other words, for wines found in the same cluster, the average proportion of citations for each attribute was computed.

# 3. Results

## 3.1. Individual Panelist Performance

The individual assessment of panel performance included the analysis of the three indices: chi-square, *R*, and *p*₁₁ (Table 3, Supplementary Table S1). The minimum values of both *R* and *p*₁₁ (0.167) were found for panelist 2, whereas panelist 17 had the minimum value of the chi-square index. It should be mentioned that panelist 21 had the second smallest values of *R* and *p*₁₁ (note that these indices are highly correlated) and the third smallest value of the chi-square index; panelist 23 had the best performance according to all three indices. The Dixon test and Grubbs test for outliers (the normality assumption is not rejected at α = 5%) support a lack of outliers; this is not the case for the chi-square test (the alternative hypothesis is that the lowest value is an outlier). However, by excluding panelists 2 and 21 from our analysis, all of the tests for *R* and *p*₁₁ became non-significant; without these two panelists, the lowest values of *R* and *p*₁₁ were 0.215 and 0.242, respectively (both calculated for panelist 16). On that basis of these findings, it was decided that panelists 2 and 21 should be excluded from further analysis.

<table><caption>**Table 3.** Descriptive statistics and tests for outliers for the chi-square, *R*, and *p*₁₁ indices.</caption><thead><tr><th></th><th colspan="3">Index</th></tr><tr><th></th><th>Chi-Square</th><th><i>R</i></th><th><i>p</i><sub>11</sub></th></tr></thead><tbody><tr><td colspan="4">Descriptive Statistics</td></tr><tr><td>Mean</td><td>3.117</td><td>0.314</td><td>0.327</td></tr><tr><td>Std</td><td>1.106</td><td>0.084</td><td>0.087</td></tr><tr><td>Min</td><td>1.294</td><td>0.167</td><td>0.167</td></tr><tr><td>Max</td><td>5.517</td><td>0.523</td><td>0.527</td></tr><tr><td>First quartile</td><td>2.419</td><td>0.252</td><td>0.265</td></tr><tr><td colspan="4">Correlations</td></tr><tr><td>Chi-Square</td><td>1</td><td>0.852</td><td>0.848</td></tr><tr><td><i>R</i></td><td></td><td>1</td><td>0.979</td></tr><tr><td>Normality Test</td><td>0.867</td><td>0.913</td><td>0.802</td></tr><tr><td colspan="4">Tests for Outliers (<i>p</i>-values)</td></tr><tr><td>Chi-square</td><td>0.056</td><td>0.024</td><td>0.039</td></tr><tr><td>Dixon</td><td>0.968</td><td>0.555</td><td>0.699</td></tr><tr><td>Grubbs</td><td>0.584</td><td>0.370</td><td>0.539</td></tr></tbody></table>

## 3.2. Overall Panel Performance

Cochran's Q test (Table 4) showed that the overall effect of replicate on the descriptors is non-significant (*p* = 0.138), providing us with evidence for the panel's reproducibility. This is also the case for each descriptor separately, except for Nuts (*p* = 0.004; the descriptor "nuts" was chosen in 11.5% of the cases in the first session and in 18.5% of the cases in the second session). Table 4 also contains the *p*-values for the effect of product on the descriptors; there are significant effects on 16 descriptors (at a 10% significance level), which supports the ability of the panel to discriminate among products.

The average values of the three indices (chi-square, *R*, and *p*₁₁) for each wine can be found in Table 5; the *p*-values from the Friedman's test show that there is no statistically significant difference among wines (evidence for the panel's reproducibility). However, it seems that panelists faced some difficulties in reproducing descriptors for MLG4, ASR1, and MSF1, in contrast to MSF9, MSF10, and ASR3, which resulted in large values for the three indices.
<table><caption>**Table 4.** Assessing replicate and product effects using Cochran's Q test.</caption><thead><tr><th rowspan="3"></th><th colspan="3">Replicate Effect</th><th>Wine Effect</th></tr><tr><th colspan="3">Proportions</th><th rowspan="2">p-Value</th></tr><tr><th>p-Value</th><th>Replicate 1</th><th>Replicate 2</th></tr></thead><tbody><tr><td>All attributes</td><td>0.138</td><td>13.4%</td><td>14.2%</td><td>0.997</td></tr><tr><td>Apple</td><td>0.808</td><td>12.1%</td><td>12.8%</td><td>0.873</td></tr><tr><td>Apricot</td><td>0.617</td><td>2.5%</td><td>3.3%</td><td>0.100</td></tr><tr><td>Banana</td><td>0.190</td><td>25.2%</td><td>28.9%</td><td>&lt;0.001</td></tr><tr><td>Caramel</td><td>0.602</td><td>5.3%</td><td>6.5%</td><td>0.068</td></tr><tr><td>Chamomile</td><td>0.201</td><td>2.8%</td><td>4.8%</td><td>0.005</td></tr><tr><td>Citrus blossoms</td><td>0.782</td><td>38.8%</td><td>39.9%</td><td>0.096</td></tr><tr><td>Earthy</td><td>0.233</td><td>13.0%</td><td>10.4%</td><td>&lt;0.001</td></tr><tr><td>Fresh-cut Grass</td><td>0.241</td><td>13.0%</td><td>11.3%</td><td>0.114</td></tr><tr><td>Grapefruit</td><td>0.725</td><td>17.7%</td><td>19.9%</td><td>0.273</td></tr><tr><td>Honey</td><td>0.453</td><td>13.0%</td><td>15.2%</td><td>&lt;0.001</td></tr><tr><td>Jasmine</td><td>0.691</td><td>13.7%</td><td>12.2%</td><td>0.001</td></tr><tr><td>Lemon</td><td>0.698</td><td>23.6%</td><td>24.4%</td><td>&lt;0.001</td></tr><tr><td>Lime</td><td>0.134</td><td>11.5%</td><td>15.8%</td><td>0.007</td></tr><tr><td>Melon</td><td>0.896</td><td>10.9%</td><td>10.7%</td><td>0.004</td></tr><tr><td>Mint</td><td>0.705</td><td>5.3%</td><td>5.7%</td><td>0.093</td></tr><tr><td>Mushroom</td><td>0.112</td><td>15.5%</td><td>11.3%</td><td>0.001</td></tr><tr><td>Nuts</td><td>0.004</td><td>11.5%</td><td>18.5%</td><td>&lt;0.001</td></tr><tr><td>Orange</td><td>0.886</td><td>9.6%</td><td>8.9%</td><td>0.478</td></tr><tr><td>Peach</td><td>0.515</td><td>9.9%</td><td>11.9%</td><td>0.135</td></tr><tr><td>Pear</td><td>0.876</td><td>7.8%</td><td>7.7%</td><td>0.165</td></tr><tr><td>Pepper</td><td>0.371</td><td>2.8%</td><td>3.9%</td><td>0.208</td></tr><tr><td>Pineapple</td><td>0.467</td><td>17.4%</td><td>16.7%</td><td>0.511</td></tr><tr><td>Rose</td><td>0.253</td><td>33.9%</td><td>37.5%</td><td>&lt;0.001</td></tr><tr><td>Tea</td><td>0.257</td><td>5.9%</td><td>3.9%</td><td>0.773</td></tr><tr><td>Vanilla</td><td>0.606</td><td>13.0%</td><td>14.0%</td><td>0.003</td></tr></tbody></table>

<table><caption>**Table 5.** The average values of the three indices (chi-square, *R*, and *p*<sub>11</sub>) for each wine, along with the *p*-values from Friedman's test.</caption><thead><tr><th></th><th>Chi-Square</th><th>R</th><th>p<sub>11</sub></th></tr></thead><tbody><tr><td>ASR1</td><td>2.541</td><td>0.285</td><td>0.309</td></tr><tr><td>ASR3</td><td>4.031</td><td>0.360</td><td>0.388</td></tr><tr><td>ASR4</td><td>3.761</td><td>0.321</td><td>0.326</td></tr><tr><td>MLG1</td><td>2.958</td><td>0.312</td><td>0.334</td></tr><tr><td>MLG2</td><td>2.492</td><td>0.305</td><td>0.299</td></tr><tr><td>MLG3</td><td>3.479</td><td>0.314</td><td>0.333</td></tr><tr><td>MLG4</td><td>2.413</td><td>0.227</td><td>0.239</td></tr><tr><td>MSF1</td><td>2.533</td><td>0.292</td><td>0.302</td></tr><tr><td>MSF10</td><td>6.046</td><td>0.472</td><td>0.479</td></tr><tr><td>MSF3</td><td>3.380</td><td>0.333</td><td>0.366</td></tr><tr><td>MSF4</td><td>3.535</td><td>0.318</td><td>0.341</td></tr><tr><td>MSF7</td><td>3.221</td><td>0.350</td><td>0.348</td></tr><tr><td>MSF8</td><td>4.641</td><td>0.328</td><td>0.354</td></tr><tr><td>MSF9</td><td>3.315</td><td>0.358</td><td>0.382</td></tr><tr><td>ROD1</td><td>3.259</td><td>0.343</td><td>0.363</td></tr><tr><td>ROD3</td><td>2.666</td><td>0.315</td><td>0.329</td></tr><tr><td>ROD4</td><td>2.960</td><td>0.366</td><td>0.365</td></tr><tr><td><strong>p-values</strong></td><td><strong>0.989</strong></td><td><strong>0.925</strong></td><td><strong>0.950</strong></td></tr></tbody></table>

The chi-square distances between the two replications for each wine were assessed by a non-metric multidimensional scaling (based on Sammon's non-linear mapping). Indeed, the expected small distances between the two replications are confirmed by the results in Figure 1 for most of the 17 wines.
The few reproducibility difficulties mentioned above are partially supported by the multidimensional scaling method.

<figure><img src="image_3.png" /><figcaption>**Figure 1.** Multidimensional scaling for the first and second evaluation (using the chi-square distance between wines) based on Sammon's non-linear mapping.</figcaption></figure>

### 3.3. *Product Characterization*

Product sensory profiles were initially evaluated by the frequency of attribute citation. Table 6 shows the six most frequently selected descriptors for each wine. Among the top three most selected descriptors for ROD1, ROD3, and ROD4, we encounter three common descriptors: Banana, Rose, and Citrus blossoms. Lemon, Honey, Nuts, Earthy, and Citrus blossoms are some common descriptors for ASR1, ASR3, and ASR4. Moreover, Rose is the most selected descriptor for MSF3, MSF4, MSF9, and MSF10 (MSF9 and MSF10 have more similarities), whereas MSF1, MSF7, and MSF8 share Lemon and Citrus blossoms among their most frequently attributed descriptors. Some common descriptors for MLG1–MLG4 are Citrus blossoms, Rose, and Lemon. It is worth noting that the most selected descriptors for the wines MSF10 and MSF9, for which we obtained the largest reproducibility indices, were Rose, Citrus blossoms, Honey, and Jasmine.
<table><caption>**Table 6.** The six most frequently selected descriptors (proportion of selection in parenthesis) by the panel for each wine.</caption><thead><tr><th></th><th>Descriptors 1</th><th>Descriptors 2</th><th>Descriptors 3</th><th>Descriptors 4</th><th>Descriptors 5</th><th>Descriptors 6</th></tr></thead><tbody><tr><td>ASR1</td><td>Lemon (40%)</td><td>Citrus_blossoms (33%)</td><td>Grapefruit (26%)</td><td>Earthy (21%)</td><td>Nuts (21%)</td><td>Rose (21%)</td></tr><tr><td>ASR3</td><td>Nuts (36%)</td><td>Earthy (33%)</td><td>Citrus_blossoms (31%)</td><td>Lemon (31%)</td><td>Grapefruit (29%)</td><td>Mushroom (26%)</td></tr><tr><td>ASR4</td><td>Honey (38%)</td><td>Citrus_blossoms (38%)</td><td>Lemon (29%)</td><td>Rose (26%)</td><td>Mushroom (21%)</td><td>Nuts (21%)</td></tr><tr><td>MLG1</td><td>Rose (33%)</td><td>Citrus_blossoms (29%)</td><td>Lemon (29%)</td><td>Honey (24%)</td><td>Earthy (19%)</td><td>Peach (19%)</td></tr><tr><td>MLG2</td><td>Citrus_blossoms (32%)</td><td>Rose (29%)</td><td>Grapefruit (29%)</td><td>Lime (29%)</td><td>Fresh-cut_Grass (29%)</td><td>Lemon (26%)</td></tr><tr><td>MLG3</td><td>Citrus_blossoms (48%)</td><td>Rose (31%)</td><td>Banana (29%)</td><td>Grapefruit (29%)</td><td>Lemon (29%)</td><td>Pineapple (24%)</td></tr><tr><td>MLG4</td><td>Citrus_blossoms (41%)</td><td>Lemon (32%)</td><td>Vanilla (26%)</td><td>Rose (21%)</td><td>Grapefruit (21%)</td><td>Mushroom (18%)</td></tr><tr><td>MSF1</td><td>Citrus_blossoms (57%)</td><td>Banana (36%)</td><td>Lemon (26%)</td><td>Mushroom (24%)</td><td>Grapefruit (24%)</td><td>Rose (19%)</td></tr><tr><td>MSF10</td><td>Rose (68%)</td><td>Jasmine (41%)</td><td>Citrus_blossoms (38%)</td><td>Honey (29%)</td><td>Grapefruit (21%)</td><td>Mint (18%)</td></tr><tr><td>MSF3</td><td>Rose (36%)</td><td>Citrus_blossoms (36%)</td><td>Lemon (31%)</td><td>Nuts (24%)</td><td>Earthy (21%)</td><td>Banana (21%)</td></tr><tr><td>MSF4</td><td>Rose (50%)</td><td>Citrus_blossoms (44%)</td><td>Banana (35%)</td><td>Lime (18%)</td><td>Lemon (18%)</td><td>Fresh-cut_Grass (15%)</td></tr><tr><td>MSF7</td><td>Citrus_blossoms (57%)</td><td>Lemon (36%)</td><td>Rose (33%)</td><td>Lime (26%)</td><td>Banana (24%)</td><td>Apple (19%)</td></tr><tr><td>MSF8</td><td>Lemon (44%)</td><td>Citrus_blossoms (41%)</td><td>Rose (35%)</td><td>Banana (26%)</td><td>Mushroom (24%)</td><td>Lime (21%)</td></tr><tr><td>MSF9</td><td>Rose (62%)</td><td>Citrus_blossoms (45%)</td><td>Honey (43%)</td><td>Jasmine (29%)</td><td>Vanilla (24%)</td><td>Caramel (19%)</td></tr><tr><td>ROD1</td><td>Banana (60%)</td><td>Rose (45%)</td><td>Citrus_blossoms (31%)</td><td>Pineapple (31%)</td><td>Vanilla (29%)</td><td>Melon (19%)</td></tr><tr><td>ROD3</td><td>Banana (43%)</td><td>Rose (38%)</td><td>Citrus_blossoms (31%)</td><td>Melon (29%)</td><td>Pineapple (21%)</td><td>Honey (19%)</td></tr><tr><td>ROD4</td><td>Rose (47%)</td><td>Banana (47%)</td><td>Citrus_blossoms (35%)</td><td>Nuts (32%)</td><td>Vanilla (29%)</td><td>Mushroom (24%)</td></tr></tbody></table>
A correspondence analysis (the *p*-value from the chi-square test equals 0.04) on a contingency table containing the average citation frequency of descriptors was conducted in order to visualize the product and descriptor space. Specifically, the contingency table was computed based on the descriptors Banana, Citrus blossoms, Earthy, Grapefruit, Honey, Jasmine, Lemon, Mushroom, Nuts, Rose, and Vanilla; these descriptors are among the top three most selected descriptors, as reported in Table 6. Note that although Mushroom is not among the top three most selected descriptors, it was included in the contingency table because it was generally selected many times. Figure 2 shows products and attributes in the first two dimensions of the correspondence analysis (symmetrical plot), which explain 63.4% of the total variability. Therefore, Dim1 is characterized mainly by Lemon, Earthy, Mushroom, and Nuts in the positive part; Honey, Jasmine, and Rose are in the negative part. Dim2 is mainly characterized by Honey and Lemon in the positive part and by Banana and Vanilla in the negative part.

<figure><img src="image_4.png" /><figcaption>**Figure 2.** The two dimensions (symmetrical plot) of the correspondence analysis in the product and descriptor space.</figcaption></figure>

Among the samples of the variety Roditis, ROD1, ROD3, and ROD4 seem to have a similar profile (also see Table 6), which is mainly characterized by odors such as Banana, Vanilla, and Rose. ASR3 is characterized by Earthy and Nuts, while ASR1 is characterized by Lemon and, to some extent, Grapefruit, which can also be found in the description of ASR3. Among the samples of the Malagousia variety, MLG1 seems to have some distinct elements, such as Honey, while MLG3 is characterized by Citrus blossoms and Grapefruit. Samples of the Moschofilero variety seem to be more dispersed in the sensory space. MSF9 and MSF10 can be described as having Jasmine, Rose, and Honey odors, while MSF8 is described as Lemon and Earthy.

Moreover, from the residuals of the contingency table (not shown here due to space limitations) and their contribution to the total variability, we can derive the most influential relationships; according to this analysis, these relationships are as follows: (1) Earthy (3.89%) and Nutty (2.71%) odors in ASR3, (2) a Honey (3.40%) odor in ASR4, (3) Rose (2.01%) and Jasmine (4.79%) odors in MSF10, (3) a Honey
(5.37%) odor in MSF9, and (4) a Banana (4.60%) odor in ROD1. As can also be seen in Figure 2, ROD1, MSF9, ASR3, and MSF10 are the most influential wines overall.

Cluster analysis, carried out on the first three dimensions (explaining 76.7% of the variability) of the correspondence analysis, indicated the existence of 4 clusters in our set of wines (Table 7). The results show a clear grouping of the three wine samples from the Roditis variety. Additionally, the samples of the Malagousia variety are divided into two groups. Most of the Moschofilero samples are grouped in the first cluster with MLG3. MSF9 and MSF10 are very similar, and both are grouped in cluster 3. Among the Assyrtiko samples, ASR1, ASR3, and ASR4 are grouped in the same cluster. A correspondence analysis on a contingency table, in which rows are determined by descriptors and columns are determined by clusters, was run to visualize the sensory profile of each cluster (also see the Pearson residuals in the last part of Table 7). Hence, Figure 3 shows the products and the cluster space in the first two dimensions (symmetrical plot; explains 84.39% of the variability). A distinction among the four clusters can partially be seen (note the low quality of representation of Cluster 1, which is mainly due to the low representation of citrus blossoms): for example, Cluster 1 is mainly characterized by (in order) Citrus blossoms, Lemon, Banana, and Grapefruit; Cluster 2 is characterized by (in order) Earthy, Lemon, Mushroom, Nuts, and Grapefruit; Cluster 3 is characterized (in order) by Honey, Jasmine, and Rose; and Cluster 4 (in order) is characterized by Banana, Vanilla, Nuts, and Rose.

<table><caption>**Table 7.** The derived clustering solution and Pearson residuals from the deduced contingency table.</caption><thead><tr><th></th><th>Cluster 1</th><th>Cluster 2</th><th>Cluster 3</th><th>Cluster 4</th></tr></thead><tbody><tr><td></td><td>MSF1</td><td>ASR1</td><td>MSF10</td><td>ROD1</td></tr><tr><td></td><td>MSF4</td><td>ASR3</td><td>MSF9</td><td>ROD3</td></tr><tr><td></td><td>MSF7</td><td>ASR4</td><td></td><td>ROD4</td></tr><tr><td></td><td>MLG3</td><td>MLG1</td><td></td><td></td></tr><tr><td></td><td></td><td>MLG2</td><td></td><td></td></tr><tr><td></td><td></td><td>MLG4</td><td></td><td></td></tr><tr><td></td><td></td><td>MSF3</td><td></td><td></td></tr><tr><td></td><td></td><td>MSF8</td><td></td><td></td></tr><tr><td></td><td></td><td></td><td>Pearson Residuals *</td><td></td></tr><tr><td>Citrus blossoms</td><td>2.062</td><td>-0.850</td><td>-0.033</td><td>-0.953</td></tr><tr><td>Lemon</td><td>0.838</td><td>2.267</td><td>-1.862</td><td>-3.007</td></tr><tr><td>Banana</td><td>0.826</td><td>-1.709</td><td>-1.828</td><td>3.290</td></tr><tr><td>Grapefruit</td><td>0.672</td><td>0.746</td><td>-0.800</td><td>-1.283</td></tr><tr><td>Jasmine</td><td>-0.128</td><td>-1.594</td><td>3.349</td><td>-0.092</td></tr><tr><td>Rose</td><td>-0.263</td><td>-1.706</td><td>2.578</td><td>0.876</td></tr><tr><td>Mushroom</td><td>-0.703</td><td>1.726</td><td>-1.914</td><td>-0.363</td></tr><tr><td>Vanilla</td><td>-1.046</td><td>-0.766</td><td>0.194</td><td>2.239</td></tr><tr><td>Earthy</td><td>-1.326</td><td>2.327</td><td>-1.733</td><td>-0.764</td></tr><tr><td>Honey</td><td>-1.469</td><td>-0.192</td><td>3.410</td><td>-0.853</td></tr><tr><td>Nuts</td><td>-1.482</td><td>1.306</td><td>-1.477</td><td>0.821</td></tr></tbody></table>

Moreover, as shown in Figure 4, the most cited attribute for Cluster 1 is Citrus blossoms (over 50%), followed by Rose (about 33%). In Cluster 2, about 35% of the panelists cited Citrus blossoms; the second most cited term for Cluster 2 is Lemon (about 32%). Cluster 3 shows the maximum proportion of citations for Rose (65%), followed by Citrus blossoms, which was cited by more than 40% of the panelists. Finally, Banana was cited by 50% of the panel in Cluster 4, followed by Rose (over 40%). These results indicate that a flower character prevails in the aroma profiles of Clusters 1 and 3, while Cluster 2 also shows a lemonish character, and Cluster 4 is characterized by a banana aroma.

<footnote>* The *p*-value for the chi-square test was *p*-value < 0.001.</footnote>
<figure><img src="image_5.png" /><figcaption>**Figure 3.** The two dimensions (symmetrical plot) of the correspondence analysis in the cluster and descriptor space.</figcaption></figure>

<figure><img src="image_6.png" /><figcaption>**Figure 4.** Spider diagram with the average citation proportion of the most cited attributes for each cluster.</figcaption></figure>
## 4. Discussion

In this study, data analysis showed that the panelists had an adequate performance as a whole, after excluding two of them, and individually. The overall performance of the panel was based on the reproducibility of their evaluations and their discrimination ability. The former was evaluated through multidimensional scaling (Figure 1), Cochran's Q test (Table 4), and Friedman's test (Table 5), while the latter was assessed through the wine effect on attribute selection by Cochran's Q test (Table 4). Cochran's Q test is widely used to analyze binomial data obtained by sensory panels [39,40]. To evaluate individual performance, we proposed the use of three different indices in order to draw more objective conclusions. Thus, we used index R, first used by Campo et al. [25], index $p_{11}$, and the average chi-square statistic for the 17 wines. These analyses showed satisfactory results as well, allowing us to continue with further analysis of our data.

With regard to the sensory space of products and attributes, Figure 2 reveals a clear character of Banana and Vanilla aromas for the samples of the Roditis variety, as well as Jasmine, Rose, and Honey aromas for the MSF9 and MSF10 samples of the Moschofilero variety. MSF3 and MSF8 are described with a more citrus-fruit-like profile (Lemon, Grapefruit), while the rest of the Moschofilero samples are mainly characterized by Citrus blossoms. The samples of the Assyrtiko variety are associated with aromas such as Honey (ASR4) and Lemon (ASR4, ASR1), as well as Earthy, Mushroom, and Nuts (ASR3). In MLG1–MLG4 samples of the Malagousia variety, Citrus blossoms, Rose, and Lemon are among the top two most cited attributes by the panelists (Table 6). This can also be seen in Figure 2, where, additionally, the odor of Mushroom seems to play a role for MLG2. Interestingly, some samples of different grape varieties, such as ASR4 and MLG1 or ASR1 and MSF3, seem to be more similar to each other rather than to other samples of the variety to which they belong. This is also supported by the results of cluster analysis (Table 7, Figure 3).

Indeed, some clusters are formed by samples of different grape varieties. Specifically, Cluster 1 consists of samples from two varieties, and Cluster 2 comprises samples from three varieties, whereas Clusters 3 and 4 are homogeneous in terms of varietal character. Taking into consideration Figure 3 and Table 7, the odor attributes describing Cluster 1 are Citrus blossoms, Banana, Grapefruit, and Lemon. Cluster 2 is characterized by Grapefruit, Lemon, Nutty, Earthy, and Mushroom odors. Floral aromas such as Jasmine and Rose, as well as Honey, are attributed to Cluster 3. Finally, Banana, Vanilla, and Rose seem to be important attributes for Cluster 4. It should be noted that Citrus blossom seems to be a common characteristic for all clusters—this can also be seen in Table 6, where Citrus blossom is amongst the top three most cited terms for all samples—although, for Cluster 1, it is more important (see Table 7). These characteristics are also evident in the spider diagram (see Figure 4), where Citrus blossom is apparently cited frequently in all of the clusters, but it does not play an important role in the formation of all clusters, especially in Clusters 2 and 4 (see Table 7). Furthermore, although the attributes Earthy, Mushroom, and Nuts are not stressed in the spider diagram, they seem to be important for Cluster 2 in the cluster analysis.

Regarding cluster formation and varietal origin of the studied wines, Ballester et al. [41], similar to our work, reported that just belonging to a specific category is not enough for an item of this category to be described by the typical characteristics of the category. Furthermore, Rosch and Mervis [42] stated that a typical product can be described not only by the attributes of its own category but also by some attributes of other categories. Within a category, items do have common attributes, but each item does not possess all of the key attributes of that category. Thus, membership in a category has been described as a continuum, where some items may exhibit more typical characteristics than others. Hence, it should not be regarded as an indicator of the absolute inclusion in a category or exclusion from that category [43]. The importance of including samples from different varieties has also been stressed before in order to better explore the limits of the sensory space of a specific variety [41].

Previous research on volatile compounds has revealed the presence of 2-phenylethyl ethanol and phenylethyl acetate in Moschofilero wines [18,44]. These compounds have been further associated with flower aromas, especially rose [45]. This is in congruence with our finding that Moschofilero
wines exhibit a floral aroma, including a rose aroma. Moreover, Kechagia et al. [19] found key odorants that are responsible for fruity, honey, and floral aromas in Assyrtiko wines. Accordingly, in our study, Lemon, Grapefruit, and Honey were some of the most cited attributes for Assyrtiko samples. Tyrosol has been previously identified as one of the main phenolic compounds in seven Malagousia wines [46], and it is also known to be responsible for the honey aroma [47]. In our work, we observed that the honey aroma was frequently cited for one Malagousia wine (MLG1), as well as in wines of Assyrtiko (ASR4) and Moschofilero varieties (MSF9, MSF10). Moreover, tropical fruit and banana notes in wines of the Roditis variety have been previously reported [48], but no scientific sources are available on the aroma character of this variety. These correlations from the literature stress the importance of investigating key odor compounds in the study of the characteristic aromas of wines of these grape varieties.

The present study is, to our knowledge, the first scientific attempt to systematically investigate the sensory aroma profiles of wines of the indigenous Greek grape varieties Assyrtiko, Roditis, Malagousia, and Moschofilero, followed by the assessment of panel performance. Other studies have researched the chemical profiles of some of these varieties and their association with other factors, such as prefermentative treatments [19] and yeast interactions [18]. However, there are no published reports in the literature that aim to identify typical aromas of these varieties. We implemented extensive panel training and a sensory technique, i.e., the frequency of attribute citation, which has been used over the last decade as a reliable and more intuitive alternative to other sensory descriptive methods [24,26,49]. Furthermore, we used three indices to check panel reproducibility, followed by robust statistical analysis, in order to ensure objectivity in our conclusions. Reproducibility indices for binomial data have also been used in prior studies [25,50,51], and they are of indisputable value, as all our data rely on panel assessments. Moreover, we used a common descriptor list for all wines, and no information was given during the evaluation of the variety of each wine so that we could obtain results with no such cognitive bias. However, we should mention that although all samples were of the same vintage, except for one, we could not account for possible different winemaking processes, as these samples were commercial wines from different winemakers and different areas. Another limitation of this study is that the number of samples for the Assyrtiko and Roditis varieties was relatively low to allow firm conclusions regarding their aroma profiles.

**5. Conclusions**

Overall, this study provides a guide to evaluate the performance of a whole panel and individual panelists through statistical indices and analysis. Furthermore, sensory data indicate patterns in the aroma profiles of the wines of four indigenous Greek white grape varieties. Specifically, wine samples of the Roditis variety exhibit mainly a Banana and Vanilla odor profile. Assyrtiko wine samples are characterized by Earthy, Mushroom, and Nutty odors, as well as Lemon and Honey for some of the samples. Malagousia wines are described as having Lemon, Grapefruit, and Citrus blossom characters, and they also share some descriptors with Assyrtiko wines, such as Mushroom and Earthy, and some with Moschofilero samples, i.e., floral and citrus notes. All Moschofilero wine samples exhibit a floral odor profile: specifically, Rose, Jasmine, or more Citrus blossom-like. Moreover, some samples of Moschofilero also reveal a Grapefruit, Lemon, and/or Earthy character, while others express Honey notes. Thus, as is already known, the present work shows that although some descriptors are more characteristic of each of the studied varieties, some samples of different varieties have overlapping profiles, and in some cases, samples of the same variety are quite different from each other.

Future work should focus on using samples that have been vinified with the same protocol. This way, the confounding factor of different winemaking processes will be excluded, and firmer conclusions about aromas that characterize each variety can be drawn. Nonetheless, we should focus not only on finding the key attributes of each variety but also on attributes to define the boundaries of the sensory space of each variety. These findings should ultimately be related and explained by chemical analysis in order to find key odorants that are responsible for those aromas.
**Supplementary Materials:** The following are available online at http://www.mdpi.com/2304-8158/9/10/1396/s1: Table S1: Chi-Square, *R*, and *p*₁₁ values for each of the panelists individually.

**Author Contributions:** Conceptualization, Y.K., E.N., and S.T.; methodology, E.N., S.T., and F.S.M.; validation, Y.K., E.N., S.T., and F.S.M.; formal analysis, F.S.M., E.N., and G.P.; investigation, E.N. and E.M.; resources, Y.K. and E.N.; data curation, E.N., E.M., and F.S.M.; writing—original draft preparation, E.N. and F.S.M.; writing—review and editing, E.N., E.M., F.S.M., G.P., S.T., and Y.K.; visualization, E.N. and F.S.M.; supervision, Y.K.; project administration, Y.K.; funding acquisition, Y.K. All authors have read and agreed to the published version of the manuscript.

**Funding:** This research was performed within the framework of the project "The Vineyard Roads, Subproject 2: Chemical/organoleptic characterization of varieties—bio-synthetic paths—vinification". This research has been financed by Greek national funds through the Public Investments Program (PIP) of the General Secretariat for Research and Technology (GSRT), under the action "The Vineyard Roads". (Project code: 2018ΣΕ01300000; Title of project: "Emblematic research action of national scope for the exploitation of new technologies in the agri-food sector, specializing in genomic technologies and pilot application in the value chains of "olive", "grapevine", "honey", and "livestock").

**Acknowledgments:** The authors would like to thank the panelists who took part in the study.

**Conflicts of Interest:** The authors declare no conflict of interest.

**References**

1. Vlachos, V.A. A macroeconomic estimation of wine production in Greece. *Wine Econ. Policy* **2017**, *6*, 3–13.
[CrossRef]

2. Greek Vineyard & Varieties. Available online: https://www.greeceandgrapes.com/en/greek-vineyard (accessed on 12 September 2020).

3. Greek Varieties. Yiannis Karakasis MW. Available online: https://www.karakasis.mw/greek-varieties (accessed on 24 July 2020).

4. Robinson, J.; Harding, J.; Vouillamoz, J. *Wine Grapes: A Complete Guide to 1368 Vine Varieties, Including Their Origins and Flavours*; Penguin: London, UK, 2012; ISBN 978-0-06-220636-7.

5. Assyrtiko. Wine Folly. Available online: https://winefolly.com/grapes/assyrtiko/ (accessed on 31 July 2020).

6. Lazarakis, K. *The Wines of Greece*, 2nd ed.; Infinite Ideas Limited: Durrington, UK, 2018; ISBN 9781910902691.

7. Moschofilero. Wine Folly. Available online: https://winefolly.com/tips/3-greek-white-wines-for-summer-drinking/ (accessed on 31 July 2020).

8. Roditis. Wines of Greece. Available online: https://winesofgreece.org/varieties/roditis/ (accessed on 31 July 2020).

9. Soufleros, E. Factors affecting maturation and quality of grapes. In *Oenology*; Soufleros, E., Ed.; Evangelos Soufleros: Thessaloniki, Greece, 2015; pp. 119–124, ISBN 978-960-90699-6-0.

10. Koussissi, E.; Paterson, A.; Cristovam, E. Sensory Discrimination of Dry Red Wines from Greece. *J. Wine Res.* **2002**, *13*, 165–179. [CrossRef]

11. Koussissi, E.; Paterson, A.; Piggott, J.R. Sensory flavour discrimination of Greek dry red wines. *J. Sci. Food Agric.* **2003**, *83*, 797–808. [CrossRef]

12. Koussissi, E.; Paterson, A.; Paraskevopoulos, Y. Factors influencing sensory quality in red wines of the variety Aghiorghitiko (*Vitis vinifera* L.) from Nemea. *Eur. Food Res. Technol.* **2008**, *226*, 745–753. [CrossRef]

13. Koussissi, E.; Dourtoglou, V.G.; Ageloussis, G.; Paraskevopoulos, Y.; Dourtoglou, T.; Paterson, A.; Chatzilazarou, A. Influence of toasting of oak chips on red wine maturation from sensory and gas chromatographic headspace analysis. *Food Chem.* **2009**, *114*, 1503–1509. [CrossRef]

14. Kyraleou, M.; Kallithraka, S.; Chira, K.; Tzanakouli, E.; Ligas, I.; Kotseridis, Y. Differentiation of Wines Treated with Wood Chips Based on Their Phenolic Content, Volatile Composition, and Sensory Parameters. *J. Food Sci.* **2015**, *80*, C2701–C2710. [CrossRef] [PubMed]

15. Kallithraka, S.; Kotseridis, Y.; Kyraleou, M.; Proxenia, N.; Tsakiris, A.; Karapetrou, G.; Stamatina, K.; Yorgos, K.; Maria, K.; Niki, P.; et al. Analytical phenolic composition and sensory assessment of selected rare Greek cultivars after extended bottle ageing. *J. Sci. Food Agric.* **2015**, *95*, 1638–1647. [CrossRef]

16. Kallithraka, S.; Arvanitoyannis, I.; Kefalas, P.; El-Zajouli, A.; Soufleros, E.; Psarra, E. Instrumental and sensory analysis of Greek wines; implementation of principal component analysis (PCA) for classification according to geographical origin. *Food Chem.* **2001**, *73*, 501–514. [CrossRef]
17. Basalekou, M.; Kyraleou, M.; Pappas, C.; Tarantilis, P.; Kotseridis, Y.; Kallithraka, S. Proanthocyanidin content as an astringency estimation tool and maturation index in red and white winemaking technology. *Food Chem.* **2019**, *299*, 125135. [CrossRef]

18. Nisiotou, A.; Mallouchos, A.; Tassou, C.; Banilas, G. Indigenous Yeast Interactions in Dual-Starter Fermentations May Improve the Varietal Expression of Moschofilero Wine. *Front. Microbiol.* **2019**, *10*, 1712. [CrossRef]

19. Kechagia, D.; Paraskevopoulos, Y.; Symeou, E.; Galiotou-Panayotou, M.; Kotseridis, Y. Influence of Prefermentative Treatments to the Major Volatile Compounds of Assyrtiko Wines. *J. Agric. Food Chem.* **2008**, *56*, 4555–4563. [CrossRef] [PubMed]

20. Heymann, H.; Ebeler, S.E. *Sensory and Instrumental Evaluation of Alcoholic Beverages*; Elsevier Inc.: London, UK, 2017; ISBN 978-0-12-802727-1.

21. Laing, D.; Glemarec, A. Selective attention and the perceptual analysis of odor mixtures. *Physiol. Behav.* **1992**, *52*, 1047–1053. [CrossRef]

22. Laing, D.G. Characteristics of the Human Sense of Smell when Processing Odor Mixtures. In *The Human Sense of Smell*; Laing, D.G., Doty, R.L., Breipohl, W., Eds.; Springer: Berlin/Heidelberg, Germany, 1991; pp. 241–259, ISBN 978-3-642-76223-9.

23. Lawless, H.T. Descriptive analysis of complex odors: Reality, model or illusion? *Food Qual. Prefer.* **1999**, *10*, 325–332. [CrossRef]

24. Campo, E.; Ballester, J.; Langlois, J.; Dacremont, C.; Valentin, D. Comparison of conventional descriptive analysis and a citation frequency-based descriptive method for odor profiling: An application to Burgundy Pinot noir wines. *Food Qual. Prefer.* **2010**, *21*, 44–55. [CrossRef]

25. Campo, E.; Do, B.V.; Ferreira, V.; Valentin, D. Aroma properties of young Spanish monovarietal white wines: A study using sorting task, list of terms and frequency of citation. *Aust. J. Grape Wine Res.* **2008**, *14*, 104–115. [CrossRef]

26. Brand, J.; Valentin, D.; Kidd, M.; Vivier, M.A.; Næs, T.; Nieuwoudt, H.H. Comparison of pivot profile© to frequency of attribute citation: Analysis of complex products with trained assessors. *Food Qual. Prefer.* **2020**, *84*, 103921. [CrossRef]

27. Noble, A.C.; Arnold, R.A.; Buechsenstein, J.; Leach, E.J.; Schmidt, J.O.; Stern, P.M. Modification of a standardized system of wine aroma erminology. *Am. J. Enol. Vitic.* **1987**, *38*, 143–146.

28. Grape. Wine Stories. Athens. 2016, pp. 18–19. Available online: https://grapemag.gr/issue01/ (accessed on 17 July 2020).

29. ISO. NORM 3591 Sensory Analysis: Apparatus Wine Tasting Glass; International Organization for Standardization: Geneva, Switzerland, 1977.

30. Komsta, L. Outliers: Tests for Outliers. R Package Version 0.14. 2011. Available online: https://cran.r-project.org/web/packages/outliers/index.html (accessed on 4 May 2020).

31. Rorabacher, D.B. Statistical treatment for rejection of deviant values: Critical values of Dixon's "Q" parameter and related subrange ratios at the 95% confidence level. *Anal. Chem.* **1991**, *63*, 139–146. [CrossRef]

32. Dixon, W.J. Analysis of Extreme Values. *Ann. Math. Stat.* **1950**, *21*, 488–506. [CrossRef]

33. Grubbs, F.E. Sample Criteria for Testing Outlying Observations. *Ann. Math. Stat.* **1950**, *21*, 27–58. [CrossRef]

34. Conover, W.J. *Practical Nonparametric Statistics*, 3rd ed.; John Wiley & Sons Inc.: New York, NY, USA, 1999; ISBN 0471160687.

35. Sammon, J. A Nonlinear Mapping for Data Structure Analysis. *IEEE Trans. Comput.* **1969**, *401–409*. [CrossRef]

36. Everitt, B.S. *An R and S-Plus® Companion to Multivariate Analysis*; Springer Science & Business Media: London, UK, 2006; ISBN 1-85233-882-2.

37. Charrad, M.; Ghazzali, N.; Boiteau, V.; Niknafs, A. NbClust: An R Package for Determining the Relevant Number of Clusters in a Data Set. *J. Stat. Softw.* **2014**, *61*, 1–36. [CrossRef]

38. R Core Team. *R: A Language and Environment for Statistical Computing*; R Foundation for Statistical Computing: Vienna, Austria, 2019. Available online: https://www.r-project.org/ (accessed on 4 May 2020).

39. Varela, P.; Ares, G. Sensory profiling, the blurred line between sensory and consumer science. A review of novel methods for product characterization. *Food Res. Int.* **2012**, *48*, 983–908. [CrossRef]

40. Meyners, M.; Castura, J.C.; Carr, B.T. Existing and new approaches for the analysis of CATA data. *Food Qual. Prefer.* **2013**, *30*, 309–319. [CrossRef]
41. Ballester, J.; Dacremont, C.; Le Fur, Y.; Etiévant, P. The role of olfaction in the elaboration and use of the Chardonnay wine concept. *Food Qual. Prefer.* **2005**, *16*, 351–359. [CrossRef]

42. Rosch, E.; Mervis, C.B. Family resemblances: Studies in the internal structure of categories. *Cogn. Psychol.* **1975**, *7*, 573–605. [CrossRef]

43. Mervis, C.B.; Rosch, E. Categorization of Natural Objects. *Annu. Rev. Psychol.* **1981**, *32*, 89–115. [CrossRef]

44. Dourtoglou, V.; Antonopoulos, A.; Dourtoglou, T.; Lalas, S. Discrimination of varietal wines according to their volatiles. *Food Chem.* **2014**, *159*, 181–187. [CrossRef]

45. Zhao, C.Y.; Xue, J.; Cai, X.D.; Guo, J.; Li, B.; Wu, S. Assessment of the key aroma compounds in rose-based products. *J. Food Drug Anal.* **2016**, *24*, 471–476. [CrossRef]

46. Tourtoglou, C.; Nenadis, N.; Paraskevopoulou, A. Phenolic composition and radical scavenging activity of commercial Greek white wines from *Vitis vinifera* L. cv. Malagousia. *J. Food Compos. Anal.* **2014**, *33*, 166–174. [CrossRef]

47. Soufleros, E. Aromatic Compounds. In *Oenology*; Soufleros, E., Ed.; Evangelos Soufleros: Thessaloniki, Greece, 2015; pp. 194–195, ISBN 978-960-90699-6-0.

48. Roditis. Greece and Grapes. Available online: https://www.greeceandgrapes.com/variety?variety=%CE%A1%CE%BF%CE%B4%CE%AF%CF%84%CE%B7%CF%82&fbclid=IwAR1OGTWEbdIvmN9FL8cbDEqs5y_khPic7YVN3Vhj58BGkS--qc5FlR3BUj4 (accessed on 13 September 2020).

49. Alexi, N.; Nanou, E.; Lazo, O.; Guerrero, L.; Grigorakis, K.; Byrne, D.V. Check-All-That-Apply (CATA) with semi-trained assessors: Sensory profiles closer to descriptive analysis or consumer elicited data? *Food Qual. Prefer.* **2018**, *64*, 11–20. [CrossRef]

50. Meyners, M.; Castura, J.C.; Worch, T. Statistical evaluation of panel repeatability in Check-All-That-Apply questions. *Food Qual. Prefer.* **2016**, *49*, 197–204. [CrossRef]

51. Jaeger, S.R.; Chheang, S.L.; Yin, J.; Bava, C.M.; Giménez, A.; Vidal, L.; Ares, G. Check-all-that-apply (CATA) responses elicited by consumers: Within-assessor reproducibility and stability of sensory product characterizations. *Food Qual. Prefer.* **2013**, *30*, 56–67. [CrossRef]

<figure><img src="image_7.png" /></figure>

© 2020 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (http://creativecommons.org/licenses/by/4.0/).