# Multi-attribute temporal descriptive methods in sensory analysis applied in food science: Protocol for a scoping review

Michel Visalli, Mara Virginia Galmarini

► To cite this version:

Michel Visalli, Mara Virginia Galmarini. Multi-attribute temporal descriptive methods in sensory analysis applied in food science: Protocol for a scoping review. PLoS ONE, 2022, 17 (7), pp.e0270969. 10.1371/journal.pone.0270969. hal-03744281

HAL Id: hal-03744281

https://hal.inrae.fr/hal-03744281

Submitted on 2 Aug 2022

HAL is a multi-disciplinary open access
archive for the deposit and dissemination of sci-
entific research documents, whether they are pub-
lished or not. The documents may come from
teaching and research institutions in France or
abroad, or from public or private research centers.

L'archive ouverte pluridisciplinaire HAL, est
destinée au dépôt et à la diffusion de documents
scientifiques de niveau recherche, publiés ou non,
émanant des établissements d'enseignement et de
recherche français ou étrangers, des laboratoires
publics ou privés.

<figure><img src="image_1.png" /></figure>

Distributed under a Creative Commons Attribution 4.0 International License
STUDY PROTOCOL

# Multi-attribute temporal descriptive methods in sensory analysis applied in food science: Protocol for a scoping review

Michel Visalli<sup>1*</sup>, Mara Virginia Galmarini<sup>2,3</sup>

1 Centre des Sciences du Goût et de l'Alimentation, AgroSup Dijon, CNRS, INRAE, Université de Bourgogne Franche-Comté, Dijon, France, 2 Member of CONICET, Consejo Nacional de Investigaciones Científicas y Tecnológicas, Buenos Aires, Argentina, 3 Facultad de Ingeniería y Ciencias Agrarias, Pontificia Universidad Católica Argentina (UCA), Buenos Aires, Argentina

* michel.visalli@inrae.fr

<figure><img src="image_2.png" /></figure>

## Abstract

### Background

Sensory perception is a temporal phenomenon highly present in food evaluation. Over the last decades, several sensory analysis methods have been developed to determine how our processing of the stimuli changes during tasting. These methods differ in several parameters: how attributes are characterized (intensity, dominance or applicability), the number of attributes evaluated, the moment of sample characterization (simultaneously with the tasting in continuous or discrete time, retrospectively), the required panel (trained subjects or consumers), etc. At the moment, there is no systematic review encompassing the full scope of this topic. This article presents the protocol for conducting a scoping review on multi-attribute temporal descriptive methods in sensory analysis in food science.

### Methods

The protocol was developed according to the Preferred Reporting Items for Systematic reviews and Meta-Analyses (PRISMA) extension for Scoping Reviews checklist. The research question was "how have multi-attribute temporal descriptive methods been implemented, used and compared in sensory analysis?". The eligibility criteria were defined using the PICOS (Population, Intervention, Comparator, Outcome, Study design) framework. This protocol details how the articles of the final review will be retrieved, selected and analyzed. The search will be based on the querying of two academic research databases (Scopus and Web of Science). The main topics reported in research involving sensory analyses methods will be identified and summarized in a data extraction form. This form (detailed in the protocol) will be used to report pertinent information regarding the objectives of the review. It could also be reused as a guideline for carrying out and reporting results of future research in a more standardized way. A quality appraisal process was derived from literature. It will be applied on the included articles of the review, and could also be re-used to ensure that future publications meet higher quality levels. Finally, for the sake of transparency, the limitations of the protocol are discussed.

<figure><img src="image_3.png" /></figure>

OPEN ACCESS

**Citation:** Visalli M, Galmarini MV (2022) Multi-attribute temporal descriptive methods in sensory analysis applied in food science: Protocol for a scoping review. PLoS ONE 17(7): e0270969.
https://doi.org/10.1371/journal.pone.0270969

**Editor:** Nobuyuki Sakai, Tohoku University: Tohoku Daigaku, JAPAN

**Received:** February 23, 2022

**Accepted:** June 22, 2022

**Published:** July 26, 2022

**Peer Review History:** PLOS recognizes the benefits of transparency in the peer review process; therefore, we enable the publication of all of the content of peer review and author responses alongside final, published articles. The editorial history of this article is available here: https://doi.org/10.1371/journal.pone.0270969

**Copyright:** © 2022 Visalli, Galmarini. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.

**Data Availability Statement:** No datasets were generated or analysed during the current study. All relevant data from this study will be made available upon study completion.
**Funding:** The author(s) received no specific funding for this work.

**Competing interests:** The authors have declared that no competing interests exist.

# 1. Introduction

## 1.1. Background

As a result of mastication, bolus formation, contact with saliva and body temperature, food and beverage perception changes during oral processing and for this reason it is considered a temporal phenomenon. Sensory analysis aims at understanding the sensory perception of products by measuring subject responses. Thus, several temporal methods have been developed in the past 50 years trying to capture, study, describe and quantify these changes in perception. These methods and their main characteristics are listed in Table 1. One main reference is cited for each, in case the reader needs further detail and information.

The time lapse studied goes mostly from the moment in which the product gets in contact with the mouth until some seconds after swallowing. That is to say, the time it takes for a person to evaluate one intake of the product (e.g., one sip, one bite). However, food and beverage consumption has another temporality: bite after bite (or sip after sip) perception can also change due to cumulative sensory phenomenon. This type of temporality (multi-intake or full portion evaluation) was only recently studied and, even though many of the methods could be applied to this, only a few have been used.

Time Intensity (TI) [1] was the first temporal method developed. It measures (by means of a scale) the intensity of one given attribute over a continuous period of time. It was conceived as a sort of temporal version of the Quantitative Descriptive Analysis [12] but allowing only to

<table><caption>Table 1. Main sensory descriptive temporal methods published in peer-reviewed articles, in chronological order.</caption><thead><tr><td>Name of the method</td><td>Abbreviation</td><td>Number of attributes</td><td>Attribute generation</td><td>Variable measured</td><td>Temporal resolution</td><td>Main reference</td></tr></thead><tbody><tr><td>Time-Intensity</td><td>TI</td><td>1</td><td>Determined before the test (by the panel leader, etc.)</td><td>Intensity</td><td>Continuous</td><td>Lee & Pangborn (1986) [1]</td></tr><tr><td>Intensity Variation Descriptive Methodology</td><td>IVDM</td><td>&gt;1</td><td>Determined before the test (by the panel leader, by consensus, etc.)</td><td>Intensity</td><td>Discontinuous</td><td>Gordin (1987) [2]</td></tr><tr><td>Discontinuous Time-Intensity</td><td>DTI</td><td>&gt;1</td><td>Determined before the test (by the panel leader, by consensus, etc.)</td><td>Intensity</td><td>Discontinuous</td><td>Clark & Lawless (1994) [3]</td></tr><tr><td>Progressive Profile</td><td>PP</td><td>&gt;1</td><td>Determined before the test (by the panel leader, by consensus, etc.)</td><td>Intensity</td><td>Discontinuous</td><td>Jack et al. (1994) [4]</td></tr><tr><td>Dual-Attribute Time-Intensity</td><td>DATI</td><td>2</td><td>Determined before the test (by the panel leader, etc.)</td><td>Intensity</td><td>Continuous</td><td>Duizer et al. (1997) [5]</td></tr><tr><td>Temporal Dominance of Sensations</td><td>TDS-I TDS</td><td>&gt;1</td><td>Determined before the test (by the panel leader, by consensus, etc.)</td><td>Dominance and intensity (TDS-I) or dominance only (TDS)</td><td>Continuous</td><td>Pineau et al. (2009) [6]</td></tr><tr><td>Sequential Profile</td><td>SP</td><td>&gt;1</td><td>Determined before the test (by the panel leader, by consensus, etc.)</td><td>Intensity</td><td>Discontinuous</td><td>Methven et al. (2010) [7]</td></tr><tr><td>Multi-attribute Time-Intensity</td><td>MATI</td><td>&gt;1</td><td>Determined before the test (by the panel leader, by consensus, etc.)</td><td>Intensity</td><td>Continuous</td><td>Kuesten et al. (2013) [8]</td></tr><tr><td>Temporal Check All That Applies</td><td>TCATA</td><td>&gt;1</td><td>Determined before the test (by the panel leader, by consensus, etc.)</td><td>Applicability</td><td>Continuous</td><td>Castura et al. (2016) [9]</td></tr><tr><td>Attack Evolution Finish</td><td>AEF</td><td>&gt;1</td><td>Determined during the test (Free-Comment)</td><td>Dominance</td><td>3 periods (retrospective)</td><td>Visalli et al. (2020) [10]</td></tr><tr><td>Free-Comment Attack Evolution Finish</td><td>FC-AEF</td><td>&gt;1</td><td>Determined during the test (Free-Comment)</td><td>Applicability</td><td>3 periods (retrospective)</td><td>Mahieu et al. (2020) [11]</td></tr></tbody></table>

https://doi.org/10.1371/journal.pone.0270969.t001
measure one attribute at a time. TI has long been the temporal method of reference, but it presents several limitations: measuring only one descriptor at a time, which results in halo-dumping effect [3]. Moreover, the "signature" effect [13] (evaluators have a characteristic shape of the curve) requires a higher training to reduce variability and obtain curves that respond to product characteristics and not to individual differences, resulting also in panellist fatigue [14]. All other temporal methods have been developed trying to compensate for these limitations.

As in every quantitative method, the use of scales calls for trained assessors. But, unlike other Descriptive Analysis techniques, TI requires a higher concentration since the evaluator needs to be focused on the perception and changes in intensity for the given attribute over a period of time. This higher concentration and the continuous temporal manner of the measurement requires some extra training in comparison. In addition to the extra training sessions to manage this, measuring only one attribute increases the number of sessions needed if a multi-attribute temporal description of the product is required.

Aiming at reducing the number of sessions to attempt a description with more than one attribute, Dual Time Intensity (DATI, [5]) and Multi Attribute Time Intensity (MATI, [8]) were developed. But they were not widely implemented, probably due to the difficulty of the task: quantifying different attributes over continuous scales at the same time. Discontinuous time alternatives have been proposed to simplify the process and enable the recording of intensities within a single bite or sip ("single-intake") at uniform intervals steps or at specific moments using Intensity Variation Descriptive Methodology (IVDM, [2]), Discontinuous Time-Intensity (DTI, [3]), or Progressive Profile (PP, [4]), or over repeated or consecutive consumptions ("multiple-intakes") using Sequential Profile (SP, [7]).

Methods developed after this tried to simplify the task by recording only qualitative data. Temporal Dominance of Sensations (TDS, [6]) introduced the concept of *dominance* (different from intensity) asking the subject to choose (from a given list) the sequence of dominant sensations. As a matter of fact, when TDS was first presented, panelists were also asked to rate the intensity of the chosen attributes. But, as it was soon deemed too difficult and the intensity scoring was disused. Temporal Check-All-That-Apply (TCATA, [9]) was developed as an alternative to TDS registering the presence/absence ("applicability") of all attributes along time. TCATA added the time dimension to the static Check-All-That-Apply (CATA) method [15]. After having been used with trained panels, TDS and TCATA were gradually more and more used with consumer panels allowing also to better understand preferences in addition to product description.

The newest methods, changed from the simultaneous tasting-evaluating paradigm and proposed a retrospective measure, describing the product right after tasting but taking into account the perceived temporality. Attack-Evolution-Finish (AEF, [10]) methods summarize perception as a sequence of 3 attributes corresponding to 3 subjective periods: "Attack", "Evolution" and "Finish". FC-AEF [11] mixed static Free-Comment method [16], AEF and applicability, allowing the subjects to characterize their temporal perception using their own words instead of predefined list of descriptors.

## 1.2. Rationale for conducting the review

As can be seen in Table 1, many temporal methods have been developed over the years. Despite their differences, they all aim at measuring the same phenomenon. In food science, [17] highlighted that the most important challenge for new methodologies for sensory characterization is the identification of their limitations. Although it was referring to non-temporal DA, it also applies to temporal descriptive methods. It has not been clearly established yet in which situations methodologies provide equivalent information and when their application is
<table><caption>Table 2. Existing reviews related to all temporal methods in sensory science (*total number of references in each review, as reported in Scopus).</caption><thead><tr><td>Reference</td><td>Type of review</td><td>Scope</td><td>Number of references*</td></tr></thead><tbody><tr><td>Cliff & Heymann (1993) [19]</td><td>Narrative</td><td>TI</td><td>66</td></tr><tr><td>Dijksterhuis & Piggott (2000) [13]</td><td>Narrative</td><td>TI, PP</td><td>56</td></tr><tr><td>Foster et al. (2011) [20]</td><td>Narrative</td><td>TI, TDS in studies related to food oral processing</td><td>136</td></tr><tr><td>Di Monaco et al. (2014) [21]</td><td>Narrative</td><td>TDS</td><td>43</td></tr><tr><td>Devezeaux de Lavergne et al. (2017) [22]</td><td>Narrative</td><td>TI, TDS, TCATA in studies related food oral processing</td><td>112</td></tr><tr><td>Schlich (2017) [23]</td><td>Narrative</td><td>TDS and variants</td><td>49</td></tr><tr><td>Fiszman & Tarrega (2018) [24]</td><td>Narrative</td><td>TDS, in studies related to texture</td><td>48</td></tr></tbody></table>

https://doi.org/10.1371/journal.pone.0270969.t002

or is not recommended. [18] recently pointed out: "Many (sensory and statistical) methods are developed and deployed, but they are rarely compared exhaustively and objectively with alternative existing methods. Why would I adopt any new method when I have something that currently (seemingly) addresses the same task in a similar way? What benefit does it bring, and is it important enough for me to bother? How can I make findings actionable to inform product design?".

However, to date, no such exhaustive comparison of the multi-attribute temporal sensory methods exists. Indeed, the searching methodology described in this article allowed finding several reviews on the subject, but none of them addresses all the existing multi-attribute temporal descriptive methods. Moreover, as it can be observed in Table 2, there is no systematic review on the topic.

[13, 19] are obviously no longer up to date. [20, 22] mainly focus on applications in food oral processing research. [21, 23, 24] only reviewed studies related to TDS. By way of comparison, more than 350 articles (without TI) will be considered for inclusion in the review using the protocol described in this article.

Thus, the relevance of conducting a systematic review of the academic research on temporal sensory methods seems established to set guidelines based on scientific evidence. To overcome the limitations of the previous reviews, it is necessary to include all the temporal methods, with the exception of TI which is singular in the sense that it is the only one which characterizes a single attribute. As the heterogeneous nature of the studies was not amenable to a more precise systematic review, a scoping review will be carried out.

## 1.3. Objectives

The objectives of this review, in accordance with [25] are:

1. to map the scientific literature to make an exhaustive and objective inventory of the methods available for multi-attribute temporal descriptive sensory analysis of food products,

2. to clarify working definitions and inform practices in the field,

3. to summarize findings and recommendations based on (i) and (ii) and to identify research gaps in the existing literature,

4. to disseminate research findings.

A specific focus will be accorded to methodology and articles comparing methods.

## 2. Materials and methods

The protocol was drafted in order to ensure that the scoping review will be conformed to the Preferred Reporting Items for Systematic reviews and Meta-Analyses extension for Scoping Reviews (PRISMA-ScR) Checklist [26].
This section was organized based on the five stages of a scoping review [27]:

1. identification of the research question,

2. identification of relevant databases and literature,

3. selection of articles,

4. data extraction,

5. summarization, interpretation and dissemination of the results.

Each stage is more detailed below in line with the objectives of the current scoping review.

## 2.1. Identification of the research question

**2.1.1. Main research question and sub-questions.** The main research question is: "how have multi-attribute temporal descriptive methods been implemented, used and compared in sensory analysis?"

The main research sub-questions concern:

Method and protocol

* What temporal sensory methods (and their variants) were used?

* What characterizes the method(s)?

* Which product categories were evaluated using the methods?

* What were the reported limitations, advantages and disadvantages of each method?

* How were the methods compared in terms of advantages and disadvantages?

* Are there any remaining unanswered questions related to the method and protocol implemented?

Data analysis

* How was the data collected with these methods analyzed?

* How was performance (accuracy, discrimination, repeatability, reproducibility) measured?

* How were the methods compared in terms of their performances?

* Are there any remaining unanswered questions related to data analysis?

Contribution to existing scientific knowledge

* In which scientific fields (food science, psychology, etc.) were these methods applied?

* What type of temporal information was obtained with these methods?

* Did this information provide additional knowledge compared to other sensory (static measures, liking, etc.) or instrumental measures?

* Was the contribution used by other researchers? (quality, number of citations)

Demographics of the research

* What are the geographical and historical coverages of the methods?

* What are the main journals and authors implied?
* Is the scientific area FAIR? (standardization of meta-data, open access, open data, ethical, etc.)

**2.1.2. Inclusion and exclusion criteria.** The PICO(S) (Population, Intervention, Comparator, Outcome, Study design) eligibility criteria [28] for inclusion will be as follows:

**Population.** Any human panel (trained or semi-trained panelists, consumers) will be eligible for inclusion, without any limitation on its composition.

**Intervention.** Any study aiming to evaluate the sensory properties of food or drink using a multi-attribute temporal descriptive method will be relevant for inclusion. Any methodological article related to temporal data collection or statistical analysis of multi-attribute temporal descriptive methods will also be eligible for inclusion.

TI studies will be included at the identification and screening phases to present the magnitude of the use and study of the method in comparison to the multi-attribute temporal ones. However, they will not be considered thereafter for inclusion.

Studies exclusively related to temporality of preferences or emotions without consideration to product sensory descriptions will not be considered for inclusion.

**Comparators.** Studies with or without comparator will be eligible for inclusion.

**Outcomes.** Not applicable.

**Study design.** All types of study design will be eligible for inclusion.

To ensure that the articles will be available for the future readers of the review, only peer-reviewed articles having a DOI will be eligible for inclusion. In order to avoid article duplication reviews, opinion papers, congress proceedings, doctoral thesis and book chapters will be excluded. Only articles written in English will be considered.

Literature search will include published works until January 16, 2022.

## 2.2. Identification of relevant databases and literature

**2.2.1. Information sources.** The following databases were searched: Scopus, Web of Science Core Collection (WOS), and Google scholar [29]. Only Scopus and WOS were retained (see 2.2.2 for details on this choice). Furthermore, we will search the reference lists and citing articles of included studies and related systematic reviews.

**2.2.2. Search strategy.** The Peer Review of Electronic Search Strategies (PRESS) [30] checklist was used to help constructing and validating the search strategy.

First, keywords were listed according to the PICOS criteria. No keyword related to population, comparators, outcomes and study design were added. Keywords related to intervention were identified, including the names of the published temporal methods (Table 1) established based on the knowledge of the authors: "progressive profile/profiling", "sequential profile/profiling", "temporal dominance of sensations", "TDS", "temporal check all that apply", "TCATA", "T-CATA", "attack evolution finish". Although TI was outside the scope of this research, the keywords "time intensity" and "time-intensity" were added to retrieve references related to DATI and MATI, but also to potentially detect articles citing TI and to get an idea of the bibliographic volume related to this method. Keywords referring to multiple intakes were also added: "multi", "multiple", "bite", "sip", "intake". The wildcard character (*) was used (when applicable) to ensure that variations of each keyword were found. The proximity operator was also preferred (when possible) to the "AND" operator to limit the number of results of the query.

Second, Scopus and WOS were queried on title, abstract and keywords, then results were quickly screened. The test query allowed to notice that the name of the method was not always present in the title, abstract or keywords. Thus, new generic keywords related to temporal perception of sensations ("temporal", "dynamic", "perception", "description" and "sensory
analysis”) were added and their combinations added to the search. The test query also allowed to identify major “subject areas” in Scopus (Agricultural and Biological Sciences; Chemistry; Psychology) and “research areas” in WOS (Food science; Chemical analytics; Psychology). They were later used to limit the number of results of the query.

Third, previous reviews related to the research question were identified (see Table 2). It allowed to check if the queries enabled to retrieve all cited references. To this end, no restriction on the type of article was added in the search. Several iterations were needed to refine the queries in WOS and Scopus. It was concluded that, with this search criteria, Google Scholar did not bring new references, and it was therefore not added as a database.

### 2.2.3. Research equations.
The following research equations were retained for each database:

**Scopus**

TITLE-ABS-KEY(
(("progressive" PRE/1 "profil")
OR ("sequential" PRE/1 "profil")
OR ("dynamic" PRE/1 "profil")
OR ("time" near/1 "intensity")
OR ("time-intensity")
OR ("temporal" AND "dominance" AND "sensation")
OR ("TDS")
OR ("temporal" AND "check" AND "all" AND "that" AND "apply")
OR ("TCATA")
OR ("T-CATA")
OR ("attack evolution finish")
OR ("intensity variation descriptive methodology")
OR ("temporal" PRE/1 "profil")
OR ("temporal" PRE/1 "perception")
OR ("temporal" PRE/1 "description")
OR ("temporal" AND "sensory analysis")
OR ("temporal method")
OR ("dynamic" PRE/1 "perception")
OR ("dynamic" PRE/1 "description")
OR ("multi*" PRE/1 "sip")
OR ("multi*" PRE/1 "bite")
OR ("multi*" PRE/1 "intake")
) AND (
LIMIT-TO (SUBJAREA, "CHEM")
OR LIMIT-TO (SUBJAREA, "AGRI")
OR LIMIT-TO (SUBJAREA, "PSYC")
)

**WOS**

TS = (
("progressive" NEAR/1 "profil")
OR ("sequential" NEAR/1 "profil")
OR ("dynamic" NEAR/1 "profil")
OR ("time" NEAR/1 "intensity")
OR ("time-intensity")
OR ("TI")
OR ("temporal" AND "dominance" AND "sensation")
OR ("TDS")
OR ("temporal" AND "check" AND "all" AND "that" AND "apply")
OR ("TCATA")
OR ("T-CATA")
OR ("attack evolution finish")
OR ("intensity variation descriptive methodology")
OR ("temporal" NEAR/1 "profil")
OR ("temporal" NEAR/1 "perception")
OR ("temporal" NEAR/1 "description")
OR ("temporal" AND "sensory analysis")
OR ("temporal method")
OR ("dynamic" NEAR/1 "perception")
OR ("dynamic" NEAR/1 "description")
OR ("multi*" NEAR/1 "sip")
OR ("multi*" NEAR/1 "bite")
OR ("multi*" NEAR/1 "intake")
)

## 2.3. Selection of articles

Following the search, all identified records will be collated into Mendeley citation manager and duplicates removed. The process of study selection will be presented using the Preferred Reporting Items for Systematic Reviews and Meta-Analyses extension for Scoping Reviews (PRISMA-ScR) [31] as in Fig 1.

The two authors will independently screen (i) the titles and (ii) abstracts retrieved from the database search for potentially eligible studies. The full texts of these studies will be obtained and further screened for eligibility based on the inclusion and exclusion criteria. Corresponding authors will eventually be contacted to retrieve articles not available. Potential disagreements regarding eligibility will be resolved through discussion and consensus. Reasons for exclusion of full-text assessed articles will be reported in the PRISMA diagram.

The articles cited in the reviews and included articles will be manually screened to look for potential relevant missing articles. The articles citing the included articles will be retrieved using Scopus and screened in the same way. The additional references not retrieved by the research equations will be reported in the PRISMA diagram.

## 2.4. Extraction of relevant information and critical appraisal

2.4.1. **Extraction of article metadata.** The meta-data will be reported as exported from the databases.

2.4.2. **Identification of generic standards for reporting researching involving temporal sensory methods.** A strategy was defined to identify relevant data in the most exhaustive way. As no comparable review exists, it was not possible to rely on previous similar research. Many standards have been developed to report quantitative or qualitative research using specific designs, but no guideline corresponded to the designs used for the studies that will be included in the review. Indeed, most of them used quasi-experimental research designs. "Quasi-experimental research is similar to experimental research in that there is manipulation of an independent variable. It differs from experimental research because either there is no control group, no random selection, no random assignment, and/or no active manipulation." [32]. For product-oriented questions, the independent variable (the product) was most often studied using within-subject (counterbalanced or randomized) experimental designs, with no control group. For subject or method-oriented questions, factorial designs still with no control group were mostly used.

Thus, generic standards adapted for this review were identified from "Journal Article Reporting Standards for Quantitative Research in Psychology: The APA Publications and Communications Board Task Force Report" (JARS) [33]. Applicable topics were identified from JARS (from part "Information Recommended for Inclusion in Manuscripts That Report New Data Collections Regardless of Research Design"). Some topics were renamed or grouped to be more consistent with the nomenclatures used in the articles in our area of interest. The
<figure><img src="image_4.png" /><figcaption>Fig 1. PRISMA flow chart that will be completed in the final scoping review.</figcaption></figure>

https://doi.org/10.1371/journal.pone.0270969.g001

expected content of each topic was completed based on literature when necessary. The result is summarized in Table 4.

**2.4.3. Definition of specific standards for reporting researching involving temporal sensory methods.** 50 articles (called hereafter "test articles") identified thanks to the database query (see 2.2.3) were randomly selected, then read. Following this reading, new topics specific to sensory analyses studies were identified. To facilitate the work of extraction following the reading of each article, a data extraction form was derived from Tables 3 and 4. To objective the topics of Table 4, the extraction form was constructed as a list of topic-related questions. When possible, the use of closed questions was preferred to maximize the agreement between the reviewers and facilitate quantitative analysis of the data in the final review. When possible, a list of pre-determined answers was suggested (the list could be extended during the final evaluation process). When the content of the information was not related to one of the identified research questions but the presence/absence of the information still relevant to be reported for
<table><caption>Table 3. Meta-data exported from WOS and Scopus.</caption><thead><tr><td>Meta-data</td><td>Description</td></tr></thead><tbody><tr><td>DOI</td><td>Digital object identifier of the article</td></tr><tr><td>Title</td><td>Title of the article</td></tr><tr><td>Authors</td><td>Authors of the article</td></tr><tr><td>Abstract</td><td>Abstract of the article</td></tr><tr><td>Year</td><td>Year of publication of the article</td></tr><tr><td>Source title</td><td>Title of the peer-reviewed journal in which the article is published</td></tr><tr><td>Keywords</td><td>Keywords reported by the authors</td></tr><tr><td>Language</td><td>Language of the article</td></tr><tr><td>Subject/research area</td><td>Subject area of the journal</td></tr><tr><td>Number of references</td><td>Number of references cited by the article</td></tr><tr><td>Number of citations</td><td>Number of references citing this article</td></tr><tr><td>Open access to the manuscript</td><td>Type of open access</td></tr></tbody></table>

https://doi.org/10.1371/journal.pone.0270969.t003

<table><caption>Table 4. Generic standards applicable for reporting studies involving temporal sensory methods, adapted from JARS.</caption><thead><tr><td>Topic</td><td>Expected content</td></tr></thead><tbody><tr><td colspan="2">Meta-data</td></tr><tr><td>Title</td><td>Title should provide a concise description of the nature and topic of the study, including the name of the data collection method [34]. General recommendations can be found in [35].</td></tr><tr><td>Abstract</td><td>Abstract should report objectives (state of the problem under investigation, main hypotheses); description of participants (pertinent characteristics); study method (research design, sample size, materials/methods used, outcome measured, data analysis procedures); main findings (including statistical significance levels); conclusions (beyond just results, reporting implications or applications). Adapted from [33].</td></tr><tr><td>Keywords</td><td>Keywords should be related to controlled vocabularies. Adapted from [36].</td></tr><tr><td colspan="2">Introduction</td></tr><tr><td>Problem</td><td>Introduction should describe the importance of the problem, including an overview of what is known about the problem, gaps in current knowledge and practical implications that make the study necessary. Adapted from [34]. Introduction should include a succinct review of relevant scholarship, including relation to previous work. Included references should be relevant to the problem studied, and cited in accordance with content and context. Self-citation should be justified. Adapted from [37].</td></tr><tr><td>Objective(s)</td><td>Introduction should report a statement framed as one or more research questions, purposes, goals, or objectives that should set readers' expectations for the methods, findings and discussion sections of the manuscript. Adapted from [34].</td></tr><tr><td colspan="2">Materials and methods</td></tr><tr><td>Participants</td><td>A participants section should be reported, indicating: inclusion and exclusion criteria (if any); major demographic characteristics as well as important research-specific characteristics; recruitment procedure; settings, locations and dates for data collection; consent and retribution made to participants; institutional review board agreements; ethical standards met and safety monitoring (if any); intended and achieved sample size if different from intended; determination of sample size (power analysis or methods used to determine the number). Adapted from [33].</td></tr><tr><td>Data collection</td><td>Authors should describe in detail their data collection design and method(s) and justify them in relation to the research question(s). The authors should describe all instruments, guides, and protocols, including their development and cite relevant literature, theories or conceptual frameworks as appropriate. Adapted from [34].</td></tr></tbody></table>

(Continued)
<table><caption>**Table 4.** (Continued)</caption><thead><tr><th>Topic</th><th>Expected content</th></tr></thead><tbody><tr><td><strong>Data analysis</strong></td><td>Materials and methods should include a data analysis section describing the analytic process so that readers can follow the logic of inquiry from the research question(s) to the analysis and findings. The authors should cite the guiding literature and describe their processes in sufficient detail so readers can judge the extent to which the processes align with the guiding approach. If modification to or deviations from the guiding approach occurred, the authors should explain and justify these modifications. Adapted from [34].<br>Data analysis section should report: the variables measured and their nature (intensity, citation rate, etc.); the planned data diagnostics (criteria for post-data collection exclusions of participants); the criteria for deciding when to infer missing data and methods used for imputation of missing data; the definition and processing of statistical outliers; the analyses of data distributions; the data transformation to be used; the statistics methods used (including details of the models and references to the appropriate literature if required); the data analysis software. Adapted from [33].<br>Before engaging in statistical inferences, level of expected statistical probability (e.g. p&lt;0.05, p &lt; .01) should be established on the basis of reasonable knowledge of the phenomena under investigation and the caution necessary for interpreting comparisons [38].</td></tr><tr><td><strong>Results</strong></td><td></td></tr><tr><td><strong>Synthesis</strong></td><td>Results should report information detailing the statistical and data-analytic methods, including: missing data; characterization of the data (n, means, standard deviations, etc.); inferential statistics (including exact p-values, minimally sufficient set of statistics needed to construct the tests: dfs, mean square effects, mean square error, etc.); reporting of any problems with statistical assumptions and/or data distributions that could affect the validity of findings. Adapted from [33].</td></tr><tr><td><strong>Findings</strong></td><td>Results should report evidence to substantiate the more general and abstract concepts or inferences presented as findings. Authors should report counter-examples and concrete details related to their findings. Judicious use of tables and figures can help communicate such findings Adapted from [34].</td></tr><tr><td><strong>Quality of measurements</strong></td><td>"Just because one obtains a graphical display or a series of tables with associated statistical significance does not mean it has any meaning or external validity" [39].<br>For new methods, results should provide validity evidence (either directly in the study itself, e.g., via pilot testing, or indirectly based on previous research) supporting the use of the given measurement instruments for the intended construct interpretations [38].<br>More on validity can be found in [40].<br>Results should also report estimates related to the reliability of measures (reliability estimates from other studies should only be used for comparison purposes). Adapted from [32, 37, 39]. More on reliability can be found in [40].</td></tr><tr><td><strong>Discussion</strong></td><td></td></tr><tr><td><strong>Support of original hypotheses</strong></td><td>Discussion should begin with a short summary of the main findings as a remainder for the readers helping them assess whether the subsequent interpretation and implications formulated are supported by the findings. Adapted from [34]. It should provide a statement of support or non-support for all hypotheses. Adapted from [33].</td></tr><tr><td><strong>Connection to prior works</strong></td><td>Discussion should elaborate on similarities and differences between reported results and work of others. Adapted from [33].</td></tr><tr><td><strong>Interpretation &amp; limitations</strong></td><td>Discussion should provide an interpretation of the results and elaboration on findings in relation to the study purpose. Specific elements, decisions or events of the study that could influence interpretation should be identified. Adapted from [34]. Authors should also take into account: sources of potential bias; imprecision of measurement protocols; overall number of tests; adequacy of sample size [33].</td></tr><tr><td><strong>Contribution to the field</strong></td><td>Discussion should consider contribution to the field [34], generalizability of the findings (taking into account target population and other contextual issues) and implications for future research [33].</td></tr><tr><td><strong>Transparency</strong></td><td></td></tr><tr><td><strong>Declaration of interest</strong></td><td>This section should identify (if applicable) any real or potential conflicts of interest that might have influenced or could appear to have influenced the research. Authors should also explain how these conflicts were managed in the conduct of the study, and describe the potential impact on study findings and/or conclusions [34].</td></tr></tbody></table>

(Continued)
<table><caption>**Table 4.** (Continued)</caption><thead><tr><td>Topic</td><td>Expected content</td></tr></thead><tbody><tr><td>Funding</td><td>This section should describe any sources of funding and other support for the study and the role of funders in data collection, data analysis and reporting, if applicable [34].</td></tr><tr><td>Contributions</td><td>This section should report the roles played by each author of the article, using Contributor Roles Taxonomy. [41].</td></tr></tbody></table>

https://doi.org/10.1371/journal.pone.0270969.t004

other purpose, the predetermined answers were “yes”, “no” or “not applicable”. The result is summarized in Table 5.

The two authors will independently fill in the data extraction form materialized by an Excel sheet (that will be included as a supplementary material in the final review). As the nature of the answers is mainly objective, the differences in reporting will be resolved by checking the article until agreement between the 2 reviewers.

<table><caption>**Table 5.** Extraction form based on topic-related questions. Items marked with an asterisk (*) are mandatory (except for statistical oriented articles) for the article to be considered for quality appraisal (see section 2.4.5).</caption><thead><tr><th>Item</th><th>Question<br>Predetermined answers</th></tr></thead><tbody><tr><td colspan="2"><strong>Meta-data</strong></td></tr><tr><td>DOI</td><td>What is the digital object identifier of the article?<br><em>As reported in Scopus/WOS.</em></td></tr><tr><td>Title</td><td>What was title of the article?<br><em>As reported in Scopus/WOS.</em></td></tr><tr><td>Authors</td><td>Who are the authors of the article?<br><em>As reported in Scopus/WOS.</em></td></tr><tr><td>Abstract</td><td>What is the content of the abstract of the article?<br><em>As reported in Scopus/WOS.</em></td></tr><tr><td>Year</td><td>What is the year of publication of the article?<br><em>As reported in Scopus/WOS.</em></td></tr><tr><td>Source title</td><td>What is the title of the peer-reviewed journal in which the article is published?<br><em>As reported in Scopus/WOS.</em></td></tr><tr><td>Keywords</td><td>What are the keywords reported by the authors?<br><em>As reported in Scopus/WOS.</em></td></tr><tr><td>Language</td><td>What is the language of the article?<br><em>As reported in Scopus/WOS.</em></td></tr><tr><td>Subject/research area</td><td>What is the subject area of the journal?<br><em>As reported in Scopus/WOS.</em></td></tr><tr><td>Number of references</td><td>How many references are cited by the article?<br><em>As reported in Scopus/WOS.</em></td></tr><tr><td>Number of citations</td><td>How many references cite the article at the moment of the review?<br><em>As reported in Scopus/WOS.</em></td></tr><tr><td>Open access to the manuscript</td><td>What is the type of open access?<br><em>As reported in Scopus/WOS.</em></td></tr><tr><td>Open access to the data</td><td>Does the reader have access to the data, in a public repository or data paper?<br>(extends “Open access to the manuscript”)<br><em>Yes/no.</em></td></tr><tr><td>Open access to the source code</td><td>Does the reader have access to the source code used for data analysis? (extends “Open access to the manuscript”)<br><em>Yes/no.</em></td></tr><tr><td colspan="2"><strong>Introduction/Problem</strong></td></tr></tbody></table>

(Continued)
<table><caption>**Table 5.** (Continued)</caption><thead><tr><th>Item</th><th>Question<br>Predetermined answers</th></tr></thead><tbody><tr><td>Review of scholarship*</td><td>Did the introduction include an overview of what is known of the problem based on a review of the scholarship (related to temporal sensory analysis)?<br>Yes/no.</td></tr><tr><td>Relevance</td><td>Did the introduction identify gaps in current knowledge and/or practical implications that make the study necessary?<br>Yes/no.</td></tr><tr><td colspan="2"><strong>Introduction/Objectives</strong></td></tr><tr><td>Objective(s)*</td><td>What were the objectives of the research?<br>As reported by the authors/not reported.</td></tr><tr><td>Area of knowledge</td><td>What was the area of knowledge produced by the research?<br>Methodological/product oriented/etc. (deduced from objective(s))</td></tr><tr><td colspan="2"><strong>Materials and methods/participants</strong></td></tr><tr><td>Selection criteria</td><td>Were the selection criteria of the participants reported?<br>Yes/no/not applicable.</td></tr><tr><td>Recruitment modalities</td><td>Were the recruitment modalities reported?<br>Yes/no/not applicable.</td></tr><tr><td>Determination of sample size</td><td>What was the criterion for determining sample size?<br>Literature/power calculation/not applicable/not reported.</td></tr><tr><td>Number*</td><td>What was the final number of participants that actually participated in the evaluation?<br>As reported by the authors/not applicable/not reported.</td></tr><tr><td>Demographics</td><td>Were the characteristics of the participants (at least one characteristic: age, gender, frequency of consumption, etc.) reported?<br>Yes/no/not applicable.</td></tr><tr><td>Country</td><td>In which country did the experiment take place?<br>As reported by the authors (or deduced from context of the experiment, but not by authors affiliation)/not reported/not applicable.</td></tr><tr><td>Location</td><td>Where did the data collection take place?<br>Lab/home/not applicable/etc.</td></tr><tr><td>Ethics review board</td><td>Did the authors report an approval by an appropriate ethics review board?<br>Yes/No/Not applicable</td></tr><tr><td>Participant consent</td><td>Did the authors report participants consent?<br>Yes/No/Not applicable</td></tr><tr><td>Nature of the compensation</td><td>Did the authors report if there was or not a compensation for the participants?<br>Yes/No/Not applicable</td></tr><tr><td colspan="2"><strong>Materials and methods/products</strong></td></tr><tr><td>Description*</td><td>Did the authors report relevant information about the food products? (brand, recipe, composition, etc.)<br>Yes/no/not applicable.</td></tr><tr><td>Type</td><td>What was the type of product? (deduced from product description)<br>Commercial/model (prepared by the experimenter)/not reported/not applicable.</td></tr><tr><td>Food category</td><td>What was the category of the food products? (deduced from product description)<br>[42]<br>Wine/chocolate/not applicable/etc.</td></tr><tr><td>Physical state</td><td>What was the physical state of the food products? (deduced from product description)<br>Solid/semi-solid/liquid/not applicable.</td></tr><tr><td>Serving conditions</td><td>Did the authors report the relevant information (portion size, container, temperature, light, etc.) about the serving conditions?<br>Yes/no/not applicable.</td></tr><tr><td>Information given to the participants</td><td>If the product is not blindly evaluated, what was the information given to the participants?<br>None/Brand/Allegation/Price/Package/etc.</td></tr></tbody></table>

(Continued)
<table><caption>**Table 5.** (Continued)</caption><thead><tr><th>Item</th><th>Question<br>Predetermined answers</th></tr></thead><tbody><tr><td>Number*</td><td>How many different products/samples were evaluated?<br>As reported by the authors/not reported/not applicable.</td></tr><tr><td colspan="2"><strong>Materials and methods/attributes</strong></td></tr><tr><td>Selection</td><td>How were the attributes selected for the study?<br>By the panel/by another panel/literature/not reported/not applicable/etc.</td></tr><tr><td>Description*</td><td>What were the names of the attributes?<br>As reported by the authors/not reported/not applicable.</td></tr><tr><td>Sensory modalities</td><td>What were the sensory modalities evaluated? (deduced from description)<br>Basic taste/flavor/texture/mouthfeel/not applicable/etc.</td></tr><tr><td>Definitions</td><td>Were attribute definitions presented to the participants?<br>Yes/no/not applicable.</td></tr><tr><td>References</td><td>Were attribute references presented to the participants?<br>Yes/no/not applicable.</td></tr><tr><td>Number</td><td>How many attributes were evaluated?<br>As reported by the authors/not reported/not applicable.</td></tr><tr><td colspan="2"><strong>Materials and methods/research design</strong></td></tr><tr><td>Object(s) of comparison</td><td>What was the object of interest?<br>Method/product/intake/subject/not applicable/etc.</td></tr><tr><td>Temporal unit</td><td>What was the temporal unit of the measures?<br>Within-intake/between intakes/etc.</td></tr><tr><td>Study design*</td><td>What was the study design used for comparing the experimental units?<br>Within balanced/within unbalanced/between/factorial/not applicable/not reported/etc.</td></tr><tr><td>Product order</td><td>What was the experimental design defining the rank of presentation of the samples?<br>Balanced/randomized/not reported/not applicable/etc.</td></tr><tr><td>Attribute order</td><td>What was the experimental design defining the rank of presentation of the attributes?<br>Balanced/randomized/not reported/not applicable/etc.</td></tr><tr><td colspan="2"><strong>Material and methods/data collection</strong></td></tr><tr><td>Temporal method(s)*</td><td>What was the name of the temporal sensory method/variant involved?<br>TDS/TDS intensity/TI/TCATA/TCATA fading/etc.</td></tr><tr><td>Other measures</td><td>Was there other information collected with the temporal sensory data?<br>Liking/physicochemical measures/none/etc.</td></tr><tr><td>Training</td><td>How were the participants introduced to the method?<br>Familiarization/training (hours)/not reported/not applicable.</td></tr><tr><td>Type of panel*</td><td>What was the type of panel? (depending on the training of the participants, [43])<br>Trained/semi-trained/expert/consumer/not reported/not applicable.</td></tr><tr><td>Instructions</td><td>Did the authors report the instructions given to the participants?<br>Yes/no/not applicable.</td></tr><tr><td>Warm-up</td><td>Did the tasting include a warm-up product prior to the evaluation of the samples?<br>Yes/no/not applicable.</td></tr><tr><td>Software</td><td>Which was the software used for temporal sensory data collection?<br>As reported by the authors/not reported/not applicable.</td></tr><tr><td>Number of evaluations</td><td>How many times were the samples evaluated (replicates)?<br>As reported by the authors/not reported/not applicable.</td></tr><tr><td>Standardization of the tasting</td><td>How was the tasting standardized?<br>As reported by the authors/not reported/not applicable.</td></tr><tr><td>Duration of the tasting</td><td>How long did the standardized tasting last?<br>Fixed duration/free duration (time)/not reported/not applicable.</td></tr><tr><td colspan="2"><strong>Material and methods/data analysis</strong></td></tr></tbody></table>

(Continued)
<table><caption>**Table 5.** (Continued)</caption><thead><tr><th>Item</th><th>Question<br>Predetermined answers</th></tr></thead><tbody><tr><td>Justification of data selection</td><td>Did the authors justify data selection (subjects, products, attributes), if any?<br>Yes/no/not applicable.</td></tr><tr><td>Data transformation</td><td>How was data transformation (if any) carried out?<br>Time standardization/periods/none/etc.</td></tr><tr><td>Variables*</td><td>What were the analyzed variables?<br>Durations of dominances/citation rates/intensities/not reported/etc.</td></tr><tr><td>Statistics*</td><td>What were the statistical analyses used?<br>Curves/PCA/ANOVA/not reported/etc.</td></tr><tr><td>Alpha</td><td>Was the level of expected statistical probability reported (previously to the results)?<br>Yes/no/not applicable.</td></tr><tr><td>Software</td><td>What was the software used for data analysis?<br>R/SAS/etc.</td></tr><tr><td colspan="2"><strong>Results/Synthesis</strong></td></tr><tr><td>Characterization of data</td><td>Did the authors provide a characterization of the data? (missing data, descriptive statistics including n, mean, standard deviations, etc.)<br>Yes/no/not applicable.</td></tr><tr><td>Inferential statistics</td><td>Did the authors report inferential statistics parameters when comparing objects of interest (products, methods, etc.)? (p-values, df's, mean square effects, mean square error, etc.)<br>Yes/no/not applicable.</td></tr><tr><td colspan="2"><strong>Results/Findings</strong></td></tr><tr><td>Main findings*</td><td>What were the main findings related to temporal sensory analysis?<br>As reported by the authors/not reported.</td></tr><tr><td colspan="2"><strong>Results/Quality of measurements</strong></td></tr><tr><td>Validity</td><td>Did the authors report validity evidence supporting the use of the method?<br>Yes/no/not applicable.</td></tr><tr><td>Reliability</td><td>Was a measure of reliability included?<br>Yes/no/not applicable.</td></tr><tr><td colspan="2"><strong>Discussion</strong></td></tr><tr><td>Answer to research question</td><td>Did the authors provide an answer to their research question?<br>Yes/no.</td></tr><tr><td>Connection to prior works</td><td>Did the authors report connections to prior works?<br>Yes/no.</td></tr><tr><td>Interpretation*</td><td>Did the authors provide an interpretation of the results in relation to the study purpose?<br>Yes/no.</td></tr><tr><td>Limitations</td><td>Did the authors report elements that could have biased the result or influenced the interpretation?<br>Yes/no.</td></tr><tr><td>Contribution to the field</td><td>Did the authors discuss the contribution to the field (generalizability of the findings and/or implications for future researches)?<br>Yes/no.</td></tr><tr><td colspan="2"><strong>Transparency</strong></td></tr><tr><td>Declaration of interest</td><td>Were the potential sources of influence on study conduct and conclusions reported?<br>Yes/no.</td></tr><tr><td>Funding</td><td>Were the sources of funding and other support reported?<br>Yes/no.</td></tr><tr><td>Contributions</td><td>Were the contributions of the authors included?<br>Yes/no.</td></tr></tbody></table>

https://doi.org/10.1371/journal.pone.0270969.t005
**2.4.4. Evaluation of completeness of data form.** Once the data extraction for an article is filled, its completeness will be evaluated. Answers “no” and “not reported” will count as 0 while other answers will count as 1 for the purpose of summing across topics of Table 4. Nine completeness indicators will be computed in this way: “Introduction” (0 to 4), “Materials and methods/participants” (0 to 10), “Materials and methods/products” (0 to 7), “Materials and methods/attributes” (0 to 6), “Materials and methods/research design” (0 to 5), “Material and methods/data collection” (0 to 10), “Material and methods/data analysis” (0 to 6), “Results” (0 to 5), “Discussion” (0 to 5).

The evaluation of the completeness will not require any subjective judgment as it will be based on consensual answers of Table 5. Thus, the completeness indicators will be automatically computed based on the data extraction form thanks to an Excel formula.

**2.4.5. Critical appraisal.** Only peer-reviewed articles will be included in the final scoping review. Nonetheless, some authors stress the importance of a thorough quality assessment in scoping reviews [44, 45]. To achieve this objective, 7 quality indicators (QI) were chosen according to [46]. It should be noted that only the articles that have the information identified as mandatory (see Table 5) will be evaluated in this stage. The articles that do not comply with this condition will be retained but marked as “not evaluated”.

To help the reviewer in their assessments, the QI were divided in topic-related questions summarized in Table 6.

The reviewers’ involvement will be added for the sake of transparency about the neutrality of the appraisal (it will be answered “yes” if at least one the reviewers is or was personally involved in the work or with the authors, considering this as potential bias in the quality appraisal).

The two reviewers (R1 and R2) will independently answer to all topic-related questions, each having 3 possible answers, “yes”, “no” and “can’t tell” (Critical Appraisal Skills Program [47]). Then, the final judgement will be obtained as follows:

**Step 1. For each topic-related question:**

<figure><img src="image_5.png" /></figure>

Reasons for giving “no” as an answer will have to be justified.

**Step 2. For the Quality Item the least favorable evaluation among the topic-related final evaluations will be retained.**

For example, if reviewer 1 answered “yes” to QI6a while reviewer 2 answered “can’t tell”, QI6a final evaluation will be “probably yes”. If the 2 reviewers answered “can’t tell” to QI6b, QI6a final evaluation will be “can’t tell”. Considering the answers to parts a and b of QI6, its final evaluation will be “can’t tell”.

No overall score quality evaluation (taking into account the seven QI) will be made, and all articles will be included whatever their score. Indeed, these scores will only reflect a quality level related to the research question of this review, and the final appraisal will be to the discretion of the future readers of the scoping review. The evaluation of each article consisted in as a 3-steps procedure (read below):

1. Extraction of information (63 items) using the extraction form

2. Automatic evaluation of the completeness of the reporting (9 indicators)
<table><caption>Table 6. Indicators of quality derived from [46].</caption><thead><tr><td>Quality indicator (QI)</td><td>Topic-related questions and related items</td></tr></thead><tbody><tr><td>QI1 -Clear research question?</td><td>QI1a -Was the introduction detailed enough to give an overview of the problem comprehensive for a competent but non-expert reviewer? ("Review of scholarship").<br/>QI1b -Was the necessity of the study justified from the perspective of a competent but non-expert reviewer? ("Relevance").<br/>QI1c -Did the stated objectives set readers' expectations for the methods, findings and discussion? ("Objective(s)", "Area of knowledge").</td></tr><tr><td>QI2 -Appropriate participants?</td><td>Were the participants appropriate for answering to the research question? ("Selection criteria", "Determination of sample size", "Number", "Location", "Demographics").</td></tr><tr><td>QI3 -Appropriate design & data collection?</td><td>QI3a -Were the research design parameters appropriate to answer the research question? ("Object(s) of comparison", "Temporal unit", "Study design", "Product order", "Attribute order")<br/>QI3b -Was the choice of all the methods justified by literature and/or appropriate to answer the research question? ("Temporal method(s)", "Other measures")<br/>QI3c -Was the implementation of the method appropriate to answer the research question? ("Training", "Type of panel", "Instructions", "Number of evaluations", "Standardization of the tasting", "Duration of the tasting")<br/>QI3d -Was the data collection process described in a way that makes the experiment reproducible?</td></tr><tr><td>QI4 -Appropriate data analysis?</td><td>QI4a - Was the analysis process made according to the literature or justified in case of a new approach? ("Data selection", "Data transformation", "Variables", "Statistics", "Alpha", "Software")<br/>QI4b - Was the data analysis process described in a way that makes it reproducible?</td></tr><tr><td>QI5 -Claims supported by evidence?</td><td>QI5a - Did authors make an appropriate synthesis of the results, including a judicious use of tables and figures allowing to characterize raw data and statistics? ("Characterization of data", "Inferential statistics")<br/>QI5b - Did authors report sufficient data and substantial evidence to support the findings? ("Main findings", "Validity", "Reliability")</td></tr><tr><td>QI6 -Integrated interpretations and conclusions?</td><td>QI6a - Did authors appropriately discuss their findings in relation to the study objectives and prior works? ("Support of original hypotheses", "Connection to prior works", "Interpretation")<br/>QI6b - Did authors objectively report sufficient elements pro and against their arguments? ("Limitations")</td></tr><tr><td>QI7 -Useful contribution?</td><td>Did authors discuss the generalizability of their findings and/or implications for future research? ("Contribution to the field")</td></tr></tbody></table>

https://doi.org/10.1371/journal.pone.0270969.t006

### 3. Critical appraisal (7 indicators)

Fig 2 summarizes the evaluation process that was refined and tested on the 50 test articles. The modifications to this evaluation process, if any, will be described in the final scoping review.

### 3. Results

Tables and figures will be produced to summarize most of the extracted data presented in Table 5. A narrative synthesis organized into themes reflecting the scoping review objectives will also be presented. Both descriptive statistics and narrative synthesis will be supported by a qualitative analysis.

### 4. Discussion

The proposed scoping review resulting from the present protocol aims at summarizing how multi-attribute temporal descriptive methods have been implemented, used and compared in
<figure><img src="image_6.png" /><figcaption>Fig 2. Summary of the process of evaluation.</figcaption></figure>

https://doi.org/10.1371/journal.pone.0270969.g002

sensory analysis. This review will help the sensory analysts choose the appropriate method according to their needs (e.g. product description, product discrimination, oral processing behavior) and adopt the best practices. Moreover, this review will allow to identify the areas where additional research and/or validation is necessary.

This protocol presents a detailed methodology for conducting the review. The publication of this protocol presents several advantages. The protocol has been reviewed thanks to expert feedbacks, ensuring its transparency and validity. The data extraction form and the quality appraisal flowchart can be adapted and reused for other areas of research, particularly in a young science such as sensory and consumer science. This protocol could also be used as checklists to ensure no important information has been forgotten when writing new articles in this field. Indeed, the training exercise on the first 50 articles showed a great heterogeneity in the way the details of the studies are reported. This protocol would help standardizing the way the results of research are reported, which is important with the emergence of open science. Moreover, the authors would also point out that despite the fact that only peer-reviewed articles have been included, several studies do not meet the quality requirements that should be expected. This could be due to a lack of information or validated sources in the field. This protocol could also be used as a guideline for reviewing research manuscripts, or at least to point out the need for defining consensual criteria among journals. Finally, this protocol will promote the use of systematic reviews in science to inform the debate and improve the quality of future research.

Limitations in this protocol have to be reported. The research strategy largely depends on the name of the temporal methods. Therefore, the authors may have missed new or little-known temporal methods. Moreover, in order to limit the number of retrieved articles by the database queries, only specific subject areas (Scopus) or research areas (WOS) have been investigated. Again, it could result in missing articles published in annex research fields such as mathematics or computer science. However, these two limits are not that serious, because it is
likely that the missed articles cite or have been cited by at least once one of the articles retrieved through the database queries. The additional references identified this way will be reported in the PRISMA diagram. The research has been limited to articles published in English language. A first look on the geographic distribution of the included studies suggests that it is not a concern. Only peer-reviewed articles have been considered for inclusions, which is debatable. This choice was made for the sake of feasibility and reproducibility. Moreover, it is unlikely that the excluded articles could have met the quality criteria, and the corpus of included publications is supposed large enough to answer to the research questions. Finally, only two databases have been queried. In a first time, Google Scholar was considered, but except for gray literature this database did not bring additional references. This seems to suggest that it was sufficient, considering all the limitations mentioned above.

## Author Contributions

**Conceptualization:** Michel Visalli, Mara Virginia Galmarini.

**Investigation:** Mara Virginia Galmarini.

**Methodology:** Michel Visalli, Mara Virginia Galmarini.

**Visualization:** Michel Visalli.

**Writing – original draft:** Michel Visalli, Mara Virginia Galmarini.

## References

1. Lee WEI, Pangborn M. Time-intensity: The temporal aspects of sensory perception. Food Technol. 1986; 40:78–82.

2. Gordin hh. Intensity variation descriptive methodology: development and application of a new sensory evaluation technique. J Sens Stud. 1987; 2(3):187–98.

3. Clark CC, Lawless HT. Limiting response alternatives in time-intensity scaling: An examination of the halo-dumping effect. Chem Senses. 1994; 19(6):583–94. https://doi.org/10.1093/chemse/19.6.583 PMID: 7735838

4. Jack FR, Piggott JR, Paterson A. Analysis of Textural Changes in Hard Cheese during Mastication by Progressive Profiling. J Food Sci. 1994; 59(3):539–43.

5. Duizer LM, Bloom K, Findlay CJ. Dual-attribute time-intensity sensory evaluation: A new method for temporal measurement of sensory perceptions. Food Qual Prefer. 1997 1; 8(4):261–9.

6. Pineau N, Schlich P, Cordelle S, Mathonnière C, Issanchou S, Imbert A, et al. Temporal Dominance of Sensations: Construction of the TDS curves and comparison with time-intensity. Food Qual Prefer. 2009; 20(6):450–5.

7. Methven L, Rahelu K, Economou N, Kinneavy L, Ladbrooke-Davis L, Kennedy OB, et al. The effect of consumption volume on profile and liking of oral nutritional supplements of varied sweetness: Sequential profiling and boredom tests. Food Qual Prefer. 2010; 21(8):948–55.

8. Kuesten C, Bi J, Feng Y. Exploring taffy product consumption experiences using a multi-attribute time-intensity (MATI) method. Food Qual Prefer. 2013; 30(2):260–73.

9. Castura JC, Antúnez L, Giménez A, Ares G. Temporal Check-All-That-Apply (TCATA): A novel dynamic method for characterizing products. Food Qual Prefer. 2016; 47:79–90.

10. Visalli M, Mahieu B, Thomas A, Schlich P. Concurrent vs. retrospective temporal data collection: Attack-evolution-finish as a simplification of Temporal Dominance of Sensations? Food Qual Prefer. 2020; 85:103956.

11. Mahieu B, Visalli M, Thomas A, Schlich P. Using Free-Comment with consumers to obtain temporal sensory descriptions of products. Food Qual Prefer. 2020; 86:104008.

12. Stone H, Sidel JL. 6—Descriptive Analysis. In: Sensory Evaluation Practices (Third Edition). 3rd ed. Elsevier Academic Press; 2004. p. 377.

13. Dijksterhuis G, Eilers P. Modelling time-intensity curves using prototype curves. Food Qual Prefer. 1997; 8(2):131–40.
14. Dijksterhuis GB, Piggott JR. Dynamic methods of sensory analysis. Trends Food Sci Technol. 2000; 11 (8):284-90.

15. Buck D, Kemp SE. Check-All-That-Apply and Free Choice Description. Descr Anal Sens Eval [Internet]. 2017;579-607.

16. Symoneaux R, Galmarini M V. Open-Ended Questions. In: VARELA P, ARES G, editors. Novel techniques in sensory characterization and consumer profiling. CRC Press.; 2014. p. 401.

17. Ares G. Methodological challenges in sensory characterization. Curr Opin Food Sci [Internet]. 2015; 3:1-5.

18. Meyners M. Controversy regarding relevance and rigor of Sensometrics for industrial applications. In: Sensometrics 2020 -E3S. 2020.

19. Cliff M, Heymann H. Development and use of time-intensity methodology for sensory evaluation: A review. Food Res Int. 1993; 26(5):375-85.

20. Foster KD, Grigor JMV, Cheong JN, Yoo MJY, Bronlund JE, Morgenstern MP. The Role of Oral Processing in Dynamic Sensory Perception. J Food Sci. 2011 Mar; 76(2):R49-61. https://doi.org/10.1111/j.1750-3841.2010.02029.x PMID: 21535784

21. Di Monaco R, Su C, Masi P, Cavella S. Temporal Dominance of Sensations: A review. Trends Food Sci Technol. 2014; 38(2):104-12.

22. Devezeaux de Lavergne M, Van de Velde F, Stieger M. Bolus matters: the influence of food oral breakdown on dynamic texture perception. Food Funct. 2017; 8(2):464-80. https://doi.org/10.1039/c6fo01005a PMID: 27713955

23. Schlich P. Temporal Dominance of Sensations (TDS): a new deal for temporal sensory analysis. Curr Opin Food Sci. 2017; 15:38-42.

24. Fiszman S, Tarrega A. The dynamics of texture perception of hard solid food: A review of the contribution of the temporal dominance of sensations technique. J Texture Stud. 2018; 49(2):202-12. https://doi.org/10.1111/jtxs.12273 PMID: 28547772

25. Daudt HML, Van Mossel C, Scott SJ. Enhancing the scoping study methodology: A large, inter-professional team's experience with Arksey and O'Malley's framework. BMC Med Res Methodol. 2013; 13 (1):1-9. https://doi.org/10.1186/1471-2288-13-48 PMID: 23522333

26. Tricco AC, Lillie E, Zarin W, O'Brien KK, Colquhoun H, Levac D, et al. PRISMA Extension for Scoping Reviews (PRISMA-ScR): Checklist and Explanation. Ann Intern Med. 2018; 169(7):467-73. https://doi.org/10.7326/M18-0850 PMID: 30178033

27. Arksey H, O'Malley L. Scoping studies: towards a methodological framework. https://doi.org/101080/1364557032000119616. 2007; 8(1):19-32.

28. Popping the (PICO) question in research and evidence-based practice. Appl Nurs Res. 2002; 15 (3):197-8. https://doi.org/10.1053/apnr.2002.34181 PMID: 12173172

29. Martín-Martín A, Orduna-Malea E, Thelwall M, Delgado López-Cózar E. Google Scholar, Web of Science, and Scopus: A systematic comparison of citations in 252 subject categories. J Informetr. 2018; 12 (4):1160-77.

30. McGowan J, Sampson M, Salzwedel DM, Cogo E, Foerster V, Lefebvre C. PRESS Peer Review of Electronic Search Strategies: 2015 Guideline Statement. J Clin Epidemiol. 2016; 75:40-6. https://doi.org/10.1016/j.jclinepi.2016.01.021 PMID: 27005575

31. Page MJ, McKenzie JE, Bossuyt PM, Boutron I, Hoffmann TC, Mulrow CD, et al. The PRISMA 2020 statement: An updated guideline for reporting systematic reviews. PLOS Med [Internet]. 2021; 18(3): e1003583. https://doi.org/10.1371/journal.pmed.1003583 PMID: 33780438

32. Abraham I, MacDonald K. Quasi-Experimental Research. In: Encyclopedia Of Nursing Research. Springer Publishing Company; 2011.

33. Appelbaum M, Cooper H, Kline RB, Mayo-Wilson E, Nezu AM, Rao SM. Journal article reporting standards for quantitative research in psychology: The APA Publications and Communications Board task force report. Am Psychol. 2018; 73(1):3. https://doi.org/10.1037/amp0000191 PMID: 29345484

34. O'Brien BC, Harris IB, Beckman TJ, Reed DA, Cook DA. Standards for reporting qualitative research: A synthesis of recommendations. Acad Med. 2014; 89(9):1245-51. https://doi.org/10.1097/ACM.0000000000000388 PMID: 24979285

35. Hays JC. Eight Recommendations for Writing Titles of Scientific Manuscripts. Public Health Nurs. 2010; 27(2):101-3. https://doi.org/10.1111/j.1525-1446.2010.00832.x PMID: 20433663

36. Ishida Y, Shimizu T, Yoshikawa M. An analysis and comparison of keyword recommendation methods for scientific data. Int J Digit Libr. 2020; 21(3):307-27.

37. Penders B. Ten simple rules for responsible referencing. PLOS Comput Biol. 2018; 14(4):e1006036. https://doi.org/10.1371/journal.pcbi.1006036 PMID: 29649210
38. Norris JM, Plonsky L, Ross SJ, Schoonen R. Guidelines for Reporting Quantitative Methods and Results in Primary Research. Lang Learn. 2015; 65(2):470–6.

39. Stone H, Bleibaum RN, Thomas HA. Test Strategy and the Design of Experiments. Sens Eval Pract. 2012;117–65.

40. Heale R, Twycross A. Validity and reliability in quantitative studies. Evid Based Nurs. 2015; 18(3):66–7. https://doi.org/10.1136/eb-2015-102129 PMID: 25979629

41. Brand A, Allen L, Altman M, Hlava M, Scott J. Beyond authorship: attribution, contribution, collaboration, and credit. Learn Publ. 2015; 28(2):151–5.

42. The food classification and description system FoodEx 2 (revision 2). EFSA Support Publ. 2017 Mar 7;12(5).

43. Barton A, Hayward L, Richardson CD, McSweeney MB. Use of different panellists (experienced, trained, consumers and experts) and the projective mapping task to evaluate white wine. Food Qual Prefer.; 83:103900.

44. Carroll C, Booth A. Quality assessment of qualitative evidence for systematic review and synthesis: Is it meaningful, and if so, how should it be performed? Res Synth Methods. 2015; 6(2):149–54. https://doi.org/10.1002/jrsm.1128 PMID: 26099483

45. Verhage A, Boels D. Critical appraisal of mixed methods research studies in a systematic scoping review on plural policing: assessing the impact of excluding inadequately reported studies by means of a sensitivity analysis. Qual Quant. 2017; 51(4):1449–68.

46. Dixon-Woods M, Shaw RL, Agarwal S, Smith JA. The problem of appraising qualitative research. BMJ Qual Saf. 2004; 13(3):223–5. https://doi.org/10.1136/qhc.13.3.223 PMID: 15175495

47. Long HA, French DP, Brooks JM. Optimising the value of the critical appraisal skills programme (CASP) tool for quality appraisal in qualitative evidence synthesis: https://doi.org/101177/2632084320947559. 2020; 1(1):31–42.