# Sensory Panel Performance Evaluation--Comprehensive Review of Practical Approaches
## 4 Methods, Models and Frameworks in Sensory Panel Evaluation
### Structure and Models of Sensory Data
\begin{table}
\begin{tabular}{c c c c c} \hline \hline
**Panelist or Panel** & **Panel Performance Parameter** & **Statistical Method/Plot** & **Software** & **References** \\ \hline \multirow{3}{*}{Panelist} & Agreement & & & \\ \cline{2-5}  & Scaling & _ANOVA_1  & SAS macro & [47] \\ \cline{2-5}  & Sensitivity & & & \\ \hline Panel & Agreement & _CLV3W_15  & ClustVarLV *  & [73] \\ \hline Panelist and panel & Agreement & _SRD_16  & Excel macro & [74] \\ \hline Panel & Reproducibility & _CV\%_17  & Excel macro & [75] \\ \hline \multirow{3}{*}{Panelist and panel} & Discrimination & & & \\ \cline{2-5}  & Agreement & _PCA_3  & R-project *  & [49,61] \\ \cline{2-5}  & Repeatability & & & \\ \hline Panelist and panel & Discrimination & _ANOVA_1  & CompuSense & [76] \\ \hline \multirow{3}{*}{Panelist and panel} & Discrimination & & & \\ \cline{2-5}  & Agreement & _ANOVA_1  & SAS macro & [77] \\ \cline{2-5}  & Repeatability & & & GRAPES & [78] \\ \hline \multirow{3}{*}{Panel} & Agreement & _RV_18  & CompuSense & [78] \\ \cline{2-5}  & Repeatability & _NRV_19  & CompuSense & [79] \\ \hline Panelist and panel & Repeatability & _RMSE_5 control chart & SAS & [80] \\ \hline \multirow{3}{*}{Panel} & Agreement & MC simulation with _PCA_3  & R-project *  & MATLAB & [82] \\ \cline{2-5}  & Consistency & & & \\ \hline Panel & Predictive ability & _N-PLS_21  & Unscrambler & [14] \\ \hline \multirow{3}{*}{Panelist} & Agreement & _PCA_ & & \\ \cline{2-5}  & _PANCA_22  & R-project *  & & \\ \cline{2-5}  & Discrimination & _GPA_23  & & \\ \cline{2-5}  & Scale usage & _FCM_24  & CompuSense & [76,84] \\ \cline{2-5}  & Repeatability & _MSE_4  & & \\ \cline{2-5}  & Discrimination & _ANOVA_1  & & \\ \hline \multirow{3}{*}{Panelist} & Agreement (Consonance) & _VAF_25  & & \\ \cline{2-5}  & \(C\)26  & CONS & [83] \\ \hline \multirow{3}{*}{Panelist and panel} & Discrimination & & & \\ \cline{2-5}  & Agreement & \(G\)27  & Excel Macro & [85] \\ \cline{2-5}  & Repeatability & & & \\ \hline \multirow{3}{*}{Panelist and panel} & Discrimination & _ANOVA_1  & & \\ \cline{2-5}  & Agreement & _RV_16  _RV2_29  & PanelCheck 2010 *  & [86] \\ \cline{2-5}  & Repeatability & _RV_16  & & \\ \hline \end{tabular}
\end{table} 
Table 1: _Cont._In the industrial practice of panel performance monitoring, panel drift can be measured using different statistical process control (SPC) methods (period of time): X-chart, CUSUM analysis, Manhattan plot and Shewhart diagram. Sensory results are often set in parallel with the results of instrumental measurements, which is an appropriate way to externally validate sensory results in quality control [30]. Laboratories accredited for sensory tests should demonstrate their proficiency in accredited tests. Proficiency tests can be performed on the results of routine tests or by analyzing independent results. The proficiency testing is determinate of laboratory testing performance by the means of two or more interlaboratory comparisons with blind samples [87; 88; 89]. Reproducibility is sometimes also seen as an element of proficiency [9]. [PERSON] presents \"the steps of proficiency test: selection of method; selection and test of material for the proficiency test items; guidelines for preparation of the proficiency test items and the execution of the test; training material and guidelines for training; coding and consignment of the proficiency test items to the participating laboratories; proficiency test, collection of data from the proficiency test round; analysis of data and report of the results\" [90]. The proficiency items (products) are different in the published studies: compotes, black and mi-doux chocolates/profile [91], candies/profile [58], red wines/profile [92], apple juices/ranking test [93], soft drinks/triangle tests [94], cooked beef/profile [95] and virgin olive oil/profile [96]. PanelCheck software can be recommended to analyze the performance of sensory assessors and panels in these cases [58].