# A Comparative Study of Design Evaluation with Virtual Prototypes Versus a Physical Product
## 3 Results and Discussion
### Appearance Aspect  
* Form  
Accuracy: Both groups performed very well by achieving over 90% accuracy. The chi-square test result indicated no significant difference between the two groups.  
Emotional responses: Only the valence construct was significantly different between the two groups. The physical group was in a more positive emotional state.  
\begin{table}
\begin{tabular}{c c c} \hline \hline  & \multicolumn{2}{c}{(**a**)} \\ \hline
**Option** & **Number of Times** & **\%** \\ \hline
2 & 13 & 26.0 \\
3 (correct) & 36 & 72.0 \\
4 & 1 & 2.0 \\ Total & 50 & 100.0 \\ \hline \hline  & \multicolumn{2}{c}{(**b**)} \\ \hline
**Option** & **Number of Times** & **\%** \\ \hline
2 & 6 & 12.0 \\
3 (correct) & 32 & 64.0 \\
4 & 12 & 24.0 \\ Total & 50 & 100.0 \\ \hline \hline  & \multicolumn{2}{c}{**(c)**} \\ \hline  & \multicolumn{2}{c}{**Values**} & **DF** & **Sig.** \\ \hline Chi-Square test & 12.122 1  & 2 & 0.002 \\ \hline \hline \end{tabular}
\end{table}
Table 1: (**a**) Estimation of referenced volume with the physical product; (**b**) estimation of referenced volume with the virtual prototype; (**c**) chi-square test for the referenced volume estimation.  
* Color Accuracy: The physical group achieved higher accuracy (62%) in comparison to the virtual group (48%). This result may be natural because the real product should, by all means, have the \"right\" color. The chi-square test result revealed that the difference was not statistically significant.  
Emotional responses: The two groups reacted differently in terms of the valence construct and arousal construct. The physical group was in a more positive state when evaluating the colors of the physical product, while the virtual group was in a more aroused state when evaluating the colors of the virtual prototype.
* Material  
Accuracy: The physical group performed rather well, with an accuracy of 96%, while the virtual group achieved an accuracy of 76% (see Table 2a,b). The chi-square test result shows that this difference is statistically significant (Table 2c).  
Emotional responses: As shown in Table 2d, the two groups had a difference with regard to the valence construct. The physical group was in a more positive state.  
\begin{table}
\begin{tabular}{c c c} \hline \hline  & \multicolumn{2}{c}{(**a**)} \\ \hline
**Option** & **Number of Times** & **\%** \\ \hline
1 & 2 & 4.0 \\
2 (correct) & 48 & 96.0 \\ total & 50 & 100.0 \\ \hline  & \multicolumn{2}{c}{(**b**)} \\ \hline
**Option** & **Number of Times** & **\%** \\ \hline
1 & 12 & 24.0 \\
2 (correct) & 38 & 76.0 \\ total & 50 & 100.0 \\ \hline  & \multicolumn{2}{c}{(**c**)} \\ \hline  & **Values** & **df** & **Sig.** \\ \hline Chi-Square test & 8.306 1  & 1 & 0.004 \\ \hline  & \multicolumn{2}{c}{(**d**)} \\ \hline  & \multicolumn{2}{c}{**SS**} & **DF** & **MS** & **F** & **P** \\ \hline  & Between Groups & 19.360 & 1 & 19.360 & 10.218 & 0.002 \\ Valence & Within Groups & 185.680 & 98 & 1.895 & \\  & Total & 205.040 & 99 & \\ \hline  & Between Groups & 7.840 & 1 & 7.840 & 2.366 & 0.127 \\ Arousal & Within Groups & 324.800 & 98 & 3.314 & \\  & Total & 332.640 & 99 & \\ \hline  & Between Groups & 9.610 & 1 & 9.610 & 3.282 & 0.073 \\ Dominance & Within Groups & 286.980 & 98 & 2.928 & \\  & Total & 296.590 & 99 & \\ \hline \hline \end{tabular} 1  
\end{table}
Table 2: (**a**) Estimation of material with the physical product. (**b**) Estimation of material with the virtual prototype. (**c**) Chi-square test for estimation of material. (**d**) ANOVA for estimation of material.