# Contactless Real-Time Eye Gaze-Mapping System Based on Simple Siamese Networks
## 4 Experiments
### Results  
A total of 90,000 GGM data-training sets, consisting of 5 users, were trained for the gaze-mapping system. The gaze-mapping system was evaluated as correct when the user gazed at a specific area for 5 s, and the calculated value of the intersection of the union (IoU) of the gaze-mapping prediction area and each grid area was 0.5 or higher. The test environment was divided into a total of three user cases, as shown in Table 1, and the experiments included various user heights and accessories.The test environment of the gaze mapping system is shown in Figure 12. When the user gazed at the lower area of the shelves (grid numbers 25 to 36), we found that the performance of the gaze mapping was lower than when they gazed at the rest of the grid area. This tendency was that when the user looked at the top of the shelves, the region of interest was relatively easy to acquire from the whole eyeball area. Conversely, when the user looked down, the gaze estimation was limited because of the insufficient acquisition of the pupil area. When the user's gaze estimation on the shelves was incomplete, the results confirmed that the approximate gaze could be guaranteed from the head-pose information. In the case of 2 users (CASE 1 and CASE 2) according to the test setting in Table 2, an evaluation was also performed, and the processing was similar to the case of one user. An NVIDIA Jetson TX2 was used to implement the gaze-mapping system. We also tested another edge device from the same manufacturer, and the AGX Xavier showed a speed of 10 fps, as shown in Table 3. The system was composed of 5 modules, and the processing of each input and output was parallelized, as shown in Figure 13.  
Figure 11: GIST gaze-mapping system shelving configuration. The grid area was composed of a total of 36 cells, and the same shelves used by the distribution industry were used. Each grid was 17 cm wide and 23 cm high, and the camera height was 1.5 m above the ground. \begin{table}
\begin{tabular}{l l c c} \hline \hline
**User Case** & **Conditions** & \\ \hline Common conditions & 1. A/B/C/D Sub-CASE (total no. of points-per-user \\  & 80 = 10 points \(\times\) 4 cases \(\times\) 2 trials) & \\  & -A: No accessories, shared at front of shelves & \\  & -B: No accessories, 30\({}^{\circ}\) side view & \\  & -C: Worce accessories (glasses, hats, masks), stared at front & \\  & of shelves & \\  & -D: Worce accessories (glasses, hats, masks), stared at 30\({}^{\circ}\) to the left and right & \\  & 2. Complied with grid setting value (6 \(\times\) 6 grid shelf) & \\ \hline Different conditions (CASE 1-3) & 1. The height of the two users must be different (user heights: 155 cm, 175 cm, \(\pm\)5 cm) & \\  & 2. The height of the two users must be different (user heights: 165 cm, 185 cm, \(\pm\)5 cm) & \\  & 3. Turn the head as far as possible and stare & \\ \hline \hline \end{tabular}
\end{table} 
Table 1: GGM dataset test scenario configuration. Each user case was constructed by changes in the user height, accessories, and head pose. \begin{table}
\begin{tabular}{c c c c} \hline \hline
**Test Definition** & **User Case** & **No. of Trials** & **(Accuracy, \%)** \\ \hline
2 users stared at 0.75 m & CASE 1 & 80 & 93.75 \\ \hline
2 users stared at 0.75 m & CASE 2 & 80 & 90.00 \\ \hline
2 users stared at 1 m & CASE 1 & 80 & 96.25 \\ \hline
2 users stared at 1 m & CASE 2 & 80 & 91.25 \\ \hline
2 users stared at 1.5 m & CASE 1 & 80 & 96.25 \\ \hline
2 users stared at 1.5 m & CASE 2 & 80 & 91.25 \\ \hline
1 user stared at 0.75 m & CASE 3 & 40 & 95.00 \\ \hline
1 user stared at 1 m & CASE 3 & 40 & 92.50 \\ \hline
1 user stared at 1.5 m & CASE 3 & 40 & 90.00 \\ \hline \hline \end{tabular}
\end{table} 
Table 2: Experiments were performed according to the defined test environment. Various tests were performed according to the number of users and the distance from the user to the shelves. Figure 12: Example of the gaze-mapping system in the test environment. This figure shows the area at which two users are staring.