# Study on Cyber Common Operational Picture Framework for Cyber Situational Awareness
## 2 Related Works
### Cyber Common Operational Pictures Interface
#### 2.3.1 Research on Response Time  
MIL-STD-1472H [36] presents the definition and time for each item, leading to the response times listed in Table 3. In addition, it is suggested that the maximum system response time of a real-time system should not exceed the time in Table 3. \begin{table}
\begin{tabular}{c c} \hline \hline
**Study** & **Implemented Visualization Number** \\ \hline [PERSON] et al. [24] & 2 \\ [PERSON] et al. [25] & Only visualization concept/methodology is presented \\ [PERSON] et al. [26] & 2, 4 \\ [PERSON] et al. [27] & Only visualization concept/methodology is presented \\ [PERSON] et al. [28] & 2 \\ [PERSON] et al. [29] & 2, 4 \\ [PERSON] et al. [30] & 2, 3, 4 \\ [PERSON] et al. [31] & There are only reviews of several visualization studies \\ [PERSON] [32] & Only visualization concept/methodology is presented \\ [PERSON] et al. [33] & 2, 4 \\ [PERSON] et al. [34] & Only visualization concept/methodology is presented \\ \hline \hline \end{tabular}
\end{table} 
Table 2: Visualization Implementation Status in CyCOP Studies. [PERSON] et al. (2017) investigated the response time experienced by users after general operations in a study on the response time in smartphone-related fields. There are a total of 28 users, 14 in their 10 s and 20 s (7 males and 7 females) and 14 in their 40 s and 50 s (7 males and 7 females), and they had been using their smartphones for at least 6 months. This survey showed that users considered the responses to be instantaneous when the system responded within 0.1-0.2 s or 0.5-1 s. If the system responded within 2-5 s, it seemed like it was in progress, but if the system responded within 7-10 s, it felt like it was disconnected. Table 4 summarizes the guidelines for the minimum response time of an appropriate system after user manipulation as suggested in the research, along with guidelines on human response time. What should be noted in this research is that users generally think that the system is operating normally until the response time is 5 s, and they are interested in the progress. However, if the response time is more than 7 s, it is considered that the system is not working properly. Therefore, it is suggested that the response time should be less than 5 s to give users confidence that the system is operating normally. [PERSON] (2017) suggested that most users prefer a short response time, and if the response time is longer than 15 s, their concentration is dispersed. The appropriate response times according to the time definitions are presented in Table 5. The above three studies ([PERSON] et al., 2017; [PERSON] et al., 2017; [PERSON] et al., 2017) suggested response speeds according to the execution. If this is again classified and synthesized according to the difficulty of calculation and data processing, it can be defined as a simple response time (less than 2 s) and complex response time (more than 2 s). \begin{table}
\begin{tabular}{c c} \hline \hline
**Type of Task** & **Appropriate Response Time (s)** \\ \hline Switch/button pressed indication & 0.1 \\ Display text after typing on the keyboard & 0.1–0.2 \\ Display touched text & 0.2 \\ Initial response to system access & 1–3 \\ Function execution & \\ Simple function & 2 \\ Complex function & 5 \\ When loading occurs during function execution & 15–60 \\ Input confirmation, input error notification & 2–4 \\ \hline \hline \end{tabular}
\end{table} 
Table 4: Acceptable System Response Times on Smartphone.