## 5 Discussions
### Performance  
The cybersecurity testing platform for ICVTest was implemented on the hardware platform with the following specifications: Processor-Xeon 2300 series with 8 cores, Memory-64 GB, Hard disk-1 TB. CentOS7 is used as the operating system. The performance of the platform is presented in Table 6.  
* Testing Process. The majority of frameworks do not prioritize the testing flow. Instead, most existing frameworks focus on theoretical threat analysis and risk assessment. However, our proposed ICVTest offers a standardized penetration testing procedure, which mitigates variances in test conclusions, enabling even novice testers to swiftly initiate penetration testing. \begin{table}
\begin{tabular}{c c c} \hline \hline
**Metric** & **Definition** & **Parameter** \\ \hline Response Time & \begin{tabular}{c} The number of services that can be handled by \\ the platform per unit time \\ \end{tabular} & \textless{}500 ms \\ \hline Query to View Time & \begin{tabular}{c} The total time consumed by the Query service \\ \end{tabular} & \textless{}50 ms \\ \hline Query per Second & \begin{tabular}{c} The number of queries the platform can process \\ per unit time \\ \end{tabular} & \textgreater{}600 \\ \hline Transaction per Second & \begin{tabular}{c} The number of integrated services that can be \\ handled by the platform per unit time \\ \end{tabular} & \textgreater{}400 \\ \hline Concurrent Users & \begin{tabular}{c} The number of users who simultaneously log in \\ to the platform and perform business operations \\ \end{tabular} & \textgreater{}30 \\ \hline Concurrent Agents & \begin{tabular}{c} The number of agents that log in and register at \\ the same time for business processing \\ \end{tabular} & \textgreater{}30 \\ \hline Failure Ratio & \begin{tabular}{c} Failure Ratio = (failed service)/(total \\ service) * 100\% \\ \end{tabular} & \textless{}0.1\% \\ \hline CPU Usage & \begin{tabular}{c} Utilization rate of CPU resources (mean/peak) \\ under platform service \\ \end{tabular} & \(12\%/80\%\) \\ \hline RAM Usage & \begin{tabular}{c} Utilization rate of RAM resources (mean/peak) \\ under platform service \\ \end{tabular} & \(1\) GB/8 GB \\ \hline Disk Throughput & \
\begin{tabular}{c} The amount of data read and write from a disk \\ per unit time in the absence of disk failure \\ \end{tabular} & \(400\) MB/s \\ \hline Network Throughput &
\begin{tabular}{c} The number of network data per unit time in the \\ absence of network failures \\ \end{tabular} & \(9\) MB/s \\ \hline \hline \end{tabular}
\end{table} 
Table 6: The performance of cybersecurity testing platform for ICVTest. \begin{table}
\begin{tabular}{c c c c c} \hline \hline
**Framework** & **Process** & **Test Case Set** & **Platform/Tool** & **Scenarios** & **Type** \\ \hline ICVTest & **Yes** & 10 & **Yes** & Penetration Testing & VPT \\ \hline [PERSON] et al. [28] & **No** & 3 & **No** & Risk Assessment & VPT \\ \hline [PERSON] et al. [29] & **No** & 10 & **No** & Risk Assessment & VPT \\ \hline [PERSON] et al. [30] & **No** & 3 & **Yes** & Education & VPT \\ \hline [PERSON] et al. [25] & **No** & 4 & **No** & Penetration Testing & IVSTP \\ \hline [PERSON] et al. [26] & **Yes** & 1 & **Yes** & Penetration Testing & IVSTP \\ \hline [PERSON] et al. [27] & **No** & 2 & **Yes** & Penetration Testing & IVSTP \\ \hline \hline \end{tabular}
\end{table} 
Table 7: The comparison between ICVTest and other frameworks. * Comprehensive Test Case Set. ICVTest abstract automotive security test scenarios into 10 sets that correspond to different fields of software and hardware architecture in vehicles, which allows for the reuse of test cases. The ability of 10 fields of vehicle cybersecurity threat modeling is not available in other frameworks. * Integrated platform. Most frameworks only theoretically point out the threats that should be considered during security assessment, and not actual tools or platforms provided for security testing. In ICVTest, we have developed a cybersecurity testing platform to facilitate the testing task for security testers.