# Web-Based Android Malicious Software Detection and Classification System
## 4 Results and Discussion
\begin{table}
\begin{tabular}{c c c c c} \hline \hline  & \begin{tabular}{c} **Number of** \\ **Correct Detection** \\ \end{tabular} & \begin{tabular}{c} **Number of False** \\ **Detection** \\ \end{tabular} & \
\begin{tabular}{c} **Rate of Correct** \\ **Detection (\%)** \\ \end{tabular} &
\begin{tabular}{c} **Rate of False** \\ **Detection (\%)** \\ \end{tabular} \\ \hline Benign Data Set & 1129 & 44 & 96.25 & 3.75 \\ Malicious Data Set & 5164 & 381 & 93.13 & 6.87 \\ Overall & 6293 & 425 & 93.67 & 6.33 \\ \hline \hline \end{tabular}
\end{table} 
Table 6: Evaluation results based on the permissions the applications in the data sets possess. \begin{table}
\begin{tabular}{c c c c} \hline \hline  & \begin{tabular}{c} **Number of** \\ **Correct Detection** \\ \end{tabular} & \begin{tabular}{c} **Number of False** \\ **Detection** \\ \end{tabular} & \
\begin{tabular}{c} **Rate of Correct** \\ **Detection (\%)** \\ \end{tabular} &
\begin{tabular}{c} **Rate of False** \\ **Detection (\%)** \\ \end{tabular} \\ \hline Benign Data Set & 1106 & 67 & 94.29 & 5.71 \\ Malicious Data Set & 5136 & 409 & 92.62 & 7.38 \\ Overall & 6242 & 476 & 92.91 & 7.09 \\ \hline \hline \end{tabular}
\end{table} 
Table 5: Results of evaluation based on the permissions in Android version 4.1. When Table 6 is examined, the correct detection rate of the benign data set according to relevant evaluation is 96.25%. The correct detection rate in the malicious dataset is 93.13%. The overall correct detection rate is 93.67%, and the overall false detection rate is 6.33%. The third method is the evaluation in which the malicious values of the applications are calculated by using the VirusTotal values of the applications and the first method. That is, it is the evaluation made using VirusTotal values of the applications in the benign and malicious data sets and 197 permissions and applications in Android version 4.1. The obtained results based on this evaluation are shown in Table 7.  
When Table 7 is examined, the correct detection rate of the benign data set according to relevant evaluation is 96.85%. The correct detection rate in the malicious dataset is 97.49%. The overall correct detection rate is 97.38% and the overall false detection rate is 2.62%. The fourth method is the evaluation in which the malicious values of the applications are calculated using the VirusTotal values of the applications and the second method. That is, it is the evaluation made using the VirusTotal values of the permissions and the applications that the applications in benign and malicious data sets use. The results obtained based on this evaluation are shown in Table 8.  
When Table 8 is examined, the correct detection rate of the benign data set according to the relevant evaluation is 98.12%. The correct detection rate in the malicious dataset is 97.51%. The overall correct detection rate is 97.62%, and the overall false detection rate is 2.38%. Among these four methods, the method with the highest performance rate is the method using the permissions in benign and malicious data sets together with VirusTotal. The use of VirusTotal in the calculation method increased the success of the system as seen in the results given above. Moreover, evaluation based on permissions on the specified Android version was the least effective method. It is believed that this is the result of the exclusion of special permissions and the permissions released after Android version 4.1. The comparison of the developed system with studies using the static analysis method in the literature is shown in Table 9.  
When Table 9 is examined, permissions and API calls are used as attributes in general. Genom and Drebin data sets have been commonly preferred for the evaluation of the proposed tools or methods in literature. The detection rate of malicious applications was used as an evaluation criterion. The proposed tools or methods were applied to both the malicious and the benign data sets. The success rates vary between 80% and 99.2%.