## 2 Evaluation Indices and Data Acquisition
### Data Preprocessing
(4) The network state perception reflects the ability of network management equipment to perceive changes when network node states change, and it is weighted by the sum of accuracy and delay. Accuracy is expressed as the number of times the network management device has successfully identified the network state change divided by the number of times that the network agent senses the change and triggers the trap reports. Delay is represented as the time lag between the node device sending trap notification and the network management device identifying the change. The calculation model is shown as follows. \[X4=\omega_{1}\frac{n_{success}}{n_{trap}}+\omega_{2}\frac{1}{n_{success}}\sum \limits_{i=1}^{n_{success}}\frac{t_{sp\max}-t_{spdelay}^{i}}{t_{sp\max}-t_{ sp\min}}\ \ \omega_{1}+\omega_{2}=1 \tag{6}\]  
\(n_{success}\) represents the number of times the network management device has successfully identified the changes, \(n_{trap}\) represents the number of times the node device has sent trap notifications, \(t_{spdelay}^{i}\) represents transmission delay of the state change notification \(i\) and \(t_{sp\max}\), \(t_{sp\min}\) represent the maximum and minimum values of the state change notification transmission delay. \(\omega_{1}\) and \(\omega_{2}\) represent the weight of accuracy and delay, which can be artificially specified or obtained by AHP and other methods. (5) The timeliness of network adjustment reflects the delay between a network adjustment instruction being sent and the successful network adjustment. Contrary to the delay calculation method in the previous article, this index calculates the time lag between the network management device sending the adjustment instruction and the node network agent processing and outputting the control instruction. The calculation model is shown as follows. \[X5=\frac{1}{n_{nm}}\sum\limits_{i=1}^{n_{nm}}\frac{t_{mm\max}-t_{nmdelay}^{i}}{ t_{nm\max}-t_{nm\min}} \tag{7}\]  
\(n_{mm}\) represents the number of network adjustment instructions, \(t_{nmdelay}^{i}\) represents the transmission delay of the network adjustment instruction \(i\) and \(t_{nm\max}\), \(t_{nm\min}\) represents the maximum and minimum values of transmission delay. (6) The success rate of temporary network access reflects the success rate of temporary network entry. The calculation method was the detachment nodes' ratio of successful network access to total application times. Successful network access means that the detachment node receives the network access permission message sent by the network management device. The calculation model is shown as follows. \[X6=\frac{n_{access}}{n_{apply}} \tag{8}\]  
\(n_{access}\) represents the number of detachment nodes that has been successfully accessed. \(n_{apply}\) represents the number of applications. (7) The voice interruption rate reflects the effect of voice communication. Similarly to the end-to-end average delay, the influence of voice interruption loss among different levels of users is different. The level of nodes on both sides of the call should also be considered in the calculation. The calculation model is shown as follows. \[X7=\frac{1}{n_{C2}+n_{De}}\sum\limits_{i=1}^{n_{C2}+n_{De}}\left(\frac{1}{n \textrm{call}_{i}}\sum\limits_{j=1}^{n\textrm{call}_{i}}\frac{s^{i}+s_{d}^{j} }{16}CF(j)\right) \tag{9}\]  
\(n_{C2}\) represents the number of C2 nodes, \(n_{De}\) represents the number of access nodes in detachment network, \(ncall_{i}\) represents the total number of calls from node \(i\), \(s^{i}\) represents the level of node \(i\) and \(s_{d}^{j}\) represents the user level of the \(j\)th call. According to the level of troop establishments, there are eight levels. altogether Thus, the maximum level of transceiver node sum is 16. _CF(j)_ is an index function, which is 1 when the call \(j\) failed or interrupted and 0 for the rest. (8) The voice link building time reflects the average time from dialing to successful chain establishment, and it is calculated by the weighted sum of the two levels of the caller.