## 3 Deepfake Detection System through Collective Intelligence and Deep Learning
### Integrated Vote
#### 3.3.3 Composition of Integrated Vote  
Progress of the Integrated Voting Process  
Figure 10 shows the sequence of the entire process for integrated voting in the proposed deepfake detection system. The figure shows objections by users, election of voters, voting according to quarters, aggregation, and integration in the proposed system. The detailed process is as follows:  
Figure 10: Process sequence diagram of the proposed system. Figure 9: Node model voting process configuration. An objection flag, which is an objection to content suspected of being manipulated by an unspecified user of the network, is presented. * The network proceeds with the voterSelect process to initiate integrated voting. * The hash value of seed S for RANDAO is submitted from each ICP node by voterSelect. * After six blocks, the original seed \(S\) is submitted, and based on the random number \(sn\) generated by Xor, a voter is randomly selected by matching with the client UID. * Voters are notified, and voting takes place within 24 h. \(\rightarrow\) User vote
* Each ICP node is notified of the implementation of integrated voting and requests a decision value for the corresponding content. \(\rightarrow\) Node model vote
* The voting performed is integrated by adding voter weight and node weight through the voting collector. * Integration voting results for flags are judged as positive (+) or negative (-) values based on a specific threshold that exceeds the threshold. Aggregation and Integration of Votes  
Integrated voting, which is a self-purification function of the proposed system, is conducted by integrating the aggregate results of collective intelligence-based user voting and deep-learning-based node model voting on suspected deepfake contents. For user voting based on collective intelligence, after electing voters through the voter selector and requesting votes from client users in the network, they are aggregated together with the user weight in the voting collector and then integrated. Node model voting is based on deep-learning voting requests from ICP, a network peer node, and the node model running on the ICP node verifies suspicious content. The verification results of the node model are aggregated in the nodevote mixer along with the node weight of each node and then integrated with user votes in the voting collector. Figure 11 shows the process of integrated voting in the proposed system. Integrated voting is initiated through the objection flag, which is an objection raised by the system user (client) for system self-purification. The flag transaction by the user is delivered to the system's main chaincode through the endorser and orderer, and the voting process is performed by branching into user voting and node model voting. The voting agenda is whether the target content has been modified by deepfake. The integrated voting of the proposed system is composed of \(n\) user voters and nodes, with \(m\) node models predicting the contents of \(k\) frames. Figure 11: Integrated vote structure of the proposed deepfake detection system. For user voting branched off from the voting process, after electing voters through the process of Section 3.3.1. Fair Election of Voters in Blockchain Environment, the event listener requests the elected voters to vote. The elected voters cast their votes during the time limit of the requested time. The number of voters elected and the voting time can be adjusted according to the size of the system. Equation (5) shows the user votes being counted in the voting collector. \[VI^{\mathit{roter}}=\sum_{\mathit{voter}}^{n}\left(V[C]_{i}\times UW_{i}\right) \tag{5}\]  
The voting integrated value of \(n\) voters \(VI^{\mathit{roter}}\) is calculated through the values of positive (1), abstention and invalidation (0), and negative (\(-1\)) of the voting result for the voting agenda content \(C\) and Equation (3). It is aggregated by adding the user weight (0.75-1.25) value. The results of user voting are counted in the voting collector and immediately reflected in the integrated vote.