# A Framework for Enhancing Big Data Integration in Biological Domain Using Distributed Processing
## 5 Results and Discussion
### Test Cases 1 and 2: Big Data Integration Framework
#### 5.1.2 Distributed Data Integration  
We did the integration in the case of 2, 3, 4, and 5 slaves. As an example, Table 3 shows the integration results after adding gene2 go, gene info, gene neighbors, gene2 pubmed, gene2 ensembl, and gene2 sts in the case of 3 slaves. After each integration, the logical consistency for the global and sub-ontologies is checked. We got a pass in all the tests. In addition, we got an equivalent in the case of comparing the global ontology results of the distributed integration with the global ontology results after the local integration. This is shown in Table 4.  
At the end of the experiments we found that our proposed distributed integration framework gave the same results as the local data integration. Moreover, each global or sub-ontology passes the logical consistency test (Jena Ontology API, HermiT, and Pellets reasoners). This means that our integration method does not violate any logical consistency rules. Additionally, at the end of each integration step, we got a global ontology equivalent to the one we got from the local integration. \begin{table}
\begin{tabular}{c c c c c c c c} \hline \hline  & **Ontology** & **Sample** & **Added** & **Added** & **Ontology** & & \\  & **Size** & **Size** & **Items** & **Roots** & **Size** & **Edges** & **Vertices** & **Roots** \\ \hline Original GO & 36,639 & 36,639 & 0 & 0 & 36,639 & 71,577 & 36,639 & 3 \\ gene2 go & 36,639 & 55,859 & 55,964 & 1 & 92,604 & 239,470 & 148,568 & 4 \\ gene\_info & 92,604 & 56,603 & 55,964 & 1 & 148,569 & 295,435 & 148,569 & 5 \\ gene\_neighbors & 148,569 & 56,647 & 55,964 & 1 & 204,534 & 407,364 & 204,534 & 6 \\ gene2 pubmed & 204,534 & 56,044 & 55,964 & 1 & 260,499 & 519,293 & 260,499 & 7 \\ gene2 ensembl & 260,499 & 56,647 & 55,964 & 1 & 316,464 & 631,222 & 316,464 & 8 \\ gene2 sts & 316,464 & 56,647 & 56,647 & 1 & 373,112 & 744,517 & 403,954 & 9 \\ gene2 accession & 373,112 & 18,142,094 & 0 & 0 & 373,112 & 744,517 & 403,954 & 9 \\ gene2 unigene & 373,112 & 589221 & 0 & 0 & 373,112 & 744,517 & 403,954 & 9 \\ gene2 vega & 373,112 & 84828 & 0 & 0 & 373,112 & 744,517 & 403,954 & 9 \\ \hline \hline \end{tabular}
\end{table} 
Table 1: Local Data Integration Summary. \begin{table}
\begin{tabular}{c c c c} \hline \hline  & **Jena Ontology API** & **HermiT Reasoner** & **Pellet Reasoner** \\ \hline Original GO & pass & pass & pass \\ gene2 go & pass & pass & pass \\ gene\_info & pass & pass & pass \\ gene\_neighbors & pass & pass & pass \\ gene2 pubmed & pass & pass & pass \\ gene2 ensembl & pass & pass & pass \\ gene2 sts & pass & pass & pass \\ \hline \hline \end{tabular}
\end{table} 
Table 2: Logical Consistency Tests and Results. The resulting ontology is equivalent in ontology size before the integration, in the number of added items, skipped items, and overlapped items, in ontology size after the integration step, in the number of edges, vertices, and roots. Although we can get the same result as in local integration in a shorter time, with less processing and overhead, we proposed that the distributed integration have a set of distributed sub-ontologies equivalent to the global one, where we can assign each sub-ontology to one of the slaves for further processing and integration such as in the case of similarity calculation. In this case, we can process each sub-ontology without the overhead of loading all the global ontology in a single machine and RAM that require more efficient computers to accomplish that. As we said before, efficient computers will \begin{table}
\begin{tabular}{l l l l l} \hline \hline  & **Jena API** & **HermiT Reasoner** & **Pellets Reasoner** & \multicolumn{2}{c}{**Compared to**} \\  & & & & **Local Integration** \\ \hline Master & pass & pass & pass & equivalent \\ Slave 1 & pass & pass & pass & NA \\ Slave 2 & pass & pass & pass & NA \\ Slave 3 & pass & pass & pass & NA \\ \hline \hline \end{tabular}
\end{table} 
Table 4: Logical consistency tests and comparing the global ontology to the one generated from the local integration in the case of 3 slaves.