# EDET: Entity Descriptor Encoder of Transformer for Multi-Modal Knowledge Graph in Scene Parsing
## 4 Experimental Results
### Entity Descriptor and EDET in Industrial Application
#### 4.5.1 Construction of Industrial Knowledge Graph  
First, it was necessary to clarify the constructed graph-oriented usage scene. In this case, the facing industrial scene was the fault analysis in the production process. Rapid warning and preliminary diagnosis of the fault information on the production line can prevent the occurrence of a large range of faults and, according to the preliminary diagnosis results, it can effectively shorten the time and labor cost of troubleshooting and improve the production efficiency.  
Secondly, after clarifying the use scenarios, the massive data were analyzed and classified to find out the objects that meet the application requirements so as to avoid the  
Figure 10: Image captioning by EDET and EDET+.  
impact of excessive redundant industrial data. By analyzing the database and comparing the structure of the data table, combined with the project requirements, the final selected entities and relationships are shown in Tables 6 and 7, respectively.  
After determining the entity and the entity relationship, the attribute selection condition was used to filter the attribute of the entity. For example, each equipment entity has a standard value in the production process, which can be regarded as an attribute of the equipment entity according to the common condition. However, some devices have more than one standard value because they measure multiple locations or types of parameters during operation. According to the unique interaction condition, multiple standard value nodes owned by the device entity need to be fused; a standard value attribute node was used to represent it uniformly and the representation method can use strings, key-value pairs, etc. At the same time, in the scene, there are situations where parts and products have the same name or the product is even a part of a device and parts are components of the device entity. According to the limited scope condition, in the process of constructing and applying the map, the node needs to be split; one exists as a component attribute and the other exists as a product entity node.  
Through the analysis of more than tens of millions of data points, a large-scale knowledge graph with expansion, and in line with the practical application needs, was established. Parts of the knowledge graph are shown in Figure 11.  
\begin{table}
\begin{tabular}{c c c} \hline \hline
**Entity Number** & **Entity Type** & **Attributes** \\ \hline
0 & Equipment & Parts, sub-images, produced by, etc. \\
1 & Order & Standardized work order content \\
2 & Production Line & Workflow \\
3 & Work Center & Location \\
4 & Workflow & Workflow code \\
5 & Parts & Parts and components \\
6 & Product & Parts, subordinate categories, sub-images, etc. \\
7 & Parameters & Category \\
8 & Fault & Fault code \\
9 & Fault Phenomenon & Context description \\
10 & Check Steps & Step description \\
11 & Solution & Content of solution \\ \hline \hline \end{tabular}
\end{table}
Table 6: Selected entities and their attributes on industrial knowledge graph by attribute selection conditions.  
\begin{table}
\begin{tabular}{c c c c} \hline \hline
**Relation Number** & **Relation Definition** & **Relation Label** & **Relation Constraint ([A:B], Entity Number)** \\ \hline
0 & A has part B & Has Part & [0 or 5:5] \\
1 & A is order of B & Order of & [1:6] \\
2 & A is produced on B & Produced On & [1:2] \\
3 & A has process B & Has Process & [2:4] \\
4 & A work on B & Work On & [4:3] \\
5 & A has fault B & Has Fault & [4:8] \\
6 & A has parameters B & Params & [0 or 4 or 6:7] \\
7 & A has phenomena B & Occur & [0 or 4 or 6:9] \\
8 & A is the performance of B & Has Phenomena & [9:8] \\
9 & A has solution B & Solution Is & [8:11] \\
10 & B may be the solution of A & May Solution & [9:11] \\
11 & A has step B & Start Step & [9:10] \\
12 & B is the next step of A & Nest Step & [10:10] \\
13 & B is the final result of A & Final Solution & [10:11] \\ \hline \hline \end{tabular}
\end{table}
Table 7: Relationships on industrial knowledge graph.