# Using Machine Learning Language Models to Generate Innovation Knowledge Graphs for Patent Mining
## 4 Case Study: Graph Summaries of Carbon Capture Patents
### Validation
\begin{table}
\begin{tabular}{c c c c c c c} \hline \hline \multirow{2}{*}{**Patent**} & \multirow{2}{*}{**Origin**} & \multirow{2}{*}{**st-Text**} & \multirow{2}{*}{**Graph**} & \multicolumn{2}{c}{**Retention**} & \multicolumn{1}{c}{**Retention**} & \multicolumn{1}{c}{**Retention**} \\  & & & & & **Ratio (st-t/o)** & **Ratio (g/o)** & **Ratio (g/st-t)** \\ \hline US20101120308A1 & 5.20 & 4.33 & 3.58 & 0.83 & 0.69 & 0.83 \\ US2014000416A1 & 5.01 & 4.07 & 3.43 & 0.81 & 0.68 & 0.84 \\ US20140196481A1 & 5.14 & 4.71 & 2.94 & 0.92 & 0.57 & 0.62 \\ US20160151742A1 & 4.55 & 4.14 & 3.63 & 0.91 & 0.88 & 0.80 \\ US20180162729A1 & 5.68 & 4.75 & 3.73 & 0.84 & 0.78 & 0.66 \\ US20190380137A1 & 5.46 & 4.96 & 3.59 & 0.91 & 0.66 & 0.72 \\ US201903886A1 & 4.86 & 4.47 & 4.21 & 0.92 & 0.87 & 0.94 \\ US20200001231A1 & 5.03 & 4.64 & 3.59 & 0.92 & 0.71 & 0.77 \\ US20200276730A1 & 3.97 & 3.38 & 3.06 & 0.85 & 0.77 & 0.90 \\ US20200289975A1 & 3.82 & 3.72 & 2.70 & 0.97 & 0.71 & 0.73 \\  & Average & & & 89\% & 73\% & 78\% \\ \hline \hline \end{tabular}
\end{table} 
Table 1: Cluster \(1\) validation results. \begin{table}
\begin{tabular}{c c c c c c c} \hline \hline \multirow{2}{*}{**Patent**} & \multirow{2}{*}{**Origin**} & \multirow{2}{*}{**st-Text**} & \multirow{2}{*}{**Graph**} & \multicolumn{1}{c}{**Retention**} & \multicolumn{1}{c}{**Retention**} & \multicolumn{1}{c}{**Retention**} \\  & & & & **Ratio (st-t/o)** & **Ratio (g/o)** & **Ratio (g/st-t)** \\ \hline US20080141672A1 & 4.01 & 3.78 & 3.10 & 0.94 & 0.77 & 0.82 \\ US20080196584A1 & 3.89 & 3.35 & 2.94 & 0.86 & 0.76 & 0.88 \\ US20080196585A1 & 3.89 & 3.35 & 2.94 & 0.86 & 0.76 & 0.88 \\ US20080196587A1 & 3.87 & 3.26 & 2.75 & 0.84 & 0.71 & 0.84 \\ US2009027326A1 & 3.81 & 3.27 & 2.48 & 0.86 & 0.65 & 0.76 \\ US20140190351A1 & 3.27 & 3.04 & 2.33 & 0.93 & 0.71 & 0.77 \\ US20160193561A1 & 3.27 & 3.07 & 2.33 & 0.94 & 0.71 & 0.76 \\ US20190282952A1 & 3.57 & 3.16 & 2.31 & 0.89 & 0.65 & 0.73 \\ US20190299151A1 & 2.91 & 2.41 & 2.19 & 0.83 & 0.75 & 0.91 \\ US20200075981A1 & 3.86 & 3.33 & 2.43 & 0.86 & 0.63 & 0.73 \\ Average & & & 88\% & 71\% & 81\% \\ \hline \hline \end{tabular}
\end{table} 
Table 3: Cluster 3 validation results. \begin{table}
\begin{tabular}{c c c c c c} \hline \hline \multirow{2}{*}{**Patent**} & \multirow{2}{*}{**Origin**} & \multirow{2}{*}{**st-Text**} & \multirow{2}{*}{**Graph**} & \multicolumn{1}{c}{**Retention**} & \multicolumn{1}{c}{**Retention**} \\  & & & & **Ratio (st-t/o)** & **Ratio (g/o)** & **Ratio (g/st-t)** \\ \hline US20080141672A1 & 4.01 & 3.78 & 3.10 & 0.94 & 0.77 & 0.82 \\ US20080196584A1 & 3.89 & 3.35 & 2.94 & 0.86 & 0.76 & 0.88 \\ US20080196585A1 & 3.89 & 3.35 & 2.94 & 0.86 & 0.76 & 0.88 \\ US20080196587A1 & 3.87 & 3.26 & 2.75 & 0.84 & 0.71 & 0.84 \\ US2009027326A1 & 3.81 & 3.27 & 2.48 & 0.86 & 0.65 & 0.76 \\ US20120190351A1 & 3.27 & 3.04 & 2.33 & 0.93 & 0.71 & 0.77 \\ US20190193561A1 & 3.27 & 3.07 & 2.33 & 0.94 & 0.71 & 0.76 \\ US20190282952A1 & 3.57 & 3.16 & 2.31 & 0.89 & 0.65 & 0.73 \\ US20190299151A1 & 2.91 & 2.41 & 2.19 & 0.83 & 0.75 & 0.91 \\ US20200075981A1 & 3.86 & 3.33 & 2.43 & 0.86 & 0.63 & 0.73 \\ Average & & & 88\% & 71\% & 81\% \\ \hline \hline \end{tabular}
\end{table} 
Table 4: Cluster 4 validation results. Table 2 shows the validation results of Cluster 2, \"Process Design\". The retention rate of the summary text to the original text is 87%; the retention rate of the summary graph to the original text is 78%; and the retention rate of the summary graph to the summary text is 89%. The validation results of the Cluster 3, \"Process Control\", patent summaries are listed in Table 3. The retention rate of the summary text to the original text is 88%; the retention rate of the summary graph to the original text is 71%; and the retention rate of the summary graph to the summary text is 81%. Table 4 shows the validation results of Cluster 4, \"Chemical Properties\".