# OEQA: Knowledge- and Intention-Driven Intelligent Ocean Engineering Question-Answering Framework
## 5 Case Study
### The Application of OEQA
: _Accuracy refers to whether the generated natural answer corresponds to the question and contains all of the correct information._  
**Definition 4**. : _Practicality refers to whether the generated natural answer is useful to the questioner._  
We found three domain experts to anonymously score the sentences on a scale of 0-5 based on the given definitions. The metrics with the higher score indicate better-generated effects. Figure 8 shows the average results of the manual evaluation of the systems. \begin{table}
\begin{tabular}{p{113.8 pt} p{284.5 pt}} \hline \hline
**[INPUT] Question** & \begin{tabular}{c} **What Is the Sea Area Used Mode of Jiangsu Xiangshui China Three Gorges 12.5 MW Wind Turbine Test Project?** \\ \end{tabular} \\ \hline Correct Answer Enities & \begin{tabular}{c} \\ \end{tabular} & \
\begin{tabular}{c} jiangsu Xiangshui China Three Gorges 12.5 MW Wind Turbine Test Project adopts two methods of permeable structures and submarine cable pipelines as the sea area used mode. The role of the permeable structure is to protect the coastline and prevent waves from eroding the seawall, and the submarine cable pipeline is to transmit the electrical energy generated to the land grid by the wind power generators. This way can not only protect the marine environment but also make full use of offshore wind energy resources to achieve efficient use of clean energy. \\ \hline \multirow{4}{*}{
\begin{tabular}{} \end{tabular}  Instances \\ \cline{2-3}  & The sea area used mode of Jiangsu Xiangshui China Three Gorges 12.5 MW Wind Turbine Test Project should refer to the sea area where the best wind turbine is located. According to the “Regulations on the Administration of the Use of Sea Areas” issued in 2010 and subsequent relevant regulations, wind power belongs to the sea for production and operation. Therefore, it can be judged that the sea used by Jiangsu Xiangshui China Three Gorges 12.5 MW Wind Turbine Test Project belongs to the sea for production and operation. However, the specific way of using the sea still needs to consult the latest relevant policies and regulations or the relevant local departments to obtain accurate answers. \\ \hline \hline \end{tabular} Correct knowledge answer entities are underlined; Incorrect knowledge answer entities are highlighted with a wavy underline.  
\end{table} 
Table 7: Samples of natural answer generation for OEQA Chatbot and ChatGPT. Figure 8: Manual evaluation of the results of answering generation. The results revealed that both systems generate fluent natural answers, although ChatGPT obtains a higher relative score of 4.9683 on Fluency. ChatGPT is advantageous in terms of Fluency, which benefits from a large number of parameters. Additionally, OEQA Chatbot achieves improvements of 1.0913, 4.2817, and 3.1071 in Relevance, Accuracy, and Practicality, respectively. The reason for the analysis is that the stored knowledge in the OEQA Chatbot is more fine-grained in this field. In contrast, ChatGPT has the problem of an inaccurate understanding of the user's intentions and provides precise answers and guidance. Therefore, the OEQA Chatbot has a good performance in intelligent question-answering in the ocean engineering field.