# CGM: Copy Mechanism GPT with Mask for Ellipsis and Anaphora Resolution in Dialogue
## 4 Experimental Results
### Experimental Results and Analysis
#### 4.3.2 IT Domain Utterance Restoration Experiments
Table 9 shows an example of this. Compared with other models that correctly restored the product name without altering the user's intent, CGM additionally restored'service customer', resulting in errors such as altering the user's intent. In the restaurant reservation data as well, similar to the IT domain, CGM-based models showed generally high performance in Rouge-L and F1 metrics. \begin{table}
\begin{tabular}{p{142.3 pt} p{142.3 pt}} \hline \hline
**Model** & **Generated Example** \\ \hline \(R_{i}\) & When installing the **AI delivery robot**, are there any conditions? \\  & Basically, you need facilities for water supply, electricity, and internet. \\ \hline \(P_{i}\) & But what if there’s an accident because of the robot? \\ \hline Baseline & What happens if the **AI delivery robot** has an accident? \\ \hline PG-GPT & What if there’s an accident because of the **AI delivery robot?** \\ \hline CGM & What if there’s an accident because of the **AI delivery robot?** \\ \hline CGM + HardPrompt A & What if there’s an accident with the **AI delivery robot?** \\ \hline CGM + HardPrompt B & What if there’s an accident with the **AI delivery robot?** \\ \hline CGM + 0/1 Mask only & What if there’s an accident because of the **AI delivery robot?** \\ \hline CGM + SepTwice & What if there’s an accident with the **AI delivery robot?** \\ \hline Ground Truth & What if there’s an accident because of the **AI delivery robot?** \\ \hline \hline \end{tabular}
\end{table} 
Table 5: Examples of sentence restoration by model. Bold represents the keyword that needs to be recovered in the result of models. \begin{table}
\begin{tabular}{l l c c c c c c c c c c} \hline \hline  & \multicolumn{6}{c}{**IT**} & \multicolumn{6}{c}{**Restaurement Reconstruction**} \\ \hline
**Type** & **Model** & **BLEU** & **Reng-L** & **F1** & **simCSE** & **BIRTScore** & **BLEU** & **Reng-L** & **F1** & **simCSE** & **BIRTScore** \\ \hline  & Baseline & 0.4673 & 0.4054 & 0.1022 & 0.5724 & 0.9763 & 0.8351 & 0.4634 & 0.2122 & 0.9378 & 0.9475 \\  & TC-GPT & 0.4232 & 0.4125 & 0.3180 & 0.3492 & 0.9509 & 0.8591 & 0.5371 & 0.2768 & **0.9518** & **0.9559** \\  & CCM & **A4080** & **0.4830** & 0.1022 & **0.8909** & 0.9257 & 0.8355 & 0.5271 & 0.7906 & 0.9374 \\  & CCM & **A4100** & 0.4207 & 0.4136 & 0.8593 & 0.9512 & 0.5186 & **0.9427** & **0.9250** & 0.9328 \\  & CCM & **A4110** & 0.4320 & 0.7016 & **0.4380** & 0.8571 & 0.9159 & 0.8120 & 0.5068 & **0.9624** & **0.9264** & **0.9268** \\  & CCM & **A4110** & 0.4313 & 0.3262 & 0.0009 & 0.8529 & **0.9262** & 0.8088 & 0.4419 & 0.2163 & 0.9538 & 0.9419 \\  & CCM & **A4590** & 0.4136 & 0.4210 & 0.5355 & 0.5086 & 0.8012 & 0.4081 & 0.2195 & 0.9557 & 0.9578 \\ \hline  & Baseline & 0.3462 & 0.3549 & 0.1207 & 0.8667 & 0.7860 & 0.7268 & 0.8757 & 0.7078 & **0.9578** & **0.9578** \\  & CCM & 0.3563 & 0.4690 & 0.2123 & **0.9612** & **0.9407** & 0.7270 & **0.8600** & 0.7080 & 0.9146 & 0.9206 \\  & CCM & 0.4350 & 0.4229 & 0.2283 & **0.8509** & 0.7023 & 0.7033 & 0.8809 & **0.9919** & 0.8171 & 0.8176 \\  & CCM & **A4110** & 0.4378 & 0.3072 & 0.8756 & 0.9012 & 0.7081 & 0.8485 & 0.7272 & 0.9141 & 0.9196 \\  & CCM & **A4110** & 0.3240 & 0.3820 & 0.8633 & 0.8939 & 0.7393 & 0.8573 & 0.8757 & 0.9419 & 0.9160 \\  & CCM & **A4110** & 0.4788 & 0.4357 & 0.8782 & 0.8950 & 0.6902 & 0.8465 & 0.0925 & 0.9169 & 0.9160 \\ \hline  & Baseline & 0.4693 & - & - & 0.9316 & 0.9143 & 0.8833 & - & - & 0.9967 & 0.9333 \\  & CCM & **A4110** & 0.4378 & 0.4378 & 0.8742 & 0.8746 & 0.8815 & - & - & 0.9961 & 0.9589 \\  & CCM & **A4110** & 0.4378 & 0.4378 & 0.8792 & 0.8950 & 0.6902 & 0.8465 & - & **0.9955** & 0.9842 \\ \hline  & Baseline & 0.4693 & - & - & 0.9305 & 0.9124 & 0.8847 & - & - & 0.9962 & 0.9626 \\  & CCM & **A4110** & 0.4378 & - & - & 0.9319 & 0.8747 & - & - & 0.9952 & 0.9622 \\  & CCM & **A4110** & 0.5701 & - & - & 0.9319 & 0.8721 & 0.8641 & - & - & 0.9975 & 0.9638 \\  & CCM & **A4590** & **0.5820** & - & - & **0.9338** & 0.9125 & 0.869 & - & - & 0.962 & **0.979** \\ \hline \hline \end{tabular}
\end{table}