## 5 Results and Discussion
### Extrinsic Evaluation
For the Enron dataset, the decision-making results for the focused group showed that 21 males and 6 females opted for results obtained with 20 epochs, while 13 males and 1 female chose results obtained with 30 epochs. Furthermore, none of the males and females chose results with 10 epochs. With regard to the Lingspam dataset, the results indicate that 15 males and 3 females selected results of 20 epochs, while 19 males and 4 females opted for results with 30 epochs. Similar to the observations of Enron dataset, none of the males and female subjects opted for results with 10 epochs. Finally, for the PU dataset, 10 males and 2 females selected results of 20 epochs, while 24 males and 5 females selected results with 30 epochs. Furthermore, no males or females opted for results with 10 epochs. While the results with respect to Enron and Lingspam datasets are non-conflicting for both BERT and LSTM models, a divided opinion is observed with the regard to the PU datasets for both BERT and LSTM models. That is, with accuracy, precision, and recall as the performance measures, it was not simple to select the best option for the human subjects, and therefore an automated decision-making approach that prov \begin{table}
\begin{tabular}{c c c c c c c c c} \hline \hline
**Dataset** & **Epochs** & **Accuracy** & **Precision** & **Recall** & \begin{tabular}{c} **Decision** \\ **(Male)** \\ \end{tabular} & \begin{tabular}{c} **Percentage** \\ **(Population)** \\ \end{tabular} & \
\begin{tabular}{c} **Decision** \\ **(Female)** \\ \end{tabular} &
\begin{tabular}{c} **Percentage** \\ **(Population)** \\ \end{tabular} \\ \hline Enron & 10 & 0.96 & 0.98 & 0.98 & 0 & 0\% & 0 & 0\% \\  & 20 & 0.97 & 0.98 & 0.98 & 21 & 62\% & 6 & 57\% \\  & 30 & 0.97 & 0.98 & 0.98 & 13 & 38\% & 1 & 43\% \\ \hline LingSpam & 10 & 0.96 & 0.96 & 0.94 & 0 & 0\% & 0 & 0\% \\  & 20 & 0.98 & 0.96 & 0.95 & 15 & 44\% & 3 & 43\% \\  & 30 & 0.98 & 0.95 & 0.97 & 19 & 56\% & 4 & 57\% \\ \hline PU & 10 & 0.93 & 0.95 & 0.9 & 0 & 0\% & 0 & 0\% \\  & 20 & 0.95 & 0.95 & 0.95 & 10 & 29\% & 2 & 29\% \\  & 30 & 0.96 & 0.96 & 0.94 & 24 & 71\% & 5 & 71\% \\ \hline \hline \end{tabular}
\end{table} 
Table 8: Summary of extrinsic evaluation for the LSTM model. \begin{table} \begin{tabular}{c c c c c c c c c} \hline \hline
**Dataset** & **Epochs** & **Accuracy** & **Precision** & **Recall** & \begin{tabular}{c} **Decision** \\ **(Male)** \\ \end{tabular} & \begin{tabular}{c} **Percentage** \\ **(Population)** \\ \end{tabular} & \begin{tabular}{c} **Decision** \\ **(Female)** \\ \end{tabular} & \
\begin{tabular}{c} **Percentage** \\ **(Population)** \\ \end{tabular} \\ \hline Enron & 10 & 0.96 & 0.98 & 0.98 & 0 & 0\% & 0 & 0\% \\  & 20 & 0.97 & 0.98 & 0.98 & 21 & 62\% & 6 & 57\% \\  & 30 & 0.97 & 0.98 & 0.98 & 13 & 38\% & 1 & 43\% \\ \hline LingSpam & 10 & 0.96 & 0.96 & 0.94 & 0 & 0\% & 0 & 0\% \\  & 20 & 0.98 & 0.96 & 0.95 & 15 & 44\% & 3 & 43\% \\  & 30 & 0.98 & 0.95 & 0.97 & 19 & 56\% & 4 & 57\% \\ \hline \hline \end{tabular} \begin{tabular}{c c c c c c c c} \hline \hline
**Dataset** & **Epochs** & **Accuracy** & **Precision** & **Recall** & \begin{tabular}{c} **Decision** \\ **(Male)** \\ \end{tabular} & \begin{tabular}{c} **Percentage** \\ **(Population)** \\ \end{tabular} & \begin{tabular}{c} **Decision** \\ **(Female)** \\ \end{tabular} & \
\begin{tabular}{c} **Percentage** \\ **(Population)** \\ \end{tabular} \\ \hline Enron & 20 & 0.96 & 0.98 & 0.98 & 0 & 0\% & 0 & 0\% \\  & 20 & 0.97 & 0.98 & 0.98 & 21 & 62\% & 6 & 57\% \\  & 30 & 0.97 & 0.98 & 0.98 & 13 & 38\% & 1 & 43\% \\ \hline \hline \end{tabular}