## 5 Evaluation
### Evaluation Results  
In evaluation A, the general functionality of the prototype was tested. It was observed that the prototype was able to perform what was expected. The variable \"number of results\" was correctly considered. As mentioned before, web scrapping is not allowed on every page, therefore the prototype skipped such web pages, and the number of output files was reduced by the count of such web pages. The variable of \"domain\" was not taken into consideration. The prototype chose the search result from Google without the limitation in the domain. For each query, the output revealed a result xml-file with the considered URL and the summarized text. The total amount of results aimed was 45 (four queries with ten results and one query with five results). Table 2 shows the results of the comparison between the human search results and the results from the prototype. Identical means that the human performer and the prototype found the same URL and listed it at the same position of the search. This outcome was found 17 times. Twelve times the same URL was found by the prototype and the human performer but on a different search result position. Nevertheless, they were among the top ten search results in both methods. Seven results were duplicated by the prototype. Meaning there was only one URL listed in the Google search results, but the prototype found different URL from the same page and listed all of them as results. As mentioned before, the limitation to the domain \"com\" was not taken into consideration and five pages were shown with different domains. In two queries, one result was missing due to web scrapping not being allowed on one page. For one website, the Google search displayed a subpage, whereas the prototype retrieved its information from the homepage. The human performer skipped this website whereas the prototype took it into consideration. In evaluation B, the quality of the text summarization was analyzed. In total 34 unique URLs resulted into text summaries. Table 3 shows the results to the evaluation questions. The first question was whether the summarized text was understandable. In the tester's opinion, 23 results were understandable. Twenty times the content of the summarized text matched the content in the webpage. But only in nine cases the reader had the impression of \begin{table}
\begin{tabular}{l l} \hline \hline
**Result Evaluation A** & **No. of Results** \\ \hline Identical & 17 \\ \hline Appears in manual search top 10 & 12 \\ \hline Duplicated & 7 \\ \hline Wrong domain & 5 \\ \hline Missing result because of scraping error & 2 \\ \hline Did not appear in manual search & 1 \\ \hline Subpage & 1 \\ \hline
**Total** & **45** \\ \hline \hline \end{tabular}
\end{table} 
Table 2: Results evaluation A.  
receiving valuable information from the text summary. Eleven results matched the content but were still perceived as uninformative. Looking at the cases where the summaries were not informative but matching the content gives more insights into the prototype's performance. In Table 4, reasons for the perceived lack of information within those summaries are given. In 5 of 11 times, the website was not relevant from the beginning, suggesting that the website would have been skipped by the human tester. Three times the products were not mentioned, even though the queries were aimed for products. The remaining three unsatisfying results showed unnecessary or misleading content from the website. Next the results from evaluation C are shown in Table 5. It displays the efficiency of the prototype in terms of search time:  
Compared to a human using only the Google search engine, the use of the prototype allowed for much faster retrieval of information. However, prototype results were not screened by a human, meaning that during the 35 s of execution no information was processed by the human mind. In contrast, during the 16 min in which the human performed the process using only the search engine, information from ten different web pages was already processed intellectually to some degree.