## 3 Materials and Methods
### Study Design
Finally, the third file, structure.txt, included answers about user's perceptions of the website's structure quality. This study's process involved several steps that included practical tasks as presented in Figure 2. In the beginning, we presented the basic purpose and goals of the experiment to the participants and briefly explained the basic steps (without a detailed explanation of the individual tasks). In this initial step, the participants signed a statement agreeing to participate in the research and use the data for further research. A short survey followed the introduction step, the aim of which was to collect basic demographic information about the participants of the experiment. This included information on participants gender, tool familiarity level and frequency of AI chatbot use. User familiarity with AI tools was assessed for ten of the most common AI-based chatbots available on the market at the time of the study (i.e., ChatGPT, Gemini, Bing Chat, OpenAI Playground, Jasper, Perplexity AI, HuggingChat, Chatsonic, YouChat, Socrates.ai). Five-point Likert scale with answers ranging from 1--Not familiar at all to 5--Very familiar was used. The frequency of the AI tool used was assessed on a similar five-point Likert scale (1--Never, 2--Very rarely, 3--Occasionally, 4--Frequently, 5--Very frequently). All aforementioned demographic data was self-reported. While user familiarity with a broader range of chatbots was assessed to contextualize participant experience, ChatGPT and Gemini were specifically selected for experimental tasks due to their advanced functionalities, alignment with the requirements of qualitative data analysis, and their popularity at the time of the study. Other chatbots listed in Table 2 were not included in the experiments as they did not fully meet the criteria for this study. \begin{table}
\begin{tabular}{l c c c c c c c c c c c c c c} \hline \hline \multicolumn{11}{c}{**Familiarity**} & \multicolumn{11}{c}{**Frequency of Use**} \\ \hline
**Chatbot** & **Range** & **Min** & **Max** & **Mean** & **Mode** & **Median** & **Std. Dev** & **Range** & **Min** & **Max** & **Mean** & **Mode** & **Median** & **Std. Dev** \\ \hline ChatGPT & 2 & 3 & 5 & 4.62 & 5 & 5 & 0.60 & 4 & 1 & 5 & 4.39 & 5 & 5 & 0.86 \\ Gemini & 4 & 1 & 5 & 2.65 & 3 & 3 & 1.23 & 4 & 1 & 5 & 1.81 & 1 & 1.05 \\ Bing Chat & 4 & 1 & 5 & 2.55 & 3 & 3 & 1.04 & 4 & 1 & 5 & 1.85 & 2 & 1 & 1.03 \\ OpenAI Playground & 4 & 1 & 5 & 1.64 & 1 & 1 & 0.92 & 4 & 1 & 5 & 1.26 & 1 & 1 & 0.70 \\ Jasper & 3 & 1 & 4 & 1.46 & 1 & 1 & 0.72 & 1 & 1 & 2 & 1.05 & 1 & 1 & 0.21 \\ Perplexity AI & 4 & 1 & 5 & 1.52 & 1 & 1 & 0.96 & 4 & 1 & 5 & 1.19 & 1 & 1 & 0.66 \\ HuggingChat & 4 & 1 & 5 & 1.25 & 1 & 1 & 0.71 & 2 & 1 & 3 & 1.12 & 1 & 1 & 0.42 \\ Chatsonic & 4 & 1 & 5 & 1.31 & 1 & 1 & 0.79 & 2 & 1 & 3 & 1.11 & 1 & 1 & 0.44 \\ YouChat & 2 & 1 & 3 & 1.14 & 1 & 1 & 0.41 & 2 & 1 & 3 & 1.04 & 1 & 1 & 0.24 \\ Socrates.ai & 2 & 1 & 3 & 1.12 & 1 & 1 & 0.36 & 3 & 1 & 4 & 1.06 & 1 & 1 & 0.36 \\ \hline \hline \end{tabular}
\end{table} 
Table 2: Participants’ Familiarity and Frequency of Use for Various AI Chatbots. After users had completed the demographic questionnaire, we presented the first task using the Taguette tool. In the first task, they were instructed to perform data annotation on the content.txt file--tagging the survey answers with the core challenges they highlighted. Participants were free to define as many tags as needed. The participants did not receive instructions or restrictions on how to name the tags. In this task, the participants had to identify and prepare a list of the top ten most crucial challenges related to the website's content based on the qualitative data. When the participants were sure that they had completed the task, they had to submit the result or solution and fill in the questionnaire to assess the implementation of task 1 with the selected tool. In the second task, the participants were asked to categorize the answers in the same dataset based on their sentient as positive or negative.