## 3 Method
### Evaluation Scope
For all evaluations, human and machine, responses generated for these tasks were scored on a standardized 1-5 Likert scale, where 1 indicated poor quality (inaccurate, unclear, irrelevant) and 5 denoted exceptional performance (accurate, clear, fully relevant, and well-formed). Example prompt templates are presented in Table 1.  
The evaluation took place outside the SALLY chatbot, using domain-relevant content and questions, rather than embedding them in the chatbot framework. This choice was primarily driven by the need to perform a clean, more controlled assessment of the core capabilities of LLMs without being influenced by chatbot-specific factors, such as user interface or system integration constraints. As the primary objective of the study is to assess and compare the LLMs' capabilities for migrant-related contexts, rather than their performance within a specific end-to-end system, we emphasize the scientific question of model suitability over engineering considerations. All prompts provided to the language models and the corresponding model-generated answers were in Greek, as the core objective of this study is to evaluate the performance of the LLMs specifically in the Greek language across the defined tasks. To enhance \begin{table}
\begin{tabular}{p{142.3 pt} p{284.5 pt}} \hline \hline
**Evaluation Task** & **Prompt Template** \\ \hline \multirow{3}{*}{**Reading Comprehension**} & Given the following text, answer the question based only on the provided content. Text: [TEXT], Question: [QUESTION] \\ \hline \multirow{3}{*}{**Text Summarisation**} & Given the following text, generate a concise and coherent summary that captures the key points and essential details. Text: [TEXT] \\ \cline{2-2}  & Correct the grammar and syntax of the following text without changing its meaning or tone. Text: [TEXT] \\ \hline \multirow{3}{*}{**Emotion Detection**} & Identify the sentiments expressed in the following text (e.g., hopeful, positive, supportive, optimistic, pragmatic, concerned, encouraging, progressive, compassionate, forward-thinking, inclusive, empowering, frustrated, solution-oriented). Return the results starting from the most plausible sentiment. Text: [TEXT] \\ \hline \hline \end{tabular}
\end{table} 
Table 1: Example Prompt templates for the evaluation tasks. understanding for a broader audience, we provide an illustrative example of the texts and responses in English translation within the main body of the paper. Furthermore, all original Greek texts used in the evaluation, along with their English translations, are available for reference in Appendices A and B. For example, one of the instantiations of the Reading Comprehension template (Table 1) was the following (the original questions were in Greek, but for clarity, we present equivalent text in English):  
_Given the following text, answer the question based only on the provided content._  
**Text:** _The accommodation structures provide temporary housing for third-country nationals or stateless persons who have applied for international protection in Greece. They also host family members of asylum seekers, unaccompanied or accompanied minors, and individuals belonging to vulnerable groups. These facilities ensure a stable living environment that meets basic living and social needs, as well as educational and learning requirements. Residents live under a regime of independent living while being required to follow internal regulations to maintain the smooth operation of the facility. Services provided include housing, food, legal and social information, psychological support, access to healthcare, personal hygiene supplies, clothing, Greek language lessons, and educational programs. Residents must leave the structures within 30 days of receiving a decision granting them international or subsidiary protection.