Figure 1: LLM instructions example _Your task involves interpreting and analyzing transcripts of interviews conducted with parents, focusing on their aspirations concerning their children’s future education and careers solely in the context of religion, without implying any monetary incentives. Specifically, your role is to discern whether the parent explicitly expresses a desire for their child to pursue a religious path. Assign the “Religious Aspirations” label only if the parent explicitly articulates aspirations for their child that include becoming a religious scholar, Hafiz, attending a madrassa, learning Arabic, Quran reading, Islamic covering, regular prayer, working in Islamic banks, or being a Islamic scholar. It is crucial not to assign this label if the child is already engaged in any of the mentioned activities, as current religious activities are not considered future aspirations. If there is no such direct reference to religious aspirations in the parent’s statement, assign the “Not Applicable” label to indicate that the topic of religious aspirations was not addressed. Here are some examples: ### Input: Interviewer: What are your aspirations for your son’s future? Respondent: I hope that he will become a great Islamic scholar. I want him to learn Arabic and read the Quran regularly. ### Output: Interpretation: The parent explicitly expresses a desire for their child to pursue a path in religious education, specifically mentioning becoming an Islamic scholar, learning Arabic, and reading the Quran regularly. Therefore, this conversation aligns with the ‘Religious Aspirations’ label. Label: Religious Aspirations ### Input: Interviewer: Do you have any specific dreams for your daughter? Respondent: I want her to excel in her studies and become a successful engineer. ### Output: Interpretation: While the parent does express aspirations for their child’s future, these aspirations are not religious in nature. The parent hopes for their child to become an engineer, which doesn’t involve any religious activities as per the instruction. Therefore, this conversation should be labeled as ’Not Applicable’. Label: Not Applicable ### Input: Interviewer: What do you envision for your child’s future? Respondent: I would like my son to become a Hafiz. It’s a great honor in our religion. ### Output: Interpretation: The parent explicitly expresses a desire for their child to become a Hafiz, which is a religious aspiration as per the instruction. Therefore, this conversation aligns with the ‘Religious Aspiration’ label. Label: Religious Aspirations ### Input: Interviewer: What are your hopes for your children’s future careers? Respondent: I want them to have successful careers. I hope my daughter becomes a doctor and my son becomes a lawyer. ### Output: Interpretation: While the parent does express aspirations for their children’s future, these aspirations do not involve any religious activities or pursuits as per the instruction. Therefore, this conversation should be labeled as ‘Not Applicable’. Label: Not Applicable_ _### Input: Interviewer: What is your dream about your son who is studying in class one? Respondent: Still in Noorani. After reading Noorani, he will read Hafezi. By the grace of Allah, he will teach in a madrasa when he becomes a hafez. That is my dream._ _### Output: (ChatGPT) Interpretation: The respondent expresses a clear religious aspiration for their child, which is to become a Hafiz and teach in a madrasa. There is no mention of any monetary incentives, so this response aligns with the criteria for "Religious Aspiration". Label: Religious Aspiration_ _### Output: (Llama-2-13b) Interpretation: The parent explicitly expresses a desire for their child to pursue a path in religious education, specifically mentioning becoming a Hafiz and teaching in a madrassa. Therefore, this conversation aligns with the "Religious Aspiration" label. Label: Religious Aspiration_ _### Output: (Llama-2-13b-chat)_ _Interpretation: The parent explicitly expresses a desire for their child to pursue religious studies and become a Hafiz (one who has memorized the Quran). They also mention teaching in a madrasa, which is an Islamic school. Therefore, this conversation aligns with the "Religious Aspiration" label. Label: Religious Aspiration_ _Note_ : This Figure shows example instructions given to the LLMs for the "Aspirations: Religious" code. These results are given to the LLM as a single prompt, but for clarity we have grouped the instructions into three parts here, as indicated by the colors. The first section (in green) describes the task and gives the definition of the code. The labelled examples (in blue) help the LLM understand the task at hand, often referred to as "few shot learning". For each example, we also provide a reasoning for the annotation (in red) so that the LLM is also asked to explain why it applies a certain label, which is known as "chain of thought" prompting. The second box shows an example of a QA pair to be annotated and the subsequent boxes show the responses of the three LLMs to this prompt.

4