# High-Quality Data from Crowdsourcing towards the Creation of a Mexican Anti-Immigrant Speech Corpus
## 3 Methodology
### Stage II: Expert Data and Criteria
#### 3.2.1 Defining Specific Criteria for Mexican Anti-Immigrant Speech  
Considering a strict definition, anti-immigrant speech conveys a hostile attitude towards people, or their descendants, who reside or settle in a territory other than their native country. Usually, individuals take an anti-immigrant stance \"on behalf of the 'natives' of a country, their interests, their culture, and even their origins (or 'race')\" [31]. Even if racism often fuels anti-immigrant speech, they are not equivalent. Indeed, ethnocentric political movements can advocate for immigration if migrants fit into supposed specific social, cultural, or biological criteria. In Mexico, it is unusual to employ the term \"anti-immigrant\". Mexico is not an immigration country. In a report on HS against migrants [1], the Mexican government prefers to utilize the more generic expression \"xenophobic speech\". However, in the specific context described in Section 1.1, HS against migrants in Mexico is increasingly similar to that present in traditional countries of immigration. Published research on online xenophobic or anti-immigrant speech tends to use a strict definition of HS, where posts must be addressed explicitly to the vulnerable category of interest and must be intentionally harmful to this category; see, for example, [18]. Because intentionality can be quite difficult to detect and we wished to consider even the most implicit types of anti-immigrant speech, we took a broader approach, arguing that \begin{table}
\begin{tabular}{l l l} \hline \hline
**Filtering Criteria** & **Year** & **Description** \\ \hline \multirow{3}{*}{Dates} & \multirow{3}{*}{2018} & First migrant caravan, presidential election in Mexico, caravan, San Ysidro crossing attempt, global compact for migration, [PERSON] mentions the caravan, legislative election \\  & & Migration agreement with Mexico, [PERSON]’s speech about work for migrants, Title 42 and pandemic \\  & & 2020 \\  & & 2021 \\  & & [PERSON]’s declaration on ISSSTE and Cuban medics, caravan, trailer tragedy in Texas \\  & & \\ \hline \multirow{3}{*}{Keywords} & \multirow{3}{*}{2018–2022} & Migr, caravana, hondurefn, frontera, centroamerican, haitian, delincuent, mara, extranjer, refugiad, invas, mugros, induce-umentad, liegales, soberania, nacion, [PERSON], negro, african, venezolano, cubano, nicaraguense, guatemalec, chapin, onu, catracho, nica, Nicoya, pinolero, sudaca, cachucos \\ \hline \multirow{3}{*}{Hashtags} & \multirow{3}{*}{2018–2022} & \#caravana \#caravanamigrante, \#mexicoprimero, \#mexicoparné, alosmexicanos, \#fueracaravanamigrante \\ \hline \hline \end{tabular}
\end{table} 
Table 1: Dates, keywords, and hashtags of interest for filtering criteria. \begin{table}
\begin{tabular}{l l l} \hline \hline
**Training Date** & **Accuracy** & **Support** \\ \hline
1 October 2021 & 0.7675 & 200 \\ \hline
5 December 2022 & 0.8291 & 200 \\ \hline
25 January 2023 & 0.8801 & 240 \\ \hline
21 March 2023 & 0.8828 & 250 \\ \hline \hline \end{tabular}
\end{table} 
Table 2: Accuracy of Mexican anti-immigrant classification models in the continuous improvement loop. in order to be anti-immigrant, a post must (a) reference migrants, explicitly or implicitly, and (b) incite, spread, or promote negative representations or behaviors against them. According to [PERSON] et al., providing non-expert annotators with a general definition such as the one mentioned above does not improve the reliability of their annotation [32]. This is why we decided to provide a more sophisticated definition, more akin to a guideline, that could help the annotators recognize certain characteristics of Mexican online antimigrant speech when given new data. The exploratory analysis of Mexican online conversations on migration described in Section 3.1.2 proved to be essential in confronting our general, theoretical considerations with empirical data, thus grounding our work in the specific context of interest.