I 2 C - H uelva at S em E val-2023 Task 10: Ensembling Transformers Models for the Detection of Online Sexism (2023)

Abstract: This work details our approach for addressing Tasks A and B of the Semeval 2023 Task 10: Explainable Detection of Online Sexism (EDOS). For Task A a simple ensemble based of majority vote system was presented. To build our proposal, first a review of transformers was carried out and the 3 best performing models were selected to be part of the ensemble. Next, for these models, the best hyperpameters were searched using a reduced data set. Finally, we trained these models using more data. During the development phase, our ensemble system achieved an f1-score of 0.8403. For task B, we developed a model based on the deBERTa transformer, utilizing the hyperparameters identified for task A. During the development phase, our proposed model attained an f1-score of 0.6467. Overall, our methodology demonstrates an effective approach to the tasks, leveraging advanced machine learning techniques and hyperparameters searches to achieve high performance in detecting and classifying instances of sexism in online text.

## introduction sexism refers to any type of mistreatment or negative attitude that is specifically directed towards women based on their gender or based on their gender combined with one or more additional aspects of their identity (such as being a black woman, muslim woman, or transgender woman). allowing sexism to thrive on these platforms can normalize violence against women and other individuals who face discrimination based on gender or gender identity. therefore, it is crucial to take measures to eradicate sexism on social media and promote a more inclusive and respectful environment for all individuals. in this work, were used transformerbased solutions @xcite ) and follow an ensemble strategy, specifically for the sexism detection in task a. by completing these tasks, we became aware selecting the correct hyperparameters for each model also boosted the prediction rate for the model. ## background a dataset developed for the semeval 2023 task -explainable detection of online sexism @xcite ) is used to train, validate, and test models. this dataset contains labelled data from the social network twitter in english language. labels associated to each tweet gives information used to classify if the tweet is sexist or not (for task a), and in case that the tweet is sexist, categorize the sexism of the tweet (for task b). the total size of the dataset is 13984 tweets (10602 not sexist and 3398 sexist). the dataset, common to all tasks, contains the tweets along with the labels used for their classification. these labels are divided in two types: sexist label (used to detect if the tweet is sexist or not sexist) and category label (used to categorize the sexism of the tweet threats, derogation, animosity, and prejudiced discussion). for task a, based on the strategy described in (vaca-serrano 2022) for a similar task, a simple ensemble based of majority vote system was presented. first a review of transformers was carried out and the three best performing models were selected to be part of the ensemble. these models were trained in two phases. during the first phase, the best hyperparameters for each model were found. in the second phase these hyperparameters are used to learn with more training data. finally, a simple assembly strategy is used. ## system overview in the approach proposed in this paper, we perform two tasks: detection of sexism (task a) and classification of sexism (task b). ## experimental setup overall, our experimental setup for an ensemble involved the following steps: experimental data preparation, model selection, hyperparameter tuning, ensemble creation and evaluation to ensure optimal performance. ## results preliminary experiments results are presented in finally, the results of the ensemble of models described in previous sections during the development and testing phases of the competition are presented in ## conclusions in this work we present our approach for addressing tasks a and b of the semeval 2023 task 10: explainable detection of online sexism (edos). during the development phase, our overall system got a macro f1-score of 0.8403 for task a and 0.6467 for task b. overall, our methodology demonstrates an effective approach to tasks, leveraging advanced machine learning techniques and hyperparameter searches to achieve high performance in detecting and classifying instances of online text sexism.