Karim-Gamal's picture
Update README.md
cf1c8f2
metadata
license: apache-2.0
language:
  - en
metrics:
  - f1

switch-base-8-finetuned

This model is a fine-tuned version of google/switch-base-8 on the SemEval-2018-Task-2 emojis english dataset with Federated Learning in IID setting. It achieves the following results on the evaluation set:

  • Accuracy: 50.750 %
  • Mac-F1: 37.355 %

Model description

More information needed

Training hyperparameters

The following hyperparameters were used during training:

  • learning_rate: 1e-4
  • train_batch_size: 464
  • eval_batch_size: 512
  • seed: 42
  • num_epochs: 30

Testing results

SemEval Testing Data accuracy Mac-F1
"Tubingen-Oslo" First SemEval Team 47.09% 35.99%
switch-base-8-finetuned-SemEval-2018-emojis-cen-1 48.040% 33.239%
switch-base-8-finetuned-SemEval-2018-emojis-cen-2 50.174% 36.660%
switch-base-8-finetuned-SemEval-2018-emojis-IID-Fed 50.750% 37.355%

Google colab to test the models on SemEval test dataset : The Notebook

Framework versions

  • Transformers 4.25.1
  • Pytorch 1.13.1+cu116
  • Tokenizers 0.13.2