Instructions to use iTroned/new_hate_speech_test_8_no_mask with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use iTroned/new_hate_speech_test_8_no_mask with Transformers:
# pip install -U transformers accelerate # Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("iTroned/new_hate_speech_test_8_no_mask", device_map="auto") - Notebooks
- Google Colab
- Kaggle
new_hate_speech_test_8_no_mask
This model is a fine-tuned version of bert-base-uncased on an unknown dataset. It achieves the following results on the evaluation set:
- Loss: 0.3184
- Accuracy Offensive: 0.7938
- F1 Offensive: 0.7640
- Accuracy Targeted: 0.9407
- F1 Targeted: 0.9184
- Accuracy Stance: 0.8837
- F1 Stance: 0.8402
Model description
More information needed
Intended uses & limitations
More information needed
Training and evaluation data
More information needed
Training procedure
Training hyperparameters
The following hyperparameters were used during training:
- learning_rate: 1e-05
- train_batch_size: 8
- eval_batch_size: 8
- seed: 42
- optimizer: Use OptimizerNames.ADAMW_TORCH with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
- lr_scheduler_type: linear
- num_epochs: 10
Training results
| Training Loss | Epoch | Step | Validation Loss | Accuracy Offensive | F1 Offensive | Accuracy Targeted | F1 Targeted | Accuracy Stance | F1 Stance |
|---|---|---|---|---|---|---|---|---|---|
| 0.7465 | 1.0 | 1324 | 0.7387 | 0.6545 | 0.5178 | 0.6545 | 0.5178 | 0.7009 | 0.5777 |
| 0.6686 | 2.0 | 2648 | 0.6345 | 0.6866 | 0.5908 | 0.7326 | 0.6760 | 0.7020 | 0.5809 |
| 0.6009 | 3.0 | 3972 | 0.5277 | 0.7247 | 0.6596 | 0.8229 | 0.7961 | 0.7931 | 0.7420 |
| 0.507 | 4.0 | 5296 | 0.4517 | 0.7394 | 0.6828 | 0.8754 | 0.8521 | 0.8338 | 0.7876 |
| 0.4585 | 5.0 | 6620 | 0.3963 | 0.7753 | 0.7379 | 0.9207 | 0.8986 | 0.8606 | 0.8179 |
| 0.4114 | 6.0 | 7944 | 0.3630 | 0.7768 | 0.7401 | 0.9282 | 0.9061 | 0.8716 | 0.8282 |
| 0.3864 | 7.0 | 9268 | 0.3420 | 0.7836 | 0.7496 | 0.9362 | 0.9139 | 0.8792 | 0.8352 |
| 0.363 | 8.0 | 10592 | 0.3274 | 0.7938 | 0.7640 | 0.9403 | 0.9180 | 0.8822 | 0.8387 |
| 0.3479 | 9.0 | 11916 | 0.3205 | 0.7931 | 0.7629 | 0.9407 | 0.9184 | 0.8837 | 0.8401 |
| 0.3475 | 10.0 | 13240 | 0.3184 | 0.7938 | 0.7640 | 0.9407 | 0.9184 | 0.8837 | 0.8402 |
Framework versions
- Transformers 4.50.2
- Pytorch 2.6.0+cu124
- Datasets 3.0.1
- Tokenizers 0.21.1
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support
Model tree for iTroned/new_hate_speech_test_8_no_mask
Base model
google-bert/bert-base-uncased