Hugging Face's logo

Tanor
/
Jerteh355SENTNEG6

Text Classification
Transformers
Safetensors
roberta
Generated from Trainer
Inference Endpoints
Model card Files Community
Jerteh355SENTNEG6 / README.md
Tanor's picture
Tanor
End of training
f9ab2cf verified
preview code
|
raw
history blame contribute delete
No virus
1.71 kB
metadata
license: cc-by-sa-4.0
base_model: jerteh/Jerteh-355
tags:
  - generated_from_trainer
metrics:
  - f1
model-index:
  - name: Jerteh355SENTNEG6
    results: []

Jerteh355SENTNEG6

This model is a fine-tuned version of jerteh/Jerteh-355 on the None dataset. It achieves the following results on the evaluation set:

  • Loss: 0.0637
  • F1: 0.5490

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

  • learning_rate: 2e-05
  • train_batch_size: 64
  • eval_batch_size: 16
  • seed: 42
  • gradient_accumulation_steps: 4
  • total_train_batch_size: 256
  • optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
  • lr_scheduler_type: linear
  • num_epochs: 32

Training results

Training Loss Epoch Step Validation Loss F1
No log 0.9843 47 0.0487 0.4878
No log 1.9895 95 0.0445 0.4737
No log 2.9948 143 0.0566 0.5306
No log 4.0 191 0.0594 0.5306
No log 4.9843 238 0.0637 0.5490

Framework versions

  • Transformers 4.40.1
  • Pytorch 2.2.2
  • Datasets 2.19.0
  • Tokenizers 0.19.1