shipping_qa_model_29_04_24

This model is a fine-tuned version of distilbert/distilbert-base-uncased on an unknown dataset. It achieves the following results on the evaluation set:

• Loss: 4.9818

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 16
• eval_batch_size: 16
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 10

Training results

Training Loss	Epoch	Step	Validation Loss
No log	1.0	28	5.6661
No log	2.0	56	5.3693
No log	3.0	84	5.2166
No log	4.0	112	5.1823
No log	5.0	140	5.1586
No log	6.0	168	5.1086
No log	7.0	196	5.0692
No log	8.0	224	5.0256
No log	9.0	252	4.9902
No log	10.0	280	4.9818

Framework versions

• Transformers 4.41.0.dev0
• Pytorch 2.2.2+cu118
• Datasets 2.18.0
• Tokenizers 0.19.1