mika5883
/

continue_grammar_model_wmt460

text2text-generation

Generated from Trainer

text-generation-inference

Model card Files Files and versions

Metrics Training metrics Community

continue_grammar_model_wmt460

This model is a fine-tuned version of mika5883/grammar_model_wmt460 on the None dataset. It achieves the following results on the evaluation set:

Loss: 0.3223
Bleu: 57.4683
Gen Len: 16.2348

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

learning_rate: 2e-05
train_batch_size: 64
eval_batch_size: 64
seed: 42
optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
lr_scheduler_type: linear
num_epochs: 2
mixed_precision_training: Native AMP

Training results

Training Loss	Epoch	Step	Validation Loss	Bleu	Gen Len
0.4944	1.0	983	0.3219	57.5404	16.2288
0.4715	2.0	1966	0.3223	57.4683	16.2348

Framework versions

Transformers 4.38.2
Pytorch 2.2.1+cu121
Datasets 2.18.0
Tokenizers 0.15.2

Downloads last month: 10

Safetensors

Model size

0.2B params

Tensor type

F32

·

Inference Providers NEW

This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for mika5883/continue_grammar_model_wmt460

Base model

mika5883/grammar_model_wmt460

Finetuned

(1)

this model