Edit model card
YAML Metadata Error: "base_model" is not allowed to be empty

wav2GPT2MusiSD3200

This model is a fine-tuned version of on an unknown dataset. It achieves the following results on the evaluation set:

  • Loss: 0.8962
  • Rouge1: 28.7212
  • Rouge2: 7.4616
  • Rougel: 21.8892
  • Rougelsum: 21.8832
  • Gen Len: 46.0

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

  • learning_rate: 1e-06
  • train_batch_size: 4
  • eval_batch_size: 4
  • seed: 42
  • optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
  • lr_scheduler_type: linear
  • num_epochs: 20

Training results

Training Loss Epoch Step Validation Loss Rouge1 Rouge2 Rougel Rougelsum Gen Len
1.0361 1.0 1361 0.9081 28.7212 7.4616 21.8892 21.8832 46.0
1.0015 2.0 2722 0.9021 28.1788 7.304 21.4695 21.4607 50.0
1.0003 3.0 4083 0.8976 27.7311 6.574 21.4759 21.4402 57.0
0.9761 4.0 5444 0.8914 27.7311 6.574 21.4759 21.4402 57.0
0.9928 5.0 6805 0.8884 27.7311 6.574 21.4759 21.4402 57.0
1.013 6.0 8166 0.8858 27.7311 6.574 21.4759 21.4402 57.0
1.0476 7.0 9527 0.8852 27.7311 6.574 21.4759 21.4402 57.0
1.0649 8.0 10888 0.8847 27.7311 6.574 21.4759 21.4402 57.0
1.1224 9.0 12249 0.8888 29.7298 7.2318 22.3598 22.3739 56.0
1.1818 10.0 13610 0.8949 29.7298 7.2318 22.3598 22.3739 56.0
1.1832 11.0 14971 0.8981 30.1982 7.2766 22.0853 22.118 59.0
1.1878 12.0 16332 0.8987 29.7298 7.2318 22.3598 22.3739 56.0
1.1833 13.0 17693 0.8983 29.7298 7.2318 22.3598 22.3739 56.0
1.1772 14.0 19054 0.8980 29.7298 7.2318 22.3598 22.3739 56.0
1.1723 15.0 20415 0.8974 28.7212 7.4616 21.8892 21.8832 46.0
1.1778 16.0 21776 0.8972 28.7212 7.4616 21.8892 21.8832 46.0
1.1707 17.0 23137 0.8968 28.7212 7.4616 21.8892 21.8832 46.0
1.1767 18.0 24498 0.8964 28.7212 7.4616 21.8892 21.8832 46.0
1.17 19.0 25859 0.8962 28.7212 7.4616 21.8892 21.8832 46.0
1.1737 20.0 27220 0.8962 28.7212 7.4616 21.8892 21.8832 46.0

Framework versions

  • Transformers 4.31.0
  • Pytorch 2.0.1+cu117
  • Datasets 2.14.2
  • Tokenizers 0.13.3
Downloads last month
2