metadata

license: apache-2.0
tags:
  - summarization
  - generated_from_trainer
metrics:
  - rouge
model-index:
  - name: mt5-small-finetuned-amazon-en-es
    results:
      - task:
          type: summarization
          name: Summarization
        dataset:
          name: cnn_dailymail
          type: cnn_dailymail
          config: 3.0.0
          split: test
        metrics:
          - type: rouge
            value: 5.5685
            name: ROUGE-1
            verified: true
            verifyToken: >-
              eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiZjQ4YjcwMTZkNDA1MmQ0ZWY0NTE2NTUzZTI1MTkzM2YxODBkMzNiOWJmZmZmNDVmOGZmNWFjOGRjZTFlMzY3NyIsInZlcnNpb24iOjF9.L3yxDP4Q_E0Sxdx_nHP-OUkHGtNdVR2snnHAoW1njbMOEd-mtTpSEodAfwjhc4A55Ggc8FNi_Bekch_7nxPrAg
          - type: rouge
            value: 1.5241
            name: ROUGE-2
            verified: true
            verifyToken: >-
              eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiYjY2YTc5ZDUwYTZhOWRiYzc3ZGFlMDIxZjI3ZmY1ZTJjMmVhMTFiNDk5MzBmM2I5MmE2YTZkMDU3ODUxOTIyZCIsInZlcnNpb24iOjF9.clixb6udwag8FRmr2sYHgHYgc20xHPTS9Y_dfVd9FdeWCUC73_VJGqJ2u0lK0OP1jkmjYf976k1PAe2VWotWBw
          - type: rouge
            value: 4.6568
            name: ROUGE-L
            verified: true
            verifyToken: >-
              eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiYjRhYmMwZjQ2NjU2NWEwZmMzNTY0MmY4MzQ3NGQ5YjA4YWVlYTQ4YzQ3Y2Q2ZDNjNzkxNWU5ZjJhNzYwNjNjNyIsInZlcnNpb24iOjF9.KV8ySJDe2Wv4lgdx-dHYhcTCn6hPKpi88VMjqhZY06cJIB7KfCm66ufT_a1sww7V_XzOIZ5RLCs1SMpMO1n6CA
          - type: rouge
            value: 5.2235
            name: ROUGE-LSUM
            verified: true
            verifyToken: >-
              eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiNDlmZmQ2ZjgxYzVkNzkyYmIxMmE2M2FhZDZkYzQ4NTcxMzIwMDY0MTFjZWVmYWU2MWU0NGRhNTVkZDMwNGQyMSIsInZlcnNpb24iOjF9.Fp_fOpucr_Lz3Rh81w2bQy4uGIPb8XQmKW9PUPUluutdBU_LRvhQ-gWfsRwDWfuxSrJ1zw_c4jgKz3dDSw9eAQ
          - type: loss
            value: 3.6021058559417725
            name: loss
            verified: true
            verifyToken: >-
              eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiNDM0MjUxNDdkMWE2ZTNlZDU0Mjg3NDI1ZDk5ODcxOTgwZjRlOTE0MzQxMjY2MGNlNDhhZWY4YzA2ZDg1Njk3ZiIsInZlcnNpb24iOjF9.e-We68CIcHa6YiAzoZH4QzJDO6UiXFZ_3vR1_1Du7gLK14N_OmPM_oDuy9bd2j5OnFIdPqucmIUlsVIk4vPQDg
          - type: gen_len
            value: 9.3862
            name: gen_len
            verified: true
            verifyToken: >-
              eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiYjk1MTlhYWFkYjRhOGJkODQ4Mzk5MDY2ZjI4ODgwZDY2YWM1MTk4N2UwZTljOWU0ZmUyNjFiNTA4ZTQ3YmNmMiIsInZlcnNpb24iOjF9.0E0yYGq-0DtIgX0Zhnuj8TLHJBiK7WgBrwkoiFukpfUGTqaJtxk4wGECIIWhAuo4hfmz-F9Sk5_TUtDeKvHLCQ

mt5-small-finetuned-amazon-en-es

This model is a fine-tuned version of google/mt5-small on the None dataset. It achieves the following results on the evaluation set:

Loss: 3.0294
Rouge1: 16.6807
Rouge2: 8.0004
Rougel: 16.2251
Rougelsum: 16.1743

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

learning_rate: 5.6e-05
train_batch_size: 8
eval_batch_size: 8
seed: 42
optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
lr_scheduler_type: linear
num_epochs: 8

Training results

Training Loss	Epoch	Step	Validation Loss	Rouge1	Rouge2	Rougel	Rougelsum
6.5928	1.0	1209	3.3005	14.7863	6.5038	14.3031	14.2522
3.9024	2.0	2418	3.1399	16.9257	8.6583	16.15	16.1299
3.5806	3.0	3627	3.0869	18.2734	9.1667	17.7441	17.5782
3.4201	4.0	4836	3.0590	17.763	8.9447	17.1833	17.1661
3.3202	5.0	6045	3.0598	17.7754	8.5695	17.4139	17.2653
3.2436	6.0	7254	3.0409	16.8423	8.1593	16.5392	16.4297
3.2079	7.0	8463	3.0332	16.8991	8.1574	16.4229	16.3515
3.1801	8.0	9672	3.0294	16.6807	8.0004	16.2251	16.1743

Framework versions

Transformers 4.22.1
Pytorch 1.12.1+cu113
Datasets 2.5.1
Tokenizers 0.12.1