metadata

license: apache-2.0
tags:
  - summarization
  - generated_from_trainer
metrics:
  - rouge
model-index:
  - name: mt5-small-finetuned-amazon-en-es
    results:
      - task:
          type: summarization
          name: Summarization
        dataset:
          name: samsum
          type: samsum
          config: samsum
          split: test
        metrics:
          - type: rouge
            value: 10.9114
            name: ROUGE-1
            verified: true
            verifyToken: >-
              eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiMTJiNDY3NjBkMjA3NjE4NDllMzBiMzk1NDE2NTVkN2MxMTM0YzcxMmNiZjNiNTg5NzYxZTY5NjZlMmU4MjUzZCIsInZlcnNpb24iOjF9.m0wl_e5-0WpgVVRGW6Pn01BXSFhoq_BdT1dkRkPNVAVKmllkxPrYqPw_-LoaC2X91D2eEoS2_MA0DPlq4uBNBQ
          - type: rouge
            value: 2.7145
            name: ROUGE-2
            verified: true
            verifyToken: >-
              eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiNDNmYTkwMWIxYWQ2YWYzYzZkNGIyNGJlYzBjZThlNmMxZDBmNzM2ZGYxN2JmNGY3MzA1OGE5MzhlN2ZiNDFjMSIsInZlcnNpb24iOjF9.NgeyPvT5d2VV5PhRsp8DTrSTiE5uE491qFeZUw-U_QQeM43gyIsnRvH59Bk_wW_onij8pWs7IVAEe_NIXDE3Ag
          - type: rouge
            value: 9.8141
            name: ROUGE-L
            verified: true
            verifyToken: >-
              eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiYTEyNDllNTllYzY5MjRkODEyZmVhNTNkYjM1MTJiNDBkMjk5MmE2OTU5OTYxNzlkMDI1ZWNkNjhkNDQ3YjBkMSIsInZlcnNpb24iOjF9.SIwjU5NprN_4-XBjgYGmK-mJhOnDRfAXWVVKaCo34uBdFwnNm_-0MnWGAGK_J8XyCle-D7j-57OUbP4Z0_B8AQ
          - type: rouge
            value: 10.311
            name: ROUGE-LSUM
            verified: true
            verifyToken: >-
              eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiN2FmZDc0YzJlMTgxOWQ0N2QzNjhiZDE5ZjlmZTZkMzI1MWM1YzJjMmU5M2FhMTY3NTJjOTliNzk3YjYwNGM4OCIsInZlcnNpb24iOjF9.OLOGV0P2tJxEC2WZRgAI64JKX8U25yqCix2chZrTrwWh4-4HD_mLzyBMVCsOqjh6HUr7_f5zqYz_mL4c7CvdAA
          - type: loss
            value: 3.8683078289031982
            name: loss
            verified: true
            verifyToken: >-
              eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiNjQ2ZjI1ZGZiYzJmNDc3N2Y4NTA4Zjg4MWQwOWUwOTAzMmNmYjZlYmE5Mjk5YzVmMDY1NWNkYjI0NjcxMjUyMSIsInZlcnNpb24iOjF9.9gkRA3y-1gTZGt83GKlCQhMWyJJd3QFNZvy9SHcX94zQkVzv2rVk5Ncg3X5VHwocnTTRDuTPRK2lLPHXYqshAw
          - type: gen_len
            value: 9.707
            name: gen_len
            verified: true
            verifyToken: >-
              eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiZDg4YWNiYzc2NzZkMDZlZTVhMjc5MDI3YWZhZThkMjYzYzFhNzVkMDU0MTkyNTdhNGQ3YWRhM2U4YzE4YWJmZiIsInZlcnNpb24iOjF9.wk6mLGPFzeZMeYZP4T_DbnPLsj9cqGYwr2fSDxpiuF7fUdfhx7BsmNC_ycfjnINZotNA2ivjszk7zsrAAQIjCg

mt5-small-finetuned-amazon-en-es

This model is a fine-tuned version of google/mt5-small on the None dataset. It achieves the following results on the evaluation set:

Loss: 3.0294
Rouge1: 16.6807
Rouge2: 8.0004
Rougel: 16.2251
Rougelsum: 16.1743

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

learning_rate: 5.6e-05
train_batch_size: 8
eval_batch_size: 8
seed: 42
optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
lr_scheduler_type: linear
num_epochs: 8

Training results

Training Loss	Epoch	Step	Validation Loss	Rouge1	Rouge2	Rougel	Rougelsum
6.5928	1.0	1209	3.3005	14.7863	6.5038	14.3031	14.2522
3.9024	2.0	2418	3.1399	16.9257	8.6583	16.15	16.1299
3.5806	3.0	3627	3.0869	18.2734	9.1667	17.7441	17.5782
3.4201	4.0	4836	3.0590	17.763	8.9447	17.1833	17.1661
3.3202	5.0	6045	3.0598	17.7754	8.5695	17.4139	17.2653
3.2436	6.0	7254	3.0409	16.8423	8.1593	16.5392	16.4297
3.2079	7.0	8463	3.0332	16.8991	8.1574	16.4229	16.3515
3.1801	8.0	9672	3.0294	16.6807	8.0004	16.2251	16.1743

Framework versions

Transformers 4.22.1
Pytorch 1.12.1+cu113
Datasets 2.5.1
Tokenizers 0.12.1