autoevaluator HF staff commited on
Commit
8ab5e92
1 Parent(s): 5e1a0e2

Add evaluation results on the mlqa config and test.ar split of xglue

Browse files

Beep boop, I am a bot from Hugging Face's automatic model evaluator 👋!\
Your model has been evaluated on the mlqa config and test.ar split of the [xglue](https://huggingface.co/datasets/xglue) dataset by

@Anwaarma

, using the predictions stored [here](https://huggingface.co/datasets/autoevaluate/autoeval-eval-xglue-mlqa-02a2ef-48376145243).\
Accept this pull request to see the results displayed on the [Hub leaderboard](https://huggingface.co/spaces/autoevaluate/leaderboards?dataset=xglue).\
Evaluate your model on more datasets [here](https://huggingface.co/spaces/autoevaluate/model-evaluator?dataset=xglue).

Files changed (1) hide show
  1. README.md +44 -2
README.md CHANGED
@@ -1,10 +1,52 @@
1
  ---
2
  language: en
3
  license: apache-2.0
4
- datasets:
5
- - xsum
6
  tags:
7
  - summarization
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
8
  ---
9
 
10
  # Roberta2Roberta_L-24_bbc EncoderDecoder model
 
1
  ---
2
  language: en
3
  license: apache-2.0
 
 
4
  tags:
5
  - summarization
6
+ datasets:
7
+ - xsum
8
+ model-index:
9
+ - name: google/roberta2roberta_L-24_bbc
10
+ results:
11
+ - task:
12
+ type: summarization
13
+ name: Summarization
14
+ dataset:
15
+ name: xglue
16
+ type: xglue
17
+ config: mlqa
18
+ split: test.ar
19
+ metrics:
20
+ - type: rouge
21
+ value: 0.0213
22
+ name: ROUGE-1
23
+ verified: true
24
+ verifyToken: eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiYjRhNmFhMDhmNTllNWM3ZjFlMTNjZDcxNDU1ZmU5YmRhZjczNTQwMjQ4MDQzMDY5NGNhZDhkM2EzM2NiODg1MyIsInZlcnNpb24iOjF9.-BNXeOa4KVK5T7kX1oDGpFWE1fiPV0HSafnwbm5cnaxM8c1BnZmfLu8uvRPCgiurWjgSQihk4og4hkcfdvffBQ
25
+ - type: rouge
26
+ value: 0.0019
27
+ name: ROUGE-2
28
+ verified: true
29
+ verifyToken: eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiZTQ0OTBmNDc1NjkxMGM3ODJlMDY1YjJlYTQyNzFhZGYyNzA1NTIyYjkwYWUxNzk0MDc5NjU0NTc1ZDU3YTY0MyIsInZlcnNpb24iOjF9.x0cqOoYSUIMjJnWTF2p9rntIRYJQGbGhm_K_UbkDKiIX9eYmRr9jO7pXHx_35TZVDbkYjG39PZMTwxXxu_I-CQ
30
+ - type: rouge
31
+ value: 0.0201
32
+ name: ROUGE-L
33
+ verified: true
34
+ verifyToken: eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiYjExOTEwZjA5ODQwNWRjMWQ0MGFmYzJiYjdlYmU4YjA0NGZlYTBmY2VkOTQ3YTFkOTUyZjdiOTg0N2E0YmQ3ZCIsInZlcnNpb24iOjF9.C1j9T_WQrGeHmJLDBDXMlLHxPjzb0kaAp7MdNuDno4tehA-WV8QMOEwQTaJc7QtRveeH1wrrsYgKxZ4P-6NEAA
35
+ - type: rouge
36
+ value: 0.0196
37
+ name: ROUGE-LSUM
38
+ verified: true
39
+ verifyToken: eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiZGFiOTVjNTEzNDBlMGIxNTc2MTZhN2I2MjUzN2U1ZGM3ZDVkYjhmNTdjZjA2OGUxZjlkYjY3YjhjODAwMzYwZCIsInZlcnNpb24iOjF9.mUtFHxPvgbB9CPonENnm_lynnps3Z2q5ncKBf0ZkzVc1E28cNN37OE_aUhLTqvdcZ2hwUqS4zHJlndZv1PONAg
40
+ - type: loss
41
+ value: 6.101626396179199
42
+ name: loss
43
+ verified: true
44
+ verifyToken: eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiMmI4M2UxZTE1ZmM4NzhkZjI4NDk1MzUwOGVjNjZlZThkMmVkOGM4YzU3MjRiOTZkMjFjZTU5YTJhNWJhNzJmNSIsInZlcnNpb24iOjF9.M8qQtenTtqRVTBHt23uY1XqRL3hGNJv4JgXeJlHV0xWnc8xp8b2b_ycvOh7FwZzcW2gPUVJmU8hpqozHTUkXDQ
45
+ - type: gen_len
46
+ value: 42.5961
47
+ name: gen_len
48
+ verified: true
49
+ verifyToken: eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiODExYmMxZDQ3ZWM0Yzc5ZjgxZmI0ZjQ3MGNlMDEwNmNhZDVkMjZmYTU1MzBjZWQ4YWM0MjRhYjM3NDZlMTI0MCIsInZlcnNpb24iOjF9.U2blxgJeU7XDoP8sU4AInQmewyVhgnJ0qPQXGCx5d-cqSsx0WveMpgx93Yxedb_r7mbrVigOwIpZm03M_Y6oBg
50
  ---
51
 
52
  # Roberta2Roberta_L-24_bbc EncoderDecoder model