mT5-OrangeSum / README.md
ell-hol's picture
Add evaluation results on the abstract config and validation split of orange_sum (#1)
f3b573f
---
language:
- unk
tags:
- autotrain
- summarization
datasets:
- ell-hol/autotrain-data-test-orangesum
widget:
- text: I love AutoTrain 🤗
co2_eq_emissions:
emissions: 675.7789931017469
model-index:
- name: ell-hol/mT5-OrangeSum
results:
- task:
type: summarization
name: Summarization
dataset:
name: orange_sum
type: orange_sum
config: abstract
split: validation
metrics:
- type: rouge
value: 33.377
name: ROUGE-1
verified: true
verifyToken: eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiMDhjMWIxYmNmNDYzNTMzMDM2YjQyOTdkYjYyMDJkZDhlNzQ2ZDVkNGM2YTIzODU4ZWYwZDg2ODZkN2U5OTk2MSIsInZlcnNpb24iOjF9.UL_nv_GGJ75LMgDmRjvrp0dYhCyjz-h5txS1ljDFS7k9Yy6iJ0QnTebou1tsLFtj7sBSvUKvZeyqFXEHN7SBCg
- type: rouge
value: 14.4472
name: ROUGE-2
verified: true
verifyToken: eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiNTYxZTVkMzFlMGUxMWNmNzc5ZDI0OWM3ODY2ZTc1MDg2MDc2NTRiZjM3OTA4NGI1MmEwNzQzMjQyOWM5NDE3YiIsInZlcnNpb24iOjF9.xsBp4kyHAnAnAWllwvcXNF3vFFbgP_3Ipplg0Cs8yMzY2qIKozlflWSpmm7qyru1RvtDrHH5JQy0hSSz49tMDQ
- type: rouge
value: 24.1902
name: ROUGE-L
verified: true
verifyToken: eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiNzgxMDNmODZiOTcxYmU0NjlkMjEzOTBmZjZhMzkxZDcyODNjYmJjOGNiNzA2MTI2YjU4MTUzZTFlM2EwYjRkNyIsInZlcnNpb24iOjF9.QE9X1gqHxDA_Vzj86nOi1FrYXrvvYR-uQgAKn2ESJp48mnT4rHCnpxVo3qJGXcoeD0vA0M9VDWJzc2pci34PBA
- type: rouge
value: 25.5277
name: ROUGE-LSUM
verified: true
verifyToken: eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiNDk2YzY1NjU3NDgxMDllYjIwMGI5NGE2ZjY3NzcxZGEwNmYzYjQxYzVlZTdmYzdkYWIxM2Y1YjkxNjZhOWRlZiIsInZlcnNpb24iOjF9.ksd-KgRtY71cHJxFsqLWr5lofRSrfiwixGTI6Hek6GvfisssetoDPy17bWnQpUqfN0ozxJciw2VzpauYPDuZCg
- type: loss
value: 1.6347737312316895
name: loss
verified: true
verifyToken: eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiZDNmODJhNzdmMzNkMTc4MDcwZDhmNDFiZjM1ZWVmYjQ4N2IzNWU3MjYwMWM4ZmM0NjFhNjY1OTBlZjBkMjY0YSIsInZlcnNpb24iOjF9.aaF2D-cKnhK4YaqFV23QhoiTCOK7rQJKoXJMMj-kuxe_NLQBLNj73LBou376IlsTmOxxk_mmEimzwMMbTiVSDA
- type: gen_len
value: 48.4967
name: gen_len
verified: true
verifyToken: eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiYzk3YjMxZWY2NzE5ZWMxZjBhYmE5YzU2YTM3MzNmMjlmNmJjM2MyMzY4ZTE1MjI1ZTNkN2YxOWZhOThmYzljMyIsInZlcnNpb24iOjF9._I_I9B66dT3S8RMMmMACG3YjIQYcXzmodriDWM33jRa4X6NFQx0b6_YHNP7K-uLEm8qD31bgb0NlsaRA37qLBA
---
# Model Trained Using AutoTrain
- Problem type: Summarization
- Model ID: 2638979565
- CO2 Emissions (in grams): 675.7790
## Validation Metrics
- Loss: 1.631
- Rouge1: 33.348
- Rouge2: 14.481
- RougeL: 24.210
- RougeLsum: 25.514
- Gen Len: 48.497
## Usage
You can use cURL to access this model:
```
$ curl -X POST -H "Authorization: Bearer YOUR_HUGGINGFACE_API_KEY" -H "Content-Type: application/json" -d '{"inputs": "I love AutoTrain"}' https://api-inference.huggingface.co/ell-hol/autotrain-test-orangesum-2638979565
```