autoevaluator
HF staff
Add verifyToken field to verify evaluation results are produced by Hugging Face's automatic model evaluator
d3fec4e
metadata
language:
- unk
tags:
- autotrain
- summarization
datasets:
- L-macc/autotrain-data-Biomedical_sc_summ
widget:
- text: I love AutoTrain 🤗
co2_eq_emissions:
emissions: 16.211223325053414
model-index:
- name: L-macc/autotrain-Biomedical_sc_summ-1217846142
results:
- task:
type: summarization
name: Summarization
dataset:
name: Blaise-g/SumPubmed
type: Blaise-g/SumPubmed
config: Blaise-g--SumPubmed
split: test
metrics:
- type: rouge
value: 38.2324
name: ROUGE-1
verified: true
verifyToken: >-
eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiMmE3MzBkNWU3MDk2MDkzMmU4MjU4NWJlY2JlM2M5ZDc1OTM5MjYwMzliNmRmNmNmNmUxMmI0ZjBlYTdiNzYyOSIsInZlcnNpb24iOjF9.83j2x0zr1zWHzo7z78kjag1tflSsn1QSLTr0_7viGTP5Y3xyUvvDS0I9OHoDgi15p1XFqBIPvZGW3BsNSbLwDA
- type: rouge
value: 12.2914
name: ROUGE-2
verified: true
verifyToken: >-
eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiYTAzNDUwOGQwZDM3NzYxY2Y2N2JhMmExMzkwYjAxYjU0ZDExZTUyOGMwZWQxMjdlMjE2NGE5OTEyZGE3Yzg3YSIsInZlcnNpb24iOjF9.7EHnTEdmr3cb4Y8HvH4Ti7PQ7xuxbE22LxvqSCVaqi2qnIxyHPq4O3lgPVvDPQpKh5iCVo1bGiHyf_lfH3FyBw
- type: rouge
value: 21.4512
name: ROUGE-L
verified: true
verifyToken: >-
eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiM2YwNzA4NmI3ZGQ3OTM4NDNhMzNiMGUxNzVhMGQxNmFkMmZhNWNlYzE0ODIxY2I4YzI3NjhiYjM3ODQ4ZGRmNCIsInZlcnNpb24iOjF9.RB94ynmrih-C99XVQ1em4QAwh4yte-Ark-z4SkIYHjTItHaoNcVJqkrkGGZS8qhswHiln3w70AqJyqTfRN87AA
- type: rouge
value: 34.3031
name: ROUGE-LSUM
verified: true
verifyToken: >-
eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiN2EwMThiZjFlNDVlMDE3ZTBiNjkyMmJhODJjNjAxNTg0YmMzNWZmMzIzMTVkZjQ4ZTQwYWIwZjQyYTY2MGI4NCIsInZlcnNpb24iOjF9.vnelWOV9LEdTMTwD4i0ttJMNyoprJSzkAxShvQIgk64JcftayHDaKPCam-t6WiVdQiAiKBFmIyz5uBWrxEW4AQ
- type: loss
value: 2.3273825645446777
name: loss
verified: true
verifyToken: >-
eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiM2I2NDI4OTRjZmQyZjU1YzFmZDY0OWMzMzhhODEwODY5NzRkYzJmNTkwYzUwODQzYTA1MDc0NTc3ZTc4YjM5NiIsInZlcnNpb24iOjF9.D932yv7CJVgXIBHhrOu4GmRqUB7TRch61fRe_9Ig9n6iz-MOiJ8DMM5hrWLcebiVyL3bmCrEyYNEyijU5679Dg
- type: gen_len
value: 130.3934
name: gen_len
verified: true
verifyToken: >-
eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiZGExMmIyMDY0ZTU1NWI4NTk1MDZlNmM3MTQ0M2RlZTVhYzUxOThmMjRmMTljNjY5YTc2NmE3MGRlMzljNTQzMSIsInZlcnNpb24iOjF9.R4jCLjKBVuF_48RxZbbZLOLUbw5huauklKQwlc4D-2MRuKHAxsR-7KXpb91vAYKKVrUXNqo4GyLcH5NMjM9pBA
Model Trained Using AutoTrain
- Problem type: Summarization
- Model ID: 1217846142
- CO2 Emissions (in grams): 16.2112
Validation Metrics
- Loss: 2.159
- Rouge1: 40.236
- Rouge2: 12.161
- RougeL: 23.255
- RougeLsum: 35.138
- Gen Len: 121.504
Usage
You can use cURL to access this model:
$ curl -X POST -H "Authorization: Bearer YOUR_HUGGINGFACE_API_KEY" -H "Content-Type: application/json" -d '{"inputs": "I love AutoTrain"}' https://api-inference.huggingface.co/L-macc/autotrain-Biomedical_sc_summ-1217846142