subtitle-v2 / README.md
autoevaluator's picture
Add evaluation results on the samsum config and test split of samsum
96092e1
metadata
tags:
  - autotrain
  - summarization
language:
  - en
widget:
  - text: I love AutoTrain 🤗
co2_eq_emissions:
  emissions: 4.325625308048844
model-index:
  - name: YtBig/subtitle-v2
    results:
      - task:
          type: summarization
          name: Summarization
        dataset:
          name: samsum
          type: samsum
          config: samsum
          split: test
        metrics:
          - name: ROUGE-1
            type: rouge
            value: 20.8518
            verified: true
          - name: ROUGE-2
            type: rouge
            value: 6.2893
            verified: true
          - name: ROUGE-L
            type: rouge
            value: 18.6895
            verified: true
          - name: ROUGE-LSUM
            type: rouge
            value: 19.3197
            verified: true
          - name: loss
            type: loss
            value: 3.1161859035491943
            verified: true
          - name: gen_len
            type: gen_len
            value: 14.9915
            verified: true

Model Trained Using AutoTrain

  • Problem type: Summarization
  • Model ID: 2343773834
  • CO2 Emissions (in grams): 4.3256

Validation Metrics

  • Loss: 2.080
  • Rouge1: 41.882
  • Rouge2: 18.838
  • RougeL: 39.859
  • RougeLsum: 39.919
  • Gen Len: 14.611

Usage

You can use cURL to access this model:

$ curl -X POST -H "Authorization: Bearer YOUR_HUGGINGFACE_API_KEY" -H "Content-Type: application/json" -d '{"inputs": "I love AutoTrain"}' https://api-inference.huggingface.co/Alfred-o/autotrain-title-2343773834