rttl's picture
Update README.md
18461c1
metadata
license: apache-2.0
language:
  - en
model-index:
  - name: rttl-ai/SentyBert
    results:
      - task:
          type: task-classification
          name: Text Classification
        dataset:
          type: sst2
          name: sst2
          config: default
          split: validation
        metrics:
          - type: f1
            value: 0.9992
            name: F1 Macro
          - type: accuracy
            value: 0.9992
            name: Accuracy
datasets:
  - sst2
  - sst

rttl-ai/SentyBert

Model Details

Model Description: This model is a fine-tune checkpoint of bert-large-uncased, fine-tuned on SST-2. This model reaches an accuracy of 99.92 on the dev set.

  • Developed by: rttl-ai
  • Model Type: Text Classification
  • Language(s): English
  • License: Apache-2.0
  • Resources for more information:
  • The model was pre-trained with task-adaptive pre-training TAPT with an increased masking rate, no corruption strategy, and using WWM, following this paper
    • fine-tuned on sst with subtrees
    • fine-tuned on sst2