egilron's picture
Update README.md
e6dd339 verified
metadata
language:
  - 'no'
  - nb
  - nn
license: cc-by-4.0
datasets:
  - ltg/norec_sentence
pipeline_tag: text-classification

Sentence-level Sentiment Analysis model for Norwegian text

This model is a fine-tuned version of ltg/norbert3-base for text classification.

Training data

The dataset used for fine-tuning is ltg/norec_sentence, the mixed subset with four sentement categories:

[0]:  Negative,  
[1]:  Positive,  
[2]:  Neutral
[0,1]: Mixed  

Quick start

You can use this model for inference as follows:

>>> from transformers import pipeline
>>> origin = "ltg/norbert3-base_sentence-sentiment"
>>> pipe = transformers.pipeline( "text-classification",
...                             model = origin,
...                             trust_remote_code=origin.startswith("ltg/norbert3"),
...                             config= origin,
...                             tokenizer = AutoTokenizer.from_pretrained(origin)
...             )
>>> preds = pipe(["Hans hese, litt såre stemme kler bluesen, men denne platen kommer neppe til å bli blant hans største kommersielle suksesser.",
...              "Borten-regjeringen gjorde ikke jobben sin." ])
>>> for p in preds:
...     print(p)

Output:

The model 'NorbertForSequenceClassification' is not supported for text-classification. Supported models are ['AlbertForSequenceClassification', ...
{'label': 'Mixed', 'score': 0.9230353236198425}
{'label': 'Negative', 'score': 0.7348112463951111}

Training hyperparameters

  • per_device_train_batch_size: 16
  • learning_rate: 1e-05
  • gradient_accumulation_steps: 1
  • num_train_epochs: 10 (best epoch 5)

Evaluation

Category F1
Negative_F1 0.580247
Positive_F1 0.781699
Neutral_F1 0.825197
Mixed_F1 0.648649
Weighted_avg_F1 0.763806