Binary toxicity classifier for Ukrainian.
This is the fine-tuned on the downstream task "Geotrend/distilbert-base-uk-cased" instance.
The evaluation metrics for binary toxicity classification are:
Precision: 0.9242 Recall: 0.9225 F1: 0.9224
The training and evaluation data will be clarified later.
How to use
from transformers import AutoTokenizer, AutoModelForSequenceClassification
# load tokenizer and model weights
tokenizer = AutoTokenizer.from_pretrained('dardem/distilbert-base-uk-cased-toxicity')
model = AutoModelForSequenceClassification.from_pretrained('dardem/distilbert-base-uk-cased-toxicity')
# prepare the input
batch = tokenizer.encode('Ти неймовірна!', return_tensors='pt')
# inference
model(batch)
- Downloads last month
- 39