Fine-tuned XLM-R Model for slovak Sentiment Analysis
This is a fine-tuned XLM-R model for sentiment analysis in slovak.
Model Details
- Model Name: XLM-R Sentiment Analysis
- Language: slovak
- Fine-tuning Dataset: DGurgurov/slovak_sa
Training Details
- Epochs: 20
- Batch Size: 32 (train), 64 (eval)
- Optimizer: AdamW
- Learning Rate: 5e-5
Performance Metrics
- Accuracy: 0.96833
- Macro F1: 0.93172
- Micro F1: 0.96833
Usage
To use this model, you can load it with the Hugging Face Transformers library:
from transformers import AutoTokenizer, AutoModelForSequenceClassification
tokenizer = AutoTokenizer.from_pretrained("DGurgurov/xlm-r_slovak_sentiment")
model = AutoModelForSequenceClassification.from_pretrained("DGurgurov/xlm-r_slovak_sentiment")
License
[MIT]