FS-distilroberta-fine-tuned

The model was obtained by fine-tuning "mrm8488/distilroberta-finetuned-financial-news-sentiment-analysis" model for sentiment analysis on financial news gathered by FinScience software. It predicts the sentiment of news with one label ("negative", "neutral" or "positive"). At the moment, the models works only in English.

Training data

The training dataset consists of 2558 titles of news that were manually labelled by FinScience Team using doccano tool. A "neutral" label was assigned to those news for which an agreement was not reached. 70% (1790 news) of such dataset was employed as training set, while 15% (384) as validation set and the remaining 15% as test set. F1-score (macro) was selected as the evaluation metric.

Set	Number of news	Scope
Training	1790	Training the model
Validation	384	Selecting the hyper-parameters
Test	384	Evaluating the performance

Accuracy

The table below summarizes the performance of the models that were tested on the same test set, consisting of 384 held-out titles:

Language	Accuracy	F1-score (macro)
FS-distilroberta-fine-tuned	76%	76%